Jul 22 16:20:44.575230 ip-10-0-133-47 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 22 16:20:44.575239 ip-10-0-133-47 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 22 16:20:44.575246 ip-10-0-133-47 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 22 16:20:44.575463 ip-10-0-133-47 systemd[1]: Failed to start Kubernetes Kubelet. Jul 22 16:20:56.105331 ip-10-0-133-47 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 22 16:20:56.105346 ip-10-0-133-47 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 3a29a0394948452d9fec33f9407b5bb6 -- Jul 22 16:22:27.766671 ip-10-0-133-47 systemd[1]: Starting Kubernetes Kubelet... Jul 22 16:22:28.207492 ip-10-0-133-47 kubenswrapper[2568]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 22 16:22:28.207492 ip-10-0-133-47 kubenswrapper[2568]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 22 16:22:28.207492 ip-10-0-133-47 kubenswrapper[2568]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 22 16:22:28.207492 ip-10-0-133-47 kubenswrapper[2568]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 22 16:22:28.207492 ip-10-0-133-47 kubenswrapper[2568]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 22 16:22:28.210232 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.210142 2568 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 22 16:22:28.217775 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.217755 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 22 16:22:28.217775 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.217773 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 22 16:22:28.217775 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.217776 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 22 16:22:28.217775 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.217780 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 22 16:22:28.217898 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.217783 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 22 16:22:28.217898 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.217786 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 22 16:22:28.217898 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.217789 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 22 16:22:28.217898 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.217792 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 22 16:22:28.217898 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.217796 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 22 16:22:28.217898 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.217800 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 22 16:22:28.217898 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.217803 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 22 16:22:28.217898 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.217805 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 22 16:22:28.217898 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.217808 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 22 16:22:28.217898 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.217810 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 22 16:22:28.217898 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.217814 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 22 16:22:28.217898 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.217817 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 22 16:22:28.217898 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.217819 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 22 16:22:28.217898 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.217823 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 22 16:22:28.217898 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.217827 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 22 16:22:28.217898 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.217830 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 22 16:22:28.217898 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.217833 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 22 16:22:28.217898 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.217835 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 22 16:22:28.217898 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.217838 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 22 16:22:28.217898 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.217840 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 22 16:22:28.218430 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.217843 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 22 16:22:28.218430 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.217846 2568 feature_gate.go:328] unrecognized feature gate: Example Jul 22 16:22:28.218430 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.217848 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 22 16:22:28.218430 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.217851 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 22 16:22:28.218430 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.217854 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 22 16:22:28.218430 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.217856 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 22 16:22:28.218430 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.217860 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 22 16:22:28.218430 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.217863 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 22 16:22:28.218430 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.217866 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 22 16:22:28.218430 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.217869 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 22 16:22:28.218430 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.217872 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 22 16:22:28.218430 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.217875 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 22 16:22:28.218430 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.217878 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 22 16:22:28.218430 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.217881 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 22 16:22:28.218430 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.217884 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 22 16:22:28.218430 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.217888 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 22 16:22:28.218430 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.217891 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 22 16:22:28.218430 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.217894 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 22 16:22:28.218430 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.217896 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 22 16:22:28.218888 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.217899 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 22 16:22:28.218888 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.217903 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 22 16:22:28.218888 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.217906 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 22 16:22:28.218888 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.217909 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 22 16:22:28.218888 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.217912 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 22 16:22:28.218888 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.217915 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 22 16:22:28.218888 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.217918 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 22 16:22:28.218888 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.217920 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 22 16:22:28.218888 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.217923 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 22 16:22:28.218888 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.217926 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 22 16:22:28.218888 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.217928 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 22 16:22:28.218888 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.217931 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 22 16:22:28.218888 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.217934 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 22 16:22:28.218888 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.217936 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 22 16:22:28.218888 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.217939 2568 feature_gate.go:328] unrecognized feature gate: Example2 Jul 22 16:22:28.218888 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.217941 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 22 16:22:28.218888 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.217944 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 22 16:22:28.218888 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.217947 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 22 16:22:28.218888 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.217949 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 22 16:22:28.218888 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.217952 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 22 16:22:28.219378 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.217954 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 22 16:22:28.219378 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.217957 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 22 16:22:28.219378 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.217959 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 22 16:22:28.219378 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.217962 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 22 16:22:28.219378 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.217971 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 22 16:22:28.219378 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.217974 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 22 16:22:28.219378 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.217978 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 22 16:22:28.219378 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.217981 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 22 16:22:28.219378 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.217985 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 22 16:22:28.219378 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.217988 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 22 16:22:28.219378 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.217990 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 22 16:22:28.219378 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.217993 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 22 16:22:28.219378 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.217996 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 22 16:22:28.219378 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.217998 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 22 16:22:28.219378 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.218001 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 22 16:22:28.219378 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.218004 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 22 16:22:28.219378 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.218007 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 22 16:22:28.219378 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.218010 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 22 16:22:28.219378 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.218012 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 22 16:22:28.219378 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.218015 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 22 16:22:28.219863 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.218017 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 22 16:22:28.219863 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.218020 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 22 16:22:28.219863 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.218022 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 22 16:22:28.219863 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.218025 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 22 16:22:28.219863 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.218027 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 22 16:22:28.219863 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.218030 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 22 16:22:28.219863 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.218032 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 22 16:22:28.219863 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.218035 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 22 16:22:28.219863 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.218037 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 22 16:22:28.219863 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.218040 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 22 16:22:28.219863 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.218042 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 22 16:22:28.219863 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.218045 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 22 16:22:28.219863 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.218047 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 22 16:22:28.219863 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.218050 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 22 16:22:28.219863 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.218053 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 22 16:22:28.219863 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.218055 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 22 16:22:28.219863 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.218778 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 22 16:22:28.219863 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.218784 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 22 16:22:28.219863 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.218788 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 22 16:22:28.219863 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.218791 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 22 16:22:28.220342 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.218794 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 22 16:22:28.220342 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.218798 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 22 16:22:28.220342 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.218800 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 22 16:22:28.220342 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.218803 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 22 16:22:28.220342 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.218805 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 22 16:22:28.220342 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.218808 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 22 16:22:28.220342 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.218811 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 22 16:22:28.220342 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.218815 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 22 16:22:28.220342 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.218819 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 22 16:22:28.220342 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.218822 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 22 16:22:28.220342 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.218825 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 22 16:22:28.220342 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.218828 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 22 16:22:28.220342 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.218831 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 22 16:22:28.220342 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.218834 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 22 16:22:28.220342 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.218836 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 22 16:22:28.220342 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.218839 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 22 16:22:28.220342 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.218841 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 22 16:22:28.220342 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.218844 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 22 16:22:28.220342 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.218846 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 22 16:22:28.220868 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.218849 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 22 16:22:28.220868 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.218851 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 22 16:22:28.220868 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.218854 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 22 16:22:28.220868 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.218857 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 22 16:22:28.220868 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.218859 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 22 16:22:28.220868 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.218861 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 22 16:22:28.220868 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.218864 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 22 16:22:28.220868 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.218866 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 22 16:22:28.220868 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.218869 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 22 16:22:28.220868 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.218871 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 22 16:22:28.220868 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.218874 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 22 16:22:28.220868 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.218878 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 22 16:22:28.220868 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.218880 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 22 16:22:28.220868 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.218883 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 22 16:22:28.220868 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.218885 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 22 16:22:28.220868 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.218892 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 22 16:22:28.220868 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.218895 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 22 16:22:28.220868 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.218898 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 22 16:22:28.220868 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.218901 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 22 16:22:28.220868 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.218904 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 22 16:22:28.221369 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.218907 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 22 16:22:28.221369 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.218909 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 22 16:22:28.221369 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.218914 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 22 16:22:28.221369 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.218917 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 22 16:22:28.221369 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.218920 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 22 16:22:28.221369 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.218923 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 22 16:22:28.221369 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.218926 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 22 16:22:28.221369 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.218930 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 22 16:22:28.221369 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.218933 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 22 16:22:28.221369 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.218936 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 22 16:22:28.221369 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.218939 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 22 16:22:28.221369 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.218941 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 22 16:22:28.221369 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.218944 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 22 16:22:28.221369 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.218947 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 22 16:22:28.221369 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.218949 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 22 16:22:28.221369 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.218952 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 22 16:22:28.221369 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.218955 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 22 16:22:28.221369 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.218957 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 22 16:22:28.221369 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.218960 2568 feature_gate.go:328] unrecognized feature gate: Example2 Jul 22 16:22:28.221369 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.218963 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 22 16:22:28.221847 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.218965 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 22 16:22:28.221847 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.218967 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 22 16:22:28.221847 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.218970 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 22 16:22:28.221847 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.218973 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 22 16:22:28.221847 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.218975 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 22 16:22:28.221847 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.218978 2568 feature_gate.go:328] unrecognized feature gate: Example Jul 22 16:22:28.221847 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.218980 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 22 16:22:28.221847 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.218983 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 22 16:22:28.221847 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.218986 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 22 16:22:28.221847 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.218988 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 22 16:22:28.221847 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.218991 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 22 16:22:28.221847 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.218994 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 22 16:22:28.221847 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.218996 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 22 16:22:28.221847 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.218999 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 22 16:22:28.221847 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.219001 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 22 16:22:28.221847 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.219004 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 22 16:22:28.221847 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.219006 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 22 16:22:28.221847 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.219008 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 22 16:22:28.221847 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.219011 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 22 16:22:28.221847 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.219014 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 22 16:22:28.222332 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.219016 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 22 16:22:28.222332 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.219019 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 22 16:22:28.222332 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.219021 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 22 16:22:28.222332 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.219024 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 22 16:22:28.222332 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.219026 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 22 16:22:28.222332 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.219031 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 22 16:22:28.222332 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.219034 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 22 16:22:28.222332 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.219036 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 22 16:22:28.222332 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.219039 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 22 16:22:28.222332 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.219042 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 22 16:22:28.222332 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.219044 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 22 16:22:28.222332 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.219047 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 22 16:22:28.222332 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.219049 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 22 16:22:28.222332 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.219052 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 22 16:22:28.222332 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.219055 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 22 16:22:28.222332 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.219057 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 22 16:22:28.222332 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.219461 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 22 16:22:28.222332 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.219467 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 22 16:22:28.222332 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.219470 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 22 16:22:28.222808 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.219472 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 22 16:22:28.222808 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.219476 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 22 16:22:28.222808 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.219479 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 22 16:22:28.222808 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.219482 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 22 16:22:28.222808 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.219485 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 22 16:22:28.222808 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.219487 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 22 16:22:28.222808 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.219490 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 22 16:22:28.222808 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.219493 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 22 16:22:28.222808 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.219495 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 22 16:22:28.222808 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.219498 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 22 16:22:28.222808 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.219501 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 22 16:22:28.222808 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.219504 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 22 16:22:28.222808 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.219507 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 22 16:22:28.222808 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.219509 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 22 16:22:28.222808 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.219512 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 22 16:22:28.222808 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.219515 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 22 16:22:28.222808 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.219517 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 22 16:22:28.222808 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.219520 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 22 16:22:28.222808 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.219523 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 22 16:22:28.222808 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.219525 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 22 16:22:28.223294 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.219528 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 22 16:22:28.223294 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.219530 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 22 16:22:28.223294 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.219533 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 22 16:22:28.223294 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.219535 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 22 16:22:28.223294 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.219538 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 22 16:22:28.223294 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.219540 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 22 16:22:28.223294 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.219543 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 22 16:22:28.223294 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.219545 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 22 16:22:28.223294 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.219548 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 22 16:22:28.223294 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.219550 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 22 16:22:28.223294 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.219553 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 22 16:22:28.223294 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.219556 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 22 16:22:28.223294 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.219559 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 22 16:22:28.223294 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.219561 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 22 16:22:28.223294 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.219565 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 22 16:22:28.223294 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.219567 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 22 16:22:28.223294 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.219570 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 22 16:22:28.223294 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.219573 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 22 16:22:28.223294 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.219575 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 22 16:22:28.223766 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.219579 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 22 16:22:28.223766 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.219583 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 22 16:22:28.223766 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.219586 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 22 16:22:28.223766 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.219589 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 22 16:22:28.223766 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.219591 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 22 16:22:28.223766 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.219595 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 22 16:22:28.223766 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.219598 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 22 16:22:28.223766 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.219601 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 22 16:22:28.223766 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.219603 2568 feature_gate.go:328] unrecognized feature gate: Example Jul 22 16:22:28.223766 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.219606 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 22 16:22:28.223766 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.219608 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 22 16:22:28.223766 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.219611 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 22 16:22:28.223766 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.219613 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 22 16:22:28.223766 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.219618 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 22 16:22:28.223766 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.219621 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 22 16:22:28.223766 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.219623 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 22 16:22:28.223766 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.219626 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 22 16:22:28.223766 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.219629 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 22 16:22:28.223766 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.219631 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 22 16:22:28.224250 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.219634 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 22 16:22:28.224250 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.219636 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 22 16:22:28.224250 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.219639 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 22 16:22:28.224250 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.219641 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 22 16:22:28.224250 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.219644 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 22 16:22:28.224250 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.219647 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 22 16:22:28.224250 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.219649 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 22 16:22:28.224250 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.219651 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 22 16:22:28.224250 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.219655 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 22 16:22:28.224250 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.219660 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 22 16:22:28.224250 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.219664 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 22 16:22:28.224250 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.219667 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 22 16:22:28.224250 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.219670 2568 feature_gate.go:328] unrecognized feature gate: Example2 Jul 22 16:22:28.224250 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.219673 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 22 16:22:28.224250 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.219675 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 22 16:22:28.224250 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.219678 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 22 16:22:28.224250 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.219680 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 22 16:22:28.224250 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.219683 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 22 16:22:28.224250 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.219685 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 22 16:22:28.224722 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.219688 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 22 16:22:28.224722 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.219690 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 22 16:22:28.224722 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.219693 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 22 16:22:28.224722 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.219695 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 22 16:22:28.224722 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.219698 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 22 16:22:28.224722 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.219700 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 22 16:22:28.224722 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.219703 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 22 16:22:28.224722 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.219708 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 22 16:22:28.224722 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.219711 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 22 16:22:28.224722 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.219714 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 22 16:22:28.224722 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.219717 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 22 16:22:28.224722 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.219719 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 22 16:22:28.224722 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.219722 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 22 16:22:28.224722 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.219725 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 22 16:22:28.224722 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.219727 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 22 16:22:28.224722 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.219730 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 22 16:22:28.224722 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.219732 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 22 16:22:28.224722 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.219735 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 22 16:22:28.224722 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.219737 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 22 16:22:28.224722 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.219815 2568 flags.go:64] FLAG: --address="0.0.0.0" Jul 22 16:22:28.224722 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.219825 2568 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 22 16:22:28.225236 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.219839 2568 flags.go:64] FLAG: --anonymous-auth="true" Jul 22 16:22:28.225236 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.219846 2568 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 22 16:22:28.225236 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.219853 2568 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 22 16:22:28.225236 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.219856 2568 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 22 16:22:28.225236 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.219860 2568 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 22 16:22:28.225236 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.219864 2568 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 22 16:22:28.225236 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.219868 2568 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 22 16:22:28.225236 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.219871 2568 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 22 16:22:28.225236 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.219875 2568 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 22 16:22:28.225236 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.219878 2568 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 22 16:22:28.225236 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.219882 2568 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 22 16:22:28.225236 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.219885 2568 flags.go:64] FLAG: --cgroup-root="" Jul 22 16:22:28.225236 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.219888 2568 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 22 16:22:28.225236 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.219891 2568 flags.go:64] FLAG: --client-ca-file="" Jul 22 16:22:28.225236 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.219894 2568 flags.go:64] FLAG: --cloud-provider="external" Jul 22 16:22:28.225236 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.219897 2568 flags.go:64] FLAG: --cluster-dns="[]" Jul 22 16:22:28.225236 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.219902 2568 flags.go:64] FLAG: --cluster-domain="" Jul 22 16:22:28.225236 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.219904 2568 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 22 16:22:28.225236 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.219909 2568 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 22 16:22:28.225236 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.219912 2568 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 22 16:22:28.225236 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.219916 2568 flags.go:64] FLAG: --container-log-max-files="5" Jul 22 16:22:28.225236 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.219920 2568 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 22 16:22:28.225236 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.219923 2568 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 22 16:22:28.225814 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.219926 2568 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 22 16:22:28.225814 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.219929 2568 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 22 16:22:28.225814 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.219933 2568 flags.go:64] FLAG: --contention-profiling="false" Jul 22 16:22:28.225814 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.219936 2568 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 22 16:22:28.225814 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.219939 2568 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 22 16:22:28.225814 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.219942 2568 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 22 16:22:28.225814 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.219946 2568 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 22 16:22:28.225814 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.219950 2568 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 22 16:22:28.225814 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.219953 2568 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 22 16:22:28.225814 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.219956 2568 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 22 16:22:28.225814 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.219959 2568 flags.go:64] FLAG: --enable-load-reader="false" Jul 22 16:22:28.225814 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.219962 2568 flags.go:64] FLAG: --enable-server="true" Jul 22 16:22:28.225814 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.219965 2568 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 22 16:22:28.225814 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.219977 2568 flags.go:64] FLAG: --event-burst="100" Jul 22 16:22:28.225814 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.219980 2568 flags.go:64] FLAG: --event-qps="50" Jul 22 16:22:28.225814 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.219983 2568 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 22 16:22:28.225814 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.219986 2568 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 22 16:22:28.225814 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.219989 2568 flags.go:64] FLAG: --eviction-hard="" Jul 22 16:22:28.225814 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.219999 2568 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 22 16:22:28.225814 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.220002 2568 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 22 16:22:28.225814 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.220005 2568 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 22 16:22:28.225814 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.220008 2568 flags.go:64] FLAG: --eviction-soft="" Jul 22 16:22:28.225814 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.220011 2568 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 22 16:22:28.225814 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.220014 2568 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 22 16:22:28.225814 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.220017 2568 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 22 16:22:28.226507 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.220020 2568 flags.go:64] FLAG: --experimental-mounter-path="" Jul 22 16:22:28.226507 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.220022 2568 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 22 16:22:28.226507 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.220027 2568 flags.go:64] FLAG: --fail-swap-on="true" Jul 22 16:22:28.226507 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.220030 2568 flags.go:64] FLAG: --feature-gates="" Jul 22 16:22:28.226507 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.220033 2568 flags.go:64] FLAG: --file-check-frequency="20s" Jul 22 16:22:28.226507 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.220037 2568 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 22 16:22:28.226507 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.220040 2568 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 22 16:22:28.226507 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.220043 2568 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 22 16:22:28.226507 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.220046 2568 flags.go:64] FLAG: --healthz-port="10248" Jul 22 16:22:28.226507 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.220049 2568 flags.go:64] FLAG: --help="false" Jul 22 16:22:28.226507 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.220052 2568 flags.go:64] FLAG: --hostname-override="ip-10-0-133-47.ec2.internal" Jul 22 16:22:28.226507 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.220055 2568 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 22 16:22:28.226507 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.220058 2568 flags.go:64] FLAG: --http-check-frequency="20s" Jul 22 16:22:28.226507 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.220060 2568 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 22 16:22:28.226507 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.220064 2568 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 22 16:22:28.226507 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.220067 2568 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 22 16:22:28.226507 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.220070 2568 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 22 16:22:28.226507 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.220073 2568 flags.go:64] FLAG: --image-service-endpoint="" Jul 22 16:22:28.226507 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.220076 2568 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 22 16:22:28.226507 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.220079 2568 flags.go:64] FLAG: --kube-api-burst="100" Jul 22 16:22:28.226507 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.220082 2568 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 22 16:22:28.226507 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.220085 2568 flags.go:64] FLAG: --kube-api-qps="50" Jul 22 16:22:28.226507 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.220088 2568 flags.go:64] FLAG: --kube-reserved="" Jul 22 16:22:28.226507 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.220091 2568 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 22 16:22:28.227103 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.220094 2568 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 22 16:22:28.227103 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.220097 2568 flags.go:64] FLAG: --kubelet-cgroups="" Jul 22 16:22:28.227103 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.220100 2568 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 22 16:22:28.227103 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.220102 2568 flags.go:64] FLAG: --lock-file="" Jul 22 16:22:28.227103 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.220105 2568 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 22 16:22:28.227103 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.220108 2568 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 22 16:22:28.227103 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.220111 2568 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 22 16:22:28.227103 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.220116 2568 flags.go:64] FLAG: --log-json-split-stream="false" Jul 22 16:22:28.227103 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.220119 2568 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 22 16:22:28.227103 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.220122 2568 flags.go:64] FLAG: --log-text-split-stream="false" Jul 22 16:22:28.227103 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.220126 2568 flags.go:64] FLAG: --logging-format="text" Jul 22 16:22:28.227103 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.220129 2568 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 22 16:22:28.227103 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.220132 2568 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 22 16:22:28.227103 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.220135 2568 flags.go:64] FLAG: --manifest-url="" Jul 22 16:22:28.227103 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.220138 2568 flags.go:64] FLAG: --manifest-url-header="" Jul 22 16:22:28.227103 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.220142 2568 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 22 16:22:28.227103 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.220145 2568 flags.go:64] FLAG: --max-open-files="1000000" Jul 22 16:22:28.227103 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.220149 2568 flags.go:64] FLAG: --max-pods="110" Jul 22 16:22:28.227103 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.220152 2568 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 22 16:22:28.227103 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.220155 2568 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 22 16:22:28.227103 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.220158 2568 flags.go:64] FLAG: --memory-manager-policy="None" Jul 22 16:22:28.227103 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.220161 2568 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 22 16:22:28.227103 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.220164 2568 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 22 16:22:28.227103 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.220166 2568 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 22 16:22:28.227103 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.220172 2568 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 22 16:22:28.227719 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.220180 2568 flags.go:64] FLAG: --node-status-max-images="50" Jul 22 16:22:28.227719 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.220183 2568 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 22 16:22:28.227719 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.220186 2568 flags.go:64] FLAG: --oom-score-adj="-999" Jul 22 16:22:28.227719 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.220189 2568 flags.go:64] FLAG: --pod-cidr="" Jul 22 16:22:28.227719 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.220192 2568 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0" Jul 22 16:22:28.227719 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.220198 2568 flags.go:64] FLAG: --pod-manifest-path="" Jul 22 16:22:28.227719 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.220202 2568 flags.go:64] FLAG: --pod-max-pids="-1" Jul 22 16:22:28.227719 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.220205 2568 flags.go:64] FLAG: --pods-per-core="0" Jul 22 16:22:28.227719 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.220207 2568 flags.go:64] FLAG: --port="10250" Jul 22 16:22:28.227719 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.220210 2568 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 22 16:22:28.227719 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.220213 2568 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-07726ec4d174aaca8" Jul 22 16:22:28.227719 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.220216 2568 flags.go:64] FLAG: --qos-reserved="" Jul 22 16:22:28.227719 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.220219 2568 flags.go:64] FLAG: --read-only-port="10255" Jul 22 16:22:28.227719 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.220222 2568 flags.go:64] FLAG: --register-node="true" Jul 22 16:22:28.227719 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.220225 2568 flags.go:64] FLAG: --register-with-taints="" Jul 22 16:22:28.227719 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.220229 2568 flags.go:64] FLAG: --registry-burst="10" Jul 22 16:22:28.227719 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.220232 2568 flags.go:64] FLAG: --registry-qps="5" Jul 22 16:22:28.227719 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.220235 2568 flags.go:64] FLAG: --reserved-cpus="" Jul 22 16:22:28.227719 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.220239 2568 flags.go:64] FLAG: --reserved-memory="" Jul 22 16:22:28.227719 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.220243 2568 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 22 16:22:28.227719 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.220246 2568 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 22 16:22:28.227719 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.220250 2568 flags.go:64] FLAG: --rotate-certificates="false" Jul 22 16:22:28.227719 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.220252 2568 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 22 16:22:28.227719 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.220255 2568 flags.go:64] FLAG: --runonce="false" Jul 22 16:22:28.227719 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.220258 2568 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 22 16:22:28.228321 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.220261 2568 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 22 16:22:28.228321 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.220264 2568 flags.go:64] FLAG: --seccomp-default="false" Jul 22 16:22:28.228321 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.220267 2568 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 22 16:22:28.228321 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.220270 2568 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 22 16:22:28.228321 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.220273 2568 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 22 16:22:28.228321 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.220276 2568 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 22 16:22:28.228321 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.220281 2568 flags.go:64] FLAG: --storage-driver-password="root" Jul 22 16:22:28.228321 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.220284 2568 flags.go:64] FLAG: --storage-driver-secure="false" Jul 22 16:22:28.228321 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.220286 2568 flags.go:64] FLAG: --storage-driver-table="stats" Jul 22 16:22:28.228321 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.220289 2568 flags.go:64] FLAG: --storage-driver-user="root" Jul 22 16:22:28.228321 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.220292 2568 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 22 16:22:28.228321 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.220295 2568 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 22 16:22:28.228321 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.220299 2568 flags.go:64] FLAG: --system-cgroups="" Jul 22 16:22:28.228321 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.220301 2568 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 22 16:22:28.228321 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.220307 2568 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 22 16:22:28.228321 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.220310 2568 flags.go:64] FLAG: --tls-cert-file="" Jul 22 16:22:28.228321 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.220313 2568 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 22 16:22:28.228321 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.220317 2568 flags.go:64] FLAG: --tls-min-version="" Jul 22 16:22:28.228321 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.220319 2568 flags.go:64] FLAG: --tls-private-key-file="" Jul 22 16:22:28.228321 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.220322 2568 flags.go:64] FLAG: --topology-manager-policy="none" Jul 22 16:22:28.228321 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.220325 2568 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 22 16:22:28.228321 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.220328 2568 flags.go:64] FLAG: --topology-manager-scope="container" Jul 22 16:22:28.228321 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.220331 2568 flags.go:64] FLAG: --v="2" Jul 22 16:22:28.228321 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.220335 2568 flags.go:64] FLAG: --version="false" Jul 22 16:22:28.228321 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.220339 2568 flags.go:64] FLAG: --vmodule="" Jul 22 16:22:28.228937 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.220357 2568 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 22 16:22:28.228937 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.220360 2568 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 22 16:22:28.228937 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.220476 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 22 16:22:28.228937 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.220480 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 22 16:22:28.228937 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.220483 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 22 16:22:28.228937 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.220485 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 22 16:22:28.228937 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.220488 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 22 16:22:28.228937 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.220490 2568 feature_gate.go:328] unrecognized feature gate: Example Jul 22 16:22:28.228937 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.220493 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 22 16:22:28.228937 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.220495 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 22 16:22:28.228937 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.220498 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 22 16:22:28.228937 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.220502 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 22 16:22:28.228937 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.220504 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 22 16:22:28.228937 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.220508 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 22 16:22:28.228937 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.220511 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 22 16:22:28.228937 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.220514 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 22 16:22:28.228937 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.220516 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 22 16:22:28.228937 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.220519 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 22 16:22:28.228937 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.220522 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 22 16:22:28.228937 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.220524 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 22 16:22:28.229438 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.220527 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 22 16:22:28.229438 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.220530 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 22 16:22:28.229438 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.220533 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 22 16:22:28.229438 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.220535 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 22 16:22:28.229438 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.220538 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 22 16:22:28.229438 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.220540 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 22 16:22:28.229438 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.220543 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 22 16:22:28.229438 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.220546 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 22 16:22:28.229438 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.220549 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 22 16:22:28.229438 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.220551 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 22 16:22:28.229438 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.220554 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 22 16:22:28.229438 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.220556 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 22 16:22:28.229438 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.220560 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 22 16:22:28.229438 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.220563 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 22 16:22:28.229438 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.220565 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 22 16:22:28.229438 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.220568 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 22 16:22:28.229438 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.220570 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 22 16:22:28.229438 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.220573 2568 feature_gate.go:328] unrecognized feature gate: Example2 Jul 22 16:22:28.229438 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.220576 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 22 16:22:28.229438 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.220578 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 22 16:22:28.229959 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.220580 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 22 16:22:28.229959 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.220583 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 22 16:22:28.229959 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.220586 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 22 16:22:28.229959 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.220588 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 22 16:22:28.229959 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.220591 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 22 16:22:28.229959 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.220595 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 22 16:22:28.229959 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.220597 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 22 16:22:28.229959 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.220600 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 22 16:22:28.229959 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.220602 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 22 16:22:28.229959 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.220605 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 22 16:22:28.229959 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.220608 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 22 16:22:28.229959 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.220610 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 22 16:22:28.229959 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.220612 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 22 16:22:28.229959 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.220616 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 22 16:22:28.229959 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.220618 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 22 16:22:28.229959 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.220621 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 22 16:22:28.229959 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.220623 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 22 16:22:28.229959 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.220627 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 22 16:22:28.229959 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.220631 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 22 16:22:28.230443 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.220633 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 22 16:22:28.230443 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.220636 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 22 16:22:28.230443 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.220639 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 22 16:22:28.230443 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.220642 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 22 16:22:28.230443 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.220644 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 22 16:22:28.230443 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.220648 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 22 16:22:28.230443 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.220651 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 22 16:22:28.230443 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.220653 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 22 16:22:28.230443 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.220657 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 22 16:22:28.230443 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.220660 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 22 16:22:28.230443 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.220663 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 22 16:22:28.230443 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.220665 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 22 16:22:28.230443 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.220668 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 22 16:22:28.230443 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.220671 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 22 16:22:28.230443 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.220674 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 22 16:22:28.230443 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.220676 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 22 16:22:28.230443 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.220678 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 22 16:22:28.230443 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.220681 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 22 16:22:28.230443 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.220685 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 22 16:22:28.230900 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.220688 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 22 16:22:28.230900 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.220690 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 22 16:22:28.230900 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.220693 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 22 16:22:28.230900 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.220695 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 22 16:22:28.230900 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.220698 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 22 16:22:28.230900 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.220701 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 22 16:22:28.230900 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.220703 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 22 16:22:28.230900 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.220707 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 22 16:22:28.230900 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.220711 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 22 16:22:28.230900 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.220714 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 22 16:22:28.230900 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.220717 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 22 16:22:28.230900 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.220719 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 22 16:22:28.230900 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.220722 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 22 16:22:28.230900 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.220724 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 22 16:22:28.230900 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.220727 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 22 16:22:28.230900 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.220729 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 22 16:22:28.230900 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.220732 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 22 16:22:28.230900 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.220734 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 22 16:22:28.230900 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.220738 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 22 16:22:28.231376 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.220740 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 22 16:22:28.231376 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.220743 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 22 16:22:28.231376 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.220745 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 22 16:22:28.231376 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.220747 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 22 16:22:28.231376 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.220753 2568 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 22 16:22:28.231376 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.227828 2568 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 22 16:22:28.231376 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.227843 2568 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 22 16:22:28.231376 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.227864 2568 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 22 16:22:28.231376 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.227873 2568 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 22 16:22:28.231376 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.227936 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 22 16:22:28.231376 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.227941 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 22 16:22:28.231376 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.227945 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 22 16:22:28.231376 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.227948 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 22 16:22:28.231376 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.227951 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 22 16:22:28.231736 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.227954 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 22 16:22:28.231736 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.227957 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 22 16:22:28.231736 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.227959 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 22 16:22:28.231736 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.227962 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 22 16:22:28.231736 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.227965 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 22 16:22:28.231736 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.227967 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 22 16:22:28.231736 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.227970 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 22 16:22:28.231736 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.227973 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 22 16:22:28.231736 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.227976 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 22 16:22:28.231736 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.227979 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 22 16:22:28.231736 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.227981 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 22 16:22:28.231736 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.227984 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 22 16:22:28.231736 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.227986 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 22 16:22:28.231736 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.227989 2568 feature_gate.go:328] unrecognized feature gate: Example Jul 22 16:22:28.231736 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.227992 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 22 16:22:28.231736 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.227994 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 22 16:22:28.231736 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.227997 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 22 16:22:28.231736 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228000 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 22 16:22:28.231736 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228003 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 22 16:22:28.231736 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228005 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 22 16:22:28.232208 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228008 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 22 16:22:28.232208 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228011 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 22 16:22:28.232208 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228014 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 22 16:22:28.232208 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228016 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 22 16:22:28.232208 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228020 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 22 16:22:28.232208 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228023 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 22 16:22:28.232208 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228026 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 22 16:22:28.232208 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228028 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 22 16:22:28.232208 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228031 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 22 16:22:28.232208 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228034 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 22 16:22:28.232208 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228036 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 22 16:22:28.232208 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228039 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 22 16:22:28.232208 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228041 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 22 16:22:28.232208 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228044 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 22 16:22:28.232208 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228046 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 22 16:22:28.232208 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228049 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 22 16:22:28.232208 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228052 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 22 16:22:28.232208 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228054 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 22 16:22:28.232208 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228057 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 22 16:22:28.232208 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228059 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 22 16:22:28.232807 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228062 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 22 16:22:28.232807 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228065 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 22 16:22:28.232807 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228067 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 22 16:22:28.232807 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228070 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 22 16:22:28.232807 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228072 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 22 16:22:28.232807 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228075 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 22 16:22:28.232807 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228078 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 22 16:22:28.232807 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228080 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 22 16:22:28.232807 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228082 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 22 16:22:28.232807 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228085 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 22 16:22:28.232807 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228087 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 22 16:22:28.232807 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228090 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 22 16:22:28.232807 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228093 2568 feature_gate.go:328] unrecognized feature gate: Example2 Jul 22 16:22:28.232807 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228095 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 22 16:22:28.232807 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228097 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 22 16:22:28.232807 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228100 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 22 16:22:28.232807 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228103 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 22 16:22:28.232807 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228106 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 22 16:22:28.232807 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228108 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 22 16:22:28.232807 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228111 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 22 16:22:28.233292 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228113 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 22 16:22:28.233292 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228116 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 22 16:22:28.233292 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228119 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 22 16:22:28.233292 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228122 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 22 16:22:28.233292 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228124 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 22 16:22:28.233292 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228127 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 22 16:22:28.233292 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228129 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 22 16:22:28.233292 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228132 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 22 16:22:28.233292 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228134 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 22 16:22:28.233292 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228136 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 22 16:22:28.233292 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228139 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 22 16:22:28.233292 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228141 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 22 16:22:28.233292 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228145 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 22 16:22:28.233292 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228149 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 22 16:22:28.233292 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228152 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 22 16:22:28.233292 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228154 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 22 16:22:28.233292 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228157 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 22 16:22:28.233292 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228159 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 22 16:22:28.233292 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228164 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 22 16:22:28.233292 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228167 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 22 16:22:28.233787 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228170 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 22 16:22:28.233787 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228173 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 22 16:22:28.233787 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228175 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 22 16:22:28.233787 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228178 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 22 16:22:28.233787 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228182 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 22 16:22:28.233787 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228185 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 22 16:22:28.233787 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228188 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 22 16:22:28.233787 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228191 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 22 16:22:28.233787 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228194 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 22 16:22:28.233787 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228196 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 22 16:22:28.233787 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228199 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 22 16:22:28.233787 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228201 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 22 16:22:28.233787 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228204 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 22 16:22:28.233787 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228206 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 22 16:22:28.234134 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.228212 2568 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 22 16:22:28.234134 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228323 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 22 16:22:28.234134 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228327 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 22 16:22:28.234134 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228330 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 22 16:22:28.234134 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228333 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 22 16:22:28.234134 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228336 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 22 16:22:28.234134 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228339 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 22 16:22:28.234134 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228354 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 22 16:22:28.234134 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228358 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 22 16:22:28.234134 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228361 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 22 16:22:28.234134 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228364 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 22 16:22:28.234134 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228367 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 22 16:22:28.234134 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228370 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 22 16:22:28.234134 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228373 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 22 16:22:28.234134 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228376 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 22 16:22:28.234528 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228379 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 22 16:22:28.234528 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228382 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 22 16:22:28.234528 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228385 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 22 16:22:28.234528 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228389 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 22 16:22:28.234528 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228392 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 22 16:22:28.234528 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228396 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 22 16:22:28.234528 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228398 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 22 16:22:28.234528 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228401 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 22 16:22:28.234528 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228405 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 22 16:22:28.234528 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228409 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 22 16:22:28.234528 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228411 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 22 16:22:28.234528 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228414 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 22 16:22:28.234528 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228417 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 22 16:22:28.234528 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228420 2568 feature_gate.go:328] unrecognized feature gate: Example Jul 22 16:22:28.234528 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228423 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 22 16:22:28.234528 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228426 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 22 16:22:28.234528 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228429 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 22 16:22:28.234528 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228432 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 22 16:22:28.234528 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228435 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 22 16:22:28.234975 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228438 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 22 16:22:28.234975 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228440 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 22 16:22:28.234975 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228443 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 22 16:22:28.234975 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228445 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 22 16:22:28.234975 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228447 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 22 16:22:28.234975 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228450 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 22 16:22:28.234975 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228452 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 22 16:22:28.234975 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228455 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 22 16:22:28.234975 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228458 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 22 16:22:28.234975 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228461 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 22 16:22:28.234975 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228463 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 22 16:22:28.234975 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228466 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 22 16:22:28.234975 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228470 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 22 16:22:28.234975 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228472 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 22 16:22:28.234975 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228475 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 22 16:22:28.234975 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228477 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 22 16:22:28.234975 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228480 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 22 16:22:28.234975 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228482 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 22 16:22:28.234975 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228485 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 22 16:22:28.234975 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228487 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 22 16:22:28.235462 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228490 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 22 16:22:28.235462 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228492 2568 feature_gate.go:328] unrecognized feature gate: Example2 Jul 22 16:22:28.235462 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228495 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 22 16:22:28.235462 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228497 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 22 16:22:28.235462 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228500 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 22 16:22:28.235462 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228502 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 22 16:22:28.235462 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228505 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 22 16:22:28.235462 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228507 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 22 16:22:28.235462 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228510 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 22 16:22:28.235462 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228512 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 22 16:22:28.235462 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228514 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 22 16:22:28.235462 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228517 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 22 16:22:28.235462 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228520 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 22 16:22:28.235462 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228522 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 22 16:22:28.235462 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228525 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 22 16:22:28.235462 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228527 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 22 16:22:28.235462 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228530 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 22 16:22:28.235462 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228532 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 22 16:22:28.235462 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228534 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 22 16:22:28.235462 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228537 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 22 16:22:28.235946 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228540 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 22 16:22:28.235946 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228542 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 22 16:22:28.235946 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228545 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 22 16:22:28.235946 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228547 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 22 16:22:28.235946 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228550 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 22 16:22:28.235946 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228553 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 22 16:22:28.235946 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228555 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 22 16:22:28.235946 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228558 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 22 16:22:28.235946 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228560 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 22 16:22:28.235946 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228563 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 22 16:22:28.235946 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228565 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 22 16:22:28.235946 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228568 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 22 16:22:28.235946 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228570 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 22 16:22:28.235946 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228572 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 22 16:22:28.235946 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228575 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 22 16:22:28.235946 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228577 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 22 16:22:28.235946 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228580 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 22 16:22:28.235946 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228583 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 22 16:22:28.235946 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228585 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 22 16:22:28.236408 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228587 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 22 16:22:28.236408 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228590 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 22 16:22:28.236408 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228593 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 22 16:22:28.236408 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228595 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 22 16:22:28.236408 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228598 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 22 16:22:28.236408 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228601 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 22 16:22:28.236408 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:28.228603 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 22 16:22:28.236408 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.228609 2568 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 22 16:22:28.236408 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.228720 2568 server.go:962] "Client rotation is on, will bootstrap in background" Jul 22 16:22:28.236408 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.231204 2568 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 22 16:22:28.236408 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.232864 2568 server.go:1019] "Starting client certificate rotation" Jul 22 16:22:28.236408 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.232963 2568 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 22 16:22:28.236408 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.232993 2568 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 22 16:22:28.236722 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.235721 2568 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 22 16:22:28.237209 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.237192 2568 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 22 16:22:28.251898 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.251875 2568 log.go:25] "Validated CRI v1 runtime API" Jul 22 16:22:28.256889 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.256867 2568 log.go:25] "Validated CRI v1 image API" Jul 22 16:22:28.258629 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.258609 2568 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 22 16:22:28.261182 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.261161 2568 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 a27a2344-ef39-4a83-9df1-6886f108d4a6:/dev/nvme0n1p4 a515238d-aa5d-4b0c-9db5-63783b288b76:/dev/nvme0n1p3] Jul 22 16:22:28.261241 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.261182 2568 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 22 16:22:28.265502 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.265390 2568 manager.go:216] Machine: {Timestamp:2026-07-22 16:22:28.26491042 +0000 UTC m=+0.366526002 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100023 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2d34517c637090ebf4b9e3b3e07a8a SystemUUID:ec2d3451-7c63-7090-ebf4-b9e3b3e07a8a BootID:3a29a039-4948-452d-9fec-33f9407b5bb6 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:87:bb:dc:a1:a7 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:87:bb:dc:a1:a7 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:5e:4b:47:6d:4f:12 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 22 16:22:28.265502 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.265499 2568 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 22 16:22:28.265614 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.265606 2568 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 22 16:22:28.269222 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.269184 2568 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 22 16:22:28.269408 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.269227 2568 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-47.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 22 16:22:28.270944 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.270928 2568 topology_manager.go:138] "Creating topology manager with none policy" Jul 22 16:22:28.271008 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.270952 2568 container_manager_linux.go:309] "Creating device plugin manager" Jul 22 16:22:28.271008 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.270963 2568 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 22 16:22:28.271605 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.271589 2568 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 22 16:22:28.271826 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.271814 2568 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 22 16:22:28.273702 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.273689 2568 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 22 16:22:28.278484 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.278468 2568 state_mem.go:36] "Initialized new in-memory state store" Jul 22 16:22:28.278628 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.278617 2568 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 22 16:22:28.278685 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.278656 2568 kubelet.go:486] "Attempting to sync node with API server" Jul 22 16:22:28.278685 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.278673 2568 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 22 16:22:28.278766 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.278692 2568 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 22 16:22:28.278766 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.278706 2568 kubelet.go:398] "Adding apiserver pod source" Jul 22 16:22:28.278766 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.278720 2568 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 22 16:22:28.279117 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.279104 2568 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 22 16:22:28.279187 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.279127 2568 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 22 16:22:28.282700 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.282681 2568 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 22 16:22:28.285209 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.285189 2568 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 22 16:22:28.285278 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.285238 2568 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 22 16:22:28.286579 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.286565 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 22 16:22:28.286579 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.286581 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 22 16:22:28.286700 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.286588 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 22 16:22:28.286700 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.286596 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 22 16:22:28.286700 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.286610 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 22 16:22:28.286700 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.286618 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 22 16:22:28.286700 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.286627 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 22 16:22:28.286700 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.286632 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 22 16:22:28.286700 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.286639 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 22 16:22:28.286700 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.286645 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 22 16:22:28.286700 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.286664 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 22 16:22:28.286700 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.286670 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 22 16:22:28.286700 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.286701 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 22 16:22:28.286700 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.286707 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 22 16:22:28.290361 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.290332 2568 server.go:1268] "Started kubelet" Jul 22 16:22:28.290449 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.290410 2568 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 22 16:22:28.290503 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.290430 2568 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 22 16:22:28.290503 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.290498 2568 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 22 16:22:28.291123 ip-10-0-133-47 systemd[1]: Started Kubernetes Kubelet. Jul 22 16:22:28.294715 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.294693 2568 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 22 16:22:28.295333 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.295314 2568 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-47.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 22 16:22:28.295444 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:22:28.295363 2568 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-47.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 22 16:22:28.295444 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:22:28.295363 2568 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 22 16:22:28.295863 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:22:28.295842 2568 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 22 16:22:28.296731 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.296707 2568 server.go:310] "Adding debug handlers to kubelet server" Jul 22 16:22:28.302476 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:22:28.301367 2568 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-47.ec2.internal.18c4a9298e343ee6 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-47.ec2.internal,UID:ip-10-0-133-47.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-47.ec2.internal,},FirstTimestamp:2026-07-22 16:22:28.290100966 +0000 UTC m=+0.391716533,LastTimestamp:2026-07-22 16:22:28.290100966 +0000 UTC m=+0.391716533,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-47.ec2.internal,}" Jul 22 16:22:28.305494 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.305478 2568 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 22 16:22:28.305824 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.305505 2568 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 22 16:22:28.305824 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:22:28.305589 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-47.ec2.internal\" not found" Jul 22 16:22:28.306414 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.306270 2568 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 22 16:22:28.306414 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.306285 2568 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 22 16:22:28.306414 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.306370 2568 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 22 16:22:28.306414 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.306385 2568 factory.go:55] Registering systemd factory Jul 22 16:22:28.306414 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.306394 2568 reconstruct.go:97] "Volume reconstruction finished" Jul 22 16:22:28.306414 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.306407 2568 reconciler.go:29] "Reconciler: start to sync state" Jul 22 16:22:28.306648 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.306447 2568 factory.go:223] Registration of the systemd container factory successfully Jul 22 16:22:28.306696 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.306687 2568 factory.go:153] Registering CRI-O factory Jul 22 16:22:28.306738 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.306704 2568 factory.go:223] Registration of the crio container factory successfully Jul 22 16:22:28.306774 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.306759 2568 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 22 16:22:28.306810 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.306785 2568 factory.go:103] Registering Raw factory Jul 22 16:22:28.306810 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.306810 2568 manager.go:1196] Started watching for new ooms in manager Jul 22 16:22:28.307125 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.307111 2568 manager.go:349] Starting recovery of all containers Jul 22 16:22:28.310737 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:22:28.310706 2568 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 22 16:22:28.316379 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:22:28.316336 2568 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-133-47.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 22 16:22:28.316459 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.316423 2568 manager.go:354] Recovery completed Jul 22 16:22:28.320431 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.320418 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 22 16:22:28.321420 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.321404 2568 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-478c4" Jul 22 16:22:28.322148 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.322134 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-47.ec2.internal" event="NodeHasSufficientMemory" Jul 22 16:22:28.322209 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.322160 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-47.ec2.internal" event="NodeHasNoDiskPressure" Jul 22 16:22:28.322209 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.322171 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-47.ec2.internal" event="NodeHasSufficientPID" Jul 22 16:22:28.322777 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.322763 2568 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 22 16:22:28.322777 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.322772 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 22 16:22:28.322777 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.322777 2568 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 22 16:22:28.322952 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.322795 2568 state_mem.go:36] "Initialized new in-memory state store" Jul 22 16:22:28.323487 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.323472 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-47.ec2.internal" event="NodeHasSufficientMemory" Jul 22 16:22:28.323541 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.323502 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-47.ec2.internal" event="NodeHasNoDiskPressure" Jul 22 16:22:28.323541 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.323514 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-47.ec2.internal" event="NodeHasSufficientPID" Jul 22 16:22:28.323911 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:22:28.323836 2568 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-47.ec2.internal.18c4a929901d3e4f default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-47.ec2.internal,UID:ip-10-0-133-47.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-133-47.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-133-47.ec2.internal,},FirstTimestamp:2026-07-22 16:22:28.322147919 +0000 UTC m=+0.423763486,LastTimestamp:2026-07-22 16:22:28.322147919 +0000 UTC m=+0.423763486,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-47.ec2.internal,}" Jul 22 16:22:28.324970 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.324957 2568 policy_none.go:49] "None policy: Start" Jul 22 16:22:28.325032 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.324977 2568 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 22 16:22:28.325032 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.324993 2568 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 22 16:22:28.326954 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.326942 2568 policy_none.go:47] "Start" Jul 22 16:22:28.329134 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.329119 2568 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-478c4" Jul 22 16:22:28.334442 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:22:28.334337 2568 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-47.ec2.internal.18c4a929901d810a default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-47.ec2.internal,UID:ip-10-0-133-47.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-133-47.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-133-47.ec2.internal,},FirstTimestamp:2026-07-22 16:22:28.322165002 +0000 UTC m=+0.423780569,LastTimestamp:2026-07-22 16:22:28.322165002 +0000 UTC m=+0.423780569,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-47.ec2.internal,}" Jul 22 16:22:28.371105 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.371087 2568 manager.go:337] "Starting Device Plugin manager" Jul 22 16:22:28.387120 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:22:28.371132 2568 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 22 16:22:28.387120 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.371145 2568 server.go:87] "Starting device plugin registration server" Jul 22 16:22:28.387120 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.371405 2568 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 22 16:22:28.387120 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.371416 2568 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 22 16:22:28.387120 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.371493 2568 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 22 16:22:28.387120 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.371584 2568 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 22 16:22:28.387120 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.371592 2568 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 22 16:22:28.387120 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:22:28.372109 2568 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 22 16:22:28.387120 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:22:28.372157 2568 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-47.ec2.internal\" not found" Jul 22 16:22:28.402049 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.402012 2568 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 22 16:22:28.403263 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.403237 2568 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 22 16:22:28.403383 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.403283 2568 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 22 16:22:28.403383 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.403306 2568 kubelet.go:2448] "Starting kubelet main sync loop" Jul 22 16:22:28.403383 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:22:28.403341 2568 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 22 16:22:28.406084 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.406065 2568 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 22 16:22:28.472318 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.472242 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 22 16:22:28.473264 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.473247 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-47.ec2.internal" event="NodeHasSufficientMemory" Jul 22 16:22:28.473379 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.473277 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-47.ec2.internal" event="NodeHasNoDiskPressure" Jul 22 16:22:28.473379 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.473287 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-47.ec2.internal" event="NodeHasSufficientPID" Jul 22 16:22:28.473379 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.473317 2568 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-47.ec2.internal" Jul 22 16:22:28.482942 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.482915 2568 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-47.ec2.internal" Jul 22 16:22:28.482942 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:22:28.482948 2568 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-47.ec2.internal\": node \"ip-10-0-133-47.ec2.internal\" not found" Jul 22 16:22:28.503865 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.503840 2568 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-47.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-47.ec2.internal"] Jul 22 16:22:28.503983 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.503908 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 22 16:22:28.503983 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:22:28.503969 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-47.ec2.internal\" not found" Jul 22 16:22:28.505260 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.505245 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-47.ec2.internal" event="NodeHasSufficientMemory" Jul 22 16:22:28.505320 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.505271 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-47.ec2.internal" event="NodeHasNoDiskPressure" Jul 22 16:22:28.505320 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.505282 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-47.ec2.internal" event="NodeHasSufficientPID" Jul 22 16:22:28.507706 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.507693 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 22 16:22:28.507809 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.507796 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-47.ec2.internal" Jul 22 16:22:28.507844 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.507826 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 22 16:22:28.508440 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.508425 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-47.ec2.internal" event="NodeHasSufficientMemory" Jul 22 16:22:28.508502 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.508449 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-47.ec2.internal" event="NodeHasNoDiskPressure" Jul 22 16:22:28.508502 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.508462 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-47.ec2.internal" event="NodeHasSufficientPID" Jul 22 16:22:28.508573 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.508506 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-47.ec2.internal" event="NodeHasSufficientMemory" Jul 22 16:22:28.508573 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.508530 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-47.ec2.internal" event="NodeHasNoDiskPressure" Jul 22 16:22:28.508573 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.508545 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-47.ec2.internal" event="NodeHasSufficientPID" Jul 22 16:22:28.510742 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.510724 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-47.ec2.internal" Jul 22 16:22:28.510827 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.510753 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 22 16:22:28.511646 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.511631 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-47.ec2.internal" event="NodeHasSufficientMemory" Jul 22 16:22:28.511720 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.511656 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-47.ec2.internal" event="NodeHasNoDiskPressure" Jul 22 16:22:28.511720 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.511666 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-47.ec2.internal" event="NodeHasSufficientPID" Jul 22 16:22:28.536126 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:22:28.536100 2568 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-47.ec2.internal\" not found" node="ip-10-0-133-47.ec2.internal" Jul 22 16:22:28.540509 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:22:28.540492 2568 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-47.ec2.internal\" not found" node="ip-10-0-133-47.ec2.internal" Jul 22 16:22:28.604812 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:22:28.604638 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-47.ec2.internal\" not found" Jul 22 16:22:28.607530 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.607503 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6c389acabb6147062a64e9641790fbaa-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-47.ec2.internal\" (UID: \"6c389acabb6147062a64e9641790fbaa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-47.ec2.internal" Jul 22 16:22:28.607530 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.607529 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6c389acabb6147062a64e9641790fbaa-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-47.ec2.internal\" (UID: \"6c389acabb6147062a64e9641790fbaa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-47.ec2.internal" Jul 22 16:22:28.607680 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.607546 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/aa9e2291606c92d6ab1f0ef1e722964e-config\") pod \"kube-apiserver-proxy-ip-10-0-133-47.ec2.internal\" (UID: \"aa9e2291606c92d6ab1f0ef1e722964e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-47.ec2.internal" Jul 22 16:22:28.705221 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:22:28.705175 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-47.ec2.internal\" not found" Jul 22 16:22:28.708499 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.708481 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6c389acabb6147062a64e9641790fbaa-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-47.ec2.internal\" (UID: \"6c389acabb6147062a64e9641790fbaa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-47.ec2.internal" Jul 22 16:22:28.708587 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.708516 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/aa9e2291606c92d6ab1f0ef1e722964e-config\") pod \"kube-apiserver-proxy-ip-10-0-133-47.ec2.internal\" (UID: \"aa9e2291606c92d6ab1f0ef1e722964e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-47.ec2.internal" Jul 22 16:22:28.708587 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.708538 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6c389acabb6147062a64e9641790fbaa-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-47.ec2.internal\" (UID: \"6c389acabb6147062a64e9641790fbaa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-47.ec2.internal" Jul 22 16:22:28.708671 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.708581 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6c389acabb6147062a64e9641790fbaa-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-47.ec2.internal\" (UID: \"6c389acabb6147062a64e9641790fbaa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-47.ec2.internal" Jul 22 16:22:28.708671 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.708584 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6c389acabb6147062a64e9641790fbaa-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-47.ec2.internal\" (UID: \"6c389acabb6147062a64e9641790fbaa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-47.ec2.internal" Jul 22 16:22:28.708671 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.708588 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/aa9e2291606c92d6ab1f0ef1e722964e-config\") pod \"kube-apiserver-proxy-ip-10-0-133-47.ec2.internal\" (UID: \"aa9e2291606c92d6ab1f0ef1e722964e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-47.ec2.internal" Jul 22 16:22:28.806068 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:22:28.805986 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-47.ec2.internal\" not found" Jul 22 16:22:28.839419 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.839389 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-47.ec2.internal" Jul 22 16:22:28.843031 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:28.843002 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-47.ec2.internal" Jul 22 16:22:28.906474 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:22:28.906418 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-47.ec2.internal\" not found" Jul 22 16:22:29.006854 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:22:29.006805 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-47.ec2.internal\" not found" Jul 22 16:22:29.107382 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:22:29.107274 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-47.ec2.internal\" not found" Jul 22 16:22:29.207713 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:22:29.207690 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-47.ec2.internal\" not found" Jul 22 16:22:29.232024 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:29.231995 2568 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 22 16:22:29.232172 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:29.232158 2568 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 22 16:22:29.308442 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:22:29.308411 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-47.ec2.internal\" not found" Jul 22 16:22:29.335245 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:29.335201 2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-21 16:17:28 +0000 UTC" deadline="2028-04-29 03:39:34.294491126 +0000 UTC" Jul 22 16:22:29.335245 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:29.335241 2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15515h17m4.959254889s" Jul 22 16:22:29.399576 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:29.399546 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 22 16:22:29.400975 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:29.400956 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-47.ec2.internal" event="NodeHasSufficientMemory" Jul 22 16:22:29.401145 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:29.400986 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-47.ec2.internal" event="NodeHasNoDiskPressure" Jul 22 16:22:29.401145 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:29.400995 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-47.ec2.internal" event="NodeHasSufficientPID" Jul 22 16:22:29.408623 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:22:29.408603 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-47.ec2.internal\" not found" Jul 22 16:22:29.420768 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:29.420744 2568 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 22 16:22:29.493569 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:29.493520 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa9e2291606c92d6ab1f0ef1e722964e.slice/crio-69c52f0f9cbd319afb2128bfd62da9033e0bd120c58ee875953c364d3f9501d9 WatchSource:0}: Error finding container 69c52f0f9cbd319afb2128bfd62da9033e0bd120c58ee875953c364d3f9501d9: Status 404 returned error can't find the container with id 69c52f0f9cbd319afb2128bfd62da9033e0bd120c58ee875953c364d3f9501d9 Jul 22 16:22:29.493851 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:29.493826 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c389acabb6147062a64e9641790fbaa.slice/crio-c4fbb2e5ab2d4fce997b0cee04557e6616e901ee725aa7e914487b08bbdba73f WatchSource:0}: Error finding container c4fbb2e5ab2d4fce997b0cee04557e6616e901ee725aa7e914487b08bbdba73f: Status 404 returned error can't find the container with id c4fbb2e5ab2d4fce997b0cee04557e6616e901ee725aa7e914487b08bbdba73f Jul 22 16:22:29.498154 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:29.498134 2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 22 16:22:29.506188 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:29.506170 2568 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-47.ec2.internal" Jul 22 16:22:29.519928 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:29.519905 2568 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 22 16:22:29.520106 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:29.520093 2568 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 22 16:22:29.521085 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:29.521072 2568 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-47.ec2.internal" Jul 22 16:22:29.528276 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:29.528262 2568 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 22 16:22:29.658603 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:29.658523 2568 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 22 16:22:30.092559 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.092472 2568 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 22 16:22:30.280336 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.280297 2568 apiserver.go:52] "Watching apiserver" Jul 22 16:22:30.289333 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.289234 2568 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 22 16:22:30.292677 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.292648 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-47.ec2.internal","openshift-multus/multus-additional-cni-plugins-swk9r","kube-system/konnectivity-agent-8qfgq","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-knwpl","openshift-image-registry/node-ca-v887c","openshift-multus/multus-2gf2v","openshift-multus/network-metrics-daemon-bknjp","openshift-network-diagnostics/network-check-target-hwfst","openshift-network-operator/iptables-alerter-qn7tr","openshift-ovn-kubernetes/ovnkube-node-4xxp4","kube-system/global-pull-secret-syncer-vtpvm","kube-system/kube-apiserver-proxy-ip-10-0-133-47.ec2.internal","openshift-cluster-node-tuning-operator/tuned-crkls","openshift-dns/node-resolver-mzcc2"] Jul 22 16:22:30.295362 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.295324 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4xxp4" Jul 22 16:22:30.298613 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.298583 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-crkls" Jul 22 16:22:30.299286 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.299264 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-4zqt5\"" Jul 22 16:22:30.299878 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.299525 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 22 16:22:30.299878 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.299808 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 22 16:22:30.299878 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.299852 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 22 16:22:30.300310 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.300082 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 22 16:22:30.300310 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.300251 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 22 16:22:30.300469 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.300388 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 22 16:22:30.300749 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.300731 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-8qfgq" Jul 22 16:22:30.301257 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.301169 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 22 16:22:30.301257 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.301201 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-7gqbl\"" Jul 22 16:22:30.301257 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.301232 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 22 16:22:30.303369 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.302192 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-swk9r" Jul 22 16:22:30.303369 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.302864 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 22 16:22:30.303513 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.303390 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 22 16:22:30.304049 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.303580 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-2bpg7\"" Jul 22 16:22:30.304835 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.304433 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-v887c" Jul 22 16:22:30.305311 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.305293 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 22 16:22:30.305419 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.305328 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 22 16:22:30.305419 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.305364 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-hfb89\"" Jul 22 16:22:30.306952 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.305979 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 22 16:22:30.306952 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.306050 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 22 16:22:30.306952 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.306144 2568 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 22 16:22:30.306952 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.306175 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 22 16:22:30.306952 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.306733 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bknjp" Jul 22 16:22:30.306952 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.306780 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 22 16:22:30.306952 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:22:30.306795 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bknjp" podUID="919e9190-67ad-4d7e-9076-4645b095a315" Jul 22 16:22:30.308424 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.308256 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-wb5db\"" Jul 22 16:22:30.308552 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.308531 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 22 16:22:30.309478 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.309461 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-qn7tr" Jul 22 16:22:30.310026 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.309989 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 22 16:22:30.311462 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.311429 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2gf2v" Jul 22 16:22:30.311958 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.311938 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 22 16:22:30.312487 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.312431 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 22 16:22:30.312777 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.312569 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-k6vj2\"" Jul 22 16:22:30.312777 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.312755 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 22 16:22:30.314117 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.314098 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-4tfrq\"" Jul 22 16:22:30.314334 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.314318 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 22 16:22:30.314625 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.314609 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-knwpl" Jul 22 16:22:30.317282 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.316673 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vtpvm" Jul 22 16:22:30.317282 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:22:30.316741 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vtpvm" podUID="e16caaed-7d7c-44de-8a3d-c45cbfa12b72" Jul 22 16:22:30.317282 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.316994 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1bf44bf4-3297-45b6-bfc0-0c54fb144110-systemd-units\") pod \"ovnkube-node-4xxp4\" (UID: \"1bf44bf4-3297-45b6-bfc0-0c54fb144110\") " pod="openshift-ovn-kubernetes/ovnkube-node-4xxp4" Jul 22 16:22:30.317282 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.317024 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1bf44bf4-3297-45b6-bfc0-0c54fb144110-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4xxp4\" (UID: \"1bf44bf4-3297-45b6-bfc0-0c54fb144110\") " pod="openshift-ovn-kubernetes/ovnkube-node-4xxp4" Jul 22 16:22:30.317282 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.317053 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b1e896dc-8494-4f9c-95b6-77337241e679-tmp\") pod \"tuned-crkls\" (UID: \"b1e896dc-8494-4f9c-95b6-77337241e679\") " pod="openshift-cluster-node-tuning-operator/tuned-crkls" Jul 22 16:22:30.317282 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.317076 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4834a81b-7ace-458e-8d65-6278acbd40bf-tuning-conf-dir\") pod \"multus-additional-cni-plugins-swk9r\" (UID: \"4834a81b-7ace-458e-8d65-6278acbd40bf\") " pod="openshift-multus/multus-additional-cni-plugins-swk9r" Jul 22 16:22:30.317282 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.317102 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4834a81b-7ace-458e-8d65-6278acbd40bf-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-swk9r\" (UID: \"4834a81b-7ace-458e-8d65-6278acbd40bf\") " pod="openshift-multus/multus-additional-cni-plugins-swk9r" Jul 22 16:22:30.317282 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.317124 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/919e9190-67ad-4d7e-9076-4645b095a315-metrics-certs\") pod \"network-metrics-daemon-bknjp\" (UID: \"919e9190-67ad-4d7e-9076-4645b095a315\") " pod="openshift-multus/network-metrics-daemon-bknjp" Jul 22 16:22:30.317282 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.317149 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1bf44bf4-3297-45b6-bfc0-0c54fb144110-run-openvswitch\") pod \"ovnkube-node-4xxp4\" (UID: \"1bf44bf4-3297-45b6-bfc0-0c54fb144110\") " pod="openshift-ovn-kubernetes/ovnkube-node-4xxp4" Jul 22 16:22:30.317282 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.317173 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1bf44bf4-3297-45b6-bfc0-0c54fb144110-log-socket\") pod \"ovnkube-node-4xxp4\" (UID: \"1bf44bf4-3297-45b6-bfc0-0c54fb144110\") " pod="openshift-ovn-kubernetes/ovnkube-node-4xxp4" Jul 22 16:22:30.317282 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.317196 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1bf44bf4-3297-45b6-bfc0-0c54fb144110-host-cni-bin\") pod \"ovnkube-node-4xxp4\" (UID: \"1bf44bf4-3297-45b6-bfc0-0c54fb144110\") " pod="openshift-ovn-kubernetes/ovnkube-node-4xxp4" Jul 22 16:22:30.317282 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.317220 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bnrcr\" (UniqueName: \"kubernetes.io/projected/b1e896dc-8494-4f9c-95b6-77337241e679-kube-api-access-bnrcr\") pod \"tuned-crkls\" (UID: \"b1e896dc-8494-4f9c-95b6-77337241e679\") " pod="openshift-cluster-node-tuning-operator/tuned-crkls" Jul 22 16:22:30.317282 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.317254 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b8064dd5-313d-433d-8efe-5035350319bf-host\") pod \"node-ca-v887c\" (UID: \"b8064dd5-313d-433d-8efe-5035350319bf\") " pod="openshift-image-registry/node-ca-v887c" Jul 22 16:22:30.317282 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.317268 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 22 16:22:30.318009 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.317276 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1bf44bf4-3297-45b6-bfc0-0c54fb144110-node-log\") pod \"ovnkube-node-4xxp4\" (UID: \"1bf44bf4-3297-45b6-bfc0-0c54fb144110\") " pod="openshift-ovn-kubernetes/ovnkube-node-4xxp4" Jul 22 16:22:30.318009 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.317339 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1bf44bf4-3297-45b6-bfc0-0c54fb144110-host-run-ovn-kubernetes\") pod \"ovnkube-node-4xxp4\" (UID: \"1bf44bf4-3297-45b6-bfc0-0c54fb144110\") " pod="openshift-ovn-kubernetes/ovnkube-node-4xxp4" Jul 22 16:22:30.318009 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.317383 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1bf44bf4-3297-45b6-bfc0-0c54fb144110-host-cni-netd\") pod \"ovnkube-node-4xxp4\" (UID: \"1bf44bf4-3297-45b6-bfc0-0c54fb144110\") " pod="openshift-ovn-kubernetes/ovnkube-node-4xxp4" Jul 22 16:22:30.318009 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.317408 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1bf44bf4-3297-45b6-bfc0-0c54fb144110-env-overrides\") pod \"ovnkube-node-4xxp4\" (UID: \"1bf44bf4-3297-45b6-bfc0-0c54fb144110\") " pod="openshift-ovn-kubernetes/ovnkube-node-4xxp4" Jul 22 16:22:30.318009 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.317432 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-654kt\" (UniqueName: \"kubernetes.io/projected/1bf44bf4-3297-45b6-bfc0-0c54fb144110-kube-api-access-654kt\") pod \"ovnkube-node-4xxp4\" (UID: \"1bf44bf4-3297-45b6-bfc0-0c54fb144110\") " pod="openshift-ovn-kubernetes/ovnkube-node-4xxp4" Jul 22 16:22:30.318009 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.317455 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b1e896dc-8494-4f9c-95b6-77337241e679-etc-sysctl-conf\") pod \"tuned-crkls\" (UID: \"b1e896dc-8494-4f9c-95b6-77337241e679\") " pod="openshift-cluster-node-tuning-operator/tuned-crkls" Jul 22 16:22:30.318009 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.317478 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b1e896dc-8494-4f9c-95b6-77337241e679-etc-systemd\") pod \"tuned-crkls\" (UID: \"b1e896dc-8494-4f9c-95b6-77337241e679\") " pod="openshift-cluster-node-tuning-operator/tuned-crkls" Jul 22 16:22:30.318009 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.317497 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 22 16:22:30.318009 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.317499 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b1e896dc-8494-4f9c-95b6-77337241e679-etc-tuned\") pod \"tuned-crkls\" (UID: \"b1e896dc-8494-4f9c-95b6-77337241e679\") " pod="openshift-cluster-node-tuning-operator/tuned-crkls" Jul 22 16:22:30.318009 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.317675 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/13fb19fd-9a49-4a7f-9c2f-aa4814848b48-agent-certs\") pod \"konnectivity-agent-8qfgq\" (UID: \"13fb19fd-9a49-4a7f-9c2f-aa4814848b48\") " pod="kube-system/konnectivity-agent-8qfgq" Jul 22 16:22:30.318009 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.317714 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1bf44bf4-3297-45b6-bfc0-0c54fb144110-host-run-netns\") pod \"ovnkube-node-4xxp4\" (UID: \"1bf44bf4-3297-45b6-bfc0-0c54fb144110\") " pod="openshift-ovn-kubernetes/ovnkube-node-4xxp4" Jul 22 16:22:30.318009 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.317744 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-42vjp\"" Jul 22 16:22:30.318009 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.317748 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1bf44bf4-3297-45b6-bfc0-0c54fb144110-ovnkube-config\") pod \"ovnkube-node-4xxp4\" (UID: \"1bf44bf4-3297-45b6-bfc0-0c54fb144110\") " pod="openshift-ovn-kubernetes/ovnkube-node-4xxp4" Jul 22 16:22:30.318009 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.317798 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 22 16:22:30.318009 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.317804 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1bf44bf4-3297-45b6-bfc0-0c54fb144110-ovnkube-script-lib\") pod \"ovnkube-node-4xxp4\" (UID: \"1bf44bf4-3297-45b6-bfc0-0c54fb144110\") " pod="openshift-ovn-kubernetes/ovnkube-node-4xxp4" Jul 22 16:22:30.318009 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.317827 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b1e896dc-8494-4f9c-95b6-77337241e679-etc-sysconfig\") pod \"tuned-crkls\" (UID: \"b1e896dc-8494-4f9c-95b6-77337241e679\") " pod="openshift-cluster-node-tuning-operator/tuned-crkls" Jul 22 16:22:30.318009 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.317848 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b1e896dc-8494-4f9c-95b6-77337241e679-etc-kubernetes\") pod \"tuned-crkls\" (UID: \"b1e896dc-8494-4f9c-95b6-77337241e679\") " pod="openshift-cluster-node-tuning-operator/tuned-crkls" Jul 22 16:22:30.318009 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.317870 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b1e896dc-8494-4f9c-95b6-77337241e679-run\") pod \"tuned-crkls\" (UID: \"b1e896dc-8494-4f9c-95b6-77337241e679\") " pod="openshift-cluster-node-tuning-operator/tuned-crkls" Jul 22 16:22:30.318795 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.317890 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b1e896dc-8494-4f9c-95b6-77337241e679-sys\") pod \"tuned-crkls\" (UID: \"b1e896dc-8494-4f9c-95b6-77337241e679\") " pod="openshift-cluster-node-tuning-operator/tuned-crkls" Jul 22 16:22:30.318795 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.317926 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b8064dd5-313d-433d-8efe-5035350319bf-serviceca\") pod \"node-ca-v887c\" (UID: \"b8064dd5-313d-433d-8efe-5035350319bf\") " pod="openshift-image-registry/node-ca-v887c" Jul 22 16:22:30.318795 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.317951 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1bf44bf4-3297-45b6-bfc0-0c54fb144110-etc-openvswitch\") pod \"ovnkube-node-4xxp4\" (UID: \"1bf44bf4-3297-45b6-bfc0-0c54fb144110\") " pod="openshift-ovn-kubernetes/ovnkube-node-4xxp4" Jul 22 16:22:30.318795 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.318005 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1bf44bf4-3297-45b6-bfc0-0c54fb144110-ovn-node-metrics-cert\") pod \"ovnkube-node-4xxp4\" (UID: \"1bf44bf4-3297-45b6-bfc0-0c54fb144110\") " pod="openshift-ovn-kubernetes/ovnkube-node-4xxp4" Jul 22 16:22:30.318795 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.318041 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b1e896dc-8494-4f9c-95b6-77337241e679-lib-modules\") pod \"tuned-crkls\" (UID: \"b1e896dc-8494-4f9c-95b6-77337241e679\") " pod="openshift-cluster-node-tuning-operator/tuned-crkls" Jul 22 16:22:30.318795 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.318069 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b1e896dc-8494-4f9c-95b6-77337241e679-var-lib-kubelet\") pod \"tuned-crkls\" (UID: \"b1e896dc-8494-4f9c-95b6-77337241e679\") " pod="openshift-cluster-node-tuning-operator/tuned-crkls" Jul 22 16:22:30.318795 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.318094 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/13fb19fd-9a49-4a7f-9c2f-aa4814848b48-konnectivity-ca\") pod \"konnectivity-agent-8qfgq\" (UID: \"13fb19fd-9a49-4a7f-9c2f-aa4814848b48\") " pod="kube-system/konnectivity-agent-8qfgq" Jul 22 16:22:30.318795 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.318131 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4834a81b-7ace-458e-8d65-6278acbd40bf-cni-binary-copy\") pod \"multus-additional-cni-plugins-swk9r\" (UID: \"4834a81b-7ace-458e-8d65-6278acbd40bf\") " pod="openshift-multus/multus-additional-cni-plugins-swk9r" Jul 22 16:22:30.318795 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.318165 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-trnm4\" (UniqueName: \"kubernetes.io/projected/919e9190-67ad-4d7e-9076-4645b095a315-kube-api-access-trnm4\") pod \"network-metrics-daemon-bknjp\" (UID: \"919e9190-67ad-4d7e-9076-4645b095a315\") " pod="openshift-multus/network-metrics-daemon-bknjp" Jul 22 16:22:30.318795 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.318202 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1bf44bf4-3297-45b6-bfc0-0c54fb144110-run-systemd\") pod \"ovnkube-node-4xxp4\" (UID: \"1bf44bf4-3297-45b6-bfc0-0c54fb144110\") " pod="openshift-ovn-kubernetes/ovnkube-node-4xxp4" Jul 22 16:22:30.318795 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.318225 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1bf44bf4-3297-45b6-bfc0-0c54fb144110-var-lib-openvswitch\") pod \"ovnkube-node-4xxp4\" (UID: \"1bf44bf4-3297-45b6-bfc0-0c54fb144110\") " pod="openshift-ovn-kubernetes/ovnkube-node-4xxp4" Jul 22 16:22:30.318795 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.318258 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4834a81b-7ace-458e-8d65-6278acbd40bf-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-swk9r\" (UID: \"4834a81b-7ace-458e-8d65-6278acbd40bf\") " pod="openshift-multus/multus-additional-cni-plugins-swk9r" Jul 22 16:22:30.318795 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.318282 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6nsfh\" (UniqueName: \"kubernetes.io/projected/4834a81b-7ace-458e-8d65-6278acbd40bf-kube-api-access-6nsfh\") pod \"multus-additional-cni-plugins-swk9r\" (UID: \"4834a81b-7ace-458e-8d65-6278acbd40bf\") " pod="openshift-multus/multus-additional-cni-plugins-swk9r" Jul 22 16:22:30.318795 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.318308 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1bf44bf4-3297-45b6-bfc0-0c54fb144110-run-ovn\") pod \"ovnkube-node-4xxp4\" (UID: \"1bf44bf4-3297-45b6-bfc0-0c54fb144110\") " pod="openshift-ovn-kubernetes/ovnkube-node-4xxp4" Jul 22 16:22:30.318795 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.318372 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b1e896dc-8494-4f9c-95b6-77337241e679-etc-sysctl-d\") pod \"tuned-crkls\" (UID: \"b1e896dc-8494-4f9c-95b6-77337241e679\") " pod="openshift-cluster-node-tuning-operator/tuned-crkls" Jul 22 16:22:30.318795 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.318399 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b1e896dc-8494-4f9c-95b6-77337241e679-host\") pod \"tuned-crkls\" (UID: \"b1e896dc-8494-4f9c-95b6-77337241e679\") " pod="openshift-cluster-node-tuning-operator/tuned-crkls" Jul 22 16:22:30.319662 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.318423 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4834a81b-7ace-458e-8d65-6278acbd40bf-cnibin\") pod \"multus-additional-cni-plugins-swk9r\" (UID: \"4834a81b-7ace-458e-8d65-6278acbd40bf\") " pod="openshift-multus/multus-additional-cni-plugins-swk9r" Jul 22 16:22:30.319662 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.318446 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hb5tf\" (UniqueName: \"kubernetes.io/projected/b8064dd5-313d-433d-8efe-5035350319bf-kube-api-access-hb5tf\") pod \"node-ca-v887c\" (UID: \"b8064dd5-313d-433d-8efe-5035350319bf\") " pod="openshift-image-registry/node-ca-v887c" Jul 22 16:22:30.319662 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.318482 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1bf44bf4-3297-45b6-bfc0-0c54fb144110-host-kubelet\") pod \"ovnkube-node-4xxp4\" (UID: \"1bf44bf4-3297-45b6-bfc0-0c54fb144110\") " pod="openshift-ovn-kubernetes/ovnkube-node-4xxp4" Jul 22 16:22:30.319662 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.318564 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1bf44bf4-3297-45b6-bfc0-0c54fb144110-host-slash\") pod \"ovnkube-node-4xxp4\" (UID: \"1bf44bf4-3297-45b6-bfc0-0c54fb144110\") " pod="openshift-ovn-kubernetes/ovnkube-node-4xxp4" Jul 22 16:22:30.319662 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.318593 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b1e896dc-8494-4f9c-95b6-77337241e679-etc-modprobe-d\") pod \"tuned-crkls\" (UID: \"b1e896dc-8494-4f9c-95b6-77337241e679\") " pod="openshift-cluster-node-tuning-operator/tuned-crkls" Jul 22 16:22:30.319662 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.318627 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4834a81b-7ace-458e-8d65-6278acbd40bf-system-cni-dir\") pod \"multus-additional-cni-plugins-swk9r\" (UID: \"4834a81b-7ace-458e-8d65-6278acbd40bf\") " pod="openshift-multus/multus-additional-cni-plugins-swk9r" Jul 22 16:22:30.319662 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.318652 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4834a81b-7ace-458e-8d65-6278acbd40bf-os-release\") pod \"multus-additional-cni-plugins-swk9r\" (UID: \"4834a81b-7ace-458e-8d65-6278acbd40bf\") " pod="openshift-multus/multus-additional-cni-plugins-swk9r" Jul 22 16:22:30.319662 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.319527 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hwfst" Jul 22 16:22:30.319662 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:22:30.319581 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hwfst" podUID="9a66c706-f3c0-4662-9053-ba2d4ac30e25" Jul 22 16:22:30.320508 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.320311 2568 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 22 16:22:30.321862 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.321778 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-mzcc2" Jul 22 16:22:30.325159 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.324320 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 22 16:22:30.325159 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.324551 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 22 16:22:30.325159 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.324733 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-tdp5t\"" Jul 22 16:22:30.339139 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.339110 2568 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-zcgzb" Jul 22 16:22:30.348514 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.348290 2568 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-zcgzb" Jul 22 16:22:30.407467 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.407442 2568 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 22 16:22:30.410279 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.410233 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-47.ec2.internal" event={"ID":"aa9e2291606c92d6ab1f0ef1e722964e","Type":"ContainerStarted","Data":"69c52f0f9cbd319afb2128bfd62da9033e0bd120c58ee875953c364d3f9501d9"} Jul 22 16:22:30.411880 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.411854 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-47.ec2.internal" event={"ID":"6c389acabb6147062a64e9641790fbaa","Type":"ContainerStarted","Data":"c4fbb2e5ab2d4fce997b0cee04557e6616e901ee725aa7e914487b08bbdba73f"} Jul 22 16:22:30.418983 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.418943 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b1e896dc-8494-4f9c-95b6-77337241e679-etc-sysctl-d\") pod \"tuned-crkls\" (UID: \"b1e896dc-8494-4f9c-95b6-77337241e679\") " pod="openshift-cluster-node-tuning-operator/tuned-crkls" Jul 22 16:22:30.419119 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.418986 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b1e896dc-8494-4f9c-95b6-77337241e679-host\") pod \"tuned-crkls\" (UID: \"b1e896dc-8494-4f9c-95b6-77337241e679\") " pod="openshift-cluster-node-tuning-operator/tuned-crkls" Jul 22 16:22:30.419119 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.419012 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4834a81b-7ace-458e-8d65-6278acbd40bf-cnibin\") pod \"multus-additional-cni-plugins-swk9r\" (UID: \"4834a81b-7ace-458e-8d65-6278acbd40bf\") " pod="openshift-multus/multus-additional-cni-plugins-swk9r" Jul 22 16:22:30.419119 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.419075 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hb5tf\" (UniqueName: \"kubernetes.io/projected/b8064dd5-313d-433d-8efe-5035350319bf-kube-api-access-hb5tf\") pod \"node-ca-v887c\" (UID: \"b8064dd5-313d-433d-8efe-5035350319bf\") " pod="openshift-image-registry/node-ca-v887c" Jul 22 16:22:30.419119 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.419108 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0c475b43-8ce3-4769-bf39-7a7c07dd92e1-host-var-lib-cni-bin\") pod \"multus-2gf2v\" (UID: \"0c475b43-8ce3-4769-bf39-7a7c07dd92e1\") " pod="openshift-multus/multus-2gf2v" Jul 22 16:22:30.419426 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.419135 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b1e896dc-8494-4f9c-95b6-77337241e679-etc-modprobe-d\") pod \"tuned-crkls\" (UID: \"b1e896dc-8494-4f9c-95b6-77337241e679\") " pod="openshift-cluster-node-tuning-operator/tuned-crkls" Jul 22 16:22:30.419426 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.419158 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4834a81b-7ace-458e-8d65-6278acbd40bf-system-cni-dir\") pod \"multus-additional-cni-plugins-swk9r\" (UID: \"4834a81b-7ace-458e-8d65-6278acbd40bf\") " pod="openshift-multus/multus-additional-cni-plugins-swk9r" Jul 22 16:22:30.419426 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.419182 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4834a81b-7ace-458e-8d65-6278acbd40bf-os-release\") pod \"multus-additional-cni-plugins-swk9r\" (UID: \"4834a81b-7ace-458e-8d65-6278acbd40bf\") " pod="openshift-multus/multus-additional-cni-plugins-swk9r" Jul 22 16:22:30.419426 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.419207 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-czr5x\" (UniqueName: \"kubernetes.io/projected/a9d52486-cc0c-43d2-99b7-c6cc4be4768d-kube-api-access-czr5x\") pod \"iptables-alerter-qn7tr\" (UID: \"a9d52486-cc0c-43d2-99b7-c6cc4be4768d\") " pod="openshift-network-operator/iptables-alerter-qn7tr" Jul 22 16:22:30.419426 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.419234 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0c475b43-8ce3-4769-bf39-7a7c07dd92e1-multus-socket-dir-parent\") pod \"multus-2gf2v\" (UID: \"0c475b43-8ce3-4769-bf39-7a7c07dd92e1\") " pod="openshift-multus/multus-2gf2v" Jul 22 16:22:30.419426 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.419261 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e16caaed-7d7c-44de-8a3d-c45cbfa12b72-dbus\") pod \"global-pull-secret-syncer-vtpvm\" (UID: \"e16caaed-7d7c-44de-8a3d-c45cbfa12b72\") " pod="kube-system/global-pull-secret-syncer-vtpvm" Jul 22 16:22:30.419426 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.419301 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b1e896dc-8494-4f9c-95b6-77337241e679-tmp\") pod \"tuned-crkls\" (UID: \"b1e896dc-8494-4f9c-95b6-77337241e679\") " pod="openshift-cluster-node-tuning-operator/tuned-crkls" Jul 22 16:22:30.419426 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.419325 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1bf44bf4-3297-45b6-bfc0-0c54fb144110-run-openvswitch\") pod \"ovnkube-node-4xxp4\" (UID: \"1bf44bf4-3297-45b6-bfc0-0c54fb144110\") " pod="openshift-ovn-kubernetes/ovnkube-node-4xxp4" Jul 22 16:22:30.419426 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.419367 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1bf44bf4-3297-45b6-bfc0-0c54fb144110-log-socket\") pod \"ovnkube-node-4xxp4\" (UID: \"1bf44bf4-3297-45b6-bfc0-0c54fb144110\") " pod="openshift-ovn-kubernetes/ovnkube-node-4xxp4" Jul 22 16:22:30.419426 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.419405 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0c475b43-8ce3-4769-bf39-7a7c07dd92e1-multus-daemon-config\") pod \"multus-2gf2v\" (UID: \"0c475b43-8ce3-4769-bf39-7a7c07dd92e1\") " pod="openshift-multus/multus-2gf2v" Jul 22 16:22:30.419899 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.419441 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bnrcr\" (UniqueName: \"kubernetes.io/projected/b1e896dc-8494-4f9c-95b6-77337241e679-kube-api-access-bnrcr\") pod \"tuned-crkls\" (UID: \"b1e896dc-8494-4f9c-95b6-77337241e679\") " pod="openshift-cluster-node-tuning-operator/tuned-crkls" Jul 22 16:22:30.419899 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.419463 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b8064dd5-313d-433d-8efe-5035350319bf-host\") pod \"node-ca-v887c\" (UID: \"b8064dd5-313d-433d-8efe-5035350319bf\") " pod="openshift-image-registry/node-ca-v887c" Jul 22 16:22:30.419899 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.419487 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1bf44bf4-3297-45b6-bfc0-0c54fb144110-host-run-ovn-kubernetes\") pod \"ovnkube-node-4xxp4\" (UID: \"1bf44bf4-3297-45b6-bfc0-0c54fb144110\") " pod="openshift-ovn-kubernetes/ovnkube-node-4xxp4" Jul 22 16:22:30.419899 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.419513 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/49c0194f-7df7-4118-83b1-c0a73004279e-sys-fs\") pod \"aws-ebs-csi-driver-node-knwpl\" (UID: \"49c0194f-7df7-4118-83b1-c0a73004279e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-knwpl" Jul 22 16:22:30.419899 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.419518 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4834a81b-7ace-458e-8d65-6278acbd40bf-cnibin\") pod \"multus-additional-cni-plugins-swk9r\" (UID: \"4834a81b-7ace-458e-8d65-6278acbd40bf\") " pod="openshift-multus/multus-additional-cni-plugins-swk9r" Jul 22 16:22:30.419899 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.419538 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0c475b43-8ce3-4769-bf39-7a7c07dd92e1-host-var-lib-kubelet\") pod \"multus-2gf2v\" (UID: \"0c475b43-8ce3-4769-bf39-7a7c07dd92e1\") " pod="openshift-multus/multus-2gf2v" Jul 22 16:22:30.419899 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.419563 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b1e896dc-8494-4f9c-95b6-77337241e679-etc-systemd\") pod \"tuned-crkls\" (UID: \"b1e896dc-8494-4f9c-95b6-77337241e679\") " pod="openshift-cluster-node-tuning-operator/tuned-crkls" Jul 22 16:22:30.419899 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.419608 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1bf44bf4-3297-45b6-bfc0-0c54fb144110-host-run-netns\") pod \"ovnkube-node-4xxp4\" (UID: \"1bf44bf4-3297-45b6-bfc0-0c54fb144110\") " pod="openshift-ovn-kubernetes/ovnkube-node-4xxp4" Jul 22 16:22:30.419899 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.419633 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/61d5f4c6-746e-4e0f-b35f-7befc6da325f-hosts-file\") pod \"node-resolver-mzcc2\" (UID: \"61d5f4c6-746e-4e0f-b35f-7befc6da325f\") " pod="openshift-dns/node-resolver-mzcc2" Jul 22 16:22:30.419899 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.419657 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b1e896dc-8494-4f9c-95b6-77337241e679-etc-sysconfig\") pod \"tuned-crkls\" (UID: \"b1e896dc-8494-4f9c-95b6-77337241e679\") " pod="openshift-cluster-node-tuning-operator/tuned-crkls" Jul 22 16:22:30.419899 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.419693 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b1e896dc-8494-4f9c-95b6-77337241e679-etc-kubernetes\") pod \"tuned-crkls\" (UID: \"b1e896dc-8494-4f9c-95b6-77337241e679\") " pod="openshift-cluster-node-tuning-operator/tuned-crkls" Jul 22 16:22:30.419899 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.419716 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b1e896dc-8494-4f9c-95b6-77337241e679-run\") pod \"tuned-crkls\" (UID: \"b1e896dc-8494-4f9c-95b6-77337241e679\") " pod="openshift-cluster-node-tuning-operator/tuned-crkls" Jul 22 16:22:30.419899 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.419744 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b1e896dc-8494-4f9c-95b6-77337241e679-sys\") pod \"tuned-crkls\" (UID: \"b1e896dc-8494-4f9c-95b6-77337241e679\") " pod="openshift-cluster-node-tuning-operator/tuned-crkls" Jul 22 16:22:30.419899 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.419768 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1bf44bf4-3297-45b6-bfc0-0c54fb144110-ovn-node-metrics-cert\") pod \"ovnkube-node-4xxp4\" (UID: \"1bf44bf4-3297-45b6-bfc0-0c54fb144110\") " pod="openshift-ovn-kubernetes/ovnkube-node-4xxp4" Jul 22 16:22:30.419899 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.419793 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0c475b43-8ce3-4769-bf39-7a7c07dd92e1-cni-binary-copy\") pod \"multus-2gf2v\" (UID: \"0c475b43-8ce3-4769-bf39-7a7c07dd92e1\") " pod="openshift-multus/multus-2gf2v" Jul 22 16:22:30.419899 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.419829 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0c475b43-8ce3-4769-bf39-7a7c07dd92e1-host-run-netns\") pod \"multus-2gf2v\" (UID: \"0c475b43-8ce3-4769-bf39-7a7c07dd92e1\") " pod="openshift-multus/multus-2gf2v" Jul 22 16:22:30.419899 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.419851 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0c475b43-8ce3-4769-bf39-7a7c07dd92e1-etc-kubernetes\") pod \"multus-2gf2v\" (UID: \"0c475b43-8ce3-4769-bf39-7a7c07dd92e1\") " pod="openshift-multus/multus-2gf2v" Jul 22 16:22:30.420704 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.419879 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b1e896dc-8494-4f9c-95b6-77337241e679-lib-modules\") pod \"tuned-crkls\" (UID: \"b1e896dc-8494-4f9c-95b6-77337241e679\") " pod="openshift-cluster-node-tuning-operator/tuned-crkls" Jul 22 16:22:30.420704 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.419868 2568 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 22 16:22:30.420704 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.419907 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/13fb19fd-9a49-4a7f-9c2f-aa4814848b48-konnectivity-ca\") pod \"konnectivity-agent-8qfgq\" (UID: \"13fb19fd-9a49-4a7f-9c2f-aa4814848b48\") " pod="kube-system/konnectivity-agent-8qfgq" Jul 22 16:22:30.420704 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.419932 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/49c0194f-7df7-4118-83b1-c0a73004279e-registration-dir\") pod \"aws-ebs-csi-driver-node-knwpl\" (UID: \"49c0194f-7df7-4118-83b1-c0a73004279e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-knwpl" Jul 22 16:22:30.420704 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.419957 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/49c0194f-7df7-4118-83b1-c0a73004279e-device-dir\") pod \"aws-ebs-csi-driver-node-knwpl\" (UID: \"49c0194f-7df7-4118-83b1-c0a73004279e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-knwpl" Jul 22 16:22:30.420704 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.419985 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0c475b43-8ce3-4769-bf39-7a7c07dd92e1-multus-cni-dir\") pod \"multus-2gf2v\" (UID: \"0c475b43-8ce3-4769-bf39-7a7c07dd92e1\") " pod="openshift-multus/multus-2gf2v" Jul 22 16:22:30.420704 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.420019 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/61d5f4c6-746e-4e0f-b35f-7befc6da325f-tmp-dir\") pod \"node-resolver-mzcc2\" (UID: \"61d5f4c6-746e-4e0f-b35f-7befc6da325f\") " pod="openshift-dns/node-resolver-mzcc2" Jul 22 16:22:30.420704 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.420043 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/49c0194f-7df7-4118-83b1-c0a73004279e-etc-selinux\") pod \"aws-ebs-csi-driver-node-knwpl\" (UID: \"49c0194f-7df7-4118-83b1-c0a73004279e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-knwpl" Jul 22 16:22:30.420704 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.420067 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8khws\" (UniqueName: \"kubernetes.io/projected/0c475b43-8ce3-4769-bf39-7a7c07dd92e1-kube-api-access-8khws\") pod \"multus-2gf2v\" (UID: \"0c475b43-8ce3-4769-bf39-7a7c07dd92e1\") " pod="openshift-multus/multus-2gf2v" Jul 22 16:22:30.420704 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.420093 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1bf44bf4-3297-45b6-bfc0-0c54fb144110-host-kubelet\") pod \"ovnkube-node-4xxp4\" (UID: \"1bf44bf4-3297-45b6-bfc0-0c54fb144110\") " pod="openshift-ovn-kubernetes/ovnkube-node-4xxp4" Jul 22 16:22:30.420704 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.420135 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1bf44bf4-3297-45b6-bfc0-0c54fb144110-host-slash\") pod \"ovnkube-node-4xxp4\" (UID: \"1bf44bf4-3297-45b6-bfc0-0c54fb144110\") " pod="openshift-ovn-kubernetes/ovnkube-node-4xxp4" Jul 22 16:22:30.420704 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.420159 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0c475b43-8ce3-4769-bf39-7a7c07dd92e1-host-run-k8s-cni-cncf-io\") pod \"multus-2gf2v\" (UID: \"0c475b43-8ce3-4769-bf39-7a7c07dd92e1\") " pod="openshift-multus/multus-2gf2v" Jul 22 16:22:30.420704 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.420183 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0c475b43-8ce3-4769-bf39-7a7c07dd92e1-host-run-multus-certs\") pod \"multus-2gf2v\" (UID: \"0c475b43-8ce3-4769-bf39-7a7c07dd92e1\") " pod="openshift-multus/multus-2gf2v" Jul 22 16:22:30.420704 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.420187 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b1e896dc-8494-4f9c-95b6-77337241e679-etc-modprobe-d\") pod \"tuned-crkls\" (UID: \"b1e896dc-8494-4f9c-95b6-77337241e679\") " pod="openshift-cluster-node-tuning-operator/tuned-crkls" Jul 22 16:22:30.420704 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.420207 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1bf44bf4-3297-45b6-bfc0-0c54fb144110-systemd-units\") pod \"ovnkube-node-4xxp4\" (UID: \"1bf44bf4-3297-45b6-bfc0-0c54fb144110\") " pod="openshift-ovn-kubernetes/ovnkube-node-4xxp4" Jul 22 16:22:30.420704 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.420234 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1bf44bf4-3297-45b6-bfc0-0c54fb144110-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4xxp4\" (UID: \"1bf44bf4-3297-45b6-bfc0-0c54fb144110\") " pod="openshift-ovn-kubernetes/ovnkube-node-4xxp4" Jul 22 16:22:30.420704 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.419156 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b1e896dc-8494-4f9c-95b6-77337241e679-etc-sysctl-d\") pod \"tuned-crkls\" (UID: \"b1e896dc-8494-4f9c-95b6-77337241e679\") " pod="openshift-cluster-node-tuning-operator/tuned-crkls" Jul 22 16:22:30.421560 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.420263 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4834a81b-7ace-458e-8d65-6278acbd40bf-tuning-conf-dir\") pod \"multus-additional-cni-plugins-swk9r\" (UID: \"4834a81b-7ace-458e-8d65-6278acbd40bf\") " pod="openshift-multus/multus-additional-cni-plugins-swk9r" Jul 22 16:22:30.421560 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.420244 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4834a81b-7ace-458e-8d65-6278acbd40bf-system-cni-dir\") pod \"multus-additional-cni-plugins-swk9r\" (UID: \"4834a81b-7ace-458e-8d65-6278acbd40bf\") " pod="openshift-multus/multus-additional-cni-plugins-swk9r" Jul 22 16:22:30.421560 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.420307 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4834a81b-7ace-458e-8d65-6278acbd40bf-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-swk9r\" (UID: \"4834a81b-7ace-458e-8d65-6278acbd40bf\") " pod="openshift-multus/multus-additional-cni-plugins-swk9r" Jul 22 16:22:30.421560 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.420363 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1bf44bf4-3297-45b6-bfc0-0c54fb144110-host-slash\") pod \"ovnkube-node-4xxp4\" (UID: \"1bf44bf4-3297-45b6-bfc0-0c54fb144110\") " pod="openshift-ovn-kubernetes/ovnkube-node-4xxp4" Jul 22 16:22:30.421560 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.420411 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b1e896dc-8494-4f9c-95b6-77337241e679-host\") pod \"tuned-crkls\" (UID: \"b1e896dc-8494-4f9c-95b6-77337241e679\") " pod="openshift-cluster-node-tuning-operator/tuned-crkls" Jul 22 16:22:30.421560 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.420407 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b1e896dc-8494-4f9c-95b6-77337241e679-lib-modules\") pod \"tuned-crkls\" (UID: \"b1e896dc-8494-4f9c-95b6-77337241e679\") " pod="openshift-cluster-node-tuning-operator/tuned-crkls" Jul 22 16:22:30.421560 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.420440 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1bf44bf4-3297-45b6-bfc0-0c54fb144110-host-kubelet\") pod \"ovnkube-node-4xxp4\" (UID: \"1bf44bf4-3297-45b6-bfc0-0c54fb144110\") " pod="openshift-ovn-kubernetes/ovnkube-node-4xxp4" Jul 22 16:22:30.421560 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.420448 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1bf44bf4-3297-45b6-bfc0-0c54fb144110-run-openvswitch\") pod \"ovnkube-node-4xxp4\" (UID: \"1bf44bf4-3297-45b6-bfc0-0c54fb144110\") " pod="openshift-ovn-kubernetes/ovnkube-node-4xxp4" Jul 22 16:22:30.421560 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.420496 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1bf44bf4-3297-45b6-bfc0-0c54fb144110-log-socket\") pod \"ovnkube-node-4xxp4\" (UID: \"1bf44bf4-3297-45b6-bfc0-0c54fb144110\") " pod="openshift-ovn-kubernetes/ovnkube-node-4xxp4" Jul 22 16:22:30.421560 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.420522 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b1e896dc-8494-4f9c-95b6-77337241e679-etc-kubernetes\") pod \"tuned-crkls\" (UID: \"b1e896dc-8494-4f9c-95b6-77337241e679\") " pod="openshift-cluster-node-tuning-operator/tuned-crkls" Jul 22 16:22:30.421560 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.420523 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/919e9190-67ad-4d7e-9076-4645b095a315-metrics-certs\") pod \"network-metrics-daemon-bknjp\" (UID: \"919e9190-67ad-4d7e-9076-4645b095a315\") " pod="openshift-multus/network-metrics-daemon-bknjp" Jul 22 16:22:30.421560 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.420562 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1bf44bf4-3297-45b6-bfc0-0c54fb144110-host-cni-bin\") pod \"ovnkube-node-4xxp4\" (UID: \"1bf44bf4-3297-45b6-bfc0-0c54fb144110\") " pod="openshift-ovn-kubernetes/ovnkube-node-4xxp4" Jul 22 16:22:30.421560 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.420589 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1bf44bf4-3297-45b6-bfc0-0c54fb144110-env-overrides\") pod \"ovnkube-node-4xxp4\" (UID: \"1bf44bf4-3297-45b6-bfc0-0c54fb144110\") " pod="openshift-ovn-kubernetes/ovnkube-node-4xxp4" Jul 22 16:22:30.421560 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:22:30.420606 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 16:22:30.421560 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.420616 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-654kt\" (UniqueName: \"kubernetes.io/projected/1bf44bf4-3297-45b6-bfc0-0c54fb144110-kube-api-access-654kt\") pod \"ovnkube-node-4xxp4\" (UID: \"1bf44bf4-3297-45b6-bfc0-0c54fb144110\") " pod="openshift-ovn-kubernetes/ovnkube-node-4xxp4" Jul 22 16:22:30.421560 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.420643 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/49c0194f-7df7-4118-83b1-c0a73004279e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-knwpl\" (UID: \"49c0194f-7df7-4118-83b1-c0a73004279e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-knwpl" Jul 22 16:22:30.421560 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:22:30.420725 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/919e9190-67ad-4d7e-9076-4645b095a315-metrics-certs podName:919e9190-67ad-4d7e-9076-4645b095a315 nodeName:}" failed. No retries permitted until 2026-07-22 16:22:30.920656869 +0000 UTC m=+3.022272428 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/919e9190-67ad-4d7e-9076-4645b095a315-metrics-certs") pod "network-metrics-daemon-bknjp" (UID: "919e9190-67ad-4d7e-9076-4645b095a315") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 16:22:30.422309 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.420747 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1bf44bf4-3297-45b6-bfc0-0c54fb144110-node-log\") pod \"ovnkube-node-4xxp4\" (UID: \"1bf44bf4-3297-45b6-bfc0-0c54fb144110\") " pod="openshift-ovn-kubernetes/ovnkube-node-4xxp4" Jul 22 16:22:30.422309 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.420777 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1bf44bf4-3297-45b6-bfc0-0c54fb144110-host-cni-netd\") pod \"ovnkube-node-4xxp4\" (UID: \"1bf44bf4-3297-45b6-bfc0-0c54fb144110\") " pod="openshift-ovn-kubernetes/ovnkube-node-4xxp4" Jul 22 16:22:30.422309 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.420805 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dxdgm\" (UniqueName: \"kubernetes.io/projected/61d5f4c6-746e-4e0f-b35f-7befc6da325f-kube-api-access-dxdgm\") pod \"node-resolver-mzcc2\" (UID: \"61d5f4c6-746e-4e0f-b35f-7befc6da325f\") " pod="openshift-dns/node-resolver-mzcc2" Jul 22 16:22:30.422309 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.420832 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/49c0194f-7df7-4118-83b1-c0a73004279e-socket-dir\") pod \"aws-ebs-csi-driver-node-knwpl\" (UID: \"49c0194f-7df7-4118-83b1-c0a73004279e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-knwpl" Jul 22 16:22:30.422309 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.420858 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e16caaed-7d7c-44de-8a3d-c45cbfa12b72-kubelet-config\") pod \"global-pull-secret-syncer-vtpvm\" (UID: \"e16caaed-7d7c-44de-8a3d-c45cbfa12b72\") " pod="kube-system/global-pull-secret-syncer-vtpvm" Jul 22 16:22:30.422309 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.420875 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b8064dd5-313d-433d-8efe-5035350319bf-host\") pod \"node-ca-v887c\" (UID: \"b8064dd5-313d-433d-8efe-5035350319bf\") " pod="openshift-image-registry/node-ca-v887c" Jul 22 16:22:30.422309 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.420886 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e16caaed-7d7c-44de-8a3d-c45cbfa12b72-original-pull-secret\") pod \"global-pull-secret-syncer-vtpvm\" (UID: \"e16caaed-7d7c-44de-8a3d-c45cbfa12b72\") " pod="kube-system/global-pull-secret-syncer-vtpvm" Jul 22 16:22:30.422309 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.420913 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1bf44bf4-3297-45b6-bfc0-0c54fb144110-host-run-ovn-kubernetes\") pod \"ovnkube-node-4xxp4\" (UID: \"1bf44bf4-3297-45b6-bfc0-0c54fb144110\") " pod="openshift-ovn-kubernetes/ovnkube-node-4xxp4" Jul 22 16:22:30.422309 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.420968 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b1e896dc-8494-4f9c-95b6-77337241e679-etc-systemd\") pod \"tuned-crkls\" (UID: \"b1e896dc-8494-4f9c-95b6-77337241e679\") " pod="openshift-cluster-node-tuning-operator/tuned-crkls" Jul 22 16:22:30.422309 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.420991 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/13fb19fd-9a49-4a7f-9c2f-aa4814848b48-konnectivity-ca\") pod \"konnectivity-agent-8qfgq\" (UID: \"13fb19fd-9a49-4a7f-9c2f-aa4814848b48\") " pod="kube-system/konnectivity-agent-8qfgq" Jul 22 16:22:30.422309 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.420997 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1bf44bf4-3297-45b6-bfc0-0c54fb144110-host-run-netns\") pod \"ovnkube-node-4xxp4\" (UID: \"1bf44bf4-3297-45b6-bfc0-0c54fb144110\") " pod="openshift-ovn-kubernetes/ovnkube-node-4xxp4" Jul 22 16:22:30.422309 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.421032 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b1e896dc-8494-4f9c-95b6-77337241e679-etc-sysconfig\") pod \"tuned-crkls\" (UID: \"b1e896dc-8494-4f9c-95b6-77337241e679\") " pod="openshift-cluster-node-tuning-operator/tuned-crkls" Jul 22 16:22:30.422309 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.421073 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1bf44bf4-3297-45b6-bfc0-0c54fb144110-host-cni-bin\") pod \"ovnkube-node-4xxp4\" (UID: \"1bf44bf4-3297-45b6-bfc0-0c54fb144110\") " pod="openshift-ovn-kubernetes/ovnkube-node-4xxp4" Jul 22 16:22:30.422309 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.421124 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1bf44bf4-3297-45b6-bfc0-0c54fb144110-node-log\") pod \"ovnkube-node-4xxp4\" (UID: \"1bf44bf4-3297-45b6-bfc0-0c54fb144110\") " pod="openshift-ovn-kubernetes/ovnkube-node-4xxp4" Jul 22 16:22:30.422309 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.421167 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1bf44bf4-3297-45b6-bfc0-0c54fb144110-host-cni-netd\") pod \"ovnkube-node-4xxp4\" (UID: \"1bf44bf4-3297-45b6-bfc0-0c54fb144110\") " pod="openshift-ovn-kubernetes/ovnkube-node-4xxp4" Jul 22 16:22:30.422309 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.421449 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b1e896dc-8494-4f9c-95b6-77337241e679-sys\") pod \"tuned-crkls\" (UID: \"b1e896dc-8494-4f9c-95b6-77337241e679\") " pod="openshift-cluster-node-tuning-operator/tuned-crkls" Jul 22 16:22:30.422309 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.421483 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b1e896dc-8494-4f9c-95b6-77337241e679-run\") pod \"tuned-crkls\" (UID: \"b1e896dc-8494-4f9c-95b6-77337241e679\") " pod="openshift-cluster-node-tuning-operator/tuned-crkls" Jul 22 16:22:30.423126 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.421520 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4834a81b-7ace-458e-8d65-6278acbd40bf-os-release\") pod \"multus-additional-cni-plugins-swk9r\" (UID: \"4834a81b-7ace-458e-8d65-6278acbd40bf\") " pod="openshift-multus/multus-additional-cni-plugins-swk9r" Jul 22 16:22:30.423126 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.421532 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4834a81b-7ace-458e-8d65-6278acbd40bf-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-swk9r\" (UID: \"4834a81b-7ace-458e-8d65-6278acbd40bf\") " pod="openshift-multus/multus-additional-cni-plugins-swk9r" Jul 22 16:22:30.423126 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.421535 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b1e896dc-8494-4f9c-95b6-77337241e679-etc-sysctl-conf\") pod \"tuned-crkls\" (UID: \"b1e896dc-8494-4f9c-95b6-77337241e679\") " pod="openshift-cluster-node-tuning-operator/tuned-crkls" Jul 22 16:22:30.423126 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.421553 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1bf44bf4-3297-45b6-bfc0-0c54fb144110-env-overrides\") pod \"ovnkube-node-4xxp4\" (UID: \"1bf44bf4-3297-45b6-bfc0-0c54fb144110\") " pod="openshift-ovn-kubernetes/ovnkube-node-4xxp4" Jul 22 16:22:30.423126 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.421558 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1bf44bf4-3297-45b6-bfc0-0c54fb144110-systemd-units\") pod \"ovnkube-node-4xxp4\" (UID: \"1bf44bf4-3297-45b6-bfc0-0c54fb144110\") " pod="openshift-ovn-kubernetes/ovnkube-node-4xxp4" Jul 22 16:22:30.423126 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.421584 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b1e896dc-8494-4f9c-95b6-77337241e679-etc-tuned\") pod \"tuned-crkls\" (UID: \"b1e896dc-8494-4f9c-95b6-77337241e679\") " pod="openshift-cluster-node-tuning-operator/tuned-crkls" Jul 22 16:22:30.423126 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.421613 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/13fb19fd-9a49-4a7f-9c2f-aa4814848b48-agent-certs\") pod \"konnectivity-agent-8qfgq\" (UID: \"13fb19fd-9a49-4a7f-9c2f-aa4814848b48\") " pod="kube-system/konnectivity-agent-8qfgq" Jul 22 16:22:30.423126 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.421641 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b1e896dc-8494-4f9c-95b6-77337241e679-etc-sysctl-conf\") pod \"tuned-crkls\" (UID: \"b1e896dc-8494-4f9c-95b6-77337241e679\") " pod="openshift-cluster-node-tuning-operator/tuned-crkls" Jul 22 16:22:30.423126 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.421586 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1bf44bf4-3297-45b6-bfc0-0c54fb144110-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4xxp4\" (UID: \"1bf44bf4-3297-45b6-bfc0-0c54fb144110\") " pod="openshift-ovn-kubernetes/ovnkube-node-4xxp4" Jul 22 16:22:30.423126 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.421682 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1bf44bf4-3297-45b6-bfc0-0c54fb144110-ovnkube-config\") pod \"ovnkube-node-4xxp4\" (UID: \"1bf44bf4-3297-45b6-bfc0-0c54fb144110\") " pod="openshift-ovn-kubernetes/ovnkube-node-4xxp4" Jul 22 16:22:30.423126 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.421709 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4834a81b-7ace-458e-8d65-6278acbd40bf-tuning-conf-dir\") pod \"multus-additional-cni-plugins-swk9r\" (UID: \"4834a81b-7ace-458e-8d65-6278acbd40bf\") " pod="openshift-multus/multus-additional-cni-plugins-swk9r" Jul 22 16:22:30.423126 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.421711 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1bf44bf4-3297-45b6-bfc0-0c54fb144110-ovnkube-script-lib\") pod \"ovnkube-node-4xxp4\" (UID: \"1bf44bf4-3297-45b6-bfc0-0c54fb144110\") " pod="openshift-ovn-kubernetes/ovnkube-node-4xxp4" Jul 22 16:22:30.423126 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.421748 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0c475b43-8ce3-4769-bf39-7a7c07dd92e1-system-cni-dir\") pod \"multus-2gf2v\" (UID: \"0c475b43-8ce3-4769-bf39-7a7c07dd92e1\") " pod="openshift-multus/multus-2gf2v" Jul 22 16:22:30.423126 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.421773 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0c475b43-8ce3-4769-bf39-7a7c07dd92e1-cnibin\") pod \"multus-2gf2v\" (UID: \"0c475b43-8ce3-4769-bf39-7a7c07dd92e1\") " pod="openshift-multus/multus-2gf2v" Jul 22 16:22:30.423126 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.421807 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0c475b43-8ce3-4769-bf39-7a7c07dd92e1-hostroot\") pod \"multus-2gf2v\" (UID: \"0c475b43-8ce3-4769-bf39-7a7c07dd92e1\") " pod="openshift-multus/multus-2gf2v" Jul 22 16:22:30.423126 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.421837 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b8064dd5-313d-433d-8efe-5035350319bf-serviceca\") pod \"node-ca-v887c\" (UID: \"b8064dd5-313d-433d-8efe-5035350319bf\") " pod="openshift-image-registry/node-ca-v887c" Jul 22 16:22:30.423126 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.421865 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1bf44bf4-3297-45b6-bfc0-0c54fb144110-etc-openvswitch\") pod \"ovnkube-node-4xxp4\" (UID: \"1bf44bf4-3297-45b6-bfc0-0c54fb144110\") " pod="openshift-ovn-kubernetes/ovnkube-node-4xxp4" Jul 22 16:22:30.423931 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.421933 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hsb6l\" (UniqueName: \"kubernetes.io/projected/9a66c706-f3c0-4662-9053-ba2d4ac30e25-kube-api-access-hsb6l\") pod \"network-check-target-hwfst\" (UID: \"9a66c706-f3c0-4662-9053-ba2d4ac30e25\") " pod="openshift-network-diagnostics/network-check-target-hwfst" Jul 22 16:22:30.423931 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.421958 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0c475b43-8ce3-4769-bf39-7a7c07dd92e1-os-release\") pod \"multus-2gf2v\" (UID: \"0c475b43-8ce3-4769-bf39-7a7c07dd92e1\") " pod="openshift-multus/multus-2gf2v" Jul 22 16:22:30.423931 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.421994 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0c475b43-8ce3-4769-bf39-7a7c07dd92e1-host-var-lib-cni-multus\") pod \"multus-2gf2v\" (UID: \"0c475b43-8ce3-4769-bf39-7a7c07dd92e1\") " pod="openshift-multus/multus-2gf2v" Jul 22 16:22:30.423931 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.422160 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1bf44bf4-3297-45b6-bfc0-0c54fb144110-ovnkube-script-lib\") pod \"ovnkube-node-4xxp4\" (UID: \"1bf44bf4-3297-45b6-bfc0-0c54fb144110\") " pod="openshift-ovn-kubernetes/ovnkube-node-4xxp4" Jul 22 16:22:30.423931 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.422257 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0c475b43-8ce3-4769-bf39-7a7c07dd92e1-multus-conf-dir\") pod \"multus-2gf2v\" (UID: \"0c475b43-8ce3-4769-bf39-7a7c07dd92e1\") " pod="openshift-multus/multus-2gf2v" Jul 22 16:22:30.423931 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.422302 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1bf44bf4-3297-45b6-bfc0-0c54fb144110-etc-openvswitch\") pod \"ovnkube-node-4xxp4\" (UID: \"1bf44bf4-3297-45b6-bfc0-0c54fb144110\") " pod="openshift-ovn-kubernetes/ovnkube-node-4xxp4" Jul 22 16:22:30.423931 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.422363 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b1e896dc-8494-4f9c-95b6-77337241e679-var-lib-kubelet\") pod \"tuned-crkls\" (UID: \"b1e896dc-8494-4f9c-95b6-77337241e679\") " pod="openshift-cluster-node-tuning-operator/tuned-crkls" Jul 22 16:22:30.423931 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.422413 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b1e896dc-8494-4f9c-95b6-77337241e679-var-lib-kubelet\") pod \"tuned-crkls\" (UID: \"b1e896dc-8494-4f9c-95b6-77337241e679\") " pod="openshift-cluster-node-tuning-operator/tuned-crkls" Jul 22 16:22:30.423931 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.422453 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4834a81b-7ace-458e-8d65-6278acbd40bf-cni-binary-copy\") pod \"multus-additional-cni-plugins-swk9r\" (UID: \"4834a81b-7ace-458e-8d65-6278acbd40bf\") " pod="openshift-multus/multus-additional-cni-plugins-swk9r" Jul 22 16:22:30.423931 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.422503 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-trnm4\" (UniqueName: \"kubernetes.io/projected/919e9190-67ad-4d7e-9076-4645b095a315-kube-api-access-trnm4\") pod \"network-metrics-daemon-bknjp\" (UID: \"919e9190-67ad-4d7e-9076-4645b095a315\") " pod="openshift-multus/network-metrics-daemon-bknjp" Jul 22 16:22:30.423931 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.422521 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b8064dd5-313d-433d-8efe-5035350319bf-serviceca\") pod \"node-ca-v887c\" (UID: \"b8064dd5-313d-433d-8efe-5035350319bf\") " pod="openshift-image-registry/node-ca-v887c" Jul 22 16:22:30.423931 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.422533 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1bf44bf4-3297-45b6-bfc0-0c54fb144110-run-systemd\") pod \"ovnkube-node-4xxp4\" (UID: \"1bf44bf4-3297-45b6-bfc0-0c54fb144110\") " pod="openshift-ovn-kubernetes/ovnkube-node-4xxp4" Jul 22 16:22:30.423931 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.422587 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1bf44bf4-3297-45b6-bfc0-0c54fb144110-run-systemd\") pod \"ovnkube-node-4xxp4\" (UID: \"1bf44bf4-3297-45b6-bfc0-0c54fb144110\") " pod="openshift-ovn-kubernetes/ovnkube-node-4xxp4" Jul 22 16:22:30.423931 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.422615 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1bf44bf4-3297-45b6-bfc0-0c54fb144110-ovnkube-config\") pod \"ovnkube-node-4xxp4\" (UID: \"1bf44bf4-3297-45b6-bfc0-0c54fb144110\") " pod="openshift-ovn-kubernetes/ovnkube-node-4xxp4" Jul 22 16:22:30.423931 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.422969 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4834a81b-7ace-458e-8d65-6278acbd40bf-cni-binary-copy\") pod \"multus-additional-cni-plugins-swk9r\" (UID: \"4834a81b-7ace-458e-8d65-6278acbd40bf\") " pod="openshift-multus/multus-additional-cni-plugins-swk9r" Jul 22 16:22:30.423931 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.423119 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1bf44bf4-3297-45b6-bfc0-0c54fb144110-var-lib-openvswitch\") pod \"ovnkube-node-4xxp4\" (UID: \"1bf44bf4-3297-45b6-bfc0-0c54fb144110\") " pod="openshift-ovn-kubernetes/ovnkube-node-4xxp4" Jul 22 16:22:30.423931 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.423165 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a9d52486-cc0c-43d2-99b7-c6cc4be4768d-iptables-alerter-script\") pod \"iptables-alerter-qn7tr\" (UID: \"a9d52486-cc0c-43d2-99b7-c6cc4be4768d\") " pod="openshift-network-operator/iptables-alerter-qn7tr" Jul 22 16:22:30.424759 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.423195 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1bf44bf4-3297-45b6-bfc0-0c54fb144110-var-lib-openvswitch\") pod \"ovnkube-node-4xxp4\" (UID: \"1bf44bf4-3297-45b6-bfc0-0c54fb144110\") " pod="openshift-ovn-kubernetes/ovnkube-node-4xxp4" Jul 22 16:22:30.424759 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.423238 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a9d52486-cc0c-43d2-99b7-c6cc4be4768d-host-slash\") pod \"iptables-alerter-qn7tr\" (UID: \"a9d52486-cc0c-43d2-99b7-c6cc4be4768d\") " pod="openshift-network-operator/iptables-alerter-qn7tr" Jul 22 16:22:30.424759 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.423277 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4834a81b-7ace-458e-8d65-6278acbd40bf-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-swk9r\" (UID: \"4834a81b-7ace-458e-8d65-6278acbd40bf\") " pod="openshift-multus/multus-additional-cni-plugins-swk9r" Jul 22 16:22:30.424759 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.423297 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6nsfh\" (UniqueName: \"kubernetes.io/projected/4834a81b-7ace-458e-8d65-6278acbd40bf-kube-api-access-6nsfh\") pod \"multus-additional-cni-plugins-swk9r\" (UID: \"4834a81b-7ace-458e-8d65-6278acbd40bf\") " pod="openshift-multus/multus-additional-cni-plugins-swk9r" Jul 22 16:22:30.424759 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.423327 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1bf44bf4-3297-45b6-bfc0-0c54fb144110-run-ovn\") pod \"ovnkube-node-4xxp4\" (UID: \"1bf44bf4-3297-45b6-bfc0-0c54fb144110\") " pod="openshift-ovn-kubernetes/ovnkube-node-4xxp4" Jul 22 16:22:30.424759 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.423389 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bkrg4\" (UniqueName: \"kubernetes.io/projected/49c0194f-7df7-4118-83b1-c0a73004279e-kube-api-access-bkrg4\") pod \"aws-ebs-csi-driver-node-knwpl\" (UID: \"49c0194f-7df7-4118-83b1-c0a73004279e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-knwpl" Jul 22 16:22:30.424759 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.423478 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1bf44bf4-3297-45b6-bfc0-0c54fb144110-run-ovn\") pod \"ovnkube-node-4xxp4\" (UID: \"1bf44bf4-3297-45b6-bfc0-0c54fb144110\") " pod="openshift-ovn-kubernetes/ovnkube-node-4xxp4" Jul 22 16:22:30.424759 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.423694 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4834a81b-7ace-458e-8d65-6278acbd40bf-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-swk9r\" (UID: \"4834a81b-7ace-458e-8d65-6278acbd40bf\") " pod="openshift-multus/multus-additional-cni-plugins-swk9r" Jul 22 16:22:30.425244 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.425177 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b1e896dc-8494-4f9c-95b6-77337241e679-etc-tuned\") pod \"tuned-crkls\" (UID: \"b1e896dc-8494-4f9c-95b6-77337241e679\") " pod="openshift-cluster-node-tuning-operator/tuned-crkls" Jul 22 16:22:30.425916 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.425661 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1bf44bf4-3297-45b6-bfc0-0c54fb144110-ovn-node-metrics-cert\") pod \"ovnkube-node-4xxp4\" (UID: \"1bf44bf4-3297-45b6-bfc0-0c54fb144110\") " pod="openshift-ovn-kubernetes/ovnkube-node-4xxp4" Jul 22 16:22:30.426037 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.426016 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/13fb19fd-9a49-4a7f-9c2f-aa4814848b48-agent-certs\") pod \"konnectivity-agent-8qfgq\" (UID: \"13fb19fd-9a49-4a7f-9c2f-aa4814848b48\") " pod="kube-system/konnectivity-agent-8qfgq" Jul 22 16:22:30.426552 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.426521 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b1e896dc-8494-4f9c-95b6-77337241e679-tmp\") pod \"tuned-crkls\" (UID: \"b1e896dc-8494-4f9c-95b6-77337241e679\") " pod="openshift-cluster-node-tuning-operator/tuned-crkls" Jul 22 16:22:30.428249 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.428207 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hb5tf\" (UniqueName: \"kubernetes.io/projected/b8064dd5-313d-433d-8efe-5035350319bf-kube-api-access-hb5tf\") pod \"node-ca-v887c\" (UID: \"b8064dd5-313d-433d-8efe-5035350319bf\") " pod="openshift-image-registry/node-ca-v887c" Jul 22 16:22:30.431103 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.430594 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bnrcr\" (UniqueName: \"kubernetes.io/projected/b1e896dc-8494-4f9c-95b6-77337241e679-kube-api-access-bnrcr\") pod \"tuned-crkls\" (UID: \"b1e896dc-8494-4f9c-95b6-77337241e679\") " pod="openshift-cluster-node-tuning-operator/tuned-crkls" Jul 22 16:22:30.431103 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.431034 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-trnm4\" (UniqueName: \"kubernetes.io/projected/919e9190-67ad-4d7e-9076-4645b095a315-kube-api-access-trnm4\") pod \"network-metrics-daemon-bknjp\" (UID: \"919e9190-67ad-4d7e-9076-4645b095a315\") " pod="openshift-multus/network-metrics-daemon-bknjp" Jul 22 16:22:30.431434 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.431415 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-654kt\" (UniqueName: \"kubernetes.io/projected/1bf44bf4-3297-45b6-bfc0-0c54fb144110-kube-api-access-654kt\") pod \"ovnkube-node-4xxp4\" (UID: \"1bf44bf4-3297-45b6-bfc0-0c54fb144110\") " pod="openshift-ovn-kubernetes/ovnkube-node-4xxp4" Jul 22 16:22:30.433106 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.433076 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6nsfh\" (UniqueName: \"kubernetes.io/projected/4834a81b-7ace-458e-8d65-6278acbd40bf-kube-api-access-6nsfh\") pod \"multus-additional-cni-plugins-swk9r\" (UID: \"4834a81b-7ace-458e-8d65-6278acbd40bf\") " pod="openshift-multus/multus-additional-cni-plugins-swk9r" Jul 22 16:22:30.524621 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.524585 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hsb6l\" (UniqueName: \"kubernetes.io/projected/9a66c706-f3c0-4662-9053-ba2d4ac30e25-kube-api-access-hsb6l\") pod \"network-check-target-hwfst\" (UID: \"9a66c706-f3c0-4662-9053-ba2d4ac30e25\") " pod="openshift-network-diagnostics/network-check-target-hwfst" Jul 22 16:22:30.524824 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.524627 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0c475b43-8ce3-4769-bf39-7a7c07dd92e1-os-release\") pod \"multus-2gf2v\" (UID: \"0c475b43-8ce3-4769-bf39-7a7c07dd92e1\") " pod="openshift-multus/multus-2gf2v" Jul 22 16:22:30.524824 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.524656 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0c475b43-8ce3-4769-bf39-7a7c07dd92e1-host-var-lib-cni-multus\") pod \"multus-2gf2v\" (UID: \"0c475b43-8ce3-4769-bf39-7a7c07dd92e1\") " pod="openshift-multus/multus-2gf2v" Jul 22 16:22:30.524824 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.524715 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0c475b43-8ce3-4769-bf39-7a7c07dd92e1-host-var-lib-cni-multus\") pod \"multus-2gf2v\" (UID: \"0c475b43-8ce3-4769-bf39-7a7c07dd92e1\") " pod="openshift-multus/multus-2gf2v" Jul 22 16:22:30.524824 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.524757 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0c475b43-8ce3-4769-bf39-7a7c07dd92e1-multus-conf-dir\") pod \"multus-2gf2v\" (UID: \"0c475b43-8ce3-4769-bf39-7a7c07dd92e1\") " pod="openshift-multus/multus-2gf2v" Jul 22 16:22:30.524824 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.524771 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0c475b43-8ce3-4769-bf39-7a7c07dd92e1-os-release\") pod \"multus-2gf2v\" (UID: \"0c475b43-8ce3-4769-bf39-7a7c07dd92e1\") " pod="openshift-multus/multus-2gf2v" Jul 22 16:22:30.524824 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.524783 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a9d52486-cc0c-43d2-99b7-c6cc4be4768d-iptables-alerter-script\") pod \"iptables-alerter-qn7tr\" (UID: \"a9d52486-cc0c-43d2-99b7-c6cc4be4768d\") " pod="openshift-network-operator/iptables-alerter-qn7tr" Jul 22 16:22:30.525142 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.524834 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a9d52486-cc0c-43d2-99b7-c6cc4be4768d-host-slash\") pod \"iptables-alerter-qn7tr\" (UID: \"a9d52486-cc0c-43d2-99b7-c6cc4be4768d\") " pod="openshift-network-operator/iptables-alerter-qn7tr" Jul 22 16:22:30.525142 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.524868 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bkrg4\" (UniqueName: \"kubernetes.io/projected/49c0194f-7df7-4118-83b1-c0a73004279e-kube-api-access-bkrg4\") pod \"aws-ebs-csi-driver-node-knwpl\" (UID: \"49c0194f-7df7-4118-83b1-c0a73004279e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-knwpl" Jul 22 16:22:30.525142 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.524875 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0c475b43-8ce3-4769-bf39-7a7c07dd92e1-multus-conf-dir\") pod \"multus-2gf2v\" (UID: \"0c475b43-8ce3-4769-bf39-7a7c07dd92e1\") " pod="openshift-multus/multus-2gf2v" Jul 22 16:22:30.525142 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.524890 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a9d52486-cc0c-43d2-99b7-c6cc4be4768d-host-slash\") pod \"iptables-alerter-qn7tr\" (UID: \"a9d52486-cc0c-43d2-99b7-c6cc4be4768d\") " pod="openshift-network-operator/iptables-alerter-qn7tr" Jul 22 16:22:30.525142 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.524902 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0c475b43-8ce3-4769-bf39-7a7c07dd92e1-host-var-lib-cni-bin\") pod \"multus-2gf2v\" (UID: \"0c475b43-8ce3-4769-bf39-7a7c07dd92e1\") " pod="openshift-multus/multus-2gf2v" Jul 22 16:22:30.525142 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.524939 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0c475b43-8ce3-4769-bf39-7a7c07dd92e1-host-var-lib-cni-bin\") pod \"multus-2gf2v\" (UID: \"0c475b43-8ce3-4769-bf39-7a7c07dd92e1\") " pod="openshift-multus/multus-2gf2v" Jul 22 16:22:30.525142 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.524942 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czr5x\" (UniqueName: \"kubernetes.io/projected/a9d52486-cc0c-43d2-99b7-c6cc4be4768d-kube-api-access-czr5x\") pod \"iptables-alerter-qn7tr\" (UID: \"a9d52486-cc0c-43d2-99b7-c6cc4be4768d\") " pod="openshift-network-operator/iptables-alerter-qn7tr" Jul 22 16:22:30.525142 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.525059 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0c475b43-8ce3-4769-bf39-7a7c07dd92e1-multus-socket-dir-parent\") pod \"multus-2gf2v\" (UID: \"0c475b43-8ce3-4769-bf39-7a7c07dd92e1\") " pod="openshift-multus/multus-2gf2v" Jul 22 16:22:30.525142 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.525098 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e16caaed-7d7c-44de-8a3d-c45cbfa12b72-dbus\") pod \"global-pull-secret-syncer-vtpvm\" (UID: \"e16caaed-7d7c-44de-8a3d-c45cbfa12b72\") " pod="kube-system/global-pull-secret-syncer-vtpvm" Jul 22 16:22:30.525142 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.525135 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0c475b43-8ce3-4769-bf39-7a7c07dd92e1-multus-daemon-config\") pod \"multus-2gf2v\" (UID: \"0c475b43-8ce3-4769-bf39-7a7c07dd92e1\") " pod="openshift-multus/multus-2gf2v" Jul 22 16:22:30.525627 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.525165 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/49c0194f-7df7-4118-83b1-c0a73004279e-sys-fs\") pod \"aws-ebs-csi-driver-node-knwpl\" (UID: \"49c0194f-7df7-4118-83b1-c0a73004279e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-knwpl" Jul 22 16:22:30.525627 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.525177 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0c475b43-8ce3-4769-bf39-7a7c07dd92e1-multus-socket-dir-parent\") pod \"multus-2gf2v\" (UID: \"0c475b43-8ce3-4769-bf39-7a7c07dd92e1\") " pod="openshift-multus/multus-2gf2v" Jul 22 16:22:30.525627 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.525191 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0c475b43-8ce3-4769-bf39-7a7c07dd92e1-host-var-lib-kubelet\") pod \"multus-2gf2v\" (UID: \"0c475b43-8ce3-4769-bf39-7a7c07dd92e1\") " pod="openshift-multus/multus-2gf2v" Jul 22 16:22:30.525627 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.525232 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0c475b43-8ce3-4769-bf39-7a7c07dd92e1-host-var-lib-kubelet\") pod \"multus-2gf2v\" (UID: \"0c475b43-8ce3-4769-bf39-7a7c07dd92e1\") " pod="openshift-multus/multus-2gf2v" Jul 22 16:22:30.525627 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.525243 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/61d5f4c6-746e-4e0f-b35f-7befc6da325f-hosts-file\") pod \"node-resolver-mzcc2\" (UID: \"61d5f4c6-746e-4e0f-b35f-7befc6da325f\") " pod="openshift-dns/node-resolver-mzcc2" Jul 22 16:22:30.525627 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.525278 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0c475b43-8ce3-4769-bf39-7a7c07dd92e1-cni-binary-copy\") pod \"multus-2gf2v\" (UID: \"0c475b43-8ce3-4769-bf39-7a7c07dd92e1\") " pod="openshift-multus/multus-2gf2v" Jul 22 16:22:30.525627 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.525289 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/49c0194f-7df7-4118-83b1-c0a73004279e-sys-fs\") pod \"aws-ebs-csi-driver-node-knwpl\" (UID: \"49c0194f-7df7-4118-83b1-c0a73004279e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-knwpl" Jul 22 16:22:30.525627 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.525304 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0c475b43-8ce3-4769-bf39-7a7c07dd92e1-host-run-netns\") pod \"multus-2gf2v\" (UID: \"0c475b43-8ce3-4769-bf39-7a7c07dd92e1\") " pod="openshift-multus/multus-2gf2v" Jul 22 16:22:30.525627 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.525315 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e16caaed-7d7c-44de-8a3d-c45cbfa12b72-dbus\") pod \"global-pull-secret-syncer-vtpvm\" (UID: \"e16caaed-7d7c-44de-8a3d-c45cbfa12b72\") " pod="kube-system/global-pull-secret-syncer-vtpvm" Jul 22 16:22:30.525627 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.525331 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0c475b43-8ce3-4769-bf39-7a7c07dd92e1-etc-kubernetes\") pod \"multus-2gf2v\" (UID: \"0c475b43-8ce3-4769-bf39-7a7c07dd92e1\") " pod="openshift-multus/multus-2gf2v" Jul 22 16:22:30.525627 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.525340 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/61d5f4c6-746e-4e0f-b35f-7befc6da325f-hosts-file\") pod \"node-resolver-mzcc2\" (UID: \"61d5f4c6-746e-4e0f-b35f-7befc6da325f\") " pod="openshift-dns/node-resolver-mzcc2" Jul 22 16:22:30.525627 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.525394 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0c475b43-8ce3-4769-bf39-7a7c07dd92e1-host-run-netns\") pod \"multus-2gf2v\" (UID: \"0c475b43-8ce3-4769-bf39-7a7c07dd92e1\") " pod="openshift-multus/multus-2gf2v" Jul 22 16:22:30.525627 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.525415 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/49c0194f-7df7-4118-83b1-c0a73004279e-registration-dir\") pod \"aws-ebs-csi-driver-node-knwpl\" (UID: \"49c0194f-7df7-4118-83b1-c0a73004279e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-knwpl" Jul 22 16:22:30.525627 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.525436 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0c475b43-8ce3-4769-bf39-7a7c07dd92e1-etc-kubernetes\") pod \"multus-2gf2v\" (UID: \"0c475b43-8ce3-4769-bf39-7a7c07dd92e1\") " pod="openshift-multus/multus-2gf2v" Jul 22 16:22:30.525627 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.525440 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a9d52486-cc0c-43d2-99b7-c6cc4be4768d-iptables-alerter-script\") pod \"iptables-alerter-qn7tr\" (UID: \"a9d52486-cc0c-43d2-99b7-c6cc4be4768d\") " pod="openshift-network-operator/iptables-alerter-qn7tr" Jul 22 16:22:30.525627 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.525455 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/49c0194f-7df7-4118-83b1-c0a73004279e-device-dir\") pod \"aws-ebs-csi-driver-node-knwpl\" (UID: \"49c0194f-7df7-4118-83b1-c0a73004279e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-knwpl" Jul 22 16:22:30.525627 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.525479 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/49c0194f-7df7-4118-83b1-c0a73004279e-registration-dir\") pod \"aws-ebs-csi-driver-node-knwpl\" (UID: \"49c0194f-7df7-4118-83b1-c0a73004279e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-knwpl" Jul 22 16:22:30.525627 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.525482 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0c475b43-8ce3-4769-bf39-7a7c07dd92e1-multus-cni-dir\") pod \"multus-2gf2v\" (UID: \"0c475b43-8ce3-4769-bf39-7a7c07dd92e1\") " pod="openshift-multus/multus-2gf2v" Jul 22 16:22:30.526467 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.525508 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/61d5f4c6-746e-4e0f-b35f-7befc6da325f-tmp-dir\") pod \"node-resolver-mzcc2\" (UID: \"61d5f4c6-746e-4e0f-b35f-7befc6da325f\") " pod="openshift-dns/node-resolver-mzcc2" Jul 22 16:22:30.526467 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.525513 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/49c0194f-7df7-4118-83b1-c0a73004279e-device-dir\") pod \"aws-ebs-csi-driver-node-knwpl\" (UID: \"49c0194f-7df7-4118-83b1-c0a73004279e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-knwpl" Jul 22 16:22:30.526467 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.525531 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/49c0194f-7df7-4118-83b1-c0a73004279e-etc-selinux\") pod \"aws-ebs-csi-driver-node-knwpl\" (UID: \"49c0194f-7df7-4118-83b1-c0a73004279e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-knwpl" Jul 22 16:22:30.526467 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.525568 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0c475b43-8ce3-4769-bf39-7a7c07dd92e1-multus-cni-dir\") pod \"multus-2gf2v\" (UID: \"0c475b43-8ce3-4769-bf39-7a7c07dd92e1\") " pod="openshift-multus/multus-2gf2v" Jul 22 16:22:30.526467 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.525580 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8khws\" (UniqueName: \"kubernetes.io/projected/0c475b43-8ce3-4769-bf39-7a7c07dd92e1-kube-api-access-8khws\") pod \"multus-2gf2v\" (UID: \"0c475b43-8ce3-4769-bf39-7a7c07dd92e1\") " pod="openshift-multus/multus-2gf2v" Jul 22 16:22:30.526467 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.525619 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0c475b43-8ce3-4769-bf39-7a7c07dd92e1-host-run-k8s-cni-cncf-io\") pod \"multus-2gf2v\" (UID: \"0c475b43-8ce3-4769-bf39-7a7c07dd92e1\") " pod="openshift-multus/multus-2gf2v" Jul 22 16:22:30.526467 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.525641 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/49c0194f-7df7-4118-83b1-c0a73004279e-etc-selinux\") pod \"aws-ebs-csi-driver-node-knwpl\" (UID: \"49c0194f-7df7-4118-83b1-c0a73004279e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-knwpl" Jul 22 16:22:30.526467 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.525646 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0c475b43-8ce3-4769-bf39-7a7c07dd92e1-host-run-multus-certs\") pod \"multus-2gf2v\" (UID: \"0c475b43-8ce3-4769-bf39-7a7c07dd92e1\") " pod="openshift-multus/multus-2gf2v" Jul 22 16:22:30.526467 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.525686 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0c475b43-8ce3-4769-bf39-7a7c07dd92e1-host-run-k8s-cni-cncf-io\") pod \"multus-2gf2v\" (UID: \"0c475b43-8ce3-4769-bf39-7a7c07dd92e1\") " pod="openshift-multus/multus-2gf2v" Jul 22 16:22:30.526467 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.525718 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/49c0194f-7df7-4118-83b1-c0a73004279e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-knwpl\" (UID: \"49c0194f-7df7-4118-83b1-c0a73004279e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-knwpl" Jul 22 16:22:30.526467 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.525746 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dxdgm\" (UniqueName: \"kubernetes.io/projected/61d5f4c6-746e-4e0f-b35f-7befc6da325f-kube-api-access-dxdgm\") pod \"node-resolver-mzcc2\" (UID: \"61d5f4c6-746e-4e0f-b35f-7befc6da325f\") " pod="openshift-dns/node-resolver-mzcc2" Jul 22 16:22:30.526467 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.525764 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/49c0194f-7df7-4118-83b1-c0a73004279e-socket-dir\") pod \"aws-ebs-csi-driver-node-knwpl\" (UID: \"49c0194f-7df7-4118-83b1-c0a73004279e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-knwpl" Jul 22 16:22:30.526467 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.525812 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/49c0194f-7df7-4118-83b1-c0a73004279e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-knwpl\" (UID: \"49c0194f-7df7-4118-83b1-c0a73004279e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-knwpl" Jul 22 16:22:30.526467 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.525820 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/61d5f4c6-746e-4e0f-b35f-7befc6da325f-tmp-dir\") pod \"node-resolver-mzcc2\" (UID: \"61d5f4c6-746e-4e0f-b35f-7befc6da325f\") " pod="openshift-dns/node-resolver-mzcc2" Jul 22 16:22:30.526467 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.525828 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0c475b43-8ce3-4769-bf39-7a7c07dd92e1-cni-binary-copy\") pod \"multus-2gf2v\" (UID: \"0c475b43-8ce3-4769-bf39-7a7c07dd92e1\") " pod="openshift-multus/multus-2gf2v" Jul 22 16:22:30.526467 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.525863 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0c475b43-8ce3-4769-bf39-7a7c07dd92e1-host-run-multus-certs\") pod \"multus-2gf2v\" (UID: \"0c475b43-8ce3-4769-bf39-7a7c07dd92e1\") " pod="openshift-multus/multus-2gf2v" Jul 22 16:22:30.526467 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.525873 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e16caaed-7d7c-44de-8a3d-c45cbfa12b72-kubelet-config\") pod \"global-pull-secret-syncer-vtpvm\" (UID: \"e16caaed-7d7c-44de-8a3d-c45cbfa12b72\") " pod="kube-system/global-pull-secret-syncer-vtpvm" Jul 22 16:22:30.527024 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.525904 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e16caaed-7d7c-44de-8a3d-c45cbfa12b72-original-pull-secret\") pod \"global-pull-secret-syncer-vtpvm\" (UID: \"e16caaed-7d7c-44de-8a3d-c45cbfa12b72\") " pod="kube-system/global-pull-secret-syncer-vtpvm" Jul 22 16:22:30.527024 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.525931 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e16caaed-7d7c-44de-8a3d-c45cbfa12b72-kubelet-config\") pod \"global-pull-secret-syncer-vtpvm\" (UID: \"e16caaed-7d7c-44de-8a3d-c45cbfa12b72\") " pod="kube-system/global-pull-secret-syncer-vtpvm" Jul 22 16:22:30.527024 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.525939 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0c475b43-8ce3-4769-bf39-7a7c07dd92e1-system-cni-dir\") pod \"multus-2gf2v\" (UID: \"0c475b43-8ce3-4769-bf39-7a7c07dd92e1\") " pod="openshift-multus/multus-2gf2v" Jul 22 16:22:30.527024 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.525947 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/49c0194f-7df7-4118-83b1-c0a73004279e-socket-dir\") pod \"aws-ebs-csi-driver-node-knwpl\" (UID: \"49c0194f-7df7-4118-83b1-c0a73004279e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-knwpl" Jul 22 16:22:30.527024 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.525974 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0c475b43-8ce3-4769-bf39-7a7c07dd92e1-cnibin\") pod \"multus-2gf2v\" (UID: \"0c475b43-8ce3-4769-bf39-7a7c07dd92e1\") " pod="openshift-multus/multus-2gf2v" Jul 22 16:22:30.527024 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.525991 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0c475b43-8ce3-4769-bf39-7a7c07dd92e1-system-cni-dir\") pod \"multus-2gf2v\" (UID: \"0c475b43-8ce3-4769-bf39-7a7c07dd92e1\") " pod="openshift-multus/multus-2gf2v" Jul 22 16:22:30.527024 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.526008 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0c475b43-8ce3-4769-bf39-7a7c07dd92e1-hostroot\") pod \"multus-2gf2v\" (UID: \"0c475b43-8ce3-4769-bf39-7a7c07dd92e1\") " pod="openshift-multus/multus-2gf2v" Jul 22 16:22:30.527024 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:22:30.526034 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 22 16:22:30.527024 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:22:30.526111 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e16caaed-7d7c-44de-8a3d-c45cbfa12b72-original-pull-secret podName:e16caaed-7d7c-44de-8a3d-c45cbfa12b72 nodeName:}" failed. No retries permitted until 2026-07-22 16:22:31.02609062 +0000 UTC m=+3.127706180 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e16caaed-7d7c-44de-8a3d-c45cbfa12b72-original-pull-secret") pod "global-pull-secret-syncer-vtpvm" (UID: "e16caaed-7d7c-44de-8a3d-c45cbfa12b72") : object "kube-system"/"original-pull-secret" not registered Jul 22 16:22:30.527024 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.526039 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0c475b43-8ce3-4769-bf39-7a7c07dd92e1-cnibin\") pod \"multus-2gf2v\" (UID: \"0c475b43-8ce3-4769-bf39-7a7c07dd92e1\") " pod="openshift-multus/multus-2gf2v" Jul 22 16:22:30.527024 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.526106 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0c475b43-8ce3-4769-bf39-7a7c07dd92e1-hostroot\") pod \"multus-2gf2v\" (UID: \"0c475b43-8ce3-4769-bf39-7a7c07dd92e1\") " pod="openshift-multus/multus-2gf2v" Jul 22 16:22:30.527024 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.526645 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0c475b43-8ce3-4769-bf39-7a7c07dd92e1-multus-daemon-config\") pod \"multus-2gf2v\" (UID: \"0c475b43-8ce3-4769-bf39-7a7c07dd92e1\") " pod="openshift-multus/multus-2gf2v" Jul 22 16:22:30.536055 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:22:30.536026 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 22 16:22:30.536055 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:22:30.536056 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 22 16:22:30.536288 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:22:30.536074 2568 projected.go:196] Error preparing data for projected volume kube-api-access-hsb6l for pod openshift-network-diagnostics/network-check-target-hwfst: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 16:22:30.536288 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:22:30.536151 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9a66c706-f3c0-4662-9053-ba2d4ac30e25-kube-api-access-hsb6l podName:9a66c706-f3c0-4662-9053-ba2d4ac30e25 nodeName:}" failed. No retries permitted until 2026-07-22 16:22:31.036130228 +0000 UTC m=+3.137745783 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-hsb6l" (UniqueName: "kubernetes.io/projected/9a66c706-f3c0-4662-9053-ba2d4ac30e25-kube-api-access-hsb6l") pod "network-check-target-hwfst" (UID: "9a66c706-f3c0-4662-9053-ba2d4ac30e25") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 16:22:30.538302 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.538273 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dxdgm\" (UniqueName: \"kubernetes.io/projected/61d5f4c6-746e-4e0f-b35f-7befc6da325f-kube-api-access-dxdgm\") pod \"node-resolver-mzcc2\" (UID: \"61d5f4c6-746e-4e0f-b35f-7befc6da325f\") " pod="openshift-dns/node-resolver-mzcc2" Jul 22 16:22:30.538829 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.538765 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8khws\" (UniqueName: \"kubernetes.io/projected/0c475b43-8ce3-4769-bf39-7a7c07dd92e1-kube-api-access-8khws\") pod \"multus-2gf2v\" (UID: \"0c475b43-8ce3-4769-bf39-7a7c07dd92e1\") " pod="openshift-multus/multus-2gf2v" Jul 22 16:22:30.539156 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.539135 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-czr5x\" (UniqueName: \"kubernetes.io/projected/a9d52486-cc0c-43d2-99b7-c6cc4be4768d-kube-api-access-czr5x\") pod \"iptables-alerter-qn7tr\" (UID: \"a9d52486-cc0c-43d2-99b7-c6cc4be4768d\") " pod="openshift-network-operator/iptables-alerter-qn7tr" Jul 22 16:22:30.539249 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.539136 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bkrg4\" (UniqueName: \"kubernetes.io/projected/49c0194f-7df7-4118-83b1-c0a73004279e-kube-api-access-bkrg4\") pod \"aws-ebs-csi-driver-node-knwpl\" (UID: \"49c0194f-7df7-4118-83b1-c0a73004279e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-knwpl" Jul 22 16:22:30.612720 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.612626 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4xxp4" Jul 22 16:22:30.620580 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.620551 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-crkls" Jul 22 16:22:30.632730 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.632699 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-8qfgq" Jul 22 16:22:30.641714 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.641688 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-swk9r" Jul 22 16:22:30.648768 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.648738 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-v887c" Jul 22 16:22:30.657737 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.657713 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-qn7tr" Jul 22 16:22:30.665881 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.665855 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2gf2v" Jul 22 16:22:30.673981 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.673954 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-knwpl" Jul 22 16:22:30.681263 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.681228 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-mzcc2" Jul 22 16:22:30.930150 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:30.930054 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/919e9190-67ad-4d7e-9076-4645b095a315-metrics-certs\") pod \"network-metrics-daemon-bknjp\" (UID: \"919e9190-67ad-4d7e-9076-4645b095a315\") " pod="openshift-multus/network-metrics-daemon-bknjp" Jul 22 16:22:30.930337 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:22:30.930191 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 16:22:30.930337 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:22:30.930265 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/919e9190-67ad-4d7e-9076-4645b095a315-metrics-certs podName:919e9190-67ad-4d7e-9076-4645b095a315 nodeName:}" failed. No retries permitted until 2026-07-22 16:22:31.930244999 +0000 UTC m=+4.031860565 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/919e9190-67ad-4d7e-9076-4645b095a315-metrics-certs") pod "network-metrics-daemon-bknjp" (UID: "919e9190-67ad-4d7e-9076-4645b095a315") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 16:22:31.030551 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:31.030511 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e16caaed-7d7c-44de-8a3d-c45cbfa12b72-original-pull-secret\") pod \"global-pull-secret-syncer-vtpvm\" (UID: \"e16caaed-7d7c-44de-8a3d-c45cbfa12b72\") " pod="kube-system/global-pull-secret-syncer-vtpvm" Jul 22 16:22:31.030812 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:22:31.030679 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 22 16:22:31.030812 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:22:31.030770 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e16caaed-7d7c-44de-8a3d-c45cbfa12b72-original-pull-secret podName:e16caaed-7d7c-44de-8a3d-c45cbfa12b72 nodeName:}" failed. No retries permitted until 2026-07-22 16:22:32.030748558 +0000 UTC m=+4.132364126 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e16caaed-7d7c-44de-8a3d-c45cbfa12b72-original-pull-secret") pod "global-pull-secret-syncer-vtpvm" (UID: "e16caaed-7d7c-44de-8a3d-c45cbfa12b72") : object "kube-system"/"original-pull-secret" not registered Jul 22 16:22:31.131489 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:31.131435 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hsb6l\" (UniqueName: \"kubernetes.io/projected/9a66c706-f3c0-4662-9053-ba2d4ac30e25-kube-api-access-hsb6l\") pod \"network-check-target-hwfst\" (UID: \"9a66c706-f3c0-4662-9053-ba2d4ac30e25\") " pod="openshift-network-diagnostics/network-check-target-hwfst" Jul 22 16:22:31.131681 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:22:31.131651 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 22 16:22:31.131681 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:22:31.131680 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 22 16:22:31.131794 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:22:31.131695 2568 projected.go:196] Error preparing data for projected volume kube-api-access-hsb6l for pod openshift-network-diagnostics/network-check-target-hwfst: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 16:22:31.131794 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:22:31.131771 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9a66c706-f3c0-4662-9053-ba2d4ac30e25-kube-api-access-hsb6l podName:9a66c706-f3c0-4662-9053-ba2d4ac30e25 nodeName:}" failed. No retries permitted until 2026-07-22 16:22:32.131745129 +0000 UTC m=+4.233360686 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-hsb6l" (UniqueName: "kubernetes.io/projected/9a66c706-f3c0-4662-9053-ba2d4ac30e25-kube-api-access-hsb6l") pod "network-check-target-hwfst" (UID: "9a66c706-f3c0-4662-9053-ba2d4ac30e25") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 16:22:31.351790 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:31.351695 2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-21 16:17:30 +0000 UTC" deadline="2028-02-03 03:45:03.916478005 +0000 UTC" Jul 22 16:22:31.351790 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:31.351737 2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13451h22m32.564745281s" Jul 22 16:22:31.546798 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:31.546773 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4834a81b_7ace_458e_8d65_6278acbd40bf.slice/crio-5dbb9acbeee021a4163d2c733a33cf09aa59a1e9b429834c3e6ad361dfa9b203 WatchSource:0}: Error finding container 5dbb9acbeee021a4163d2c733a33cf09aa59a1e9b429834c3e6ad361dfa9b203: Status 404 returned error can't find the container with id 5dbb9acbeee021a4163d2c733a33cf09aa59a1e9b429834c3e6ad361dfa9b203 Jul 22 16:22:31.548728 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:31.548696 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9d52486_cc0c_43d2_99b7_c6cc4be4768d.slice/crio-4507a7d076ae03be9e8a193d627f5c2a8654a1075e0b333c9251eeef266e644f WatchSource:0}: Error finding container 4507a7d076ae03be9e8a193d627f5c2a8654a1075e0b333c9251eeef266e644f: Status 404 returned error can't find the container with id 4507a7d076ae03be9e8a193d627f5c2a8654a1075e0b333c9251eeef266e644f Jul 22 16:22:31.551802 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:31.551769 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8064dd5_313d_433d_8efe_5035350319bf.slice/crio-b491cb506ce107aefbcda2aa48ecac2f2526fe040fa16d578ac5822b61704077 WatchSource:0}: Error finding container b491cb506ce107aefbcda2aa48ecac2f2526fe040fa16d578ac5822b61704077: Status 404 returned error can't find the container with id b491cb506ce107aefbcda2aa48ecac2f2526fe040fa16d578ac5822b61704077 Jul 22 16:22:31.552775 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:31.552742 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1bf44bf4_3297_45b6_bfc0_0c54fb144110.slice/crio-78a7049b5ae4082a8c7e05fb0be45da1bc31de6b15862fb6998d05407881411e WatchSource:0}: Error finding container 78a7049b5ae4082a8c7e05fb0be45da1bc31de6b15862fb6998d05407881411e: Status 404 returned error can't find the container with id 78a7049b5ae4082a8c7e05fb0be45da1bc31de6b15862fb6998d05407881411e Jul 22 16:22:31.554714 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:31.554686 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61d5f4c6_746e_4e0f_b35f_7befc6da325f.slice/crio-329719a27423e9d50d6530fc49f98eb11f73c81a28d030dcb2195824d96def44 WatchSource:0}: Error finding container 329719a27423e9d50d6530fc49f98eb11f73c81a28d030dcb2195824d96def44: Status 404 returned error can't find the container with id 329719a27423e9d50d6530fc49f98eb11f73c81a28d030dcb2195824d96def44 Jul 22 16:22:31.555855 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:31.555740 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1e896dc_8494_4f9c_95b6_77337241e679.slice/crio-5c0304b40b6da362062d33dbd4db73ddf63783dd8d58913f90946a266662b39b WatchSource:0}: Error finding container 5c0304b40b6da362062d33dbd4db73ddf63783dd8d58913f90946a266662b39b: Status 404 returned error can't find the container with id 5c0304b40b6da362062d33dbd4db73ddf63783dd8d58913f90946a266662b39b Jul 22 16:22:31.557835 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:31.557775 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49c0194f_7df7_4118_83b1_c0a73004279e.slice/crio-a91e7c8e7684b317422331d32591799513c0b99799634f3f4206997f4ff93f91 WatchSource:0}: Error finding container a91e7c8e7684b317422331d32591799513c0b99799634f3f4206997f4ff93f91: Status 404 returned error can't find the container with id a91e7c8e7684b317422331d32591799513c0b99799634f3f4206997f4ff93f91 Jul 22 16:22:31.559564 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:31.559543 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c475b43_8ce3_4769_bf39_7a7c07dd92e1.slice/crio-4f6dd5cae11428c2382c3462f9e97eaeb181e33a5880ae67f16260daac05c0c5 WatchSource:0}: Error finding container 4f6dd5cae11428c2382c3462f9e97eaeb181e33a5880ae67f16260daac05c0c5: Status 404 returned error can't find the container with id 4f6dd5cae11428c2382c3462f9e97eaeb181e33a5880ae67f16260daac05c0c5 Jul 22 16:22:31.561112 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:22:31.561070 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13fb19fd_9a49_4a7f_9c2f_aa4814848b48.slice/crio-c90b983422d0cde1b3e18bc3f8a96d9692a0a5004006da175992f052d1a0881c WatchSource:0}: Error finding container c90b983422d0cde1b3e18bc3f8a96d9692a0a5004006da175992f052d1a0881c: Status 404 returned error can't find the container with id c90b983422d0cde1b3e18bc3f8a96d9692a0a5004006da175992f052d1a0881c Jul 22 16:22:31.938911 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:31.938575 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/919e9190-67ad-4d7e-9076-4645b095a315-metrics-certs\") pod \"network-metrics-daemon-bknjp\" (UID: \"919e9190-67ad-4d7e-9076-4645b095a315\") " pod="openshift-multus/network-metrics-daemon-bknjp" Jul 22 16:22:31.939084 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:22:31.938757 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 16:22:31.939084 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:22:31.939021 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/919e9190-67ad-4d7e-9076-4645b095a315-metrics-certs podName:919e9190-67ad-4d7e-9076-4645b095a315 nodeName:}" failed. No retries permitted until 2026-07-22 16:22:33.938996403 +0000 UTC m=+6.040611964 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/919e9190-67ad-4d7e-9076-4645b095a315-metrics-certs") pod "network-metrics-daemon-bknjp" (UID: "919e9190-67ad-4d7e-9076-4645b095a315") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 16:22:32.040024 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:32.039977 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e16caaed-7d7c-44de-8a3d-c45cbfa12b72-original-pull-secret\") pod \"global-pull-secret-syncer-vtpvm\" (UID: \"e16caaed-7d7c-44de-8a3d-c45cbfa12b72\") " pod="kube-system/global-pull-secret-syncer-vtpvm" Jul 22 16:22:32.040216 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:22:32.040177 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 22 16:22:32.040298 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:22:32.040250 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e16caaed-7d7c-44de-8a3d-c45cbfa12b72-original-pull-secret podName:e16caaed-7d7c-44de-8a3d-c45cbfa12b72 nodeName:}" failed. No retries permitted until 2026-07-22 16:22:34.040229624 +0000 UTC m=+6.141845185 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e16caaed-7d7c-44de-8a3d-c45cbfa12b72-original-pull-secret") pod "global-pull-secret-syncer-vtpvm" (UID: "e16caaed-7d7c-44de-8a3d-c45cbfa12b72") : object "kube-system"/"original-pull-secret" not registered Jul 22 16:22:32.140928 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:32.140885 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hsb6l\" (UniqueName: \"kubernetes.io/projected/9a66c706-f3c0-4662-9053-ba2d4ac30e25-kube-api-access-hsb6l\") pod \"network-check-target-hwfst\" (UID: \"9a66c706-f3c0-4662-9053-ba2d4ac30e25\") " pod="openshift-network-diagnostics/network-check-target-hwfst" Jul 22 16:22:32.141141 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:22:32.141057 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 22 16:22:32.141141 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:22:32.141080 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 22 16:22:32.141141 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:22:32.141094 2568 projected.go:196] Error preparing data for projected volume kube-api-access-hsb6l for pod openshift-network-diagnostics/network-check-target-hwfst: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 16:22:32.141304 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:22:32.141191 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9a66c706-f3c0-4662-9053-ba2d4ac30e25-kube-api-access-hsb6l podName:9a66c706-f3c0-4662-9053-ba2d4ac30e25 nodeName:}" failed. No retries permitted until 2026-07-22 16:22:34.141170306 +0000 UTC m=+6.242785865 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-hsb6l" (UniqueName: "kubernetes.io/projected/9a66c706-f3c0-4662-9053-ba2d4ac30e25-kube-api-access-hsb6l") pod "network-check-target-hwfst" (UID: "9a66c706-f3c0-4662-9053-ba2d4ac30e25") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 16:22:32.353324 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:32.353065 2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-21 16:17:30 +0000 UTC" deadline="2028-01-29 14:01:39.672230114 +0000 UTC" Jul 22 16:22:32.353324 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:32.353139 2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13341h39m7.319095596s" Jul 22 16:22:32.406442 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:32.406394 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vtpvm" Jul 22 16:22:32.406616 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:22:32.406590 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vtpvm" podUID="e16caaed-7d7c-44de-8a3d-c45cbfa12b72" Jul 22 16:22:32.407069 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:32.407049 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hwfst" Jul 22 16:22:32.407174 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:22:32.407154 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hwfst" podUID="9a66c706-f3c0-4662-9053-ba2d4ac30e25" Jul 22 16:22:32.407253 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:32.407239 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bknjp" Jul 22 16:22:32.407350 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:22:32.407331 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bknjp" podUID="919e9190-67ad-4d7e-9076-4645b095a315" Jul 22 16:22:32.433685 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:32.433644 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4xxp4" event={"ID":"1bf44bf4-3297-45b6-bfc0-0c54fb144110","Type":"ContainerStarted","Data":"78a7049b5ae4082a8c7e05fb0be45da1bc31de6b15862fb6998d05407881411e"} Jul 22 16:22:32.440146 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:32.440091 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-swk9r" event={"ID":"4834a81b-7ace-458e-8d65-6278acbd40bf","Type":"ContainerStarted","Data":"5dbb9acbeee021a4163d2c733a33cf09aa59a1e9b429834c3e6ad361dfa9b203"} Jul 22 16:22:32.458238 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:32.458202 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-47.ec2.internal" event={"ID":"aa9e2291606c92d6ab1f0ef1e722964e","Type":"ContainerStarted","Data":"31f4ecfd38fb66b33f14b5d27fcc754511cde33933a67b5f2ed27c2b3d07eae6"} Jul 22 16:22:32.477599 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:32.477540 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2gf2v" event={"ID":"0c475b43-8ce3-4769-bf39-7a7c07dd92e1","Type":"ContainerStarted","Data":"4f6dd5cae11428c2382c3462f9e97eaeb181e33a5880ae67f16260daac05c0c5"} Jul 22 16:22:32.499118 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:32.499037 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-8qfgq" event={"ID":"13fb19fd-9a49-4a7f-9c2f-aa4814848b48","Type":"ContainerStarted","Data":"c90b983422d0cde1b3e18bc3f8a96d9692a0a5004006da175992f052d1a0881c"} Jul 22 16:22:32.521471 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:32.521430 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-knwpl" event={"ID":"49c0194f-7df7-4118-83b1-c0a73004279e","Type":"ContainerStarted","Data":"a91e7c8e7684b317422331d32591799513c0b99799634f3f4206997f4ff93f91"} Jul 22 16:22:32.534070 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:32.534023 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-crkls" event={"ID":"b1e896dc-8494-4f9c-95b6-77337241e679","Type":"ContainerStarted","Data":"5c0304b40b6da362062d33dbd4db73ddf63783dd8d58913f90946a266662b39b"} Jul 22 16:22:32.549453 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:32.549342 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-mzcc2" event={"ID":"61d5f4c6-746e-4e0f-b35f-7befc6da325f","Type":"ContainerStarted","Data":"329719a27423e9d50d6530fc49f98eb11f73c81a28d030dcb2195824d96def44"} Jul 22 16:22:32.558892 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:32.558852 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-v887c" event={"ID":"b8064dd5-313d-433d-8efe-5035350319bf","Type":"ContainerStarted","Data":"b491cb506ce107aefbcda2aa48ecac2f2526fe040fa16d578ac5822b61704077"} Jul 22 16:22:32.576114 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:32.576035 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-qn7tr" event={"ID":"a9d52486-cc0c-43d2-99b7-c6cc4be4768d","Type":"ContainerStarted","Data":"4507a7d076ae03be9e8a193d627f5c2a8654a1075e0b333c9251eeef266e644f"} Jul 22 16:22:32.607799 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:32.607709 2568 generic.go:356] "Generic (PLEG): container finished" podID="6c389acabb6147062a64e9641790fbaa" containerID="75485435d6de76c2d41639da293c855b0c6ccb086c5d215d2ecc0722e3712f6e" exitCode=0 Jul 22 16:22:32.607799 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:32.607763 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-47.ec2.internal" event={"ID":"6c389acabb6147062a64e9641790fbaa","Type":"ContainerDied","Data":"75485435d6de76c2d41639da293c855b0c6ccb086c5d215d2ecc0722e3712f6e"} Jul 22 16:22:32.626169 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:32.626107 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-47.ec2.internal" podStartSLOduration=3.626083898 podStartE2EDuration="3.626083898s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 16:22:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:22:32.474703661 +0000 UTC m=+4.576319242" watchObservedRunningTime="2026-07-22 16:22:32.626083898 +0000 UTC m=+4.727699479" Jul 22 16:22:33.634529 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:33.634494 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-47.ec2.internal" event={"ID":"6c389acabb6147062a64e9641790fbaa","Type":"ContainerStarted","Data":"cb083ccb2169c11dae1bbe713a7e93f89b6e7960b995c1adb24ec2e5dc6c4bc6"} Jul 22 16:22:33.959905 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:33.959810 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/919e9190-67ad-4d7e-9076-4645b095a315-metrics-certs\") pod \"network-metrics-daemon-bknjp\" (UID: \"919e9190-67ad-4d7e-9076-4645b095a315\") " pod="openshift-multus/network-metrics-daemon-bknjp" Jul 22 16:22:33.960070 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:22:33.960054 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 16:22:33.960133 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:22:33.960123 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/919e9190-67ad-4d7e-9076-4645b095a315-metrics-certs podName:919e9190-67ad-4d7e-9076-4645b095a315 nodeName:}" failed. No retries permitted until 2026-07-22 16:22:37.960103585 +0000 UTC m=+10.061719146 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/919e9190-67ad-4d7e-9076-4645b095a315-metrics-certs") pod "network-metrics-daemon-bknjp" (UID: "919e9190-67ad-4d7e-9076-4645b095a315") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 16:22:34.061089 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:34.061041 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e16caaed-7d7c-44de-8a3d-c45cbfa12b72-original-pull-secret\") pod \"global-pull-secret-syncer-vtpvm\" (UID: \"e16caaed-7d7c-44de-8a3d-c45cbfa12b72\") " pod="kube-system/global-pull-secret-syncer-vtpvm" Jul 22 16:22:34.061279 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:22:34.061223 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 22 16:22:34.061342 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:22:34.061290 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e16caaed-7d7c-44de-8a3d-c45cbfa12b72-original-pull-secret podName:e16caaed-7d7c-44de-8a3d-c45cbfa12b72 nodeName:}" failed. No retries permitted until 2026-07-22 16:22:38.061269752 +0000 UTC m=+10.162885324 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e16caaed-7d7c-44de-8a3d-c45cbfa12b72-original-pull-secret") pod "global-pull-secret-syncer-vtpvm" (UID: "e16caaed-7d7c-44de-8a3d-c45cbfa12b72") : object "kube-system"/"original-pull-secret" not registered Jul 22 16:22:34.162837 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:34.162137 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hsb6l\" (UniqueName: \"kubernetes.io/projected/9a66c706-f3c0-4662-9053-ba2d4ac30e25-kube-api-access-hsb6l\") pod \"network-check-target-hwfst\" (UID: \"9a66c706-f3c0-4662-9053-ba2d4ac30e25\") " pod="openshift-network-diagnostics/network-check-target-hwfst" Jul 22 16:22:34.162837 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:22:34.162318 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 22 16:22:34.162837 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:22:34.162339 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 22 16:22:34.162837 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:22:34.162368 2568 projected.go:196] Error preparing data for projected volume kube-api-access-hsb6l for pod openshift-network-diagnostics/network-check-target-hwfst: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 16:22:34.162837 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:22:34.162429 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9a66c706-f3c0-4662-9053-ba2d4ac30e25-kube-api-access-hsb6l podName:9a66c706-f3c0-4662-9053-ba2d4ac30e25 nodeName:}" failed. No retries permitted until 2026-07-22 16:22:38.162410239 +0000 UTC m=+10.264025796 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-hsb6l" (UniqueName: "kubernetes.io/projected/9a66c706-f3c0-4662-9053-ba2d4ac30e25-kube-api-access-hsb6l") pod "network-check-target-hwfst" (UID: "9a66c706-f3c0-4662-9053-ba2d4ac30e25") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 16:22:34.406376 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:34.406320 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vtpvm" Jul 22 16:22:34.406539 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:22:34.406464 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vtpvm" podUID="e16caaed-7d7c-44de-8a3d-c45cbfa12b72" Jul 22 16:22:34.406871 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:34.406852 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hwfst" Jul 22 16:22:34.406963 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:22:34.406944 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hwfst" podUID="9a66c706-f3c0-4662-9053-ba2d4ac30e25" Jul 22 16:22:34.407026 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:34.406995 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bknjp" Jul 22 16:22:34.407091 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:22:34.407068 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bknjp" podUID="919e9190-67ad-4d7e-9076-4645b095a315" Jul 22 16:22:36.404646 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:36.404611 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vtpvm" Jul 22 16:22:36.405113 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:22:36.404761 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vtpvm" podUID="e16caaed-7d7c-44de-8a3d-c45cbfa12b72" Jul 22 16:22:36.405230 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:36.405209 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hwfst" Jul 22 16:22:36.405385 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:22:36.405311 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hwfst" podUID="9a66c706-f3c0-4662-9053-ba2d4ac30e25" Jul 22 16:22:36.405569 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:36.405483 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bknjp" Jul 22 16:22:36.405635 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:22:36.405586 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bknjp" podUID="919e9190-67ad-4d7e-9076-4645b095a315" Jul 22 16:22:38.000276 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:37.999870 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/919e9190-67ad-4d7e-9076-4645b095a315-metrics-certs\") pod \"network-metrics-daemon-bknjp\" (UID: \"919e9190-67ad-4d7e-9076-4645b095a315\") " pod="openshift-multus/network-metrics-daemon-bknjp" Jul 22 16:22:38.000276 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:22:38.000052 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 16:22:38.000276 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:22:38.000117 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/919e9190-67ad-4d7e-9076-4645b095a315-metrics-certs podName:919e9190-67ad-4d7e-9076-4645b095a315 nodeName:}" failed. No retries permitted until 2026-07-22 16:22:46.000095548 +0000 UTC m=+18.101711133 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/919e9190-67ad-4d7e-9076-4645b095a315-metrics-certs") pod "network-metrics-daemon-bknjp" (UID: "919e9190-67ad-4d7e-9076-4645b095a315") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 16:22:38.101460 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:38.101332 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e16caaed-7d7c-44de-8a3d-c45cbfa12b72-original-pull-secret\") pod \"global-pull-secret-syncer-vtpvm\" (UID: \"e16caaed-7d7c-44de-8a3d-c45cbfa12b72\") " pod="kube-system/global-pull-secret-syncer-vtpvm" Jul 22 16:22:38.101648 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:22:38.101470 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 22 16:22:38.101648 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:22:38.101550 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e16caaed-7d7c-44de-8a3d-c45cbfa12b72-original-pull-secret podName:e16caaed-7d7c-44de-8a3d-c45cbfa12b72 nodeName:}" failed. No retries permitted until 2026-07-22 16:22:46.101530303 +0000 UTC m=+18.203145867 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e16caaed-7d7c-44de-8a3d-c45cbfa12b72-original-pull-secret") pod "global-pull-secret-syncer-vtpvm" (UID: "e16caaed-7d7c-44de-8a3d-c45cbfa12b72") : object "kube-system"/"original-pull-secret" not registered Jul 22 16:22:38.202098 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:38.201987 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hsb6l\" (UniqueName: \"kubernetes.io/projected/9a66c706-f3c0-4662-9053-ba2d4ac30e25-kube-api-access-hsb6l\") pod \"network-check-target-hwfst\" (UID: \"9a66c706-f3c0-4662-9053-ba2d4ac30e25\") " pod="openshift-network-diagnostics/network-check-target-hwfst" Jul 22 16:22:38.202276 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:22:38.202162 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 22 16:22:38.202276 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:22:38.202179 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 22 16:22:38.202276 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:22:38.202191 2568 projected.go:196] Error preparing data for projected volume kube-api-access-hsb6l for pod openshift-network-diagnostics/network-check-target-hwfst: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 16:22:38.202276 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:22:38.202244 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9a66c706-f3c0-4662-9053-ba2d4ac30e25-kube-api-access-hsb6l podName:9a66c706-f3c0-4662-9053-ba2d4ac30e25 nodeName:}" failed. No retries permitted until 2026-07-22 16:22:46.202228093 +0000 UTC m=+18.303843661 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-hsb6l" (UniqueName: "kubernetes.io/projected/9a66c706-f3c0-4662-9053-ba2d4ac30e25-kube-api-access-hsb6l") pod "network-check-target-hwfst" (UID: "9a66c706-f3c0-4662-9053-ba2d4ac30e25") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 16:22:38.405694 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:38.404935 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vtpvm" Jul 22 16:22:38.405694 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:22:38.405039 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vtpvm" podUID="e16caaed-7d7c-44de-8a3d-c45cbfa12b72" Jul 22 16:22:38.405694 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:38.405087 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hwfst" Jul 22 16:22:38.405694 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:22:38.405154 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hwfst" podUID="9a66c706-f3c0-4662-9053-ba2d4ac30e25" Jul 22 16:22:38.405694 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:38.405506 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bknjp" Jul 22 16:22:38.405694 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:22:38.405610 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bknjp" podUID="919e9190-67ad-4d7e-9076-4645b095a315" Jul 22 16:22:40.404996 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:40.404287 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vtpvm" Jul 22 16:22:40.404996 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:22:40.404437 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vtpvm" podUID="e16caaed-7d7c-44de-8a3d-c45cbfa12b72" Jul 22 16:22:40.404996 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:40.404845 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hwfst" Jul 22 16:22:40.404996 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:22:40.404941 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hwfst" podUID="9a66c706-f3c0-4662-9053-ba2d4ac30e25" Jul 22 16:22:40.405863 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:40.405700 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bknjp" Jul 22 16:22:40.405863 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:22:40.405824 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bknjp" podUID="919e9190-67ad-4d7e-9076-4645b095a315" Jul 22 16:22:42.403893 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:42.403855 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hwfst" Jul 22 16:22:42.403893 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:42.403888 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vtpvm" Jul 22 16:22:42.404417 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:42.403855 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bknjp" Jul 22 16:22:42.404417 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:22:42.404002 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hwfst" podUID="9a66c706-f3c0-4662-9053-ba2d4ac30e25" Jul 22 16:22:42.404417 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:22:42.404127 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bknjp" podUID="919e9190-67ad-4d7e-9076-4645b095a315" Jul 22 16:22:42.404417 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:22:42.404214 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vtpvm" podUID="e16caaed-7d7c-44de-8a3d-c45cbfa12b72" Jul 22 16:22:44.403595 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:44.403560 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hwfst" Jul 22 16:22:44.403595 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:44.403588 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bknjp" Jul 22 16:22:44.404124 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:44.403555 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vtpvm" Jul 22 16:22:44.404124 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:22:44.403694 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hwfst" podUID="9a66c706-f3c0-4662-9053-ba2d4ac30e25" Jul 22 16:22:44.404124 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:22:44.403763 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vtpvm" podUID="e16caaed-7d7c-44de-8a3d-c45cbfa12b72" Jul 22 16:22:44.404124 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:22:44.403888 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bknjp" podUID="919e9190-67ad-4d7e-9076-4645b095a315" Jul 22 16:22:46.062696 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:46.062659 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/919e9190-67ad-4d7e-9076-4645b095a315-metrics-certs\") pod \"network-metrics-daemon-bknjp\" (UID: \"919e9190-67ad-4d7e-9076-4645b095a315\") " pod="openshift-multus/network-metrics-daemon-bknjp" Jul 22 16:22:46.063145 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:22:46.062833 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 16:22:46.063145 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:22:46.062918 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/919e9190-67ad-4d7e-9076-4645b095a315-metrics-certs podName:919e9190-67ad-4d7e-9076-4645b095a315 nodeName:}" failed. No retries permitted until 2026-07-22 16:23:02.062893982 +0000 UTC m=+34.164509539 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/919e9190-67ad-4d7e-9076-4645b095a315-metrics-certs") pod "network-metrics-daemon-bknjp" (UID: "919e9190-67ad-4d7e-9076-4645b095a315") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 16:22:46.163153 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:46.163113 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e16caaed-7d7c-44de-8a3d-c45cbfa12b72-original-pull-secret\") pod \"global-pull-secret-syncer-vtpvm\" (UID: \"e16caaed-7d7c-44de-8a3d-c45cbfa12b72\") " pod="kube-system/global-pull-secret-syncer-vtpvm" Jul 22 16:22:46.163365 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:22:46.163279 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 22 16:22:46.163365 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:22:46.163361 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e16caaed-7d7c-44de-8a3d-c45cbfa12b72-original-pull-secret podName:e16caaed-7d7c-44de-8a3d-c45cbfa12b72 nodeName:}" failed. No retries permitted until 2026-07-22 16:23:02.163329784 +0000 UTC m=+34.264945338 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e16caaed-7d7c-44de-8a3d-c45cbfa12b72-original-pull-secret") pod "global-pull-secret-syncer-vtpvm" (UID: "e16caaed-7d7c-44de-8a3d-c45cbfa12b72") : object "kube-system"/"original-pull-secret" not registered Jul 22 16:22:46.263851 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:46.263815 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hsb6l\" (UniqueName: \"kubernetes.io/projected/9a66c706-f3c0-4662-9053-ba2d4ac30e25-kube-api-access-hsb6l\") pod \"network-check-target-hwfst\" (UID: \"9a66c706-f3c0-4662-9053-ba2d4ac30e25\") " pod="openshift-network-diagnostics/network-check-target-hwfst" Jul 22 16:22:46.264025 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:22:46.263999 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 22 16:22:46.264025 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:22:46.264023 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 22 16:22:46.264104 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:22:46.264033 2568 projected.go:196] Error preparing data for projected volume kube-api-access-hsb6l for pod openshift-network-diagnostics/network-check-target-hwfst: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 16:22:46.264104 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:22:46.264090 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9a66c706-f3c0-4662-9053-ba2d4ac30e25-kube-api-access-hsb6l podName:9a66c706-f3c0-4662-9053-ba2d4ac30e25 nodeName:}" failed. No retries permitted until 2026-07-22 16:23:02.264071262 +0000 UTC m=+34.365686819 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-hsb6l" (UniqueName: "kubernetes.io/projected/9a66c706-f3c0-4662-9053-ba2d4ac30e25-kube-api-access-hsb6l") pod "network-check-target-hwfst" (UID: "9a66c706-f3c0-4662-9053-ba2d4ac30e25") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 16:22:46.403977 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:46.403892 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vtpvm" Jul 22 16:22:46.403977 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:46.403912 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bknjp" Jul 22 16:22:46.404193 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:46.403905 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hwfst" Jul 22 16:22:46.404193 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:22:46.404022 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vtpvm" podUID="e16caaed-7d7c-44de-8a3d-c45cbfa12b72" Jul 22 16:22:46.404193 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:22:46.404130 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hwfst" podUID="9a66c706-f3c0-4662-9053-ba2d4ac30e25" Jul 22 16:22:46.404325 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:22:46.404241 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bknjp" podUID="919e9190-67ad-4d7e-9076-4645b095a315" Jul 22 16:22:48.405168 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:48.405134 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bknjp" Jul 22 16:22:48.405702 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:48.405178 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vtpvm" Jul 22 16:22:48.405702 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:22:48.405263 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bknjp" podUID="919e9190-67ad-4d7e-9076-4645b095a315" Jul 22 16:22:48.405702 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:22:48.405366 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vtpvm" podUID="e16caaed-7d7c-44de-8a3d-c45cbfa12b72" Jul 22 16:22:48.405702 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:48.405429 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hwfst" Jul 22 16:22:48.405702 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:22:48.405506 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hwfst" podUID="9a66c706-f3c0-4662-9053-ba2d4ac30e25" Jul 22 16:22:50.404920 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:50.404827 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vtpvm" Jul 22 16:22:50.404920 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:50.404839 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hwfst" Jul 22 16:22:50.405408 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:22:50.404958 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vtpvm" podUID="e16caaed-7d7c-44de-8a3d-c45cbfa12b72" Jul 22 16:22:50.405408 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:50.405029 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bknjp" Jul 22 16:22:50.405408 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:22:50.405017 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hwfst" podUID="9a66c706-f3c0-4662-9053-ba2d4ac30e25" Jul 22 16:22:50.405408 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:22:50.405109 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bknjp" podUID="919e9190-67ad-4d7e-9076-4645b095a315" Jul 22 16:22:50.670726 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:50.670483 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-crkls" event={"ID":"b1e896dc-8494-4f9c-95b6-77337241e679","Type":"ContainerStarted","Data":"19c5fee62217441bb2156a871161f4d0d59637b50628b7ef6f9f0680d5528188"} Jul 22 16:22:50.671886 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:50.671858 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-mzcc2" event={"ID":"61d5f4c6-746e-4e0f-b35f-7befc6da325f","Type":"ContainerStarted","Data":"efd52a56b009efe16d4432912263ba9e083d510fb2a9ac8f03bf37e57bffb53b"} Jul 22 16:22:50.673313 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:50.673278 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-v887c" event={"ID":"b8064dd5-313d-433d-8efe-5035350319bf","Type":"ContainerStarted","Data":"359db5374a8d772feb8b255e5e69a9d43dad646b43482ea436f4bc2303cc4765"} Jul 22 16:22:50.675238 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:50.675214 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4xxp4" event={"ID":"1bf44bf4-3297-45b6-bfc0-0c54fb144110","Type":"ContainerStarted","Data":"f27886759a53ffef4cde5e9ca0761526fb4606e79025ce61b12b1db7588d11a8"} Jul 22 16:22:50.675374 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:50.675273 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4xxp4" event={"ID":"1bf44bf4-3297-45b6-bfc0-0c54fb144110","Type":"ContainerStarted","Data":"29a0a296752337d19b18bddd38b6aa82b63b03d25f62d9ee8163ec2e2354263b"} Jul 22 16:22:50.675374 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:50.675309 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4xxp4" event={"ID":"1bf44bf4-3297-45b6-bfc0-0c54fb144110","Type":"ContainerStarted","Data":"86a98be9d69c4d07efc6faba3fca8aa398ce58446af3e09b2cf46888f0e8fe4e"} Jul 22 16:22:50.676491 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:50.676472 2568 generic.go:356] "Generic (PLEG): container finished" podID="4834a81b-7ace-458e-8d65-6278acbd40bf" containerID="80bf506a0ac1f09cdea328713ae633f4b865cfe2183eacc8001d0095cc65a6ab" exitCode=0 Jul 22 16:22:50.676564 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:50.676528 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-swk9r" event={"ID":"4834a81b-7ace-458e-8d65-6278acbd40bf","Type":"ContainerDied","Data":"80bf506a0ac1f09cdea328713ae633f4b865cfe2183eacc8001d0095cc65a6ab"} Jul 22 16:22:50.677858 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:50.677781 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2gf2v" event={"ID":"0c475b43-8ce3-4769-bf39-7a7c07dd92e1","Type":"ContainerStarted","Data":"25a5725d519c0eef2a0017a3f6f2b24f2d2bc98dacb010f9d73a3571bed00893"} Jul 22 16:22:50.680738 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:50.680717 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-8qfgq" event={"ID":"13fb19fd-9a49-4a7f-9c2f-aa4814848b48","Type":"ContainerStarted","Data":"3b6d4bee4adab042d7203aa8e26e4f5d72be86d0d349439f78362e8010f08f44"} Jul 22 16:22:50.682555 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:50.682536 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-knwpl" event={"ID":"49c0194f-7df7-4118-83b1-c0a73004279e","Type":"ContainerStarted","Data":"17c860564889aa87cab68488495b7f6df363b5d5bc2b5d15dcc035eab46760ac"} Jul 22 16:22:50.686206 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:50.686171 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-crkls" podStartSLOduration=3.986702193 podStartE2EDuration="22.686159868s" totalImagesPullingTime="18.699457675s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 16:22:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:22:50.685851456 +0000 UTC m=+22.787467034" watchObservedRunningTime="2026-07-22 16:22:50.686159868 +0000 UTC m=+22.787775444" Jul 22 16:22:50.686294 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:50.686279 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-47.ec2.internal" podStartSLOduration=21.686275095 podStartE2EDuration="21.686275095s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 16:22:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:22:33.652323933 +0000 UTC m=+5.753939514" watchObservedRunningTime="2026-07-22 16:22:50.686275095 +0000 UTC m=+22.787890670" Jul 22 16:22:50.702897 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:50.702855 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-v887c" podStartSLOduration=4.009324572 podStartE2EDuration="22.702842441s" totalImagesPullingTime="18.693517869s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 16:22:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:22:50.702463621 +0000 UTC m=+22.804079197" watchObservedRunningTime="2026-07-22 16:22:50.702842441 +0000 UTC m=+22.804458022" Jul 22 16:22:50.723986 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:50.723943 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-2gf2v" podStartSLOduration=2.968524826 podStartE2EDuration="21.723928467s" totalImagesPullingTime="18.755403641s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 16:22:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:22:50.723783729 +0000 UTC m=+22.825399305" watchObservedRunningTime="2026-07-22 16:22:50.723928467 +0000 UTC m=+22.825544042" Jul 22 16:22:50.780695 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:50.780647 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-mzcc2" podStartSLOduration=3.090775081 podStartE2EDuration="21.780630156s" totalImagesPullingTime="18.689855075s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 16:22:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:22:50.762761692 +0000 UTC m=+22.864377265" watchObservedRunningTime="2026-07-22 16:22:50.780630156 +0000 UTC m=+22.882245729" Jul 22 16:22:50.780886 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:50.780863 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-8qfgq" podStartSLOduration=7.779347727 podStartE2EDuration="22.780855318s" totalImagesPullingTime="15.001507591s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:22:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:22:50.780854605 +0000 UTC m=+22.882470181" watchObservedRunningTime="2026-07-22 16:22:50.780855318 +0000 UTC m=+22.882470894" Jul 22 16:22:50.861441 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:50.861409 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-8qfgq" Jul 22 16:22:50.862057 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:50.862042 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-8qfgq" Jul 22 16:22:51.688360 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:51.687739 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-qn7tr" event={"ID":"a9d52486-cc0c-43d2-99b7-c6cc4be4768d","Type":"ContainerStarted","Data":"ee78817f1a3dfbef102a74234fc86040ea9fdf896c425cebfb213023a852fea2"} Jul 22 16:22:51.692525 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:51.692308 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4xxp4" event={"ID":"1bf44bf4-3297-45b6-bfc0-0c54fb144110","Type":"ContainerStarted","Data":"e31077af7ae646910842ed7513de4102ad9ea139ac77060b91573618ed8f20ae"} Jul 22 16:22:51.692525 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:51.692435 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4xxp4" event={"ID":"1bf44bf4-3297-45b6-bfc0-0c54fb144110","Type":"ContainerStarted","Data":"f0d6ca82d831171c0eabbebfb5308bf7f00c1adc36eee8ae24e59ec1e68ce212"} Jul 22 16:22:51.693240 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:51.693217 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-8qfgq" Jul 22 16:22:51.693403 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:51.693278 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4xxp4" event={"ID":"1bf44bf4-3297-45b6-bfc0-0c54fb144110","Type":"ContainerStarted","Data":"bb3270080c49302992c0d5f49b5ab1442bcd3582c47871438c40e3026f97fdea"} Jul 22 16:22:51.693525 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:51.693505 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-8qfgq" Jul 22 16:22:51.703388 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:51.703312 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-qn7tr" podStartSLOduration=5.012613523 podStartE2EDuration="23.703291392s" totalImagesPullingTime="18.690677869s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 16:22:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:22:51.702942854 +0000 UTC m=+23.804558431" watchObservedRunningTime="2026-07-22 16:22:51.703291392 +0000 UTC m=+23.804906969" Jul 22 16:22:51.798204 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:51.798173 2568 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 22 16:22:52.393728 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:52.393640 2568 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-22T16:22:51.79819715Z","UUID":"cf6b7d4e-e9b7-403e-aa54-259b59442e26","Handler":null,"Name":"","Endpoint":""} Jul 22 16:22:52.395285 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:52.395262 2568 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 22 16:22:52.395285 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:52.395300 2568 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 22 16:22:52.403992 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:52.403961 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bknjp" Jul 22 16:22:52.404123 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:52.403963 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vtpvm" Jul 22 16:22:52.404123 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:22:52.404088 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bknjp" podUID="919e9190-67ad-4d7e-9076-4645b095a315" Jul 22 16:22:52.404235 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:52.404123 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hwfst" Jul 22 16:22:52.404235 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:22:52.404216 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vtpvm" podUID="e16caaed-7d7c-44de-8a3d-c45cbfa12b72" Jul 22 16:22:52.404328 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:22:52.404289 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hwfst" podUID="9a66c706-f3c0-4662-9053-ba2d4ac30e25" Jul 22 16:22:52.696846 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:52.696763 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-knwpl" event={"ID":"49c0194f-7df7-4118-83b1-c0a73004279e","Type":"ContainerStarted","Data":"9e8a57269c43cb9e49e06db6f078e423aa0d1c1afd2176ad409890c126713f4b"} Jul 22 16:22:53.703549 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:53.703509 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4xxp4" event={"ID":"1bf44bf4-3297-45b6-bfc0-0c54fb144110","Type":"ContainerStarted","Data":"327ff958e1f5ea8f399cf0f1a4f142fed40dd298543afc07e746a846d70087e0"} Jul 22 16:22:54.403539 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:54.403501 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vtpvm" Jul 22 16:22:54.403727 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:54.403506 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hwfst" Jul 22 16:22:54.403727 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:22:54.403645 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vtpvm" podUID="e16caaed-7d7c-44de-8a3d-c45cbfa12b72" Jul 22 16:22:54.403727 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:54.403698 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bknjp" Jul 22 16:22:54.403896 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:22:54.403776 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hwfst" podUID="9a66c706-f3c0-4662-9053-ba2d4ac30e25" Jul 22 16:22:54.403896 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:22:54.403863 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bknjp" podUID="919e9190-67ad-4d7e-9076-4645b095a315" Jul 22 16:22:55.710681 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:55.710599 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-knwpl" event={"ID":"49c0194f-7df7-4118-83b1-c0a73004279e","Type":"ContainerStarted","Data":"34740ab49d00e236bb91ba42cf9101952ef0bfff76812780ad3b323279838269"} Jul 22 16:22:55.714140 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:55.714110 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4xxp4" event={"ID":"1bf44bf4-3297-45b6-bfc0-0c54fb144110","Type":"ContainerStarted","Data":"2dc4d99d1b38535f466490fcc8669d330636bd4cbc63240e742c1fb234598adf"} Jul 22 16:22:55.715094 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:55.714880 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4xxp4" Jul 22 16:22:55.715094 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:55.715025 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4xxp4" Jul 22 16:22:55.719414 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:55.719385 2568 generic.go:356] "Generic (PLEG): container finished" podID="4834a81b-7ace-458e-8d65-6278acbd40bf" containerID="d5be4a263c4c754220568085beac8c9b7d6ebe000a6a5012fcad015fb6c42055" exitCode=0 Jul 22 16:22:55.719546 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:55.719426 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-swk9r" event={"ID":"4834a81b-7ace-458e-8d65-6278acbd40bf","Type":"ContainerDied","Data":"d5be4a263c4c754220568085beac8c9b7d6ebe000a6a5012fcad015fb6c42055"} Jul 22 16:22:55.730845 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:55.730819 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4xxp4" Jul 22 16:22:55.731250 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:55.731212 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-knwpl" podStartSLOduration=3.415020678 podStartE2EDuration="26.731201002s" totalImagesPullingTime="23.316180324s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 16:22:29 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:22:55.730508247 +0000 UTC m=+27.832123824" watchObservedRunningTime="2026-07-22 16:22:55.731201002 +0000 UTC m=+27.832816579" Jul 22 16:22:55.732761 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:55.732745 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4xxp4" Jul 22 16:22:55.756832 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:55.756789 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-4xxp4" podStartSLOduration=9.010218079 podStartE2EDuration="27.756774755s" totalImagesPullingTime="18.746556676s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 16:22:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:22:55.755390114 +0000 UTC m=+27.857005689" watchObservedRunningTime="2026-07-22 16:22:55.756774755 +0000 UTC m=+27.858390330" Jul 22 16:22:56.404232 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:56.404026 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bknjp" Jul 22 16:22:56.404430 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:56.404026 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hwfst" Jul 22 16:22:56.404430 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:22:56.404327 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bknjp" podUID="919e9190-67ad-4d7e-9076-4645b095a315" Jul 22 16:22:56.404430 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:22:56.404416 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hwfst" podUID="9a66c706-f3c0-4662-9053-ba2d4ac30e25" Jul 22 16:22:56.404587 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:56.404026 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vtpvm" Jul 22 16:22:56.404587 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:22:56.404531 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vtpvm" podUID="e16caaed-7d7c-44de-8a3d-c45cbfa12b72" Jul 22 16:22:56.721931 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:56.721905 2568 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 22 16:22:57.292063 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:57.292020 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-vtpvm"] Jul 22 16:22:57.292269 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:57.292208 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vtpvm" Jul 22 16:22:57.292524 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:22:57.292337 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vtpvm" podUID="e16caaed-7d7c-44de-8a3d-c45cbfa12b72" Jul 22 16:22:57.295163 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:57.295112 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-bknjp"] Jul 22 16:22:57.295293 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:57.295253 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bknjp" Jul 22 16:22:57.295411 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:22:57.295390 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bknjp" podUID="919e9190-67ad-4d7e-9076-4645b095a315" Jul 22 16:22:57.295792 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:57.295775 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hwfst"] Jul 22 16:22:57.295867 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:57.295848 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hwfst" Jul 22 16:22:57.295928 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:22:57.295910 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hwfst" podUID="9a66c706-f3c0-4662-9053-ba2d4ac30e25" Jul 22 16:22:57.726234 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:57.726199 2568 generic.go:356] "Generic (PLEG): container finished" podID="4834a81b-7ace-458e-8d65-6278acbd40bf" containerID="645d99ad18056f602c272917074078d386f18681eab64b0c1e4dfbde0db8b17c" exitCode=0 Jul 22 16:22:57.726768 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:57.726279 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-swk9r" event={"ID":"4834a81b-7ace-458e-8d65-6278acbd40bf","Type":"ContainerDied","Data":"645d99ad18056f602c272917074078d386f18681eab64b0c1e4dfbde0db8b17c"} Jul 22 16:22:57.726768 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:57.726406 2568 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 22 16:22:58.404760 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:58.404730 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vtpvm" Jul 22 16:22:58.404924 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:22:58.404849 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vtpvm" podUID="e16caaed-7d7c-44de-8a3d-c45cbfa12b72" Jul 22 16:22:58.415119 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:58.415089 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4xxp4" Jul 22 16:22:59.403756 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:59.403723 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bknjp" Jul 22 16:22:59.403756 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:59.403745 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hwfst" Jul 22 16:22:59.404141 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:22:59.403833 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bknjp" podUID="919e9190-67ad-4d7e-9076-4645b095a315" Jul 22 16:22:59.404141 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:22:59.403940 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hwfst" podUID="9a66c706-f3c0-4662-9053-ba2d4ac30e25" Jul 22 16:22:59.733653 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:59.733615 2568 generic.go:356] "Generic (PLEG): container finished" podID="4834a81b-7ace-458e-8d65-6278acbd40bf" containerID="fe354a0dd9ff82baf2022b89d8ffa3814bf0f2e48b3e7f35b0c8b86ae69e13af" exitCode=0 Jul 22 16:22:59.733812 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:22:59.733665 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-swk9r" event={"ID":"4834a81b-7ace-458e-8d65-6278acbd40bf","Type":"ContainerDied","Data":"fe354a0dd9ff82baf2022b89d8ffa3814bf0f2e48b3e7f35b0c8b86ae69e13af"} Jul 22 16:23:00.404268 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:00.404235 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vtpvm" Jul 22 16:23:00.404783 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:23:00.404381 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vtpvm" podUID="e16caaed-7d7c-44de-8a3d-c45cbfa12b72" Jul 22 16:23:01.403812 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:01.403757 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hwfst" Jul 22 16:23:01.404014 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:01.403769 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bknjp" Jul 22 16:23:01.404014 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:23:01.403945 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hwfst" podUID="9a66c706-f3c0-4662-9053-ba2d4ac30e25" Jul 22 16:23:01.404135 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:23:01.404081 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bknjp" podUID="919e9190-67ad-4d7e-9076-4645b095a315" Jul 22 16:23:02.084298 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:02.084263 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/919e9190-67ad-4d7e-9076-4645b095a315-metrics-certs\") pod \"network-metrics-daemon-bknjp\" (UID: \"919e9190-67ad-4d7e-9076-4645b095a315\") " pod="openshift-multus/network-metrics-daemon-bknjp" Jul 22 16:23:02.084747 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:23:02.084437 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 16:23:02.084747 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:23:02.084522 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/919e9190-67ad-4d7e-9076-4645b095a315-metrics-certs podName:919e9190-67ad-4d7e-9076-4645b095a315 nodeName:}" failed. No retries permitted until 2026-07-22 16:23:34.084497634 +0000 UTC m=+66.186113197 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/919e9190-67ad-4d7e-9076-4645b095a315-metrics-certs") pod "network-metrics-daemon-bknjp" (UID: "919e9190-67ad-4d7e-9076-4645b095a315") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 16:23:02.185551 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:02.185505 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e16caaed-7d7c-44de-8a3d-c45cbfa12b72-original-pull-secret\") pod \"global-pull-secret-syncer-vtpvm\" (UID: \"e16caaed-7d7c-44de-8a3d-c45cbfa12b72\") " pod="kube-system/global-pull-secret-syncer-vtpvm" Jul 22 16:23:02.185726 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:23:02.185627 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 22 16:23:02.185726 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:23:02.185685 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e16caaed-7d7c-44de-8a3d-c45cbfa12b72-original-pull-secret podName:e16caaed-7d7c-44de-8a3d-c45cbfa12b72 nodeName:}" failed. No retries permitted until 2026-07-22 16:23:34.185669469 +0000 UTC m=+66.287285026 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e16caaed-7d7c-44de-8a3d-c45cbfa12b72-original-pull-secret") pod "global-pull-secret-syncer-vtpvm" (UID: "e16caaed-7d7c-44de-8a3d-c45cbfa12b72") : object "kube-system"/"original-pull-secret" not registered Jul 22 16:23:02.286493 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:02.286454 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hsb6l\" (UniqueName: \"kubernetes.io/projected/9a66c706-f3c0-4662-9053-ba2d4ac30e25-kube-api-access-hsb6l\") pod \"network-check-target-hwfst\" (UID: \"9a66c706-f3c0-4662-9053-ba2d4ac30e25\") " pod="openshift-network-diagnostics/network-check-target-hwfst" Jul 22 16:23:02.286679 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:23:02.286599 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 22 16:23:02.286679 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:23:02.286624 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 22 16:23:02.286679 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:23:02.286637 2568 projected.go:196] Error preparing data for projected volume kube-api-access-hsb6l for pod openshift-network-diagnostics/network-check-target-hwfst: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 16:23:02.286851 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:23:02.286714 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9a66c706-f3c0-4662-9053-ba2d4ac30e25-kube-api-access-hsb6l podName:9a66c706-f3c0-4662-9053-ba2d4ac30e25 nodeName:}" failed. No retries permitted until 2026-07-22 16:23:34.286673663 +0000 UTC m=+66.388289242 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-hsb6l" (UniqueName: "kubernetes.io/projected/9a66c706-f3c0-4662-9053-ba2d4ac30e25-kube-api-access-hsb6l") pod "network-check-target-hwfst" (UID: "9a66c706-f3c0-4662-9053-ba2d4ac30e25") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 16:23:02.404266 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:02.404172 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vtpvm" Jul 22 16:23:02.404462 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:23:02.404306 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vtpvm" podUID="e16caaed-7d7c-44de-8a3d-c45cbfa12b72" Jul 22 16:23:03.403817 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:03.403587 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bknjp" Jul 22 16:23:03.404272 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:03.403608 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hwfst" Jul 22 16:23:03.404272 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:23:03.403931 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bknjp" podUID="919e9190-67ad-4d7e-9076-4645b095a315" Jul 22 16:23:03.404272 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:23:03.404013 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hwfst" podUID="9a66c706-f3c0-4662-9053-ba2d4ac30e25" Jul 22 16:23:04.216904 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:04.216843 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-47.ec2.internal" event="NodeReady" Jul 22 16:23:04.217095 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:04.217012 2568 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 22 16:23:04.250917 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:04.250886 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-546c5d6bb-qbhlm"] Jul 22 16:23:04.282438 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:04.282375 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-b2qn2"] Jul 22 16:23:04.282709 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:04.282687 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-546c5d6bb-qbhlm" Jul 22 16:23:04.285570 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:04.285545 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 22 16:23:04.285685 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:04.285602 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 22 16:23:04.285685 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:04.285609 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 22 16:23:04.285861 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:04.285842 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-kgbkt\"" Jul 22 16:23:04.291474 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:04.291281 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 22 16:23:04.304319 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:04.304289 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-546c5d6bb-qbhlm"] Jul 22 16:23:04.304469 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:04.304341 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-6q9l7"] Jul 22 16:23:04.304469 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:04.304422 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-b2qn2" Jul 22 16:23:04.308515 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:04.308479 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 22 16:23:04.308688 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:04.308641 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 22 16:23:04.308760 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:04.308700 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-cfcr6\"" Jul 22 16:23:04.322590 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:04.322565 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-b2qn2"] Jul 22 16:23:04.322698 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:04.322602 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6q9l7"] Jul 22 16:23:04.322698 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:04.322670 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6q9l7" Jul 22 16:23:04.325231 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:04.325212 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-8zl58\"" Jul 22 16:23:04.325370 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:04.325212 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 22 16:23:04.325565 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:04.325547 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 22 16:23:04.325645 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:04.325617 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 22 16:23:04.402209 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:04.402179 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d5c01298-8e46-4810-8190-c75c64e59cdd-config-volume\") pod \"dns-default-b2qn2\" (UID: \"d5c01298-8e46-4810-8190-c75c64e59cdd\") " pod="openshift-dns/dns-default-b2qn2" Jul 22 16:23:04.402360 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:04.402212 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d5c01298-8e46-4810-8190-c75c64e59cdd-tmp-dir\") pod \"dns-default-b2qn2\" (UID: \"d5c01298-8e46-4810-8190-c75c64e59cdd\") " pod="openshift-dns/dns-default-b2qn2" Jul 22 16:23:04.402360 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:04.402234 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1c84131c-de70-401c-a71b-8d7bc6dd171f-trusted-ca\") pod \"image-registry-546c5d6bb-qbhlm\" (UID: \"1c84131c-de70-401c-a71b-8d7bc6dd171f\") " pod="openshift-image-registry/image-registry-546c5d6bb-qbhlm" Jul 22 16:23:04.402360 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:04.402251 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1c84131c-de70-401c-a71b-8d7bc6dd171f-registry-certificates\") pod \"image-registry-546c5d6bb-qbhlm\" (UID: \"1c84131c-de70-401c-a71b-8d7bc6dd171f\") " pod="openshift-image-registry/image-registry-546c5d6bb-qbhlm" Jul 22 16:23:04.402360 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:04.402268 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1c84131c-de70-401c-a71b-8d7bc6dd171f-bound-sa-token\") pod \"image-registry-546c5d6bb-qbhlm\" (UID: \"1c84131c-de70-401c-a71b-8d7bc6dd171f\") " pod="openshift-image-registry/image-registry-546c5d6bb-qbhlm" Jul 22 16:23:04.402360 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:04.402285 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9fwl\" (UniqueName: \"kubernetes.io/projected/1c84131c-de70-401c-a71b-8d7bc6dd171f-kube-api-access-c9fwl\") pod \"image-registry-546c5d6bb-qbhlm\" (UID: \"1c84131c-de70-401c-a71b-8d7bc6dd171f\") " pod="openshift-image-registry/image-registry-546c5d6bb-qbhlm" Jul 22 16:23:04.402360 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:04.402311 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d5c01298-8e46-4810-8190-c75c64e59cdd-metrics-tls\") pod \"dns-default-b2qn2\" (UID: \"d5c01298-8e46-4810-8190-c75c64e59cdd\") " pod="openshift-dns/dns-default-b2qn2" Jul 22 16:23:04.402552 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:04.402400 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7zpxx\" (UniqueName: \"kubernetes.io/projected/d5c01298-8e46-4810-8190-c75c64e59cdd-kube-api-access-7zpxx\") pod \"dns-default-b2qn2\" (UID: \"d5c01298-8e46-4810-8190-c75c64e59cdd\") " pod="openshift-dns/dns-default-b2qn2" Jul 22 16:23:04.402552 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:04.402437 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1c84131c-de70-401c-a71b-8d7bc6dd171f-installation-pull-secrets\") pod \"image-registry-546c5d6bb-qbhlm\" (UID: \"1c84131c-de70-401c-a71b-8d7bc6dd171f\") " pod="openshift-image-registry/image-registry-546c5d6bb-qbhlm" Jul 22 16:23:04.402552 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:04.402463 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1c84131c-de70-401c-a71b-8d7bc6dd171f-registry-tls\") pod \"image-registry-546c5d6bb-qbhlm\" (UID: \"1c84131c-de70-401c-a71b-8d7bc6dd171f\") " pod="openshift-image-registry/image-registry-546c5d6bb-qbhlm" Jul 22 16:23:04.402552 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:04.402488 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1c84131c-de70-401c-a71b-8d7bc6dd171f-image-registry-private-configuration\") pod \"image-registry-546c5d6bb-qbhlm\" (UID: \"1c84131c-de70-401c-a71b-8d7bc6dd171f\") " pod="openshift-image-registry/image-registry-546c5d6bb-qbhlm" Jul 22 16:23:04.402669 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:04.402561 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1c84131c-de70-401c-a71b-8d7bc6dd171f-ca-trust-extracted\") pod \"image-registry-546c5d6bb-qbhlm\" (UID: \"1c84131c-de70-401c-a71b-8d7bc6dd171f\") " pod="openshift-image-registry/image-registry-546c5d6bb-qbhlm" Jul 22 16:23:04.404287 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:04.404268 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vtpvm" Jul 22 16:23:04.407036 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:04.406976 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 22 16:23:04.503576 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:04.503542 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1c84131c-de70-401c-a71b-8d7bc6dd171f-image-registry-private-configuration\") pod \"image-registry-546c5d6bb-qbhlm\" (UID: \"1c84131c-de70-401c-a71b-8d7bc6dd171f\") " pod="openshift-image-registry/image-registry-546c5d6bb-qbhlm" Jul 22 16:23:04.503760 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:04.503602 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1c84131c-de70-401c-a71b-8d7bc6dd171f-ca-trust-extracted\") pod \"image-registry-546c5d6bb-qbhlm\" (UID: \"1c84131c-de70-401c-a71b-8d7bc6dd171f\") " pod="openshift-image-registry/image-registry-546c5d6bb-qbhlm" Jul 22 16:23:04.503760 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:04.503631 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d5c01298-8e46-4810-8190-c75c64e59cdd-config-volume\") pod \"dns-default-b2qn2\" (UID: \"d5c01298-8e46-4810-8190-c75c64e59cdd\") " pod="openshift-dns/dns-default-b2qn2" Jul 22 16:23:04.503760 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:04.503647 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d5c01298-8e46-4810-8190-c75c64e59cdd-tmp-dir\") pod \"dns-default-b2qn2\" (UID: \"d5c01298-8e46-4810-8190-c75c64e59cdd\") " pod="openshift-dns/dns-default-b2qn2" Jul 22 16:23:04.503760 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:04.503666 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1c84131c-de70-401c-a71b-8d7bc6dd171f-trusted-ca\") pod \"image-registry-546c5d6bb-qbhlm\" (UID: \"1c84131c-de70-401c-a71b-8d7bc6dd171f\") " pod="openshift-image-registry/image-registry-546c5d6bb-qbhlm" Jul 22 16:23:04.503760 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:04.503682 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1c84131c-de70-401c-a71b-8d7bc6dd171f-registry-certificates\") pod \"image-registry-546c5d6bb-qbhlm\" (UID: \"1c84131c-de70-401c-a71b-8d7bc6dd171f\") " pod="openshift-image-registry/image-registry-546c5d6bb-qbhlm" Jul 22 16:23:04.503760 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:04.503702 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1c84131c-de70-401c-a71b-8d7bc6dd171f-bound-sa-token\") pod \"image-registry-546c5d6bb-qbhlm\" (UID: \"1c84131c-de70-401c-a71b-8d7bc6dd171f\") " pod="openshift-image-registry/image-registry-546c5d6bb-qbhlm" Jul 22 16:23:04.503760 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:04.503725 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9fwl\" (UniqueName: \"kubernetes.io/projected/1c84131c-de70-401c-a71b-8d7bc6dd171f-kube-api-access-c9fwl\") pod \"image-registry-546c5d6bb-qbhlm\" (UID: \"1c84131c-de70-401c-a71b-8d7bc6dd171f\") " pod="openshift-image-registry/image-registry-546c5d6bb-qbhlm" Jul 22 16:23:04.503760 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:04.503751 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/13340988-afe9-464b-a66e-eb09a8694a8c-cert\") pod \"ingress-canary-6q9l7\" (UID: \"13340988-afe9-464b-a66e-eb09a8694a8c\") " pod="openshift-ingress-canary/ingress-canary-6q9l7" Jul 22 16:23:04.504133 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:04.503775 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d5c01298-8e46-4810-8190-c75c64e59cdd-metrics-tls\") pod \"dns-default-b2qn2\" (UID: \"d5c01298-8e46-4810-8190-c75c64e59cdd\") " pod="openshift-dns/dns-default-b2qn2" Jul 22 16:23:04.504133 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:04.503806 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7zpxx\" (UniqueName: \"kubernetes.io/projected/d5c01298-8e46-4810-8190-c75c64e59cdd-kube-api-access-7zpxx\") pod \"dns-default-b2qn2\" (UID: \"d5c01298-8e46-4810-8190-c75c64e59cdd\") " pod="openshift-dns/dns-default-b2qn2" Jul 22 16:23:04.504133 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:04.503834 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1c84131c-de70-401c-a71b-8d7bc6dd171f-installation-pull-secrets\") pod \"image-registry-546c5d6bb-qbhlm\" (UID: \"1c84131c-de70-401c-a71b-8d7bc6dd171f\") " pod="openshift-image-registry/image-registry-546c5d6bb-qbhlm" Jul 22 16:23:04.504133 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:04.503867 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1c84131c-de70-401c-a71b-8d7bc6dd171f-registry-tls\") pod \"image-registry-546c5d6bb-qbhlm\" (UID: \"1c84131c-de70-401c-a71b-8d7bc6dd171f\") " pod="openshift-image-registry/image-registry-546c5d6bb-qbhlm" Jul 22 16:23:04.504133 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:04.503897 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5l8f9\" (UniqueName: \"kubernetes.io/projected/13340988-afe9-464b-a66e-eb09a8694a8c-kube-api-access-5l8f9\") pod \"ingress-canary-6q9l7\" (UID: \"13340988-afe9-464b-a66e-eb09a8694a8c\") " pod="openshift-ingress-canary/ingress-canary-6q9l7" Jul 22 16:23:04.504133 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:04.504026 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d5c01298-8e46-4810-8190-c75c64e59cdd-tmp-dir\") pod \"dns-default-b2qn2\" (UID: \"d5c01298-8e46-4810-8190-c75c64e59cdd\") " pod="openshift-dns/dns-default-b2qn2" Jul 22 16:23:04.504459 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:23:04.504149 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 22 16:23:04.504459 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:04.504171 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1c84131c-de70-401c-a71b-8d7bc6dd171f-ca-trust-extracted\") pod \"image-registry-546c5d6bb-qbhlm\" (UID: \"1c84131c-de70-401c-a71b-8d7bc6dd171f\") " pod="openshift-image-registry/image-registry-546c5d6bb-qbhlm" Jul 22 16:23:04.504459 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:23:04.504210 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5c01298-8e46-4810-8190-c75c64e59cdd-metrics-tls podName:d5c01298-8e46-4810-8190-c75c64e59cdd nodeName:}" failed. No retries permitted until 2026-07-22 16:23:05.004190228 +0000 UTC m=+37.105805788 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d5c01298-8e46-4810-8190-c75c64e59cdd-metrics-tls") pod "dns-default-b2qn2" (UID: "d5c01298-8e46-4810-8190-c75c64e59cdd") : secret "dns-default-metrics-tls" not found Jul 22 16:23:04.504459 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:23:04.504267 2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 22 16:23:04.504459 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:23:04.504281 2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-546c5d6bb-qbhlm: secret "image-registry-tls" not found Jul 22 16:23:04.504459 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:23:04.504330 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1c84131c-de70-401c-a71b-8d7bc6dd171f-registry-tls podName:1c84131c-de70-401c-a71b-8d7bc6dd171f nodeName:}" failed. No retries permitted until 2026-07-22 16:23:05.004311957 +0000 UTC m=+37.105927518 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1c84131c-de70-401c-a71b-8d7bc6dd171f-registry-tls") pod "image-registry-546c5d6bb-qbhlm" (UID: "1c84131c-de70-401c-a71b-8d7bc6dd171f") : secret "image-registry-tls" not found Jul 22 16:23:04.504683 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:04.504501 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1c84131c-de70-401c-a71b-8d7bc6dd171f-registry-certificates\") pod \"image-registry-546c5d6bb-qbhlm\" (UID: \"1c84131c-de70-401c-a71b-8d7bc6dd171f\") " pod="openshift-image-registry/image-registry-546c5d6bb-qbhlm" Jul 22 16:23:04.504844 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:04.504824 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d5c01298-8e46-4810-8190-c75c64e59cdd-config-volume\") pod \"dns-default-b2qn2\" (UID: \"d5c01298-8e46-4810-8190-c75c64e59cdd\") " pod="openshift-dns/dns-default-b2qn2" Jul 22 16:23:04.504878 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:04.504858 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1c84131c-de70-401c-a71b-8d7bc6dd171f-trusted-ca\") pod \"image-registry-546c5d6bb-qbhlm\" (UID: \"1c84131c-de70-401c-a71b-8d7bc6dd171f\") " pod="openshift-image-registry/image-registry-546c5d6bb-qbhlm" Jul 22 16:23:04.509137 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:04.509107 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1c84131c-de70-401c-a71b-8d7bc6dd171f-image-registry-private-configuration\") pod \"image-registry-546c5d6bb-qbhlm\" (UID: \"1c84131c-de70-401c-a71b-8d7bc6dd171f\") " pod="openshift-image-registry/image-registry-546c5d6bb-qbhlm" Jul 22 16:23:04.509275 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:04.509134 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1c84131c-de70-401c-a71b-8d7bc6dd171f-installation-pull-secrets\") pod \"image-registry-546c5d6bb-qbhlm\" (UID: \"1c84131c-de70-401c-a71b-8d7bc6dd171f\") " pod="openshift-image-registry/image-registry-546c5d6bb-qbhlm" Jul 22 16:23:04.513040 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:04.513004 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9fwl\" (UniqueName: \"kubernetes.io/projected/1c84131c-de70-401c-a71b-8d7bc6dd171f-kube-api-access-c9fwl\") pod \"image-registry-546c5d6bb-qbhlm\" (UID: \"1c84131c-de70-401c-a71b-8d7bc6dd171f\") " pod="openshift-image-registry/image-registry-546c5d6bb-qbhlm" Jul 22 16:23:04.513170 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:04.513084 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1c84131c-de70-401c-a71b-8d7bc6dd171f-bound-sa-token\") pod \"image-registry-546c5d6bb-qbhlm\" (UID: \"1c84131c-de70-401c-a71b-8d7bc6dd171f\") " pod="openshift-image-registry/image-registry-546c5d6bb-qbhlm" Jul 22 16:23:04.513529 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:04.513504 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7zpxx\" (UniqueName: \"kubernetes.io/projected/d5c01298-8e46-4810-8190-c75c64e59cdd-kube-api-access-7zpxx\") pod \"dns-default-b2qn2\" (UID: \"d5c01298-8e46-4810-8190-c75c64e59cdd\") " pod="openshift-dns/dns-default-b2qn2" Jul 22 16:23:04.604536 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:04.604497 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5l8f9\" (UniqueName: \"kubernetes.io/projected/13340988-afe9-464b-a66e-eb09a8694a8c-kube-api-access-5l8f9\") pod \"ingress-canary-6q9l7\" (UID: \"13340988-afe9-464b-a66e-eb09a8694a8c\") " pod="openshift-ingress-canary/ingress-canary-6q9l7" Jul 22 16:23:04.604710 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:04.604573 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/13340988-afe9-464b-a66e-eb09a8694a8c-cert\") pod \"ingress-canary-6q9l7\" (UID: \"13340988-afe9-464b-a66e-eb09a8694a8c\") " pod="openshift-ingress-canary/ingress-canary-6q9l7" Jul 22 16:23:04.606895 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:04.606871 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/13340988-afe9-464b-a66e-eb09a8694a8c-cert\") pod \"ingress-canary-6q9l7\" (UID: \"13340988-afe9-464b-a66e-eb09a8694a8c\") " pod="openshift-ingress-canary/ingress-canary-6q9l7" Jul 22 16:23:04.613210 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:04.613192 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5l8f9\" (UniqueName: \"kubernetes.io/projected/13340988-afe9-464b-a66e-eb09a8694a8c-kube-api-access-5l8f9\") pod \"ingress-canary-6q9l7\" (UID: \"13340988-afe9-464b-a66e-eb09a8694a8c\") " pod="openshift-ingress-canary/ingress-canary-6q9l7" Jul 22 16:23:04.631161 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:04.631137 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6q9l7" Jul 22 16:23:04.748064 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:04.748028 2568 generic.go:356] "Generic (PLEG): container finished" podID="4834a81b-7ace-458e-8d65-6278acbd40bf" containerID="60b25fea5726ad1df0ec9efbbaec2db7709200bc151c45e21d89bc662d972a96" exitCode=0 Jul 22 16:23:04.748206 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:04.748089 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-swk9r" event={"ID":"4834a81b-7ace-458e-8d65-6278acbd40bf","Type":"ContainerDied","Data":"60b25fea5726ad1df0ec9efbbaec2db7709200bc151c45e21d89bc662d972a96"} Jul 22 16:23:04.778272 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:04.778037 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6q9l7"] Jul 22 16:23:04.782700 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:23:04.782675 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13340988_afe9_464b_a66e_eb09a8694a8c.slice/crio-9cb3db95ca5606b593c366bb0e7e1f4adb1182652087606163d3d4ba7b093cde WatchSource:0}: Error finding container 9cb3db95ca5606b593c366bb0e7e1f4adb1182652087606163d3d4ba7b093cde: Status 404 returned error can't find the container with id 9cb3db95ca5606b593c366bb0e7e1f4adb1182652087606163d3d4ba7b093cde Jul 22 16:23:05.006811 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:05.006771 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d5c01298-8e46-4810-8190-c75c64e59cdd-metrics-tls\") pod \"dns-default-b2qn2\" (UID: \"d5c01298-8e46-4810-8190-c75c64e59cdd\") " pod="openshift-dns/dns-default-b2qn2" Jul 22 16:23:05.007003 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:05.006838 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1c84131c-de70-401c-a71b-8d7bc6dd171f-registry-tls\") pod \"image-registry-546c5d6bb-qbhlm\" (UID: \"1c84131c-de70-401c-a71b-8d7bc6dd171f\") " pod="openshift-image-registry/image-registry-546c5d6bb-qbhlm" Jul 22 16:23:05.007003 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:23:05.006929 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 22 16:23:05.007003 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:23:05.006959 2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 22 16:23:05.007003 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:23:05.006972 2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-546c5d6bb-qbhlm: secret "image-registry-tls" not found Jul 22 16:23:05.007003 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:23:05.006994 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5c01298-8e46-4810-8190-c75c64e59cdd-metrics-tls podName:d5c01298-8e46-4810-8190-c75c64e59cdd nodeName:}" failed. No retries permitted until 2026-07-22 16:23:06.006976261 +0000 UTC m=+38.108591831 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d5c01298-8e46-4810-8190-c75c64e59cdd-metrics-tls") pod "dns-default-b2qn2" (UID: "d5c01298-8e46-4810-8190-c75c64e59cdd") : secret "dns-default-metrics-tls" not found Jul 22 16:23:05.007187 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:23:05.007019 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1c84131c-de70-401c-a71b-8d7bc6dd171f-registry-tls podName:1c84131c-de70-401c-a71b-8d7bc6dd171f nodeName:}" failed. No retries permitted until 2026-07-22 16:23:06.007002588 +0000 UTC m=+38.108618144 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1c84131c-de70-401c-a71b-8d7bc6dd171f-registry-tls") pod "image-registry-546c5d6bb-qbhlm" (UID: "1c84131c-de70-401c-a71b-8d7bc6dd171f") : secret "image-registry-tls" not found Jul 22 16:23:05.403791 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:05.403700 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bknjp" Jul 22 16:23:05.403961 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:05.403888 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hwfst" Jul 22 16:23:05.406907 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:05.406824 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 22 16:23:05.406907 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:05.406837 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 22 16:23:05.406907 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:05.406847 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-h7v2l\"" Jul 22 16:23:05.406907 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:05.406857 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-vhlm5\"" Jul 22 16:23:05.406907 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:05.406833 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 22 16:23:05.756017 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:05.755980 2568 generic.go:356] "Generic (PLEG): container finished" podID="4834a81b-7ace-458e-8d65-6278acbd40bf" containerID="918569dd6820b6d30532a079ffa1c1e1b20184bf0a442a081522ea2b7affda01" exitCode=0 Jul 22 16:23:05.756209 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:05.756057 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-swk9r" event={"ID":"4834a81b-7ace-458e-8d65-6278acbd40bf","Type":"ContainerDied","Data":"918569dd6820b6d30532a079ffa1c1e1b20184bf0a442a081522ea2b7affda01"} Jul 22 16:23:05.757843 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:05.757730 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6q9l7" event={"ID":"13340988-afe9-464b-a66e-eb09a8694a8c","Type":"ContainerStarted","Data":"9cb3db95ca5606b593c366bb0e7e1f4adb1182652087606163d3d4ba7b093cde"} Jul 22 16:23:06.015012 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:06.014891 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1c84131c-de70-401c-a71b-8d7bc6dd171f-registry-tls\") pod \"image-registry-546c5d6bb-qbhlm\" (UID: \"1c84131c-de70-401c-a71b-8d7bc6dd171f\") " pod="openshift-image-registry/image-registry-546c5d6bb-qbhlm" Jul 22 16:23:06.015012 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:06.015005 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d5c01298-8e46-4810-8190-c75c64e59cdd-metrics-tls\") pod \"dns-default-b2qn2\" (UID: \"d5c01298-8e46-4810-8190-c75c64e59cdd\") " pod="openshift-dns/dns-default-b2qn2" Jul 22 16:23:06.015200 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:23:06.015045 2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 22 16:23:06.015200 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:23:06.015067 2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-546c5d6bb-qbhlm: secret "image-registry-tls" not found Jul 22 16:23:06.015200 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:23:06.015091 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 22 16:23:06.015200 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:23:06.015129 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1c84131c-de70-401c-a71b-8d7bc6dd171f-registry-tls podName:1c84131c-de70-401c-a71b-8d7bc6dd171f nodeName:}" failed. No retries permitted until 2026-07-22 16:23:08.015111282 +0000 UTC m=+40.116726839 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1c84131c-de70-401c-a71b-8d7bc6dd171f-registry-tls") pod "image-registry-546c5d6bb-qbhlm" (UID: "1c84131c-de70-401c-a71b-8d7bc6dd171f") : secret "image-registry-tls" not found Jul 22 16:23:06.015200 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:23:06.015143 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5c01298-8e46-4810-8190-c75c64e59cdd-metrics-tls podName:d5c01298-8e46-4810-8190-c75c64e59cdd nodeName:}" failed. No retries permitted until 2026-07-22 16:23:08.015137496 +0000 UTC m=+40.116753051 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d5c01298-8e46-4810-8190-c75c64e59cdd-metrics-tls") pod "dns-default-b2qn2" (UID: "d5c01298-8e46-4810-8190-c75c64e59cdd") : secret "dns-default-metrics-tls" not found Jul 22 16:23:06.765118 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:06.765079 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-swk9r" event={"ID":"4834a81b-7ace-458e-8d65-6278acbd40bf","Type":"ContainerStarted","Data":"213d0321cb88ded3ce92c7218dab85fea60af871a136bd7b4e16131ecc809eff"} Jul 22 16:23:06.788720 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:06.788660 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-swk9r" podStartSLOduration=8.663464674 podStartE2EDuration="38.788639085s" totalImagesPullingTime="30.125174411s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 16:22:28 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:23:06.78711096 +0000 UTC m=+38.888726539" watchObservedRunningTime="2026-07-22 16:23:06.788639085 +0000 UTC m=+38.890254663" Jul 22 16:23:07.769440 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:07.769162 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6q9l7" event={"ID":"13340988-afe9-464b-a66e-eb09a8694a8c","Type":"ContainerStarted","Data":"ae74599f8526783b079df462f1b8216145d5822682b5fcc97b96dcca92150e62"} Jul 22 16:23:07.785627 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:07.785574 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-6q9l7" podStartSLOduration=1.4078091289999999 podStartE2EDuration="3.785559503s" totalImagesPullingTime="2.377750374s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:23:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:23:07.785183881 +0000 UTC m=+39.886799456" watchObservedRunningTime="2026-07-22 16:23:07.785559503 +0000 UTC m=+39.887175078" Jul 22 16:23:08.031080 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:08.030980 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d5c01298-8e46-4810-8190-c75c64e59cdd-metrics-tls\") pod \"dns-default-b2qn2\" (UID: \"d5c01298-8e46-4810-8190-c75c64e59cdd\") " pod="openshift-dns/dns-default-b2qn2" Jul 22 16:23:08.031080 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:08.031032 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1c84131c-de70-401c-a71b-8d7bc6dd171f-registry-tls\") pod \"image-registry-546c5d6bb-qbhlm\" (UID: \"1c84131c-de70-401c-a71b-8d7bc6dd171f\") " pod="openshift-image-registry/image-registry-546c5d6bb-qbhlm" Jul 22 16:23:08.031316 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:23:08.031129 2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 22 16:23:08.031316 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:23:08.031139 2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-546c5d6bb-qbhlm: secret "image-registry-tls" not found Jul 22 16:23:08.031316 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:23:08.031143 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 22 16:23:08.031316 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:23:08.031188 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1c84131c-de70-401c-a71b-8d7bc6dd171f-registry-tls podName:1c84131c-de70-401c-a71b-8d7bc6dd171f nodeName:}" failed. No retries permitted until 2026-07-22 16:23:12.031174124 +0000 UTC m=+44.132789678 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1c84131c-de70-401c-a71b-8d7bc6dd171f-registry-tls") pod "image-registry-546c5d6bb-qbhlm" (UID: "1c84131c-de70-401c-a71b-8d7bc6dd171f") : secret "image-registry-tls" not found Jul 22 16:23:08.031316 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:23:08.031200 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5c01298-8e46-4810-8190-c75c64e59cdd-metrics-tls podName:d5c01298-8e46-4810-8190-c75c64e59cdd nodeName:}" failed. No retries permitted until 2026-07-22 16:23:12.031194405 +0000 UTC m=+44.132809959 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d5c01298-8e46-4810-8190-c75c64e59cdd-metrics-tls") pod "dns-default-b2qn2" (UID: "d5c01298-8e46-4810-8190-c75c64e59cdd") : secret "dns-default-metrics-tls" not found Jul 22 16:23:09.145799 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.143747 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2qxr6"] Jul 22 16:23:09.148031 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.148003 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2qxr6" Jul 22 16:23:09.149746 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.149717 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-lfqs8"] Jul 22 16:23:09.150948 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.150925 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 22 16:23:09.151062 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.150929 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 22 16:23:09.151110 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.151070 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-jnfcx\"" Jul 22 16:23:09.151416 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.151399 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 22 16:23:09.152438 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.152419 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-2xzn9"] Jul 22 16:23:09.152556 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.152517 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-lfqs8" Jul 22 16:23:09.155196 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.155176 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-2xzn9" Jul 22 16:23:09.155719 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.155524 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 22 16:23:09.155719 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.155660 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2qxr6"] Jul 22 16:23:09.155947 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.155926 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 22 16:23:09.156276 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.156260 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 22 16:23:09.156576 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.156547 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 22 16:23:09.156576 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.156564 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-58ccq\"" Jul 22 16:23:09.158426 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.158408 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 22 16:23:09.158702 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.158681 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-k97wn\"" Jul 22 16:23:09.158841 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.158824 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 22 16:23:09.159122 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.159105 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 22 16:23:09.159199 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.159123 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 22 16:23:09.161941 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.161921 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 22 16:23:09.164763 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.164742 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-2xzn9"] Jul 22 16:23:09.165570 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.165533 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-lfqs8"] Jul 22 16:23:09.240205 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.240165 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b3d96828-99a1-47cc-9b81-2841561328e3-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-2qxr6\" (UID: \"b3d96828-99a1-47cc-9b81-2841561328e3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2qxr6" Jul 22 16:23:09.240205 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.240202 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ec2173f3-fbea-470c-8d86-a118033f43fd-config\") pod \"service-ca-operator-5bcbc94c78-2xzn9\" (UID: \"ec2173f3-fbea-470c-8d86-a118033f43fd\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-2xzn9" Jul 22 16:23:09.240444 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.240219 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/816518f1-790a-4350-ae15-18287e06323a-serving-cert\") pod \"console-operator-565b7b569d-lfqs8\" (UID: \"816518f1-790a-4350-ae15-18287e06323a\") " pod="openshift-console-operator/console-operator-565b7b569d-lfqs8" Jul 22 16:23:09.240444 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.240234 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/816518f1-790a-4350-ae15-18287e06323a-trusted-ca\") pod \"console-operator-565b7b569d-lfqs8\" (UID: \"816518f1-790a-4350-ae15-18287e06323a\") " pod="openshift-console-operator/console-operator-565b7b569d-lfqs8" Jul 22 16:23:09.240444 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.240303 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ec2173f3-fbea-470c-8d86-a118033f43fd-serving-cert\") pod \"service-ca-operator-5bcbc94c78-2xzn9\" (UID: \"ec2173f3-fbea-470c-8d86-a118033f43fd\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-2xzn9" Jul 22 16:23:09.240444 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.240377 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gv29q\" (UniqueName: \"kubernetes.io/projected/ec2173f3-fbea-470c-8d86-a118033f43fd-kube-api-access-gv29q\") pod \"service-ca-operator-5bcbc94c78-2xzn9\" (UID: \"ec2173f3-fbea-470c-8d86-a118033f43fd\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-2xzn9" Jul 22 16:23:09.240444 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.240410 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/816518f1-790a-4350-ae15-18287e06323a-config\") pod \"console-operator-565b7b569d-lfqs8\" (UID: \"816518f1-790a-4350-ae15-18287e06323a\") " pod="openshift-console-operator/console-operator-565b7b569d-lfqs8" Jul 22 16:23:09.240444 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.240441 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jpxht\" (UniqueName: \"kubernetes.io/projected/b3d96828-99a1-47cc-9b81-2841561328e3-kube-api-access-jpxht\") pod \"cluster-samples-operator-79b7c55f87-2qxr6\" (UID: \"b3d96828-99a1-47cc-9b81-2841561328e3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2qxr6" Jul 22 16:23:09.240626 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.240494 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h8ftn\" (UniqueName: \"kubernetes.io/projected/816518f1-790a-4350-ae15-18287e06323a-kube-api-access-h8ftn\") pod \"console-operator-565b7b569d-lfqs8\" (UID: \"816518f1-790a-4350-ae15-18287e06323a\") " pod="openshift-console-operator/console-operator-565b7b569d-lfqs8" Jul 22 16:23:09.245936 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.245909 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-chbv4"] Jul 22 16:23:09.249123 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.249109 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-dd5l9"] Jul 22 16:23:09.249252 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.249238 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-chbv4" Jul 22 16:23:09.251770 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.251750 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-qbtm7\"" Jul 22 16:23:09.251884 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.251820 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-dd5l9" Jul 22 16:23:09.254830 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.254808 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 22 16:23:09.254924 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.254812 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-gkg7v\"" Jul 22 16:23:09.254924 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.254813 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 22 16:23:09.257265 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.257246 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-s4wdv"] Jul 22 16:23:09.260170 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.260147 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-57b96c888d-pxl85"] Jul 22 16:23:09.260837 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.260813 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-s4wdv" Jul 22 16:23:09.263312 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.263293 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-mrs47"] Jul 22 16:23:09.263567 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.263549 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-57b96c888d-pxl85" Jul 22 16:23:09.263712 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.263560 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-fmjdf\"" Jul 22 16:23:09.263712 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.263608 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 22 16:23:09.264078 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.263560 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 22 16:23:09.264560 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.264540 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 22 16:23:09.264749 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.264731 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 22 16:23:09.266527 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.266503 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-chbv4"] Jul 22 16:23:09.266624 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.266545 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-dd5l9"] Jul 22 16:23:09.266624 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.266610 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 22 16:23:09.266758 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.266621 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 22 16:23:09.266825 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.266646 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 22 16:23:09.266874 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.266681 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-mrs47" Jul 22 16:23:09.266923 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.266697 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 22 16:23:09.266975 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.266707 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 22 16:23:09.266975 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.266814 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 22 16:23:09.267108 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.267091 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-56m76\"" Jul 22 16:23:09.269408 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.269392 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 22 16:23:09.269912 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.269890 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-gpmpg\"" Jul 22 16:23:09.270221 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.270201 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 22 16:23:09.271779 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.271762 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 22 16:23:09.274709 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.273287 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 22 16:23:09.276911 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.276832 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-s4wdv"] Jul 22 16:23:09.278906 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.278888 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-mrs47"] Jul 22 16:23:09.280044 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.280024 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-57b96c888d-pxl85"] Jul 22 16:23:09.341359 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.341326 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/8273b4e7-b4e0-4338-b8f1-ad7e1e7dae27-stats-auth\") pod \"router-default-57b96c888d-pxl85\" (UID: \"8273b4e7-b4e0-4338-b8f1-ad7e1e7dae27\") " pod="openshift-ingress/router-default-57b96c888d-pxl85" Jul 22 16:23:09.341546 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.341377 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ec2173f3-fbea-470c-8d86-a118033f43fd-serving-cert\") pod \"service-ca-operator-5bcbc94c78-2xzn9\" (UID: \"ec2173f3-fbea-470c-8d86-a118033f43fd\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-2xzn9" Jul 22 16:23:09.341546 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.341416 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/743b9a0c-6a6a-4e95-8289-84d715effd40-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-s4wdv\" (UID: \"743b9a0c-6a6a-4e95-8289-84d715effd40\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-s4wdv" Jul 22 16:23:09.341546 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.341441 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8273b4e7-b4e0-4338-b8f1-ad7e1e7dae27-metrics-certs\") pod \"router-default-57b96c888d-pxl85\" (UID: \"8273b4e7-b4e0-4338-b8f1-ad7e1e7dae27\") " pod="openshift-ingress/router-default-57b96c888d-pxl85" Jul 22 16:23:09.341546 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.341466 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/816518f1-790a-4350-ae15-18287e06323a-config\") pod \"console-operator-565b7b569d-lfqs8\" (UID: \"816518f1-790a-4350-ae15-18287e06323a\") " pod="openshift-console-operator/console-operator-565b7b569d-lfqs8" Jul 22 16:23:09.341546 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.341503 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h8ftn\" (UniqueName: \"kubernetes.io/projected/816518f1-790a-4350-ae15-18287e06323a-kube-api-access-h8ftn\") pod \"console-operator-565b7b569d-lfqs8\" (UID: \"816518f1-790a-4350-ae15-18287e06323a\") " pod="openshift-console-operator/console-operator-565b7b569d-lfqs8" Jul 22 16:23:09.341546 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.341531 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xn78l\" (UniqueName: \"kubernetes.io/projected/15d71c24-3074-4145-a424-c032a1e16f90-kube-api-access-xn78l\") pod \"cluster-monitoring-operator-76cf8966f8-mrs47\" (UID: \"15d71c24-3074-4145-a424-c032a1e16f90\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-mrs47" Jul 22 16:23:09.341818 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.341561 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ec2173f3-fbea-470c-8d86-a118033f43fd-config\") pod \"service-ca-operator-5bcbc94c78-2xzn9\" (UID: \"ec2173f3-fbea-470c-8d86-a118033f43fd\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-2xzn9" Jul 22 16:23:09.341818 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.341586 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/743b9a0c-6a6a-4e95-8289-84d715effd40-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-s4wdv\" (UID: \"743b9a0c-6a6a-4e95-8289-84d715effd40\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-s4wdv" Jul 22 16:23:09.341818 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.341607 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/8273b4e7-b4e0-4338-b8f1-ad7e1e7dae27-default-certificate\") pod \"router-default-57b96c888d-pxl85\" (UID: \"8273b4e7-b4e0-4338-b8f1-ad7e1e7dae27\") " pod="openshift-ingress/router-default-57b96c888d-pxl85" Jul 22 16:23:09.341818 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.341687 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/15d71c24-3074-4145-a424-c032a1e16f90-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-mrs47\" (UID: \"15d71c24-3074-4145-a424-c032a1e16f90\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-mrs47" Jul 22 16:23:09.341818 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.341760 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b3d96828-99a1-47cc-9b81-2841561328e3-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-2qxr6\" (UID: \"b3d96828-99a1-47cc-9b81-2841561328e3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2qxr6" Jul 22 16:23:09.341818 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.341803 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/816518f1-790a-4350-ae15-18287e06323a-trusted-ca\") pod \"console-operator-565b7b569d-lfqs8\" (UID: \"816518f1-790a-4350-ae15-18287e06323a\") " pod="openshift-console-operator/console-operator-565b7b569d-lfqs8" Jul 22 16:23:09.342067 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.341839 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhgl5\" (UniqueName: \"kubernetes.io/projected/743b9a0c-6a6a-4e95-8289-84d715effd40-kube-api-access-jhgl5\") pod \"kube-storage-version-migrator-operator-7658d9b749-s4wdv\" (UID: \"743b9a0c-6a6a-4e95-8289-84d715effd40\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-s4wdv" Jul 22 16:23:09.342067 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.341874 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gv29q\" (UniqueName: \"kubernetes.io/projected/ec2173f3-fbea-470c-8d86-a118033f43fd-kube-api-access-gv29q\") pod \"service-ca-operator-5bcbc94c78-2xzn9\" (UID: \"ec2173f3-fbea-470c-8d86-a118033f43fd\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-2xzn9" Jul 22 16:23:09.342067 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:23:09.341885 2568 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 22 16:23:09.342067 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.341904 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7e2887e8-0300-4255-bfb9-265e48b18be4-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-dd5l9\" (UID: \"7e2887e8-0300-4255-bfb9-265e48b18be4\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-dd5l9" Jul 22 16:23:09.342067 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:23:09.341948 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3d96828-99a1-47cc-9b81-2841561328e3-samples-operator-tls podName:b3d96828-99a1-47cc-9b81-2841561328e3 nodeName:}" failed. No retries permitted until 2026-07-22 16:23:09.841927661 +0000 UTC m=+41.943543224 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/b3d96828-99a1-47cc-9b81-2841561328e3-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-2qxr6" (UID: "b3d96828-99a1-47cc-9b81-2841561328e3") : secret "samples-operator-tls" not found Jul 22 16:23:09.342067 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.341973 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8273b4e7-b4e0-4338-b8f1-ad7e1e7dae27-service-ca-bundle\") pod \"router-default-57b96c888d-pxl85\" (UID: \"8273b4e7-b4e0-4338-b8f1-ad7e1e7dae27\") " pod="openshift-ingress/router-default-57b96c888d-pxl85" Jul 22 16:23:09.342067 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.342019 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/15d71c24-3074-4145-a424-c032a1e16f90-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-mrs47\" (UID: \"15d71c24-3074-4145-a424-c032a1e16f90\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-mrs47" Jul 22 16:23:09.342067 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.342051 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jpxht\" (UniqueName: \"kubernetes.io/projected/b3d96828-99a1-47cc-9b81-2841561328e3-kube-api-access-jpxht\") pod \"cluster-samples-operator-79b7c55f87-2qxr6\" (UID: \"b3d96828-99a1-47cc-9b81-2841561328e3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2qxr6" Jul 22 16:23:09.342468 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.342092 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vn8cp\" (UniqueName: \"kubernetes.io/projected/4b2e0cf2-14c5-4738-8c59-79bc6a78047a-kube-api-access-vn8cp\") pod \"network-check-source-7bc5b6bf85-chbv4\" (UID: \"4b2e0cf2-14c5-4738-8c59-79bc6a78047a\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-chbv4" Jul 22 16:23:09.342468 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.342141 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/816518f1-790a-4350-ae15-18287e06323a-serving-cert\") pod \"console-operator-565b7b569d-lfqs8\" (UID: \"816518f1-790a-4350-ae15-18287e06323a\") " pod="openshift-console-operator/console-operator-565b7b569d-lfqs8" Jul 22 16:23:09.342468 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.342196 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bf4cm\" (UniqueName: \"kubernetes.io/projected/8273b4e7-b4e0-4338-b8f1-ad7e1e7dae27-kube-api-access-bf4cm\") pod \"router-default-57b96c888d-pxl85\" (UID: \"8273b4e7-b4e0-4338-b8f1-ad7e1e7dae27\") " pod="openshift-ingress/router-default-57b96c888d-pxl85" Jul 22 16:23:09.342468 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.342242 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/7e2887e8-0300-4255-bfb9-265e48b18be4-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-dd5l9\" (UID: \"7e2887e8-0300-4255-bfb9-265e48b18be4\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-dd5l9" Jul 22 16:23:09.342468 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.342244 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ec2173f3-fbea-470c-8d86-a118033f43fd-config\") pod \"service-ca-operator-5bcbc94c78-2xzn9\" (UID: \"ec2173f3-fbea-470c-8d86-a118033f43fd\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-2xzn9" Jul 22 16:23:09.342468 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.342244 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/816518f1-790a-4350-ae15-18287e06323a-config\") pod \"console-operator-565b7b569d-lfqs8\" (UID: \"816518f1-790a-4350-ae15-18287e06323a\") " pod="openshift-console-operator/console-operator-565b7b569d-lfqs8" Jul 22 16:23:09.342662 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.342642 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/816518f1-790a-4350-ae15-18287e06323a-trusted-ca\") pod \"console-operator-565b7b569d-lfqs8\" (UID: \"816518f1-790a-4350-ae15-18287e06323a\") " pod="openshift-console-operator/console-operator-565b7b569d-lfqs8" Jul 22 16:23:09.345615 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.345597 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ec2173f3-fbea-470c-8d86-a118033f43fd-serving-cert\") pod \"service-ca-operator-5bcbc94c78-2xzn9\" (UID: \"ec2173f3-fbea-470c-8d86-a118033f43fd\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-2xzn9" Jul 22 16:23:09.345615 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.345600 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/816518f1-790a-4350-ae15-18287e06323a-serving-cert\") pod \"console-operator-565b7b569d-lfqs8\" (UID: \"816518f1-790a-4350-ae15-18287e06323a\") " pod="openshift-console-operator/console-operator-565b7b569d-lfqs8" Jul 22 16:23:09.351878 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.351853 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h8ftn\" (UniqueName: \"kubernetes.io/projected/816518f1-790a-4350-ae15-18287e06323a-kube-api-access-h8ftn\") pod \"console-operator-565b7b569d-lfqs8\" (UID: \"816518f1-790a-4350-ae15-18287e06323a\") " pod="openshift-console-operator/console-operator-565b7b569d-lfqs8" Jul 22 16:23:09.352091 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.352070 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jpxht\" (UniqueName: \"kubernetes.io/projected/b3d96828-99a1-47cc-9b81-2841561328e3-kube-api-access-jpxht\") pod \"cluster-samples-operator-79b7c55f87-2qxr6\" (UID: \"b3d96828-99a1-47cc-9b81-2841561328e3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2qxr6" Jul 22 16:23:09.374956 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.374925 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gv29q\" (UniqueName: \"kubernetes.io/projected/ec2173f3-fbea-470c-8d86-a118033f43fd-kube-api-access-gv29q\") pod \"service-ca-operator-5bcbc94c78-2xzn9\" (UID: \"ec2173f3-fbea-470c-8d86-a118033f43fd\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-2xzn9" Jul 22 16:23:09.380196 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.380173 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-p2ppt"] Jul 22 16:23:09.384305 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.384290 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-p2ppt" Jul 22 16:23:09.386388 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.386366 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-555d9d7885-njgfd"] Jul 22 16:23:09.387118 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.387097 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 22 16:23:09.387216 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.387190 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 22 16:23:09.387417 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.387401 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-l7h9g\"" Jul 22 16:23:09.389223 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.389204 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-njgfd" Jul 22 16:23:09.392004 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.391783 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 22 16:23:09.392004 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.391805 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 22 16:23:09.392004 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.391896 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-68r98\"" Jul 22 16:23:09.392283 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.392267 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 22 16:23:09.392645 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.392628 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 22 16:23:09.398095 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.398074 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-p2ppt"] Jul 22 16:23:09.399156 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.399133 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 22 16:23:09.401931 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.401899 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-njgfd"] Jul 22 16:23:09.442901 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.442864 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/8273b4e7-b4e0-4338-b8f1-ad7e1e7dae27-default-certificate\") pod \"router-default-57b96c888d-pxl85\" (UID: \"8273b4e7-b4e0-4338-b8f1-ad7e1e7dae27\") " pod="openshift-ingress/router-default-57b96c888d-pxl85" Jul 22 16:23:09.443069 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.442906 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/15d71c24-3074-4145-a424-c032a1e16f90-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-mrs47\" (UID: \"15d71c24-3074-4145-a424-c032a1e16f90\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-mrs47" Jul 22 16:23:09.443069 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.443041 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/2fc23598-8762-408d-b678-1eba72c5e867-snapshots\") pod \"insights-operator-555d9d7885-njgfd\" (UID: \"2fc23598-8762-408d-b678-1eba72c5e867\") " pod="openshift-insights/insights-operator-555d9d7885-njgfd" Jul 22 16:23:09.443182 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.443082 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhgl5\" (UniqueName: \"kubernetes.io/projected/743b9a0c-6a6a-4e95-8289-84d715effd40-kube-api-access-jhgl5\") pod \"kube-storage-version-migrator-operator-7658d9b749-s4wdv\" (UID: \"743b9a0c-6a6a-4e95-8289-84d715effd40\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-s4wdv" Jul 22 16:23:09.443182 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.443111 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2fc23598-8762-408d-b678-1eba72c5e867-serving-cert\") pod \"insights-operator-555d9d7885-njgfd\" (UID: \"2fc23598-8762-408d-b678-1eba72c5e867\") " pod="openshift-insights/insights-operator-555d9d7885-njgfd" Jul 22 16:23:09.443182 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.443145 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7e2887e8-0300-4255-bfb9-265e48b18be4-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-dd5l9\" (UID: \"7e2887e8-0300-4255-bfb9-265e48b18be4\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-dd5l9" Jul 22 16:23:09.443182 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.443170 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8273b4e7-b4e0-4338-b8f1-ad7e1e7dae27-service-ca-bundle\") pod \"router-default-57b96c888d-pxl85\" (UID: \"8273b4e7-b4e0-4338-b8f1-ad7e1e7dae27\") " pod="openshift-ingress/router-default-57b96c888d-pxl85" Jul 22 16:23:09.443415 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.443200 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vzfh8\" (UniqueName: \"kubernetes.io/projected/2fc23598-8762-408d-b678-1eba72c5e867-kube-api-access-vzfh8\") pod \"insights-operator-555d9d7885-njgfd\" (UID: \"2fc23598-8762-408d-b678-1eba72c5e867\") " pod="openshift-insights/insights-operator-555d9d7885-njgfd" Jul 22 16:23:09.443415 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.443236 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/15d71c24-3074-4145-a424-c032a1e16f90-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-mrs47\" (UID: \"15d71c24-3074-4145-a424-c032a1e16f90\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-mrs47" Jul 22 16:23:09.443415 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:23:09.443277 2568 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 22 16:23:09.443415 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.443298 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vn8cp\" (UniqueName: \"kubernetes.io/projected/4b2e0cf2-14c5-4738-8c59-79bc6a78047a-kube-api-access-vn8cp\") pod \"network-check-source-7bc5b6bf85-chbv4\" (UID: \"4b2e0cf2-14c5-4738-8c59-79bc6a78047a\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-chbv4" Jul 22 16:23:09.443415 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:23:09.443313 2568 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 22 16:23:09.443415 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:23:09.443392 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8273b4e7-b4e0-4338-b8f1-ad7e1e7dae27-service-ca-bundle podName:8273b4e7-b4e0-4338-b8f1-ad7e1e7dae27 nodeName:}" failed. No retries permitted until 2026-07-22 16:23:09.943338069 +0000 UTC m=+42.044953655 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8273b4e7-b4e0-4338-b8f1-ad7e1e7dae27-service-ca-bundle") pod "router-default-57b96c888d-pxl85" (UID: "8273b4e7-b4e0-4338-b8f1-ad7e1e7dae27") : configmap references non-existent config key: service-ca.crt Jul 22 16:23:09.443714 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.443454 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bf4cm\" (UniqueName: \"kubernetes.io/projected/8273b4e7-b4e0-4338-b8f1-ad7e1e7dae27-kube-api-access-bf4cm\") pod \"router-default-57b96c888d-pxl85\" (UID: \"8273b4e7-b4e0-4338-b8f1-ad7e1e7dae27\") " pod="openshift-ingress/router-default-57b96c888d-pxl85" Jul 22 16:23:09.443714 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:23:09.443468 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e2887e8-0300-4255-bfb9-265e48b18be4-networking-console-plugin-cert podName:7e2887e8-0300-4255-bfb9-265e48b18be4 nodeName:}" failed. No retries permitted until 2026-07-22 16:23:09.943450454 +0000 UTC m=+42.045066008 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7e2887e8-0300-4255-bfb9-265e48b18be4-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-dd5l9" (UID: "7e2887e8-0300-4255-bfb9-265e48b18be4") : secret "networking-console-plugin-cert" not found Jul 22 16:23:09.443714 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:23:09.443493 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15d71c24-3074-4145-a424-c032a1e16f90-cluster-monitoring-operator-tls podName:15d71c24-3074-4145-a424-c032a1e16f90 nodeName:}" failed. No retries permitted until 2026-07-22 16:23:09.943483301 +0000 UTC m=+42.045098854 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/15d71c24-3074-4145-a424-c032a1e16f90-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-mrs47" (UID: "15d71c24-3074-4145-a424-c032a1e16f90") : secret "cluster-monitoring-operator-tls" not found Jul 22 16:23:09.443714 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.443546 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/7e2887e8-0300-4255-bfb9-265e48b18be4-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-dd5l9\" (UID: \"7e2887e8-0300-4255-bfb9-265e48b18be4\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-dd5l9" Jul 22 16:23:09.443714 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.443590 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ggtp\" (UniqueName: \"kubernetes.io/projected/05a2bd49-c888-4088-b738-3c824d606966-kube-api-access-8ggtp\") pod \"volume-data-source-validator-78cf4c6f6-p2ppt\" (UID: \"05a2bd49-c888-4088-b738-3c824d606966\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-p2ppt" Jul 22 16:23:09.443714 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.443646 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/8273b4e7-b4e0-4338-b8f1-ad7e1e7dae27-stats-auth\") pod \"router-default-57b96c888d-pxl85\" (UID: \"8273b4e7-b4e0-4338-b8f1-ad7e1e7dae27\") " pod="openshift-ingress/router-default-57b96c888d-pxl85" Jul 22 16:23:09.443714 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.443694 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2fc23598-8762-408d-b678-1eba72c5e867-tmp\") pod \"insights-operator-555d9d7885-njgfd\" (UID: \"2fc23598-8762-408d-b678-1eba72c5e867\") " pod="openshift-insights/insights-operator-555d9d7885-njgfd" Jul 22 16:23:09.444049 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.443723 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/15d71c24-3074-4145-a424-c032a1e16f90-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-mrs47\" (UID: \"15d71c24-3074-4145-a424-c032a1e16f90\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-mrs47" Jul 22 16:23:09.444049 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.443729 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/743b9a0c-6a6a-4e95-8289-84d715effd40-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-s4wdv\" (UID: \"743b9a0c-6a6a-4e95-8289-84d715effd40\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-s4wdv" Jul 22 16:23:09.444049 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.443784 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8273b4e7-b4e0-4338-b8f1-ad7e1e7dae27-metrics-certs\") pod \"router-default-57b96c888d-pxl85\" (UID: \"8273b4e7-b4e0-4338-b8f1-ad7e1e7dae27\") " pod="openshift-ingress/router-default-57b96c888d-pxl85" Jul 22 16:23:09.444049 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.443820 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2fc23598-8762-408d-b678-1eba72c5e867-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-njgfd\" (UID: \"2fc23598-8762-408d-b678-1eba72c5e867\") " pod="openshift-insights/insights-operator-555d9d7885-njgfd" Jul 22 16:23:09.444049 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.443845 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2fc23598-8762-408d-b678-1eba72c5e867-service-ca-bundle\") pod \"insights-operator-555d9d7885-njgfd\" (UID: \"2fc23598-8762-408d-b678-1eba72c5e867\") " pod="openshift-insights/insights-operator-555d9d7885-njgfd" Jul 22 16:23:09.444049 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.443902 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xn78l\" (UniqueName: \"kubernetes.io/projected/15d71c24-3074-4145-a424-c032a1e16f90-kube-api-access-xn78l\") pod \"cluster-monitoring-operator-76cf8966f8-mrs47\" (UID: \"15d71c24-3074-4145-a424-c032a1e16f90\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-mrs47" Jul 22 16:23:09.444049 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:23:09.443938 2568 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 22 16:23:09.444049 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.443989 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/743b9a0c-6a6a-4e95-8289-84d715effd40-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-s4wdv\" (UID: \"743b9a0c-6a6a-4e95-8289-84d715effd40\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-s4wdv" Jul 22 16:23:09.444463 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:23:09.444119 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8273b4e7-b4e0-4338-b8f1-ad7e1e7dae27-metrics-certs podName:8273b4e7-b4e0-4338-b8f1-ad7e1e7dae27 nodeName:}" failed. No retries permitted until 2026-07-22 16:23:09.944100092 +0000 UTC m=+42.045715647 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8273b4e7-b4e0-4338-b8f1-ad7e1e7dae27-metrics-certs") pod "router-default-57b96c888d-pxl85" (UID: "8273b4e7-b4e0-4338-b8f1-ad7e1e7dae27") : secret "router-metrics-certs-default" not found Jul 22 16:23:09.444463 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.444251 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/7e2887e8-0300-4255-bfb9-265e48b18be4-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-dd5l9\" (UID: \"7e2887e8-0300-4255-bfb9-265e48b18be4\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-dd5l9" Jul 22 16:23:09.444463 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.444313 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/743b9a0c-6a6a-4e95-8289-84d715effd40-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-s4wdv\" (UID: \"743b9a0c-6a6a-4e95-8289-84d715effd40\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-s4wdv" Jul 22 16:23:09.445551 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.445529 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/8273b4e7-b4e0-4338-b8f1-ad7e1e7dae27-default-certificate\") pod \"router-default-57b96c888d-pxl85\" (UID: \"8273b4e7-b4e0-4338-b8f1-ad7e1e7dae27\") " pod="openshift-ingress/router-default-57b96c888d-pxl85" Jul 22 16:23:09.445894 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.445875 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/743b9a0c-6a6a-4e95-8289-84d715effd40-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-s4wdv\" (UID: \"743b9a0c-6a6a-4e95-8289-84d715effd40\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-s4wdv" Jul 22 16:23:09.445952 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.445943 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/8273b4e7-b4e0-4338-b8f1-ad7e1e7dae27-stats-auth\") pod \"router-default-57b96c888d-pxl85\" (UID: \"8273b4e7-b4e0-4338-b8f1-ad7e1e7dae27\") " pod="openshift-ingress/router-default-57b96c888d-pxl85" Jul 22 16:23:09.452465 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.452441 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhgl5\" (UniqueName: \"kubernetes.io/projected/743b9a0c-6a6a-4e95-8289-84d715effd40-kube-api-access-jhgl5\") pod \"kube-storage-version-migrator-operator-7658d9b749-s4wdv\" (UID: \"743b9a0c-6a6a-4e95-8289-84d715effd40\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-s4wdv" Jul 22 16:23:09.452950 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.452928 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vn8cp\" (UniqueName: \"kubernetes.io/projected/4b2e0cf2-14c5-4738-8c59-79bc6a78047a-kube-api-access-vn8cp\") pod \"network-check-source-7bc5b6bf85-chbv4\" (UID: \"4b2e0cf2-14c5-4738-8c59-79bc6a78047a\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-chbv4" Jul 22 16:23:09.453019 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.452931 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bf4cm\" (UniqueName: \"kubernetes.io/projected/8273b4e7-b4e0-4338-b8f1-ad7e1e7dae27-kube-api-access-bf4cm\") pod \"router-default-57b96c888d-pxl85\" (UID: \"8273b4e7-b4e0-4338-b8f1-ad7e1e7dae27\") " pod="openshift-ingress/router-default-57b96c888d-pxl85" Jul 22 16:23:09.453019 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.453002 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xn78l\" (UniqueName: \"kubernetes.io/projected/15d71c24-3074-4145-a424-c032a1e16f90-kube-api-access-xn78l\") pod \"cluster-monitoring-operator-76cf8966f8-mrs47\" (UID: \"15d71c24-3074-4145-a424-c032a1e16f90\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-mrs47" Jul 22 16:23:09.466050 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.466031 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-lfqs8" Jul 22 16:23:09.471136 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.471122 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-2xzn9" Jul 22 16:23:09.544450 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.544417 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2fc23598-8762-408d-b678-1eba72c5e867-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-njgfd\" (UID: \"2fc23598-8762-408d-b678-1eba72c5e867\") " pod="openshift-insights/insights-operator-555d9d7885-njgfd" Jul 22 16:23:09.544608 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.544459 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2fc23598-8762-408d-b678-1eba72c5e867-service-ca-bundle\") pod \"insights-operator-555d9d7885-njgfd\" (UID: \"2fc23598-8762-408d-b678-1eba72c5e867\") " pod="openshift-insights/insights-operator-555d9d7885-njgfd" Jul 22 16:23:09.544608 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.544529 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/2fc23598-8762-408d-b678-1eba72c5e867-snapshots\") pod \"insights-operator-555d9d7885-njgfd\" (UID: \"2fc23598-8762-408d-b678-1eba72c5e867\") " pod="openshift-insights/insights-operator-555d9d7885-njgfd" Jul 22 16:23:09.544608 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.544561 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2fc23598-8762-408d-b678-1eba72c5e867-serving-cert\") pod \"insights-operator-555d9d7885-njgfd\" (UID: \"2fc23598-8762-408d-b678-1eba72c5e867\") " pod="openshift-insights/insights-operator-555d9d7885-njgfd" Jul 22 16:23:09.544753 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.544619 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vzfh8\" (UniqueName: \"kubernetes.io/projected/2fc23598-8762-408d-b678-1eba72c5e867-kube-api-access-vzfh8\") pod \"insights-operator-555d9d7885-njgfd\" (UID: \"2fc23598-8762-408d-b678-1eba72c5e867\") " pod="openshift-insights/insights-operator-555d9d7885-njgfd" Jul 22 16:23:09.544753 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.544739 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ggtp\" (UniqueName: \"kubernetes.io/projected/05a2bd49-c888-4088-b738-3c824d606966-kube-api-access-8ggtp\") pod \"volume-data-source-validator-78cf4c6f6-p2ppt\" (UID: \"05a2bd49-c888-4088-b738-3c824d606966\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-p2ppt" Jul 22 16:23:09.544847 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.544780 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2fc23598-8762-408d-b678-1eba72c5e867-tmp\") pod \"insights-operator-555d9d7885-njgfd\" (UID: \"2fc23598-8762-408d-b678-1eba72c5e867\") " pod="openshift-insights/insights-operator-555d9d7885-njgfd" Jul 22 16:23:09.545268 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.545204 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2fc23598-8762-408d-b678-1eba72c5e867-service-ca-bundle\") pod \"insights-operator-555d9d7885-njgfd\" (UID: \"2fc23598-8762-408d-b678-1eba72c5e867\") " pod="openshift-insights/insights-operator-555d9d7885-njgfd" Jul 22 16:23:09.545268 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.545261 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/2fc23598-8762-408d-b678-1eba72c5e867-snapshots\") pod \"insights-operator-555d9d7885-njgfd\" (UID: \"2fc23598-8762-408d-b678-1eba72c5e867\") " pod="openshift-insights/insights-operator-555d9d7885-njgfd" Jul 22 16:23:09.545558 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.545525 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2fc23598-8762-408d-b678-1eba72c5e867-tmp\") pod \"insights-operator-555d9d7885-njgfd\" (UID: \"2fc23598-8762-408d-b678-1eba72c5e867\") " pod="openshift-insights/insights-operator-555d9d7885-njgfd" Jul 22 16:23:09.545644 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.545625 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2fc23598-8762-408d-b678-1eba72c5e867-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-njgfd\" (UID: \"2fc23598-8762-408d-b678-1eba72c5e867\") " pod="openshift-insights/insights-operator-555d9d7885-njgfd" Jul 22 16:23:09.546873 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.546856 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2fc23598-8762-408d-b678-1eba72c5e867-serving-cert\") pod \"insights-operator-555d9d7885-njgfd\" (UID: \"2fc23598-8762-408d-b678-1eba72c5e867\") " pod="openshift-insights/insights-operator-555d9d7885-njgfd" Jul 22 16:23:09.553228 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.553207 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ggtp\" (UniqueName: \"kubernetes.io/projected/05a2bd49-c888-4088-b738-3c824d606966-kube-api-access-8ggtp\") pod \"volume-data-source-validator-78cf4c6f6-p2ppt\" (UID: \"05a2bd49-c888-4088-b738-3c824d606966\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-p2ppt" Jul 22 16:23:09.553438 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.553399 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vzfh8\" (UniqueName: \"kubernetes.io/projected/2fc23598-8762-408d-b678-1eba72c5e867-kube-api-access-vzfh8\") pod \"insights-operator-555d9d7885-njgfd\" (UID: \"2fc23598-8762-408d-b678-1eba72c5e867\") " pod="openshift-insights/insights-operator-555d9d7885-njgfd" Jul 22 16:23:09.558988 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.558963 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-chbv4" Jul 22 16:23:09.580819 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.580582 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-s4wdv" Jul 22 16:23:09.598633 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.598604 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-lfqs8"] Jul 22 16:23:09.600999 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:23:09.600975 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod816518f1_790a_4350_ae15_18287e06323a.slice/crio-ce46c8579c16934edb8024d38c754be80035cd7991b861fb3763872c9c275517 WatchSource:0}: Error finding container ce46c8579c16934edb8024d38c754be80035cd7991b861fb3763872c9c275517: Status 404 returned error can't find the container with id ce46c8579c16934edb8024d38c754be80035cd7991b861fb3763872c9c275517 Jul 22 16:23:09.615381 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.615312 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-2xzn9"] Jul 22 16:23:09.619804 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:23:09.619776 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec2173f3_fbea_470c_8d86_a118033f43fd.slice/crio-9db49a13d001f770920854a2c59ac239a821a37d580ca0297b5362d4d2950bac WatchSource:0}: Error finding container 9db49a13d001f770920854a2c59ac239a821a37d580ca0297b5362d4d2950bac: Status 404 returned error can't find the container with id 9db49a13d001f770920854a2c59ac239a821a37d580ca0297b5362d4d2950bac Jul 22 16:23:09.695392 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.695338 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-p2ppt" Jul 22 16:23:09.699931 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.699904 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-njgfd" Jul 22 16:23:09.701150 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.700876 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-chbv4"] Jul 22 16:23:09.719045 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.719015 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-s4wdv"] Jul 22 16:23:09.722582 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:23:09.722551 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod743b9a0c_6a6a_4e95_8289_84d715effd40.slice/crio-8be27d3aa5cb557b53685056f810b59a31bd2bebc893aa77a60f257125e0eb02 WatchSource:0}: Error finding container 8be27d3aa5cb557b53685056f810b59a31bd2bebc893aa77a60f257125e0eb02: Status 404 returned error can't find the container with id 8be27d3aa5cb557b53685056f810b59a31bd2bebc893aa77a60f257125e0eb02 Jul 22 16:23:09.778231 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.778154 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-s4wdv" event={"ID":"743b9a0c-6a6a-4e95-8289-84d715effd40","Type":"ContainerStarted","Data":"8be27d3aa5cb557b53685056f810b59a31bd2bebc893aa77a60f257125e0eb02"} Jul 22 16:23:09.779656 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.779577 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-2xzn9" event={"ID":"ec2173f3-fbea-470c-8d86-a118033f43fd","Type":"ContainerStarted","Data":"9db49a13d001f770920854a2c59ac239a821a37d580ca0297b5362d4d2950bac"} Jul 22 16:23:09.780925 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.780871 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-chbv4" event={"ID":"4b2e0cf2-14c5-4738-8c59-79bc6a78047a","Type":"ContainerStarted","Data":"5fe1580e2545d9c102d59be27d4da554c3a016fb2083625ecc6aa95c1864e526"} Jul 22 16:23:09.782005 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.781980 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-lfqs8" event={"ID":"816518f1-790a-4350-ae15-18287e06323a","Type":"ContainerStarted","Data":"ce46c8579c16934edb8024d38c754be80035cd7991b861fb3763872c9c275517"} Jul 22 16:23:09.841765 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.841723 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-njgfd"] Jul 22 16:23:09.844446 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:23:09.844419 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fc23598_8762_408d_b678_1eba72c5e867.slice/crio-11d532fbf98fc15e686c812d5e5221681f5a430aae9b0c6e043e7448f8294c5c WatchSource:0}: Error finding container 11d532fbf98fc15e686c812d5e5221681f5a430aae9b0c6e043e7448f8294c5c: Status 404 returned error can't find the container with id 11d532fbf98fc15e686c812d5e5221681f5a430aae9b0c6e043e7448f8294c5c Jul 22 16:23:09.847289 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.847269 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b3d96828-99a1-47cc-9b81-2841561328e3-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-2qxr6\" (UID: \"b3d96828-99a1-47cc-9b81-2841561328e3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2qxr6" Jul 22 16:23:09.847490 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:23:09.847461 2568 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 22 16:23:09.847544 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:23:09.847530 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3d96828-99a1-47cc-9b81-2841561328e3-samples-operator-tls podName:b3d96828-99a1-47cc-9b81-2841561328e3 nodeName:}" failed. No retries permitted until 2026-07-22 16:23:10.847514654 +0000 UTC m=+42.949130208 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/b3d96828-99a1-47cc-9b81-2841561328e3-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-2qxr6" (UID: "b3d96828-99a1-47cc-9b81-2841561328e3") : secret "samples-operator-tls" not found Jul 22 16:23:09.856082 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.856059 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-p2ppt"] Jul 22 16:23:09.858941 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:23:09.858917 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05a2bd49_c888_4088_b738_3c824d606966.slice/crio-dd8f154a53d322f74c7e54268734212e28332635057facb2fbe10a4203201fdd WatchSource:0}: Error finding container dd8f154a53d322f74c7e54268734212e28332635057facb2fbe10a4203201fdd: Status 404 returned error can't find the container with id dd8f154a53d322f74c7e54268734212e28332635057facb2fbe10a4203201fdd Jul 22 16:23:09.948089 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.948001 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7e2887e8-0300-4255-bfb9-265e48b18be4-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-dd5l9\" (UID: \"7e2887e8-0300-4255-bfb9-265e48b18be4\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-dd5l9" Jul 22 16:23:09.948089 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.948041 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8273b4e7-b4e0-4338-b8f1-ad7e1e7dae27-service-ca-bundle\") pod \"router-default-57b96c888d-pxl85\" (UID: \"8273b4e7-b4e0-4338-b8f1-ad7e1e7dae27\") " pod="openshift-ingress/router-default-57b96c888d-pxl85" Jul 22 16:23:09.948089 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.948061 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/15d71c24-3074-4145-a424-c032a1e16f90-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-mrs47\" (UID: \"15d71c24-3074-4145-a424-c032a1e16f90\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-mrs47" Jul 22 16:23:09.948365 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:09.948148 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8273b4e7-b4e0-4338-b8f1-ad7e1e7dae27-metrics-certs\") pod \"router-default-57b96c888d-pxl85\" (UID: \"8273b4e7-b4e0-4338-b8f1-ad7e1e7dae27\") " pod="openshift-ingress/router-default-57b96c888d-pxl85" Jul 22 16:23:09.948365 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:23:09.948216 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8273b4e7-b4e0-4338-b8f1-ad7e1e7dae27-service-ca-bundle podName:8273b4e7-b4e0-4338-b8f1-ad7e1e7dae27 nodeName:}" failed. No retries permitted until 2026-07-22 16:23:10.948192846 +0000 UTC m=+43.049808409 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8273b4e7-b4e0-4338-b8f1-ad7e1e7dae27-service-ca-bundle") pod "router-default-57b96c888d-pxl85" (UID: "8273b4e7-b4e0-4338-b8f1-ad7e1e7dae27") : configmap references non-existent config key: service-ca.crt Jul 22 16:23:09.948365 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:23:09.948226 2568 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 22 16:23:09.948365 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:23:09.948238 2568 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 22 16:23:09.948365 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:23:09.948264 2568 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 22 16:23:09.948365 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:23:09.948292 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e2887e8-0300-4255-bfb9-265e48b18be4-networking-console-plugin-cert podName:7e2887e8-0300-4255-bfb9-265e48b18be4 nodeName:}" failed. No retries permitted until 2026-07-22 16:23:10.948275466 +0000 UTC m=+43.049891033 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7e2887e8-0300-4255-bfb9-265e48b18be4-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-dd5l9" (UID: "7e2887e8-0300-4255-bfb9-265e48b18be4") : secret "networking-console-plugin-cert" not found Jul 22 16:23:09.948365 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:23:09.948308 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8273b4e7-b4e0-4338-b8f1-ad7e1e7dae27-metrics-certs podName:8273b4e7-b4e0-4338-b8f1-ad7e1e7dae27 nodeName:}" failed. No retries permitted until 2026-07-22 16:23:10.948301313 +0000 UTC m=+43.049916867 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8273b4e7-b4e0-4338-b8f1-ad7e1e7dae27-metrics-certs") pod "router-default-57b96c888d-pxl85" (UID: "8273b4e7-b4e0-4338-b8f1-ad7e1e7dae27") : secret "router-metrics-certs-default" not found Jul 22 16:23:09.948365 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:23:09.948318 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15d71c24-3074-4145-a424-c032a1e16f90-cluster-monitoring-operator-tls podName:15d71c24-3074-4145-a424-c032a1e16f90 nodeName:}" failed. No retries permitted until 2026-07-22 16:23:10.948313487 +0000 UTC m=+43.049929041 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/15d71c24-3074-4145-a424-c032a1e16f90-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-mrs47" (UID: "15d71c24-3074-4145-a424-c032a1e16f90") : secret "cluster-monitoring-operator-tls" not found Jul 22 16:23:10.790840 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:10.790768 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-p2ppt" event={"ID":"05a2bd49-c888-4088-b738-3c824d606966","Type":"ContainerStarted","Data":"dd8f154a53d322f74c7e54268734212e28332635057facb2fbe10a4203201fdd"} Jul 22 16:23:10.792620 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:10.792552 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-njgfd" event={"ID":"2fc23598-8762-408d-b678-1eba72c5e867","Type":"ContainerStarted","Data":"11d532fbf98fc15e686c812d5e5221681f5a430aae9b0c6e043e7448f8294c5c"} Jul 22 16:23:10.857962 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:10.857071 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b3d96828-99a1-47cc-9b81-2841561328e3-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-2qxr6\" (UID: \"b3d96828-99a1-47cc-9b81-2841561328e3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2qxr6" Jul 22 16:23:10.857962 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:23:10.857504 2568 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 22 16:23:10.857962 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:23:10.857582 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3d96828-99a1-47cc-9b81-2841561328e3-samples-operator-tls podName:b3d96828-99a1-47cc-9b81-2841561328e3 nodeName:}" failed. No retries permitted until 2026-07-22 16:23:12.857558654 +0000 UTC m=+44.959174232 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/b3d96828-99a1-47cc-9b81-2841561328e3-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-2qxr6" (UID: "b3d96828-99a1-47cc-9b81-2841561328e3") : secret "samples-operator-tls" not found Jul 22 16:23:10.958519 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:10.958477 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8273b4e7-b4e0-4338-b8f1-ad7e1e7dae27-metrics-certs\") pod \"router-default-57b96c888d-pxl85\" (UID: \"8273b4e7-b4e0-4338-b8f1-ad7e1e7dae27\") " pod="openshift-ingress/router-default-57b96c888d-pxl85" Jul 22 16:23:10.958681 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:10.958582 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7e2887e8-0300-4255-bfb9-265e48b18be4-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-dd5l9\" (UID: \"7e2887e8-0300-4255-bfb9-265e48b18be4\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-dd5l9" Jul 22 16:23:10.958681 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:10.958607 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8273b4e7-b4e0-4338-b8f1-ad7e1e7dae27-service-ca-bundle\") pod \"router-default-57b96c888d-pxl85\" (UID: \"8273b4e7-b4e0-4338-b8f1-ad7e1e7dae27\") " pod="openshift-ingress/router-default-57b96c888d-pxl85" Jul 22 16:23:10.958681 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:10.958635 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/15d71c24-3074-4145-a424-c032a1e16f90-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-mrs47\" (UID: \"15d71c24-3074-4145-a424-c032a1e16f90\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-mrs47" Jul 22 16:23:10.958831 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:23:10.958797 2568 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 22 16:23:10.958875 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:23:10.958861 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15d71c24-3074-4145-a424-c032a1e16f90-cluster-monitoring-operator-tls podName:15d71c24-3074-4145-a424-c032a1e16f90 nodeName:}" failed. No retries permitted until 2026-07-22 16:23:12.95884197 +0000 UTC m=+45.060457547 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/15d71c24-3074-4145-a424-c032a1e16f90-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-mrs47" (UID: "15d71c24-3074-4145-a424-c032a1e16f90") : secret "cluster-monitoring-operator-tls" not found Jul 22 16:23:10.958953 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:23:10.958931 2568 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 22 16:23:10.959013 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:23:10.958974 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8273b4e7-b4e0-4338-b8f1-ad7e1e7dae27-metrics-certs podName:8273b4e7-b4e0-4338-b8f1-ad7e1e7dae27 nodeName:}" failed. No retries permitted until 2026-07-22 16:23:12.958961126 +0000 UTC m=+45.060576694 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8273b4e7-b4e0-4338-b8f1-ad7e1e7dae27-metrics-certs") pod "router-default-57b96c888d-pxl85" (UID: "8273b4e7-b4e0-4338-b8f1-ad7e1e7dae27") : secret "router-metrics-certs-default" not found Jul 22 16:23:10.959073 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:23:10.959037 2568 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 22 16:23:10.959073 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:23:10.959070 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e2887e8-0300-4255-bfb9-265e48b18be4-networking-console-plugin-cert podName:7e2887e8-0300-4255-bfb9-265e48b18be4 nodeName:}" failed. No retries permitted until 2026-07-22 16:23:12.959060143 +0000 UTC m=+45.060675700 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7e2887e8-0300-4255-bfb9-265e48b18be4-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-dd5l9" (UID: "7e2887e8-0300-4255-bfb9-265e48b18be4") : secret "networking-console-plugin-cert" not found Jul 22 16:23:10.959163 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:23:10.959139 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8273b4e7-b4e0-4338-b8f1-ad7e1e7dae27-service-ca-bundle podName:8273b4e7-b4e0-4338-b8f1-ad7e1e7dae27 nodeName:}" failed. No retries permitted until 2026-07-22 16:23:12.959129791 +0000 UTC m=+45.060745359 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8273b4e7-b4e0-4338-b8f1-ad7e1e7dae27-service-ca-bundle") pod "router-default-57b96c888d-pxl85" (UID: "8273b4e7-b4e0-4338-b8f1-ad7e1e7dae27") : configmap references non-existent config key: service-ca.crt Jul 22 16:23:12.070715 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:12.070603 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1c84131c-de70-401c-a71b-8d7bc6dd171f-registry-tls\") pod \"image-registry-546c5d6bb-qbhlm\" (UID: \"1c84131c-de70-401c-a71b-8d7bc6dd171f\") " pod="openshift-image-registry/image-registry-546c5d6bb-qbhlm" Jul 22 16:23:12.071174 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:23:12.070775 2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 22 16:23:12.071174 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:23:12.070798 2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-546c5d6bb-qbhlm: secret "image-registry-tls" not found Jul 22 16:23:12.071174 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:12.070806 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d5c01298-8e46-4810-8190-c75c64e59cdd-metrics-tls\") pod \"dns-default-b2qn2\" (UID: \"d5c01298-8e46-4810-8190-c75c64e59cdd\") " pod="openshift-dns/dns-default-b2qn2" Jul 22 16:23:12.071174 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:23:12.070858 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1c84131c-de70-401c-a71b-8d7bc6dd171f-registry-tls podName:1c84131c-de70-401c-a71b-8d7bc6dd171f nodeName:}" failed. No retries permitted until 2026-07-22 16:23:20.070840914 +0000 UTC m=+52.172456471 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1c84131c-de70-401c-a71b-8d7bc6dd171f-registry-tls") pod "image-registry-546c5d6bb-qbhlm" (UID: "1c84131c-de70-401c-a71b-8d7bc6dd171f") : secret "image-registry-tls" not found Jul 22 16:23:12.071174 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:23:12.070944 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 22 16:23:12.071174 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:23:12.071003 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5c01298-8e46-4810-8190-c75c64e59cdd-metrics-tls podName:d5c01298-8e46-4810-8190-c75c64e59cdd nodeName:}" failed. No retries permitted until 2026-07-22 16:23:20.070986367 +0000 UTC m=+52.172601922 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d5c01298-8e46-4810-8190-c75c64e59cdd-metrics-tls") pod "dns-default-b2qn2" (UID: "d5c01298-8e46-4810-8190-c75c64e59cdd") : secret "dns-default-metrics-tls" not found Jul 22 16:23:12.878299 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:12.878254 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b3d96828-99a1-47cc-9b81-2841561328e3-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-2qxr6\" (UID: \"b3d96828-99a1-47cc-9b81-2841561328e3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2qxr6" Jul 22 16:23:12.878511 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:23:12.878460 2568 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 22 16:23:12.878570 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:23:12.878542 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3d96828-99a1-47cc-9b81-2841561328e3-samples-operator-tls podName:b3d96828-99a1-47cc-9b81-2841561328e3 nodeName:}" failed. No retries permitted until 2026-07-22 16:23:16.878520675 +0000 UTC m=+48.980136237 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/b3d96828-99a1-47cc-9b81-2841561328e3-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-2qxr6" (UID: "b3d96828-99a1-47cc-9b81-2841561328e3") : secret "samples-operator-tls" not found Jul 22 16:23:12.979617 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:12.979562 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7e2887e8-0300-4255-bfb9-265e48b18be4-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-dd5l9\" (UID: \"7e2887e8-0300-4255-bfb9-265e48b18be4\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-dd5l9" Jul 22 16:23:12.979617 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:12.979624 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8273b4e7-b4e0-4338-b8f1-ad7e1e7dae27-service-ca-bundle\") pod \"router-default-57b96c888d-pxl85\" (UID: \"8273b4e7-b4e0-4338-b8f1-ad7e1e7dae27\") " pod="openshift-ingress/router-default-57b96c888d-pxl85" Jul 22 16:23:12.979855 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:12.979659 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/15d71c24-3074-4145-a424-c032a1e16f90-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-mrs47\" (UID: \"15d71c24-3074-4145-a424-c032a1e16f90\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-mrs47" Jul 22 16:23:12.979855 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:23:12.979727 2568 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 22 16:23:12.979855 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:23:12.979729 2568 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 22 16:23:12.979855 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:23:12.979774 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8273b4e7-b4e0-4338-b8f1-ad7e1e7dae27-service-ca-bundle podName:8273b4e7-b4e0-4338-b8f1-ad7e1e7dae27 nodeName:}" failed. No retries permitted until 2026-07-22 16:23:16.979753418 +0000 UTC m=+49.081368973 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8273b4e7-b4e0-4338-b8f1-ad7e1e7dae27-service-ca-bundle") pod "router-default-57b96c888d-pxl85" (UID: "8273b4e7-b4e0-4338-b8f1-ad7e1e7dae27") : configmap references non-existent config key: service-ca.crt Jul 22 16:23:12.979855 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:23:12.979829 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e2887e8-0300-4255-bfb9-265e48b18be4-networking-console-plugin-cert podName:7e2887e8-0300-4255-bfb9-265e48b18be4 nodeName:}" failed. No retries permitted until 2026-07-22 16:23:16.979815406 +0000 UTC m=+49.081430972 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7e2887e8-0300-4255-bfb9-265e48b18be4-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-dd5l9" (UID: "7e2887e8-0300-4255-bfb9-265e48b18be4") : secret "networking-console-plugin-cert" not found Jul 22 16:23:12.979855 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:23:12.979841 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15d71c24-3074-4145-a424-c032a1e16f90-cluster-monitoring-operator-tls podName:15d71c24-3074-4145-a424-c032a1e16f90 nodeName:}" failed. No retries permitted until 2026-07-22 16:23:16.979834988 +0000 UTC m=+49.081450542 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/15d71c24-3074-4145-a424-c032a1e16f90-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-mrs47" (UID: "15d71c24-3074-4145-a424-c032a1e16f90") : secret "cluster-monitoring-operator-tls" not found Jul 22 16:23:12.980123 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:12.979867 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8273b4e7-b4e0-4338-b8f1-ad7e1e7dae27-metrics-certs\") pod \"router-default-57b96c888d-pxl85\" (UID: \"8273b4e7-b4e0-4338-b8f1-ad7e1e7dae27\") " pod="openshift-ingress/router-default-57b96c888d-pxl85" Jul 22 16:23:12.980123 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:23:12.979966 2568 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 22 16:23:12.980123 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:23:12.980000 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8273b4e7-b4e0-4338-b8f1-ad7e1e7dae27-metrics-certs podName:8273b4e7-b4e0-4338-b8f1-ad7e1e7dae27 nodeName:}" failed. No retries permitted until 2026-07-22 16:23:16.979988262 +0000 UTC m=+49.081603817 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8273b4e7-b4e0-4338-b8f1-ad7e1e7dae27-metrics-certs") pod "router-default-57b96c888d-pxl85" (UID: "8273b4e7-b4e0-4338-b8f1-ad7e1e7dae27") : secret "router-metrics-certs-default" not found Jul 22 16:23:16.812370 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:16.812259 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-s4wdv" event={"ID":"743b9a0c-6a6a-4e95-8289-84d715effd40","Type":"ContainerStarted","Data":"e9987495fa4f09adf0a90316b9c308dd6f5f8ae2734da31e309cb863dce98ca5"} Jul 22 16:23:16.814268 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:16.814213 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-2xzn9" event={"ID":"ec2173f3-fbea-470c-8d86-a118033f43fd","Type":"ContainerStarted","Data":"fb90707111abd09fa06f0c57e9866158a1f242617ba1da44f80d0802831d634a"} Jul 22 16:23:16.815966 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:16.815942 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-p2ppt" event={"ID":"05a2bd49-c888-4088-b738-3c824d606966","Type":"ContainerStarted","Data":"d508c64566534fcd4874d4e8ee77d09bf737703ae9ca2c2282e9de33323697de"} Jul 22 16:23:16.818000 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:16.817980 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-chbv4" event={"ID":"4b2e0cf2-14c5-4738-8c59-79bc6a78047a","Type":"ContainerStarted","Data":"fee4b1f47edd21c8842791e6cb8d43a832b410886ee7fc3a5ca0e8effa27df9b"} Jul 22 16:23:16.819740 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:16.819719 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-lfqs8_816518f1-790a-4350-ae15-18287e06323a/console-operator/0.log" Jul 22 16:23:16.819853 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:16.819758 2568 generic.go:356] "Generic (PLEG): container finished" podID="816518f1-790a-4350-ae15-18287e06323a" containerID="12fbc1ce053d04f4c7a31432f9aa47c453554b5c7558af93e15ce3085ff130b2" exitCode=255 Jul 22 16:23:16.819853 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:16.819824 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-lfqs8" event={"ID":"816518f1-790a-4350-ae15-18287e06323a","Type":"ContainerDied","Data":"12fbc1ce053d04f4c7a31432f9aa47c453554b5c7558af93e15ce3085ff130b2"} Jul 22 16:23:16.820005 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:16.819989 2568 scope.go:117] "RemoveContainer" containerID="12fbc1ce053d04f4c7a31432f9aa47c453554b5c7558af93e15ce3085ff130b2" Jul 22 16:23:16.821546 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:16.821523 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-njgfd" event={"ID":"2fc23598-8762-408d-b678-1eba72c5e867","Type":"ContainerStarted","Data":"a4c681d6e57bbf1185154e8ad3eaaae35fe9f1548aa2cbe970e8ca408ef4e60f"} Jul 22 16:23:16.830320 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:16.830273 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-s4wdv" podStartSLOduration=1.246081533 podStartE2EDuration="7.830255035s" totalImagesPullingTime="6.584173502s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:23:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:23:16.829615596 +0000 UTC m=+48.931231173" watchObservedRunningTime="2026-07-22 16:23:16.830255035 +0000 UTC m=+48.931870590" Jul 22 16:23:16.868340 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:16.867667 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-555d9d7885-njgfd" podStartSLOduration=1.405309825 podStartE2EDuration="7.867646324s" totalImagesPullingTime="6.462336499s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:23:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:23:16.848336502 +0000 UTC m=+48.949952079" watchObservedRunningTime="2026-07-22 16:23:16.867646324 +0000 UTC m=+48.969261882" Jul 22 16:23:16.887413 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:16.887144 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-2xzn9" podStartSLOduration=1.193720498 podStartE2EDuration="7.887121399s" totalImagesPullingTime="6.693400901s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:23:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:23:16.885101925 +0000 UTC m=+48.986717501" watchObservedRunningTime="2026-07-22 16:23:16.887121399 +0000 UTC m=+48.988736976" Jul 22 16:23:16.901719 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:16.901669 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-chbv4" podStartSLOduration=1.299512774 podStartE2EDuration="7.901651954s" totalImagesPullingTime="6.60213918s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:23:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:23:16.89970128 +0000 UTC m=+49.001316856" watchObservedRunningTime="2026-07-22 16:23:16.901651954 +0000 UTC m=+49.003267533" Jul 22 16:23:16.914676 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:16.914621 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-p2ppt" podStartSLOduration=1.466261557 podStartE2EDuration="7.91460347s" totalImagesPullingTime="6.448341913s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:23:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:23:16.914046192 +0000 UTC m=+49.015661766" watchObservedRunningTime="2026-07-22 16:23:16.91460347 +0000 UTC m=+49.016219049" Jul 22 16:23:16.920635 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:16.918929 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b3d96828-99a1-47cc-9b81-2841561328e3-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-2qxr6\" (UID: \"b3d96828-99a1-47cc-9b81-2841561328e3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2qxr6" Jul 22 16:23:16.920635 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:23:16.920572 2568 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 22 16:23:16.920821 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:23:16.920721 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3d96828-99a1-47cc-9b81-2841561328e3-samples-operator-tls podName:b3d96828-99a1-47cc-9b81-2841561328e3 nodeName:}" failed. No retries permitted until 2026-07-22 16:23:24.920700727 +0000 UTC m=+57.022316281 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/b3d96828-99a1-47cc-9b81-2841561328e3-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-2qxr6" (UID: "b3d96828-99a1-47cc-9b81-2841561328e3") : secret "samples-operator-tls" not found Jul 22 16:23:17.019585 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:17.019541 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8273b4e7-b4e0-4338-b8f1-ad7e1e7dae27-metrics-certs\") pod \"router-default-57b96c888d-pxl85\" (UID: \"8273b4e7-b4e0-4338-b8f1-ad7e1e7dae27\") " pod="openshift-ingress/router-default-57b96c888d-pxl85" Jul 22 16:23:17.019725 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:17.019644 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7e2887e8-0300-4255-bfb9-265e48b18be4-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-dd5l9\" (UID: \"7e2887e8-0300-4255-bfb9-265e48b18be4\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-dd5l9" Jul 22 16:23:17.019725 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:17.019673 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8273b4e7-b4e0-4338-b8f1-ad7e1e7dae27-service-ca-bundle\") pod \"router-default-57b96c888d-pxl85\" (UID: \"8273b4e7-b4e0-4338-b8f1-ad7e1e7dae27\") " pod="openshift-ingress/router-default-57b96c888d-pxl85" Jul 22 16:23:17.019725 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:17.019703 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/15d71c24-3074-4145-a424-c032a1e16f90-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-mrs47\" (UID: \"15d71c24-3074-4145-a424-c032a1e16f90\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-mrs47" Jul 22 16:23:17.019725 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:23:17.019714 2568 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 22 16:23:17.019941 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:23:17.019759 2568 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 22 16:23:17.019941 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:23:17.019788 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8273b4e7-b4e0-4338-b8f1-ad7e1e7dae27-metrics-certs podName:8273b4e7-b4e0-4338-b8f1-ad7e1e7dae27 nodeName:}" failed. No retries permitted until 2026-07-22 16:23:25.01976639 +0000 UTC m=+57.121381963 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8273b4e7-b4e0-4338-b8f1-ad7e1e7dae27-metrics-certs") pod "router-default-57b96c888d-pxl85" (UID: "8273b4e7-b4e0-4338-b8f1-ad7e1e7dae27") : secret "router-metrics-certs-default" not found Jul 22 16:23:17.019941 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:23:17.019824 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e2887e8-0300-4255-bfb9-265e48b18be4-networking-console-plugin-cert podName:7e2887e8-0300-4255-bfb9-265e48b18be4 nodeName:}" failed. No retries permitted until 2026-07-22 16:23:25.01980588 +0000 UTC m=+57.121421449 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7e2887e8-0300-4255-bfb9-265e48b18be4-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-dd5l9" (UID: "7e2887e8-0300-4255-bfb9-265e48b18be4") : secret "networking-console-plugin-cert" not found Jul 22 16:23:17.019941 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:23:17.019827 2568 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 22 16:23:17.019941 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:23:17.019894 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8273b4e7-b4e0-4338-b8f1-ad7e1e7dae27-service-ca-bundle podName:8273b4e7-b4e0-4338-b8f1-ad7e1e7dae27 nodeName:}" failed. No retries permitted until 2026-07-22 16:23:25.019882321 +0000 UTC m=+57.121497883 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8273b4e7-b4e0-4338-b8f1-ad7e1e7dae27-service-ca-bundle") pod "router-default-57b96c888d-pxl85" (UID: "8273b4e7-b4e0-4338-b8f1-ad7e1e7dae27") : configmap references non-existent config key: service-ca.crt Jul 22 16:23:17.019941 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:23:17.019912 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15d71c24-3074-4145-a424-c032a1e16f90-cluster-monitoring-operator-tls podName:15d71c24-3074-4145-a424-c032a1e16f90 nodeName:}" failed. No retries permitted until 2026-07-22 16:23:25.019902903 +0000 UTC m=+57.121518460 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/15d71c24-3074-4145-a424-c032a1e16f90-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-mrs47" (UID: "15d71c24-3074-4145-a424-c032a1e16f90") : secret "cluster-monitoring-operator-tls" not found Jul 22 16:23:17.827771 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:17.827742 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-lfqs8_816518f1-790a-4350-ae15-18287e06323a/console-operator/1.log" Jul 22 16:23:17.828213 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:17.828198 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-lfqs8_816518f1-790a-4350-ae15-18287e06323a/console-operator/0.log" Jul 22 16:23:17.828286 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:17.828232 2568 generic.go:356] "Generic (PLEG): container finished" podID="816518f1-790a-4350-ae15-18287e06323a" containerID="533a7ca95053fb8d0eb6eed214cc4f732df895fcf1fca6f88e44431590d9767d" exitCode=255 Jul 22 16:23:17.828371 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:17.828329 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-lfqs8" event={"ID":"816518f1-790a-4350-ae15-18287e06323a","Type":"ContainerDied","Data":"533a7ca95053fb8d0eb6eed214cc4f732df895fcf1fca6f88e44431590d9767d"} Jul 22 16:23:17.828449 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:17.828435 2568 scope.go:117] "RemoveContainer" containerID="12fbc1ce053d04f4c7a31432f9aa47c453554b5c7558af93e15ce3085ff130b2" Jul 22 16:23:17.828754 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:17.828636 2568 scope.go:117] "RemoveContainer" containerID="533a7ca95053fb8d0eb6eed214cc4f732df895fcf1fca6f88e44431590d9767d" Jul 22 16:23:17.828857 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:23:17.828817 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-lfqs8_openshift-console-operator(816518f1-790a-4350-ae15-18287e06323a)\"" pod="openshift-console-operator/console-operator-565b7b569d-lfqs8" podUID="816518f1-790a-4350-ae15-18287e06323a" Jul 22 16:23:18.581056 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:18.581023 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-6vgpb"] Jul 22 16:23:18.593624 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:18.593595 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6vgpb" Jul 22 16:23:18.594778 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:18.594747 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6vgpb"] Jul 22 16:23:18.596294 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:18.596268 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 22 16:23:18.596448 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:18.596302 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-qp2c5\"" Jul 22 16:23:18.596448 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:18.596273 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 22 16:23:18.634520 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:18.634479 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/75011229-cada-4038-bd30-f9cafb82061c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6vgpb\" (UID: \"75011229-cada-4038-bd30-f9cafb82061c\") " pod="openshift-insights/insights-runtime-extractor-6vgpb" Jul 22 16:23:18.634686 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:18.634606 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/75011229-cada-4038-bd30-f9cafb82061c-crio-socket\") pod \"insights-runtime-extractor-6vgpb\" (UID: \"75011229-cada-4038-bd30-f9cafb82061c\") " pod="openshift-insights/insights-runtime-extractor-6vgpb" Jul 22 16:23:18.634686 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:18.634671 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g565p\" (UniqueName: \"kubernetes.io/projected/75011229-cada-4038-bd30-f9cafb82061c-kube-api-access-g565p\") pod \"insights-runtime-extractor-6vgpb\" (UID: \"75011229-cada-4038-bd30-f9cafb82061c\") " pod="openshift-insights/insights-runtime-extractor-6vgpb" Jul 22 16:23:18.634773 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:18.634731 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/75011229-cada-4038-bd30-f9cafb82061c-data-volume\") pod \"insights-runtime-extractor-6vgpb\" (UID: \"75011229-cada-4038-bd30-f9cafb82061c\") " pod="openshift-insights/insights-runtime-extractor-6vgpb" Jul 22 16:23:18.634868 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:18.634852 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/75011229-cada-4038-bd30-f9cafb82061c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6vgpb\" (UID: \"75011229-cada-4038-bd30-f9cafb82061c\") " pod="openshift-insights/insights-runtime-extractor-6vgpb" Jul 22 16:23:18.736255 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:18.736212 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/75011229-cada-4038-bd30-f9cafb82061c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6vgpb\" (UID: \"75011229-cada-4038-bd30-f9cafb82061c\") " pod="openshift-insights/insights-runtime-extractor-6vgpb" Jul 22 16:23:18.736427 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:18.736297 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/75011229-cada-4038-bd30-f9cafb82061c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6vgpb\" (UID: \"75011229-cada-4038-bd30-f9cafb82061c\") " pod="openshift-insights/insights-runtime-extractor-6vgpb" Jul 22 16:23:18.736427 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:23:18.736384 2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 22 16:23:18.736427 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:18.736413 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/75011229-cada-4038-bd30-f9cafb82061c-crio-socket\") pod \"insights-runtime-extractor-6vgpb\" (UID: \"75011229-cada-4038-bd30-f9cafb82061c\") " pod="openshift-insights/insights-runtime-extractor-6vgpb" Jul 22 16:23:18.736560 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:23:18.736420 2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 22 16:23:18.736560 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:23:18.736463 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75011229-cada-4038-bd30-f9cafb82061c-insights-runtime-extractor-tls podName:75011229-cada-4038-bd30-f9cafb82061c nodeName:}" failed. No retries permitted until 2026-07-22 16:23:19.236443155 +0000 UTC m=+51.338058720 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/75011229-cada-4038-bd30-f9cafb82061c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6vgpb" (UID: "75011229-cada-4038-bd30-f9cafb82061c") : secret "insights-runtime-extractor-tls" not found Jul 22 16:23:18.736560 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:23:18.736484 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/75011229-cada-4038-bd30-f9cafb82061c-kube-rbac-proxy-cm podName:75011229-cada-4038-bd30-f9cafb82061c nodeName:}" failed. No retries permitted until 2026-07-22 16:23:19.236475312 +0000 UTC m=+51.338090866 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/75011229-cada-4038-bd30-f9cafb82061c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6vgpb" (UID: "75011229-cada-4038-bd30-f9cafb82061c") : configmap "kube-rbac-proxy" not found Jul 22 16:23:18.736560 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:18.736502 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/75011229-cada-4038-bd30-f9cafb82061c-crio-socket\") pod \"insights-runtime-extractor-6vgpb\" (UID: \"75011229-cada-4038-bd30-f9cafb82061c\") " pod="openshift-insights/insights-runtime-extractor-6vgpb" Jul 22 16:23:18.736560 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:18.736520 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g565p\" (UniqueName: \"kubernetes.io/projected/75011229-cada-4038-bd30-f9cafb82061c-kube-api-access-g565p\") pod \"insights-runtime-extractor-6vgpb\" (UID: \"75011229-cada-4038-bd30-f9cafb82061c\") " pod="openshift-insights/insights-runtime-extractor-6vgpb" Jul 22 16:23:18.736720 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:18.736578 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/75011229-cada-4038-bd30-f9cafb82061c-data-volume\") pod \"insights-runtime-extractor-6vgpb\" (UID: \"75011229-cada-4038-bd30-f9cafb82061c\") " pod="openshift-insights/insights-runtime-extractor-6vgpb" Jul 22 16:23:18.736917 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:18.736899 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/75011229-cada-4038-bd30-f9cafb82061c-data-volume\") pod \"insights-runtime-extractor-6vgpb\" (UID: \"75011229-cada-4038-bd30-f9cafb82061c\") " pod="openshift-insights/insights-runtime-extractor-6vgpb" Jul 22 16:23:18.747210 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:18.747185 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g565p\" (UniqueName: \"kubernetes.io/projected/75011229-cada-4038-bd30-f9cafb82061c-kube-api-access-g565p\") pod \"insights-runtime-extractor-6vgpb\" (UID: \"75011229-cada-4038-bd30-f9cafb82061c\") " pod="openshift-insights/insights-runtime-extractor-6vgpb" Jul 22 16:23:18.834490 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:18.834407 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-lfqs8_816518f1-790a-4350-ae15-18287e06323a/console-operator/1.log" Jul 22 16:23:18.834939 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:18.834839 2568 scope.go:117] "RemoveContainer" containerID="533a7ca95053fb8d0eb6eed214cc4f732df895fcf1fca6f88e44431590d9767d" Jul 22 16:23:18.835054 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:23:18.835031 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-lfqs8_openshift-console-operator(816518f1-790a-4350-ae15-18287e06323a)\"" pod="openshift-console-operator/console-operator-565b7b569d-lfqs8" podUID="816518f1-790a-4350-ae15-18287e06323a" Jul 22 16:23:19.241246 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:19.241204 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/75011229-cada-4038-bd30-f9cafb82061c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6vgpb\" (UID: \"75011229-cada-4038-bd30-f9cafb82061c\") " pod="openshift-insights/insights-runtime-extractor-6vgpb" Jul 22 16:23:19.241425 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:19.241273 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/75011229-cada-4038-bd30-f9cafb82061c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6vgpb\" (UID: \"75011229-cada-4038-bd30-f9cafb82061c\") " pod="openshift-insights/insights-runtime-extractor-6vgpb" Jul 22 16:23:19.241425 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:23:19.241381 2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 22 16:23:19.241529 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:23:19.241445 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75011229-cada-4038-bd30-f9cafb82061c-insights-runtime-extractor-tls podName:75011229-cada-4038-bd30-f9cafb82061c nodeName:}" failed. No retries permitted until 2026-07-22 16:23:20.241427555 +0000 UTC m=+52.343043124 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/75011229-cada-4038-bd30-f9cafb82061c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6vgpb" (UID: "75011229-cada-4038-bd30-f9cafb82061c") : secret "insights-runtime-extractor-tls" not found Jul 22 16:23:19.241801 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:19.241780 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/75011229-cada-4038-bd30-f9cafb82061c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6vgpb\" (UID: \"75011229-cada-4038-bd30-f9cafb82061c\") " pod="openshift-insights/insights-runtime-extractor-6vgpb" Jul 22 16:23:19.466131 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:19.466089 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-lfqs8" Jul 22 16:23:19.466312 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:19.466218 2568 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-565b7b569d-lfqs8" Jul 22 16:23:19.837918 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:19.837889 2568 scope.go:117] "RemoveContainer" containerID="533a7ca95053fb8d0eb6eed214cc4f732df895fcf1fca6f88e44431590d9767d" Jul 22 16:23:19.838320 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:23:19.838100 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-lfqs8_openshift-console-operator(816518f1-790a-4350-ae15-18287e06323a)\"" pod="openshift-console-operator/console-operator-565b7b569d-lfqs8" podUID="816518f1-790a-4350-ae15-18287e06323a" Jul 22 16:23:20.148626 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:20.148527 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d5c01298-8e46-4810-8190-c75c64e59cdd-metrics-tls\") pod \"dns-default-b2qn2\" (UID: \"d5c01298-8e46-4810-8190-c75c64e59cdd\") " pod="openshift-dns/dns-default-b2qn2" Jul 22 16:23:20.148626 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:20.148579 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1c84131c-de70-401c-a71b-8d7bc6dd171f-registry-tls\") pod \"image-registry-546c5d6bb-qbhlm\" (UID: \"1c84131c-de70-401c-a71b-8d7bc6dd171f\") " pod="openshift-image-registry/image-registry-546c5d6bb-qbhlm" Jul 22 16:23:20.148840 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:23:20.148666 2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 22 16:23:20.148840 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:23:20.148678 2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-546c5d6bb-qbhlm: secret "image-registry-tls" not found Jul 22 16:23:20.148840 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:23:20.148686 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 22 16:23:20.148840 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:23:20.148749 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1c84131c-de70-401c-a71b-8d7bc6dd171f-registry-tls podName:1c84131c-de70-401c-a71b-8d7bc6dd171f nodeName:}" failed. No retries permitted until 2026-07-22 16:23:36.148735766 +0000 UTC m=+68.250351321 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1c84131c-de70-401c-a71b-8d7bc6dd171f-registry-tls") pod "image-registry-546c5d6bb-qbhlm" (UID: "1c84131c-de70-401c-a71b-8d7bc6dd171f") : secret "image-registry-tls" not found Jul 22 16:23:20.148840 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:23:20.148762 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5c01298-8e46-4810-8190-c75c64e59cdd-metrics-tls podName:d5c01298-8e46-4810-8190-c75c64e59cdd nodeName:}" failed. No retries permitted until 2026-07-22 16:23:36.14875614 +0000 UTC m=+68.250371693 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d5c01298-8e46-4810-8190-c75c64e59cdd-metrics-tls") pod "dns-default-b2qn2" (UID: "d5c01298-8e46-4810-8190-c75c64e59cdd") : secret "dns-default-metrics-tls" not found Jul 22 16:23:20.249886 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:20.249845 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/75011229-cada-4038-bd30-f9cafb82061c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6vgpb\" (UID: \"75011229-cada-4038-bd30-f9cafb82061c\") " pod="openshift-insights/insights-runtime-extractor-6vgpb" Jul 22 16:23:20.250067 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:23:20.250001 2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 22 16:23:20.250118 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:23:20.250070 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75011229-cada-4038-bd30-f9cafb82061c-insights-runtime-extractor-tls podName:75011229-cada-4038-bd30-f9cafb82061c nodeName:}" failed. No retries permitted until 2026-07-22 16:23:22.25005447 +0000 UTC m=+54.351670024 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/75011229-cada-4038-bd30-f9cafb82061c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6vgpb" (UID: "75011229-cada-4038-bd30-f9cafb82061c") : secret "insights-runtime-extractor-tls" not found Jul 22 16:23:20.840595 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:20.840567 2568 scope.go:117] "RemoveContainer" containerID="533a7ca95053fb8d0eb6eed214cc4f732df895fcf1fca6f88e44431590d9767d" Jul 22 16:23:20.840960 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:23:20.840740 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-lfqs8_openshift-console-operator(816518f1-790a-4350-ae15-18287e06323a)\"" pod="openshift-console-operator/console-operator-565b7b569d-lfqs8" podUID="816518f1-790a-4350-ae15-18287e06323a" Jul 22 16:23:20.984832 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:20.984799 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-mzcc2_61d5f4c6-746e-4e0f-b35f-7befc6da325f/dns-node-resolver/0.log" Jul 22 16:23:21.983809 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:21.983773 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-v887c_b8064dd5-313d-433d-8efe-5035350319bf/node-ca/0.log" Jul 22 16:23:22.265818 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:22.265733 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/75011229-cada-4038-bd30-f9cafb82061c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6vgpb\" (UID: \"75011229-cada-4038-bd30-f9cafb82061c\") " pod="openshift-insights/insights-runtime-extractor-6vgpb" Jul 22 16:23:22.265964 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:23:22.265859 2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 22 16:23:22.265964 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:23:22.265915 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75011229-cada-4038-bd30-f9cafb82061c-insights-runtime-extractor-tls podName:75011229-cada-4038-bd30-f9cafb82061c nodeName:}" failed. No retries permitted until 2026-07-22 16:23:26.265901529 +0000 UTC m=+58.367517084 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/75011229-cada-4038-bd30-f9cafb82061c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6vgpb" (UID: "75011229-cada-4038-bd30-f9cafb82061c") : secret "insights-runtime-extractor-tls" not found Jul 22 16:23:22.583325 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:22.583247 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6q9l7_13340988-afe9-464b-a66e-eb09a8694a8c/serve-healthcheck-canary/0.log" Jul 22 16:23:23.386716 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:23.386676 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-s4wdv_743b9a0c-6a6a-4e95-8289-84d715effd40/kube-storage-version-migrator-operator/0.log" Jul 22 16:23:24.989140 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:24.989098 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b3d96828-99a1-47cc-9b81-2841561328e3-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-2qxr6\" (UID: \"b3d96828-99a1-47cc-9b81-2841561328e3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2qxr6" Jul 22 16:23:24.989563 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:23:24.989250 2568 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 22 16:23:24.989563 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:23:24.989317 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3d96828-99a1-47cc-9b81-2841561328e3-samples-operator-tls podName:b3d96828-99a1-47cc-9b81-2841561328e3 nodeName:}" failed. No retries permitted until 2026-07-22 16:23:40.98930148 +0000 UTC m=+73.090917034 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/b3d96828-99a1-47cc-9b81-2841561328e3-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-2qxr6" (UID: "b3d96828-99a1-47cc-9b81-2841561328e3") : secret "samples-operator-tls" not found Jul 22 16:23:25.089722 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:25.089681 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8273b4e7-b4e0-4338-b8f1-ad7e1e7dae27-metrics-certs\") pod \"router-default-57b96c888d-pxl85\" (UID: \"8273b4e7-b4e0-4338-b8f1-ad7e1e7dae27\") " pod="openshift-ingress/router-default-57b96c888d-pxl85" Jul 22 16:23:25.089884 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:25.089767 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7e2887e8-0300-4255-bfb9-265e48b18be4-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-dd5l9\" (UID: \"7e2887e8-0300-4255-bfb9-265e48b18be4\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-dd5l9" Jul 22 16:23:25.089884 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:25.089787 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8273b4e7-b4e0-4338-b8f1-ad7e1e7dae27-service-ca-bundle\") pod \"router-default-57b96c888d-pxl85\" (UID: \"8273b4e7-b4e0-4338-b8f1-ad7e1e7dae27\") " pod="openshift-ingress/router-default-57b96c888d-pxl85" Jul 22 16:23:25.089884 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:25.089806 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/15d71c24-3074-4145-a424-c032a1e16f90-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-mrs47\" (UID: \"15d71c24-3074-4145-a424-c032a1e16f90\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-mrs47" Jul 22 16:23:25.089884 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:23:25.089839 2568 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 22 16:23:25.090009 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:23:25.089907 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8273b4e7-b4e0-4338-b8f1-ad7e1e7dae27-metrics-certs podName:8273b4e7-b4e0-4338-b8f1-ad7e1e7dae27 nodeName:}" failed. No retries permitted until 2026-07-22 16:23:41.089891324 +0000 UTC m=+73.191506879 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8273b4e7-b4e0-4338-b8f1-ad7e1e7dae27-metrics-certs") pod "router-default-57b96c888d-pxl85" (UID: "8273b4e7-b4e0-4338-b8f1-ad7e1e7dae27") : secret "router-metrics-certs-default" not found Jul 22 16:23:25.090009 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:23:25.089925 2568 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 22 16:23:25.090009 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:23:25.089949 2568 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 22 16:23:25.090009 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:23:25.089970 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8273b4e7-b4e0-4338-b8f1-ad7e1e7dae27-service-ca-bundle podName:8273b4e7-b4e0-4338-b8f1-ad7e1e7dae27 nodeName:}" failed. No retries permitted until 2026-07-22 16:23:41.08995029 +0000 UTC m=+73.191565863 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8273b4e7-b4e0-4338-b8f1-ad7e1e7dae27-service-ca-bundle") pod "router-default-57b96c888d-pxl85" (UID: "8273b4e7-b4e0-4338-b8f1-ad7e1e7dae27") : configmap references non-existent config key: service-ca.crt Jul 22 16:23:25.090009 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:23:25.089987 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e2887e8-0300-4255-bfb9-265e48b18be4-networking-console-plugin-cert podName:7e2887e8-0300-4255-bfb9-265e48b18be4 nodeName:}" failed. No retries permitted until 2026-07-22 16:23:41.08998138 +0000 UTC m=+73.191596934 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7e2887e8-0300-4255-bfb9-265e48b18be4-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-dd5l9" (UID: "7e2887e8-0300-4255-bfb9-265e48b18be4") : secret "networking-console-plugin-cert" not found Jul 22 16:23:25.090009 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:23:25.089998 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15d71c24-3074-4145-a424-c032a1e16f90-cluster-monitoring-operator-tls podName:15d71c24-3074-4145-a424-c032a1e16f90 nodeName:}" failed. No retries permitted until 2026-07-22 16:23:41.08999215 +0000 UTC m=+73.191607703 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/15d71c24-3074-4145-a424-c032a1e16f90-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-mrs47" (UID: "15d71c24-3074-4145-a424-c032a1e16f90") : secret "cluster-monitoring-operator-tls" not found Jul 22 16:23:26.299806 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:26.299762 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/75011229-cada-4038-bd30-f9cafb82061c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6vgpb\" (UID: \"75011229-cada-4038-bd30-f9cafb82061c\") " pod="openshift-insights/insights-runtime-extractor-6vgpb" Jul 22 16:23:26.300235 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:23:26.299904 2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 22 16:23:26.300235 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:23:26.299967 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75011229-cada-4038-bd30-f9cafb82061c-insights-runtime-extractor-tls podName:75011229-cada-4038-bd30-f9cafb82061c nodeName:}" failed. No retries permitted until 2026-07-22 16:23:34.299952238 +0000 UTC m=+66.401567792 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/75011229-cada-4038-bd30-f9cafb82061c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6vgpb" (UID: "75011229-cada-4038-bd30-f9cafb82061c") : secret "insights-runtime-extractor-tls" not found Jul 22 16:23:28.739551 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:28.739526 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4xxp4" Jul 22 16:23:32.404453 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:32.404429 2568 scope.go:117] "RemoveContainer" containerID="533a7ca95053fb8d0eb6eed214cc4f732df895fcf1fca6f88e44431590d9767d" Jul 22 16:23:32.876711 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:32.876682 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-lfqs8_816518f1-790a-4350-ae15-18287e06323a/console-operator/2.log" Jul 22 16:23:32.877079 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:32.877064 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-lfqs8_816518f1-790a-4350-ae15-18287e06323a/console-operator/1.log" Jul 22 16:23:32.877136 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:32.877098 2568 generic.go:356] "Generic (PLEG): container finished" podID="816518f1-790a-4350-ae15-18287e06323a" containerID="b4b22dccda07c14fbf9e9d7dae476ddb3a88d488c6bb8114094682a3f4bf0751" exitCode=255 Jul 22 16:23:32.877171 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:32.877152 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-lfqs8" event={"ID":"816518f1-790a-4350-ae15-18287e06323a","Type":"ContainerDied","Data":"b4b22dccda07c14fbf9e9d7dae476ddb3a88d488c6bb8114094682a3f4bf0751"} Jul 22 16:23:32.877203 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:32.877197 2568 scope.go:117] "RemoveContainer" containerID="533a7ca95053fb8d0eb6eed214cc4f732df895fcf1fca6f88e44431590d9767d" Jul 22 16:23:32.877543 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:32.877521 2568 scope.go:117] "RemoveContainer" containerID="b4b22dccda07c14fbf9e9d7dae476ddb3a88d488c6bb8114094682a3f4bf0751" Jul 22 16:23:32.877721 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:23:32.877699 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-565b7b569d-lfqs8_openshift-console-operator(816518f1-790a-4350-ae15-18287e06323a)\"" pod="openshift-console-operator/console-operator-565b7b569d-lfqs8" podUID="816518f1-790a-4350-ae15-18287e06323a" Jul 22 16:23:33.881148 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:33.881115 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-lfqs8_816518f1-790a-4350-ae15-18287e06323a/console-operator/2.log" Jul 22 16:23:34.170642 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:34.170551 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/919e9190-67ad-4d7e-9076-4645b095a315-metrics-certs\") pod \"network-metrics-daemon-bknjp\" (UID: \"919e9190-67ad-4d7e-9076-4645b095a315\") " pod="openshift-multus/network-metrics-daemon-bknjp" Jul 22 16:23:34.173592 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:34.173574 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 22 16:23:34.184029 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:34.184001 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/919e9190-67ad-4d7e-9076-4645b095a315-metrics-certs\") pod \"network-metrics-daemon-bknjp\" (UID: \"919e9190-67ad-4d7e-9076-4645b095a315\") " pod="openshift-multus/network-metrics-daemon-bknjp" Jul 22 16:23:34.219078 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:34.219051 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-vhlm5\"" Jul 22 16:23:34.227270 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:34.227242 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bknjp" Jul 22 16:23:34.271540 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:34.271509 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e16caaed-7d7c-44de-8a3d-c45cbfa12b72-original-pull-secret\") pod \"global-pull-secret-syncer-vtpvm\" (UID: \"e16caaed-7d7c-44de-8a3d-c45cbfa12b72\") " pod="kube-system/global-pull-secret-syncer-vtpvm" Jul 22 16:23:34.274878 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:34.274859 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 22 16:23:34.284292 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:34.284266 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e16caaed-7d7c-44de-8a3d-c45cbfa12b72-original-pull-secret\") pod \"global-pull-secret-syncer-vtpvm\" (UID: \"e16caaed-7d7c-44de-8a3d-c45cbfa12b72\") " pod="kube-system/global-pull-secret-syncer-vtpvm" Jul 22 16:23:34.372660 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:34.372624 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/75011229-cada-4038-bd30-f9cafb82061c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6vgpb\" (UID: \"75011229-cada-4038-bd30-f9cafb82061c\") " pod="openshift-insights/insights-runtime-extractor-6vgpb" Jul 22 16:23:34.372660 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:34.372660 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hsb6l\" (UniqueName: \"kubernetes.io/projected/9a66c706-f3c0-4662-9053-ba2d4ac30e25-kube-api-access-hsb6l\") pod \"network-check-target-hwfst\" (UID: \"9a66c706-f3c0-4662-9053-ba2d4ac30e25\") " pod="openshift-network-diagnostics/network-check-target-hwfst" Jul 22 16:23:34.374894 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:34.374864 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/75011229-cada-4038-bd30-f9cafb82061c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6vgpb\" (UID: \"75011229-cada-4038-bd30-f9cafb82061c\") " pod="openshift-insights/insights-runtime-extractor-6vgpb" Jul 22 16:23:34.375277 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:34.375258 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hsb6l\" (UniqueName: \"kubernetes.io/projected/9a66c706-f3c0-4662-9053-ba2d4ac30e25-kube-api-access-hsb6l\") pod \"network-check-target-hwfst\" (UID: \"9a66c706-f3c0-4662-9053-ba2d4ac30e25\") " pod="openshift-network-diagnostics/network-check-target-hwfst" Jul 22 16:23:34.386599 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:34.386570 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-bknjp"] Jul 22 16:23:34.389281 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:23:34.389258 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod919e9190_67ad_4d7e_9076_4645b095a315.slice/crio-436626f79adadd2538a1cb4440dfc94275caefef2d4a5178764b09b46f9bca7c WatchSource:0}: Error finding container 436626f79adadd2538a1cb4440dfc94275caefef2d4a5178764b09b46f9bca7c: Status 404 returned error can't find the container with id 436626f79adadd2538a1cb4440dfc94275caefef2d4a5178764b09b46f9bca7c Jul 22 16:23:34.438626 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:34.438537 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vtpvm" Jul 22 16:23:34.507327 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:34.507294 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-qp2c5\"" Jul 22 16:23:34.514501 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:34.514473 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6vgpb" Jul 22 16:23:34.525424 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:34.525399 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-h7v2l\"" Jul 22 16:23:34.533712 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:34.533657 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hwfst" Jul 22 16:23:34.619066 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:34.611788 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-vtpvm"] Jul 22 16:23:34.630810 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:23:34.627046 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode16caaed_7d7c_44de_8a3d_c45cbfa12b72.slice/crio-3527280a9b0db57668f419ab285999848461ba01a9d7004a909a293edc88d51f WatchSource:0}: Error finding container 3527280a9b0db57668f419ab285999848461ba01a9d7004a909a293edc88d51f: Status 404 returned error can't find the container with id 3527280a9b0db57668f419ab285999848461ba01a9d7004a909a293edc88d51f Jul 22 16:23:34.695826 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:34.695800 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6vgpb"] Jul 22 16:23:34.698090 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:23:34.698055 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75011229_cada_4038_bd30_f9cafb82061c.slice/crio-81122fbc9db9cd7a94ecac5075916b0d69f586ad20895e66d411c9eb8492d05f WatchSource:0}: Error finding container 81122fbc9db9cd7a94ecac5075916b0d69f586ad20895e66d411c9eb8492d05f: Status 404 returned error can't find the container with id 81122fbc9db9cd7a94ecac5075916b0d69f586ad20895e66d411c9eb8492d05f Jul 22 16:23:34.723912 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:34.723884 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hwfst"] Jul 22 16:23:34.725866 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:23:34.725837 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a66c706_f3c0_4662_9053_ba2d4ac30e25.slice/crio-08608b6f5f439f8a200278e705acde49f284311f42355c445d16ab19b57f043f WatchSource:0}: Error finding container 08608b6f5f439f8a200278e705acde49f284311f42355c445d16ab19b57f043f: Status 404 returned error can't find the container with id 08608b6f5f439f8a200278e705acde49f284311f42355c445d16ab19b57f043f Jul 22 16:23:34.886105 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:34.886066 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hwfst" event={"ID":"9a66c706-f3c0-4662-9053-ba2d4ac30e25","Type":"ContainerStarted","Data":"e04dfa8b0d795f67f91bb8d7a302983470ca42bbd068889d859a9e500a0b5e31"} Jul 22 16:23:34.886559 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:34.886126 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hwfst" event={"ID":"9a66c706-f3c0-4662-9053-ba2d4ac30e25","Type":"ContainerStarted","Data":"08608b6f5f439f8a200278e705acde49f284311f42355c445d16ab19b57f043f"} Jul 22 16:23:34.886559 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:34.886150 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-hwfst" Jul 22 16:23:34.887324 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:34.887300 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bknjp" event={"ID":"919e9190-67ad-4d7e-9076-4645b095a315","Type":"ContainerStarted","Data":"436626f79adadd2538a1cb4440dfc94275caefef2d4a5178764b09b46f9bca7c"} Jul 22 16:23:34.888382 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:34.888339 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6vgpb" event={"ID":"75011229-cada-4038-bd30-f9cafb82061c","Type":"ContainerStarted","Data":"81122fbc9db9cd7a94ecac5075916b0d69f586ad20895e66d411c9eb8492d05f"} Jul 22 16:23:34.889301 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:34.889277 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-vtpvm" event={"ID":"e16caaed-7d7c-44de-8a3d-c45cbfa12b72","Type":"ContainerStarted","Data":"3527280a9b0db57668f419ab285999848461ba01a9d7004a909a293edc88d51f"} Jul 22 16:23:34.903499 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:34.903460 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-hwfst" podStartSLOduration=65.903444521 podStartE2EDuration="1m5.903444521s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:22:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:23:34.90303858 +0000 UTC m=+67.004654157" watchObservedRunningTime="2026-07-22 16:23:34.903444521 +0000 UTC m=+67.005060096" Jul 22 16:23:35.898298 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:35.898254 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bknjp" event={"ID":"919e9190-67ad-4d7e-9076-4645b095a315","Type":"ContainerStarted","Data":"1dd6c045effcdaa16e45e457ae9bd8a533e7f140273be2cf49792df43c589a1f"} Jul 22 16:23:36.191414 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:36.191376 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d5c01298-8e46-4810-8190-c75c64e59cdd-metrics-tls\") pod \"dns-default-b2qn2\" (UID: \"d5c01298-8e46-4810-8190-c75c64e59cdd\") " pod="openshift-dns/dns-default-b2qn2" Jul 22 16:23:36.191620 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:36.191443 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1c84131c-de70-401c-a71b-8d7bc6dd171f-registry-tls\") pod \"image-registry-546c5d6bb-qbhlm\" (UID: \"1c84131c-de70-401c-a71b-8d7bc6dd171f\") " pod="openshift-image-registry/image-registry-546c5d6bb-qbhlm" Jul 22 16:23:36.194323 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:36.194294 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d5c01298-8e46-4810-8190-c75c64e59cdd-metrics-tls\") pod \"dns-default-b2qn2\" (UID: \"d5c01298-8e46-4810-8190-c75c64e59cdd\") " pod="openshift-dns/dns-default-b2qn2" Jul 22 16:23:36.194521 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:36.194495 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1c84131c-de70-401c-a71b-8d7bc6dd171f-registry-tls\") pod \"image-registry-546c5d6bb-qbhlm\" (UID: \"1c84131c-de70-401c-a71b-8d7bc6dd171f\") " pod="openshift-image-registry/image-registry-546c5d6bb-qbhlm" Jul 22 16:23:36.397408 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:36.397368 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-kgbkt\"" Jul 22 16:23:36.404775 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:36.404713 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-546c5d6bb-qbhlm" Jul 22 16:23:36.419502 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:36.419465 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-cfcr6\"" Jul 22 16:23:36.426878 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:36.426852 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-b2qn2" Jul 22 16:23:36.577682 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:36.577600 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-546c5d6bb-qbhlm"] Jul 22 16:23:36.580779 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:23:36.580745 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c84131c_de70_401c_a71b_8d7bc6dd171f.slice/crio-6adcd6741f981d6d6f3542a50958cadf4cdf517cb298dbca8a75aa4210afaae4 WatchSource:0}: Error finding container 6adcd6741f981d6d6f3542a50958cadf4cdf517cb298dbca8a75aa4210afaae4: Status 404 returned error can't find the container with id 6adcd6741f981d6d6f3542a50958cadf4cdf517cb298dbca8a75aa4210afaae4 Jul 22 16:23:36.598420 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:36.598333 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-b2qn2"] Jul 22 16:23:36.601758 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:23:36.601714 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5c01298_8e46_4810_8190_c75c64e59cdd.slice/crio-14570cfef3cbf1d78fa10c1f6a7fa0a2fcdaa30e243e846e7a035a9860527ad3 WatchSource:0}: Error finding container 14570cfef3cbf1d78fa10c1f6a7fa0a2fcdaa30e243e846e7a035a9860527ad3: Status 404 returned error can't find the container with id 14570cfef3cbf1d78fa10c1f6a7fa0a2fcdaa30e243e846e7a035a9860527ad3 Jul 22 16:23:36.905426 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:36.905160 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-546c5d6bb-qbhlm" event={"ID":"1c84131c-de70-401c-a71b-8d7bc6dd171f","Type":"ContainerStarted","Data":"333b5c0994215b70cbe7f0ef52bcd445ce7dc03d4e3ab73e7a928db55345f651"} Jul 22 16:23:36.905426 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:36.905231 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-546c5d6bb-qbhlm" event={"ID":"1c84131c-de70-401c-a71b-8d7bc6dd171f","Type":"ContainerStarted","Data":"6adcd6741f981d6d6f3542a50958cadf4cdf517cb298dbca8a75aa4210afaae4"} Jul 22 16:23:36.905426 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:36.905260 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-546c5d6bb-qbhlm" Jul 22 16:23:36.907666 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:36.907616 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bknjp" event={"ID":"919e9190-67ad-4d7e-9076-4645b095a315","Type":"ContainerStarted","Data":"87b9364376499f206d8b541ebdf819c7d67a6395a9e2a66d7f52840b5ec7a5a5"} Jul 22 16:23:36.909431 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:36.909402 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-b2qn2" event={"ID":"d5c01298-8e46-4810-8190-c75c64e59cdd","Type":"ContainerStarted","Data":"14570cfef3cbf1d78fa10c1f6a7fa0a2fcdaa30e243e846e7a035a9860527ad3"} Jul 22 16:23:36.928297 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:36.928230 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-546c5d6bb-qbhlm" podStartSLOduration=67.928207558 podStartE2EDuration="1m7.928207558s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:22:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:23:36.92586797 +0000 UTC m=+69.027483546" watchObservedRunningTime="2026-07-22 16:23:36.928207558 +0000 UTC m=+69.029823114" Jul 22 16:23:36.943118 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:36.942930 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-bknjp" podStartSLOduration=67.663629889 podStartE2EDuration="1m8.942910277s" totalImagesPullingTime="1.279280388s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:22:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:23:36.942247869 +0000 UTC m=+69.043863446" watchObservedRunningTime="2026-07-22 16:23:36.942910277 +0000 UTC m=+69.044525854" Jul 22 16:23:39.466775 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:39.466731 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-lfqs8" Jul 22 16:23:39.467228 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:39.466790 2568 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-565b7b569d-lfqs8" Jul 22 16:23:39.467228 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:39.467146 2568 scope.go:117] "RemoveContainer" containerID="b4b22dccda07c14fbf9e9d7dae476ddb3a88d488c6bb8114094682a3f4bf0751" Jul 22 16:23:39.467387 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:23:39.467329 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-565b7b569d-lfqs8_openshift-console-operator(816518f1-790a-4350-ae15-18287e06323a)\"" pod="openshift-console-operator/console-operator-565b7b569d-lfqs8" podUID="816518f1-790a-4350-ae15-18287e06323a" Jul 22 16:23:40.912014 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:40.911978 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cf9d7976b-dl2d9"] Jul 22 16:23:40.915560 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:40.915533 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cf9d7976b-dl2d9" Jul 22 16:23:40.919645 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:40.919576 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 22 16:23:40.920951 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:40.920760 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 22 16:23:40.920951 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:40.920830 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 22 16:23:40.920951 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:40.920874 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-4rxsx\"" Jul 22 16:23:40.920951 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:40.920833 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 22 16:23:40.930338 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:40.930310 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cf9d7976b-dl2d9"] Jul 22 16:23:41.038942 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:41.038901 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6hdn\" (UniqueName: \"kubernetes.io/projected/da89668c-522f-42cc-817b-a40b3446f619-kube-api-access-d6hdn\") pod \"managed-serviceaccount-addon-agent-7cf9d7976b-dl2d9\" (UID: \"da89668c-522f-42cc-817b-a40b3446f619\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cf9d7976b-dl2d9" Jul 22 16:23:41.039125 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:41.039027 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/da89668c-522f-42cc-817b-a40b3446f619-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7cf9d7976b-dl2d9\" (UID: \"da89668c-522f-42cc-817b-a40b3446f619\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cf9d7976b-dl2d9" Jul 22 16:23:41.039125 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:41.039086 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b3d96828-99a1-47cc-9b81-2841561328e3-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-2qxr6\" (UID: \"b3d96828-99a1-47cc-9b81-2841561328e3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2qxr6" Jul 22 16:23:41.041772 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:41.041748 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b3d96828-99a1-47cc-9b81-2841561328e3-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-2qxr6\" (UID: \"b3d96828-99a1-47cc-9b81-2841561328e3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2qxr6" Jul 22 16:23:41.139892 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:41.139849 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7e2887e8-0300-4255-bfb9-265e48b18be4-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-dd5l9\" (UID: \"7e2887e8-0300-4255-bfb9-265e48b18be4\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-dd5l9" Jul 22 16:23:41.140093 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:41.139907 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8273b4e7-b4e0-4338-b8f1-ad7e1e7dae27-service-ca-bundle\") pod \"router-default-57b96c888d-pxl85\" (UID: \"8273b4e7-b4e0-4338-b8f1-ad7e1e7dae27\") " pod="openshift-ingress/router-default-57b96c888d-pxl85" Jul 22 16:23:41.140093 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:41.139933 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/15d71c24-3074-4145-a424-c032a1e16f90-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-mrs47\" (UID: \"15d71c24-3074-4145-a424-c032a1e16f90\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-mrs47" Jul 22 16:23:41.140093 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:41.139968 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6hdn\" (UniqueName: \"kubernetes.io/projected/da89668c-522f-42cc-817b-a40b3446f619-kube-api-access-d6hdn\") pod \"managed-serviceaccount-addon-agent-7cf9d7976b-dl2d9\" (UID: \"da89668c-522f-42cc-817b-a40b3446f619\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cf9d7976b-dl2d9" Jul 22 16:23:41.140093 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:41.140012 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8273b4e7-b4e0-4338-b8f1-ad7e1e7dae27-metrics-certs\") pod \"router-default-57b96c888d-pxl85\" (UID: \"8273b4e7-b4e0-4338-b8f1-ad7e1e7dae27\") " pod="openshift-ingress/router-default-57b96c888d-pxl85" Jul 22 16:23:41.140093 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:41.140037 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/da89668c-522f-42cc-817b-a40b3446f619-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7cf9d7976b-dl2d9\" (UID: \"da89668c-522f-42cc-817b-a40b3446f619\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cf9d7976b-dl2d9" Jul 22 16:23:41.140757 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:41.140726 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8273b4e7-b4e0-4338-b8f1-ad7e1e7dae27-service-ca-bundle\") pod \"router-default-57b96c888d-pxl85\" (UID: \"8273b4e7-b4e0-4338-b8f1-ad7e1e7dae27\") " pod="openshift-ingress/router-default-57b96c888d-pxl85" Jul 22 16:23:41.143147 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:41.143122 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/da89668c-522f-42cc-817b-a40b3446f619-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7cf9d7976b-dl2d9\" (UID: \"da89668c-522f-42cc-817b-a40b3446f619\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cf9d7976b-dl2d9" Jul 22 16:23:41.143292 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:41.143127 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8273b4e7-b4e0-4338-b8f1-ad7e1e7dae27-metrics-certs\") pod \"router-default-57b96c888d-pxl85\" (UID: \"8273b4e7-b4e0-4338-b8f1-ad7e1e7dae27\") " pod="openshift-ingress/router-default-57b96c888d-pxl85" Jul 22 16:23:41.143292 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:41.143132 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7e2887e8-0300-4255-bfb9-265e48b18be4-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-dd5l9\" (UID: \"7e2887e8-0300-4255-bfb9-265e48b18be4\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-dd5l9" Jul 22 16:23:41.144846 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:41.144823 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/15d71c24-3074-4145-a424-c032a1e16f90-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-mrs47\" (UID: \"15d71c24-3074-4145-a424-c032a1e16f90\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-mrs47" Jul 22 16:23:41.153066 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:41.153033 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6hdn\" (UniqueName: \"kubernetes.io/projected/da89668c-522f-42cc-817b-a40b3446f619-kube-api-access-d6hdn\") pod \"managed-serviceaccount-addon-agent-7cf9d7976b-dl2d9\" (UID: \"da89668c-522f-42cc-817b-a40b3446f619\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cf9d7976b-dl2d9" Jul 22 16:23:41.237421 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:41.237379 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cf9d7976b-dl2d9" Jul 22 16:23:41.262861 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:41.262829 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-jnfcx\"" Jul 22 16:23:41.270482 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:41.270457 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2qxr6" Jul 22 16:23:41.370649 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:41.370620 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-gkg7v\"" Jul 22 16:23:41.375947 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:41.375921 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-dd5l9" Jul 22 16:23:41.389102 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:41.389078 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-56m76\"" Jul 22 16:23:41.394986 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:41.394959 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-gpmpg\"" Jul 22 16:23:41.397008 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:41.396984 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-57b96c888d-pxl85" Jul 22 16:23:41.402026 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:41.402005 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-mrs47" Jul 22 16:23:42.318456 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:42.318425 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-57b96c888d-pxl85"] Jul 22 16:23:42.325548 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:42.325458 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2qxr6"] Jul 22 16:23:42.332273 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:42.332247 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-dd5l9"] Jul 22 16:23:42.347872 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:23:42.347766 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e2887e8_0300_4255_bfb9_265e48b18be4.slice/crio-9204517c02767ab7ab5fa1fe9f3bbab0852cac0d64d4e805917e9ef99bd711da WatchSource:0}: Error finding container 9204517c02767ab7ab5fa1fe9f3bbab0852cac0d64d4e805917e9ef99bd711da: Status 404 returned error can't find the container with id 9204517c02767ab7ab5fa1fe9f3bbab0852cac0d64d4e805917e9ef99bd711da Jul 22 16:23:42.364513 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:42.364048 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cf9d7976b-dl2d9"] Jul 22 16:23:42.365007 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:42.364985 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-mrs47"] Jul 22 16:23:42.367406 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:23:42.367374 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podda89668c_522f_42cc_817b_a40b3446f619.slice/crio-9bb58674af97d28f2cac31acc932ec58cd24bfe840323430d88329953f2540fb WatchSource:0}: Error finding container 9bb58674af97d28f2cac31acc932ec58cd24bfe840323430d88329953f2540fb: Status 404 returned error can't find the container with id 9bb58674af97d28f2cac31acc932ec58cd24bfe840323430d88329953f2540fb Jul 22 16:23:42.367692 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:23:42.367667 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15d71c24_3074_4145_a424_c032a1e16f90.slice/crio-586ff50bc4bfe3f4ed27e1c48f0f67216329b89117e2854d1aec4fb7480d8ee1 WatchSource:0}: Error finding container 586ff50bc4bfe3f4ed27e1c48f0f67216329b89117e2854d1aec4fb7480d8ee1: Status 404 returned error can't find the container with id 586ff50bc4bfe3f4ed27e1c48f0f67216329b89117e2854d1aec4fb7480d8ee1 Jul 22 16:23:42.937253 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:42.937213 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-b2qn2" event={"ID":"d5c01298-8e46-4810-8190-c75c64e59cdd","Type":"ContainerStarted","Data":"f303cfd9cb690198857b52861e5235c650dc4e0cabbfb8884f0f44bc27d821bd"} Jul 22 16:23:42.937450 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:42.937284 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-b2qn2" event={"ID":"d5c01298-8e46-4810-8190-c75c64e59cdd","Type":"ContainerStarted","Data":"a686da06017944b74809cc992c046e2fcbc07799c79039f1cc8a9c6b9a971074"} Jul 22 16:23:42.937450 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:42.937337 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-b2qn2" Jul 22 16:23:42.939560 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:42.939493 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-mrs47" event={"ID":"15d71c24-3074-4145-a424-c032a1e16f90","Type":"ContainerStarted","Data":"586ff50bc4bfe3f4ed27e1c48f0f67216329b89117e2854d1aec4fb7480d8ee1"} Jul 22 16:23:42.942611 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:42.942493 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-vtpvm" event={"ID":"e16caaed-7d7c-44de-8a3d-c45cbfa12b72","Type":"ContainerStarted","Data":"2e06339521a5c41d3449e518cdd837a5dbeb818bd7e8ccf0cad4500a6e724a55"} Jul 22 16:23:42.944079 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:42.944048 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-dd5l9" event={"ID":"7e2887e8-0300-4255-bfb9-265e48b18be4","Type":"ContainerStarted","Data":"9204517c02767ab7ab5fa1fe9f3bbab0852cac0d64d4e805917e9ef99bd711da"} Jul 22 16:23:42.947206 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:42.947151 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2qxr6" event={"ID":"b3d96828-99a1-47cc-9b81-2841561328e3","Type":"ContainerStarted","Data":"2363c42edfbbc674d8be6eaaac471628e7e0241cbea854aa75f4987a7fd550af"} Jul 22 16:23:42.949542 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:42.948982 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-57b96c888d-pxl85" event={"ID":"8273b4e7-b4e0-4338-b8f1-ad7e1e7dae27","Type":"ContainerStarted","Data":"c7155c05e9e11f4089b39dd01c207c61a13dfa2ed6ce54515d50d5523e99294b"} Jul 22 16:23:42.949542 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:42.949030 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-57b96c888d-pxl85" event={"ID":"8273b4e7-b4e0-4338-b8f1-ad7e1e7dae27","Type":"ContainerStarted","Data":"8f7862200d37544cf35efe4afcd94b0f89d4f8a8cbd915db5b4dfc1c3bc7e39f"} Jul 22 16:23:42.951134 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:42.951098 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cf9d7976b-dl2d9" event={"ID":"da89668c-522f-42cc-817b-a40b3446f619","Type":"ContainerStarted","Data":"9bb58674af97d28f2cac31acc932ec58cd24bfe840323430d88329953f2540fb"} Jul 22 16:23:42.953393 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:42.953364 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6vgpb" event={"ID":"75011229-cada-4038-bd30-f9cafb82061c","Type":"ContainerStarted","Data":"1e50fd5ad9769c95a2677781e95e122b60b2d199e2e7a938eab8617db29aa1e4"} Jul 22 16:23:42.966209 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:42.966156 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-b2qn2" podStartSLOduration=33.545115088 podStartE2EDuration="38.966137177s" totalImagesPullingTime="5.421022089s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:23:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:23:42.965785573 +0000 UTC m=+75.067401150" watchObservedRunningTime="2026-07-22 16:23:42.966137177 +0000 UTC m=+75.067752758" Jul 22 16:23:42.993124 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:42.993061 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-57b96c888d-pxl85" podStartSLOduration=33.993044583 podStartE2EDuration="33.993044583s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:23:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:23:42.99150903 +0000 UTC m=+75.093124602" watchObservedRunningTime="2026-07-22 16:23:42.993044583 +0000 UTC m=+75.094660137" Jul 22 16:23:43.011009 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:43.010784 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-vtpvm" podStartSLOduration=66.588284674 podStartE2EDuration="1m14.0107701s" totalImagesPullingTime="7.422485426s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 16:22:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:23:43.009737803 +0000 UTC m=+75.111353379" watchObservedRunningTime="2026-07-22 16:23:43.0107701 +0000 UTC m=+75.112385676" Jul 22 16:23:43.398064 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:43.398035 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-57b96c888d-pxl85" Jul 22 16:23:43.400865 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:43.400839 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-57b96c888d-pxl85" Jul 22 16:23:43.961875 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:43.961794 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-57b96c888d-pxl85" Jul 22 16:23:43.964601 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:43.964378 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-57b96c888d-pxl85" Jul 22 16:23:49.986409 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:49.986240 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cf9d7976b-dl2d9" event={"ID":"da89668c-522f-42cc-817b-a40b3446f619","Type":"ContainerStarted","Data":"8363d9f8962b5c53a75500612524d5cf3188f54ffc3a897647346fc29d5ead3e"} Jul 22 16:23:49.988617 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:49.988587 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6vgpb" event={"ID":"75011229-cada-4038-bd30-f9cafb82061c","Type":"ContainerStarted","Data":"4b56c6e7d416b03d2d1d1100712b11d0a00642315ebc09f4818dc08c1134b945"} Jul 22 16:23:49.990426 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:49.990398 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-mrs47" event={"ID":"15d71c24-3074-4145-a424-c032a1e16f90","Type":"ContainerStarted","Data":"2b3911a7eac3a2cb925831a99039758cd5d6864c61bcaf77edd2362135875798"} Jul 22 16:23:49.992324 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:49.992295 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-dd5l9" event={"ID":"7e2887e8-0300-4255-bfb9-265e48b18be4","Type":"ContainerStarted","Data":"02b50d59997dd01a3c54d2edbe3320f442417957cf4a9b226d57b5e714513a94"} Jul 22 16:23:49.999914 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:49.999879 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2qxr6" event={"ID":"b3d96828-99a1-47cc-9b81-2841561328e3","Type":"ContainerStarted","Data":"5e46d0340ec523c5ede65181fce0a1817c6d56bc24a89e9498e52f2427d65a76"} Jul 22 16:23:50.000180 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:50.000151 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2qxr6" event={"ID":"b3d96828-99a1-47cc-9b81-2841561328e3","Type":"ContainerStarted","Data":"b2acf247a5543efd4729212bd07102c33d63a5e8b7331caa2fcd4c2c858f1731"} Jul 22 16:23:50.002574 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:50.002520 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cf9d7976b-dl2d9" podStartSLOduration=2.963137606 podStartE2EDuration="10.002504435s" totalImagesPullingTime="7.039366829s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:23:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:23:50.002150339 +0000 UTC m=+82.103765920" watchObservedRunningTime="2026-07-22 16:23:50.002504435 +0000 UTC m=+82.104120012" Jul 22 16:23:50.026637 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:50.026582 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-mrs47" podStartSLOduration=34.00308479 podStartE2EDuration="41.02656703s" totalImagesPullingTime="7.02348224s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:23:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:23:50.024768327 +0000 UTC m=+82.126383900" watchObservedRunningTime="2026-07-22 16:23:50.02656703 +0000 UTC m=+82.128182607" Jul 22 16:23:50.041190 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:50.041099 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-dd5l9" podStartSLOduration=33.996629831 podStartE2EDuration="41.041077651s" totalImagesPullingTime="7.04444782s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:23:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:23:50.040157987 +0000 UTC m=+82.141773559" watchObservedRunningTime="2026-07-22 16:23:50.041077651 +0000 UTC m=+82.142693229" Jul 22 16:23:50.060723 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:50.060290 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2qxr6" podStartSLOduration=34.04489317 podStartE2EDuration="41.060274038s" totalImagesPullingTime="7.015380868s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:23:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:23:50.059023787 +0000 UTC m=+82.160639363" watchObservedRunningTime="2026-07-22 16:23:50.060274038 +0000 UTC m=+82.161889615" Jul 22 16:23:51.404208 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:51.404174 2568 scope.go:117] "RemoveContainer" containerID="b4b22dccda07c14fbf9e9d7dae476ddb3a88d488c6bb8114094682a3f4bf0751" Jul 22 16:23:51.404618 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:23:51.404378 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-565b7b569d-lfqs8_openshift-console-operator(816518f1-790a-4350-ae15-18287e06323a)\"" pod="openshift-console-operator/console-operator-565b7b569d-lfqs8" podUID="816518f1-790a-4350-ae15-18287e06323a" Jul 22 16:23:52.965160 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:52.965130 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-b2qn2" Jul 22 16:23:54.017610 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:54.017572 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6vgpb" event={"ID":"75011229-cada-4038-bd30-f9cafb82061c","Type":"ContainerStarted","Data":"653f8ae3a622a065c813cdf4e73f73be4eaaef1e532a8018c390928c4d9c0445"} Jul 22 16:23:54.038980 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:54.038857 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-6vgpb" podStartSLOduration=18.002884493 podStartE2EDuration="36.038839358s" totalImagesPullingTime="18.035954865s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 16:23:18 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:23:54.038527218 +0000 UTC m=+86.140142795" watchObservedRunningTime="2026-07-22 16:23:54.038839358 +0000 UTC m=+86.140454936" Jul 22 16:23:57.918014 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:23:57.917976 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-546c5d6bb-qbhlm" Jul 22 16:24:00.451713 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:00.451679 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-hfxmd"] Jul 22 16:24:00.456287 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:00.456268 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-hfxmd" Jul 22 16:24:00.459571 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:00.459547 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 22 16:24:00.460588 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:00.460574 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 22 16:24:00.460676 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:00.460585 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-jsxbv\"" Jul 22 16:24:00.460676 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:00.460657 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 22 16:24:00.460676 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:00.460667 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 22 16:24:00.485851 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:00.485806 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1cd78a30-9e6a-4ccb-856e-bd4f679ec2d8-node-exporter-accelerators-collector-config\") pod \"node-exporter-hfxmd\" (UID: \"1cd78a30-9e6a-4ccb-856e-bd4f679ec2d8\") " pod="openshift-monitoring/node-exporter-hfxmd" Jul 22 16:24:00.486004 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:00.485865 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1cd78a30-9e6a-4ccb-856e-bd4f679ec2d8-sys\") pod \"node-exporter-hfxmd\" (UID: \"1cd78a30-9e6a-4ccb-856e-bd4f679ec2d8\") " pod="openshift-monitoring/node-exporter-hfxmd" Jul 22 16:24:00.486004 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:00.485900 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1cd78a30-9e6a-4ccb-856e-bd4f679ec2d8-node-exporter-wtmp\") pod \"node-exporter-hfxmd\" (UID: \"1cd78a30-9e6a-4ccb-856e-bd4f679ec2d8\") " pod="openshift-monitoring/node-exporter-hfxmd" Jul 22 16:24:00.486004 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:00.485925 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1cd78a30-9e6a-4ccb-856e-bd4f679ec2d8-node-exporter-textfile\") pod \"node-exporter-hfxmd\" (UID: \"1cd78a30-9e6a-4ccb-856e-bd4f679ec2d8\") " pod="openshift-monitoring/node-exporter-hfxmd" Jul 22 16:24:00.486004 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:00.485984 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1cd78a30-9e6a-4ccb-856e-bd4f679ec2d8-metrics-client-ca\") pod \"node-exporter-hfxmd\" (UID: \"1cd78a30-9e6a-4ccb-856e-bd4f679ec2d8\") " pod="openshift-monitoring/node-exporter-hfxmd" Jul 22 16:24:00.486144 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:00.486036 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1cd78a30-9e6a-4ccb-856e-bd4f679ec2d8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hfxmd\" (UID: \"1cd78a30-9e6a-4ccb-856e-bd4f679ec2d8\") " pod="openshift-monitoring/node-exporter-hfxmd" Jul 22 16:24:00.486144 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:00.486076 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1cd78a30-9e6a-4ccb-856e-bd4f679ec2d8-node-exporter-tls\") pod \"node-exporter-hfxmd\" (UID: \"1cd78a30-9e6a-4ccb-856e-bd4f679ec2d8\") " pod="openshift-monitoring/node-exporter-hfxmd" Jul 22 16:24:00.486144 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:00.486096 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jfvx4\" (UniqueName: \"kubernetes.io/projected/1cd78a30-9e6a-4ccb-856e-bd4f679ec2d8-kube-api-access-jfvx4\") pod \"node-exporter-hfxmd\" (UID: \"1cd78a30-9e6a-4ccb-856e-bd4f679ec2d8\") " pod="openshift-monitoring/node-exporter-hfxmd" Jul 22 16:24:00.486144 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:00.486134 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1cd78a30-9e6a-4ccb-856e-bd4f679ec2d8-root\") pod \"node-exporter-hfxmd\" (UID: \"1cd78a30-9e6a-4ccb-856e-bd4f679ec2d8\") " pod="openshift-monitoring/node-exporter-hfxmd" Jul 22 16:24:00.587258 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:00.587231 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1cd78a30-9e6a-4ccb-856e-bd4f679ec2d8-metrics-client-ca\") pod \"node-exporter-hfxmd\" (UID: \"1cd78a30-9e6a-4ccb-856e-bd4f679ec2d8\") " pod="openshift-monitoring/node-exporter-hfxmd" Jul 22 16:24:00.587438 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:00.587270 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1cd78a30-9e6a-4ccb-856e-bd4f679ec2d8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hfxmd\" (UID: \"1cd78a30-9e6a-4ccb-856e-bd4f679ec2d8\") " pod="openshift-monitoring/node-exporter-hfxmd" Jul 22 16:24:00.587438 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:00.587336 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1cd78a30-9e6a-4ccb-856e-bd4f679ec2d8-node-exporter-tls\") pod \"node-exporter-hfxmd\" (UID: \"1cd78a30-9e6a-4ccb-856e-bd4f679ec2d8\") " pod="openshift-monitoring/node-exporter-hfxmd" Jul 22 16:24:00.587438 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:00.587382 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfvx4\" (UniqueName: \"kubernetes.io/projected/1cd78a30-9e6a-4ccb-856e-bd4f679ec2d8-kube-api-access-jfvx4\") pod \"node-exporter-hfxmd\" (UID: \"1cd78a30-9e6a-4ccb-856e-bd4f679ec2d8\") " pod="openshift-monitoring/node-exporter-hfxmd" Jul 22 16:24:00.587438 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:00.587407 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1cd78a30-9e6a-4ccb-856e-bd4f679ec2d8-root\") pod \"node-exporter-hfxmd\" (UID: \"1cd78a30-9e6a-4ccb-856e-bd4f679ec2d8\") " pod="openshift-monitoring/node-exporter-hfxmd" Jul 22 16:24:00.587634 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:00.587453 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1cd78a30-9e6a-4ccb-856e-bd4f679ec2d8-node-exporter-accelerators-collector-config\") pod \"node-exporter-hfxmd\" (UID: \"1cd78a30-9e6a-4ccb-856e-bd4f679ec2d8\") " pod="openshift-monitoring/node-exporter-hfxmd" Jul 22 16:24:00.587634 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:00.587492 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1cd78a30-9e6a-4ccb-856e-bd4f679ec2d8-sys\") pod \"node-exporter-hfxmd\" (UID: \"1cd78a30-9e6a-4ccb-856e-bd4f679ec2d8\") " pod="openshift-monitoring/node-exporter-hfxmd" Jul 22 16:24:00.587634 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:00.587526 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1cd78a30-9e6a-4ccb-856e-bd4f679ec2d8-node-exporter-wtmp\") pod \"node-exporter-hfxmd\" (UID: \"1cd78a30-9e6a-4ccb-856e-bd4f679ec2d8\") " pod="openshift-monitoring/node-exporter-hfxmd" Jul 22 16:24:00.587634 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:00.587542 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1cd78a30-9e6a-4ccb-856e-bd4f679ec2d8-root\") pod \"node-exporter-hfxmd\" (UID: \"1cd78a30-9e6a-4ccb-856e-bd4f679ec2d8\") " pod="openshift-monitoring/node-exporter-hfxmd" Jul 22 16:24:00.587634 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:00.587550 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1cd78a30-9e6a-4ccb-856e-bd4f679ec2d8-node-exporter-textfile\") pod \"node-exporter-hfxmd\" (UID: \"1cd78a30-9e6a-4ccb-856e-bd4f679ec2d8\") " pod="openshift-monitoring/node-exporter-hfxmd" Jul 22 16:24:00.587634 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:00.587616 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1cd78a30-9e6a-4ccb-856e-bd4f679ec2d8-sys\") pod \"node-exporter-hfxmd\" (UID: \"1cd78a30-9e6a-4ccb-856e-bd4f679ec2d8\") " pod="openshift-monitoring/node-exporter-hfxmd" Jul 22 16:24:00.587866 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:00.587740 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1cd78a30-9e6a-4ccb-856e-bd4f679ec2d8-node-exporter-wtmp\") pod \"node-exporter-hfxmd\" (UID: \"1cd78a30-9e6a-4ccb-856e-bd4f679ec2d8\") " pod="openshift-monitoring/node-exporter-hfxmd" Jul 22 16:24:00.587912 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:00.587860 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1cd78a30-9e6a-4ccb-856e-bd4f679ec2d8-node-exporter-textfile\") pod \"node-exporter-hfxmd\" (UID: \"1cd78a30-9e6a-4ccb-856e-bd4f679ec2d8\") " pod="openshift-monitoring/node-exporter-hfxmd" Jul 22 16:24:00.588075 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:00.588047 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1cd78a30-9e6a-4ccb-856e-bd4f679ec2d8-node-exporter-accelerators-collector-config\") pod \"node-exporter-hfxmd\" (UID: \"1cd78a30-9e6a-4ccb-856e-bd4f679ec2d8\") " pod="openshift-monitoring/node-exporter-hfxmd" Jul 22 16:24:00.588175 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:00.588157 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1cd78a30-9e6a-4ccb-856e-bd4f679ec2d8-metrics-client-ca\") pod \"node-exporter-hfxmd\" (UID: \"1cd78a30-9e6a-4ccb-856e-bd4f679ec2d8\") " pod="openshift-monitoring/node-exporter-hfxmd" Jul 22 16:24:00.590112 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:00.590095 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1cd78a30-9e6a-4ccb-856e-bd4f679ec2d8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hfxmd\" (UID: \"1cd78a30-9e6a-4ccb-856e-bd4f679ec2d8\") " pod="openshift-monitoring/node-exporter-hfxmd" Jul 22 16:24:00.590257 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:00.590239 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1cd78a30-9e6a-4ccb-856e-bd4f679ec2d8-node-exporter-tls\") pod \"node-exporter-hfxmd\" (UID: \"1cd78a30-9e6a-4ccb-856e-bd4f679ec2d8\") " pod="openshift-monitoring/node-exporter-hfxmd" Jul 22 16:24:00.595825 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:00.595796 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jfvx4\" (UniqueName: \"kubernetes.io/projected/1cd78a30-9e6a-4ccb-856e-bd4f679ec2d8-kube-api-access-jfvx4\") pod \"node-exporter-hfxmd\" (UID: \"1cd78a30-9e6a-4ccb-856e-bd4f679ec2d8\") " pod="openshift-monitoring/node-exporter-hfxmd" Jul 22 16:24:00.765980 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:00.765946 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-hfxmd" Jul 22 16:24:00.777952 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:24:00.777919 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1cd78a30_9e6a_4ccb_856e_bd4f679ec2d8.slice/crio-94783545aafaf9c541c5aeb3188226ccf66766952e354dd2f590274aa0d09d44 WatchSource:0}: Error finding container 94783545aafaf9c541c5aeb3188226ccf66766952e354dd2f590274aa0d09d44: Status 404 returned error can't find the container with id 94783545aafaf9c541c5aeb3188226ccf66766952e354dd2f590274aa0d09d44 Jul 22 16:24:01.042858 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:01.042780 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hfxmd" event={"ID":"1cd78a30-9e6a-4ccb-856e-bd4f679ec2d8","Type":"ContainerStarted","Data":"94783545aafaf9c541c5aeb3188226ccf66766952e354dd2f590274aa0d09d44"} Jul 22 16:24:02.047996 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:02.047960 2568 generic.go:356] "Generic (PLEG): container finished" podID="1cd78a30-9e6a-4ccb-856e-bd4f679ec2d8" containerID="66b4c20d52cf77bdf3a2e51fda39fd35584039deef7afe9cde53f87e71bdace3" exitCode=0 Jul 22 16:24:02.048390 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:02.048020 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hfxmd" event={"ID":"1cd78a30-9e6a-4ccb-856e-bd4f679ec2d8","Type":"ContainerDied","Data":"66b4c20d52cf77bdf3a2e51fda39fd35584039deef7afe9cde53f87e71bdace3"} Jul 22 16:24:03.054102 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:03.054062 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hfxmd" event={"ID":"1cd78a30-9e6a-4ccb-856e-bd4f679ec2d8","Type":"ContainerStarted","Data":"abe9f93ea7fe96b95b354dc36744432dc0eb2c785bf4b7b9cc5573ac54d7fb65"} Jul 22 16:24:03.054486 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:03.054113 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hfxmd" event={"ID":"1cd78a30-9e6a-4ccb-856e-bd4f679ec2d8","Type":"ContainerStarted","Data":"7bb08800acf22e2941f1a03cacf9eddc6d6f7826879884d6a78520baa470d530"} Jul 22 16:24:03.077770 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:03.077740 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-546c5d6bb-qbhlm"] Jul 22 16:24:03.078288 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:03.078236 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-hfxmd" podStartSLOduration=2.082237907 podStartE2EDuration="3.078220432s" totalImagesPullingTime="931.301922ms" totalInitContainerRuntime="64.680603ms" isStatefulPod=true podCreationTimestamp="2026-07-22 16:24:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:24:03.07555334 +0000 UTC m=+95.177168929" watchObservedRunningTime="2026-07-22 16:24:03.078220432 +0000 UTC m=+95.179836008" Jul 22 16:24:05.404785 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:05.404748 2568 scope.go:117] "RemoveContainer" containerID="b4b22dccda07c14fbf9e9d7dae476ddb3a88d488c6bb8114094682a3f4bf0751" Jul 22 16:24:05.900921 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:05.900890 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-hwfst" Jul 22 16:24:06.068224 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:06.068197 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-lfqs8_816518f1-790a-4350-ae15-18287e06323a/console-operator/2.log" Jul 22 16:24:06.068415 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:06.068276 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-lfqs8" event={"ID":"816518f1-790a-4350-ae15-18287e06323a","Type":"ContainerStarted","Data":"0ce817f17f4ecc40ce521d82f3446ee2af1d5b1b219f4760f946dab01c02ed78"} Jul 22 16:24:06.068648 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:06.068629 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-lfqs8" Jul 22 16:24:06.087692 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:06.087641 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-565b7b569d-lfqs8" podStartSLOduration=50.381896073 podStartE2EDuration="57.087624237s" totalImagesPullingTime="6.705728164s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:23:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:24:06.086604492 +0000 UTC m=+98.188220093" watchObservedRunningTime="2026-07-22 16:24:06.087624237 +0000 UTC m=+98.189239812" Jul 22 16:24:06.551310 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:06.551283 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-565b7b569d-lfqs8" Jul 22 16:24:06.737530 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:06.737494 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-5bc67dcd46-8qjkk"] Jul 22 16:24:06.742504 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:06.742484 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-8qjkk" Jul 22 16:24:06.746065 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:06.746041 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 22 16:24:06.746187 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:06.746170 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-c5d9k\"" Jul 22 16:24:06.747968 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:06.747948 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 22 16:24:06.752320 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:06.752298 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-8qjkk"] Jul 22 16:24:06.839204 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:06.839113 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hppc8\" (UniqueName: \"kubernetes.io/projected/31360bae-3541-43b7-8f55-aa268c7ee53b-kube-api-access-hppc8\") pod \"downloads-5bc67dcd46-8qjkk\" (UID: \"31360bae-3541-43b7-8f55-aa268c7ee53b\") " pod="openshift-console/downloads-5bc67dcd46-8qjkk" Jul 22 16:24:06.940068 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:06.940027 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hppc8\" (UniqueName: \"kubernetes.io/projected/31360bae-3541-43b7-8f55-aa268c7ee53b-kube-api-access-hppc8\") pod \"downloads-5bc67dcd46-8qjkk\" (UID: \"31360bae-3541-43b7-8f55-aa268c7ee53b\") " pod="openshift-console/downloads-5bc67dcd46-8qjkk" Jul 22 16:24:06.949790 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:06.949756 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hppc8\" (UniqueName: \"kubernetes.io/projected/31360bae-3541-43b7-8f55-aa268c7ee53b-kube-api-access-hppc8\") pod \"downloads-5bc67dcd46-8qjkk\" (UID: \"31360bae-3541-43b7-8f55-aa268c7ee53b\") " pod="openshift-console/downloads-5bc67dcd46-8qjkk" Jul 22 16:24:07.052476 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:07.052437 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-8qjkk" Jul 22 16:24:07.210536 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:07.210511 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-8qjkk"] Jul 22 16:24:07.213120 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:24:07.213089 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31360bae_3541_43b7_8f55_aa268c7ee53b.slice/crio-884d4c29c408489e8fd08d9b7fa2c84e83f8aeb0a92a9254d2b734af905572dd WatchSource:0}: Error finding container 884d4c29c408489e8fd08d9b7fa2c84e83f8aeb0a92a9254d2b734af905572dd: Status 404 returned error can't find the container with id 884d4c29c408489e8fd08d9b7fa2c84e83f8aeb0a92a9254d2b734af905572dd Jul 22 16:24:08.078896 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:08.078851 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-8qjkk" event={"ID":"31360bae-3541-43b7-8f55-aa268c7ee53b","Type":"ContainerStarted","Data":"884d4c29c408489e8fd08d9b7fa2c84e83f8aeb0a92a9254d2b734af905572dd"} Jul 22 16:24:12.897016 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:12.896977 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5dd74b96b-fhjs8"] Jul 22 16:24:12.989227 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:12.989182 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5dd74b96b-fhjs8"] Jul 22 16:24:12.989426 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:12.989287 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5dd74b96b-fhjs8" Jul 22 16:24:12.992396 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:12.992366 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 22 16:24:12.992588 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:12.992424 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 22 16:24:12.992588 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:12.992428 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 22 16:24:12.992588 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:12.992469 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 22 16:24:12.992588 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:12.992431 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 22 16:24:12.993507 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:12.993490 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-gqwck\"" Jul 22 16:24:13.097546 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:13.097503 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2fc8a890-b765-4a91-8da9-a0dc7e0aba1e-console-oauth-config\") pod \"console-5dd74b96b-fhjs8\" (UID: \"2fc8a890-b765-4a91-8da9-a0dc7e0aba1e\") " pod="openshift-console/console-5dd74b96b-fhjs8" Jul 22 16:24:13.097546 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:13.097548 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lrt5t\" (UniqueName: \"kubernetes.io/projected/2fc8a890-b765-4a91-8da9-a0dc7e0aba1e-kube-api-access-lrt5t\") pod \"console-5dd74b96b-fhjs8\" (UID: \"2fc8a890-b765-4a91-8da9-a0dc7e0aba1e\") " pod="openshift-console/console-5dd74b96b-fhjs8" Jul 22 16:24:13.097800 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:13.097659 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2fc8a890-b765-4a91-8da9-a0dc7e0aba1e-oauth-serving-cert\") pod \"console-5dd74b96b-fhjs8\" (UID: \"2fc8a890-b765-4a91-8da9-a0dc7e0aba1e\") " pod="openshift-console/console-5dd74b96b-fhjs8" Jul 22 16:24:13.097800 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:13.097750 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2fc8a890-b765-4a91-8da9-a0dc7e0aba1e-console-serving-cert\") pod \"console-5dd74b96b-fhjs8\" (UID: \"2fc8a890-b765-4a91-8da9-a0dc7e0aba1e\") " pod="openshift-console/console-5dd74b96b-fhjs8" Jul 22 16:24:13.097800 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:13.097794 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2fc8a890-b765-4a91-8da9-a0dc7e0aba1e-console-config\") pod \"console-5dd74b96b-fhjs8\" (UID: \"2fc8a890-b765-4a91-8da9-a0dc7e0aba1e\") " pod="openshift-console/console-5dd74b96b-fhjs8" Jul 22 16:24:13.097958 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:13.097849 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2fc8a890-b765-4a91-8da9-a0dc7e0aba1e-service-ca\") pod \"console-5dd74b96b-fhjs8\" (UID: \"2fc8a890-b765-4a91-8da9-a0dc7e0aba1e\") " pod="openshift-console/console-5dd74b96b-fhjs8" Jul 22 16:24:13.199266 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:13.199187 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2fc8a890-b765-4a91-8da9-a0dc7e0aba1e-oauth-serving-cert\") pod \"console-5dd74b96b-fhjs8\" (UID: \"2fc8a890-b765-4a91-8da9-a0dc7e0aba1e\") " pod="openshift-console/console-5dd74b96b-fhjs8" Jul 22 16:24:13.199266 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:13.199253 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2fc8a890-b765-4a91-8da9-a0dc7e0aba1e-console-serving-cert\") pod \"console-5dd74b96b-fhjs8\" (UID: \"2fc8a890-b765-4a91-8da9-a0dc7e0aba1e\") " pod="openshift-console/console-5dd74b96b-fhjs8" Jul 22 16:24:13.199580 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:13.199292 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2fc8a890-b765-4a91-8da9-a0dc7e0aba1e-console-config\") pod \"console-5dd74b96b-fhjs8\" (UID: \"2fc8a890-b765-4a91-8da9-a0dc7e0aba1e\") " pod="openshift-console/console-5dd74b96b-fhjs8" Jul 22 16:24:13.199580 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:13.199319 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2fc8a890-b765-4a91-8da9-a0dc7e0aba1e-service-ca\") pod \"console-5dd74b96b-fhjs8\" (UID: \"2fc8a890-b765-4a91-8da9-a0dc7e0aba1e\") " pod="openshift-console/console-5dd74b96b-fhjs8" Jul 22 16:24:13.199580 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:13.199401 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2fc8a890-b765-4a91-8da9-a0dc7e0aba1e-console-oauth-config\") pod \"console-5dd74b96b-fhjs8\" (UID: \"2fc8a890-b765-4a91-8da9-a0dc7e0aba1e\") " pod="openshift-console/console-5dd74b96b-fhjs8" Jul 22 16:24:13.199580 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:13.199449 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lrt5t\" (UniqueName: \"kubernetes.io/projected/2fc8a890-b765-4a91-8da9-a0dc7e0aba1e-kube-api-access-lrt5t\") pod \"console-5dd74b96b-fhjs8\" (UID: \"2fc8a890-b765-4a91-8da9-a0dc7e0aba1e\") " pod="openshift-console/console-5dd74b96b-fhjs8" Jul 22 16:24:13.200103 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:13.200055 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2fc8a890-b765-4a91-8da9-a0dc7e0aba1e-oauth-serving-cert\") pod \"console-5dd74b96b-fhjs8\" (UID: \"2fc8a890-b765-4a91-8da9-a0dc7e0aba1e\") " pod="openshift-console/console-5dd74b96b-fhjs8" Jul 22 16:24:13.200236 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:13.200214 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2fc8a890-b765-4a91-8da9-a0dc7e0aba1e-service-ca\") pod \"console-5dd74b96b-fhjs8\" (UID: \"2fc8a890-b765-4a91-8da9-a0dc7e0aba1e\") " pod="openshift-console/console-5dd74b96b-fhjs8" Jul 22 16:24:13.200299 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:13.200222 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2fc8a890-b765-4a91-8da9-a0dc7e0aba1e-console-config\") pod \"console-5dd74b96b-fhjs8\" (UID: \"2fc8a890-b765-4a91-8da9-a0dc7e0aba1e\") " pod="openshift-console/console-5dd74b96b-fhjs8" Jul 22 16:24:13.202623 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:13.202574 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2fc8a890-b765-4a91-8da9-a0dc7e0aba1e-console-oauth-config\") pod \"console-5dd74b96b-fhjs8\" (UID: \"2fc8a890-b765-4a91-8da9-a0dc7e0aba1e\") " pod="openshift-console/console-5dd74b96b-fhjs8" Jul 22 16:24:13.202733 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:13.202666 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2fc8a890-b765-4a91-8da9-a0dc7e0aba1e-console-serving-cert\") pod \"console-5dd74b96b-fhjs8\" (UID: \"2fc8a890-b765-4a91-8da9-a0dc7e0aba1e\") " pod="openshift-console/console-5dd74b96b-fhjs8" Jul 22 16:24:13.208452 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:13.208426 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lrt5t\" (UniqueName: \"kubernetes.io/projected/2fc8a890-b765-4a91-8da9-a0dc7e0aba1e-kube-api-access-lrt5t\") pod \"console-5dd74b96b-fhjs8\" (UID: \"2fc8a890-b765-4a91-8da9-a0dc7e0aba1e\") " pod="openshift-console/console-5dd74b96b-fhjs8" Jul 22 16:24:13.302026 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:13.301987 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5dd74b96b-fhjs8" Jul 22 16:24:13.507432 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:13.507406 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5dd74b96b-fhjs8"] Jul 22 16:24:13.510514 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:24:13.510484 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fc8a890_b765_4a91_8da9_a0dc7e0aba1e.slice/crio-bff2e900e7151a38ced650d9c63a201c3b61415c8cd01ed255b85e260503ce12 WatchSource:0}: Error finding container bff2e900e7151a38ced650d9c63a201c3b61415c8cd01ed255b85e260503ce12: Status 404 returned error can't find the container with id bff2e900e7151a38ced650d9c63a201c3b61415c8cd01ed255b85e260503ce12 Jul 22 16:24:14.105019 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:14.104984 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5dd74b96b-fhjs8" event={"ID":"2fc8a890-b765-4a91-8da9-a0dc7e0aba1e","Type":"ContainerStarted","Data":"bff2e900e7151a38ced650d9c63a201c3b61415c8cd01ed255b85e260503ce12"} Jul 22 16:24:23.426560 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:23.426523 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-644757b87d-sqnk9"] Jul 22 16:24:23.569235 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:23.569193 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-644757b87d-sqnk9"] Jul 22 16:24:23.569451 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:23.569340 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-644757b87d-sqnk9" Jul 22 16:24:23.579104 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:23.579075 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 22 16:24:23.701688 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:23.701587 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/45eb037f-25bf-4f23-8a1f-fdba67ee7253-console-config\") pod \"console-644757b87d-sqnk9\" (UID: \"45eb037f-25bf-4f23-8a1f-fdba67ee7253\") " pod="openshift-console/console-644757b87d-sqnk9" Jul 22 16:24:23.701688 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:23.701671 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/45eb037f-25bf-4f23-8a1f-fdba67ee7253-console-serving-cert\") pod \"console-644757b87d-sqnk9\" (UID: \"45eb037f-25bf-4f23-8a1f-fdba67ee7253\") " pod="openshift-console/console-644757b87d-sqnk9" Jul 22 16:24:23.701902 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:23.701724 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45eb037f-25bf-4f23-8a1f-fdba67ee7253-trusted-ca-bundle\") pod \"console-644757b87d-sqnk9\" (UID: \"45eb037f-25bf-4f23-8a1f-fdba67ee7253\") " pod="openshift-console/console-644757b87d-sqnk9" Jul 22 16:24:23.701902 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:23.701744 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/45eb037f-25bf-4f23-8a1f-fdba67ee7253-console-oauth-config\") pod \"console-644757b87d-sqnk9\" (UID: \"45eb037f-25bf-4f23-8a1f-fdba67ee7253\") " pod="openshift-console/console-644757b87d-sqnk9" Jul 22 16:24:23.701902 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:23.701775 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/45eb037f-25bf-4f23-8a1f-fdba67ee7253-service-ca\") pod \"console-644757b87d-sqnk9\" (UID: \"45eb037f-25bf-4f23-8a1f-fdba67ee7253\") " pod="openshift-console/console-644757b87d-sqnk9" Jul 22 16:24:23.701902 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:23.701795 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/45eb037f-25bf-4f23-8a1f-fdba67ee7253-oauth-serving-cert\") pod \"console-644757b87d-sqnk9\" (UID: \"45eb037f-25bf-4f23-8a1f-fdba67ee7253\") " pod="openshift-console/console-644757b87d-sqnk9" Jul 22 16:24:23.701902 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:23.701852 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n4l7v\" (UniqueName: \"kubernetes.io/projected/45eb037f-25bf-4f23-8a1f-fdba67ee7253-kube-api-access-n4l7v\") pod \"console-644757b87d-sqnk9\" (UID: \"45eb037f-25bf-4f23-8a1f-fdba67ee7253\") " pod="openshift-console/console-644757b87d-sqnk9" Jul 22 16:24:23.802483 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:23.802446 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4l7v\" (UniqueName: \"kubernetes.io/projected/45eb037f-25bf-4f23-8a1f-fdba67ee7253-kube-api-access-n4l7v\") pod \"console-644757b87d-sqnk9\" (UID: \"45eb037f-25bf-4f23-8a1f-fdba67ee7253\") " pod="openshift-console/console-644757b87d-sqnk9" Jul 22 16:24:23.802640 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:23.802514 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/45eb037f-25bf-4f23-8a1f-fdba67ee7253-console-config\") pod \"console-644757b87d-sqnk9\" (UID: \"45eb037f-25bf-4f23-8a1f-fdba67ee7253\") " pod="openshift-console/console-644757b87d-sqnk9" Jul 22 16:24:23.802640 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:23.802559 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/45eb037f-25bf-4f23-8a1f-fdba67ee7253-console-serving-cert\") pod \"console-644757b87d-sqnk9\" (UID: \"45eb037f-25bf-4f23-8a1f-fdba67ee7253\") " pod="openshift-console/console-644757b87d-sqnk9" Jul 22 16:24:23.802640 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:23.802585 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45eb037f-25bf-4f23-8a1f-fdba67ee7253-trusted-ca-bundle\") pod \"console-644757b87d-sqnk9\" (UID: \"45eb037f-25bf-4f23-8a1f-fdba67ee7253\") " pod="openshift-console/console-644757b87d-sqnk9" Jul 22 16:24:23.802640 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:23.802606 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/45eb037f-25bf-4f23-8a1f-fdba67ee7253-console-oauth-config\") pod \"console-644757b87d-sqnk9\" (UID: \"45eb037f-25bf-4f23-8a1f-fdba67ee7253\") " pod="openshift-console/console-644757b87d-sqnk9" Jul 22 16:24:23.802821 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:23.802727 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/45eb037f-25bf-4f23-8a1f-fdba67ee7253-service-ca\") pod \"console-644757b87d-sqnk9\" (UID: \"45eb037f-25bf-4f23-8a1f-fdba67ee7253\") " pod="openshift-console/console-644757b87d-sqnk9" Jul 22 16:24:23.802821 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:23.802773 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/45eb037f-25bf-4f23-8a1f-fdba67ee7253-oauth-serving-cert\") pod \"console-644757b87d-sqnk9\" (UID: \"45eb037f-25bf-4f23-8a1f-fdba67ee7253\") " pod="openshift-console/console-644757b87d-sqnk9" Jul 22 16:24:23.803304 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:23.803279 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/45eb037f-25bf-4f23-8a1f-fdba67ee7253-console-config\") pod \"console-644757b87d-sqnk9\" (UID: \"45eb037f-25bf-4f23-8a1f-fdba67ee7253\") " pod="openshift-console/console-644757b87d-sqnk9" Jul 22 16:24:23.803464 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:23.803432 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/45eb037f-25bf-4f23-8a1f-fdba67ee7253-service-ca\") pod \"console-644757b87d-sqnk9\" (UID: \"45eb037f-25bf-4f23-8a1f-fdba67ee7253\") " pod="openshift-console/console-644757b87d-sqnk9" Jul 22 16:24:23.803528 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:23.803493 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/45eb037f-25bf-4f23-8a1f-fdba67ee7253-oauth-serving-cert\") pod \"console-644757b87d-sqnk9\" (UID: \"45eb037f-25bf-4f23-8a1f-fdba67ee7253\") " pod="openshift-console/console-644757b87d-sqnk9" Jul 22 16:24:23.803650 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:23.803624 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45eb037f-25bf-4f23-8a1f-fdba67ee7253-trusted-ca-bundle\") pod \"console-644757b87d-sqnk9\" (UID: \"45eb037f-25bf-4f23-8a1f-fdba67ee7253\") " pod="openshift-console/console-644757b87d-sqnk9" Jul 22 16:24:23.805063 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:23.805038 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/45eb037f-25bf-4f23-8a1f-fdba67ee7253-console-serving-cert\") pod \"console-644757b87d-sqnk9\" (UID: \"45eb037f-25bf-4f23-8a1f-fdba67ee7253\") " pod="openshift-console/console-644757b87d-sqnk9" Jul 22 16:24:23.805182 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:23.805163 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/45eb037f-25bf-4f23-8a1f-fdba67ee7253-console-oauth-config\") pod \"console-644757b87d-sqnk9\" (UID: \"45eb037f-25bf-4f23-8a1f-fdba67ee7253\") " pod="openshift-console/console-644757b87d-sqnk9" Jul 22 16:24:23.810519 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:23.810497 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n4l7v\" (UniqueName: \"kubernetes.io/projected/45eb037f-25bf-4f23-8a1f-fdba67ee7253-kube-api-access-n4l7v\") pod \"console-644757b87d-sqnk9\" (UID: \"45eb037f-25bf-4f23-8a1f-fdba67ee7253\") " pod="openshift-console/console-644757b87d-sqnk9" Jul 22 16:24:23.881413 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:23.881379 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-644757b87d-sqnk9" Jul 22 16:24:24.351545 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:24.351522 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-644757b87d-sqnk9"] Jul 22 16:24:24.355166 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:24:24.355136 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45eb037f_25bf_4f23_8a1f_fdba67ee7253.slice/crio-f1938e390dc195b5eedd222e82c49c27a257925b04dcd510fd7c6a458acedbad WatchSource:0}: Error finding container f1938e390dc195b5eedd222e82c49c27a257925b04dcd510fd7c6a458acedbad: Status 404 returned error can't find the container with id f1938e390dc195b5eedd222e82c49c27a257925b04dcd510fd7c6a458acedbad Jul 22 16:24:25.153889 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:25.153845 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-644757b87d-sqnk9" event={"ID":"45eb037f-25bf-4f23-8a1f-fdba67ee7253","Type":"ContainerStarted","Data":"e299fa1ac40af7ed37bd8b2cc24d9da1aacee9d63bc310b5fb7cf39edf4a60e3"} Jul 22 16:24:25.154392 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:25.153915 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-644757b87d-sqnk9" event={"ID":"45eb037f-25bf-4f23-8a1f-fdba67ee7253","Type":"ContainerStarted","Data":"f1938e390dc195b5eedd222e82c49c27a257925b04dcd510fd7c6a458acedbad"} Jul 22 16:24:25.155945 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:25.155909 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-8qjkk" event={"ID":"31360bae-3541-43b7-8f55-aa268c7ee53b","Type":"ContainerStarted","Data":"ea23fdf1ea58d8a0496d4d1f0ecf394a352ab6bd742c90ea7f59d71de8d75910"} Jul 22 16:24:25.156075 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:25.156057 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-5bc67dcd46-8qjkk" Jul 22 16:24:25.157882 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:25.157854 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5dd74b96b-fhjs8" event={"ID":"2fc8a890-b765-4a91-8da9-a0dc7e0aba1e","Type":"ContainerStarted","Data":"dd26c0a4a714932d95c07e7522b4829330093d8a11d501f1266fff12ef631b97"} Jul 22 16:24:25.169880 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:25.169846 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-5bc67dcd46-8qjkk" Jul 22 16:24:25.171811 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:25.171755 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-644757b87d-sqnk9" podStartSLOduration=2.171733734 podStartE2EDuration="2.171733734s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:24:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:24:25.170899964 +0000 UTC m=+117.272515551" watchObservedRunningTime="2026-07-22 16:24:25.171733734 +0000 UTC m=+117.273349303" Jul 22 16:24:25.187705 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:25.187639 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5dd74b96b-fhjs8" podStartSLOduration=2.48553599 podStartE2EDuration="13.187616838s" totalImagesPullingTime="10.702080848s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:24:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:24:25.186876478 +0000 UTC m=+117.288492078" watchObservedRunningTime="2026-07-22 16:24:25.187616838 +0000 UTC m=+117.289232414" Jul 22 16:24:25.206001 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:25.205939 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-5bc67dcd46-8qjkk" podStartSLOduration=2.152606674 podStartE2EDuration="19.205918621s" totalImagesPullingTime="17.053311947s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:24:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:24:25.205376442 +0000 UTC m=+117.306992018" watchObservedRunningTime="2026-07-22 16:24:25.205918621 +0000 UTC m=+117.307534198" Jul 22 16:24:28.099471 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:28.099415 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-546c5d6bb-qbhlm" podUID="1c84131c-de70-401c-a71b-8d7bc6dd171f" containerName="registry" containerID="cri-o://333b5c0994215b70cbe7f0ef52bcd445ce7dc03d4e3ab73e7a928db55345f651" gracePeriod=30 Jul 22 16:24:28.402389 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:28.402359 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-546c5d6bb-qbhlm" Jul 22 16:24:28.550421 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:28.550379 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1c84131c-de70-401c-a71b-8d7bc6dd171f-registry-certificates\") pod \"1c84131c-de70-401c-a71b-8d7bc6dd171f\" (UID: \"1c84131c-de70-401c-a71b-8d7bc6dd171f\") " Jul 22 16:24:28.550421 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:28.550428 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1c84131c-de70-401c-a71b-8d7bc6dd171f-registry-tls\") pod \"1c84131c-de70-401c-a71b-8d7bc6dd171f\" (UID: \"1c84131c-de70-401c-a71b-8d7bc6dd171f\") " Jul 22 16:24:28.550664 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:28.550460 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c9fwl\" (UniqueName: \"kubernetes.io/projected/1c84131c-de70-401c-a71b-8d7bc6dd171f-kube-api-access-c9fwl\") pod \"1c84131c-de70-401c-a71b-8d7bc6dd171f\" (UID: \"1c84131c-de70-401c-a71b-8d7bc6dd171f\") " Jul 22 16:24:28.550664 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:28.550489 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1c84131c-de70-401c-a71b-8d7bc6dd171f-installation-pull-secrets\") pod \"1c84131c-de70-401c-a71b-8d7bc6dd171f\" (UID: \"1c84131c-de70-401c-a71b-8d7bc6dd171f\") " Jul 22 16:24:28.550664 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:28.550544 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1c84131c-de70-401c-a71b-8d7bc6dd171f-bound-sa-token\") pod \"1c84131c-de70-401c-a71b-8d7bc6dd171f\" (UID: \"1c84131c-de70-401c-a71b-8d7bc6dd171f\") " Jul 22 16:24:28.550817 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:28.550705 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1c84131c-de70-401c-a71b-8d7bc6dd171f-trusted-ca\") pod \"1c84131c-de70-401c-a71b-8d7bc6dd171f\" (UID: \"1c84131c-de70-401c-a71b-8d7bc6dd171f\") " Jul 22 16:24:28.550817 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:28.550749 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1c84131c-de70-401c-a71b-8d7bc6dd171f-ca-trust-extracted\") pod \"1c84131c-de70-401c-a71b-8d7bc6dd171f\" (UID: \"1c84131c-de70-401c-a71b-8d7bc6dd171f\") " Jul 22 16:24:28.550817 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:28.550785 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1c84131c-de70-401c-a71b-8d7bc6dd171f-image-registry-private-configuration\") pod \"1c84131c-de70-401c-a71b-8d7bc6dd171f\" (UID: \"1c84131c-de70-401c-a71b-8d7bc6dd171f\") " Jul 22 16:24:28.550967 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:28.550852 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1c84131c-de70-401c-a71b-8d7bc6dd171f-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "1c84131c-de70-401c-a71b-8d7bc6dd171f" (UID: "1c84131c-de70-401c-a71b-8d7bc6dd171f"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 16:24:28.551117 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:28.551085 2568 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1c84131c-de70-401c-a71b-8d7bc6dd171f-registry-certificates\") on node \"ip-10-0-133-47.ec2.internal\" DevicePath \"\"" Jul 22 16:24:28.551178 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:28.551157 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1c84131c-de70-401c-a71b-8d7bc6dd171f-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "1c84131c-de70-401c-a71b-8d7bc6dd171f" (UID: "1c84131c-de70-401c-a71b-8d7bc6dd171f"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 16:24:28.554012 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:28.553981 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c84131c-de70-401c-a71b-8d7bc6dd171f-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "1c84131c-de70-401c-a71b-8d7bc6dd171f" (UID: "1c84131c-de70-401c-a71b-8d7bc6dd171f"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 16:24:28.554520 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:28.554429 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c84131c-de70-401c-a71b-8d7bc6dd171f-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "1c84131c-de70-401c-a71b-8d7bc6dd171f" (UID: "1c84131c-de70-401c-a71b-8d7bc6dd171f"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 16:24:28.554767 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:28.554669 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c84131c-de70-401c-a71b-8d7bc6dd171f-kube-api-access-c9fwl" (OuterVolumeSpecName: "kube-api-access-c9fwl") pod "1c84131c-de70-401c-a71b-8d7bc6dd171f" (UID: "1c84131c-de70-401c-a71b-8d7bc6dd171f"). InnerVolumeSpecName "kube-api-access-c9fwl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 16:24:28.554847 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:28.554823 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c84131c-de70-401c-a71b-8d7bc6dd171f-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "1c84131c-de70-401c-a71b-8d7bc6dd171f" (UID: "1c84131c-de70-401c-a71b-8d7bc6dd171f"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 16:24:28.555862 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:28.555834 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c84131c-de70-401c-a71b-8d7bc6dd171f-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "1c84131c-de70-401c-a71b-8d7bc6dd171f" (UID: "1c84131c-de70-401c-a71b-8d7bc6dd171f"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 16:24:28.562519 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:28.562489 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c84131c-de70-401c-a71b-8d7bc6dd171f-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "1c84131c-de70-401c-a71b-8d7bc6dd171f" (UID: "1c84131c-de70-401c-a71b-8d7bc6dd171f"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 16:24:28.652233 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:28.652149 2568 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1c84131c-de70-401c-a71b-8d7bc6dd171f-bound-sa-token\") on node \"ip-10-0-133-47.ec2.internal\" DevicePath \"\"" Jul 22 16:24:28.652233 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:28.652182 2568 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1c84131c-de70-401c-a71b-8d7bc6dd171f-trusted-ca\") on node \"ip-10-0-133-47.ec2.internal\" DevicePath \"\"" Jul 22 16:24:28.652233 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:28.652192 2568 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1c84131c-de70-401c-a71b-8d7bc6dd171f-ca-trust-extracted\") on node \"ip-10-0-133-47.ec2.internal\" DevicePath \"\"" Jul 22 16:24:28.652233 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:28.652202 2568 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1c84131c-de70-401c-a71b-8d7bc6dd171f-image-registry-private-configuration\") on node \"ip-10-0-133-47.ec2.internal\" DevicePath \"\"" Jul 22 16:24:28.652233 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:28.652217 2568 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1c84131c-de70-401c-a71b-8d7bc6dd171f-registry-tls\") on node \"ip-10-0-133-47.ec2.internal\" DevicePath \"\"" Jul 22 16:24:28.652233 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:28.652232 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c9fwl\" (UniqueName: \"kubernetes.io/projected/1c84131c-de70-401c-a71b-8d7bc6dd171f-kube-api-access-c9fwl\") on node \"ip-10-0-133-47.ec2.internal\" DevicePath \"\"" Jul 22 16:24:28.652636 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:28.652241 2568 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1c84131c-de70-401c-a71b-8d7bc6dd171f-installation-pull-secrets\") on node \"ip-10-0-133-47.ec2.internal\" DevicePath \"\"" Jul 22 16:24:29.176529 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:29.176473 2568 generic.go:356] "Generic (PLEG): container finished" podID="1c84131c-de70-401c-a71b-8d7bc6dd171f" containerID="333b5c0994215b70cbe7f0ef52bcd445ce7dc03d4e3ab73e7a928db55345f651" exitCode=0 Jul 22 16:24:29.176529 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:29.176524 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-546c5d6bb-qbhlm" Jul 22 16:24:29.177183 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:29.176548 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-546c5d6bb-qbhlm" event={"ID":"1c84131c-de70-401c-a71b-8d7bc6dd171f","Type":"ContainerDied","Data":"333b5c0994215b70cbe7f0ef52bcd445ce7dc03d4e3ab73e7a928db55345f651"} Jul 22 16:24:29.177183 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:29.176598 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-546c5d6bb-qbhlm" event={"ID":"1c84131c-de70-401c-a71b-8d7bc6dd171f","Type":"ContainerDied","Data":"6adcd6741f981d6d6f3542a50958cadf4cdf517cb298dbca8a75aa4210afaae4"} Jul 22 16:24:29.177183 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:29.176623 2568 scope.go:117] "RemoveContainer" containerID="333b5c0994215b70cbe7f0ef52bcd445ce7dc03d4e3ab73e7a928db55345f651" Jul 22 16:24:29.187214 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:29.187061 2568 scope.go:117] "RemoveContainer" containerID="333b5c0994215b70cbe7f0ef52bcd445ce7dc03d4e3ab73e7a928db55345f651" Jul 22 16:24:29.187429 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:24:29.187405 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"333b5c0994215b70cbe7f0ef52bcd445ce7dc03d4e3ab73e7a928db55345f651\": container with ID starting with 333b5c0994215b70cbe7f0ef52bcd445ce7dc03d4e3ab73e7a928db55345f651 not found: ID does not exist" containerID="333b5c0994215b70cbe7f0ef52bcd445ce7dc03d4e3ab73e7a928db55345f651" Jul 22 16:24:29.187527 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:29.187443 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"333b5c0994215b70cbe7f0ef52bcd445ce7dc03d4e3ab73e7a928db55345f651"} err="failed to get container status \"333b5c0994215b70cbe7f0ef52bcd445ce7dc03d4e3ab73e7a928db55345f651\": rpc error: code = NotFound desc = could not find container \"333b5c0994215b70cbe7f0ef52bcd445ce7dc03d4e3ab73e7a928db55345f651\": container with ID starting with 333b5c0994215b70cbe7f0ef52bcd445ce7dc03d4e3ab73e7a928db55345f651 not found: ID does not exist" Jul 22 16:24:29.202249 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:29.202215 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-546c5d6bb-qbhlm"] Jul 22 16:24:29.205410 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:29.205376 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-546c5d6bb-qbhlm"] Jul 22 16:24:30.410036 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:30.410002 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1c84131c-de70-401c-a71b-8d7bc6dd171f" path="/var/lib/kubelet/pods/1c84131c-de70-401c-a71b-8d7bc6dd171f/volumes" Jul 22 16:24:33.198052 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:33.198011 2568 generic.go:356] "Generic (PLEG): container finished" podID="2fc23598-8762-408d-b678-1eba72c5e867" containerID="a4c681d6e57bbf1185154e8ad3eaaae35fe9f1548aa2cbe970e8ca408ef4e60f" exitCode=0 Jul 22 16:24:33.198560 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:33.198081 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-njgfd" event={"ID":"2fc23598-8762-408d-b678-1eba72c5e867","Type":"ContainerDied","Data":"a4c681d6e57bbf1185154e8ad3eaaae35fe9f1548aa2cbe970e8ca408ef4e60f"} Jul 22 16:24:33.198560 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:33.198512 2568 scope.go:117] "RemoveContainer" containerID="a4c681d6e57bbf1185154e8ad3eaaae35fe9f1548aa2cbe970e8ca408ef4e60f" Jul 22 16:24:33.200456 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:33.200329 2568 generic.go:356] "Generic (PLEG): container finished" podID="743b9a0c-6a6a-4e95-8289-84d715effd40" containerID="e9987495fa4f09adf0a90316b9c308dd6f5f8ae2734da31e309cb863dce98ca5" exitCode=0 Jul 22 16:24:33.200456 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:33.200383 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-s4wdv" event={"ID":"743b9a0c-6a6a-4e95-8289-84d715effd40","Type":"ContainerDied","Data":"e9987495fa4f09adf0a90316b9c308dd6f5f8ae2734da31e309cb863dce98ca5"} Jul 22 16:24:33.200717 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:33.200697 2568 scope.go:117] "RemoveContainer" containerID="e9987495fa4f09adf0a90316b9c308dd6f5f8ae2734da31e309cb863dce98ca5" Jul 22 16:24:33.302957 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:33.302926 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5dd74b96b-fhjs8" Jul 22 16:24:33.303114 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:33.303025 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5dd74b96b-fhjs8" Jul 22 16:24:33.307659 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:33.307636 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5dd74b96b-fhjs8" Jul 22 16:24:33.882412 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:33.882371 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-644757b87d-sqnk9" Jul 22 16:24:33.882707 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:33.882686 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-644757b87d-sqnk9" Jul 22 16:24:33.887785 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:33.887760 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-644757b87d-sqnk9" Jul 22 16:24:34.206745 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:34.206662 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-s4wdv" event={"ID":"743b9a0c-6a6a-4e95-8289-84d715effd40","Type":"ContainerStarted","Data":"0ab50e9ddc1ddf387b29c708b026701ad058923d41823f6afde696bec623953d"} Jul 22 16:24:34.208484 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:34.208455 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-njgfd" event={"ID":"2fc23598-8762-408d-b678-1eba72c5e867","Type":"ContainerStarted","Data":"a24780dfb5c3a5a9679426875d2481da39efcfb4a52eea6ffa06da56d0ca25e5"} Jul 22 16:24:34.212307 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:34.212289 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5dd74b96b-fhjs8" Jul 22 16:24:34.212700 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:34.212682 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-644757b87d-sqnk9" Jul 22 16:24:34.292473 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:34.292437 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5dd74b96b-fhjs8"] Jul 22 16:24:36.322723 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:36.322693 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-76cf8966f8-mrs47_15d71c24-3074-4145-a424-c032a1e16f90/cluster-monitoring-operator/0.log" Jul 22 16:24:37.518939 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:37.518911 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hfxmd_1cd78a30-9e6a-4ccb-856e-bd4f679ec2d8/init-textfile/0.log" Jul 22 16:24:37.719559 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:37.719521 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hfxmd_1cd78a30-9e6a-4ccb-856e-bd4f679ec2d8/node-exporter/0.log" Jul 22 16:24:37.922123 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:37.922035 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hfxmd_1cd78a30-9e6a-4ccb-856e-bd4f679ec2d8/kube-rbac-proxy/0.log" Jul 22 16:24:42.244548 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:42.244513 2568 generic.go:356] "Generic (PLEG): container finished" podID="ec2173f3-fbea-470c-8d86-a118033f43fd" containerID="fb90707111abd09fa06f0c57e9866158a1f242617ba1da44f80d0802831d634a" exitCode=0 Jul 22 16:24:42.245008 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:42.244561 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-2xzn9" event={"ID":"ec2173f3-fbea-470c-8d86-a118033f43fd","Type":"ContainerDied","Data":"fb90707111abd09fa06f0c57e9866158a1f242617ba1da44f80d0802831d634a"} Jul 22 16:24:42.245008 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:42.244884 2568 scope.go:117] "RemoveContainer" containerID="fb90707111abd09fa06f0c57e9866158a1f242617ba1da44f80d0802831d634a" Jul 22 16:24:43.250651 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:43.250618 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-2xzn9" event={"ID":"ec2173f3-fbea-470c-8d86-a118033f43fd","Type":"ContainerStarted","Data":"f6b0f0065405d0f82cf323e16166b13176d0c6686adf0ce0671b3c6b2353bf9f"} Jul 22 16:24:43.718909 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:43.718834 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-7bc7489cb5-dd5l9_7e2887e8-0300-4255-bfb9-265e48b18be4/networking-console-plugin/0.log" Jul 22 16:24:43.918263 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:43.918237 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-lfqs8_816518f1-790a-4350-ae15-18287e06323a/console-operator/2.log" Jul 22 16:24:44.120162 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:44.120132 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-lfqs8_816518f1-790a-4350-ae15-18287e06323a/console-operator/3.log" Jul 22 16:24:44.319820 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:44.319795 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5dd74b96b-fhjs8_2fc8a890-b765-4a91-8da9-a0dc7e0aba1e/console/0.log" Jul 22 16:24:44.520124 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:44.520095 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-644757b87d-sqnk9_45eb037f-25bf-4f23-8a1f-fdba67ee7253/console/0.log" Jul 22 16:24:44.720114 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:44.720087 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-5bc67dcd46-8qjkk_31360bae-3541-43b7-8f55-aa268c7ee53b/download-server/0.log" Jul 22 16:24:44.919383 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:44.919263 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-57b96c888d-pxl85_8273b4e7-b4e0-4338-b8f1-ad7e1e7dae27/router/0.log" Jul 22 16:24:45.319196 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:24:45.319160 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6q9l7_13340988-afe9-464b-a66e-eb09a8694a8c/serve-healthcheck-canary/0.log" Jul 22 16:25:01.237668 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:25:01.237621 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5dd74b96b-fhjs8" podUID="2fc8a890-b765-4a91-8da9-a0dc7e0aba1e" containerName="console" containerID="cri-o://dd26c0a4a714932d95c07e7522b4829330093d8a11d501f1266fff12ef631b97" gracePeriod=15 Jul 22 16:25:01.513768 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:25:01.513671 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5dd74b96b-fhjs8" Jul 22 16:25:01.608341 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:25:01.608302 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2fc8a890-b765-4a91-8da9-a0dc7e0aba1e-console-serving-cert\") pod \"2fc8a890-b765-4a91-8da9-a0dc7e0aba1e\" (UID: \"2fc8a890-b765-4a91-8da9-a0dc7e0aba1e\") " Jul 22 16:25:01.608559 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:25:01.608380 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2fc8a890-b765-4a91-8da9-a0dc7e0aba1e-oauth-serving-cert\") pod \"2fc8a890-b765-4a91-8da9-a0dc7e0aba1e\" (UID: \"2fc8a890-b765-4a91-8da9-a0dc7e0aba1e\") " Jul 22 16:25:01.608559 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:25:01.608423 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2fc8a890-b765-4a91-8da9-a0dc7e0aba1e-console-oauth-config\") pod \"2fc8a890-b765-4a91-8da9-a0dc7e0aba1e\" (UID: \"2fc8a890-b765-4a91-8da9-a0dc7e0aba1e\") " Jul 22 16:25:01.608559 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:25:01.608448 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2fc8a890-b765-4a91-8da9-a0dc7e0aba1e-console-config\") pod \"2fc8a890-b765-4a91-8da9-a0dc7e0aba1e\" (UID: \"2fc8a890-b765-4a91-8da9-a0dc7e0aba1e\") " Jul 22 16:25:01.608559 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:25:01.608501 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2fc8a890-b765-4a91-8da9-a0dc7e0aba1e-service-ca\") pod \"2fc8a890-b765-4a91-8da9-a0dc7e0aba1e\" (UID: \"2fc8a890-b765-4a91-8da9-a0dc7e0aba1e\") " Jul 22 16:25:01.608559 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:25:01.608547 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lrt5t\" (UniqueName: \"kubernetes.io/projected/2fc8a890-b765-4a91-8da9-a0dc7e0aba1e-kube-api-access-lrt5t\") pod \"2fc8a890-b765-4a91-8da9-a0dc7e0aba1e\" (UID: \"2fc8a890-b765-4a91-8da9-a0dc7e0aba1e\") " Jul 22 16:25:01.608841 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:25:01.608814 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2fc8a890-b765-4a91-8da9-a0dc7e0aba1e-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "2fc8a890-b765-4a91-8da9-a0dc7e0aba1e" (UID: "2fc8a890-b765-4a91-8da9-a0dc7e0aba1e"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 16:25:01.608934 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:25:01.608907 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2fc8a890-b765-4a91-8da9-a0dc7e0aba1e-console-config" (OuterVolumeSpecName: "console-config") pod "2fc8a890-b765-4a91-8da9-a0dc7e0aba1e" (UID: "2fc8a890-b765-4a91-8da9-a0dc7e0aba1e"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 16:25:01.608988 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:25:01.608910 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2fc8a890-b765-4a91-8da9-a0dc7e0aba1e-service-ca" (OuterVolumeSpecName: "service-ca") pod "2fc8a890-b765-4a91-8da9-a0dc7e0aba1e" (UID: "2fc8a890-b765-4a91-8da9-a0dc7e0aba1e"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 16:25:01.610793 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:25:01.610764 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2fc8a890-b765-4a91-8da9-a0dc7e0aba1e-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "2fc8a890-b765-4a91-8da9-a0dc7e0aba1e" (UID: "2fc8a890-b765-4a91-8da9-a0dc7e0aba1e"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 16:25:01.610793 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:25:01.610784 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2fc8a890-b765-4a91-8da9-a0dc7e0aba1e-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "2fc8a890-b765-4a91-8da9-a0dc7e0aba1e" (UID: "2fc8a890-b765-4a91-8da9-a0dc7e0aba1e"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 16:25:01.610793 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:25:01.610771 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2fc8a890-b765-4a91-8da9-a0dc7e0aba1e-kube-api-access-lrt5t" (OuterVolumeSpecName: "kube-api-access-lrt5t") pod "2fc8a890-b765-4a91-8da9-a0dc7e0aba1e" (UID: "2fc8a890-b765-4a91-8da9-a0dc7e0aba1e"). InnerVolumeSpecName "kube-api-access-lrt5t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 16:25:01.709024 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:25:01.708990 2568 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2fc8a890-b765-4a91-8da9-a0dc7e0aba1e-service-ca\") on node \"ip-10-0-133-47.ec2.internal\" DevicePath \"\"" Jul 22 16:25:01.709024 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:25:01.709019 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lrt5t\" (UniqueName: \"kubernetes.io/projected/2fc8a890-b765-4a91-8da9-a0dc7e0aba1e-kube-api-access-lrt5t\") on node \"ip-10-0-133-47.ec2.internal\" DevicePath \"\"" Jul 22 16:25:01.709024 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:25:01.709030 2568 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2fc8a890-b765-4a91-8da9-a0dc7e0aba1e-console-serving-cert\") on node \"ip-10-0-133-47.ec2.internal\" DevicePath \"\"" Jul 22 16:25:01.709254 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:25:01.709040 2568 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2fc8a890-b765-4a91-8da9-a0dc7e0aba1e-oauth-serving-cert\") on node \"ip-10-0-133-47.ec2.internal\" DevicePath \"\"" Jul 22 16:25:01.709254 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:25:01.709049 2568 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2fc8a890-b765-4a91-8da9-a0dc7e0aba1e-console-oauth-config\") on node \"ip-10-0-133-47.ec2.internal\" DevicePath \"\"" Jul 22 16:25:01.709254 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:25:01.709057 2568 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2fc8a890-b765-4a91-8da9-a0dc7e0aba1e-console-config\") on node \"ip-10-0-133-47.ec2.internal\" DevicePath \"\"" Jul 22 16:25:02.324405 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:25:02.324368 2568 generic.go:356] "Generic (PLEG): container finished" podID="2fc8a890-b765-4a91-8da9-a0dc7e0aba1e" containerID="dd26c0a4a714932d95c07e7522b4829330093d8a11d501f1266fff12ef631b97" exitCode=0 Jul 22 16:25:02.324405 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:25:02.324403 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5dd74b96b-fhjs8" Jul 22 16:25:02.324829 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:25:02.324432 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5dd74b96b-fhjs8" event={"ID":"2fc8a890-b765-4a91-8da9-a0dc7e0aba1e","Type":"ContainerDied","Data":"dd26c0a4a714932d95c07e7522b4829330093d8a11d501f1266fff12ef631b97"} Jul 22 16:25:02.324829 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:25:02.324476 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5dd74b96b-fhjs8" event={"ID":"2fc8a890-b765-4a91-8da9-a0dc7e0aba1e","Type":"ContainerDied","Data":"bff2e900e7151a38ced650d9c63a201c3b61415c8cd01ed255b85e260503ce12"} Jul 22 16:25:02.324829 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:25:02.324501 2568 scope.go:117] "RemoveContainer" containerID="dd26c0a4a714932d95c07e7522b4829330093d8a11d501f1266fff12ef631b97" Jul 22 16:25:02.333274 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:25:02.333252 2568 scope.go:117] "RemoveContainer" containerID="dd26c0a4a714932d95c07e7522b4829330093d8a11d501f1266fff12ef631b97" Jul 22 16:25:02.333601 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:25:02.333582 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dd26c0a4a714932d95c07e7522b4829330093d8a11d501f1266fff12ef631b97\": container with ID starting with dd26c0a4a714932d95c07e7522b4829330093d8a11d501f1266fff12ef631b97 not found: ID does not exist" containerID="dd26c0a4a714932d95c07e7522b4829330093d8a11d501f1266fff12ef631b97" Jul 22 16:25:02.333676 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:25:02.333617 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd26c0a4a714932d95c07e7522b4829330093d8a11d501f1266fff12ef631b97"} err="failed to get container status \"dd26c0a4a714932d95c07e7522b4829330093d8a11d501f1266fff12ef631b97\": rpc error: code = NotFound desc = could not find container \"dd26c0a4a714932d95c07e7522b4829330093d8a11d501f1266fff12ef631b97\": container with ID starting with dd26c0a4a714932d95c07e7522b4829330093d8a11d501f1266fff12ef631b97 not found: ID does not exist" Jul 22 16:25:02.344906 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:25:02.344874 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5dd74b96b-fhjs8"] Jul 22 16:25:02.348440 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:25:02.348414 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5dd74b96b-fhjs8"] Jul 22 16:25:02.408941 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:25:02.408904 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2fc8a890-b765-4a91-8da9-a0dc7e0aba1e" path="/var/lib/kubelet/pods/2fc8a890-b765-4a91-8da9-a0dc7e0aba1e/volumes" Jul 22 16:25:21.508323 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:25:21.508239 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-ff898c44b-szxvb"] Jul 22 16:25:21.508758 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:25:21.508664 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c84131c-de70-401c-a71b-8d7bc6dd171f" containerName="registry" Jul 22 16:25:21.508758 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:25:21.508680 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c84131c-de70-401c-a71b-8d7bc6dd171f" containerName="registry" Jul 22 16:25:21.508758 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:25:21.508715 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2fc8a890-b765-4a91-8da9-a0dc7e0aba1e" containerName="console" Jul 22 16:25:21.508758 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:25:21.508724 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="2fc8a890-b765-4a91-8da9-a0dc7e0aba1e" containerName="console" Jul 22 16:25:21.508893 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:25:21.508783 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c84131c-de70-401c-a71b-8d7bc6dd171f" containerName="registry" Jul 22 16:25:21.508893 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:25:21.508794 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="2fc8a890-b765-4a91-8da9-a0dc7e0aba1e" containerName="console" Jul 22 16:25:21.511933 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:25:21.511906 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-ff898c44b-szxvb" Jul 22 16:25:21.522453 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:25:21.522424 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-ff898c44b-szxvb"] Jul 22 16:25:21.558911 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:25:21.558874 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/810bc8da-7ca0-4b66-a33d-52a5a514a73f-console-serving-cert\") pod \"console-ff898c44b-szxvb\" (UID: \"810bc8da-7ca0-4b66-a33d-52a5a514a73f\") " pod="openshift-console/console-ff898c44b-szxvb" Jul 22 16:25:21.558911 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:25:21.558915 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/810bc8da-7ca0-4b66-a33d-52a5a514a73f-trusted-ca-bundle\") pod \"console-ff898c44b-szxvb\" (UID: \"810bc8da-7ca0-4b66-a33d-52a5a514a73f\") " pod="openshift-console/console-ff898c44b-szxvb" Jul 22 16:25:21.559132 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:25:21.558933 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/810bc8da-7ca0-4b66-a33d-52a5a514a73f-oauth-serving-cert\") pod \"console-ff898c44b-szxvb\" (UID: \"810bc8da-7ca0-4b66-a33d-52a5a514a73f\") " pod="openshift-console/console-ff898c44b-szxvb" Jul 22 16:25:21.559132 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:25:21.559013 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/810bc8da-7ca0-4b66-a33d-52a5a514a73f-console-oauth-config\") pod \"console-ff898c44b-szxvb\" (UID: \"810bc8da-7ca0-4b66-a33d-52a5a514a73f\") " pod="openshift-console/console-ff898c44b-szxvb" Jul 22 16:25:21.559132 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:25:21.559085 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/810bc8da-7ca0-4b66-a33d-52a5a514a73f-service-ca\") pod \"console-ff898c44b-szxvb\" (UID: \"810bc8da-7ca0-4b66-a33d-52a5a514a73f\") " pod="openshift-console/console-ff898c44b-szxvb" Jul 22 16:25:21.559132 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:25:21.559130 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/810bc8da-7ca0-4b66-a33d-52a5a514a73f-console-config\") pod \"console-ff898c44b-szxvb\" (UID: \"810bc8da-7ca0-4b66-a33d-52a5a514a73f\") " pod="openshift-console/console-ff898c44b-szxvb" Jul 22 16:25:21.559284 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:25:21.559165 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p5txb\" (UniqueName: \"kubernetes.io/projected/810bc8da-7ca0-4b66-a33d-52a5a514a73f-kube-api-access-p5txb\") pod \"console-ff898c44b-szxvb\" (UID: \"810bc8da-7ca0-4b66-a33d-52a5a514a73f\") " pod="openshift-console/console-ff898c44b-szxvb" Jul 22 16:25:21.659844 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:25:21.659804 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/810bc8da-7ca0-4b66-a33d-52a5a514a73f-service-ca\") pod \"console-ff898c44b-szxvb\" (UID: \"810bc8da-7ca0-4b66-a33d-52a5a514a73f\") " pod="openshift-console/console-ff898c44b-szxvb" Jul 22 16:25:21.659844 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:25:21.659851 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/810bc8da-7ca0-4b66-a33d-52a5a514a73f-console-config\") pod \"console-ff898c44b-szxvb\" (UID: \"810bc8da-7ca0-4b66-a33d-52a5a514a73f\") " pod="openshift-console/console-ff898c44b-szxvb" Jul 22 16:25:21.660109 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:25:21.659874 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5txb\" (UniqueName: \"kubernetes.io/projected/810bc8da-7ca0-4b66-a33d-52a5a514a73f-kube-api-access-p5txb\") pod \"console-ff898c44b-szxvb\" (UID: \"810bc8da-7ca0-4b66-a33d-52a5a514a73f\") " pod="openshift-console/console-ff898c44b-szxvb" Jul 22 16:25:21.660109 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:25:21.659894 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/810bc8da-7ca0-4b66-a33d-52a5a514a73f-console-serving-cert\") pod \"console-ff898c44b-szxvb\" (UID: \"810bc8da-7ca0-4b66-a33d-52a5a514a73f\") " pod="openshift-console/console-ff898c44b-szxvb" Jul 22 16:25:21.660109 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:25:21.659925 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/810bc8da-7ca0-4b66-a33d-52a5a514a73f-trusted-ca-bundle\") pod \"console-ff898c44b-szxvb\" (UID: \"810bc8da-7ca0-4b66-a33d-52a5a514a73f\") " pod="openshift-console/console-ff898c44b-szxvb" Jul 22 16:25:21.660109 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:25:21.659940 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/810bc8da-7ca0-4b66-a33d-52a5a514a73f-oauth-serving-cert\") pod \"console-ff898c44b-szxvb\" (UID: \"810bc8da-7ca0-4b66-a33d-52a5a514a73f\") " pod="openshift-console/console-ff898c44b-szxvb" Jul 22 16:25:21.660109 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:25:21.659965 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/810bc8da-7ca0-4b66-a33d-52a5a514a73f-console-oauth-config\") pod \"console-ff898c44b-szxvb\" (UID: \"810bc8da-7ca0-4b66-a33d-52a5a514a73f\") " pod="openshift-console/console-ff898c44b-szxvb" Jul 22 16:25:21.660674 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:25:21.660648 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/810bc8da-7ca0-4b66-a33d-52a5a514a73f-oauth-serving-cert\") pod \"console-ff898c44b-szxvb\" (UID: \"810bc8da-7ca0-4b66-a33d-52a5a514a73f\") " pod="openshift-console/console-ff898c44b-szxvb" Jul 22 16:25:21.660780 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:25:21.660664 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/810bc8da-7ca0-4b66-a33d-52a5a514a73f-service-ca\") pod \"console-ff898c44b-szxvb\" (UID: \"810bc8da-7ca0-4b66-a33d-52a5a514a73f\") " pod="openshift-console/console-ff898c44b-szxvb" Jul 22 16:25:21.660780 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:25:21.660740 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/810bc8da-7ca0-4b66-a33d-52a5a514a73f-console-config\") pod \"console-ff898c44b-szxvb\" (UID: \"810bc8da-7ca0-4b66-a33d-52a5a514a73f\") " pod="openshift-console/console-ff898c44b-szxvb" Jul 22 16:25:21.660880 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:25:21.660857 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/810bc8da-7ca0-4b66-a33d-52a5a514a73f-trusted-ca-bundle\") pod \"console-ff898c44b-szxvb\" (UID: \"810bc8da-7ca0-4b66-a33d-52a5a514a73f\") " pod="openshift-console/console-ff898c44b-szxvb" Jul 22 16:25:21.662439 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:25:21.662410 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/810bc8da-7ca0-4b66-a33d-52a5a514a73f-console-oauth-config\") pod \"console-ff898c44b-szxvb\" (UID: \"810bc8da-7ca0-4b66-a33d-52a5a514a73f\") " pod="openshift-console/console-ff898c44b-szxvb" Jul 22 16:25:21.662744 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:25:21.662722 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/810bc8da-7ca0-4b66-a33d-52a5a514a73f-console-serving-cert\") pod \"console-ff898c44b-szxvb\" (UID: \"810bc8da-7ca0-4b66-a33d-52a5a514a73f\") " pod="openshift-console/console-ff898c44b-szxvb" Jul 22 16:25:21.667998 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:25:21.667972 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p5txb\" (UniqueName: \"kubernetes.io/projected/810bc8da-7ca0-4b66-a33d-52a5a514a73f-kube-api-access-p5txb\") pod \"console-ff898c44b-szxvb\" (UID: \"810bc8da-7ca0-4b66-a33d-52a5a514a73f\") " pod="openshift-console/console-ff898c44b-szxvb" Jul 22 16:25:21.822229 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:25:21.822133 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-ff898c44b-szxvb" Jul 22 16:25:21.954503 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:25:21.954461 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-ff898c44b-szxvb"] Jul 22 16:25:21.956734 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:25:21.956707 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod810bc8da_7ca0_4b66_a33d_52a5a514a73f.slice/crio-a86812161fdf6d4acee630356de1bb5bcbd4c011349ad012586cc2c9d23bfc8f WatchSource:0}: Error finding container a86812161fdf6d4acee630356de1bb5bcbd4c011349ad012586cc2c9d23bfc8f: Status 404 returned error can't find the container with id a86812161fdf6d4acee630356de1bb5bcbd4c011349ad012586cc2c9d23bfc8f Jul 22 16:25:22.402481 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:25:22.402442 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-ff898c44b-szxvb" event={"ID":"810bc8da-7ca0-4b66-a33d-52a5a514a73f","Type":"ContainerStarted","Data":"2dad2916d515bd3b4572a1e2fd2ffa4f03bf9e12a25719604a335c09b504b5ee"} Jul 22 16:25:22.402655 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:25:22.402492 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-ff898c44b-szxvb" event={"ID":"810bc8da-7ca0-4b66-a33d-52a5a514a73f","Type":"ContainerStarted","Data":"a86812161fdf6d4acee630356de1bb5bcbd4c011349ad012586cc2c9d23bfc8f"} Jul 22 16:25:22.419828 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:25:22.419777 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-ff898c44b-szxvb" podStartSLOduration=1.419758527 podStartE2EDuration="1.419758527s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:25:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:25:22.419112472 +0000 UTC m=+174.520728059" watchObservedRunningTime="2026-07-22 16:25:22.419758527 +0000 UTC m=+174.521374103" Jul 22 16:25:31.822741 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:25:31.822701 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-ff898c44b-szxvb" Jul 22 16:25:31.823226 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:25:31.822771 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-ff898c44b-szxvb" Jul 22 16:25:31.827522 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:25:31.827498 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-ff898c44b-szxvb" Jul 22 16:25:32.442795 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:25:32.442763 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-ff898c44b-szxvb" Jul 22 16:25:32.490836 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:25:32.490799 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-644757b87d-sqnk9"] Jul 22 16:25:57.513541 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:25:57.513493 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-644757b87d-sqnk9" podUID="45eb037f-25bf-4f23-8a1f-fdba67ee7253" containerName="console" containerID="cri-o://e299fa1ac40af7ed37bd8b2cc24d9da1aacee9d63bc310b5fb7cf39edf4a60e3" gracePeriod=15 Jul 22 16:25:57.756797 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:25:57.756769 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-644757b87d-sqnk9" Jul 22 16:25:57.762110 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:25:57.762088 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/45eb037f-25bf-4f23-8a1f-fdba67ee7253-console-oauth-config\") pod \"45eb037f-25bf-4f23-8a1f-fdba67ee7253\" (UID: \"45eb037f-25bf-4f23-8a1f-fdba67ee7253\") " Jul 22 16:25:57.762199 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:25:57.762124 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/45eb037f-25bf-4f23-8a1f-fdba67ee7253-oauth-serving-cert\") pod \"45eb037f-25bf-4f23-8a1f-fdba67ee7253\" (UID: \"45eb037f-25bf-4f23-8a1f-fdba67ee7253\") " Jul 22 16:25:57.762199 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:25:57.762143 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/45eb037f-25bf-4f23-8a1f-fdba67ee7253-service-ca\") pod \"45eb037f-25bf-4f23-8a1f-fdba67ee7253\" (UID: \"45eb037f-25bf-4f23-8a1f-fdba67ee7253\") " Jul 22 16:25:57.762199 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:25:57.762164 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/45eb037f-25bf-4f23-8a1f-fdba67ee7253-console-serving-cert\") pod \"45eb037f-25bf-4f23-8a1f-fdba67ee7253\" (UID: \"45eb037f-25bf-4f23-8a1f-fdba67ee7253\") " Jul 22 16:25:57.762199 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:25:57.762197 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n4l7v\" (UniqueName: \"kubernetes.io/projected/45eb037f-25bf-4f23-8a1f-fdba67ee7253-kube-api-access-n4l7v\") pod \"45eb037f-25bf-4f23-8a1f-fdba67ee7253\" (UID: \"45eb037f-25bf-4f23-8a1f-fdba67ee7253\") " Jul 22 16:25:57.762452 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:25:57.762230 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45eb037f-25bf-4f23-8a1f-fdba67ee7253-trusted-ca-bundle\") pod \"45eb037f-25bf-4f23-8a1f-fdba67ee7253\" (UID: \"45eb037f-25bf-4f23-8a1f-fdba67ee7253\") " Jul 22 16:25:57.762452 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:25:57.762255 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/45eb037f-25bf-4f23-8a1f-fdba67ee7253-console-config\") pod \"45eb037f-25bf-4f23-8a1f-fdba67ee7253\" (UID: \"45eb037f-25bf-4f23-8a1f-fdba67ee7253\") " Jul 22 16:25:57.762654 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:25:57.762625 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/45eb037f-25bf-4f23-8a1f-fdba67ee7253-service-ca" (OuterVolumeSpecName: "service-ca") pod "45eb037f-25bf-4f23-8a1f-fdba67ee7253" (UID: "45eb037f-25bf-4f23-8a1f-fdba67ee7253"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 16:25:57.762749 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:25:57.762671 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/45eb037f-25bf-4f23-8a1f-fdba67ee7253-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "45eb037f-25bf-4f23-8a1f-fdba67ee7253" (UID: "45eb037f-25bf-4f23-8a1f-fdba67ee7253"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 16:25:57.762749 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:25:57.762712 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/45eb037f-25bf-4f23-8a1f-fdba67ee7253-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "45eb037f-25bf-4f23-8a1f-fdba67ee7253" (UID: "45eb037f-25bf-4f23-8a1f-fdba67ee7253"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 16:25:57.762836 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:25:57.762738 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/45eb037f-25bf-4f23-8a1f-fdba67ee7253-console-config" (OuterVolumeSpecName: "console-config") pod "45eb037f-25bf-4f23-8a1f-fdba67ee7253" (UID: "45eb037f-25bf-4f23-8a1f-fdba67ee7253"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 16:25:57.764263 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:25:57.764207 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45eb037f-25bf-4f23-8a1f-fdba67ee7253-kube-api-access-n4l7v" (OuterVolumeSpecName: "kube-api-access-n4l7v") pod "45eb037f-25bf-4f23-8a1f-fdba67ee7253" (UID: "45eb037f-25bf-4f23-8a1f-fdba67ee7253"). InnerVolumeSpecName "kube-api-access-n4l7v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 16:25:57.764410 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:25:57.764392 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/45eb037f-25bf-4f23-8a1f-fdba67ee7253-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "45eb037f-25bf-4f23-8a1f-fdba67ee7253" (UID: "45eb037f-25bf-4f23-8a1f-fdba67ee7253"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 16:25:57.764463 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:25:57.764407 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/45eb037f-25bf-4f23-8a1f-fdba67ee7253-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "45eb037f-25bf-4f23-8a1f-fdba67ee7253" (UID: "45eb037f-25bf-4f23-8a1f-fdba67ee7253"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 16:25:57.863222 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:25:57.863178 2568 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/45eb037f-25bf-4f23-8a1f-fdba67ee7253-console-oauth-config\") on node \"ip-10-0-133-47.ec2.internal\" DevicePath \"\"" Jul 22 16:25:57.863222 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:25:57.863210 2568 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/45eb037f-25bf-4f23-8a1f-fdba67ee7253-oauth-serving-cert\") on node \"ip-10-0-133-47.ec2.internal\" DevicePath \"\"" Jul 22 16:25:57.863222 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:25:57.863224 2568 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/45eb037f-25bf-4f23-8a1f-fdba67ee7253-service-ca\") on node \"ip-10-0-133-47.ec2.internal\" DevicePath \"\"" Jul 22 16:25:57.863222 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:25:57.863233 2568 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/45eb037f-25bf-4f23-8a1f-fdba67ee7253-console-serving-cert\") on node \"ip-10-0-133-47.ec2.internal\" DevicePath \"\"" Jul 22 16:25:57.863528 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:25:57.863242 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n4l7v\" (UniqueName: \"kubernetes.io/projected/45eb037f-25bf-4f23-8a1f-fdba67ee7253-kube-api-access-n4l7v\") on node \"ip-10-0-133-47.ec2.internal\" DevicePath \"\"" Jul 22 16:25:57.863528 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:25:57.863251 2568 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45eb037f-25bf-4f23-8a1f-fdba67ee7253-trusted-ca-bundle\") on node \"ip-10-0-133-47.ec2.internal\" DevicePath \"\"" Jul 22 16:25:57.863528 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:25:57.863260 2568 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/45eb037f-25bf-4f23-8a1f-fdba67ee7253-console-config\") on node \"ip-10-0-133-47.ec2.internal\" DevicePath \"\"" Jul 22 16:25:58.533516 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:25:58.533482 2568 generic.go:356] "Generic (PLEG): container finished" podID="45eb037f-25bf-4f23-8a1f-fdba67ee7253" containerID="e299fa1ac40af7ed37bd8b2cc24d9da1aacee9d63bc310b5fb7cf39edf4a60e3" exitCode=0 Jul 22 16:25:58.533915 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:25:58.533527 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-644757b87d-sqnk9" Jul 22 16:25:58.533915 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:25:58.533569 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-644757b87d-sqnk9" event={"ID":"45eb037f-25bf-4f23-8a1f-fdba67ee7253","Type":"ContainerDied","Data":"e299fa1ac40af7ed37bd8b2cc24d9da1aacee9d63bc310b5fb7cf39edf4a60e3"} Jul 22 16:25:58.533915 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:25:58.533621 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-644757b87d-sqnk9" event={"ID":"45eb037f-25bf-4f23-8a1f-fdba67ee7253","Type":"ContainerDied","Data":"f1938e390dc195b5eedd222e82c49c27a257925b04dcd510fd7c6a458acedbad"} Jul 22 16:25:58.533915 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:25:58.533641 2568 scope.go:117] "RemoveContainer" containerID="e299fa1ac40af7ed37bd8b2cc24d9da1aacee9d63bc310b5fb7cf39edf4a60e3" Jul 22 16:25:58.542475 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:25:58.542443 2568 scope.go:117] "RemoveContainer" containerID="e299fa1ac40af7ed37bd8b2cc24d9da1aacee9d63bc310b5fb7cf39edf4a60e3" Jul 22 16:25:58.542740 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:25:58.542721 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e299fa1ac40af7ed37bd8b2cc24d9da1aacee9d63bc310b5fb7cf39edf4a60e3\": container with ID starting with e299fa1ac40af7ed37bd8b2cc24d9da1aacee9d63bc310b5fb7cf39edf4a60e3 not found: ID does not exist" containerID="e299fa1ac40af7ed37bd8b2cc24d9da1aacee9d63bc310b5fb7cf39edf4a60e3" Jul 22 16:25:58.542792 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:25:58.542748 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e299fa1ac40af7ed37bd8b2cc24d9da1aacee9d63bc310b5fb7cf39edf4a60e3"} err="failed to get container status \"e299fa1ac40af7ed37bd8b2cc24d9da1aacee9d63bc310b5fb7cf39edf4a60e3\": rpc error: code = NotFound desc = could not find container \"e299fa1ac40af7ed37bd8b2cc24d9da1aacee9d63bc310b5fb7cf39edf4a60e3\": container with ID starting with e299fa1ac40af7ed37bd8b2cc24d9da1aacee9d63bc310b5fb7cf39edf4a60e3 not found: ID does not exist" Jul 22 16:25:58.553266 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:25:58.553240 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-644757b87d-sqnk9"] Jul 22 16:25:58.557659 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:25:58.557636 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-644757b87d-sqnk9"] Jul 22 16:26:00.408672 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:26:00.408632 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="45eb037f-25bf-4f23-8a1f-fdba67ee7253" path="/var/lib/kubelet/pods/45eb037f-25bf-4f23-8a1f-fdba67ee7253/volumes" Jul 22 16:26:43.239856 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:26:43.239817 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l5lqj"] Jul 22 16:26:43.240338 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:26:43.240109 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45eb037f-25bf-4f23-8a1f-fdba67ee7253" containerName="console" Jul 22 16:26:43.240338 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:26:43.240119 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="45eb037f-25bf-4f23-8a1f-fdba67ee7253" containerName="console" Jul 22 16:26:43.240338 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:26:43.240171 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="45eb037f-25bf-4f23-8a1f-fdba67ee7253" containerName="console" Jul 22 16:26:43.243268 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:26:43.243249 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l5lqj" Jul 22 16:26:43.246296 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:26:43.246269 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-6bwdm\"" Jul 22 16:26:43.246296 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:26:43.246287 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 22 16:26:43.246989 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:26:43.246973 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 22 16:26:43.253986 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:26:43.253963 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l5lqj"] Jul 22 16:26:43.324311 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:26:43.324276 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d2c75bfb-97ec-4d9a-8472-e6ab603219a3-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l5lqj\" (UID: \"d2c75bfb-97ec-4d9a-8472-e6ab603219a3\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l5lqj" Jul 22 16:26:43.324499 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:26:43.324321 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d2c75bfb-97ec-4d9a-8472-e6ab603219a3-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l5lqj\" (UID: \"d2c75bfb-97ec-4d9a-8472-e6ab603219a3\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l5lqj" Jul 22 16:26:43.324499 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:26:43.324370 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n88ds\" (UniqueName: \"kubernetes.io/projected/d2c75bfb-97ec-4d9a-8472-e6ab603219a3-kube-api-access-n88ds\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l5lqj\" (UID: \"d2c75bfb-97ec-4d9a-8472-e6ab603219a3\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l5lqj" Jul 22 16:26:43.425544 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:26:43.425506 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d2c75bfb-97ec-4d9a-8472-e6ab603219a3-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l5lqj\" (UID: \"d2c75bfb-97ec-4d9a-8472-e6ab603219a3\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l5lqj" Jul 22 16:26:43.425705 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:26:43.425556 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d2c75bfb-97ec-4d9a-8472-e6ab603219a3-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l5lqj\" (UID: \"d2c75bfb-97ec-4d9a-8472-e6ab603219a3\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l5lqj" Jul 22 16:26:43.425705 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:26:43.425583 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n88ds\" (UniqueName: \"kubernetes.io/projected/d2c75bfb-97ec-4d9a-8472-e6ab603219a3-kube-api-access-n88ds\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l5lqj\" (UID: \"d2c75bfb-97ec-4d9a-8472-e6ab603219a3\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l5lqj" Jul 22 16:26:43.425922 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:26:43.425901 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d2c75bfb-97ec-4d9a-8472-e6ab603219a3-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l5lqj\" (UID: \"d2c75bfb-97ec-4d9a-8472-e6ab603219a3\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l5lqj" Jul 22 16:26:43.425957 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:26:43.425908 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d2c75bfb-97ec-4d9a-8472-e6ab603219a3-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l5lqj\" (UID: \"d2c75bfb-97ec-4d9a-8472-e6ab603219a3\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l5lqj" Jul 22 16:26:43.433633 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:26:43.433601 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n88ds\" (UniqueName: \"kubernetes.io/projected/d2c75bfb-97ec-4d9a-8472-e6ab603219a3-kube-api-access-n88ds\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l5lqj\" (UID: \"d2c75bfb-97ec-4d9a-8472-e6ab603219a3\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l5lqj" Jul 22 16:26:43.552057 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:26:43.551971 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l5lqj" Jul 22 16:26:43.683812 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:26:43.683703 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l5lqj"] Jul 22 16:26:43.686442 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:26:43.686417 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2c75bfb_97ec_4d9a_8472_e6ab603219a3.slice/crio-26657e486553b1b2a82c8498247f1fb98bc5495efcc0f829fa157538023c4a85 WatchSource:0}: Error finding container 26657e486553b1b2a82c8498247f1fb98bc5495efcc0f829fa157538023c4a85: Status 404 returned error can't find the container with id 26657e486553b1b2a82c8498247f1fb98bc5495efcc0f829fa157538023c4a85 Jul 22 16:26:43.700147 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:26:43.700117 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l5lqj" event={"ID":"d2c75bfb-97ec-4d9a-8472-e6ab603219a3","Type":"ContainerStarted","Data":"26657e486553b1b2a82c8498247f1fb98bc5495efcc0f829fa157538023c4a85"} Jul 22 16:26:50.738819 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:26:50.738782 2568 generic.go:356] "Generic (PLEG): container finished" podID="d2c75bfb-97ec-4d9a-8472-e6ab603219a3" containerID="082f0adfddc2dbae8f9eba250e6b76c6917cc1579795160cf5096ac290f924e0" exitCode=0 Jul 22 16:26:50.739215 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:26:50.738864 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l5lqj" event={"ID":"d2c75bfb-97ec-4d9a-8472-e6ab603219a3","Type":"ContainerDied","Data":"082f0adfddc2dbae8f9eba250e6b76c6917cc1579795160cf5096ac290f924e0"} Jul 22 16:26:53.751958 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:26:53.751923 2568 generic.go:356] "Generic (PLEG): container finished" podID="d2c75bfb-97ec-4d9a-8472-e6ab603219a3" containerID="affb9776b842db527508aaafa017fba489731143b46e0983eb3bf97cfa1a396c" exitCode=0 Jul 22 16:26:53.752334 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:26:53.751973 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l5lqj" event={"ID":"d2c75bfb-97ec-4d9a-8472-e6ab603219a3","Type":"ContainerDied","Data":"affb9776b842db527508aaafa017fba489731143b46e0983eb3bf97cfa1a396c"} Jul 22 16:27:01.788289 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:01.788251 2568 generic.go:356] "Generic (PLEG): container finished" podID="d2c75bfb-97ec-4d9a-8472-e6ab603219a3" containerID="cf24fa28be1b5b82c666a5a4043998648188d0b8d4ce07afc510e891b0c61b2d" exitCode=0 Jul 22 16:27:01.788702 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:01.788335 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l5lqj" event={"ID":"d2c75bfb-97ec-4d9a-8472-e6ab603219a3","Type":"ContainerDied","Data":"cf24fa28be1b5b82c666a5a4043998648188d0b8d4ce07afc510e891b0c61b2d"} Jul 22 16:27:02.927144 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:02.927114 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l5lqj" Jul 22 16:27:02.986266 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:02.986224 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d2c75bfb-97ec-4d9a-8472-e6ab603219a3-util\") pod \"d2c75bfb-97ec-4d9a-8472-e6ab603219a3\" (UID: \"d2c75bfb-97ec-4d9a-8472-e6ab603219a3\") " Jul 22 16:27:02.986266 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:02.986265 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d2c75bfb-97ec-4d9a-8472-e6ab603219a3-bundle\") pod \"d2c75bfb-97ec-4d9a-8472-e6ab603219a3\" (UID: \"d2c75bfb-97ec-4d9a-8472-e6ab603219a3\") " Jul 22 16:27:02.986536 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:02.986303 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n88ds\" (UniqueName: \"kubernetes.io/projected/d2c75bfb-97ec-4d9a-8472-e6ab603219a3-kube-api-access-n88ds\") pod \"d2c75bfb-97ec-4d9a-8472-e6ab603219a3\" (UID: \"d2c75bfb-97ec-4d9a-8472-e6ab603219a3\") " Jul 22 16:27:02.986950 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:02.986921 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2c75bfb-97ec-4d9a-8472-e6ab603219a3-bundle" (OuterVolumeSpecName: "bundle") pod "d2c75bfb-97ec-4d9a-8472-e6ab603219a3" (UID: "d2c75bfb-97ec-4d9a-8472-e6ab603219a3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 16:27:02.988546 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:02.988515 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2c75bfb-97ec-4d9a-8472-e6ab603219a3-kube-api-access-n88ds" (OuterVolumeSpecName: "kube-api-access-n88ds") pod "d2c75bfb-97ec-4d9a-8472-e6ab603219a3" (UID: "d2c75bfb-97ec-4d9a-8472-e6ab603219a3"). InnerVolumeSpecName "kube-api-access-n88ds". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 16:27:02.990548 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:02.990528 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2c75bfb-97ec-4d9a-8472-e6ab603219a3-util" (OuterVolumeSpecName: "util") pod "d2c75bfb-97ec-4d9a-8472-e6ab603219a3" (UID: "d2c75bfb-97ec-4d9a-8472-e6ab603219a3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 16:27:03.087868 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:03.087763 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n88ds\" (UniqueName: \"kubernetes.io/projected/d2c75bfb-97ec-4d9a-8472-e6ab603219a3-kube-api-access-n88ds\") on node \"ip-10-0-133-47.ec2.internal\" DevicePath \"\"" Jul 22 16:27:03.087868 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:03.087809 2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d2c75bfb-97ec-4d9a-8472-e6ab603219a3-util\") on node \"ip-10-0-133-47.ec2.internal\" DevicePath \"\"" Jul 22 16:27:03.087868 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:03.087823 2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d2c75bfb-97ec-4d9a-8472-e6ab603219a3-bundle\") on node \"ip-10-0-133-47.ec2.internal\" DevicePath \"\"" Jul 22 16:27:03.797956 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:03.797915 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l5lqj" event={"ID":"d2c75bfb-97ec-4d9a-8472-e6ab603219a3","Type":"ContainerDied","Data":"26657e486553b1b2a82c8498247f1fb98bc5495efcc0f829fa157538023c4a85"} Jul 22 16:27:03.797956 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:03.797950 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l5lqj" Jul 22 16:27:03.798164 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:03.797977 2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="26657e486553b1b2a82c8498247f1fb98bc5495efcc0f829fa157538023c4a85" Jul 22 16:27:11.271882 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:11.271838 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-k2s2j"] Jul 22 16:27:11.272486 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:11.272243 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2c75bfb-97ec-4d9a-8472-e6ab603219a3" containerName="extract" Jul 22 16:27:11.272486 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:11.272260 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2c75bfb-97ec-4d9a-8472-e6ab603219a3" containerName="extract" Jul 22 16:27:11.272486 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:11.272273 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2c75bfb-97ec-4d9a-8472-e6ab603219a3" containerName="pull" Jul 22 16:27:11.272486 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:11.272281 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2c75bfb-97ec-4d9a-8472-e6ab603219a3" containerName="pull" Jul 22 16:27:11.272486 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:11.272298 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2c75bfb-97ec-4d9a-8472-e6ab603219a3" containerName="util" Jul 22 16:27:11.272486 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:11.272307 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2c75bfb-97ec-4d9a-8472-e6ab603219a3" containerName="util" Jul 22 16:27:11.272486 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:11.272404 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="d2c75bfb-97ec-4d9a-8472-e6ab603219a3" containerName="extract" Jul 22 16:27:11.277520 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:11.277498 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-k2s2j" Jul 22 16:27:11.283090 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:11.283068 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 22 16:27:11.284428 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:11.284409 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-zj5nj\"" Jul 22 16:27:11.285234 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:11.285217 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 22 16:27:11.294002 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:11.293972 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-k2s2j"] Jul 22 16:27:11.354580 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:11.354537 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-snqn5\" (UniqueName: \"kubernetes.io/projected/d834972a-1359-4a8b-9db4-7be340e19ddf-kube-api-access-snqn5\") pod \"cert-manager-operator-controller-manager-55c444bf86-k2s2j\" (UID: \"d834972a-1359-4a8b-9db4-7be340e19ddf\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-k2s2j" Jul 22 16:27:11.354580 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:11.354584 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d834972a-1359-4a8b-9db4-7be340e19ddf-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-k2s2j\" (UID: \"d834972a-1359-4a8b-9db4-7be340e19ddf\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-k2s2j" Jul 22 16:27:11.455276 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:11.455235 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-snqn5\" (UniqueName: \"kubernetes.io/projected/d834972a-1359-4a8b-9db4-7be340e19ddf-kube-api-access-snqn5\") pod \"cert-manager-operator-controller-manager-55c444bf86-k2s2j\" (UID: \"d834972a-1359-4a8b-9db4-7be340e19ddf\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-k2s2j" Jul 22 16:27:11.455276 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:11.455282 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d834972a-1359-4a8b-9db4-7be340e19ddf-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-k2s2j\" (UID: \"d834972a-1359-4a8b-9db4-7be340e19ddf\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-k2s2j" Jul 22 16:27:11.455694 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:11.455671 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d834972a-1359-4a8b-9db4-7be340e19ddf-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-k2s2j\" (UID: \"d834972a-1359-4a8b-9db4-7be340e19ddf\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-k2s2j" Jul 22 16:27:11.464915 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:11.464880 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-snqn5\" (UniqueName: \"kubernetes.io/projected/d834972a-1359-4a8b-9db4-7be340e19ddf-kube-api-access-snqn5\") pod \"cert-manager-operator-controller-manager-55c444bf86-k2s2j\" (UID: \"d834972a-1359-4a8b-9db4-7be340e19ddf\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-k2s2j" Jul 22 16:27:11.586726 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:11.586628 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-k2s2j" Jul 22 16:27:11.723185 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:11.723153 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-k2s2j"] Jul 22 16:27:11.726681 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:27:11.726654 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd834972a_1359_4a8b_9db4_7be340e19ddf.slice/crio-942525d8d874e00a390bcc40438126e7015f1770c8dc3f4a7e8a867185eabf3e WatchSource:0}: Error finding container 942525d8d874e00a390bcc40438126e7015f1770c8dc3f4a7e8a867185eabf3e: Status 404 returned error can't find the container with id 942525d8d874e00a390bcc40438126e7015f1770c8dc3f4a7e8a867185eabf3e Jul 22 16:27:11.831331 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:11.831286 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-k2s2j" event={"ID":"d834972a-1359-4a8b-9db4-7be340e19ddf","Type":"ContainerStarted","Data":"942525d8d874e00a390bcc40438126e7015f1770c8dc3f4a7e8a867185eabf3e"} Jul 22 16:27:13.843085 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:13.843044 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-k2s2j" event={"ID":"d834972a-1359-4a8b-9db4-7be340e19ddf","Type":"ContainerStarted","Data":"30f59191bc105cd174483180a2921626020c845f4f781d94e9ad614c147ce6c3"} Jul 22 16:27:13.877105 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:13.877055 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-k2s2j" podStartSLOduration=1.4425581109999999 podStartE2EDuration="2.877038513s" totalImagesPullingTime="1.434480402s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:27:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:27:13.87559429 +0000 UTC m=+285.977209868" watchObservedRunningTime="2026-07-22 16:27:13.877038513 +0000 UTC m=+285.978654091" Jul 22 16:27:15.720189 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:15.720157 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzk5ng"] Jul 22 16:27:15.723725 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:15.723699 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzk5ng" Jul 22 16:27:15.726531 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:15.726471 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 22 16:27:15.726531 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:15.726499 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 22 16:27:15.727296 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:15.727277 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-6bwdm\"" Jul 22 16:27:15.732871 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:15.732846 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzk5ng"] Jul 22 16:27:15.792690 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:15.792649 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lc9qq\" (UniqueName: \"kubernetes.io/projected/82337539-62a2-430a-bd5a-631533511114-kube-api-access-lc9qq\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzk5ng\" (UID: \"82337539-62a2-430a-bd5a-631533511114\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzk5ng" Jul 22 16:27:15.792875 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:15.792698 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/82337539-62a2-430a-bd5a-631533511114-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzk5ng\" (UID: \"82337539-62a2-430a-bd5a-631533511114\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzk5ng" Jul 22 16:27:15.792875 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:15.792799 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/82337539-62a2-430a-bd5a-631533511114-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzk5ng\" (UID: \"82337539-62a2-430a-bd5a-631533511114\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzk5ng" Jul 22 16:27:15.894067 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:15.894033 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/82337539-62a2-430a-bd5a-631533511114-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzk5ng\" (UID: \"82337539-62a2-430a-bd5a-631533511114\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzk5ng" Jul 22 16:27:15.894219 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:15.894086 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/82337539-62a2-430a-bd5a-631533511114-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzk5ng\" (UID: \"82337539-62a2-430a-bd5a-631533511114\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzk5ng" Jul 22 16:27:15.894219 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:15.894140 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lc9qq\" (UniqueName: \"kubernetes.io/projected/82337539-62a2-430a-bd5a-631533511114-kube-api-access-lc9qq\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzk5ng\" (UID: \"82337539-62a2-430a-bd5a-631533511114\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzk5ng" Jul 22 16:27:15.894536 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:15.894508 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/82337539-62a2-430a-bd5a-631533511114-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzk5ng\" (UID: \"82337539-62a2-430a-bd5a-631533511114\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzk5ng" Jul 22 16:27:15.894571 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:15.894545 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/82337539-62a2-430a-bd5a-631533511114-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzk5ng\" (UID: \"82337539-62a2-430a-bd5a-631533511114\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzk5ng" Jul 22 16:27:15.902980 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:15.902949 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lc9qq\" (UniqueName: \"kubernetes.io/projected/82337539-62a2-430a-bd5a-631533511114-kube-api-access-lc9qq\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzk5ng\" (UID: \"82337539-62a2-430a-bd5a-631533511114\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzk5ng" Jul 22 16:27:16.036076 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:16.035989 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzk5ng" Jul 22 16:27:16.166748 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:16.166621 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzk5ng"] Jul 22 16:27:16.169282 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:27:16.169242 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82337539_62a2_430a_bd5a_631533511114.slice/crio-139e0828ea2a26e67b7c31c554de39ba943073d6fe928fcb6f5a63eeb5321dd7 WatchSource:0}: Error finding container 139e0828ea2a26e67b7c31c554de39ba943073d6fe928fcb6f5a63eeb5321dd7: Status 404 returned error can't find the container with id 139e0828ea2a26e67b7c31c554de39ba943073d6fe928fcb6f5a63eeb5321dd7 Jul 22 16:27:16.856643 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:16.856606 2568 generic.go:356] "Generic (PLEG): container finished" podID="82337539-62a2-430a-bd5a-631533511114" containerID="3c1bc8bb9ea80ec48fbae08fb9c7c8abac6fe7ccb95ae94fc993fe10158e018f" exitCode=0 Jul 22 16:27:16.857039 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:16.856687 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzk5ng" event={"ID":"82337539-62a2-430a-bd5a-631533511114","Type":"ContainerDied","Data":"3c1bc8bb9ea80ec48fbae08fb9c7c8abac6fe7ccb95ae94fc993fe10158e018f"} Jul 22 16:27:16.857039 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:16.856738 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzk5ng" event={"ID":"82337539-62a2-430a-bd5a-631533511114","Type":"ContainerStarted","Data":"139e0828ea2a26e67b7c31c554de39ba943073d6fe928fcb6f5a63eeb5321dd7"} Jul 22 16:27:18.868029 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:18.867991 2568 generic.go:356] "Generic (PLEG): container finished" podID="82337539-62a2-430a-bd5a-631533511114" containerID="2f6b5be96b54faa5840def4acc5b97029ec2753129854f1ce0d5f2b007d01b85" exitCode=0 Jul 22 16:27:18.868510 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:18.868071 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzk5ng" event={"ID":"82337539-62a2-430a-bd5a-631533511114","Type":"ContainerDied","Data":"2f6b5be96b54faa5840def4acc5b97029ec2753129854f1ce0d5f2b007d01b85"} Jul 22 16:27:19.874142 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:19.874104 2568 generic.go:356] "Generic (PLEG): container finished" podID="82337539-62a2-430a-bd5a-631533511114" containerID="1630ada39d1d74a8b8968054d77689ee10e4ddbc8f816a40adf354224d16e742" exitCode=0 Jul 22 16:27:19.874556 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:19.874181 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzk5ng" event={"ID":"82337539-62a2-430a-bd5a-631533511114","Type":"ContainerDied","Data":"1630ada39d1d74a8b8968054d77689ee10e4ddbc8f816a40adf354224d16e742"} Jul 22 16:27:21.006042 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:21.006017 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzk5ng" Jul 22 16:27:21.140234 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:21.140125 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/82337539-62a2-430a-bd5a-631533511114-util\") pod \"82337539-62a2-430a-bd5a-631533511114\" (UID: \"82337539-62a2-430a-bd5a-631533511114\") " Jul 22 16:27:21.140234 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:21.140196 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/82337539-62a2-430a-bd5a-631533511114-bundle\") pod \"82337539-62a2-430a-bd5a-631533511114\" (UID: \"82337539-62a2-430a-bd5a-631533511114\") " Jul 22 16:27:21.140234 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:21.140225 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lc9qq\" (UniqueName: \"kubernetes.io/projected/82337539-62a2-430a-bd5a-631533511114-kube-api-access-lc9qq\") pod \"82337539-62a2-430a-bd5a-631533511114\" (UID: \"82337539-62a2-430a-bd5a-631533511114\") " Jul 22 16:27:21.140701 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:21.140651 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82337539-62a2-430a-bd5a-631533511114-bundle" (OuterVolumeSpecName: "bundle") pod "82337539-62a2-430a-bd5a-631533511114" (UID: "82337539-62a2-430a-bd5a-631533511114"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 16:27:21.142301 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:21.142282 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82337539-62a2-430a-bd5a-631533511114-kube-api-access-lc9qq" (OuterVolumeSpecName: "kube-api-access-lc9qq") pod "82337539-62a2-430a-bd5a-631533511114" (UID: "82337539-62a2-430a-bd5a-631533511114"). InnerVolumeSpecName "kube-api-access-lc9qq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 16:27:21.148015 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:21.147984 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82337539-62a2-430a-bd5a-631533511114-util" (OuterVolumeSpecName: "util") pod "82337539-62a2-430a-bd5a-631533511114" (UID: "82337539-62a2-430a-bd5a-631533511114"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 16:27:21.241777 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:21.241744 2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/82337539-62a2-430a-bd5a-631533511114-util\") on node \"ip-10-0-133-47.ec2.internal\" DevicePath \"\"" Jul 22 16:27:21.241777 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:21.241773 2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/82337539-62a2-430a-bd5a-631533511114-bundle\") on node \"ip-10-0-133-47.ec2.internal\" DevicePath \"\"" Jul 22 16:27:21.241777 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:21.241782 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lc9qq\" (UniqueName: \"kubernetes.io/projected/82337539-62a2-430a-bd5a-631533511114-kube-api-access-lc9qq\") on node \"ip-10-0-133-47.ec2.internal\" DevicePath \"\"" Jul 22 16:27:21.884417 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:21.884382 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzk5ng" event={"ID":"82337539-62a2-430a-bd5a-631533511114","Type":"ContainerDied","Data":"139e0828ea2a26e67b7c31c554de39ba943073d6fe928fcb6f5a63eeb5321dd7"} Jul 22 16:27:21.884580 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:21.884433 2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="139e0828ea2a26e67b7c31c554de39ba943073d6fe928fcb6f5a63eeb5321dd7" Jul 22 16:27:21.884580 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:21.884394 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzk5ng" Jul 22 16:27:24.145851 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:24.145811 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-2vkdq"] Jul 22 16:27:24.146229 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:24.146087 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82337539-62a2-430a-bd5a-631533511114" containerName="extract" Jul 22 16:27:24.146229 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:24.146098 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="82337539-62a2-430a-bd5a-631533511114" containerName="extract" Jul 22 16:27:24.146229 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:24.146113 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82337539-62a2-430a-bd5a-631533511114" containerName="util" Jul 22 16:27:24.146229 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:24.146118 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="82337539-62a2-430a-bd5a-631533511114" containerName="util" Jul 22 16:27:24.146229 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:24.146124 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82337539-62a2-430a-bd5a-631533511114" containerName="pull" Jul 22 16:27:24.146229 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:24.146130 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="82337539-62a2-430a-bd5a-631533511114" containerName="pull" Jul 22 16:27:24.146229 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:24.146185 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="82337539-62a2-430a-bd5a-631533511114" containerName="extract" Jul 22 16:27:24.149211 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:24.149194 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-2vkdq" Jul 22 16:27:24.152682 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:24.152658 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 22 16:27:24.152973 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:24.152958 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-8g9kz\"" Jul 22 16:27:24.153583 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:24.153567 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 22 16:27:24.161586 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:24.161550 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-2vkdq"] Jul 22 16:27:24.269158 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:24.269121 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6582d519-8598-4b3d-89a3-c8d2be3ff6a3-bound-sa-token\") pod \"cert-manager-55b4d954d5-2vkdq\" (UID: \"6582d519-8598-4b3d-89a3-c8d2be3ff6a3\") " pod="cert-manager/cert-manager-55b4d954d5-2vkdq" Jul 22 16:27:24.269158 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:24.269159 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-654wh\" (UniqueName: \"kubernetes.io/projected/6582d519-8598-4b3d-89a3-c8d2be3ff6a3-kube-api-access-654wh\") pod \"cert-manager-55b4d954d5-2vkdq\" (UID: \"6582d519-8598-4b3d-89a3-c8d2be3ff6a3\") " pod="cert-manager/cert-manager-55b4d954d5-2vkdq" Jul 22 16:27:24.369768 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:24.369724 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6582d519-8598-4b3d-89a3-c8d2be3ff6a3-bound-sa-token\") pod \"cert-manager-55b4d954d5-2vkdq\" (UID: \"6582d519-8598-4b3d-89a3-c8d2be3ff6a3\") " pod="cert-manager/cert-manager-55b4d954d5-2vkdq" Jul 22 16:27:24.369768 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:24.369781 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-654wh\" (UniqueName: \"kubernetes.io/projected/6582d519-8598-4b3d-89a3-c8d2be3ff6a3-kube-api-access-654wh\") pod \"cert-manager-55b4d954d5-2vkdq\" (UID: \"6582d519-8598-4b3d-89a3-c8d2be3ff6a3\") " pod="cert-manager/cert-manager-55b4d954d5-2vkdq" Jul 22 16:27:24.380269 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:24.380235 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6582d519-8598-4b3d-89a3-c8d2be3ff6a3-bound-sa-token\") pod \"cert-manager-55b4d954d5-2vkdq\" (UID: \"6582d519-8598-4b3d-89a3-c8d2be3ff6a3\") " pod="cert-manager/cert-manager-55b4d954d5-2vkdq" Jul 22 16:27:24.380396 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:24.380325 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-654wh\" (UniqueName: \"kubernetes.io/projected/6582d519-8598-4b3d-89a3-c8d2be3ff6a3-kube-api-access-654wh\") pod \"cert-manager-55b4d954d5-2vkdq\" (UID: \"6582d519-8598-4b3d-89a3-c8d2be3ff6a3\") " pod="cert-manager/cert-manager-55b4d954d5-2vkdq" Jul 22 16:27:24.457964 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:24.457871 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-2vkdq" Jul 22 16:27:24.590188 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:24.590159 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-2vkdq"] Jul 22 16:27:24.592469 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:27:24.592444 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6582d519_8598_4b3d_89a3_c8d2be3ff6a3.slice/crio-2dfdaca4eff7a0aba223ed77e5ccef8247161a05569c3555cec67cb91db88575 WatchSource:0}: Error finding container 2dfdaca4eff7a0aba223ed77e5ccef8247161a05569c3555cec67cb91db88575: Status 404 returned error can't find the container with id 2dfdaca4eff7a0aba223ed77e5ccef8247161a05569c3555cec67cb91db88575 Jul 22 16:27:24.897775 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:24.897737 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-2vkdq" event={"ID":"6582d519-8598-4b3d-89a3-c8d2be3ff6a3","Type":"ContainerStarted","Data":"2dfdaca4eff7a0aba223ed77e5ccef8247161a05569c3555cec67cb91db88575"} Jul 22 16:27:27.913411 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:27.913377 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-2vkdq" event={"ID":"6582d519-8598-4b3d-89a3-c8d2be3ff6a3","Type":"ContainerStarted","Data":"d3cc492e32ef65c24a3f86d7b9e15fe82fa920f48901c6978a786072fa6f902a"} Jul 22 16:27:27.930946 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:27.930895 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-2vkdq" podStartSLOduration=1.215047559 podStartE2EDuration="3.930879297s" totalImagesPullingTime="2.715831738s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:27:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:27:27.928740772 +0000 UTC m=+300.030356345" watchObservedRunningTime="2026-07-22 16:27:27.930879297 +0000 UTC m=+300.032494872" Jul 22 16:27:28.316522 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:28.316492 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-lfqs8_816518f1-790a-4350-ae15-18287e06323a/console-operator/2.log" Jul 22 16:27:28.323494 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:28.323469 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-lfqs8_816518f1-790a-4350-ae15-18287e06323a/console-operator/2.log" Jul 22 16:27:28.326618 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:28.326593 2568 kubelet.go:1648] "Image garbage collection succeeded" Jul 22 16:27:32.321463 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:32.321424 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qvqcr"] Jul 22 16:27:32.357455 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:32.357425 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qvqcr"] Jul 22 16:27:32.357599 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:32.357510 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qvqcr" Jul 22 16:27:32.361157 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:32.361134 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 22 16:27:32.361984 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:32.361963 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-2whrs\"" Jul 22 16:27:32.362111 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:32.361984 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 22 16:27:32.433831 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:32.433793 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1eca6662-01af-4c64-acdf-7fb466edb219-tmp\") pod \"openshift-lws-operator-fd8ccff4c-qvqcr\" (UID: \"1eca6662-01af-4c64-acdf-7fb466edb219\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qvqcr" Jul 22 16:27:32.434000 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:32.433862 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cgknt\" (UniqueName: \"kubernetes.io/projected/1eca6662-01af-4c64-acdf-7fb466edb219-kube-api-access-cgknt\") pod \"openshift-lws-operator-fd8ccff4c-qvqcr\" (UID: \"1eca6662-01af-4c64-acdf-7fb466edb219\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qvqcr" Jul 22 16:27:32.535202 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:32.535166 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cgknt\" (UniqueName: \"kubernetes.io/projected/1eca6662-01af-4c64-acdf-7fb466edb219-kube-api-access-cgknt\") pod \"openshift-lws-operator-fd8ccff4c-qvqcr\" (UID: \"1eca6662-01af-4c64-acdf-7fb466edb219\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qvqcr" Jul 22 16:27:32.535390 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:32.535247 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1eca6662-01af-4c64-acdf-7fb466edb219-tmp\") pod \"openshift-lws-operator-fd8ccff4c-qvqcr\" (UID: \"1eca6662-01af-4c64-acdf-7fb466edb219\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qvqcr" Jul 22 16:27:32.535631 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:32.535613 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1eca6662-01af-4c64-acdf-7fb466edb219-tmp\") pod \"openshift-lws-operator-fd8ccff4c-qvqcr\" (UID: \"1eca6662-01af-4c64-acdf-7fb466edb219\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qvqcr" Jul 22 16:27:32.544290 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:32.544259 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cgknt\" (UniqueName: \"kubernetes.io/projected/1eca6662-01af-4c64-acdf-7fb466edb219-kube-api-access-cgknt\") pod \"openshift-lws-operator-fd8ccff4c-qvqcr\" (UID: \"1eca6662-01af-4c64-acdf-7fb466edb219\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qvqcr" Jul 22 16:27:32.667527 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:32.667432 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qvqcr" Jul 22 16:27:32.794305 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:32.794280 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qvqcr"] Jul 22 16:27:32.796682 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:27:32.796654 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1eca6662_01af_4c64_acdf_7fb466edb219.slice/crio-a7b3fe961d117585b661e02aa47e8c54edb2fff13535318c5bd6e18462b4a454 WatchSource:0}: Error finding container a7b3fe961d117585b661e02aa47e8c54edb2fff13535318c5bd6e18462b4a454: Status 404 returned error can't find the container with id a7b3fe961d117585b661e02aa47e8c54edb2fff13535318c5bd6e18462b4a454 Jul 22 16:27:32.798333 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:32.798318 2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 22 16:27:32.935542 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:32.935459 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qvqcr" event={"ID":"1eca6662-01af-4c64-acdf-7fb466edb219","Type":"ContainerStarted","Data":"a7b3fe961d117585b661e02aa47e8c54edb2fff13535318c5bd6e18462b4a454"} Jul 22 16:27:34.945823 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:34.945788 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qvqcr" event={"ID":"1eca6662-01af-4c64-acdf-7fb466edb219","Type":"ContainerStarted","Data":"07ae370c3b9e84f9315d54d4380b84ea859f717744a1008d436e4d5b4a3df88b"} Jul 22 16:27:34.964197 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:34.964135 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qvqcr" podStartSLOduration=1.495327252 podStartE2EDuration="2.964119067s" totalImagesPullingTime="1.468791815s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:27:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:27:34.96228276 +0000 UTC m=+307.063898359" watchObservedRunningTime="2026-07-22 16:27:34.964119067 +0000 UTC m=+307.065734642" Jul 22 16:27:39.760339 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:39.760303 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxkcnn"] Jul 22 16:27:39.763754 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:39.763735 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxkcnn" Jul 22 16:27:39.766543 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:39.766517 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 22 16:27:39.767428 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:39.767414 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 22 16:27:39.767491 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:39.767419 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-6bwdm\"" Jul 22 16:27:39.772225 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:39.772200 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxkcnn"] Jul 22 16:27:39.899512 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:39.899475 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8f72de91-26e9-4f63-964c-0b5f05a6726f-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxkcnn\" (UID: \"8f72de91-26e9-4f63-964c-0b5f05a6726f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxkcnn" Jul 22 16:27:39.899716 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:39.899520 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rtn6v\" (UniqueName: \"kubernetes.io/projected/8f72de91-26e9-4f63-964c-0b5f05a6726f-kube-api-access-rtn6v\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxkcnn\" (UID: \"8f72de91-26e9-4f63-964c-0b5f05a6726f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxkcnn" Jul 22 16:27:39.899716 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:39.899599 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8f72de91-26e9-4f63-964c-0b5f05a6726f-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxkcnn\" (UID: \"8f72de91-26e9-4f63-964c-0b5f05a6726f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxkcnn" Jul 22 16:27:40.000135 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:40.000102 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8f72de91-26e9-4f63-964c-0b5f05a6726f-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxkcnn\" (UID: \"8f72de91-26e9-4f63-964c-0b5f05a6726f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxkcnn" Jul 22 16:27:40.000303 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:40.000171 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8f72de91-26e9-4f63-964c-0b5f05a6726f-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxkcnn\" (UID: \"8f72de91-26e9-4f63-964c-0b5f05a6726f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxkcnn" Jul 22 16:27:40.000303 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:40.000202 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtn6v\" (UniqueName: \"kubernetes.io/projected/8f72de91-26e9-4f63-964c-0b5f05a6726f-kube-api-access-rtn6v\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxkcnn\" (UID: \"8f72de91-26e9-4f63-964c-0b5f05a6726f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxkcnn" Jul 22 16:27:40.000656 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:40.000635 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8f72de91-26e9-4f63-964c-0b5f05a6726f-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxkcnn\" (UID: \"8f72de91-26e9-4f63-964c-0b5f05a6726f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxkcnn" Jul 22 16:27:40.000693 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:40.000650 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8f72de91-26e9-4f63-964c-0b5f05a6726f-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxkcnn\" (UID: \"8f72de91-26e9-4f63-964c-0b5f05a6726f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxkcnn" Jul 22 16:27:40.009125 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:40.009094 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rtn6v\" (UniqueName: \"kubernetes.io/projected/8f72de91-26e9-4f63-964c-0b5f05a6726f-kube-api-access-rtn6v\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxkcnn\" (UID: \"8f72de91-26e9-4f63-964c-0b5f05a6726f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxkcnn" Jul 22 16:27:40.074150 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:40.074053 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxkcnn" Jul 22 16:27:40.205140 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:40.205114 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxkcnn"] Jul 22 16:27:40.207249 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:27:40.207226 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f72de91_26e9_4f63_964c_0b5f05a6726f.slice/crio-d6b0cddd1a3bb9607638dc773fee0dc533db801855a0a83fc8eace68d5344a42 WatchSource:0}: Error finding container d6b0cddd1a3bb9607638dc773fee0dc533db801855a0a83fc8eace68d5344a42: Status 404 returned error can't find the container with id d6b0cddd1a3bb9607638dc773fee0dc533db801855a0a83fc8eace68d5344a42 Jul 22 16:27:40.974035 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:40.973998 2568 generic.go:356] "Generic (PLEG): container finished" podID="8f72de91-26e9-4f63-964c-0b5f05a6726f" containerID="35af63d03704aa14decb802cef10d6c15a5112f4fbea4702b6bf143204323f23" exitCode=0 Jul 22 16:27:40.974433 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:40.974077 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxkcnn" event={"ID":"8f72de91-26e9-4f63-964c-0b5f05a6726f","Type":"ContainerDied","Data":"35af63d03704aa14decb802cef10d6c15a5112f4fbea4702b6bf143204323f23"} Jul 22 16:27:40.974433 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:40.974121 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxkcnn" event={"ID":"8f72de91-26e9-4f63-964c-0b5f05a6726f","Type":"ContainerStarted","Data":"d6b0cddd1a3bb9607638dc773fee0dc533db801855a0a83fc8eace68d5344a42"} Jul 22 16:27:41.979777 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:41.979741 2568 generic.go:356] "Generic (PLEG): container finished" podID="8f72de91-26e9-4f63-964c-0b5f05a6726f" containerID="2e1c739d0219254287f5586040e9a93552269e148f7ed31cefd768616c2a2b6a" exitCode=0 Jul 22 16:27:41.980211 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:41.979825 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxkcnn" event={"ID":"8f72de91-26e9-4f63-964c-0b5f05a6726f","Type":"ContainerDied","Data":"2e1c739d0219254287f5586040e9a93552269e148f7ed31cefd768616c2a2b6a"} Jul 22 16:27:42.986653 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:42.986620 2568 generic.go:356] "Generic (PLEG): container finished" podID="8f72de91-26e9-4f63-964c-0b5f05a6726f" containerID="21d36135b4754b0e30051497e281387daa2ae942e9c6114faf5b555c221e2569" exitCode=0 Jul 22 16:27:42.987037 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:42.986702 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxkcnn" event={"ID":"8f72de91-26e9-4f63-964c-0b5f05a6726f","Type":"ContainerDied","Data":"21d36135b4754b0e30051497e281387daa2ae942e9c6114faf5b555c221e2569"} Jul 22 16:27:44.120681 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:44.120650 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxkcnn" Jul 22 16:27:44.238456 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:44.238417 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rtn6v\" (UniqueName: \"kubernetes.io/projected/8f72de91-26e9-4f63-964c-0b5f05a6726f-kube-api-access-rtn6v\") pod \"8f72de91-26e9-4f63-964c-0b5f05a6726f\" (UID: \"8f72de91-26e9-4f63-964c-0b5f05a6726f\") " Jul 22 16:27:44.238619 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:44.238514 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8f72de91-26e9-4f63-964c-0b5f05a6726f-util\") pod \"8f72de91-26e9-4f63-964c-0b5f05a6726f\" (UID: \"8f72de91-26e9-4f63-964c-0b5f05a6726f\") " Jul 22 16:27:44.238619 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:44.238571 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8f72de91-26e9-4f63-964c-0b5f05a6726f-bundle\") pod \"8f72de91-26e9-4f63-964c-0b5f05a6726f\" (UID: \"8f72de91-26e9-4f63-964c-0b5f05a6726f\") " Jul 22 16:27:44.239328 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:44.239292 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f72de91-26e9-4f63-964c-0b5f05a6726f-bundle" (OuterVolumeSpecName: "bundle") pod "8f72de91-26e9-4f63-964c-0b5f05a6726f" (UID: "8f72de91-26e9-4f63-964c-0b5f05a6726f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 16:27:44.245382 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:44.245291 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f72de91-26e9-4f63-964c-0b5f05a6726f-kube-api-access-rtn6v" (OuterVolumeSpecName: "kube-api-access-rtn6v") pod "8f72de91-26e9-4f63-964c-0b5f05a6726f" (UID: "8f72de91-26e9-4f63-964c-0b5f05a6726f"). InnerVolumeSpecName "kube-api-access-rtn6v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 16:27:44.247835 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:44.247806 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f72de91-26e9-4f63-964c-0b5f05a6726f-util" (OuterVolumeSpecName: "util") pod "8f72de91-26e9-4f63-964c-0b5f05a6726f" (UID: "8f72de91-26e9-4f63-964c-0b5f05a6726f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 16:27:44.340163 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:44.340134 2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8f72de91-26e9-4f63-964c-0b5f05a6726f-util\") on node \"ip-10-0-133-47.ec2.internal\" DevicePath \"\"" Jul 22 16:27:44.340163 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:44.340158 2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8f72de91-26e9-4f63-964c-0b5f05a6726f-bundle\") on node \"ip-10-0-133-47.ec2.internal\" DevicePath \"\"" Jul 22 16:27:44.340163 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:44.340167 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rtn6v\" (UniqueName: \"kubernetes.io/projected/8f72de91-26e9-4f63-964c-0b5f05a6726f-kube-api-access-rtn6v\") on node \"ip-10-0-133-47.ec2.internal\" DevicePath \"\"" Jul 22 16:27:44.997299 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:44.997262 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxkcnn" event={"ID":"8f72de91-26e9-4f63-964c-0b5f05a6726f","Type":"ContainerDied","Data":"d6b0cddd1a3bb9607638dc773fee0dc533db801855a0a83fc8eace68d5344a42"} Jul 22 16:27:44.997299 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:44.997287 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxkcnn" Jul 22 16:27:44.997530 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:44.997309 2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d6b0cddd1a3bb9607638dc773fee0dc533db801855a0a83fc8eace68d5344a42" Jul 22 16:27:53.481401 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:53.481359 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-9b566c8c6-l8x88"] Jul 22 16:27:53.481913 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:53.481722 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f72de91-26e9-4f63-964c-0b5f05a6726f" containerName="pull" Jul 22 16:27:53.481913 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:53.481736 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f72de91-26e9-4f63-964c-0b5f05a6726f" containerName="pull" Jul 22 16:27:53.481913 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:53.481756 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f72de91-26e9-4f63-964c-0b5f05a6726f" containerName="extract" Jul 22 16:27:53.481913 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:53.481761 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f72de91-26e9-4f63-964c-0b5f05a6726f" containerName="extract" Jul 22 16:27:53.481913 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:53.481774 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f72de91-26e9-4f63-964c-0b5f05a6726f" containerName="util" Jul 22 16:27:53.481913 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:53.481779 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f72de91-26e9-4f63-964c-0b5f05a6726f" containerName="util" Jul 22 16:27:53.481913 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:53.481829 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f72de91-26e9-4f63-964c-0b5f05a6726f" containerName="extract" Jul 22 16:27:53.486369 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:53.486324 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-9b566c8c6-l8x88" Jul 22 16:27:53.489173 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:53.489147 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 22 16:27:53.489310 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:53.489231 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-pf667\"" Jul 22 16:27:53.489385 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:53.489366 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 22 16:27:53.489518 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:53.489499 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 22 16:27:53.489699 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:53.489684 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 22 16:27:53.509096 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:53.509065 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-9b566c8c6-l8x88"] Jul 22 16:27:53.513593 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:53.513563 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8a1f1d5a-dceb-4e26-a019-8add8aeac28d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-9b566c8c6-l8x88\" (UID: \"8a1f1d5a-dceb-4e26-a019-8add8aeac28d\") " pod="opendatahub/opendatahub-operator-controller-manager-9b566c8c6-l8x88" Jul 22 16:27:53.513751 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:53.513626 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8a1f1d5a-dceb-4e26-a019-8add8aeac28d-manifests\") pod \"opendatahub-operator-controller-manager-9b566c8c6-l8x88\" (UID: \"8a1f1d5a-dceb-4e26-a019-8add8aeac28d\") " pod="opendatahub/opendatahub-operator-controller-manager-9b566c8c6-l8x88" Jul 22 16:27:53.513751 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:53.513658 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d52k5\" (UniqueName: \"kubernetes.io/projected/8a1f1d5a-dceb-4e26-a019-8add8aeac28d-kube-api-access-d52k5\") pod \"opendatahub-operator-controller-manager-9b566c8c6-l8x88\" (UID: \"8a1f1d5a-dceb-4e26-a019-8add8aeac28d\") " pod="opendatahub/opendatahub-operator-controller-manager-9b566c8c6-l8x88" Jul 22 16:27:53.513849 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:53.513757 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8a1f1d5a-dceb-4e26-a019-8add8aeac28d-webhook-cert\") pod \"opendatahub-operator-controller-manager-9b566c8c6-l8x88\" (UID: \"8a1f1d5a-dceb-4e26-a019-8add8aeac28d\") " pod="opendatahub/opendatahub-operator-controller-manager-9b566c8c6-l8x88" Jul 22 16:27:53.513849 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:53.513799 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8a1f1d5a-dceb-4e26-a019-8add8aeac28d-tmp\") pod \"opendatahub-operator-controller-manager-9b566c8c6-l8x88\" (UID: \"8a1f1d5a-dceb-4e26-a019-8add8aeac28d\") " pod="opendatahub/opendatahub-operator-controller-manager-9b566c8c6-l8x88" Jul 22 16:27:53.614339 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:53.614300 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8a1f1d5a-dceb-4e26-a019-8add8aeac28d-webhook-cert\") pod \"opendatahub-operator-controller-manager-9b566c8c6-l8x88\" (UID: \"8a1f1d5a-dceb-4e26-a019-8add8aeac28d\") " pod="opendatahub/opendatahub-operator-controller-manager-9b566c8c6-l8x88" Jul 22 16:27:53.614339 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:53.614368 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8a1f1d5a-dceb-4e26-a019-8add8aeac28d-tmp\") pod \"opendatahub-operator-controller-manager-9b566c8c6-l8x88\" (UID: \"8a1f1d5a-dceb-4e26-a019-8add8aeac28d\") " pod="opendatahub/opendatahub-operator-controller-manager-9b566c8c6-l8x88" Jul 22 16:27:53.614635 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:53.614410 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8a1f1d5a-dceb-4e26-a019-8add8aeac28d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-9b566c8c6-l8x88\" (UID: \"8a1f1d5a-dceb-4e26-a019-8add8aeac28d\") " pod="opendatahub/opendatahub-operator-controller-manager-9b566c8c6-l8x88" Jul 22 16:27:53.614635 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:53.614451 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8a1f1d5a-dceb-4e26-a019-8add8aeac28d-manifests\") pod \"opendatahub-operator-controller-manager-9b566c8c6-l8x88\" (UID: \"8a1f1d5a-dceb-4e26-a019-8add8aeac28d\") " pod="opendatahub/opendatahub-operator-controller-manager-9b566c8c6-l8x88" Jul 22 16:27:53.614635 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:53.614529 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d52k5\" (UniqueName: \"kubernetes.io/projected/8a1f1d5a-dceb-4e26-a019-8add8aeac28d-kube-api-access-d52k5\") pod \"opendatahub-operator-controller-manager-9b566c8c6-l8x88\" (UID: \"8a1f1d5a-dceb-4e26-a019-8add8aeac28d\") " pod="opendatahub/opendatahub-operator-controller-manager-9b566c8c6-l8x88" Jul 22 16:27:53.614851 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:53.614827 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8a1f1d5a-dceb-4e26-a019-8add8aeac28d-manifests\") pod \"opendatahub-operator-controller-manager-9b566c8c6-l8x88\" (UID: \"8a1f1d5a-dceb-4e26-a019-8add8aeac28d\") " pod="opendatahub/opendatahub-operator-controller-manager-9b566c8c6-l8x88" Jul 22 16:27:53.616811 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:53.616777 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8a1f1d5a-dceb-4e26-a019-8add8aeac28d-tmp\") pod \"opendatahub-operator-controller-manager-9b566c8c6-l8x88\" (UID: \"8a1f1d5a-dceb-4e26-a019-8add8aeac28d\") " pod="opendatahub/opendatahub-operator-controller-manager-9b566c8c6-l8x88" Jul 22 16:27:53.616986 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:53.616965 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8a1f1d5a-dceb-4e26-a019-8add8aeac28d-webhook-cert\") pod \"opendatahub-operator-controller-manager-9b566c8c6-l8x88\" (UID: \"8a1f1d5a-dceb-4e26-a019-8add8aeac28d\") " pod="opendatahub/opendatahub-operator-controller-manager-9b566c8c6-l8x88" Jul 22 16:27:53.617048 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:53.617002 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8a1f1d5a-dceb-4e26-a019-8add8aeac28d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-9b566c8c6-l8x88\" (UID: \"8a1f1d5a-dceb-4e26-a019-8add8aeac28d\") " pod="opendatahub/opendatahub-operator-controller-manager-9b566c8c6-l8x88" Jul 22 16:27:53.623185 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:53.623163 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d52k5\" (UniqueName: \"kubernetes.io/projected/8a1f1d5a-dceb-4e26-a019-8add8aeac28d-kube-api-access-d52k5\") pod \"opendatahub-operator-controller-manager-9b566c8c6-l8x88\" (UID: \"8a1f1d5a-dceb-4e26-a019-8add8aeac28d\") " pod="opendatahub/opendatahub-operator-controller-manager-9b566c8c6-l8x88" Jul 22 16:27:53.796575 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:53.796473 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-9b566c8c6-l8x88" Jul 22 16:27:53.962423 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:53.962142 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-9b566c8c6-l8x88"] Jul 22 16:27:53.965081 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:27:53.965049 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a1f1d5a_dceb_4e26_a019_8add8aeac28d.slice/crio-7dc82e193389e99d8a3ab642ae1497f0d66f2af69ced2e4256c114008b055eaf WatchSource:0}: Error finding container 7dc82e193389e99d8a3ab642ae1497f0d66f2af69ced2e4256c114008b055eaf: Status 404 returned error can't find the container with id 7dc82e193389e99d8a3ab642ae1497f0d66f2af69ced2e4256c114008b055eaf Jul 22 16:27:54.041090 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:54.041051 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9b566c8c6-l8x88" event={"ID":"8a1f1d5a-dceb-4e26-a019-8add8aeac28d","Type":"ContainerStarted","Data":"7dc82e193389e99d8a3ab642ae1497f0d66f2af69ced2e4256c114008b055eaf"} Jul 22 16:27:57.058270 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:57.058183 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9b566c8c6-l8x88" event={"ID":"8a1f1d5a-dceb-4e26-a019-8add8aeac28d","Type":"ContainerStarted","Data":"3c1d72bca0222ae841e63a1180a3fc7e8ec144757f646036cbc87e82f85ef443"} Jul 22 16:27:58.064156 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:58.064116 2568 generic.go:356] "Generic (PLEG): container finished" podID="8a1f1d5a-dceb-4e26-a019-8add8aeac28d" containerID="3c1d72bca0222ae841e63a1180a3fc7e8ec144757f646036cbc87e82f85ef443" exitCode=0 Jul 22 16:27:58.064655 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:58.064179 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9b566c8c6-l8x88" event={"ID":"8a1f1d5a-dceb-4e26-a019-8add8aeac28d","Type":"ContainerDied","Data":"3c1d72bca0222ae841e63a1180a3fc7e8ec144757f646036cbc87e82f85ef443"} Jul 22 16:27:59.071552 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:59.071513 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9b566c8c6-l8x88" event={"ID":"8a1f1d5a-dceb-4e26-a019-8add8aeac28d","Type":"ContainerStarted","Data":"f9dcc3a027bdf72b006239a71aa6332876988dcabab8c62ca94a5d82fb0ca7de"} Jul 22 16:27:59.071924 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:59.071654 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-9b566c8c6-l8x88" Jul 22 16:27:59.097506 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:27:59.097454 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-9b566c8c6-l8x88" podStartSLOduration=1.748496748 podStartE2EDuration="6.097435952s" totalImagesPullingTime="3.26768726s" totalInitContainerRuntime="1.081251944s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:27:53 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:27:59.095750134 +0000 UTC m=+331.197365725" watchObservedRunningTime="2026-07-22 16:27:59.097435952 +0000 UTC m=+331.199051528" Jul 22 16:28:10.079478 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:10.079446 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-9b566c8c6-l8x88" Jul 22 16:28:13.103200 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:13.103165 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6d7df686d9-c4mq7"] Jul 22 16:28:13.112535 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:13.112508 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6d7df686d9-c4mq7" Jul 22 16:28:13.117969 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:13.117946 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 22 16:28:13.118532 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:13.118505 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-4hpl6\"" Jul 22 16:28:13.118619 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:13.118540 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 22 16:28:13.167465 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:13.167434 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ffrdc\" (UniqueName: \"kubernetes.io/projected/d0b5e0f7-623d-4a3e-a536-43bc6b1408a8-kube-api-access-ffrdc\") pod \"kube-auth-proxy-6d7df686d9-c4mq7\" (UID: \"d0b5e0f7-623d-4a3e-a536-43bc6b1408a8\") " pod="openshift-ingress/kube-auth-proxy-6d7df686d9-c4mq7" Jul 22 16:28:13.167661 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:13.167489 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d0b5e0f7-623d-4a3e-a536-43bc6b1408a8-tls-certs\") pod \"kube-auth-proxy-6d7df686d9-c4mq7\" (UID: \"d0b5e0f7-623d-4a3e-a536-43bc6b1408a8\") " pod="openshift-ingress/kube-auth-proxy-6d7df686d9-c4mq7" Jul 22 16:28:13.167661 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:13.167552 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d0b5e0f7-623d-4a3e-a536-43bc6b1408a8-tmp\") pod \"kube-auth-proxy-6d7df686d9-c4mq7\" (UID: \"d0b5e0f7-623d-4a3e-a536-43bc6b1408a8\") " pod="openshift-ingress/kube-auth-proxy-6d7df686d9-c4mq7" Jul 22 16:28:13.177985 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:13.177952 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6d7df686d9-c4mq7"] Jul 22 16:28:13.268845 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:13.268800 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d0b5e0f7-623d-4a3e-a536-43bc6b1408a8-tmp\") pod \"kube-auth-proxy-6d7df686d9-c4mq7\" (UID: \"d0b5e0f7-623d-4a3e-a536-43bc6b1408a8\") " pod="openshift-ingress/kube-auth-proxy-6d7df686d9-c4mq7" Jul 22 16:28:13.269004 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:13.268874 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ffrdc\" (UniqueName: \"kubernetes.io/projected/d0b5e0f7-623d-4a3e-a536-43bc6b1408a8-kube-api-access-ffrdc\") pod \"kube-auth-proxy-6d7df686d9-c4mq7\" (UID: \"d0b5e0f7-623d-4a3e-a536-43bc6b1408a8\") " pod="openshift-ingress/kube-auth-proxy-6d7df686d9-c4mq7" Jul 22 16:28:13.269004 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:13.268922 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d0b5e0f7-623d-4a3e-a536-43bc6b1408a8-tls-certs\") pod \"kube-auth-proxy-6d7df686d9-c4mq7\" (UID: \"d0b5e0f7-623d-4a3e-a536-43bc6b1408a8\") " pod="openshift-ingress/kube-auth-proxy-6d7df686d9-c4mq7" Jul 22 16:28:13.271699 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:13.271674 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d0b5e0f7-623d-4a3e-a536-43bc6b1408a8-tmp\") pod \"kube-auth-proxy-6d7df686d9-c4mq7\" (UID: \"d0b5e0f7-623d-4a3e-a536-43bc6b1408a8\") " pod="openshift-ingress/kube-auth-proxy-6d7df686d9-c4mq7" Jul 22 16:28:13.271994 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:13.271973 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d0b5e0f7-623d-4a3e-a536-43bc6b1408a8-tls-certs\") pod \"kube-auth-proxy-6d7df686d9-c4mq7\" (UID: \"d0b5e0f7-623d-4a3e-a536-43bc6b1408a8\") " pod="openshift-ingress/kube-auth-proxy-6d7df686d9-c4mq7" Jul 22 16:28:13.280871 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:13.280842 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ffrdc\" (UniqueName: \"kubernetes.io/projected/d0b5e0f7-623d-4a3e-a536-43bc6b1408a8-kube-api-access-ffrdc\") pod \"kube-auth-proxy-6d7df686d9-c4mq7\" (UID: \"d0b5e0f7-623d-4a3e-a536-43bc6b1408a8\") " pod="openshift-ingress/kube-auth-proxy-6d7df686d9-c4mq7" Jul 22 16:28:13.348565 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:13.348526 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-j9j8t"] Jul 22 16:28:13.352285 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:13.352267 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-j9j8t" Jul 22 16:28:13.355087 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:13.355036 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jul 22 16:28:13.355313 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:13.355295 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-2r8kk\"" Jul 22 16:28:13.371316 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:13.371283 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-j9j8t"] Jul 22 16:28:13.422934 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:13.422903 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6d7df686d9-c4mq7" Jul 22 16:28:13.470647 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:13.470613 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9578018a-266d-45a6-82e1-1d5596fedd92-cert\") pod \"odh-model-controller-7998c67dc4-j9j8t\" (UID: \"9578018a-266d-45a6-82e1-1d5596fedd92\") " pod="opendatahub/odh-model-controller-7998c67dc4-j9j8t" Jul 22 16:28:13.470819 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:13.470656 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjd95\" (UniqueName: \"kubernetes.io/projected/9578018a-266d-45a6-82e1-1d5596fedd92-kube-api-access-vjd95\") pod \"odh-model-controller-7998c67dc4-j9j8t\" (UID: \"9578018a-266d-45a6-82e1-1d5596fedd92\") " pod="opendatahub/odh-model-controller-7998c67dc4-j9j8t" Jul 22 16:28:13.571269 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:13.571219 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9578018a-266d-45a6-82e1-1d5596fedd92-cert\") pod \"odh-model-controller-7998c67dc4-j9j8t\" (UID: \"9578018a-266d-45a6-82e1-1d5596fedd92\") " pod="opendatahub/odh-model-controller-7998c67dc4-j9j8t" Jul 22 16:28:13.571269 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:13.571264 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjd95\" (UniqueName: \"kubernetes.io/projected/9578018a-266d-45a6-82e1-1d5596fedd92-kube-api-access-vjd95\") pod \"odh-model-controller-7998c67dc4-j9j8t\" (UID: \"9578018a-266d-45a6-82e1-1d5596fedd92\") " pod="opendatahub/odh-model-controller-7998c67dc4-j9j8t" Jul 22 16:28:13.573835 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:13.573807 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9578018a-266d-45a6-82e1-1d5596fedd92-cert\") pod \"odh-model-controller-7998c67dc4-j9j8t\" (UID: \"9578018a-266d-45a6-82e1-1d5596fedd92\") " pod="opendatahub/odh-model-controller-7998c67dc4-j9j8t" Jul 22 16:28:13.585236 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:13.585212 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6d7df686d9-c4mq7"] Jul 22 16:28:13.588055 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:28:13.588025 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0b5e0f7_623d_4a3e_a536_43bc6b1408a8.slice/crio-d0afcf516081005b5975ef8cbe891c28ea2ccaa35cffbc7efcec3004cd4c9f91 WatchSource:0}: Error finding container d0afcf516081005b5975ef8cbe891c28ea2ccaa35cffbc7efcec3004cd4c9f91: Status 404 returned error can't find the container with id d0afcf516081005b5975ef8cbe891c28ea2ccaa35cffbc7efcec3004cd4c9f91 Jul 22 16:28:13.588622 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:13.588603 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjd95\" (UniqueName: \"kubernetes.io/projected/9578018a-266d-45a6-82e1-1d5596fedd92-kube-api-access-vjd95\") pod \"odh-model-controller-7998c67dc4-j9j8t\" (UID: \"9578018a-266d-45a6-82e1-1d5596fedd92\") " pod="opendatahub/odh-model-controller-7998c67dc4-j9j8t" Jul 22 16:28:13.662816 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:13.662717 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-j9j8t" Jul 22 16:28:13.811309 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:13.811281 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-j9j8t"] Jul 22 16:28:13.812976 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:28:13.812949 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9578018a_266d_45a6_82e1_1d5596fedd92.slice/crio-aa3d1243b0932ffab08cb90f2bfcd07db37ab0e4fb24890f7adcc4394c2a0179 WatchSource:0}: Error finding container aa3d1243b0932ffab08cb90f2bfcd07db37ab0e4fb24890f7adcc4394c2a0179: Status 404 returned error can't find the container with id aa3d1243b0932ffab08cb90f2bfcd07db37ab0e4fb24890f7adcc4394c2a0179 Jul 22 16:28:14.148655 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:14.148520 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-j9j8t" event={"ID":"9578018a-266d-45a6-82e1-1d5596fedd92","Type":"ContainerStarted","Data":"aa3d1243b0932ffab08cb90f2bfcd07db37ab0e4fb24890f7adcc4394c2a0179"} Jul 22 16:28:14.150642 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:14.150592 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6d7df686d9-c4mq7" event={"ID":"d0b5e0f7-623d-4a3e-a536-43bc6b1408a8","Type":"ContainerStarted","Data":"d0afcf516081005b5975ef8cbe891c28ea2ccaa35cffbc7efcec3004cd4c9f91"} Jul 22 16:28:14.220784 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:14.220719 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-pqr2k"] Jul 22 16:28:14.224757 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:14.224731 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-pqr2k" Jul 22 16:28:14.231042 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:14.230880 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jul 22 16:28:14.231179 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:14.231131 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-mvfcd\"" Jul 22 16:28:14.250424 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:14.250394 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-pqr2k"] Jul 22 16:28:14.287839 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:14.287798 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xclzt\" (UniqueName: \"kubernetes.io/projected/92d843b6-a1c9-4669-8735-fe7e1c413996-kube-api-access-xclzt\") pod \"model-serving-api-54d89bd5fc-pqr2k\" (UID: \"92d843b6-a1c9-4669-8735-fe7e1c413996\") " pod="opendatahub/model-serving-api-54d89bd5fc-pqr2k" Jul 22 16:28:14.288152 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:14.287936 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/92d843b6-a1c9-4669-8735-fe7e1c413996-tls-certs\") pod \"model-serving-api-54d89bd5fc-pqr2k\" (UID: \"92d843b6-a1c9-4669-8735-fe7e1c413996\") " pod="opendatahub/model-serving-api-54d89bd5fc-pqr2k" Jul 22 16:28:14.388908 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:14.388824 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xclzt\" (UniqueName: \"kubernetes.io/projected/92d843b6-a1c9-4669-8735-fe7e1c413996-kube-api-access-xclzt\") pod \"model-serving-api-54d89bd5fc-pqr2k\" (UID: \"92d843b6-a1c9-4669-8735-fe7e1c413996\") " pod="opendatahub/model-serving-api-54d89bd5fc-pqr2k" Jul 22 16:28:14.389100 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:14.388952 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/92d843b6-a1c9-4669-8735-fe7e1c413996-tls-certs\") pod \"model-serving-api-54d89bd5fc-pqr2k\" (UID: \"92d843b6-a1c9-4669-8735-fe7e1c413996\") " pod="opendatahub/model-serving-api-54d89bd5fc-pqr2k" Jul 22 16:28:14.389163 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:28:14.389104 2568 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Jul 22 16:28:14.389224 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:28:14.389178 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92d843b6-a1c9-4669-8735-fe7e1c413996-tls-certs podName:92d843b6-a1c9-4669-8735-fe7e1c413996 nodeName:}" failed. No retries permitted until 2026-07-22 16:28:14.889155649 +0000 UTC m=+346.990771208 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/92d843b6-a1c9-4669-8735-fe7e1c413996-tls-certs") pod "model-serving-api-54d89bd5fc-pqr2k" (UID: "92d843b6-a1c9-4669-8735-fe7e1c413996") : secret "model-serving-api-tls" not found Jul 22 16:28:14.417065 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:14.416988 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xclzt\" (UniqueName: \"kubernetes.io/projected/92d843b6-a1c9-4669-8735-fe7e1c413996-kube-api-access-xclzt\") pod \"model-serving-api-54d89bd5fc-pqr2k\" (UID: \"92d843b6-a1c9-4669-8735-fe7e1c413996\") " pod="opendatahub/model-serving-api-54d89bd5fc-pqr2k" Jul 22 16:28:14.764679 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:14.763955 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-rg5v8"] Jul 22 16:28:14.769298 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:14.768097 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-rg5v8" Jul 22 16:28:14.771457 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:14.771429 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 22 16:28:14.772437 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:14.771681 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-mjcn6\"" Jul 22 16:28:14.772437 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:14.771860 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 22 16:28:14.772437 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:14.772028 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 22 16:28:14.772437 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:14.772246 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 22 16:28:14.790054 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:14.790016 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-rg5v8"] Jul 22 16:28:14.902141 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:14.901422 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0df632ce-9f15-418b-beb6-01f0571f0405-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-rg5v8\" (UID: \"0df632ce-9f15-418b-beb6-01f0571f0405\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-rg5v8" Jul 22 16:28:14.902141 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:14.901476 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0df632ce-9f15-418b-beb6-01f0571f0405-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-rg5v8\" (UID: \"0df632ce-9f15-418b-beb6-01f0571f0405\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-rg5v8" Jul 22 16:28:14.902141 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:14.901561 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0df632ce-9f15-418b-beb6-01f0571f0405-istio-token\") pod \"istiod-openshift-gateway-7574459656-rg5v8\" (UID: \"0df632ce-9f15-418b-beb6-01f0571f0405\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-rg5v8" Jul 22 16:28:14.902141 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:14.901593 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0df632ce-9f15-418b-beb6-01f0571f0405-local-certs\") pod \"istiod-openshift-gateway-7574459656-rg5v8\" (UID: \"0df632ce-9f15-418b-beb6-01f0571f0405\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-rg5v8" Jul 22 16:28:14.902141 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:14.901628 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0df632ce-9f15-418b-beb6-01f0571f0405-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-rg5v8\" (UID: \"0df632ce-9f15-418b-beb6-01f0571f0405\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-rg5v8" Jul 22 16:28:14.902141 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:14.901672 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/92d843b6-a1c9-4669-8735-fe7e1c413996-tls-certs\") pod \"model-serving-api-54d89bd5fc-pqr2k\" (UID: \"92d843b6-a1c9-4669-8735-fe7e1c413996\") " pod="opendatahub/model-serving-api-54d89bd5fc-pqr2k" Jul 22 16:28:14.902141 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:14.901696 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qmgj7\" (UniqueName: \"kubernetes.io/projected/0df632ce-9f15-418b-beb6-01f0571f0405-kube-api-access-qmgj7\") pod \"istiod-openshift-gateway-7574459656-rg5v8\" (UID: \"0df632ce-9f15-418b-beb6-01f0571f0405\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-rg5v8" Jul 22 16:28:14.902141 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:14.901747 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0df632ce-9f15-418b-beb6-01f0571f0405-cacerts\") pod \"istiod-openshift-gateway-7574459656-rg5v8\" (UID: \"0df632ce-9f15-418b-beb6-01f0571f0405\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-rg5v8" Jul 22 16:28:14.907262 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:14.907227 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/92d843b6-a1c9-4669-8735-fe7e1c413996-tls-certs\") pod \"model-serving-api-54d89bd5fc-pqr2k\" (UID: \"92d843b6-a1c9-4669-8735-fe7e1c413996\") " pod="opendatahub/model-serving-api-54d89bd5fc-pqr2k" Jul 22 16:28:15.003129 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:15.003089 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0df632ce-9f15-418b-beb6-01f0571f0405-istio-token\") pod \"istiod-openshift-gateway-7574459656-rg5v8\" (UID: \"0df632ce-9f15-418b-beb6-01f0571f0405\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-rg5v8" Jul 22 16:28:15.003322 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:15.003140 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0df632ce-9f15-418b-beb6-01f0571f0405-local-certs\") pod \"istiod-openshift-gateway-7574459656-rg5v8\" (UID: \"0df632ce-9f15-418b-beb6-01f0571f0405\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-rg5v8" Jul 22 16:28:15.003322 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:15.003172 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0df632ce-9f15-418b-beb6-01f0571f0405-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-rg5v8\" (UID: \"0df632ce-9f15-418b-beb6-01f0571f0405\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-rg5v8" Jul 22 16:28:15.003322 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:15.003198 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qmgj7\" (UniqueName: \"kubernetes.io/projected/0df632ce-9f15-418b-beb6-01f0571f0405-kube-api-access-qmgj7\") pod \"istiod-openshift-gateway-7574459656-rg5v8\" (UID: \"0df632ce-9f15-418b-beb6-01f0571f0405\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-rg5v8" Jul 22 16:28:15.003322 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:15.003243 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0df632ce-9f15-418b-beb6-01f0571f0405-cacerts\") pod \"istiod-openshift-gateway-7574459656-rg5v8\" (UID: \"0df632ce-9f15-418b-beb6-01f0571f0405\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-rg5v8" Jul 22 16:28:15.003322 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:15.003289 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0df632ce-9f15-418b-beb6-01f0571f0405-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-rg5v8\" (UID: \"0df632ce-9f15-418b-beb6-01f0571f0405\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-rg5v8" Jul 22 16:28:15.003322 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:15.003313 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0df632ce-9f15-418b-beb6-01f0571f0405-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-rg5v8\" (UID: \"0df632ce-9f15-418b-beb6-01f0571f0405\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-rg5v8" Jul 22 16:28:15.005467 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:15.005436 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0df632ce-9f15-418b-beb6-01f0571f0405-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-rg5v8\" (UID: \"0df632ce-9f15-418b-beb6-01f0571f0405\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-rg5v8" Jul 22 16:28:15.007423 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:15.007341 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0df632ce-9f15-418b-beb6-01f0571f0405-local-certs\") pod \"istiod-openshift-gateway-7574459656-rg5v8\" (UID: \"0df632ce-9f15-418b-beb6-01f0571f0405\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-rg5v8" Jul 22 16:28:15.009041 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:15.009003 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0df632ce-9f15-418b-beb6-01f0571f0405-cacerts\") pod \"istiod-openshift-gateway-7574459656-rg5v8\" (UID: \"0df632ce-9f15-418b-beb6-01f0571f0405\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-rg5v8" Jul 22 16:28:15.009233 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:15.009205 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0df632ce-9f15-418b-beb6-01f0571f0405-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-rg5v8\" (UID: \"0df632ce-9f15-418b-beb6-01f0571f0405\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-rg5v8" Jul 22 16:28:15.009414 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:15.009394 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0df632ce-9f15-418b-beb6-01f0571f0405-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-rg5v8\" (UID: \"0df632ce-9f15-418b-beb6-01f0571f0405\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-rg5v8" Jul 22 16:28:15.026231 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:15.026157 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0df632ce-9f15-418b-beb6-01f0571f0405-istio-token\") pod \"istiod-openshift-gateway-7574459656-rg5v8\" (UID: \"0df632ce-9f15-418b-beb6-01f0571f0405\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-rg5v8" Jul 22 16:28:15.027780 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:15.027751 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qmgj7\" (UniqueName: \"kubernetes.io/projected/0df632ce-9f15-418b-beb6-01f0571f0405-kube-api-access-qmgj7\") pod \"istiod-openshift-gateway-7574459656-rg5v8\" (UID: \"0df632ce-9f15-418b-beb6-01f0571f0405\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-rg5v8" Jul 22 16:28:15.081726 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:15.081680 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-rg5v8" Jul 22 16:28:15.140252 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:15.140206 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-pqr2k" Jul 22 16:28:15.290711 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:15.290598 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-rg5v8"] Jul 22 16:28:15.362092 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:15.362064 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-pqr2k"] Jul 22 16:28:16.010230 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:28:16.010196 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92d843b6_a1c9_4669_8735_fe7e1c413996.slice/crio-184b2be714f9b5f0b2d21381c1c85a3fc62467ba00d6018cf6029939c2d176de WatchSource:0}: Error finding container 184b2be714f9b5f0b2d21381c1c85a3fc62467ba00d6018cf6029939c2d176de: Status 404 returned error can't find the container with id 184b2be714f9b5f0b2d21381c1c85a3fc62467ba00d6018cf6029939c2d176de Jul 22 16:28:16.166755 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:16.166709 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-pqr2k" event={"ID":"92d843b6-a1c9-4669-8735-fe7e1c413996","Type":"ContainerStarted","Data":"184b2be714f9b5f0b2d21381c1c85a3fc62467ba00d6018cf6029939c2d176de"} Jul 22 16:28:17.231554 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:28:17.231519 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0df632ce_9f15_418b_beb6_01f0571f0405.slice/crio-73e3befac086edc9a75be39871b69fa4c1a6c03b072deb833d94022567a7b689 WatchSource:0}: Error finding container 73e3befac086edc9a75be39871b69fa4c1a6c03b072deb833d94022567a7b689: Status 404 returned error can't find the container with id 73e3befac086edc9a75be39871b69fa4c1a6c03b072deb833d94022567a7b689 Jul 22 16:28:18.182656 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:18.182612 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-j9j8t" event={"ID":"9578018a-266d-45a6-82e1-1d5596fedd92","Type":"ContainerStarted","Data":"10e441d1d53ddc2db281895a2a630d0a29bb640ad9c90d63297bba71a57897df"} Jul 22 16:28:18.182836 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:18.182730 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-j9j8t" Jul 22 16:28:18.186092 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:18.185475 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6d7df686d9-c4mq7" event={"ID":"d0b5e0f7-623d-4a3e-a536-43bc6b1408a8","Type":"ContainerStarted","Data":"0c5edecfc7b146b52c3d7864a39a1950ef71b82eeb11d36fee8b677ecd2f0e1e"} Jul 22 16:28:18.188993 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:18.188962 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-rg5v8" event={"ID":"0df632ce-9f15-418b-beb6-01f0571f0405","Type":"ContainerStarted","Data":"73e3befac086edc9a75be39871b69fa4c1a6c03b072deb833d94022567a7b689"} Jul 22 16:28:18.208112 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:18.208052 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-j9j8t" podStartSLOduration=1.71496177 podStartE2EDuration="5.208036102s" totalImagesPullingTime="3.493074332s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:28:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:28:18.205401287 +0000 UTC m=+350.307016877" watchObservedRunningTime="2026-07-22 16:28:18.208036102 +0000 UTC m=+350.309651656" Jul 22 16:28:18.227979 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:18.227925 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6d7df686d9-c4mq7" podStartSLOduration=1.516462029 podStartE2EDuration="5.22790334s" totalImagesPullingTime="3.711441311s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:28:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:28:18.225371212 +0000 UTC m=+350.326986791" watchObservedRunningTime="2026-07-22 16:28:18.22790334 +0000 UTC m=+350.329518917" Jul 22 16:28:19.196761 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:19.196669 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-pqr2k" event={"ID":"92d843b6-a1c9-4669-8735-fe7e1c413996","Type":"ContainerStarted","Data":"2fdb9fa6ff28eed9a1e02b6d06b606ac3fb771ec5debd1768b185621aa74ac88"} Jul 22 16:28:19.197202 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:19.197130 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-pqr2k" Jul 22 16:28:19.234492 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:19.234433 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-pqr2k" podStartSLOduration=2.5104838320000002 podStartE2EDuration="5.23441368s" totalImagesPullingTime="2.723929848s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:28:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:28:19.230088321 +0000 UTC m=+351.331703897" watchObservedRunningTime="2026-07-22 16:28:19.23441368 +0000 UTC m=+351.336029259" Jul 22 16:28:19.733321 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:19.733283 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 16:28:19.733427 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:19.733379 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 16:28:20.203942 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:20.203818 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-rg5v8" event={"ID":"0df632ce-9f15-418b-beb6-01f0571f0405","Type":"ContainerStarted","Data":"56b7f505f839aa386a1334d06ef949fc9bb8a1d6e88ad4e1b1a7ff5d723129aa"} Jul 22 16:28:20.204358 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:20.204082 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-rg5v8" Jul 22 16:28:20.205668 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:20.205627 2568 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-rg5v8 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 22 16:28:20.205790 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:20.205690 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-rg5v8" podUID="0df632ce-9f15-418b-beb6-01f0571f0405" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 22 16:28:20.232724 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:20.232673 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-rg5v8" podStartSLOduration=3.79078994 podStartE2EDuration="6.232658954s" totalImagesPullingTime="2.441869014s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:28:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:28:20.231278162 +0000 UTC m=+352.332893738" watchObservedRunningTime="2026-07-22 16:28:20.232658954 +0000 UTC m=+352.334274529" Jul 22 16:28:21.210578 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:21.210549 2568 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-rg5v8 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 22 16:28:21.211016 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:21.210599 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-rg5v8" podUID="0df632ce-9f15-418b-beb6-01f0571f0405" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 22 16:28:24.211408 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:24.211377 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-rg5v8" Jul 22 16:28:25.446772 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:25.446739 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-bffnb"] Jul 22 16:28:25.450205 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:25.450185 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-bffnb" Jul 22 16:28:25.453278 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:25.453256 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-tmhzv\"" Jul 22 16:28:25.453525 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:25.453509 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jul 22 16:28:25.465223 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:25.465201 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-f24q7"] Jul 22 16:28:25.468641 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:25.468621 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-f24q7" Jul 22 16:28:25.471665 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:25.471642 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-bffnb"] Jul 22 16:28:25.472677 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:25.472657 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-2csj8\"" Jul 22 16:28:25.473968 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:25.473943 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jul 22 16:28:25.491178 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:25.491142 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-f24q7"] Jul 22 16:28:25.610920 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:25.610874 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w88bh\" (UniqueName: \"kubernetes.io/projected/97c084d7-ae84-450a-a13d-4ccfebd6703f-kube-api-access-w88bh\") pod \"llmisvc-controller-manager-777c6bd7d5-f24q7\" (UID: \"97c084d7-ae84-450a-a13d-4ccfebd6703f\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-f24q7" Jul 22 16:28:25.611092 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:25.610940 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/97c084d7-ae84-450a-a13d-4ccfebd6703f-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-f24q7\" (UID: \"97c084d7-ae84-450a-a13d-4ccfebd6703f\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-f24q7" Jul 22 16:28:25.611092 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:25.610988 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9ed4ef31-1079-41d0-beb1-2951df187ab0-cert\") pod \"kserve-controller-manager-d6f4b65b8-bffnb\" (UID: \"9ed4ef31-1079-41d0-beb1-2951df187ab0\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-bffnb" Jul 22 16:28:25.611166 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:25.611116 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4s28\" (UniqueName: \"kubernetes.io/projected/9ed4ef31-1079-41d0-beb1-2951df187ab0-kube-api-access-m4s28\") pod \"kserve-controller-manager-d6f4b65b8-bffnb\" (UID: \"9ed4ef31-1079-41d0-beb1-2951df187ab0\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-bffnb" Jul 22 16:28:25.712113 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:25.712040 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m4s28\" (UniqueName: \"kubernetes.io/projected/9ed4ef31-1079-41d0-beb1-2951df187ab0-kube-api-access-m4s28\") pod \"kserve-controller-manager-d6f4b65b8-bffnb\" (UID: \"9ed4ef31-1079-41d0-beb1-2951df187ab0\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-bffnb" Jul 22 16:28:25.712113 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:25.712085 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w88bh\" (UniqueName: \"kubernetes.io/projected/97c084d7-ae84-450a-a13d-4ccfebd6703f-kube-api-access-w88bh\") pod \"llmisvc-controller-manager-777c6bd7d5-f24q7\" (UID: \"97c084d7-ae84-450a-a13d-4ccfebd6703f\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-f24q7" Jul 22 16:28:25.712316 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:25.712122 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/97c084d7-ae84-450a-a13d-4ccfebd6703f-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-f24q7\" (UID: \"97c084d7-ae84-450a-a13d-4ccfebd6703f\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-f24q7" Jul 22 16:28:25.712316 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:25.712154 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9ed4ef31-1079-41d0-beb1-2951df187ab0-cert\") pod \"kserve-controller-manager-d6f4b65b8-bffnb\" (UID: \"9ed4ef31-1079-41d0-beb1-2951df187ab0\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-bffnb" Jul 22 16:28:25.712316 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:28:25.712279 2568 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found Jul 22 16:28:25.712514 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:28:25.712334 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ed4ef31-1079-41d0-beb1-2951df187ab0-cert podName:9ed4ef31-1079-41d0-beb1-2951df187ab0 nodeName:}" failed. No retries permitted until 2026-07-22 16:28:26.212318231 +0000 UTC m=+358.313933786 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/9ed4ef31-1079-41d0-beb1-2951df187ab0-cert") pod "kserve-controller-manager-d6f4b65b8-bffnb" (UID: "9ed4ef31-1079-41d0-beb1-2951df187ab0") : secret "kserve-webhook-server-cert" not found Jul 22 16:28:25.714958 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:25.714928 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/97c084d7-ae84-450a-a13d-4ccfebd6703f-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-f24q7\" (UID: \"97c084d7-ae84-450a-a13d-4ccfebd6703f\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-f24q7" Jul 22 16:28:25.724803 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:25.724774 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4s28\" (UniqueName: \"kubernetes.io/projected/9ed4ef31-1079-41d0-beb1-2951df187ab0-kube-api-access-m4s28\") pod \"kserve-controller-manager-d6f4b65b8-bffnb\" (UID: \"9ed4ef31-1079-41d0-beb1-2951df187ab0\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-bffnb" Jul 22 16:28:25.724803 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:25.724790 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w88bh\" (UniqueName: \"kubernetes.io/projected/97c084d7-ae84-450a-a13d-4ccfebd6703f-kube-api-access-w88bh\") pod \"llmisvc-controller-manager-777c6bd7d5-f24q7\" (UID: \"97c084d7-ae84-450a-a13d-4ccfebd6703f\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-f24q7" Jul 22 16:28:25.780271 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:25.780238 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-f24q7" Jul 22 16:28:25.922098 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:25.922071 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-f24q7"] Jul 22 16:28:25.925101 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:28:25.925073 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod97c084d7_ae84_450a_a13d_4ccfebd6703f.slice/crio-858438038c09a9fdd567111d2f9e2b15ae96410cedaebba5fff48c4b2859b3de WatchSource:0}: Error finding container 858438038c09a9fdd567111d2f9e2b15ae96410cedaebba5fff48c4b2859b3de: Status 404 returned error can't find the container with id 858438038c09a9fdd567111d2f9e2b15ae96410cedaebba5fff48c4b2859b3de Jul 22 16:28:26.216741 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:26.216705 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9ed4ef31-1079-41d0-beb1-2951df187ab0-cert\") pod \"kserve-controller-manager-d6f4b65b8-bffnb\" (UID: \"9ed4ef31-1079-41d0-beb1-2951df187ab0\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-bffnb" Jul 22 16:28:26.219144 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:26.219118 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9ed4ef31-1079-41d0-beb1-2951df187ab0-cert\") pod \"kserve-controller-manager-d6f4b65b8-bffnb\" (UID: \"9ed4ef31-1079-41d0-beb1-2951df187ab0\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-bffnb" Jul 22 16:28:26.235484 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:26.235450 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-f24q7" event={"ID":"97c084d7-ae84-450a-a13d-4ccfebd6703f","Type":"ContainerStarted","Data":"858438038c09a9fdd567111d2f9e2b15ae96410cedaebba5fff48c4b2859b3de"} Jul 22 16:28:26.360255 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:26.360220 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-bffnb" Jul 22 16:28:26.505531 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:26.505506 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-bffnb"] Jul 22 16:28:26.582624 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:28:26.582586 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ed4ef31_1079_41d0_beb1_2951df187ab0.slice/crio-285cce663bbd6e6f04a7164698fb57cf05cef5d6a24eb42d532603819cb2f1ae WatchSource:0}: Error finding container 285cce663bbd6e6f04a7164698fb57cf05cef5d6a24eb42d532603819cb2f1ae: Status 404 returned error can't find the container with id 285cce663bbd6e6f04a7164698fb57cf05cef5d6a24eb42d532603819cb2f1ae Jul 22 16:28:27.243091 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:27.243054 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-bffnb" event={"ID":"9ed4ef31-1079-41d0-beb1-2951df187ab0","Type":"ContainerStarted","Data":"285cce663bbd6e6f04a7164698fb57cf05cef5d6a24eb42d532603819cb2f1ae"} Jul 22 16:28:28.090001 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:28.089942 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-rg5v8"] Jul 22 16:28:28.090528 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:28.090176 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-rg5v8" podUID="0df632ce-9f15-418b-beb6-01f0571f0405" containerName="discovery" containerID="cri-o://56b7f505f839aa386a1334d06ef949fc9bb8a1d6e88ad4e1b1a7ff5d723129aa" gracePeriod=30 Jul 22 16:28:28.428093 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:28.428063 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-rg5v8" Jul 22 16:28:28.535454 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:28.535414 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0df632ce-9f15-418b-beb6-01f0571f0405-istio-csr-dns-cert\") pod \"0df632ce-9f15-418b-beb6-01f0571f0405\" (UID: \"0df632ce-9f15-418b-beb6-01f0571f0405\") " Jul 22 16:28:28.535638 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:28.535463 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qmgj7\" (UniqueName: \"kubernetes.io/projected/0df632ce-9f15-418b-beb6-01f0571f0405-kube-api-access-qmgj7\") pod \"0df632ce-9f15-418b-beb6-01f0571f0405\" (UID: \"0df632ce-9f15-418b-beb6-01f0571f0405\") " Jul 22 16:28:28.535638 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:28.535522 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0df632ce-9f15-418b-beb6-01f0571f0405-istio-token\") pod \"0df632ce-9f15-418b-beb6-01f0571f0405\" (UID: \"0df632ce-9f15-418b-beb6-01f0571f0405\") " Jul 22 16:28:28.535638 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:28.535571 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0df632ce-9f15-418b-beb6-01f0571f0405-istio-csr-ca-configmap\") pod \"0df632ce-9f15-418b-beb6-01f0571f0405\" (UID: \"0df632ce-9f15-418b-beb6-01f0571f0405\") " Jul 22 16:28:28.535638 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:28.535617 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0df632ce-9f15-418b-beb6-01f0571f0405-cacerts\") pod \"0df632ce-9f15-418b-beb6-01f0571f0405\" (UID: \"0df632ce-9f15-418b-beb6-01f0571f0405\") " Jul 22 16:28:28.535850 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:28.535648 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0df632ce-9f15-418b-beb6-01f0571f0405-istio-kubeconfig\") pod \"0df632ce-9f15-418b-beb6-01f0571f0405\" (UID: \"0df632ce-9f15-418b-beb6-01f0571f0405\") " Jul 22 16:28:28.535850 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:28.535694 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0df632ce-9f15-418b-beb6-01f0571f0405-local-certs\") pod \"0df632ce-9f15-418b-beb6-01f0571f0405\" (UID: \"0df632ce-9f15-418b-beb6-01f0571f0405\") " Jul 22 16:28:28.536245 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:28.536003 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0df632ce-9f15-418b-beb6-01f0571f0405-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "0df632ce-9f15-418b-beb6-01f0571f0405" (UID: "0df632ce-9f15-418b-beb6-01f0571f0405"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 16:28:28.538303 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:28.538273 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0df632ce-9f15-418b-beb6-01f0571f0405-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "0df632ce-9f15-418b-beb6-01f0571f0405" (UID: "0df632ce-9f15-418b-beb6-01f0571f0405"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 16:28:28.538978 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:28.538942 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0df632ce-9f15-418b-beb6-01f0571f0405-cacerts" (OuterVolumeSpecName: "cacerts") pod "0df632ce-9f15-418b-beb6-01f0571f0405" (UID: "0df632ce-9f15-418b-beb6-01f0571f0405"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 16:28:28.539179 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:28.539153 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0df632ce-9f15-418b-beb6-01f0571f0405-istio-token" (OuterVolumeSpecName: "istio-token") pod "0df632ce-9f15-418b-beb6-01f0571f0405" (UID: "0df632ce-9f15-418b-beb6-01f0571f0405"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 16:28:28.539179 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:28.539168 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0df632ce-9f15-418b-beb6-01f0571f0405-kube-api-access-qmgj7" (OuterVolumeSpecName: "kube-api-access-qmgj7") pod "0df632ce-9f15-418b-beb6-01f0571f0405" (UID: "0df632ce-9f15-418b-beb6-01f0571f0405"). InnerVolumeSpecName "kube-api-access-qmgj7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 16:28:28.539357 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:28.539204 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0df632ce-9f15-418b-beb6-01f0571f0405-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "0df632ce-9f15-418b-beb6-01f0571f0405" (UID: "0df632ce-9f15-418b-beb6-01f0571f0405"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 16:28:28.539535 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:28.539509 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0df632ce-9f15-418b-beb6-01f0571f0405-local-certs" (OuterVolumeSpecName: "local-certs") pod "0df632ce-9f15-418b-beb6-01f0571f0405" (UID: "0df632ce-9f15-418b-beb6-01f0571f0405"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 16:28:28.637411 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:28.637312 2568 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0df632ce-9f15-418b-beb6-01f0571f0405-istio-csr-dns-cert\") on node \"ip-10-0-133-47.ec2.internal\" DevicePath \"\"" Jul 22 16:28:28.637411 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:28.637384 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qmgj7\" (UniqueName: \"kubernetes.io/projected/0df632ce-9f15-418b-beb6-01f0571f0405-kube-api-access-qmgj7\") on node \"ip-10-0-133-47.ec2.internal\" DevicePath \"\"" Jul 22 16:28:28.637411 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:28.637401 2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0df632ce-9f15-418b-beb6-01f0571f0405-istio-token\") on node \"ip-10-0-133-47.ec2.internal\" DevicePath \"\"" Jul 22 16:28:28.637709 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:28.637416 2568 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0df632ce-9f15-418b-beb6-01f0571f0405-istio-csr-ca-configmap\") on node \"ip-10-0-133-47.ec2.internal\" DevicePath \"\"" Jul 22 16:28:28.637709 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:28.637431 2568 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0df632ce-9f15-418b-beb6-01f0571f0405-cacerts\") on node \"ip-10-0-133-47.ec2.internal\" DevicePath \"\"" Jul 22 16:28:28.637709 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:28.637444 2568 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0df632ce-9f15-418b-beb6-01f0571f0405-istio-kubeconfig\") on node \"ip-10-0-133-47.ec2.internal\" DevicePath \"\"" Jul 22 16:28:28.637709 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:28.637457 2568 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0df632ce-9f15-418b-beb6-01f0571f0405-local-certs\") on node \"ip-10-0-133-47.ec2.internal\" DevicePath \"\"" Jul 22 16:28:29.198997 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:29.198963 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-j9j8t" Jul 22 16:28:29.259600 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:29.259519 2568 generic.go:356] "Generic (PLEG): container finished" podID="0df632ce-9f15-418b-beb6-01f0571f0405" containerID="56b7f505f839aa386a1334d06ef949fc9bb8a1d6e88ad4e1b1a7ff5d723129aa" exitCode=0 Jul 22 16:28:29.259791 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:29.259713 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-rg5v8" Jul 22 16:28:29.260086 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:29.260059 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-rg5v8" event={"ID":"0df632ce-9f15-418b-beb6-01f0571f0405","Type":"ContainerDied","Data":"56b7f505f839aa386a1334d06ef949fc9bb8a1d6e88ad4e1b1a7ff5d723129aa"} Jul 22 16:28:29.260194 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:29.260121 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-rg5v8" event={"ID":"0df632ce-9f15-418b-beb6-01f0571f0405","Type":"ContainerDied","Data":"73e3befac086edc9a75be39871b69fa4c1a6c03b072deb833d94022567a7b689"} Jul 22 16:28:29.260194 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:29.260152 2568 scope.go:117] "RemoveContainer" containerID="56b7f505f839aa386a1334d06ef949fc9bb8a1d6e88ad4e1b1a7ff5d723129aa" Jul 22 16:28:29.262821 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:29.262798 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-f24q7" event={"ID":"97c084d7-ae84-450a-a13d-4ccfebd6703f","Type":"ContainerStarted","Data":"953dd873ca2c8f3cb9d889df9f51ca4959d65e1e61a33da9a2b0865db660a3fe"} Jul 22 16:28:29.265890 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:29.265861 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-f24q7" Jul 22 16:28:29.284827 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:29.284530 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-f24q7" podStartSLOduration=1.8873196110000001 podStartE2EDuration="4.284509207s" totalImagesPullingTime="2.397189596s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:28:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:28:29.283670462 +0000 UTC m=+361.385286040" watchObservedRunningTime="2026-07-22 16:28:29.284509207 +0000 UTC m=+361.386124785" Jul 22 16:28:29.302597 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:29.302559 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-rg5v8"] Jul 22 16:28:29.305830 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:29.305802 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-rg5v8"] Jul 22 16:28:29.319500 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:29.319470 2568 scope.go:117] "RemoveContainer" containerID="56b7f505f839aa386a1334d06ef949fc9bb8a1d6e88ad4e1b1a7ff5d723129aa" Jul 22 16:28:29.319843 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:28:29.319820 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"56b7f505f839aa386a1334d06ef949fc9bb8a1d6e88ad4e1b1a7ff5d723129aa\": container with ID starting with 56b7f505f839aa386a1334d06ef949fc9bb8a1d6e88ad4e1b1a7ff5d723129aa not found: ID does not exist" containerID="56b7f505f839aa386a1334d06ef949fc9bb8a1d6e88ad4e1b1a7ff5d723129aa" Jul 22 16:28:29.319908 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:29.319855 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56b7f505f839aa386a1334d06ef949fc9bb8a1d6e88ad4e1b1a7ff5d723129aa"} err="failed to get container status \"56b7f505f839aa386a1334d06ef949fc9bb8a1d6e88ad4e1b1a7ff5d723129aa\": rpc error: code = NotFound desc = could not find container \"56b7f505f839aa386a1334d06ef949fc9bb8a1d6e88ad4e1b1a7ff5d723129aa\": container with ID starting with 56b7f505f839aa386a1334d06ef949fc9bb8a1d6e88ad4e1b1a7ff5d723129aa not found: ID does not exist" Jul 22 16:28:30.270950 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:30.270908 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-bffnb" event={"ID":"9ed4ef31-1079-41d0-beb1-2951df187ab0","Type":"ContainerStarted","Data":"30bac2a8b9cf8efbcb35a230ac7c0b1ec452fc8b3380951bdab92941a9f93656"} Jul 22 16:28:30.271465 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:30.271058 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-bffnb" Jul 22 16:28:30.288865 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:30.288797 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-bffnb" podStartSLOduration=2.50019869 podStartE2EDuration="5.288777089s" totalImagesPullingTime="2.788578399s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:28:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:28:30.287327592 +0000 UTC m=+362.388943177" watchObservedRunningTime="2026-07-22 16:28:30.288777089 +0000 UTC m=+362.390392665" Jul 22 16:28:30.410630 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:30.410596 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0df632ce-9f15-418b-beb6-01f0571f0405" path="/var/lib/kubelet/pods/0df632ce-9f15-418b-beb6-01f0571f0405/volumes" Jul 22 16:28:31.213708 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:28:31.213681 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-pqr2k" Jul 22 16:29:01.279421 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:01.279391 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-f24q7" Jul 22 16:29:01.282900 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:01.282874 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-bffnb" Jul 22 16:29:14.282816 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:14.282777 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-f4v5j"] Jul 22 16:29:14.283191 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:14.283114 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0df632ce-9f15-418b-beb6-01f0571f0405" containerName="discovery" Jul 22 16:29:14.283191 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:14.283125 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="0df632ce-9f15-418b-beb6-01f0571f0405" containerName="discovery" Jul 22 16:29:14.283191 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:14.283183 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="0df632ce-9f15-418b-beb6-01f0571f0405" containerName="discovery" Jul 22 16:29:14.288703 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:14.288682 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-f4v5j" Jul 22 16:29:14.291445 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:14.291424 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 22 16:29:14.292378 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:14.292340 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-2ph7v\"" Jul 22 16:29:14.292378 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:14.292368 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 22 16:29:14.298301 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:14.298278 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-f4v5j"] Jul 22 16:29:14.424949 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:14.424919 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nt6lk\" (UniqueName: \"kubernetes.io/projected/63be9f62-313f-4d90-996d-7843d5e00c15-kube-api-access-nt6lk\") pod \"kuadrant-operator-catalog-f4v5j\" (UID: \"63be9f62-313f-4d90-996d-7843d5e00c15\") " pod="kuadrant-system/kuadrant-operator-catalog-f4v5j" Jul 22 16:29:14.525913 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:14.525873 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nt6lk\" (UniqueName: \"kubernetes.io/projected/63be9f62-313f-4d90-996d-7843d5e00c15-kube-api-access-nt6lk\") pod \"kuadrant-operator-catalog-f4v5j\" (UID: \"63be9f62-313f-4d90-996d-7843d5e00c15\") " pod="kuadrant-system/kuadrant-operator-catalog-f4v5j" Jul 22 16:29:14.534459 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:14.534378 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nt6lk\" (UniqueName: \"kubernetes.io/projected/63be9f62-313f-4d90-996d-7843d5e00c15-kube-api-access-nt6lk\") pod \"kuadrant-operator-catalog-f4v5j\" (UID: \"63be9f62-313f-4d90-996d-7843d5e00c15\") " pod="kuadrant-system/kuadrant-operator-catalog-f4v5j" Jul 22 16:29:14.599239 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:14.599201 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-f4v5j" Jul 22 16:29:14.600124 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:14.600102 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-f4v5j"] Jul 22 16:29:14.736760 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:14.736734 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-f4v5j"] Jul 22 16:29:14.739451 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:29:14.739422 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63be9f62_313f_4d90_996d_7843d5e00c15.slice/crio-2d2c7fe45acadb27a576d1f68869b882daf16026d3491ad2a14ab34600725e7b WatchSource:0}: Error finding container 2d2c7fe45acadb27a576d1f68869b882daf16026d3491ad2a14ab34600725e7b: Status 404 returned error can't find the container with id 2d2c7fe45acadb27a576d1f68869b882daf16026d3491ad2a14ab34600725e7b Jul 22 16:29:14.811502 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:14.811402 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-gtcgq"] Jul 22 16:29:14.815624 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:14.815606 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-gtcgq" Jul 22 16:29:14.821852 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:14.821779 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-gtcgq"] Jul 22 16:29:14.930835 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:14.930795 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t27m7\" (UniqueName: \"kubernetes.io/projected/5698664d-d86b-4968-8d3d-17c2550b3ccc-kube-api-access-t27m7\") pod \"kuadrant-operator-catalog-gtcgq\" (UID: \"5698664d-d86b-4968-8d3d-17c2550b3ccc\") " pod="kuadrant-system/kuadrant-operator-catalog-gtcgq" Jul 22 16:29:15.032286 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:15.032231 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t27m7\" (UniqueName: \"kubernetes.io/projected/5698664d-d86b-4968-8d3d-17c2550b3ccc-kube-api-access-t27m7\") pod \"kuadrant-operator-catalog-gtcgq\" (UID: \"5698664d-d86b-4968-8d3d-17c2550b3ccc\") " pod="kuadrant-system/kuadrant-operator-catalog-gtcgq" Jul 22 16:29:15.043649 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:15.043615 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t27m7\" (UniqueName: \"kubernetes.io/projected/5698664d-d86b-4968-8d3d-17c2550b3ccc-kube-api-access-t27m7\") pod \"kuadrant-operator-catalog-gtcgq\" (UID: \"5698664d-d86b-4968-8d3d-17c2550b3ccc\") " pod="kuadrant-system/kuadrant-operator-catalog-gtcgq" Jul 22 16:29:15.126555 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:15.126465 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-gtcgq" Jul 22 16:29:15.319709 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:15.319684 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-gtcgq"] Jul 22 16:29:15.344185 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:29:15.344156 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5698664d_d86b_4968_8d3d_17c2550b3ccc.slice/crio-5c26ffb9529cf9039dad0907ed9827a71dd001e3ccabed2d72ad7e4daa85d80b WatchSource:0}: Error finding container 5c26ffb9529cf9039dad0907ed9827a71dd001e3ccabed2d72ad7e4daa85d80b: Status 404 returned error can't find the container with id 5c26ffb9529cf9039dad0907ed9827a71dd001e3ccabed2d72ad7e4daa85d80b Jul 22 16:29:15.496674 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:15.496629 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-gtcgq" event={"ID":"5698664d-d86b-4968-8d3d-17c2550b3ccc","Type":"ContainerStarted","Data":"5c26ffb9529cf9039dad0907ed9827a71dd001e3ccabed2d72ad7e4daa85d80b"} Jul 22 16:29:15.501126 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:15.501084 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-f4v5j" event={"ID":"63be9f62-313f-4d90-996d-7843d5e00c15","Type":"ContainerStarted","Data":"2d2c7fe45acadb27a576d1f68869b882daf16026d3491ad2a14ab34600725e7b"} Jul 22 16:29:17.512375 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:17.512316 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-gtcgq" event={"ID":"5698664d-d86b-4968-8d3d-17c2550b3ccc","Type":"ContainerStarted","Data":"944d08e9d50f3fb607e4940947a327e4ea4d290282e7178922ac6644f85dc7c1"} Jul 22 16:29:17.513788 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:17.513765 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-f4v5j" event={"ID":"63be9f62-313f-4d90-996d-7843d5e00c15","Type":"ContainerStarted","Data":"a9a1e06e57fb6f862fe2a36e5b558f6d48b52b273155b9b828e1e1aa355eb673"} Jul 22 16:29:17.513906 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:17.513790 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-f4v5j" podUID="63be9f62-313f-4d90-996d-7843d5e00c15" containerName="registry-server" containerID="cri-o://a9a1e06e57fb6f862fe2a36e5b558f6d48b52b273155b9b828e1e1aa355eb673" gracePeriod=2 Jul 22 16:29:17.530194 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:17.530051 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-gtcgq" podStartSLOduration=2.310825718 podStartE2EDuration="3.53003127s" totalImagesPullingTime="1.219205552s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:29:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:29:17.527509041 +0000 UTC m=+409.629124638" watchObservedRunningTime="2026-07-22 16:29:17.53003127 +0000 UTC m=+409.631646847" Jul 22 16:29:17.544305 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:17.544256 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-f4v5j" podStartSLOduration=1.720788589 podStartE2EDuration="3.544241612s" totalImagesPullingTime="1.823453023s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:29:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:29:17.542635517 +0000 UTC m=+409.644251090" watchObservedRunningTime="2026-07-22 16:29:17.544241612 +0000 UTC m=+409.645857185" Jul 22 16:29:17.779077 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:17.779054 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-f4v5j" Jul 22 16:29:17.857944 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:17.857904 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nt6lk\" (UniqueName: \"kubernetes.io/projected/63be9f62-313f-4d90-996d-7843d5e00c15-kube-api-access-nt6lk\") pod \"63be9f62-313f-4d90-996d-7843d5e00c15\" (UID: \"63be9f62-313f-4d90-996d-7843d5e00c15\") " Jul 22 16:29:17.860372 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:17.860311 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/63be9f62-313f-4d90-996d-7843d5e00c15-kube-api-access-nt6lk" (OuterVolumeSpecName: "kube-api-access-nt6lk") pod "63be9f62-313f-4d90-996d-7843d5e00c15" (UID: "63be9f62-313f-4d90-996d-7843d5e00c15"). InnerVolumeSpecName "kube-api-access-nt6lk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 16:29:17.959042 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:17.959003 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nt6lk\" (UniqueName: \"kubernetes.io/projected/63be9f62-313f-4d90-996d-7843d5e00c15-kube-api-access-nt6lk\") on node \"ip-10-0-133-47.ec2.internal\" DevicePath \"\"" Jul 22 16:29:18.519984 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:18.519950 2568 generic.go:356] "Generic (PLEG): container finished" podID="63be9f62-313f-4d90-996d-7843d5e00c15" containerID="a9a1e06e57fb6f862fe2a36e5b558f6d48b52b273155b9b828e1e1aa355eb673" exitCode=0 Jul 22 16:29:18.520421 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:18.520008 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-f4v5j" Jul 22 16:29:18.520421 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:18.520039 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-f4v5j" event={"ID":"63be9f62-313f-4d90-996d-7843d5e00c15","Type":"ContainerDied","Data":"a9a1e06e57fb6f862fe2a36e5b558f6d48b52b273155b9b828e1e1aa355eb673"} Jul 22 16:29:18.520421 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:18.520119 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-f4v5j" event={"ID":"63be9f62-313f-4d90-996d-7843d5e00c15","Type":"ContainerDied","Data":"2d2c7fe45acadb27a576d1f68869b882daf16026d3491ad2a14ab34600725e7b"} Jul 22 16:29:18.520421 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:18.520145 2568 scope.go:117] "RemoveContainer" containerID="a9a1e06e57fb6f862fe2a36e5b558f6d48b52b273155b9b828e1e1aa355eb673" Jul 22 16:29:18.528690 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:18.528672 2568 scope.go:117] "RemoveContainer" containerID="a9a1e06e57fb6f862fe2a36e5b558f6d48b52b273155b9b828e1e1aa355eb673" Jul 22 16:29:18.528934 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:29:18.528914 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a9a1e06e57fb6f862fe2a36e5b558f6d48b52b273155b9b828e1e1aa355eb673\": container with ID starting with a9a1e06e57fb6f862fe2a36e5b558f6d48b52b273155b9b828e1e1aa355eb673 not found: ID does not exist" containerID="a9a1e06e57fb6f862fe2a36e5b558f6d48b52b273155b9b828e1e1aa355eb673" Jul 22 16:29:18.528996 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:18.528948 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a9a1e06e57fb6f862fe2a36e5b558f6d48b52b273155b9b828e1e1aa355eb673"} err="failed to get container status \"a9a1e06e57fb6f862fe2a36e5b558f6d48b52b273155b9b828e1e1aa355eb673\": rpc error: code = NotFound desc = could not find container \"a9a1e06e57fb6f862fe2a36e5b558f6d48b52b273155b9b828e1e1aa355eb673\": container with ID starting with a9a1e06e57fb6f862fe2a36e5b558f6d48b52b273155b9b828e1e1aa355eb673 not found: ID does not exist" Jul 22 16:29:18.538513 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:18.538489 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-f4v5j"] Jul 22 16:29:18.542848 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:18.542825 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-f4v5j"] Jul 22 16:29:20.052420 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:20.052372 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6569ccbcd8-rwnqw"] Jul 22 16:29:20.052957 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:20.052922 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63be9f62-313f-4d90-996d-7843d5e00c15" containerName="registry-server" Jul 22 16:29:20.052957 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:20.052944 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="63be9f62-313f-4d90-996d-7843d5e00c15" containerName="registry-server" Jul 22 16:29:20.053121 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:20.053022 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="63be9f62-313f-4d90-996d-7843d5e00c15" containerName="registry-server" Jul 22 16:29:20.057562 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:20.057537 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6569ccbcd8-rwnqw" Jul 22 16:29:20.068445 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:20.068417 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6569ccbcd8-rwnqw"] Jul 22 16:29:20.176472 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:20.176425 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/170d2c8f-b493-4ab3-bd22-567765a39616-trusted-ca-bundle\") pod \"console-6569ccbcd8-rwnqw\" (UID: \"170d2c8f-b493-4ab3-bd22-567765a39616\") " pod="openshift-console/console-6569ccbcd8-rwnqw" Jul 22 16:29:20.176472 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:20.176479 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/170d2c8f-b493-4ab3-bd22-567765a39616-oauth-serving-cert\") pod \"console-6569ccbcd8-rwnqw\" (UID: \"170d2c8f-b493-4ab3-bd22-567765a39616\") " pod="openshift-console/console-6569ccbcd8-rwnqw" Jul 22 16:29:20.176686 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:20.176555 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/170d2c8f-b493-4ab3-bd22-567765a39616-console-oauth-config\") pod \"console-6569ccbcd8-rwnqw\" (UID: \"170d2c8f-b493-4ab3-bd22-567765a39616\") " pod="openshift-console/console-6569ccbcd8-rwnqw" Jul 22 16:29:20.176686 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:20.176582 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/170d2c8f-b493-4ab3-bd22-567765a39616-service-ca\") pod \"console-6569ccbcd8-rwnqw\" (UID: \"170d2c8f-b493-4ab3-bd22-567765a39616\") " pod="openshift-console/console-6569ccbcd8-rwnqw" Jul 22 16:29:20.176686 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:20.176605 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2m5sm\" (UniqueName: \"kubernetes.io/projected/170d2c8f-b493-4ab3-bd22-567765a39616-kube-api-access-2m5sm\") pod \"console-6569ccbcd8-rwnqw\" (UID: \"170d2c8f-b493-4ab3-bd22-567765a39616\") " pod="openshift-console/console-6569ccbcd8-rwnqw" Jul 22 16:29:20.176686 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:20.176669 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/170d2c8f-b493-4ab3-bd22-567765a39616-console-serving-cert\") pod \"console-6569ccbcd8-rwnqw\" (UID: \"170d2c8f-b493-4ab3-bd22-567765a39616\") " pod="openshift-console/console-6569ccbcd8-rwnqw" Jul 22 16:29:20.176809 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:20.176704 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/170d2c8f-b493-4ab3-bd22-567765a39616-console-config\") pod \"console-6569ccbcd8-rwnqw\" (UID: \"170d2c8f-b493-4ab3-bd22-567765a39616\") " pod="openshift-console/console-6569ccbcd8-rwnqw" Jul 22 16:29:20.277960 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:20.277918 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/170d2c8f-b493-4ab3-bd22-567765a39616-console-config\") pod \"console-6569ccbcd8-rwnqw\" (UID: \"170d2c8f-b493-4ab3-bd22-567765a39616\") " pod="openshift-console/console-6569ccbcd8-rwnqw" Jul 22 16:29:20.278114 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:20.277984 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/170d2c8f-b493-4ab3-bd22-567765a39616-trusted-ca-bundle\") pod \"console-6569ccbcd8-rwnqw\" (UID: \"170d2c8f-b493-4ab3-bd22-567765a39616\") " pod="openshift-console/console-6569ccbcd8-rwnqw" Jul 22 16:29:20.278114 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:20.278006 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/170d2c8f-b493-4ab3-bd22-567765a39616-oauth-serving-cert\") pod \"console-6569ccbcd8-rwnqw\" (UID: \"170d2c8f-b493-4ab3-bd22-567765a39616\") " pod="openshift-console/console-6569ccbcd8-rwnqw" Jul 22 16:29:20.278114 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:20.278032 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/170d2c8f-b493-4ab3-bd22-567765a39616-console-oauth-config\") pod \"console-6569ccbcd8-rwnqw\" (UID: \"170d2c8f-b493-4ab3-bd22-567765a39616\") " pod="openshift-console/console-6569ccbcd8-rwnqw" Jul 22 16:29:20.278114 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:20.278048 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/170d2c8f-b493-4ab3-bd22-567765a39616-service-ca\") pod \"console-6569ccbcd8-rwnqw\" (UID: \"170d2c8f-b493-4ab3-bd22-567765a39616\") " pod="openshift-console/console-6569ccbcd8-rwnqw" Jul 22 16:29:20.278114 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:20.278067 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2m5sm\" (UniqueName: \"kubernetes.io/projected/170d2c8f-b493-4ab3-bd22-567765a39616-kube-api-access-2m5sm\") pod \"console-6569ccbcd8-rwnqw\" (UID: \"170d2c8f-b493-4ab3-bd22-567765a39616\") " pod="openshift-console/console-6569ccbcd8-rwnqw" Jul 22 16:29:20.278114 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:20.278096 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/170d2c8f-b493-4ab3-bd22-567765a39616-console-serving-cert\") pod \"console-6569ccbcd8-rwnqw\" (UID: \"170d2c8f-b493-4ab3-bd22-567765a39616\") " pod="openshift-console/console-6569ccbcd8-rwnqw" Jul 22 16:29:20.278866 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:20.278833 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/170d2c8f-b493-4ab3-bd22-567765a39616-console-config\") pod \"console-6569ccbcd8-rwnqw\" (UID: \"170d2c8f-b493-4ab3-bd22-567765a39616\") " pod="openshift-console/console-6569ccbcd8-rwnqw" Jul 22 16:29:20.278866 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:20.278858 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/170d2c8f-b493-4ab3-bd22-567765a39616-service-ca\") pod \"console-6569ccbcd8-rwnqw\" (UID: \"170d2c8f-b493-4ab3-bd22-567765a39616\") " pod="openshift-console/console-6569ccbcd8-rwnqw" Jul 22 16:29:20.279009 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:20.278906 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/170d2c8f-b493-4ab3-bd22-567765a39616-oauth-serving-cert\") pod \"console-6569ccbcd8-rwnqw\" (UID: \"170d2c8f-b493-4ab3-bd22-567765a39616\") " pod="openshift-console/console-6569ccbcd8-rwnqw" Jul 22 16:29:20.279009 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:20.278973 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/170d2c8f-b493-4ab3-bd22-567765a39616-trusted-ca-bundle\") pod \"console-6569ccbcd8-rwnqw\" (UID: \"170d2c8f-b493-4ab3-bd22-567765a39616\") " pod="openshift-console/console-6569ccbcd8-rwnqw" Jul 22 16:29:20.280598 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:20.280576 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/170d2c8f-b493-4ab3-bd22-567765a39616-console-oauth-config\") pod \"console-6569ccbcd8-rwnqw\" (UID: \"170d2c8f-b493-4ab3-bd22-567765a39616\") " pod="openshift-console/console-6569ccbcd8-rwnqw" Jul 22 16:29:20.280703 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:20.280677 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/170d2c8f-b493-4ab3-bd22-567765a39616-console-serving-cert\") pod \"console-6569ccbcd8-rwnqw\" (UID: \"170d2c8f-b493-4ab3-bd22-567765a39616\") " pod="openshift-console/console-6569ccbcd8-rwnqw" Jul 22 16:29:20.289308 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:20.289287 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2m5sm\" (UniqueName: \"kubernetes.io/projected/170d2c8f-b493-4ab3-bd22-567765a39616-kube-api-access-2m5sm\") pod \"console-6569ccbcd8-rwnqw\" (UID: \"170d2c8f-b493-4ab3-bd22-567765a39616\") " pod="openshift-console/console-6569ccbcd8-rwnqw" Jul 22 16:29:20.367938 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:20.367852 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6569ccbcd8-rwnqw" Jul 22 16:29:20.410132 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:20.410085 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="63be9f62-313f-4d90-996d-7843d5e00c15" path="/var/lib/kubelet/pods/63be9f62-313f-4d90-996d-7843d5e00c15/volumes" Jul 22 16:29:20.510904 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:20.510877 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6569ccbcd8-rwnqw"] Jul 22 16:29:20.513365 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:29:20.513322 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod170d2c8f_b493_4ab3_bd22_567765a39616.slice/crio-a854bc02322b02578bfb92f75212a07c2353b4c4a1ec25f0fbc8618c629304cb WatchSource:0}: Error finding container a854bc02322b02578bfb92f75212a07c2353b4c4a1ec25f0fbc8618c629304cb: Status 404 returned error can't find the container with id a854bc02322b02578bfb92f75212a07c2353b4c4a1ec25f0fbc8618c629304cb Jul 22 16:29:20.532813 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:20.532780 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6569ccbcd8-rwnqw" event={"ID":"170d2c8f-b493-4ab3-bd22-567765a39616","Type":"ContainerStarted","Data":"a854bc02322b02578bfb92f75212a07c2353b4c4a1ec25f0fbc8618c629304cb"} Jul 22 16:29:21.539715 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:21.539679 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6569ccbcd8-rwnqw" event={"ID":"170d2c8f-b493-4ab3-bd22-567765a39616","Type":"ContainerStarted","Data":"386c2449cd872eec163a88fac41219424673a8fc40bf4ce795ac517731af3a72"} Jul 22 16:29:21.558292 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:21.558239 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6569ccbcd8-rwnqw" podStartSLOduration=1.5582220549999999 podStartE2EDuration="1.558222055s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:29:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:29:21.556976786 +0000 UTC m=+413.658592362" watchObservedRunningTime="2026-07-22 16:29:21.558222055 +0000 UTC m=+413.659837631" Jul 22 16:29:25.126822 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:25.126781 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-gtcgq" Jul 22 16:29:25.127298 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:25.126847 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-gtcgq" Jul 22 16:29:25.149860 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:25.149831 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-gtcgq" Jul 22 16:29:25.582818 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:25.582788 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-gtcgq" Jul 22 16:29:29.621641 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:29.621600 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x7lf2"] Jul 22 16:29:29.626628 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:29.626604 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x7lf2" Jul 22 16:29:29.629394 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:29.629376 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-l2vmv\"" Jul 22 16:29:29.634485 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:29.634461 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x7lf2"] Jul 22 16:29:29.763314 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:29.763274 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a001a5ac-8967-4f5c-b0f4-9326356ac5b5-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x7lf2\" (UID: \"a001a5ac-8967-4f5c-b0f4-9326356ac5b5\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x7lf2" Jul 22 16:29:29.763314 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:29.763319 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a001a5ac-8967-4f5c-b0f4-9326356ac5b5-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x7lf2\" (UID: \"a001a5ac-8967-4f5c-b0f4-9326356ac5b5\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x7lf2" Jul 22 16:29:29.763548 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:29.763485 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xgj7g\" (UniqueName: \"kubernetes.io/projected/a001a5ac-8967-4f5c-b0f4-9326356ac5b5-kube-api-access-xgj7g\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x7lf2\" (UID: \"a001a5ac-8967-4f5c-b0f4-9326356ac5b5\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x7lf2" Jul 22 16:29:29.864459 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:29.864409 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xgj7g\" (UniqueName: \"kubernetes.io/projected/a001a5ac-8967-4f5c-b0f4-9326356ac5b5-kube-api-access-xgj7g\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x7lf2\" (UID: \"a001a5ac-8967-4f5c-b0f4-9326356ac5b5\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x7lf2" Jul 22 16:29:29.864667 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:29.864468 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a001a5ac-8967-4f5c-b0f4-9326356ac5b5-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x7lf2\" (UID: \"a001a5ac-8967-4f5c-b0f4-9326356ac5b5\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x7lf2" Jul 22 16:29:29.864667 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:29.864503 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a001a5ac-8967-4f5c-b0f4-9326356ac5b5-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x7lf2\" (UID: \"a001a5ac-8967-4f5c-b0f4-9326356ac5b5\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x7lf2" Jul 22 16:29:29.864904 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:29.864883 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a001a5ac-8967-4f5c-b0f4-9326356ac5b5-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x7lf2\" (UID: \"a001a5ac-8967-4f5c-b0f4-9326356ac5b5\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x7lf2" Jul 22 16:29:29.864974 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:29.864903 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a001a5ac-8967-4f5c-b0f4-9326356ac5b5-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x7lf2\" (UID: \"a001a5ac-8967-4f5c-b0f4-9326356ac5b5\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x7lf2" Jul 22 16:29:29.872529 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:29.872459 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xgj7g\" (UniqueName: \"kubernetes.io/projected/a001a5ac-8967-4f5c-b0f4-9326356ac5b5-kube-api-access-xgj7g\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x7lf2\" (UID: \"a001a5ac-8967-4f5c-b0f4-9326356ac5b5\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x7lf2" Jul 22 16:29:29.937072 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:29.937035 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x7lf2" Jul 22 16:29:30.069680 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:30.069650 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x7lf2"] Jul 22 16:29:30.071651 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:29:30.071620 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda001a5ac_8967_4f5c_b0f4_9326356ac5b5.slice/crio-9a591104c935b592913a5fe4ff97769d10121229f867d2015dadf932acb9f5be WatchSource:0}: Error finding container 9a591104c935b592913a5fe4ff97769d10121229f867d2015dadf932acb9f5be: Status 404 returned error can't find the container with id 9a591104c935b592913a5fe4ff97769d10121229f867d2015dadf932acb9f5be Jul 22 16:29:30.217650 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:30.217615 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ffg42"] Jul 22 16:29:30.221157 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:30.221138 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ffg42" Jul 22 16:29:30.228404 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:30.228281 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ffg42"] Jul 22 16:29:30.368423 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:30.368383 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6569ccbcd8-rwnqw" Jul 22 16:29:30.368602 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:30.368455 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6569ccbcd8-rwnqw" Jul 22 16:29:30.368602 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:30.368585 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/344287ba-b88d-4668-87cd-3b268afeb07d-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ffg42\" (UID: \"344287ba-b88d-4668-87cd-3b268afeb07d\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ffg42" Jul 22 16:29:30.368675 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:30.368636 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/344287ba-b88d-4668-87cd-3b268afeb07d-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ffg42\" (UID: \"344287ba-b88d-4668-87cd-3b268afeb07d\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ffg42" Jul 22 16:29:30.368715 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:30.368672 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xpndr\" (UniqueName: \"kubernetes.io/projected/344287ba-b88d-4668-87cd-3b268afeb07d-kube-api-access-xpndr\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ffg42\" (UID: \"344287ba-b88d-4668-87cd-3b268afeb07d\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ffg42" Jul 22 16:29:30.373463 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:30.373439 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6569ccbcd8-rwnqw" Jul 22 16:29:30.469695 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:30.469663 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/344287ba-b88d-4668-87cd-3b268afeb07d-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ffg42\" (UID: \"344287ba-b88d-4668-87cd-3b268afeb07d\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ffg42" Jul 22 16:29:30.469874 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:30.469756 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/344287ba-b88d-4668-87cd-3b268afeb07d-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ffg42\" (UID: \"344287ba-b88d-4668-87cd-3b268afeb07d\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ffg42" Jul 22 16:29:30.469874 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:30.469801 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xpndr\" (UniqueName: \"kubernetes.io/projected/344287ba-b88d-4668-87cd-3b268afeb07d-kube-api-access-xpndr\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ffg42\" (UID: \"344287ba-b88d-4668-87cd-3b268afeb07d\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ffg42" Jul 22 16:29:30.470150 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:30.470125 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/344287ba-b88d-4668-87cd-3b268afeb07d-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ffg42\" (UID: \"344287ba-b88d-4668-87cd-3b268afeb07d\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ffg42" Jul 22 16:29:30.470240 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:30.470148 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/344287ba-b88d-4668-87cd-3b268afeb07d-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ffg42\" (UID: \"344287ba-b88d-4668-87cd-3b268afeb07d\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ffg42" Jul 22 16:29:30.481522 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:30.481492 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xpndr\" (UniqueName: \"kubernetes.io/projected/344287ba-b88d-4668-87cd-3b268afeb07d-kube-api-access-xpndr\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ffg42\" (UID: \"344287ba-b88d-4668-87cd-3b268afeb07d\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ffg42" Jul 22 16:29:30.531049 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:30.531000 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ffg42" Jul 22 16:29:30.589629 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:30.589421 2568 generic.go:356] "Generic (PLEG): container finished" podID="a001a5ac-8967-4f5c-b0f4-9326356ac5b5" containerID="a7330a09c439a9702984b24a95f195baca8e347c9814f40563ac03d4e9f525e3" exitCode=0 Jul 22 16:29:30.589775 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:30.589620 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x7lf2" event={"ID":"a001a5ac-8967-4f5c-b0f4-9326356ac5b5","Type":"ContainerDied","Data":"a7330a09c439a9702984b24a95f195baca8e347c9814f40563ac03d4e9f525e3"} Jul 22 16:29:30.589775 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:30.589686 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x7lf2" event={"ID":"a001a5ac-8967-4f5c-b0f4-9326356ac5b5","Type":"ContainerStarted","Data":"9a591104c935b592913a5fe4ff97769d10121229f867d2015dadf932acb9f5be"} Jul 22 16:29:30.594509 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:30.594487 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6569ccbcd8-rwnqw" Jul 22 16:29:30.630040 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:30.630005 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75998xhm"] Jul 22 16:29:30.635476 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:30.635443 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75998xhm" Jul 22 16:29:30.644066 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:30.643965 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75998xhm"] Jul 22 16:29:30.664758 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:30.664722 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-ff898c44b-szxvb"] Jul 22 16:29:30.680690 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:30.680654 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ffg42"] Jul 22 16:29:30.684544 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:29:30.684511 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod344287ba_b88d_4668_87cd_3b268afeb07d.slice/crio-b0e9d061d6a9079c913f665a3db898651ffe5942d33e3d397fb5f8525062079a WatchSource:0}: Error finding container b0e9d061d6a9079c913f665a3db898651ffe5942d33e3d397fb5f8525062079a: Status 404 returned error can't find the container with id b0e9d061d6a9079c913f665a3db898651ffe5942d33e3d397fb5f8525062079a Jul 22 16:29:30.773263 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:30.773229 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f2074d1f-a84f-4534-84ce-828e9fd12963-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75998xhm\" (UID: \"f2074d1f-a84f-4534-84ce-828e9fd12963\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75998xhm" Jul 22 16:29:30.773446 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:30.773340 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f2074d1f-a84f-4534-84ce-828e9fd12963-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75998xhm\" (UID: \"f2074d1f-a84f-4534-84ce-828e9fd12963\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75998xhm" Jul 22 16:29:30.773646 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:30.773622 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2q7d2\" (UniqueName: \"kubernetes.io/projected/f2074d1f-a84f-4534-84ce-828e9fd12963-kube-api-access-2q7d2\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75998xhm\" (UID: \"f2074d1f-a84f-4534-84ce-828e9fd12963\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75998xhm" Jul 22 16:29:30.875221 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:30.875175 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f2074d1f-a84f-4534-84ce-828e9fd12963-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75998xhm\" (UID: \"f2074d1f-a84f-4534-84ce-828e9fd12963\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75998xhm" Jul 22 16:29:30.875413 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:30.875270 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f2074d1f-a84f-4534-84ce-828e9fd12963-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75998xhm\" (UID: \"f2074d1f-a84f-4534-84ce-828e9fd12963\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75998xhm" Jul 22 16:29:30.875413 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:30.875360 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2q7d2\" (UniqueName: \"kubernetes.io/projected/f2074d1f-a84f-4534-84ce-828e9fd12963-kube-api-access-2q7d2\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75998xhm\" (UID: \"f2074d1f-a84f-4534-84ce-828e9fd12963\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75998xhm" Jul 22 16:29:30.875582 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:30.875561 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f2074d1f-a84f-4534-84ce-828e9fd12963-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75998xhm\" (UID: \"f2074d1f-a84f-4534-84ce-828e9fd12963\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75998xhm" Jul 22 16:29:30.875666 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:30.875643 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f2074d1f-a84f-4534-84ce-828e9fd12963-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75998xhm\" (UID: \"f2074d1f-a84f-4534-84ce-828e9fd12963\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75998xhm" Jul 22 16:29:30.883797 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:30.883764 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2q7d2\" (UniqueName: \"kubernetes.io/projected/f2074d1f-a84f-4534-84ce-828e9fd12963-kube-api-access-2q7d2\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75998xhm\" (UID: \"f2074d1f-a84f-4534-84ce-828e9fd12963\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75998xhm" Jul 22 16:29:30.953627 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:30.953589 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75998xhm" Jul 22 16:29:31.029067 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:31.029031 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c95cw"] Jul 22 16:29:31.033192 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:31.033169 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c95cw" Jul 22 16:29:31.041150 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:31.041114 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c95cw"] Jul 22 16:29:31.103832 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:31.103807 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75998xhm"] Jul 22 16:29:31.116571 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:29:31.116532 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2074d1f_a84f_4534_84ce_828e9fd12963.slice/crio-c467d4f6a5cef4e7d03180b408865c136ffe51dc62dd75270c7bae1716cfc8ca WatchSource:0}: Error finding container c467d4f6a5cef4e7d03180b408865c136ffe51dc62dd75270c7bae1716cfc8ca: Status 404 returned error can't find the container with id c467d4f6a5cef4e7d03180b408865c136ffe51dc62dd75270c7bae1716cfc8ca Jul 22 16:29:31.177653 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:31.177622 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/37c0e045-28be-4674-ad82-91268755751f-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c95cw\" (UID: \"37c0e045-28be-4674-ad82-91268755751f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c95cw" Jul 22 16:29:31.177748 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:31.177691 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/37c0e045-28be-4674-ad82-91268755751f-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c95cw\" (UID: \"37c0e045-28be-4674-ad82-91268755751f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c95cw" Jul 22 16:29:31.177806 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:31.177747 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bnj89\" (UniqueName: \"kubernetes.io/projected/37c0e045-28be-4674-ad82-91268755751f-kube-api-access-bnj89\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c95cw\" (UID: \"37c0e045-28be-4674-ad82-91268755751f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c95cw" Jul 22 16:29:31.278470 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:31.278435 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/37c0e045-28be-4674-ad82-91268755751f-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c95cw\" (UID: \"37c0e045-28be-4674-ad82-91268755751f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c95cw" Jul 22 16:29:31.278658 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:31.278500 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/37c0e045-28be-4674-ad82-91268755751f-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c95cw\" (UID: \"37c0e045-28be-4674-ad82-91268755751f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c95cw" Jul 22 16:29:31.278658 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:31.278548 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bnj89\" (UniqueName: \"kubernetes.io/projected/37c0e045-28be-4674-ad82-91268755751f-kube-api-access-bnj89\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c95cw\" (UID: \"37c0e045-28be-4674-ad82-91268755751f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c95cw" Jul 22 16:29:31.278888 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:31.278861 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/37c0e045-28be-4674-ad82-91268755751f-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c95cw\" (UID: \"37c0e045-28be-4674-ad82-91268755751f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c95cw" Jul 22 16:29:31.278959 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:31.278851 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/37c0e045-28be-4674-ad82-91268755751f-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c95cw\" (UID: \"37c0e045-28be-4674-ad82-91268755751f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c95cw" Jul 22 16:29:31.287545 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:31.287520 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bnj89\" (UniqueName: \"kubernetes.io/projected/37c0e045-28be-4674-ad82-91268755751f-kube-api-access-bnj89\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c95cw\" (UID: \"37c0e045-28be-4674-ad82-91268755751f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c95cw" Jul 22 16:29:31.345174 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:31.345135 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c95cw" Jul 22 16:29:31.482073 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:31.482046 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c95cw"] Jul 22 16:29:31.483833 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:29:31.483794 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37c0e045_28be_4674_ad82_91268755751f.slice/crio-d35068d467f27445074a24d964ae317bc5e2116edaba667909a3975faf4c9771 WatchSource:0}: Error finding container d35068d467f27445074a24d964ae317bc5e2116edaba667909a3975faf4c9771: Status 404 returned error can't find the container with id d35068d467f27445074a24d964ae317bc5e2116edaba667909a3975faf4c9771 Jul 22 16:29:31.595586 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:31.595558 2568 generic.go:356] "Generic (PLEG): container finished" podID="a001a5ac-8967-4f5c-b0f4-9326356ac5b5" containerID="37d7b7b8578a67bbf99501e2abf491808812bd6179d5b213e423bd8a685fe85a" exitCode=0 Jul 22 16:29:31.595742 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:31.595628 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x7lf2" event={"ID":"a001a5ac-8967-4f5c-b0f4-9326356ac5b5","Type":"ContainerDied","Data":"37d7b7b8578a67bbf99501e2abf491808812bd6179d5b213e423bd8a685fe85a"} Jul 22 16:29:31.597127 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:31.597068 2568 generic.go:356] "Generic (PLEG): container finished" podID="37c0e045-28be-4674-ad82-91268755751f" containerID="157af4767b059ed2a77b97bfb2065f16cfe335f3af18faaa7cf2c05ec0203585" exitCode=0 Jul 22 16:29:31.597188 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:31.597155 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c95cw" event={"ID":"37c0e045-28be-4674-ad82-91268755751f","Type":"ContainerDied","Data":"157af4767b059ed2a77b97bfb2065f16cfe335f3af18faaa7cf2c05ec0203585"} Jul 22 16:29:31.597240 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:31.597202 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c95cw" event={"ID":"37c0e045-28be-4674-ad82-91268755751f","Type":"ContainerStarted","Data":"d35068d467f27445074a24d964ae317bc5e2116edaba667909a3975faf4c9771"} Jul 22 16:29:31.598776 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:31.598753 2568 generic.go:356] "Generic (PLEG): container finished" podID="f2074d1f-a84f-4534-84ce-828e9fd12963" containerID="67121c224459f7aadb309df778b71ef8a9fdba6e6331961b81248b82df4538d7" exitCode=0 Jul 22 16:29:31.598860 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:31.598827 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75998xhm" event={"ID":"f2074d1f-a84f-4534-84ce-828e9fd12963","Type":"ContainerDied","Data":"67121c224459f7aadb309df778b71ef8a9fdba6e6331961b81248b82df4538d7"} Jul 22 16:29:31.598908 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:31.598862 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75998xhm" event={"ID":"f2074d1f-a84f-4534-84ce-828e9fd12963","Type":"ContainerStarted","Data":"c467d4f6a5cef4e7d03180b408865c136ffe51dc62dd75270c7bae1716cfc8ca"} Jul 22 16:29:31.600535 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:31.600436 2568 generic.go:356] "Generic (PLEG): container finished" podID="344287ba-b88d-4668-87cd-3b268afeb07d" containerID="8639b790332f9cc1f19910476c2b6a7decfa3a69fc5af71e645551f4b5a46036" exitCode=0 Jul 22 16:29:31.600535 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:31.600464 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ffg42" event={"ID":"344287ba-b88d-4668-87cd-3b268afeb07d","Type":"ContainerDied","Data":"8639b790332f9cc1f19910476c2b6a7decfa3a69fc5af71e645551f4b5a46036"} Jul 22 16:29:31.600535 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:31.600509 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ffg42" event={"ID":"344287ba-b88d-4668-87cd-3b268afeb07d","Type":"ContainerStarted","Data":"b0e9d061d6a9079c913f665a3db898651ffe5942d33e3d397fb5f8525062079a"} Jul 22 16:29:32.608267 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:32.608232 2568 generic.go:356] "Generic (PLEG): container finished" podID="344287ba-b88d-4668-87cd-3b268afeb07d" containerID="198178708c52d5a96d1da73e8d4dfea1cf2652391026cc6dcdc34c0f1a1f6f60" exitCode=0 Jul 22 16:29:32.608792 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:32.608319 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ffg42" event={"ID":"344287ba-b88d-4668-87cd-3b268afeb07d","Type":"ContainerDied","Data":"198178708c52d5a96d1da73e8d4dfea1cf2652391026cc6dcdc34c0f1a1f6f60"} Jul 22 16:29:32.610600 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:32.610580 2568 generic.go:356] "Generic (PLEG): container finished" podID="a001a5ac-8967-4f5c-b0f4-9326356ac5b5" containerID="29226f58f4f27d9d0de335897403191379938a6d96f9c04873e565ed1b48e65d" exitCode=0 Jul 22 16:29:32.610689 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:32.610669 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x7lf2" event={"ID":"a001a5ac-8967-4f5c-b0f4-9326356ac5b5","Type":"ContainerDied","Data":"29226f58f4f27d9d0de335897403191379938a6d96f9c04873e565ed1b48e65d"} Jul 22 16:29:32.612410 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:32.612388 2568 generic.go:356] "Generic (PLEG): container finished" podID="37c0e045-28be-4674-ad82-91268755751f" containerID="5a81ffc51eb2320ec888bffbbb64f1a3d8f61d1d9084ac92b5ae23e8fd4af97f" exitCode=0 Jul 22 16:29:32.612537 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:32.612465 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c95cw" event={"ID":"37c0e045-28be-4674-ad82-91268755751f","Type":"ContainerDied","Data":"5a81ffc51eb2320ec888bffbbb64f1a3d8f61d1d9084ac92b5ae23e8fd4af97f"} Jul 22 16:29:32.614330 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:32.614312 2568 generic.go:356] "Generic (PLEG): container finished" podID="f2074d1f-a84f-4534-84ce-828e9fd12963" containerID="9afd00bb2eacceed35a329bf81411887ce81f54ae5ab5e8dad6156cbe94eb079" exitCode=0 Jul 22 16:29:32.614455 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:32.614379 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75998xhm" event={"ID":"f2074d1f-a84f-4534-84ce-828e9fd12963","Type":"ContainerDied","Data":"9afd00bb2eacceed35a329bf81411887ce81f54ae5ab5e8dad6156cbe94eb079"} Jul 22 16:29:33.623769 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:33.623721 2568 generic.go:356] "Generic (PLEG): container finished" podID="37c0e045-28be-4674-ad82-91268755751f" containerID="492519b111306111598fcf458c629f1f3ff304276cf51028243455db519f7873" exitCode=0 Jul 22 16:29:33.624264 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:33.623940 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c95cw" event={"ID":"37c0e045-28be-4674-ad82-91268755751f","Type":"ContainerDied","Data":"492519b111306111598fcf458c629f1f3ff304276cf51028243455db519f7873"} Jul 22 16:29:33.626620 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:33.626573 2568 generic.go:356] "Generic (PLEG): container finished" podID="f2074d1f-a84f-4534-84ce-828e9fd12963" containerID="52f1251f86dc2d68734b1826f97ae045c915aa90673bf0eb717f555af900cfff" exitCode=0 Jul 22 16:29:33.626620 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:33.626609 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75998xhm" event={"ID":"f2074d1f-a84f-4534-84ce-828e9fd12963","Type":"ContainerDied","Data":"52f1251f86dc2d68734b1826f97ae045c915aa90673bf0eb717f555af900cfff"} Jul 22 16:29:33.628722 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:33.628598 2568 generic.go:356] "Generic (PLEG): container finished" podID="344287ba-b88d-4668-87cd-3b268afeb07d" containerID="e63ff374f437367ebf1844640a31fc2e085d68cfb9db02354ef00a16ef3b867f" exitCode=0 Jul 22 16:29:33.628722 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:33.628672 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ffg42" event={"ID":"344287ba-b88d-4668-87cd-3b268afeb07d","Type":"ContainerDied","Data":"e63ff374f437367ebf1844640a31fc2e085d68cfb9db02354ef00a16ef3b867f"} Jul 22 16:29:33.771752 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:33.771718 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x7lf2" Jul 22 16:29:33.904621 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:33.904537 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xgj7g\" (UniqueName: \"kubernetes.io/projected/a001a5ac-8967-4f5c-b0f4-9326356ac5b5-kube-api-access-xgj7g\") pod \"a001a5ac-8967-4f5c-b0f4-9326356ac5b5\" (UID: \"a001a5ac-8967-4f5c-b0f4-9326356ac5b5\") " Jul 22 16:29:33.904621 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:33.904584 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a001a5ac-8967-4f5c-b0f4-9326356ac5b5-bundle\") pod \"a001a5ac-8967-4f5c-b0f4-9326356ac5b5\" (UID: \"a001a5ac-8967-4f5c-b0f4-9326356ac5b5\") " Jul 22 16:29:33.904621 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:33.904616 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a001a5ac-8967-4f5c-b0f4-9326356ac5b5-util\") pod \"a001a5ac-8967-4f5c-b0f4-9326356ac5b5\" (UID: \"a001a5ac-8967-4f5c-b0f4-9326356ac5b5\") " Jul 22 16:29:33.905331 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:33.905299 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a001a5ac-8967-4f5c-b0f4-9326356ac5b5-bundle" (OuterVolumeSpecName: "bundle") pod "a001a5ac-8967-4f5c-b0f4-9326356ac5b5" (UID: "a001a5ac-8967-4f5c-b0f4-9326356ac5b5"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 16:29:33.906759 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:33.906731 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a001a5ac-8967-4f5c-b0f4-9326356ac5b5-kube-api-access-xgj7g" (OuterVolumeSpecName: "kube-api-access-xgj7g") pod "a001a5ac-8967-4f5c-b0f4-9326356ac5b5" (UID: "a001a5ac-8967-4f5c-b0f4-9326356ac5b5"). InnerVolumeSpecName "kube-api-access-xgj7g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 16:29:33.910394 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:33.910369 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a001a5ac-8967-4f5c-b0f4-9326356ac5b5-util" (OuterVolumeSpecName: "util") pod "a001a5ac-8967-4f5c-b0f4-9326356ac5b5" (UID: "a001a5ac-8967-4f5c-b0f4-9326356ac5b5"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 16:29:34.005878 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:34.005836 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xgj7g\" (UniqueName: \"kubernetes.io/projected/a001a5ac-8967-4f5c-b0f4-9326356ac5b5-kube-api-access-xgj7g\") on node \"ip-10-0-133-47.ec2.internal\" DevicePath \"\"" Jul 22 16:29:34.005878 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:34.005873 2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a001a5ac-8967-4f5c-b0f4-9326356ac5b5-bundle\") on node \"ip-10-0-133-47.ec2.internal\" DevicePath \"\"" Jul 22 16:29:34.005878 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:34.005885 2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a001a5ac-8967-4f5c-b0f4-9326356ac5b5-util\") on node \"ip-10-0-133-47.ec2.internal\" DevicePath \"\"" Jul 22 16:29:34.635861 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:34.635826 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x7lf2" Jul 22 16:29:34.635861 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:34.635824 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x7lf2" event={"ID":"a001a5ac-8967-4f5c-b0f4-9326356ac5b5","Type":"ContainerDied","Data":"9a591104c935b592913a5fe4ff97769d10121229f867d2015dadf932acb9f5be"} Jul 22 16:29:34.636428 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:34.635884 2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9a591104c935b592913a5fe4ff97769d10121229f867d2015dadf932acb9f5be" Jul 22 16:29:34.792024 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:34.791997 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c95cw" Jul 22 16:29:34.812781 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:34.812121 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bnj89\" (UniqueName: \"kubernetes.io/projected/37c0e045-28be-4674-ad82-91268755751f-kube-api-access-bnj89\") pod \"37c0e045-28be-4674-ad82-91268755751f\" (UID: \"37c0e045-28be-4674-ad82-91268755751f\") " Jul 22 16:29:34.812781 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:34.812206 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/37c0e045-28be-4674-ad82-91268755751f-util\") pod \"37c0e045-28be-4674-ad82-91268755751f\" (UID: \"37c0e045-28be-4674-ad82-91268755751f\") " Jul 22 16:29:34.812781 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:34.812292 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/37c0e045-28be-4674-ad82-91268755751f-bundle\") pod \"37c0e045-28be-4674-ad82-91268755751f\" (UID: \"37c0e045-28be-4674-ad82-91268755751f\") " Jul 22 16:29:34.813621 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:34.813580 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37c0e045-28be-4674-ad82-91268755751f-bundle" (OuterVolumeSpecName: "bundle") pod "37c0e045-28be-4674-ad82-91268755751f" (UID: "37c0e045-28be-4674-ad82-91268755751f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 16:29:34.815611 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:34.815566 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/37c0e045-28be-4674-ad82-91268755751f-kube-api-access-bnj89" (OuterVolumeSpecName: "kube-api-access-bnj89") pod "37c0e045-28be-4674-ad82-91268755751f" (UID: "37c0e045-28be-4674-ad82-91268755751f"). InnerVolumeSpecName "kube-api-access-bnj89". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 16:29:34.821078 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:34.821041 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37c0e045-28be-4674-ad82-91268755751f-util" (OuterVolumeSpecName: "util") pod "37c0e045-28be-4674-ad82-91268755751f" (UID: "37c0e045-28be-4674-ad82-91268755751f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 16:29:34.837945 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:34.837916 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ffg42" Jul 22 16:29:34.840803 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:34.840775 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75998xhm" Jul 22 16:29:34.912861 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:34.912823 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xpndr\" (UniqueName: \"kubernetes.io/projected/344287ba-b88d-4668-87cd-3b268afeb07d-kube-api-access-xpndr\") pod \"344287ba-b88d-4668-87cd-3b268afeb07d\" (UID: \"344287ba-b88d-4668-87cd-3b268afeb07d\") " Jul 22 16:29:34.913039 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:34.912868 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/344287ba-b88d-4668-87cd-3b268afeb07d-bundle\") pod \"344287ba-b88d-4668-87cd-3b268afeb07d\" (UID: \"344287ba-b88d-4668-87cd-3b268afeb07d\") " Jul 22 16:29:34.913039 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:34.912892 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f2074d1f-a84f-4534-84ce-828e9fd12963-util\") pod \"f2074d1f-a84f-4534-84ce-828e9fd12963\" (UID: \"f2074d1f-a84f-4534-84ce-828e9fd12963\") " Jul 22 16:29:34.913039 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:34.912929 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2q7d2\" (UniqueName: \"kubernetes.io/projected/f2074d1f-a84f-4534-84ce-828e9fd12963-kube-api-access-2q7d2\") pod \"f2074d1f-a84f-4534-84ce-828e9fd12963\" (UID: \"f2074d1f-a84f-4534-84ce-828e9fd12963\") " Jul 22 16:29:34.913039 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:34.913025 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/344287ba-b88d-4668-87cd-3b268afeb07d-util\") pod \"344287ba-b88d-4668-87cd-3b268afeb07d\" (UID: \"344287ba-b88d-4668-87cd-3b268afeb07d\") " Jul 22 16:29:34.913216 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:34.913059 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f2074d1f-a84f-4534-84ce-828e9fd12963-bundle\") pod \"f2074d1f-a84f-4534-84ce-828e9fd12963\" (UID: \"f2074d1f-a84f-4534-84ce-828e9fd12963\") " Jul 22 16:29:34.913311 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:34.913286 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bnj89\" (UniqueName: \"kubernetes.io/projected/37c0e045-28be-4674-ad82-91268755751f-kube-api-access-bnj89\") on node \"ip-10-0-133-47.ec2.internal\" DevicePath \"\"" Jul 22 16:29:34.913497 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:34.913480 2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/37c0e045-28be-4674-ad82-91268755751f-util\") on node \"ip-10-0-133-47.ec2.internal\" DevicePath \"\"" Jul 22 16:29:34.913639 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:34.913598 2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/37c0e045-28be-4674-ad82-91268755751f-bundle\") on node \"ip-10-0-133-47.ec2.internal\" DevicePath \"\"" Jul 22 16:29:34.913639 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:34.913508 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/344287ba-b88d-4668-87cd-3b268afeb07d-bundle" (OuterVolumeSpecName: "bundle") pod "344287ba-b88d-4668-87cd-3b268afeb07d" (UID: "344287ba-b88d-4668-87cd-3b268afeb07d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 16:29:34.913807 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:34.913679 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f2074d1f-a84f-4534-84ce-828e9fd12963-bundle" (OuterVolumeSpecName: "bundle") pod "f2074d1f-a84f-4534-84ce-828e9fd12963" (UID: "f2074d1f-a84f-4534-84ce-828e9fd12963"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 16:29:34.915016 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:34.914992 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/344287ba-b88d-4668-87cd-3b268afeb07d-kube-api-access-xpndr" (OuterVolumeSpecName: "kube-api-access-xpndr") pod "344287ba-b88d-4668-87cd-3b268afeb07d" (UID: "344287ba-b88d-4668-87cd-3b268afeb07d"). InnerVolumeSpecName "kube-api-access-xpndr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 16:29:34.915103 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:34.915092 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f2074d1f-a84f-4534-84ce-828e9fd12963-kube-api-access-2q7d2" (OuterVolumeSpecName: "kube-api-access-2q7d2") pod "f2074d1f-a84f-4534-84ce-828e9fd12963" (UID: "f2074d1f-a84f-4534-84ce-828e9fd12963"). InnerVolumeSpecName "kube-api-access-2q7d2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 16:29:34.918978 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:34.918935 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f2074d1f-a84f-4534-84ce-828e9fd12963-util" (OuterVolumeSpecName: "util") pod "f2074d1f-a84f-4534-84ce-828e9fd12963" (UID: "f2074d1f-a84f-4534-84ce-828e9fd12963"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 16:29:34.921557 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:34.921526 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/344287ba-b88d-4668-87cd-3b268afeb07d-util" (OuterVolumeSpecName: "util") pod "344287ba-b88d-4668-87cd-3b268afeb07d" (UID: "344287ba-b88d-4668-87cd-3b268afeb07d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 16:29:35.014423 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:35.014384 2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f2074d1f-a84f-4534-84ce-828e9fd12963-bundle\") on node \"ip-10-0-133-47.ec2.internal\" DevicePath \"\"" Jul 22 16:29:35.014423 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:35.014418 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xpndr\" (UniqueName: \"kubernetes.io/projected/344287ba-b88d-4668-87cd-3b268afeb07d-kube-api-access-xpndr\") on node \"ip-10-0-133-47.ec2.internal\" DevicePath \"\"" Jul 22 16:29:35.014423 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:35.014429 2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/344287ba-b88d-4668-87cd-3b268afeb07d-bundle\") on node \"ip-10-0-133-47.ec2.internal\" DevicePath \"\"" Jul 22 16:29:35.014651 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:35.014437 2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f2074d1f-a84f-4534-84ce-828e9fd12963-util\") on node \"ip-10-0-133-47.ec2.internal\" DevicePath \"\"" Jul 22 16:29:35.014651 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:35.014446 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2q7d2\" (UniqueName: \"kubernetes.io/projected/f2074d1f-a84f-4534-84ce-828e9fd12963-kube-api-access-2q7d2\") on node \"ip-10-0-133-47.ec2.internal\" DevicePath \"\"" Jul 22 16:29:35.014651 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:35.014454 2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/344287ba-b88d-4668-87cd-3b268afeb07d-util\") on node \"ip-10-0-133-47.ec2.internal\" DevicePath \"\"" Jul 22 16:29:35.642818 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:35.642775 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ffg42" event={"ID":"344287ba-b88d-4668-87cd-3b268afeb07d","Type":"ContainerDied","Data":"b0e9d061d6a9079c913f665a3db898651ffe5942d33e3d397fb5f8525062079a"} Jul 22 16:29:35.642818 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:35.642808 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ffg42" Jul 22 16:29:35.643283 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:35.642846 2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b0e9d061d6a9079c913f665a3db898651ffe5942d33e3d397fb5f8525062079a" Jul 22 16:29:35.645141 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:35.645123 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c95cw" Jul 22 16:29:35.645141 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:35.645134 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c95cw" event={"ID":"37c0e045-28be-4674-ad82-91268755751f","Type":"ContainerDied","Data":"d35068d467f27445074a24d964ae317bc5e2116edaba667909a3975faf4c9771"} Jul 22 16:29:35.645339 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:35.645173 2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d35068d467f27445074a24d964ae317bc5e2116edaba667909a3975faf4c9771" Jul 22 16:29:35.647309 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:35.647287 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75998xhm" event={"ID":"f2074d1f-a84f-4534-84ce-828e9fd12963","Type":"ContainerDied","Data":"c467d4f6a5cef4e7d03180b408865c136ffe51dc62dd75270c7bae1716cfc8ca"} Jul 22 16:29:35.647452 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:35.647323 2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c467d4f6a5cef4e7d03180b408865c136ffe51dc62dd75270c7bae1716cfc8ca" Jul 22 16:29:35.647452 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:35.647329 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75998xhm" Jul 22 16:29:39.992476 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:39.992444 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xtj5k"] Jul 22 16:29:39.992947 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:39.992774 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37c0e045-28be-4674-ad82-91268755751f" containerName="util" Jul 22 16:29:39.992947 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:39.992784 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="37c0e045-28be-4674-ad82-91268755751f" containerName="util" Jul 22 16:29:39.992947 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:39.992793 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a001a5ac-8967-4f5c-b0f4-9326356ac5b5" containerName="extract" Jul 22 16:29:39.992947 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:39.992799 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="a001a5ac-8967-4f5c-b0f4-9326356ac5b5" containerName="extract" Jul 22 16:29:39.992947 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:39.992808 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a001a5ac-8967-4f5c-b0f4-9326356ac5b5" containerName="pull" Jul 22 16:29:39.992947 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:39.992813 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="a001a5ac-8967-4f5c-b0f4-9326356ac5b5" containerName="pull" Jul 22 16:29:39.992947 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:39.992819 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37c0e045-28be-4674-ad82-91268755751f" containerName="pull" Jul 22 16:29:39.992947 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:39.992824 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="37c0e045-28be-4674-ad82-91268755751f" containerName="pull" Jul 22 16:29:39.992947 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:39.992847 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2074d1f-a84f-4534-84ce-828e9fd12963" containerName="pull" Jul 22 16:29:39.992947 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:39.992853 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2074d1f-a84f-4534-84ce-828e9fd12963" containerName="pull" Jul 22 16:29:39.992947 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:39.992859 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="344287ba-b88d-4668-87cd-3b268afeb07d" containerName="extract" Jul 22 16:29:39.992947 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:39.992864 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="344287ba-b88d-4668-87cd-3b268afeb07d" containerName="extract" Jul 22 16:29:39.992947 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:39.992872 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2074d1f-a84f-4534-84ce-828e9fd12963" containerName="extract" Jul 22 16:29:39.992947 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:39.992877 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2074d1f-a84f-4534-84ce-828e9fd12963" containerName="extract" Jul 22 16:29:39.992947 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:39.992884 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2074d1f-a84f-4534-84ce-828e9fd12963" containerName="util" Jul 22 16:29:39.992947 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:39.992889 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2074d1f-a84f-4534-84ce-828e9fd12963" containerName="util" Jul 22 16:29:39.992947 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:39.992897 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="344287ba-b88d-4668-87cd-3b268afeb07d" containerName="util" Jul 22 16:29:39.992947 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:39.992903 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="344287ba-b88d-4668-87cd-3b268afeb07d" containerName="util" Jul 22 16:29:39.992947 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:39.992919 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37c0e045-28be-4674-ad82-91268755751f" containerName="extract" Jul 22 16:29:39.992947 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:39.992927 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="37c0e045-28be-4674-ad82-91268755751f" containerName="extract" Jul 22 16:29:39.992947 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:39.992936 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a001a5ac-8967-4f5c-b0f4-9326356ac5b5" containerName="util" Jul 22 16:29:39.992947 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:39.992942 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="a001a5ac-8967-4f5c-b0f4-9326356ac5b5" containerName="util" Jul 22 16:29:39.992947 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:39.992949 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="344287ba-b88d-4668-87cd-3b268afeb07d" containerName="pull" Jul 22 16:29:39.992947 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:39.992954 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="344287ba-b88d-4668-87cd-3b268afeb07d" containerName="pull" Jul 22 16:29:39.994128 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:39.993015 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="a001a5ac-8967-4f5c-b0f4-9326356ac5b5" containerName="extract" Jul 22 16:29:39.994128 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:39.993022 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="344287ba-b88d-4668-87cd-3b268afeb07d" containerName="extract" Jul 22 16:29:39.994128 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:39.993028 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="f2074d1f-a84f-4534-84ce-828e9fd12963" containerName="extract" Jul 22 16:29:39.994128 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:39.993036 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="37c0e045-28be-4674-ad82-91268755751f" containerName="extract" Jul 22 16:29:39.997504 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:39.997487 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xtj5k" Jul 22 16:29:40.000158 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:40.000137 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-qg58g\"" Jul 22 16:29:40.008488 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:40.008459 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xtj5k"] Jul 22 16:29:40.058152 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:40.058113 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kplnj\" (UniqueName: \"kubernetes.io/projected/0e8f8c14-f474-4533-9cd4-e0682cad54db-kube-api-access-kplnj\") pod \"limitador-operator-controller-manager-859d7b78bd-xtj5k\" (UID: \"0e8f8c14-f474-4533-9cd4-e0682cad54db\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xtj5k" Jul 22 16:29:40.159268 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:40.159232 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kplnj\" (UniqueName: \"kubernetes.io/projected/0e8f8c14-f474-4533-9cd4-e0682cad54db-kube-api-access-kplnj\") pod \"limitador-operator-controller-manager-859d7b78bd-xtj5k\" (UID: \"0e8f8c14-f474-4533-9cd4-e0682cad54db\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xtj5k" Jul 22 16:29:40.172245 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:40.172215 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kplnj\" (UniqueName: \"kubernetes.io/projected/0e8f8c14-f474-4533-9cd4-e0682cad54db-kube-api-access-kplnj\") pod \"limitador-operator-controller-manager-859d7b78bd-xtj5k\" (UID: \"0e8f8c14-f474-4533-9cd4-e0682cad54db\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xtj5k" Jul 22 16:29:40.308273 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:40.308182 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xtj5k" Jul 22 16:29:40.450089 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:40.449938 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xtj5k"] Jul 22 16:29:40.452847 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:29:40.452818 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e8f8c14_f474_4533_9cd4_e0682cad54db.slice/crio-b5eecbd38c8741c92da55544026f6f8bc2f00c23ae6cb37cd33f6dbeb5070714 WatchSource:0}: Error finding container b5eecbd38c8741c92da55544026f6f8bc2f00c23ae6cb37cd33f6dbeb5070714: Status 404 returned error can't find the container with id b5eecbd38c8741c92da55544026f6f8bc2f00c23ae6cb37cd33f6dbeb5070714 Jul 22 16:29:40.677702 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:40.677612 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xtj5k" event={"ID":"0e8f8c14-f474-4533-9cd4-e0682cad54db","Type":"ContainerStarted","Data":"b5eecbd38c8741c92da55544026f6f8bc2f00c23ae6cb37cd33f6dbeb5070714"} Jul 22 16:29:42.690850 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:42.690811 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xtj5k" event={"ID":"0e8f8c14-f474-4533-9cd4-e0682cad54db","Type":"ContainerStarted","Data":"ebfe101adc251857286195859a21161d89d0515462260ed80de83fd3de110f9e"} Jul 22 16:29:42.691338 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:42.690936 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xtj5k" Jul 22 16:29:42.716324 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:42.716274 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xtj5k" podStartSLOduration=2.236305388 podStartE2EDuration="3.716260328s" totalImagesPullingTime="1.47995494s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:29:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:29:42.71377815 +0000 UTC m=+434.815393728" watchObservedRunningTime="2026-07-22 16:29:42.716260328 +0000 UTC m=+434.817875903" Jul 22 16:29:45.766015 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:45.765977 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kft9x"] Jul 22 16:29:45.773019 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:45.772994 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kft9x" Jul 22 16:29:45.776460 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:45.776437 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-stkvr\"" Jul 22 16:29:45.785562 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:45.785533 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kft9x"] Jul 22 16:29:45.807646 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:45.807606 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5xv4c\" (UniqueName: \"kubernetes.io/projected/b931aad1-10af-4206-a099-95c9bb7b1c1c-kube-api-access-5xv4c\") pod \"kuadrant-operator-controller-manager-8684c9ff49-kft9x\" (UID: \"b931aad1-10af-4206-a099-95c9bb7b1c1c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kft9x" Jul 22 16:29:45.807783 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:45.807669 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b931aad1-10af-4206-a099-95c9bb7b1c1c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-kft9x\" (UID: \"b931aad1-10af-4206-a099-95c9bb7b1c1c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kft9x" Jul 22 16:29:45.908498 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:45.908447 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5xv4c\" (UniqueName: \"kubernetes.io/projected/b931aad1-10af-4206-a099-95c9bb7b1c1c-kube-api-access-5xv4c\") pod \"kuadrant-operator-controller-manager-8684c9ff49-kft9x\" (UID: \"b931aad1-10af-4206-a099-95c9bb7b1c1c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kft9x" Jul 22 16:29:45.908684 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:45.908551 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b931aad1-10af-4206-a099-95c9bb7b1c1c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-kft9x\" (UID: \"b931aad1-10af-4206-a099-95c9bb7b1c1c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kft9x" Jul 22 16:29:45.908939 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:45.908920 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b931aad1-10af-4206-a099-95c9bb7b1c1c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-kft9x\" (UID: \"b931aad1-10af-4206-a099-95c9bb7b1c1c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kft9x" Jul 22 16:29:45.919895 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:45.919854 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5xv4c\" (UniqueName: \"kubernetes.io/projected/b931aad1-10af-4206-a099-95c9bb7b1c1c-kube-api-access-5xv4c\") pod \"kuadrant-operator-controller-manager-8684c9ff49-kft9x\" (UID: \"b931aad1-10af-4206-a099-95c9bb7b1c1c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kft9x" Jul 22 16:29:46.083223 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:46.083135 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kft9x" Jul 22 16:29:46.233365 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:46.233323 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kft9x"] Jul 22 16:29:46.235836 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:29:46.235807 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb931aad1_10af_4206_a099_95c9bb7b1c1c.slice/crio-94783ed2b156c8ee9b1e0f933b6365af0e05a70fc763143b6fd63da6aa18a415 WatchSource:0}: Error finding container 94783ed2b156c8ee9b1e0f933b6365af0e05a70fc763143b6fd63da6aa18a415: Status 404 returned error can't find the container with id 94783ed2b156c8ee9b1e0f933b6365af0e05a70fc763143b6fd63da6aa18a415 Jul 22 16:29:46.717136 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:46.717062 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kft9x" event={"ID":"b931aad1-10af-4206-a099-95c9bb7b1c1c","Type":"ContainerStarted","Data":"94783ed2b156c8ee9b1e0f933b6365af0e05a70fc763143b6fd63da6aa18a415"} Jul 22 16:29:48.933070 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:48.933029 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-8p94r"] Jul 22 16:29:48.936752 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:48.936734 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-8p94r" Jul 22 16:29:48.939542 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:48.939520 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jul 22 16:29:48.939631 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:48.939587 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-gm8dz\"" Jul 22 16:29:48.947750 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:48.947725 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-8p94r"] Jul 22 16:29:49.035030 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:49.034986 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-svk9p\" (UniqueName: \"kubernetes.io/projected/4d9edac5-f5eb-4430-9754-af308c5b6928-kube-api-access-svk9p\") pod \"dns-operator-controller-manager-864dd78c4c-8p94r\" (UID: \"4d9edac5-f5eb-4430-9754-af308c5b6928\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-8p94r" Jul 22 16:29:49.136004 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:49.135946 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svk9p\" (UniqueName: \"kubernetes.io/projected/4d9edac5-f5eb-4430-9754-af308c5b6928-kube-api-access-svk9p\") pod \"dns-operator-controller-manager-864dd78c4c-8p94r\" (UID: \"4d9edac5-f5eb-4430-9754-af308c5b6928\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-8p94r" Jul 22 16:29:49.153837 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:49.153801 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-svk9p\" (UniqueName: \"kubernetes.io/projected/4d9edac5-f5eb-4430-9754-af308c5b6928-kube-api-access-svk9p\") pod \"dns-operator-controller-manager-864dd78c4c-8p94r\" (UID: \"4d9edac5-f5eb-4430-9754-af308c5b6928\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-8p94r" Jul 22 16:29:49.248819 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:49.248768 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-8p94r" Jul 22 16:29:49.411317 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:49.411283 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-8p94r"] Jul 22 16:29:49.415161 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:29:49.415129 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d9edac5_f5eb_4430_9754_af308c5b6928.slice/crio-7feca9239fc6344a73ee1713678c29f941a8de93decfbd476a441e3190b78d3d WatchSource:0}: Error finding container 7feca9239fc6344a73ee1713678c29f941a8de93decfbd476a441e3190b78d3d: Status 404 returned error can't find the container with id 7feca9239fc6344a73ee1713678c29f941a8de93decfbd476a441e3190b78d3d Jul 22 16:29:49.736033 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:49.735986 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-8p94r" event={"ID":"4d9edac5-f5eb-4430-9754-af308c5b6928","Type":"ContainerStarted","Data":"7feca9239fc6344a73ee1713678c29f941a8de93decfbd476a441e3190b78d3d"} Jul 22 16:29:51.750876 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:51.750840 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kft9x" event={"ID":"b931aad1-10af-4206-a099-95c9bb7b1c1c","Type":"ContainerStarted","Data":"42623a5ada889da6bed9d721980278092bb9abbc618c0a810a7f0b75bb3a0b0b"} Jul 22 16:29:51.751328 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:51.750933 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kft9x" Jul 22 16:29:51.776875 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:51.776810 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kft9x" podStartSLOduration=2.307905272 podStartE2EDuration="6.77679374s" totalImagesPullingTime="4.468888468s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:29:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:29:51.775179903 +0000 UTC m=+443.876795520" watchObservedRunningTime="2026-07-22 16:29:51.77679374 +0000 UTC m=+443.878409315" Jul 22 16:29:52.541286 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:52.541249 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-kfcmk"] Jul 22 16:29:52.545137 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:52.545111 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-kfcmk" Jul 22 16:29:52.547990 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:52.547967 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-z8zch\"" Jul 22 16:29:52.563226 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:52.563195 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-kfcmk"] Jul 22 16:29:52.670230 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:52.670190 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khlcj\" (UniqueName: \"kubernetes.io/projected/a515d563-6944-405f-83fb-4150cc57b2dc-kube-api-access-khlcj\") pod \"authorino-operator-75cc8d5cb7-kfcmk\" (UID: \"a515d563-6944-405f-83fb-4150cc57b2dc\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-kfcmk" Jul 22 16:29:52.758026 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:52.757991 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-8p94r" event={"ID":"4d9edac5-f5eb-4430-9754-af308c5b6928","Type":"ContainerStarted","Data":"a782dcc6d9e61883cf1c2adb07398a912b9fd54f1262c117e8b5d269cc5fe729"} Jul 22 16:29:52.758461 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:52.758298 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-8p94r" Jul 22 16:29:52.771235 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:52.771194 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-khlcj\" (UniqueName: \"kubernetes.io/projected/a515d563-6944-405f-83fb-4150cc57b2dc-kube-api-access-khlcj\") pod \"authorino-operator-75cc8d5cb7-kfcmk\" (UID: \"a515d563-6944-405f-83fb-4150cc57b2dc\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-kfcmk" Jul 22 16:29:52.777160 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:52.777115 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-8p94r" podStartSLOduration=2.282333028 podStartE2EDuration="4.777100045s" totalImagesPullingTime="2.494767017s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:29:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:29:52.77537886 +0000 UTC m=+444.876994434" watchObservedRunningTime="2026-07-22 16:29:52.777100045 +0000 UTC m=+444.878715620" Jul 22 16:29:52.783662 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:52.783640 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-khlcj\" (UniqueName: \"kubernetes.io/projected/a515d563-6944-405f-83fb-4150cc57b2dc-kube-api-access-khlcj\") pod \"authorino-operator-75cc8d5cb7-kfcmk\" (UID: \"a515d563-6944-405f-83fb-4150cc57b2dc\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-kfcmk" Jul 22 16:29:52.855537 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:52.855443 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-kfcmk" Jul 22 16:29:52.996983 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:52.996948 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-kfcmk"] Jul 22 16:29:52.999068 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:29:52.999038 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda515d563_6944_405f_83fb_4150cc57b2dc.slice/crio-5b23ce023254e9f0360171ff82d824fd2e94520f11bc76eb34492a5816bf8e3f WatchSource:0}: Error finding container 5b23ce023254e9f0360171ff82d824fd2e94520f11bc76eb34492a5816bf8e3f: Status 404 returned error can't find the container with id 5b23ce023254e9f0360171ff82d824fd2e94520f11bc76eb34492a5816bf8e3f Jul 22 16:29:53.698855 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:53.698818 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xtj5k" Jul 22 16:29:53.769213 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:53.768661 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-kfcmk" event={"ID":"a515d563-6944-405f-83fb-4150cc57b2dc","Type":"ContainerStarted","Data":"5b23ce023254e9f0360171ff82d824fd2e94520f11bc76eb34492a5816bf8e3f"} Jul 22 16:29:53.856074 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:53.856043 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-dntbc"] Jul 22 16:29:53.860128 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:53.860101 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-dntbc" Jul 22 16:29:53.863404 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:53.863039 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jul 22 16:29:53.863404 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:53.863137 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jul 22 16:29:53.863404 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:53.863151 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-l2vmv\"" Jul 22 16:29:53.871435 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:53.871404 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-dntbc"] Jul 22 16:29:53.982772 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:53.982731 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c5c8cbc0-f7a9-4470-b489-682ad60673ac-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-dntbc\" (UID: \"c5c8cbc0-f7a9-4470-b489-682ad60673ac\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-dntbc" Jul 22 16:29:53.982986 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:53.982807 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/c5c8cbc0-f7a9-4470-b489-682ad60673ac-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-dntbc\" (UID: \"c5c8cbc0-f7a9-4470-b489-682ad60673ac\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-dntbc" Jul 22 16:29:53.982986 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:53.982835 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-scmvh\" (UniqueName: \"kubernetes.io/projected/c5c8cbc0-f7a9-4470-b489-682ad60673ac-kube-api-access-scmvh\") pod \"kuadrant-console-plugin-66b5774985-dntbc\" (UID: \"c5c8cbc0-f7a9-4470-b489-682ad60673ac\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-dntbc" Jul 22 16:29:54.083820 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:54.083784 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c5c8cbc0-f7a9-4470-b489-682ad60673ac-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-dntbc\" (UID: \"c5c8cbc0-f7a9-4470-b489-682ad60673ac\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-dntbc" Jul 22 16:29:54.084009 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:54.083852 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/c5c8cbc0-f7a9-4470-b489-682ad60673ac-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-dntbc\" (UID: \"c5c8cbc0-f7a9-4470-b489-682ad60673ac\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-dntbc" Jul 22 16:29:54.084009 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:54.083880 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-scmvh\" (UniqueName: \"kubernetes.io/projected/c5c8cbc0-f7a9-4470-b489-682ad60673ac-kube-api-access-scmvh\") pod \"kuadrant-console-plugin-66b5774985-dntbc\" (UID: \"c5c8cbc0-f7a9-4470-b489-682ad60673ac\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-dntbc" Jul 22 16:29:54.084258 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:29:54.084010 2568 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found Jul 22 16:29:54.084258 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:29:54.084091 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5c8cbc0-f7a9-4470-b489-682ad60673ac-plugin-serving-cert podName:c5c8cbc0-f7a9-4470-b489-682ad60673ac nodeName:}" failed. No retries permitted until 2026-07-22 16:29:54.584070143 +0000 UTC m=+446.685685714 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/c5c8cbc0-f7a9-4470-b489-682ad60673ac-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-dntbc" (UID: "c5c8cbc0-f7a9-4470-b489-682ad60673ac") : secret "plugin-serving-cert" not found Jul 22 16:29:54.084560 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:54.084519 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c5c8cbc0-f7a9-4470-b489-682ad60673ac-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-dntbc\" (UID: \"c5c8cbc0-f7a9-4470-b489-682ad60673ac\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-dntbc" Jul 22 16:29:54.094843 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:54.094820 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-scmvh\" (UniqueName: \"kubernetes.io/projected/c5c8cbc0-f7a9-4470-b489-682ad60673ac-kube-api-access-scmvh\") pod \"kuadrant-console-plugin-66b5774985-dntbc\" (UID: \"c5c8cbc0-f7a9-4470-b489-682ad60673ac\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-dntbc" Jul 22 16:29:54.589033 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:54.588992 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/c5c8cbc0-f7a9-4470-b489-682ad60673ac-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-dntbc\" (UID: \"c5c8cbc0-f7a9-4470-b489-682ad60673ac\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-dntbc" Jul 22 16:29:54.591783 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:54.591751 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/c5c8cbc0-f7a9-4470-b489-682ad60673ac-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-dntbc\" (UID: \"c5c8cbc0-f7a9-4470-b489-682ad60673ac\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-dntbc" Jul 22 16:29:54.774863 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:54.774830 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-dntbc" Jul 22 16:29:55.296266 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:55.296238 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-dntbc"] Jul 22 16:29:55.297747 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:29:55.297721 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc5c8cbc0_f7a9_4470_b489_682ad60673ac.slice/crio-eb75908282fec33d7643e87d2bda168917937284b3766e34a1d8f733bbebf7f1 WatchSource:0}: Error finding container eb75908282fec33d7643e87d2bda168917937284b3766e34a1d8f733bbebf7f1: Status 404 returned error can't find the container with id eb75908282fec33d7643e87d2bda168917937284b3766e34a1d8f733bbebf7f1 Jul 22 16:29:55.690233 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:55.690183 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-ff898c44b-szxvb" podUID="810bc8da-7ca0-4b66-a33d-52a5a514a73f" containerName="console" containerID="cri-o://2dad2916d515bd3b4572a1e2fd2ffa4f03bf9e12a25719604a335c09b504b5ee" gracePeriod=15 Jul 22 16:29:55.785029 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:55.784872 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-kfcmk" event={"ID":"a515d563-6944-405f-83fb-4150cc57b2dc","Type":"ContainerStarted","Data":"3056a1ec48311d771330c41531f3308040e6f7e31ba52b233df9564c3e223bac"} Jul 22 16:29:55.785029 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:55.784955 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-kfcmk" Jul 22 16:29:55.786988 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:55.786946 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-dntbc" event={"ID":"c5c8cbc0-f7a9-4470-b489-682ad60673ac","Type":"ContainerStarted","Data":"eb75908282fec33d7643e87d2bda168917937284b3766e34a1d8f733bbebf7f1"} Jul 22 16:29:55.812965 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:55.810473 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-kfcmk" podStartSLOduration=1.616370244 podStartE2EDuration="3.810450093s" totalImagesPullingTime="2.194079849s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:29:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:29:55.807951763 +0000 UTC m=+447.909567351" watchObservedRunningTime="2026-07-22 16:29:55.810450093 +0000 UTC m=+447.912065672" Jul 22 16:29:55.959482 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:55.959455 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-ff898c44b-szxvb" Jul 22 16:29:56.001751 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:56.001713 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/810bc8da-7ca0-4b66-a33d-52a5a514a73f-trusted-ca-bundle\") pod \"810bc8da-7ca0-4b66-a33d-52a5a514a73f\" (UID: \"810bc8da-7ca0-4b66-a33d-52a5a514a73f\") " Jul 22 16:29:56.001751 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:56.001756 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/810bc8da-7ca0-4b66-a33d-52a5a514a73f-oauth-serving-cert\") pod \"810bc8da-7ca0-4b66-a33d-52a5a514a73f\" (UID: \"810bc8da-7ca0-4b66-a33d-52a5a514a73f\") " Jul 22 16:29:56.001980 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:56.001798 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/810bc8da-7ca0-4b66-a33d-52a5a514a73f-console-oauth-config\") pod \"810bc8da-7ca0-4b66-a33d-52a5a514a73f\" (UID: \"810bc8da-7ca0-4b66-a33d-52a5a514a73f\") " Jul 22 16:29:56.001980 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:56.001835 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/810bc8da-7ca0-4b66-a33d-52a5a514a73f-console-config\") pod \"810bc8da-7ca0-4b66-a33d-52a5a514a73f\" (UID: \"810bc8da-7ca0-4b66-a33d-52a5a514a73f\") " Jul 22 16:29:56.001980 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:56.001919 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p5txb\" (UniqueName: \"kubernetes.io/projected/810bc8da-7ca0-4b66-a33d-52a5a514a73f-kube-api-access-p5txb\") pod \"810bc8da-7ca0-4b66-a33d-52a5a514a73f\" (UID: \"810bc8da-7ca0-4b66-a33d-52a5a514a73f\") " Jul 22 16:29:56.001980 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:56.001970 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/810bc8da-7ca0-4b66-a33d-52a5a514a73f-console-serving-cert\") pod \"810bc8da-7ca0-4b66-a33d-52a5a514a73f\" (UID: \"810bc8da-7ca0-4b66-a33d-52a5a514a73f\") " Jul 22 16:29:56.002204 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:56.002000 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/810bc8da-7ca0-4b66-a33d-52a5a514a73f-service-ca\") pod \"810bc8da-7ca0-4b66-a33d-52a5a514a73f\" (UID: \"810bc8da-7ca0-4b66-a33d-52a5a514a73f\") " Jul 22 16:29:56.002822 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:56.002654 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/810bc8da-7ca0-4b66-a33d-52a5a514a73f-service-ca" (OuterVolumeSpecName: "service-ca") pod "810bc8da-7ca0-4b66-a33d-52a5a514a73f" (UID: "810bc8da-7ca0-4b66-a33d-52a5a514a73f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 16:29:56.002929 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:56.002819 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/810bc8da-7ca0-4b66-a33d-52a5a514a73f-console-config" (OuterVolumeSpecName: "console-config") pod "810bc8da-7ca0-4b66-a33d-52a5a514a73f" (UID: "810bc8da-7ca0-4b66-a33d-52a5a514a73f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 16:29:56.003012 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:56.002986 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/810bc8da-7ca0-4b66-a33d-52a5a514a73f-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "810bc8da-7ca0-4b66-a33d-52a5a514a73f" (UID: "810bc8da-7ca0-4b66-a33d-52a5a514a73f"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 16:29:56.003074 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:56.003026 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/810bc8da-7ca0-4b66-a33d-52a5a514a73f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "810bc8da-7ca0-4b66-a33d-52a5a514a73f" (UID: "810bc8da-7ca0-4b66-a33d-52a5a514a73f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 16:29:56.004744 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:56.004702 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/810bc8da-7ca0-4b66-a33d-52a5a514a73f-kube-api-access-p5txb" (OuterVolumeSpecName: "kube-api-access-p5txb") pod "810bc8da-7ca0-4b66-a33d-52a5a514a73f" (UID: "810bc8da-7ca0-4b66-a33d-52a5a514a73f"). InnerVolumeSpecName "kube-api-access-p5txb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 16:29:56.005613 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:56.005586 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/810bc8da-7ca0-4b66-a33d-52a5a514a73f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "810bc8da-7ca0-4b66-a33d-52a5a514a73f" (UID: "810bc8da-7ca0-4b66-a33d-52a5a514a73f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 16:29:56.005716 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:56.005672 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/810bc8da-7ca0-4b66-a33d-52a5a514a73f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "810bc8da-7ca0-4b66-a33d-52a5a514a73f" (UID: "810bc8da-7ca0-4b66-a33d-52a5a514a73f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 16:29:56.102825 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:56.102790 2568 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/810bc8da-7ca0-4b66-a33d-52a5a514a73f-console-serving-cert\") on node \"ip-10-0-133-47.ec2.internal\" DevicePath \"\"" Jul 22 16:29:56.102825 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:56.102819 2568 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/810bc8da-7ca0-4b66-a33d-52a5a514a73f-service-ca\") on node \"ip-10-0-133-47.ec2.internal\" DevicePath \"\"" Jul 22 16:29:56.102825 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:56.102829 2568 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/810bc8da-7ca0-4b66-a33d-52a5a514a73f-trusted-ca-bundle\") on node \"ip-10-0-133-47.ec2.internal\" DevicePath \"\"" Jul 22 16:29:56.102825 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:56.102838 2568 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/810bc8da-7ca0-4b66-a33d-52a5a514a73f-oauth-serving-cert\") on node \"ip-10-0-133-47.ec2.internal\" DevicePath \"\"" Jul 22 16:29:56.103171 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:56.102846 2568 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/810bc8da-7ca0-4b66-a33d-52a5a514a73f-console-oauth-config\") on node \"ip-10-0-133-47.ec2.internal\" DevicePath \"\"" Jul 22 16:29:56.103171 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:56.102856 2568 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/810bc8da-7ca0-4b66-a33d-52a5a514a73f-console-config\") on node \"ip-10-0-133-47.ec2.internal\" DevicePath \"\"" Jul 22 16:29:56.103171 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:56.102864 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p5txb\" (UniqueName: \"kubernetes.io/projected/810bc8da-7ca0-4b66-a33d-52a5a514a73f-kube-api-access-p5txb\") on node \"ip-10-0-133-47.ec2.internal\" DevicePath \"\"" Jul 22 16:29:56.796284 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:56.796242 2568 generic.go:356] "Generic (PLEG): container finished" podID="810bc8da-7ca0-4b66-a33d-52a5a514a73f" containerID="2dad2916d515bd3b4572a1e2fd2ffa4f03bf9e12a25719604a335c09b504b5ee" exitCode=0 Jul 22 16:29:56.796803 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:56.796292 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-ff898c44b-szxvb" Jul 22 16:29:56.796803 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:56.796364 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-ff898c44b-szxvb" event={"ID":"810bc8da-7ca0-4b66-a33d-52a5a514a73f","Type":"ContainerDied","Data":"2dad2916d515bd3b4572a1e2fd2ffa4f03bf9e12a25719604a335c09b504b5ee"} Jul 22 16:29:56.796803 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:56.796420 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-ff898c44b-szxvb" event={"ID":"810bc8da-7ca0-4b66-a33d-52a5a514a73f","Type":"ContainerDied","Data":"a86812161fdf6d4acee630356de1bb5bcbd4c011349ad012586cc2c9d23bfc8f"} Jul 22 16:29:56.796803 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:56.796449 2568 scope.go:117] "RemoveContainer" containerID="2dad2916d515bd3b4572a1e2fd2ffa4f03bf9e12a25719604a335c09b504b5ee" Jul 22 16:29:56.808316 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:56.808060 2568 scope.go:117] "RemoveContainer" containerID="2dad2916d515bd3b4572a1e2fd2ffa4f03bf9e12a25719604a335c09b504b5ee" Jul 22 16:29:56.808432 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:29:56.808404 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2dad2916d515bd3b4572a1e2fd2ffa4f03bf9e12a25719604a335c09b504b5ee\": container with ID starting with 2dad2916d515bd3b4572a1e2fd2ffa4f03bf9e12a25719604a335c09b504b5ee not found: ID does not exist" containerID="2dad2916d515bd3b4572a1e2fd2ffa4f03bf9e12a25719604a335c09b504b5ee" Jul 22 16:29:56.808516 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:56.808445 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2dad2916d515bd3b4572a1e2fd2ffa4f03bf9e12a25719604a335c09b504b5ee"} err="failed to get container status \"2dad2916d515bd3b4572a1e2fd2ffa4f03bf9e12a25719604a335c09b504b5ee\": rpc error: code = NotFound desc = could not find container \"2dad2916d515bd3b4572a1e2fd2ffa4f03bf9e12a25719604a335c09b504b5ee\": container with ID starting with 2dad2916d515bd3b4572a1e2fd2ffa4f03bf9e12a25719604a335c09b504b5ee not found: ID does not exist" Jul 22 16:29:56.818247 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:56.818216 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-ff898c44b-szxvb"] Jul 22 16:29:56.826081 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:56.826053 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-ff898c44b-szxvb"] Jul 22 16:29:58.413804 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:29:58.413766 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="810bc8da-7ca0-4b66-a33d-52a5a514a73f" path="/var/lib/kubelet/pods/810bc8da-7ca0-4b66-a33d-52a5a514a73f/volumes" Jul 22 16:30:02.761431 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:02.761385 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kft9x" Jul 22 16:30:03.771776 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:03.771741 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-8p94r" Jul 22 16:30:06.798863 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:06.798828 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-kfcmk" Jul 22 16:30:11.690237 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:11.690190 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kft9x"] Jul 22 16:30:11.690729 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:11.690521 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kft9x" podUID="b931aad1-10af-4206-a099-95c9bb7b1c1c" containerName="manager" containerID="cri-o://42623a5ada889da6bed9d721980278092bb9abbc618c0a810a7f0b75bb3a0b0b" gracePeriod=2 Jul 22 16:30:11.693195 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:30:11.693146 2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-kft9x\" is forbidden: User \"system:node:ip-10-0-133-47.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-47.ec2.internal' and this object" podUID="b931aad1-10af-4206-a099-95c9bb7b1c1c" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kft9x" Jul 22 16:30:11.695563 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:11.695536 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kft9x"] Jul 22 16:30:11.715470 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:11.714970 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rmxlt"] Jul 22 16:30:11.715647 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:11.715581 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b931aad1-10af-4206-a099-95c9bb7b1c1c" containerName="manager" Jul 22 16:30:11.715647 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:11.715602 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="b931aad1-10af-4206-a099-95c9bb7b1c1c" containerName="manager" Jul 22 16:30:11.715647 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:11.715643 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="810bc8da-7ca0-4b66-a33d-52a5a514a73f" containerName="console" Jul 22 16:30:11.715813 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:11.715651 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="810bc8da-7ca0-4b66-a33d-52a5a514a73f" containerName="console" Jul 22 16:30:11.715813 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:11.715795 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="b931aad1-10af-4206-a099-95c9bb7b1c1c" containerName="manager" Jul 22 16:30:11.715917 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:11.715815 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="810bc8da-7ca0-4b66-a33d-52a5a514a73f" containerName="console" Jul 22 16:30:11.790543 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:11.790507 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r795k"] Jul 22 16:30:11.790746 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:11.790602 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rmxlt" Jul 22 16:30:11.793830 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:30:11.793644 2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-kft9x\" is forbidden: User \"system:node:ip-10-0-133-47.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-47.ec2.internal' and this object" podUID="b931aad1-10af-4206-a099-95c9bb7b1c1c" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kft9x" Jul 22 16:30:11.798419 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:11.798237 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xtj5k"] Jul 22 16:30:11.798419 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:11.798288 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rmxlt"] Jul 22 16:30:11.798419 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:11.798316 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xtj5k"] Jul 22 16:30:11.798419 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:11.798379 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r795k"] Jul 22 16:30:11.798726 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:11.798564 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xtj5k" podUID="0e8f8c14-f474-4533-9cd4-e0682cad54db" containerName="manager" containerID="cri-o://ebfe101adc251857286195859a21161d89d0515462260ed80de83fd3de110f9e" gracePeriod=2 Jul 22 16:30:11.798726 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:11.798657 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r795k" Jul 22 16:30:11.833715 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:30:11.833676 2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-kft9x\" is forbidden: User \"system:node:ip-10-0-133-47.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-47.ec2.internal' and this object" podUID="b931aad1-10af-4206-a099-95c9bb7b1c1c" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kft9x" Jul 22 16:30:11.835647 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:30:11.835609 2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-xtj5k\" is forbidden: User \"system:node:ip-10-0-133-47.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-47.ec2.internal' and this object" podUID="0e8f8c14-f474-4533-9cd4-e0682cad54db" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xtj5k" Jul 22 16:30:11.955593 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:11.955235 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6d0ea298-5bd8-4f65-9e07-82c929eccdb6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-r795k\" (UID: \"6d0ea298-5bd8-4f65-9e07-82c929eccdb6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r795k" Jul 22 16:30:11.955593 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:11.955309 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/48497379-8b10-4557-90a7-e5c2bd1c237f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rmxlt\" (UID: \"48497379-8b10-4557-90a7-e5c2bd1c237f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rmxlt" Jul 22 16:30:11.955593 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:11.955420 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtlw5\" (UniqueName: \"kubernetes.io/projected/6d0ea298-5bd8-4f65-9e07-82c929eccdb6-kube-api-access-jtlw5\") pod \"kuadrant-operator-controller-manager-86878c769f-r795k\" (UID: \"6d0ea298-5bd8-4f65-9e07-82c929eccdb6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r795k" Jul 22 16:30:11.955593 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:11.955457 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jgkxt\" (UniqueName: \"kubernetes.io/projected/48497379-8b10-4557-90a7-e5c2bd1c237f-kube-api-access-jgkxt\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rmxlt\" (UID: \"48497379-8b10-4557-90a7-e5c2bd1c237f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rmxlt" Jul 22 16:30:12.056673 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:12.056615 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jtlw5\" (UniqueName: \"kubernetes.io/projected/6d0ea298-5bd8-4f65-9e07-82c929eccdb6-kube-api-access-jtlw5\") pod \"kuadrant-operator-controller-manager-86878c769f-r795k\" (UID: \"6d0ea298-5bd8-4f65-9e07-82c929eccdb6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r795k" Jul 22 16:30:12.056876 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:12.056685 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jgkxt\" (UniqueName: \"kubernetes.io/projected/48497379-8b10-4557-90a7-e5c2bd1c237f-kube-api-access-jgkxt\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rmxlt\" (UID: \"48497379-8b10-4557-90a7-e5c2bd1c237f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rmxlt" Jul 22 16:30:12.056876 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:12.056730 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6d0ea298-5bd8-4f65-9e07-82c929eccdb6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-r795k\" (UID: \"6d0ea298-5bd8-4f65-9e07-82c929eccdb6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r795k" Jul 22 16:30:12.056876 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:12.056776 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/48497379-8b10-4557-90a7-e5c2bd1c237f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rmxlt\" (UID: \"48497379-8b10-4557-90a7-e5c2bd1c237f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rmxlt" Jul 22 16:30:12.057229 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:12.057203 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6d0ea298-5bd8-4f65-9e07-82c929eccdb6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-r795k\" (UID: \"6d0ea298-5bd8-4f65-9e07-82c929eccdb6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r795k" Jul 22 16:30:12.057323 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:12.057204 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/48497379-8b10-4557-90a7-e5c2bd1c237f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rmxlt\" (UID: \"48497379-8b10-4557-90a7-e5c2bd1c237f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rmxlt" Jul 22 16:30:12.072517 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:12.072488 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtlw5\" (UniqueName: \"kubernetes.io/projected/6d0ea298-5bd8-4f65-9e07-82c929eccdb6-kube-api-access-jtlw5\") pod \"kuadrant-operator-controller-manager-86878c769f-r795k\" (UID: \"6d0ea298-5bd8-4f65-9e07-82c929eccdb6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r795k" Jul 22 16:30:12.072683 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:12.072622 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jgkxt\" (UniqueName: \"kubernetes.io/projected/48497379-8b10-4557-90a7-e5c2bd1c237f-kube-api-access-jgkxt\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rmxlt\" (UID: \"48497379-8b10-4557-90a7-e5c2bd1c237f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rmxlt" Jul 22 16:30:12.209026 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:12.208932 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rmxlt" Jul 22 16:30:12.216062 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:12.216020 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r795k" Jul 22 16:30:17.420903 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:17.420872 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xtj5k" Jul 22 16:30:17.430538 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:17.426605 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r795k"] Jul 22 16:30:17.430749 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:30:17.430716 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d0ea298_5bd8_4f65_9e07_82c929eccdb6.slice/crio-1b120807239cde6793a5763bc9ecf6929cd63eb4b5c6a2acf0e15d85b5cc856e WatchSource:0}: Error finding container 1b120807239cde6793a5763bc9ecf6929cd63eb4b5c6a2acf0e15d85b5cc856e: Status 404 returned error can't find the container with id 1b120807239cde6793a5763bc9ecf6929cd63eb4b5c6a2acf0e15d85b5cc856e Jul 22 16:30:17.435198 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:17.435175 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kft9x" Jul 22 16:30:17.455789 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:17.455763 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rmxlt"] Jul 22 16:30:17.465469 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:30:17.465440 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48497379_8b10_4557_90a7_e5c2bd1c237f.slice/crio-4aa21be84b33531dab0a68405932e4f642f1132d017942a18fadf83608df9183 WatchSource:0}: Error finding container 4aa21be84b33531dab0a68405932e4f642f1132d017942a18fadf83608df9183: Status 404 returned error can't find the container with id 4aa21be84b33531dab0a68405932e4f642f1132d017942a18fadf83608df9183 Jul 22 16:30:17.513547 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:17.513525 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5xv4c\" (UniqueName: \"kubernetes.io/projected/b931aad1-10af-4206-a099-95c9bb7b1c1c-kube-api-access-5xv4c\") pod \"b931aad1-10af-4206-a099-95c9bb7b1c1c\" (UID: \"b931aad1-10af-4206-a099-95c9bb7b1c1c\") " Jul 22 16:30:17.513636 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:17.513578 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b931aad1-10af-4206-a099-95c9bb7b1c1c-extensions-socket-volume\") pod \"b931aad1-10af-4206-a099-95c9bb7b1c1c\" (UID: \"b931aad1-10af-4206-a099-95c9bb7b1c1c\") " Jul 22 16:30:17.513636 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:17.513598 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kplnj\" (UniqueName: \"kubernetes.io/projected/0e8f8c14-f474-4533-9cd4-e0682cad54db-kube-api-access-kplnj\") pod \"0e8f8c14-f474-4533-9cd4-e0682cad54db\" (UID: \"0e8f8c14-f474-4533-9cd4-e0682cad54db\") " Jul 22 16:30:17.514089 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:17.514064 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b931aad1-10af-4206-a099-95c9bb7b1c1c-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "b931aad1-10af-4206-a099-95c9bb7b1c1c" (UID: "b931aad1-10af-4206-a099-95c9bb7b1c1c"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 16:30:17.515666 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:17.515640 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e8f8c14-f474-4533-9cd4-e0682cad54db-kube-api-access-kplnj" (OuterVolumeSpecName: "kube-api-access-kplnj") pod "0e8f8c14-f474-4533-9cd4-e0682cad54db" (UID: "0e8f8c14-f474-4533-9cd4-e0682cad54db"). InnerVolumeSpecName "kube-api-access-kplnj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 16:30:17.515901 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:17.515865 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b931aad1-10af-4206-a099-95c9bb7b1c1c-kube-api-access-5xv4c" (OuterVolumeSpecName: "kube-api-access-5xv4c") pod "b931aad1-10af-4206-a099-95c9bb7b1c1c" (UID: "b931aad1-10af-4206-a099-95c9bb7b1c1c"). InnerVolumeSpecName "kube-api-access-5xv4c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 16:30:17.614635 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:17.614592 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5xv4c\" (UniqueName: \"kubernetes.io/projected/b931aad1-10af-4206-a099-95c9bb7b1c1c-kube-api-access-5xv4c\") on node \"ip-10-0-133-47.ec2.internal\" DevicePath \"\"" Jul 22 16:30:17.614635 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:17.614626 2568 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b931aad1-10af-4206-a099-95c9bb7b1c1c-extensions-socket-volume\") on node \"ip-10-0-133-47.ec2.internal\" DevicePath \"\"" Jul 22 16:30:17.614635 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:17.614637 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kplnj\" (UniqueName: \"kubernetes.io/projected/0e8f8c14-f474-4533-9cd4-e0682cad54db-kube-api-access-kplnj\") on node \"ip-10-0-133-47.ec2.internal\" DevicePath \"\"" Jul 22 16:30:17.949000 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:17.948874 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-dntbc" event={"ID":"c5c8cbc0-f7a9-4470-b489-682ad60673ac","Type":"ContainerStarted","Data":"d4ac665f852ef1258066305c32311a89134be276d948c7d466bdeb6575b8662c"} Jul 22 16:30:17.950977 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:17.950937 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rmxlt" event={"ID":"48497379-8b10-4557-90a7-e5c2bd1c237f","Type":"ContainerStarted","Data":"d0b30aa56c57863701363b3cd82d30fa4b8b23fbf6b9bda93f6e482ad253ec80"} Jul 22 16:30:17.951130 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:17.950993 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rmxlt" event={"ID":"48497379-8b10-4557-90a7-e5c2bd1c237f","Type":"ContainerStarted","Data":"4aa21be84b33531dab0a68405932e4f642f1132d017942a18fadf83608df9183"} Jul 22 16:30:17.951130 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:17.951022 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rmxlt" Jul 22 16:30:17.952539 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:17.952504 2568 generic.go:356] "Generic (PLEG): container finished" podID="b931aad1-10af-4206-a099-95c9bb7b1c1c" containerID="42623a5ada889da6bed9d721980278092bb9abbc618c0a810a7f0b75bb3a0b0b" exitCode=0 Jul 22 16:30:17.952685 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:17.952546 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kft9x" Jul 22 16:30:17.952685 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:17.952608 2568 scope.go:117] "RemoveContainer" containerID="42623a5ada889da6bed9d721980278092bb9abbc618c0a810a7f0b75bb3a0b0b" Jul 22 16:30:17.954563 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:17.954538 2568 generic.go:356] "Generic (PLEG): container finished" podID="0e8f8c14-f474-4533-9cd4-e0682cad54db" containerID="ebfe101adc251857286195859a21161d89d0515462260ed80de83fd3de110f9e" exitCode=0 Jul 22 16:30:17.954685 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:17.954581 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xtj5k" Jul 22 16:30:17.956636 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:17.956532 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r795k" event={"ID":"6d0ea298-5bd8-4f65-9e07-82c929eccdb6","Type":"ContainerStarted","Data":"8abfe062c7fa7a80d5ece6ace36560df082ab860ca12b638768c53a1076f0912"} Jul 22 16:30:17.956636 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:17.956575 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r795k" event={"ID":"6d0ea298-5bd8-4f65-9e07-82c929eccdb6","Type":"ContainerStarted","Data":"1b120807239cde6793a5763bc9ecf6929cd63eb4b5c6a2acf0e15d85b5cc856e"} Jul 22 16:30:17.956786 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:17.956653 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r795k" Jul 22 16:30:17.963022 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:17.962923 2568 scope.go:117] "RemoveContainer" containerID="42623a5ada889da6bed9d721980278092bb9abbc618c0a810a7f0b75bb3a0b0b" Jul 22 16:30:17.963432 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:30:17.963403 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"42623a5ada889da6bed9d721980278092bb9abbc618c0a810a7f0b75bb3a0b0b\": container with ID starting with 42623a5ada889da6bed9d721980278092bb9abbc618c0a810a7f0b75bb3a0b0b not found: ID does not exist" containerID="42623a5ada889da6bed9d721980278092bb9abbc618c0a810a7f0b75bb3a0b0b" Jul 22 16:30:17.963540 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:17.963445 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"42623a5ada889da6bed9d721980278092bb9abbc618c0a810a7f0b75bb3a0b0b"} err="failed to get container status \"42623a5ada889da6bed9d721980278092bb9abbc618c0a810a7f0b75bb3a0b0b\": rpc error: code = NotFound desc = could not find container \"42623a5ada889da6bed9d721980278092bb9abbc618c0a810a7f0b75bb3a0b0b\": container with ID starting with 42623a5ada889da6bed9d721980278092bb9abbc618c0a810a7f0b75bb3a0b0b not found: ID does not exist" Jul 22 16:30:17.963540 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:17.963470 2568 scope.go:117] "RemoveContainer" containerID="ebfe101adc251857286195859a21161d89d0515462260ed80de83fd3de110f9e" Jul 22 16:30:17.965739 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:17.965696 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-dntbc" podStartSLOduration=2.911794742 podStartE2EDuration="24.965681793s" totalImagesPullingTime="22.053887051s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:29:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:30:17.965268001 +0000 UTC m=+470.066883567" watchObservedRunningTime="2026-07-22 16:30:17.965681793 +0000 UTC m=+470.067297371" Jul 22 16:30:17.972976 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:17.972955 2568 scope.go:117] "RemoveContainer" containerID="ebfe101adc251857286195859a21161d89d0515462260ed80de83fd3de110f9e" Jul 22 16:30:17.973294 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:30:17.973272 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ebfe101adc251857286195859a21161d89d0515462260ed80de83fd3de110f9e\": container with ID starting with ebfe101adc251857286195859a21161d89d0515462260ed80de83fd3de110f9e not found: ID does not exist" containerID="ebfe101adc251857286195859a21161d89d0515462260ed80de83fd3de110f9e" Jul 22 16:30:17.973431 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:17.973303 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ebfe101adc251857286195859a21161d89d0515462260ed80de83fd3de110f9e"} err="failed to get container status \"ebfe101adc251857286195859a21161d89d0515462260ed80de83fd3de110f9e\": rpc error: code = NotFound desc = could not find container \"ebfe101adc251857286195859a21161d89d0515462260ed80de83fd3de110f9e\": container with ID starting with ebfe101adc251857286195859a21161d89d0515462260ed80de83fd3de110f9e not found: ID does not exist" Jul 22 16:30:17.988513 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:17.988459 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r795k" podStartSLOduration=6.9884418010000005 podStartE2EDuration="6.988441801s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:30:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:30:17.986176807 +0000 UTC m=+470.087792384" watchObservedRunningTime="2026-07-22 16:30:17.988441801 +0000 UTC m=+470.090057377" Jul 22 16:30:18.009712 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:18.009652 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rmxlt" podStartSLOduration=7.009633466 podStartE2EDuration="7.009633466s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:30:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:30:18.007910632 +0000 UTC m=+470.109526230" watchObservedRunningTime="2026-07-22 16:30:18.009633466 +0000 UTC m=+470.111249042" Jul 22 16:30:18.413363 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:18.413316 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0e8f8c14-f474-4533-9cd4-e0682cad54db" path="/var/lib/kubelet/pods/0e8f8c14-f474-4533-9cd4-e0682cad54db/volumes" Jul 22 16:30:18.413748 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:18.413731 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b931aad1-10af-4206-a099-95c9bb7b1c1c" path="/var/lib/kubelet/pods/b931aad1-10af-4206-a099-95c9bb7b1c1c/volumes" Jul 22 16:30:28.965819 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:28.965787 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rmxlt" Jul 22 16:30:28.966288 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:28.965863 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r795k" Jul 22 16:30:29.028792 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:29.028755 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rmxlt"] Jul 22 16:30:29.029044 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:29.028972 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rmxlt" podUID="48497379-8b10-4557-90a7-e5c2bd1c237f" containerName="manager" containerID="cri-o://d0b30aa56c57863701363b3cd82d30fa4b8b23fbf6b9bda93f6e482ad253ec80" gracePeriod=10 Jul 22 16:30:29.284150 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:29.284124 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rmxlt" Jul 22 16:30:29.321938 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:29.321907 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jgkxt\" (UniqueName: \"kubernetes.io/projected/48497379-8b10-4557-90a7-e5c2bd1c237f-kube-api-access-jgkxt\") pod \"48497379-8b10-4557-90a7-e5c2bd1c237f\" (UID: \"48497379-8b10-4557-90a7-e5c2bd1c237f\") " Jul 22 16:30:29.322105 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:29.321952 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/48497379-8b10-4557-90a7-e5c2bd1c237f-extensions-socket-volume\") pod \"48497379-8b10-4557-90a7-e5c2bd1c237f\" (UID: \"48497379-8b10-4557-90a7-e5c2bd1c237f\") " Jul 22 16:30:29.322493 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:29.322463 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/48497379-8b10-4557-90a7-e5c2bd1c237f-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "48497379-8b10-4557-90a7-e5c2bd1c237f" (UID: "48497379-8b10-4557-90a7-e5c2bd1c237f"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 16:30:29.324218 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:29.324195 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/48497379-8b10-4557-90a7-e5c2bd1c237f-kube-api-access-jgkxt" (OuterVolumeSpecName: "kube-api-access-jgkxt") pod "48497379-8b10-4557-90a7-e5c2bd1c237f" (UID: "48497379-8b10-4557-90a7-e5c2bd1c237f"). InnerVolumeSpecName "kube-api-access-jgkxt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 16:30:29.423100 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:29.423063 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jgkxt\" (UniqueName: \"kubernetes.io/projected/48497379-8b10-4557-90a7-e5c2bd1c237f-kube-api-access-jgkxt\") on node \"ip-10-0-133-47.ec2.internal\" DevicePath \"\"" Jul 22 16:30:29.423100 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:29.423095 2568 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/48497379-8b10-4557-90a7-e5c2bd1c237f-extensions-socket-volume\") on node \"ip-10-0-133-47.ec2.internal\" DevicePath \"\"" Jul 22 16:30:30.030826 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:30.030794 2568 generic.go:356] "Generic (PLEG): container finished" podID="48497379-8b10-4557-90a7-e5c2bd1c237f" containerID="d0b30aa56c57863701363b3cd82d30fa4b8b23fbf6b9bda93f6e482ad253ec80" exitCode=0 Jul 22 16:30:30.031337 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:30.030834 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rmxlt" Jul 22 16:30:30.031337 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:30.030885 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rmxlt" event={"ID":"48497379-8b10-4557-90a7-e5c2bd1c237f","Type":"ContainerDied","Data":"d0b30aa56c57863701363b3cd82d30fa4b8b23fbf6b9bda93f6e482ad253ec80"} Jul 22 16:30:30.031337 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:30.030945 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rmxlt" event={"ID":"48497379-8b10-4557-90a7-e5c2bd1c237f","Type":"ContainerDied","Data":"4aa21be84b33531dab0a68405932e4f642f1132d017942a18fadf83608df9183"} Jul 22 16:30:30.031337 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:30.030978 2568 scope.go:117] "RemoveContainer" containerID="d0b30aa56c57863701363b3cd82d30fa4b8b23fbf6b9bda93f6e482ad253ec80" Jul 22 16:30:30.040957 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:30.040937 2568 scope.go:117] "RemoveContainer" containerID="d0b30aa56c57863701363b3cd82d30fa4b8b23fbf6b9bda93f6e482ad253ec80" Jul 22 16:30:30.041232 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:30:30.041213 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d0b30aa56c57863701363b3cd82d30fa4b8b23fbf6b9bda93f6e482ad253ec80\": container with ID starting with d0b30aa56c57863701363b3cd82d30fa4b8b23fbf6b9bda93f6e482ad253ec80 not found: ID does not exist" containerID="d0b30aa56c57863701363b3cd82d30fa4b8b23fbf6b9bda93f6e482ad253ec80" Jul 22 16:30:30.041290 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:30.041242 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d0b30aa56c57863701363b3cd82d30fa4b8b23fbf6b9bda93f6e482ad253ec80"} err="failed to get container status \"d0b30aa56c57863701363b3cd82d30fa4b8b23fbf6b9bda93f6e482ad253ec80\": rpc error: code = NotFound desc = could not find container \"d0b30aa56c57863701363b3cd82d30fa4b8b23fbf6b9bda93f6e482ad253ec80\": container with ID starting with d0b30aa56c57863701363b3cd82d30fa4b8b23fbf6b9bda93f6e482ad253ec80 not found: ID does not exist" Jul 22 16:30:30.056553 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:30.056524 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rmxlt"] Jul 22 16:30:30.062490 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:30.062462 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rmxlt"] Jul 22 16:30:30.409796 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:30.409716 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="48497379-8b10-4557-90a7-e5c2bd1c237f" path="/var/lib/kubelet/pods/48497379-8b10-4557-90a7-e5c2bd1c237f/volumes" Jul 22 16:30:45.435002 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:45.434953 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-z87c4"] Jul 22 16:30:45.435531 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:45.435510 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e8f8c14-f474-4533-9cd4-e0682cad54db" containerName="manager" Jul 22 16:30:45.435600 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:45.435534 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e8f8c14-f474-4533-9cd4-e0682cad54db" containerName="manager" Jul 22 16:30:45.435600 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:45.435543 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48497379-8b10-4557-90a7-e5c2bd1c237f" containerName="manager" Jul 22 16:30:45.435600 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:45.435548 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="48497379-8b10-4557-90a7-e5c2bd1c237f" containerName="manager" Jul 22 16:30:45.435756 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:45.435640 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e8f8c14-f474-4533-9cd4-e0682cad54db" containerName="manager" Jul 22 16:30:45.435756 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:45.435653 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="48497379-8b10-4557-90a7-e5c2bd1c237f" containerName="manager" Jul 22 16:30:45.598736 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:45.598691 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-z87c4"] Jul 22 16:30:45.598951 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:45.598836 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-z87c4" Jul 22 16:30:45.601470 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:45.601442 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 22 16:30:45.601609 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:45.601536 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-cq4kv\"" Jul 22 16:30:45.676402 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:45.676321 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/30013739-f498-4418-b2e0-90ce6285ad42-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-z87c4\" (UID: \"30013739-f498-4418-b2e0-90ce6285ad42\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-z87c4" Jul 22 16:30:45.676606 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:45.676455 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/30013739-f498-4418-b2e0-90ce6285ad42-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-z87c4\" (UID: \"30013739-f498-4418-b2e0-90ce6285ad42\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-z87c4" Jul 22 16:30:45.676606 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:45.676486 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/30013739-f498-4418-b2e0-90ce6285ad42-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-z87c4\" (UID: \"30013739-f498-4418-b2e0-90ce6285ad42\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-z87c4" Jul 22 16:30:45.676606 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:45.676547 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/30013739-f498-4418-b2e0-90ce6285ad42-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-z87c4\" (UID: \"30013739-f498-4418-b2e0-90ce6285ad42\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-z87c4" Jul 22 16:30:45.676606 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:45.676592 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhqz4\" (UniqueName: \"kubernetes.io/projected/30013739-f498-4418-b2e0-90ce6285ad42-kube-api-access-nhqz4\") pod \"maas-default-gateway-openshift-default-56654dcf7-z87c4\" (UID: \"30013739-f498-4418-b2e0-90ce6285ad42\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-z87c4" Jul 22 16:30:45.676749 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:45.676627 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/30013739-f498-4418-b2e0-90ce6285ad42-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-z87c4\" (UID: \"30013739-f498-4418-b2e0-90ce6285ad42\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-z87c4" Jul 22 16:30:45.676749 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:45.676647 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/30013739-f498-4418-b2e0-90ce6285ad42-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-z87c4\" (UID: \"30013739-f498-4418-b2e0-90ce6285ad42\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-z87c4" Jul 22 16:30:45.676749 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:45.676683 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/30013739-f498-4418-b2e0-90ce6285ad42-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-z87c4\" (UID: \"30013739-f498-4418-b2e0-90ce6285ad42\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-z87c4" Jul 22 16:30:45.676749 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:45.676704 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/30013739-f498-4418-b2e0-90ce6285ad42-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-z87c4\" (UID: \"30013739-f498-4418-b2e0-90ce6285ad42\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-z87c4" Jul 22 16:30:45.777620 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:45.777579 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/30013739-f498-4418-b2e0-90ce6285ad42-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-z87c4\" (UID: \"30013739-f498-4418-b2e0-90ce6285ad42\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-z87c4" Jul 22 16:30:45.777849 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:45.777643 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/30013739-f498-4418-b2e0-90ce6285ad42-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-z87c4\" (UID: \"30013739-f498-4418-b2e0-90ce6285ad42\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-z87c4" Jul 22 16:30:45.777849 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:45.777670 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/30013739-f498-4418-b2e0-90ce6285ad42-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-z87c4\" (UID: \"30013739-f498-4418-b2e0-90ce6285ad42\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-z87c4" Jul 22 16:30:45.777849 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:45.777742 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/30013739-f498-4418-b2e0-90ce6285ad42-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-z87c4\" (UID: \"30013739-f498-4418-b2e0-90ce6285ad42\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-z87c4" Jul 22 16:30:45.777849 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:45.777771 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nhqz4\" (UniqueName: \"kubernetes.io/projected/30013739-f498-4418-b2e0-90ce6285ad42-kube-api-access-nhqz4\") pod \"maas-default-gateway-openshift-default-56654dcf7-z87c4\" (UID: \"30013739-f498-4418-b2e0-90ce6285ad42\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-z87c4" Jul 22 16:30:45.777849 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:45.777800 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/30013739-f498-4418-b2e0-90ce6285ad42-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-z87c4\" (UID: \"30013739-f498-4418-b2e0-90ce6285ad42\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-z87c4" Jul 22 16:30:45.777849 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:45.777824 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/30013739-f498-4418-b2e0-90ce6285ad42-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-z87c4\" (UID: \"30013739-f498-4418-b2e0-90ce6285ad42\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-z87c4" Jul 22 16:30:45.778177 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:45.777858 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/30013739-f498-4418-b2e0-90ce6285ad42-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-z87c4\" (UID: \"30013739-f498-4418-b2e0-90ce6285ad42\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-z87c4" Jul 22 16:30:45.778177 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:45.777889 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/30013739-f498-4418-b2e0-90ce6285ad42-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-z87c4\" (UID: \"30013739-f498-4418-b2e0-90ce6285ad42\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-z87c4" Jul 22 16:30:45.778177 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:45.778032 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/30013739-f498-4418-b2e0-90ce6285ad42-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-z87c4\" (UID: \"30013739-f498-4418-b2e0-90ce6285ad42\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-z87c4" Jul 22 16:30:45.778397 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:45.778367 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/30013739-f498-4418-b2e0-90ce6285ad42-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-z87c4\" (UID: \"30013739-f498-4418-b2e0-90ce6285ad42\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-z87c4" Jul 22 16:30:45.778397 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:45.778391 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/30013739-f498-4418-b2e0-90ce6285ad42-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-z87c4\" (UID: \"30013739-f498-4418-b2e0-90ce6285ad42\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-z87c4" Jul 22 16:30:45.778574 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:45.778473 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/30013739-f498-4418-b2e0-90ce6285ad42-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-z87c4\" (UID: \"30013739-f498-4418-b2e0-90ce6285ad42\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-z87c4" Jul 22 16:30:45.778620 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:45.778576 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/30013739-f498-4418-b2e0-90ce6285ad42-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-z87c4\" (UID: \"30013739-f498-4418-b2e0-90ce6285ad42\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-z87c4" Jul 22 16:30:45.780046 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:45.780020 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/30013739-f498-4418-b2e0-90ce6285ad42-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-z87c4\" (UID: \"30013739-f498-4418-b2e0-90ce6285ad42\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-z87c4" Jul 22 16:30:45.780172 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:45.780154 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/30013739-f498-4418-b2e0-90ce6285ad42-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-z87c4\" (UID: \"30013739-f498-4418-b2e0-90ce6285ad42\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-z87c4" Jul 22 16:30:45.786040 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:45.786016 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/30013739-f498-4418-b2e0-90ce6285ad42-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-z87c4\" (UID: \"30013739-f498-4418-b2e0-90ce6285ad42\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-z87c4" Jul 22 16:30:45.786208 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:45.786182 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhqz4\" (UniqueName: \"kubernetes.io/projected/30013739-f498-4418-b2e0-90ce6285ad42-kube-api-access-nhqz4\") pod \"maas-default-gateway-openshift-default-56654dcf7-z87c4\" (UID: \"30013739-f498-4418-b2e0-90ce6285ad42\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-z87c4" Jul 22 16:30:45.909669 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:45.909633 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-z87c4" Jul 22 16:30:46.096675 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:46.096648 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-z87c4"] Jul 22 16:30:46.097966 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:30:46.097938 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30013739_f498_4418_b2e0_90ce6285ad42.slice/crio-896bc3a1e5152a3b814103e4b99e490467c3cbc94c49e5f3836112009f4b5297 WatchSource:0}: Error finding container 896bc3a1e5152a3b814103e4b99e490467c3cbc94c49e5f3836112009f4b5297: Status 404 returned error can't find the container with id 896bc3a1e5152a3b814103e4b99e490467c3cbc94c49e5f3836112009f4b5297 Jul 22 16:30:46.126525 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:46.126481 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-z87c4" event={"ID":"30013739-f498-4418-b2e0-90ce6285ad42","Type":"ContainerStarted","Data":"896bc3a1e5152a3b814103e4b99e490467c3cbc94c49e5f3836112009f4b5297"} Jul 22 16:30:49.161391 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:49.161355 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 16:30:49.161666 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:49.161425 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 16:30:49.161666 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:49.161456 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 16:30:50.151303 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:50.151264 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-z87c4" event={"ID":"30013739-f498-4418-b2e0-90ce6285ad42","Type":"ContainerStarted","Data":"d51995e77a96bba6d8d415157de9581166700dfa2bf595e49835f6dcde0b8fd8"} Jul 22 16:30:50.176681 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:50.176623 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-z87c4" podStartSLOduration=2.115552563 podStartE2EDuration="5.176607538s" totalImagesPullingTime="3.061054975s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:30:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:30:50.173989217 +0000 UTC m=+502.275604792" watchObservedRunningTime="2026-07-22 16:30:50.176607538 +0000 UTC m=+502.278223113" Jul 22 16:30:50.910300 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:50.910257 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-z87c4" Jul 22 16:30:50.914912 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:50.914884 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-z87c4" Jul 22 16:30:51.158599 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:51.158556 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-z87c4" Jul 22 16:30:51.159564 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:51.159541 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-z87c4" Jul 22 16:30:51.229471 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:51.229439 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-n25k9"] Jul 22 16:30:51.233659 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:51.233633 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-n25k9" Jul 22 16:30:51.236391 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:51.236362 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 22 16:30:51.244070 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:51.244041 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-n25k9"] Jul 22 16:30:51.328525 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:51.328486 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-94v7q\" (UniqueName: \"kubernetes.io/projected/55cff420-4a8d-404b-8c6b-49833a240e9c-kube-api-access-94v7q\") pod \"limitador-limitador-64c94fd64f-n25k9\" (UID: \"55cff420-4a8d-404b-8c6b-49833a240e9c\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-n25k9" Jul 22 16:30:51.328715 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:51.328641 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/55cff420-4a8d-404b-8c6b-49833a240e9c-config-file\") pod \"limitador-limitador-64c94fd64f-n25k9\" (UID: \"55cff420-4a8d-404b-8c6b-49833a240e9c\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-n25k9" Jul 22 16:30:51.333538 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:51.333507 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-n25k9"] Jul 22 16:30:51.429726 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:51.429690 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/55cff420-4a8d-404b-8c6b-49833a240e9c-config-file\") pod \"limitador-limitador-64c94fd64f-n25k9\" (UID: \"55cff420-4a8d-404b-8c6b-49833a240e9c\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-n25k9" Jul 22 16:30:51.429890 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:51.429756 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-94v7q\" (UniqueName: \"kubernetes.io/projected/55cff420-4a8d-404b-8c6b-49833a240e9c-kube-api-access-94v7q\") pod \"limitador-limitador-64c94fd64f-n25k9\" (UID: \"55cff420-4a8d-404b-8c6b-49833a240e9c\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-n25k9" Jul 22 16:30:51.430556 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:51.430531 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/55cff420-4a8d-404b-8c6b-49833a240e9c-config-file\") pod \"limitador-limitador-64c94fd64f-n25k9\" (UID: \"55cff420-4a8d-404b-8c6b-49833a240e9c\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-n25k9" Jul 22 16:30:51.439602 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:51.439566 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-94v7q\" (UniqueName: \"kubernetes.io/projected/55cff420-4a8d-404b-8c6b-49833a240e9c-kube-api-access-94v7q\") pod \"limitador-limitador-64c94fd64f-n25k9\" (UID: \"55cff420-4a8d-404b-8c6b-49833a240e9c\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-n25k9" Jul 22 16:30:51.546512 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:51.546421 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-n25k9" Jul 22 16:30:51.704571 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:51.704541 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-n25k9"] Jul 22 16:30:51.707087 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:30:51.707012 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55cff420_4a8d_404b_8c6b_49833a240e9c.slice/crio-4c72cab44accf4db733abb5c075f91815a3b4dbb3f70a9d9f4de89660faa761a WatchSource:0}: Error finding container 4c72cab44accf4db733abb5c075f91815a3b4dbb3f70a9d9f4de89660faa761a: Status 404 returned error can't find the container with id 4c72cab44accf4db733abb5c075f91815a3b4dbb3f70a9d9f4de89660faa761a Jul 22 16:30:52.016200 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:52.016159 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-wncvx"] Jul 22 16:30:52.020188 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:52.020164 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-wncvx" Jul 22 16:30:52.022603 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:52.022583 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-dmhxd\"" Jul 22 16:30:52.029630 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:52.029601 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-wncvx"] Jul 22 16:30:52.135825 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:52.135783 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bm66z\" (UniqueName: \"kubernetes.io/projected/8657349f-16f7-4290-a0a4-5b12124800aa-kube-api-access-bm66z\") pod \"authorino-58cd955675-wncvx\" (UID: \"8657349f-16f7-4290-a0a4-5b12124800aa\") " pod="kuadrant-system/authorino-58cd955675-wncvx" Jul 22 16:30:52.165689 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:52.165651 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-n25k9" event={"ID":"55cff420-4a8d-404b-8c6b-49833a240e9c","Type":"ContainerStarted","Data":"4c72cab44accf4db733abb5c075f91815a3b4dbb3f70a9d9f4de89660faa761a"} Jul 22 16:30:52.236398 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:52.236335 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bm66z\" (UniqueName: \"kubernetes.io/projected/8657349f-16f7-4290-a0a4-5b12124800aa-kube-api-access-bm66z\") pod \"authorino-58cd955675-wncvx\" (UID: \"8657349f-16f7-4290-a0a4-5b12124800aa\") " pod="kuadrant-system/authorino-58cd955675-wncvx" Jul 22 16:30:52.245893 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:52.245827 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bm66z\" (UniqueName: \"kubernetes.io/projected/8657349f-16f7-4290-a0a4-5b12124800aa-kube-api-access-bm66z\") pod \"authorino-58cd955675-wncvx\" (UID: \"8657349f-16f7-4290-a0a4-5b12124800aa\") " pod="kuadrant-system/authorino-58cd955675-wncvx" Jul 22 16:30:52.330266 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:52.330172 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-wncvx" Jul 22 16:30:52.540113 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:52.540076 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-wncvx"] Jul 22 16:30:52.543566 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:30:52.543328 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8657349f_16f7_4290_a0a4_5b12124800aa.slice/crio-2c200bf96ba4b29384a105860fbaeb5dae3f8bf7d5979572b1ecb6381848e6a0 WatchSource:0}: Error finding container 2c200bf96ba4b29384a105860fbaeb5dae3f8bf7d5979572b1ecb6381848e6a0: Status 404 returned error can't find the container with id 2c200bf96ba4b29384a105860fbaeb5dae3f8bf7d5979572b1ecb6381848e6a0 Jul 22 16:30:53.176055 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:53.176016 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-wncvx" event={"ID":"8657349f-16f7-4290-a0a4-5b12124800aa","Type":"ContainerStarted","Data":"2c200bf96ba4b29384a105860fbaeb5dae3f8bf7d5979572b1ecb6381848e6a0"} Jul 22 16:30:55.193741 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:55.193689 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-n25k9" event={"ID":"55cff420-4a8d-404b-8c6b-49833a240e9c","Type":"ContainerStarted","Data":"cb339493fa3a4399ad2950d83b6a568076ffd9b8c4b41bb7fa9f882632781ed9"} Jul 22 16:30:55.194166 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:55.193922 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-n25k9" Jul 22 16:30:55.211003 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:55.210936 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-n25k9" podStartSLOduration=1.47744768 podStartE2EDuration="4.210915259s" totalImagesPullingTime="2.733467579s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:30:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:30:55.210572165 +0000 UTC m=+507.312187742" watchObservedRunningTime="2026-07-22 16:30:55.210915259 +0000 UTC m=+507.312530836" Jul 22 16:30:55.741941 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:55.741909 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-wncvx"] Jul 22 16:30:57.208016 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:57.207979 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-wncvx" event={"ID":"8657349f-16f7-4290-a0a4-5b12124800aa","Type":"ContainerStarted","Data":"1812933d22e769d537005c5bd21378f601e4ad8bb3e1975a05eee1ca7678bf6e"} Jul 22 16:30:57.208016 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:57.208008 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-wncvx" podUID="8657349f-16f7-4290-a0a4-5b12124800aa" containerName="authorino" containerID="cri-o://1812933d22e769d537005c5bd21378f601e4ad8bb3e1975a05eee1ca7678bf6e" gracePeriod=30 Jul 22 16:30:57.224401 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:57.224313 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-wncvx" podStartSLOduration=2.464092614 podStartE2EDuration="6.224296678s" totalImagesPullingTime="3.760204064s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:30:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:30:57.223406285 +0000 UTC m=+509.325021862" watchObservedRunningTime="2026-07-22 16:30:57.224296678 +0000 UTC m=+509.325912254" Jul 22 16:30:57.457056 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:57.457032 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-wncvx" Jul 22 16:30:57.589631 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:57.589596 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bm66z\" (UniqueName: \"kubernetes.io/projected/8657349f-16f7-4290-a0a4-5b12124800aa-kube-api-access-bm66z\") pod \"8657349f-16f7-4290-a0a4-5b12124800aa\" (UID: \"8657349f-16f7-4290-a0a4-5b12124800aa\") " Jul 22 16:30:57.591695 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:57.591665 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8657349f-16f7-4290-a0a4-5b12124800aa-kube-api-access-bm66z" (OuterVolumeSpecName: "kube-api-access-bm66z") pod "8657349f-16f7-4290-a0a4-5b12124800aa" (UID: "8657349f-16f7-4290-a0a4-5b12124800aa"). InnerVolumeSpecName "kube-api-access-bm66z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 16:30:57.690713 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:57.690678 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bm66z\" (UniqueName: \"kubernetes.io/projected/8657349f-16f7-4290-a0a4-5b12124800aa-kube-api-access-bm66z\") on node \"ip-10-0-133-47.ec2.internal\" DevicePath \"\"" Jul 22 16:30:58.214517 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:58.214476 2568 generic.go:356] "Generic (PLEG): container finished" podID="8657349f-16f7-4290-a0a4-5b12124800aa" containerID="1812933d22e769d537005c5bd21378f601e4ad8bb3e1975a05eee1ca7678bf6e" exitCode=0 Jul 22 16:30:58.214517 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:58.214521 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-wncvx" Jul 22 16:30:58.215027 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:58.214567 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-wncvx" event={"ID":"8657349f-16f7-4290-a0a4-5b12124800aa","Type":"ContainerDied","Data":"1812933d22e769d537005c5bd21378f601e4ad8bb3e1975a05eee1ca7678bf6e"} Jul 22 16:30:58.215027 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:58.214617 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-wncvx" event={"ID":"8657349f-16f7-4290-a0a4-5b12124800aa","Type":"ContainerDied","Data":"2c200bf96ba4b29384a105860fbaeb5dae3f8bf7d5979572b1ecb6381848e6a0"} Jul 22 16:30:58.215027 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:58.214643 2568 scope.go:117] "RemoveContainer" containerID="1812933d22e769d537005c5bd21378f601e4ad8bb3e1975a05eee1ca7678bf6e" Jul 22 16:30:58.223897 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:58.223883 2568 scope.go:117] "RemoveContainer" containerID="1812933d22e769d537005c5bd21378f601e4ad8bb3e1975a05eee1ca7678bf6e" Jul 22 16:30:58.224143 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:30:58.224126 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1812933d22e769d537005c5bd21378f601e4ad8bb3e1975a05eee1ca7678bf6e\": container with ID starting with 1812933d22e769d537005c5bd21378f601e4ad8bb3e1975a05eee1ca7678bf6e not found: ID does not exist" containerID="1812933d22e769d537005c5bd21378f601e4ad8bb3e1975a05eee1ca7678bf6e" Jul 22 16:30:58.224187 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:58.224151 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1812933d22e769d537005c5bd21378f601e4ad8bb3e1975a05eee1ca7678bf6e"} err="failed to get container status \"1812933d22e769d537005c5bd21378f601e4ad8bb3e1975a05eee1ca7678bf6e\": rpc error: code = NotFound desc = could not find container \"1812933d22e769d537005c5bd21378f601e4ad8bb3e1975a05eee1ca7678bf6e\": container with ID starting with 1812933d22e769d537005c5bd21378f601e4ad8bb3e1975a05eee1ca7678bf6e not found: ID does not exist" Jul 22 16:30:58.235580 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:58.235556 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-wncvx"] Jul 22 16:30:58.241065 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:58.241043 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-wncvx"] Jul 22 16:30:58.410027 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:30:58.409999 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8657349f-16f7-4290-a0a4-5b12124800aa" path="/var/lib/kubelet/pods/8657349f-16f7-4290-a0a4-5b12124800aa/volumes" Jul 22 16:31:05.614835 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:31:05.614799 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-n25k9"] Jul 22 16:31:05.615409 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:31:05.615020 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-n25k9" podUID="55cff420-4a8d-404b-8c6b-49833a240e9c" containerName="limitador" containerID="cri-o://cb339493fa3a4399ad2950d83b6a568076ffd9b8c4b41bb7fa9f882632781ed9" gracePeriod=30 Jul 22 16:31:05.615801 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:31:05.615715 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-n25k9" Jul 22 16:31:06.172401 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:31:06.172374 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-n25k9" Jul 22 16:31:06.265106 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:31:06.265063 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-94v7q\" (UniqueName: \"kubernetes.io/projected/55cff420-4a8d-404b-8c6b-49833a240e9c-kube-api-access-94v7q\") pod \"55cff420-4a8d-404b-8c6b-49833a240e9c\" (UID: \"55cff420-4a8d-404b-8c6b-49833a240e9c\") " Jul 22 16:31:06.265460 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:31:06.265426 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/55cff420-4a8d-404b-8c6b-49833a240e9c-config-file\") pod \"55cff420-4a8d-404b-8c6b-49833a240e9c\" (UID: \"55cff420-4a8d-404b-8c6b-49833a240e9c\") " Jul 22 16:31:06.266256 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:31:06.266152 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/55cff420-4a8d-404b-8c6b-49833a240e9c-config-file" (OuterVolumeSpecName: "config-file") pod "55cff420-4a8d-404b-8c6b-49833a240e9c" (UID: "55cff420-4a8d-404b-8c6b-49833a240e9c"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 16:31:06.267539 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:31:06.267508 2568 generic.go:356] "Generic (PLEG): container finished" podID="55cff420-4a8d-404b-8c6b-49833a240e9c" containerID="cb339493fa3a4399ad2950d83b6a568076ffd9b8c4b41bb7fa9f882632781ed9" exitCode=0 Jul 22 16:31:06.267639 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:31:06.267565 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-n25k9" Jul 22 16:31:06.267639 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:31:06.267581 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-n25k9" event={"ID":"55cff420-4a8d-404b-8c6b-49833a240e9c","Type":"ContainerDied","Data":"cb339493fa3a4399ad2950d83b6a568076ffd9b8c4b41bb7fa9f882632781ed9"} Jul 22 16:31:06.267747 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:31:06.267688 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-n25k9" event={"ID":"55cff420-4a8d-404b-8c6b-49833a240e9c","Type":"ContainerDied","Data":"4c72cab44accf4db733abb5c075f91815a3b4dbb3f70a9d9f4de89660faa761a"} Jul 22 16:31:06.267747 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:31:06.267712 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/55cff420-4a8d-404b-8c6b-49833a240e9c-kube-api-access-94v7q" (OuterVolumeSpecName: "kube-api-access-94v7q") pod "55cff420-4a8d-404b-8c6b-49833a240e9c" (UID: "55cff420-4a8d-404b-8c6b-49833a240e9c"). InnerVolumeSpecName "kube-api-access-94v7q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 16:31:06.267747 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:31:06.267724 2568 scope.go:117] "RemoveContainer" containerID="cb339493fa3a4399ad2950d83b6a568076ffd9b8c4b41bb7fa9f882632781ed9" Jul 22 16:31:06.280461 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:31:06.280441 2568 scope.go:117] "RemoveContainer" containerID="cb339493fa3a4399ad2950d83b6a568076ffd9b8c4b41bb7fa9f882632781ed9" Jul 22 16:31:06.280795 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:31:06.280775 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cb339493fa3a4399ad2950d83b6a568076ffd9b8c4b41bb7fa9f882632781ed9\": container with ID starting with cb339493fa3a4399ad2950d83b6a568076ffd9b8c4b41bb7fa9f882632781ed9 not found: ID does not exist" containerID="cb339493fa3a4399ad2950d83b6a568076ffd9b8c4b41bb7fa9f882632781ed9" Jul 22 16:31:06.280877 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:31:06.280808 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb339493fa3a4399ad2950d83b6a568076ffd9b8c4b41bb7fa9f882632781ed9"} err="failed to get container status \"cb339493fa3a4399ad2950d83b6a568076ffd9b8c4b41bb7fa9f882632781ed9\": rpc error: code = NotFound desc = could not find container \"cb339493fa3a4399ad2950d83b6a568076ffd9b8c4b41bb7fa9f882632781ed9\": container with ID starting with cb339493fa3a4399ad2950d83b6a568076ffd9b8c4b41bb7fa9f882632781ed9 not found: ID does not exist" Jul 22 16:31:06.367297 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:31:06.367264 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-94v7q\" (UniqueName: \"kubernetes.io/projected/55cff420-4a8d-404b-8c6b-49833a240e9c-kube-api-access-94v7q\") on node \"ip-10-0-133-47.ec2.internal\" DevicePath \"\"" Jul 22 16:31:06.367297 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:31:06.367295 2568 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/55cff420-4a8d-404b-8c6b-49833a240e9c-config-file\") on node \"ip-10-0-133-47.ec2.internal\" DevicePath \"\"" Jul 22 16:31:06.585143 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:31:06.585061 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-n25k9"] Jul 22 16:31:06.589342 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:31:06.589316 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-n25k9"] Jul 22 16:31:07.901200 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:31:07.901160 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-ncv64"] Jul 22 16:31:07.901790 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:31:07.901768 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55cff420-4a8d-404b-8c6b-49833a240e9c" containerName="limitador" Jul 22 16:31:07.901835 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:31:07.901796 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="55cff420-4a8d-404b-8c6b-49833a240e9c" containerName="limitador" Jul 22 16:31:07.901835 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:31:07.901815 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8657349f-16f7-4290-a0a4-5b12124800aa" containerName="authorino" Jul 22 16:31:07.901835 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:31:07.901823 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="8657349f-16f7-4290-a0a4-5b12124800aa" containerName="authorino" Jul 22 16:31:07.901945 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:31:07.901933 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="8657349f-16f7-4290-a0a4-5b12124800aa" containerName="authorino" Jul 22 16:31:07.901984 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:31:07.901951 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="55cff420-4a8d-404b-8c6b-49833a240e9c" containerName="limitador" Jul 22 16:31:07.906650 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:31:07.906633 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-ncv64" Jul 22 16:31:07.909313 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:31:07.909289 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\"" Jul 22 16:31:07.909462 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:31:07.909335 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-chbwq\"" Jul 22 16:31:07.909462 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:31:07.909370 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 22 16:31:07.910293 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:31:07.910278 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 22 16:31:07.910611 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:31:07.910590 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-ncv64"] Jul 22 16:31:07.981448 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:31:07.981411 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/f1906eb2-31d0-4d2e-bb0d-d8de70414877-data\") pod \"postgres-69fb4594cf-ncv64\" (UID: \"f1906eb2-31d0-4d2e-bb0d-d8de70414877\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-ncv64" Jul 22 16:31:07.981646 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:31:07.981513 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wfhq\" (UniqueName: \"kubernetes.io/projected/f1906eb2-31d0-4d2e-bb0d-d8de70414877-kube-api-access-5wfhq\") pod \"postgres-69fb4594cf-ncv64\" (UID: \"f1906eb2-31d0-4d2e-bb0d-d8de70414877\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-ncv64" Jul 22 16:31:08.082552 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:31:08.082504 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wfhq\" (UniqueName: \"kubernetes.io/projected/f1906eb2-31d0-4d2e-bb0d-d8de70414877-kube-api-access-5wfhq\") pod \"postgres-69fb4594cf-ncv64\" (UID: \"f1906eb2-31d0-4d2e-bb0d-d8de70414877\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-ncv64" Jul 22 16:31:08.082552 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:31:08.082569 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/f1906eb2-31d0-4d2e-bb0d-d8de70414877-data\") pod \"postgres-69fb4594cf-ncv64\" (UID: \"f1906eb2-31d0-4d2e-bb0d-d8de70414877\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-ncv64" Jul 22 16:31:08.082953 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:31:08.082936 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/f1906eb2-31d0-4d2e-bb0d-d8de70414877-data\") pod \"postgres-69fb4594cf-ncv64\" (UID: \"f1906eb2-31d0-4d2e-bb0d-d8de70414877\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-ncv64" Jul 22 16:31:08.091059 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:31:08.091028 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wfhq\" (UniqueName: \"kubernetes.io/projected/f1906eb2-31d0-4d2e-bb0d-d8de70414877-kube-api-access-5wfhq\") pod \"postgres-69fb4594cf-ncv64\" (UID: \"f1906eb2-31d0-4d2e-bb0d-d8de70414877\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-ncv64" Jul 22 16:31:08.218307 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:31:08.218212 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-ncv64" Jul 22 16:31:08.381619 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:31:08.381586 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-ncv64"] Jul 22 16:31:08.383401 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:31:08.383371 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1906eb2_31d0_4d2e_bb0d_d8de70414877.slice/crio-013589dd259c5739dfd162b9ccf6d789311713e01a6cdd84c48199682375a575 WatchSource:0}: Error finding container 013589dd259c5739dfd162b9ccf6d789311713e01a6cdd84c48199682375a575: Status 404 returned error can't find the container with id 013589dd259c5739dfd162b9ccf6d789311713e01a6cdd84c48199682375a575 Jul 22 16:31:08.409984 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:31:08.409954 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="55cff420-4a8d-404b-8c6b-49833a240e9c" path="/var/lib/kubelet/pods/55cff420-4a8d-404b-8c6b-49833a240e9c/volumes" Jul 22 16:31:09.306737 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:31:09.306699 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-ncv64" event={"ID":"f1906eb2-31d0-4d2e-bb0d-d8de70414877","Type":"ContainerStarted","Data":"013589dd259c5739dfd162b9ccf6d789311713e01a6cdd84c48199682375a575"} Jul 22 16:31:14.340180 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:31:14.340136 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-ncv64" event={"ID":"f1906eb2-31d0-4d2e-bb0d-d8de70414877","Type":"ContainerStarted","Data":"af36b6ad5fbe0c9d3fed240fe46111d80dacc0969ab6567457821d2c95902ff9"} Jul 22 16:31:14.340583 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:31:14.340224 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-ncv64" Jul 22 16:31:14.357150 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:31:14.357088 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-ncv64" podStartSLOduration=2.43756243 podStartE2EDuration="7.357067727s" totalImagesPullingTime="4.919505297s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:31:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:31:14.355146763 +0000 UTC m=+526.456762349" watchObservedRunningTime="2026-07-22 16:31:14.357067727 +0000 UTC m=+526.458683305" Jul 22 16:31:20.376757 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:31:20.376685 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-ncv64" Jul 22 16:31:20.939361 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:31:20.939318 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-8z6v4"] Jul 22 16:31:20.946599 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:31:20.946562 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-8z6v4" Jul 22 16:31:20.949108 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:31:20.949082 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-dmhxd\"" Jul 22 16:31:20.949660 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:31:20.949634 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-8z6v4"] Jul 22 16:31:21.013222 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:31:21.013189 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rw9ld\" (UniqueName: \"kubernetes.io/projected/9e786b05-8645-475d-ba8b-9c8bec8a9d98-kube-api-access-rw9ld\") pod \"authorino-5d4b67c446-8z6v4\" (UID: \"9e786b05-8645-475d-ba8b-9c8bec8a9d98\") " pod="kuadrant-system/authorino-5d4b67c446-8z6v4" Jul 22 16:31:21.107635 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:31:21.107593 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-8z6v4"] Jul 22 16:31:21.107974 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:31:21.107946 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-rw9ld], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-8z6v4" podUID="9e786b05-8645-475d-ba8b-9c8bec8a9d98" Jul 22 16:31:21.113947 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:31:21.113919 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rw9ld\" (UniqueName: \"kubernetes.io/projected/9e786b05-8645-475d-ba8b-9c8bec8a9d98-kube-api-access-rw9ld\") pod \"authorino-5d4b67c446-8z6v4\" (UID: \"9e786b05-8645-475d-ba8b-9c8bec8a9d98\") " pod="kuadrant-system/authorino-5d4b67c446-8z6v4" Jul 22 16:31:21.127427 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:31:21.127405 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rw9ld\" (UniqueName: \"kubernetes.io/projected/9e786b05-8645-475d-ba8b-9c8bec8a9d98-kube-api-access-rw9ld\") pod \"authorino-5d4b67c446-8z6v4\" (UID: \"9e786b05-8645-475d-ba8b-9c8bec8a9d98\") " pod="kuadrant-system/authorino-5d4b67c446-8z6v4" Jul 22 16:31:21.133458 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:31:21.133429 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-76877994-gwtvh"] Jul 22 16:31:21.138057 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:31:21.138036 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-gwtvh" Jul 22 16:31:21.140406 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:31:21.140384 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 22 16:31:21.144471 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:31:21.144436 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-76877994-gwtvh"] Jul 22 16:31:21.188077 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:31:21.188033 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76877994-gwtvh"] Jul 22 16:31:21.188461 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:31:21.188433 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-2l7zw tls-cert], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-76877994-gwtvh" podUID="eaf4641b-aac8-4063-9705-ab12f29a56b6" Jul 22 16:31:21.214646 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:31:21.214554 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/eaf4641b-aac8-4063-9705-ab12f29a56b6-tls-cert\") pod \"authorino-76877994-gwtvh\" (UID: \"eaf4641b-aac8-4063-9705-ab12f29a56b6\") " pod="kuadrant-system/authorino-76877994-gwtvh" Jul 22 16:31:21.214800 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:31:21.214653 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2l7zw\" (UniqueName: \"kubernetes.io/projected/eaf4641b-aac8-4063-9705-ab12f29a56b6-kube-api-access-2l7zw\") pod \"authorino-76877994-gwtvh\" (UID: \"eaf4641b-aac8-4063-9705-ab12f29a56b6\") " pod="kuadrant-system/authorino-76877994-gwtvh" Jul 22 16:31:21.215200 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:31:21.215180 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7c659676cd-6wlss"] Jul 22 16:31:21.219334 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:31:21.219313 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7c659676cd-6wlss" Jul 22 16:31:21.224723 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:31:21.224697 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7c659676cd-6wlss"] Jul 22 16:31:21.315897 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:31:21.315854 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b03b100c-fc34-4401-9fb1-9c3d6604ba58-tls-cert\") pod \"authorino-7c659676cd-6wlss\" (UID: \"b03b100c-fc34-4401-9fb1-9c3d6604ba58\") " pod="kuadrant-system/authorino-7c659676cd-6wlss" Jul 22 16:31:21.316105 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:31:21.315912 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5pcb\" (UniqueName: \"kubernetes.io/projected/b03b100c-fc34-4401-9fb1-9c3d6604ba58-kube-api-access-f5pcb\") pod \"authorino-7c659676cd-6wlss\" (UID: \"b03b100c-fc34-4401-9fb1-9c3d6604ba58\") " pod="kuadrant-system/authorino-7c659676cd-6wlss" Jul 22 16:31:21.316105 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:31:21.316000 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/eaf4641b-aac8-4063-9705-ab12f29a56b6-tls-cert\") pod \"authorino-76877994-gwtvh\" (UID: \"eaf4641b-aac8-4063-9705-ab12f29a56b6\") " pod="kuadrant-system/authorino-76877994-gwtvh" Jul 22 16:31:21.316105 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:31:21.316075 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2l7zw\" (UniqueName: \"kubernetes.io/projected/eaf4641b-aac8-4063-9705-ab12f29a56b6-kube-api-access-2l7zw\") pod \"authorino-76877994-gwtvh\" (UID: \"eaf4641b-aac8-4063-9705-ab12f29a56b6\") " pod="kuadrant-system/authorino-76877994-gwtvh" Jul 22 16:31:21.318520 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:31:21.318495 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/eaf4641b-aac8-4063-9705-ab12f29a56b6-tls-cert\") pod \"authorino-76877994-gwtvh\" (UID: \"eaf4641b-aac8-4063-9705-ab12f29a56b6\") " pod="kuadrant-system/authorino-76877994-gwtvh" Jul 22 16:31:21.324104 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:31:21.324078 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2l7zw\" (UniqueName: \"kubernetes.io/projected/eaf4641b-aac8-4063-9705-ab12f29a56b6-kube-api-access-2l7zw\") pod \"authorino-76877994-gwtvh\" (UID: \"eaf4641b-aac8-4063-9705-ab12f29a56b6\") " pod="kuadrant-system/authorino-76877994-gwtvh" Jul 22 16:31:21.380056 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:31:21.380023 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-gwtvh" Jul 22 16:31:21.380546 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:31:21.380023 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-8z6v4" Jul 22 16:31:21.387609 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:31:21.387579 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-gwtvh" Jul 22 16:31:21.390605 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:31:21.390586 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-8z6v4" Jul 22 16:31:21.417605 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:31:21.417571 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b03b100c-fc34-4401-9fb1-9c3d6604ba58-tls-cert\") pod \"authorino-7c659676cd-6wlss\" (UID: \"b03b100c-fc34-4401-9fb1-9c3d6604ba58\") " pod="kuadrant-system/authorino-7c659676cd-6wlss" Jul 22 16:31:21.417831 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:31:21.417621 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5pcb\" (UniqueName: \"kubernetes.io/projected/b03b100c-fc34-4401-9fb1-9c3d6604ba58-kube-api-access-f5pcb\") pod \"authorino-7c659676cd-6wlss\" (UID: \"b03b100c-fc34-4401-9fb1-9c3d6604ba58\") " pod="kuadrant-system/authorino-7c659676cd-6wlss" Jul 22 16:31:21.420077 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:31:21.420049 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b03b100c-fc34-4401-9fb1-9c3d6604ba58-tls-cert\") pod \"authorino-7c659676cd-6wlss\" (UID: \"b03b100c-fc34-4401-9fb1-9c3d6604ba58\") " pod="kuadrant-system/authorino-7c659676cd-6wlss" Jul 22 16:31:21.425854 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:31:21.425830 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5pcb\" (UniqueName: \"kubernetes.io/projected/b03b100c-fc34-4401-9fb1-9c3d6604ba58-kube-api-access-f5pcb\") pod \"authorino-7c659676cd-6wlss\" (UID: \"b03b100c-fc34-4401-9fb1-9c3d6604ba58\") " pod="kuadrant-system/authorino-7c659676cd-6wlss" Jul 22 16:31:21.518687 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:31:21.518649 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2l7zw\" (UniqueName: \"kubernetes.io/projected/eaf4641b-aac8-4063-9705-ab12f29a56b6-kube-api-access-2l7zw\") pod \"eaf4641b-aac8-4063-9705-ab12f29a56b6\" (UID: \"eaf4641b-aac8-4063-9705-ab12f29a56b6\") " Jul 22 16:31:21.518904 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:31:21.518699 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rw9ld\" (UniqueName: \"kubernetes.io/projected/9e786b05-8645-475d-ba8b-9c8bec8a9d98-kube-api-access-rw9ld\") pod \"9e786b05-8645-475d-ba8b-9c8bec8a9d98\" (UID: \"9e786b05-8645-475d-ba8b-9c8bec8a9d98\") " Jul 22 16:31:21.518904 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:31:21.518813 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/eaf4641b-aac8-4063-9705-ab12f29a56b6-tls-cert\") pod \"eaf4641b-aac8-4063-9705-ab12f29a56b6\" (UID: \"eaf4641b-aac8-4063-9705-ab12f29a56b6\") " Jul 22 16:31:21.520984 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:31:21.520948 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eaf4641b-aac8-4063-9705-ab12f29a56b6-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "eaf4641b-aac8-4063-9705-ab12f29a56b6" (UID: "eaf4641b-aac8-4063-9705-ab12f29a56b6"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 16:31:21.521104 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:31:21.520985 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eaf4641b-aac8-4063-9705-ab12f29a56b6-kube-api-access-2l7zw" (OuterVolumeSpecName: "kube-api-access-2l7zw") pod "eaf4641b-aac8-4063-9705-ab12f29a56b6" (UID: "eaf4641b-aac8-4063-9705-ab12f29a56b6"). InnerVolumeSpecName "kube-api-access-2l7zw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 16:31:21.521104 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:31:21.520996 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e786b05-8645-475d-ba8b-9c8bec8a9d98-kube-api-access-rw9ld" (OuterVolumeSpecName: "kube-api-access-rw9ld") pod "9e786b05-8645-475d-ba8b-9c8bec8a9d98" (UID: "9e786b05-8645-475d-ba8b-9c8bec8a9d98"). InnerVolumeSpecName "kube-api-access-rw9ld". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 16:31:21.529142 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:31:21.529119 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7c659676cd-6wlss" Jul 22 16:31:21.620249 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:31:21.620213 2568 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/eaf4641b-aac8-4063-9705-ab12f29a56b6-tls-cert\") on node \"ip-10-0-133-47.ec2.internal\" DevicePath \"\"" Jul 22 16:31:21.620249 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:31:21.620252 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2l7zw\" (UniqueName: \"kubernetes.io/projected/eaf4641b-aac8-4063-9705-ab12f29a56b6-kube-api-access-2l7zw\") on node \"ip-10-0-133-47.ec2.internal\" DevicePath \"\"" Jul 22 16:31:21.620525 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:31:21.620269 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rw9ld\" (UniqueName: \"kubernetes.io/projected/9e786b05-8645-475d-ba8b-9c8bec8a9d98-kube-api-access-rw9ld\") on node \"ip-10-0-133-47.ec2.internal\" DevicePath \"\"" Jul 22 16:31:21.666987 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:31:21.666956 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7c659676cd-6wlss"] Jul 22 16:31:21.668536 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:31:21.668498 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb03b100c_fc34_4401_9fb1_9c3d6604ba58.slice/crio-00b15cedf94ccbf29f336bc2fbe968fb23c6811947766a09c6d276ee40510850 WatchSource:0}: Error finding container 00b15cedf94ccbf29f336bc2fbe968fb23c6811947766a09c6d276ee40510850: Status 404 returned error can't find the container with id 00b15cedf94ccbf29f336bc2fbe968fb23c6811947766a09c6d276ee40510850 Jul 22 16:31:22.387437 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:31:22.387327 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7c659676cd-6wlss" event={"ID":"b03b100c-fc34-4401-9fb1-9c3d6604ba58","Type":"ContainerStarted","Data":"a79155add68b4eea36a8948711de60c7757a906482dd49efc36d2860f3e5d8a7"} Jul 22 16:31:22.387437 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:31:22.387371 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-8z6v4" Jul 22 16:31:22.387437 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:31:22.387397 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7c659676cd-6wlss" event={"ID":"b03b100c-fc34-4401-9fb1-9c3d6604ba58","Type":"ContainerStarted","Data":"00b15cedf94ccbf29f336bc2fbe968fb23c6811947766a09c6d276ee40510850"} Jul 22 16:31:22.387998 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:31:22.387373 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-gwtvh" Jul 22 16:31:22.408595 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:31:22.408530 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7c659676cd-6wlss" podStartSLOduration=1.018244801 podStartE2EDuration="1.408502775s" totalImagesPullingTime="390.257974ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:31:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:31:22.405601766 +0000 UTC m=+534.507217342" watchObservedRunningTime="2026-07-22 16:31:22.408502775 +0000 UTC m=+534.510118345" Jul 22 16:31:22.434368 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:31:22.434321 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-8z6v4"] Jul 22 16:31:22.436629 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:31:22.436599 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-8z6v4"] Jul 22 16:31:22.463862 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:31:22.463832 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76877994-gwtvh"] Jul 22 16:31:22.468239 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:31:22.468207 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-76877994-gwtvh"] Jul 22 16:31:24.410127 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:31:24.410094 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9e786b05-8645-475d-ba8b-9c8bec8a9d98" path="/var/lib/kubelet/pods/9e786b05-8645-475d-ba8b-9c8bec8a9d98/volumes" Jul 22 16:31:24.410555 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:31:24.410383 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eaf4641b-aac8-4063-9705-ab12f29a56b6" path="/var/lib/kubelet/pods/eaf4641b-aac8-4063-9705-ab12f29a56b6/volumes" Jul 22 16:31:27.211748 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:31:27.211711 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5cb8dc788d-257kh"] Jul 22 16:31:27.222209 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:31:27.222181 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5cb8dc788d-257kh" Jul 22 16:31:27.226554 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:31:27.226082 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 22 16:31:27.226554 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:31:27.226139 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-w2s7k\"" Jul 22 16:31:27.226773 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:31:27.226619 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 22 16:31:27.228288 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:31:27.228264 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5cb8dc788d-257kh"] Jul 22 16:31:27.376895 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:31:27.376861 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/adf24946-43b8-4802-b039-4bed83a56364-webhook-cert\") pod \"maas-controller-5cb8dc788d-257kh\" (UID: \"adf24946-43b8-4802-b039-4bed83a56364\") " pod="opendatahub/maas-controller-5cb8dc788d-257kh" Jul 22 16:31:27.377089 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:31:27.376909 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5stdn\" (UniqueName: \"kubernetes.io/projected/adf24946-43b8-4802-b039-4bed83a56364-kube-api-access-5stdn\") pod \"maas-controller-5cb8dc788d-257kh\" (UID: \"adf24946-43b8-4802-b039-4bed83a56364\") " pod="opendatahub/maas-controller-5cb8dc788d-257kh" Jul 22 16:31:27.478061 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:31:27.478036 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/adf24946-43b8-4802-b039-4bed83a56364-webhook-cert\") pod \"maas-controller-5cb8dc788d-257kh\" (UID: \"adf24946-43b8-4802-b039-4bed83a56364\") " pod="opendatahub/maas-controller-5cb8dc788d-257kh" Jul 22 16:31:27.478209 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:31:27.478085 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5stdn\" (UniqueName: \"kubernetes.io/projected/adf24946-43b8-4802-b039-4bed83a56364-kube-api-access-5stdn\") pod \"maas-controller-5cb8dc788d-257kh\" (UID: \"adf24946-43b8-4802-b039-4bed83a56364\") " pod="opendatahub/maas-controller-5cb8dc788d-257kh" Jul 22 16:31:27.480553 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:31:27.480535 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/adf24946-43b8-4802-b039-4bed83a56364-webhook-cert\") pod \"maas-controller-5cb8dc788d-257kh\" (UID: \"adf24946-43b8-4802-b039-4bed83a56364\") " pod="opendatahub/maas-controller-5cb8dc788d-257kh" Jul 22 16:31:27.487936 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:31:27.487913 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5stdn\" (UniqueName: \"kubernetes.io/projected/adf24946-43b8-4802-b039-4bed83a56364-kube-api-access-5stdn\") pod \"maas-controller-5cb8dc788d-257kh\" (UID: \"adf24946-43b8-4802-b039-4bed83a56364\") " pod="opendatahub/maas-controller-5cb8dc788d-257kh" Jul 22 16:31:27.535534 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:31:27.535497 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5cb8dc788d-257kh" Jul 22 16:31:27.676956 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:31:27.676924 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5cb8dc788d-257kh"] Jul 22 16:31:27.678616 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:31:27.678589 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadf24946_43b8_4802_b039_4bed83a56364.slice/crio-495c1d14980f245e0b78ac71066bb3a2c429d58aea145dad99507b6770ac5185 WatchSource:0}: Error finding container 495c1d14980f245e0b78ac71066bb3a2c429d58aea145dad99507b6770ac5185: Status 404 returned error can't find the container with id 495c1d14980f245e0b78ac71066bb3a2c429d58aea145dad99507b6770ac5185 Jul 22 16:31:28.421910 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:31:28.421882 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5cb8dc788d-257kh" event={"ID":"adf24946-43b8-4802-b039-4bed83a56364","Type":"ContainerStarted","Data":"495c1d14980f245e0b78ac71066bb3a2c429d58aea145dad99507b6770ac5185"} Jul 22 16:31:30.221492 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:31:30.221461 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 22 16:31:30.435941 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:31:30.435901 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5cb8dc788d-257kh" event={"ID":"adf24946-43b8-4802-b039-4bed83a56364","Type":"ContainerStarted","Data":"cfeaef77fa0233905b1b1935000c0c00b2574d0ce958b4c0b68afd8f9480bb8e"} Jul 22 16:31:30.436099 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:31:30.435974 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5cb8dc788d-257kh" Jul 22 16:31:30.466627 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:31:30.466546 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5cb8dc788d-257kh" podStartSLOduration=0.927765446 podStartE2EDuration="3.466528909s" totalImagesPullingTime="2.538763463s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:31:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:31:30.465915728 +0000 UTC m=+542.567531327" watchObservedRunningTime="2026-07-22 16:31:30.466528909 +0000 UTC m=+542.568144485" Jul 22 16:31:41.443859 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:31:41.443830 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5cb8dc788d-257kh" Jul 22 16:31:41.928736 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:31:41.928685 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5cb8dc788d-257kh"] Jul 22 16:31:41.928928 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:31:41.928904 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-5cb8dc788d-257kh" podUID="adf24946-43b8-4802-b039-4bed83a56364" containerName="manager" containerID="cri-o://cfeaef77fa0233905b1b1935000c0c00b2574d0ce958b4c0b68afd8f9480bb8e" gracePeriod=30 Jul 22 16:31:42.178711 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:31:42.178683 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5cb8dc788d-257kh" Jul 22 16:31:42.309767 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:31:42.309732 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/adf24946-43b8-4802-b039-4bed83a56364-webhook-cert\") pod \"adf24946-43b8-4802-b039-4bed83a56364\" (UID: \"adf24946-43b8-4802-b039-4bed83a56364\") " Jul 22 16:31:42.309936 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:31:42.309880 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5stdn\" (UniqueName: \"kubernetes.io/projected/adf24946-43b8-4802-b039-4bed83a56364-kube-api-access-5stdn\") pod \"adf24946-43b8-4802-b039-4bed83a56364\" (UID: \"adf24946-43b8-4802-b039-4bed83a56364\") " Jul 22 16:31:42.311967 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:31:42.311938 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/adf24946-43b8-4802-b039-4bed83a56364-kube-api-access-5stdn" (OuterVolumeSpecName: "kube-api-access-5stdn") pod "adf24946-43b8-4802-b039-4bed83a56364" (UID: "adf24946-43b8-4802-b039-4bed83a56364"). InnerVolumeSpecName "kube-api-access-5stdn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 16:31:42.312114 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:31:42.312031 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/adf24946-43b8-4802-b039-4bed83a56364-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "adf24946-43b8-4802-b039-4bed83a56364" (UID: "adf24946-43b8-4802-b039-4bed83a56364"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 16:31:42.411194 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:31:42.411162 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5stdn\" (UniqueName: \"kubernetes.io/projected/adf24946-43b8-4802-b039-4bed83a56364-kube-api-access-5stdn\") on node \"ip-10-0-133-47.ec2.internal\" DevicePath \"\"" Jul 22 16:31:42.411194 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:31:42.411189 2568 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/adf24946-43b8-4802-b039-4bed83a56364-webhook-cert\") on node \"ip-10-0-133-47.ec2.internal\" DevicePath \"\"" Jul 22 16:31:42.505593 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:31:42.505550 2568 generic.go:356] "Generic (PLEG): container finished" podID="adf24946-43b8-4802-b039-4bed83a56364" containerID="cfeaef77fa0233905b1b1935000c0c00b2574d0ce958b4c0b68afd8f9480bb8e" exitCode=0 Jul 22 16:31:42.505593 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:31:42.505589 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5cb8dc788d-257kh" Jul 22 16:31:42.506129 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:31:42.505628 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5cb8dc788d-257kh" event={"ID":"adf24946-43b8-4802-b039-4bed83a56364","Type":"ContainerDied","Data":"cfeaef77fa0233905b1b1935000c0c00b2574d0ce958b4c0b68afd8f9480bb8e"} Jul 22 16:31:42.506129 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:31:42.505682 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5cb8dc788d-257kh" event={"ID":"adf24946-43b8-4802-b039-4bed83a56364","Type":"ContainerDied","Data":"495c1d14980f245e0b78ac71066bb3a2c429d58aea145dad99507b6770ac5185"} Jul 22 16:31:42.506129 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:31:42.505705 2568 scope.go:117] "RemoveContainer" containerID="cfeaef77fa0233905b1b1935000c0c00b2574d0ce958b4c0b68afd8f9480bb8e" Jul 22 16:31:42.515258 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:31:42.515233 2568 scope.go:117] "RemoveContainer" containerID="cfeaef77fa0233905b1b1935000c0c00b2574d0ce958b4c0b68afd8f9480bb8e" Jul 22 16:31:42.515572 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:31:42.515552 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cfeaef77fa0233905b1b1935000c0c00b2574d0ce958b4c0b68afd8f9480bb8e\": container with ID starting with cfeaef77fa0233905b1b1935000c0c00b2574d0ce958b4c0b68afd8f9480bb8e not found: ID does not exist" containerID="cfeaef77fa0233905b1b1935000c0c00b2574d0ce958b4c0b68afd8f9480bb8e" Jul 22 16:31:42.515672 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:31:42.515588 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cfeaef77fa0233905b1b1935000c0c00b2574d0ce958b4c0b68afd8f9480bb8e"} err="failed to get container status \"cfeaef77fa0233905b1b1935000c0c00b2574d0ce958b4c0b68afd8f9480bb8e\": rpc error: code = NotFound desc = could not find container \"cfeaef77fa0233905b1b1935000c0c00b2574d0ce958b4c0b68afd8f9480bb8e\": container with ID starting with cfeaef77fa0233905b1b1935000c0c00b2574d0ce958b4c0b68afd8f9480bb8e not found: ID does not exist" Jul 22 16:31:42.522321 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:31:42.522291 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5cb8dc788d-257kh"] Jul 22 16:31:42.526301 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:31:42.526277 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5cb8dc788d-257kh"] Jul 22 16:31:44.410536 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:31:44.410505 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="adf24946-43b8-4802-b039-4bed83a56364" path="/var/lib/kubelet/pods/adf24946-43b8-4802-b039-4bed83a56364/volumes" Jul 22 16:32:04.347538 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:32:04.347494 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-5pgh4"] Jul 22 16:32:04.348217 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:32:04.348191 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="adf24946-43b8-4802-b039-4bed83a56364" containerName="manager" Jul 22 16:32:04.348217 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:32:04.348216 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="adf24946-43b8-4802-b039-4bed83a56364" containerName="manager" Jul 22 16:32:04.348468 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:32:04.348382 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="adf24946-43b8-4802-b039-4bed83a56364" containerName="manager" Jul 22 16:32:04.355003 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:32:04.354981 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5bf47cd988-5pgh4" Jul 22 16:32:04.358077 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:32:04.358050 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 22 16:32:04.358261 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:32:04.358055 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-g4tpb\"" Jul 22 16:32:04.360992 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:32:04.360964 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-5pgh4"] Jul 22 16:32:04.400418 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:32:04.400379 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8s4p\" (UniqueName: \"kubernetes.io/projected/8fa9b53d-fb76-4f4c-a6f3-d5d0c0735a60-kube-api-access-d8s4p\") pod \"payload-processing-5bf47cd988-5pgh4\" (UID: \"8fa9b53d-fb76-4f4c-a6f3-d5d0c0735a60\") " pod="openshift-ingress/payload-processing-5bf47cd988-5pgh4" Jul 22 16:32:04.400596 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:32:04.400539 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8fa9b53d-fb76-4f4c-a6f3-d5d0c0735a60-plugins-config-volume\") pod \"payload-processing-5bf47cd988-5pgh4\" (UID: \"8fa9b53d-fb76-4f4c-a6f3-d5d0c0735a60\") " pod="openshift-ingress/payload-processing-5bf47cd988-5pgh4" Jul 22 16:32:04.502003 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:32:04.501968 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8fa9b53d-fb76-4f4c-a6f3-d5d0c0735a60-plugins-config-volume\") pod \"payload-processing-5bf47cd988-5pgh4\" (UID: \"8fa9b53d-fb76-4f4c-a6f3-d5d0c0735a60\") " pod="openshift-ingress/payload-processing-5bf47cd988-5pgh4" Jul 22 16:32:04.502003 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:32:04.502016 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8s4p\" (UniqueName: \"kubernetes.io/projected/8fa9b53d-fb76-4f4c-a6f3-d5d0c0735a60-kube-api-access-d8s4p\") pod \"payload-processing-5bf47cd988-5pgh4\" (UID: \"8fa9b53d-fb76-4f4c-a6f3-d5d0c0735a60\") " pod="openshift-ingress/payload-processing-5bf47cd988-5pgh4" Jul 22 16:32:04.502750 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:32:04.502728 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8fa9b53d-fb76-4f4c-a6f3-d5d0c0735a60-plugins-config-volume\") pod \"payload-processing-5bf47cd988-5pgh4\" (UID: \"8fa9b53d-fb76-4f4c-a6f3-d5d0c0735a60\") " pod="openshift-ingress/payload-processing-5bf47cd988-5pgh4" Jul 22 16:32:04.510054 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:32:04.510030 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8s4p\" (UniqueName: \"kubernetes.io/projected/8fa9b53d-fb76-4f4c-a6f3-d5d0c0735a60-kube-api-access-d8s4p\") pod \"payload-processing-5bf47cd988-5pgh4\" (UID: \"8fa9b53d-fb76-4f4c-a6f3-d5d0c0735a60\") " pod="openshift-ingress/payload-processing-5bf47cd988-5pgh4" Jul 22 16:32:04.667769 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:32:04.667673 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5bf47cd988-5pgh4" Jul 22 16:32:04.822253 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:32:04.822206 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-5pgh4"] Jul 22 16:32:04.827576 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:32:04.827504 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fa9b53d_fb76_4f4c_a6f3_d5d0c0735a60.slice/crio-f77b9da932f37b43a9003c7a9d3c6294492fcb292eac2f473c8db451366185bf WatchSource:0}: Error finding container f77b9da932f37b43a9003c7a9d3c6294492fcb292eac2f473c8db451366185bf: Status 404 returned error can't find the container with id f77b9da932f37b43a9003c7a9d3c6294492fcb292eac2f473c8db451366185bf Jul 22 16:32:05.662405 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:32:05.661131 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5bf47cd988-5pgh4" event={"ID":"8fa9b53d-fb76-4f4c-a6f3-d5d0c0735a60","Type":"ContainerStarted","Data":"f77b9da932f37b43a9003c7a9d3c6294492fcb292eac2f473c8db451366185bf"} Jul 22 16:32:07.677824 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:32:07.677789 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5bf47cd988-5pgh4" event={"ID":"8fa9b53d-fb76-4f4c-a6f3-d5d0c0735a60","Type":"ContainerStarted","Data":"da261d94d5fe43d7a3ae8c743e9114c72ac4cd603fe47ea29916f1db2a29bef5"} Jul 22 16:32:07.678295 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:32:07.677963 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5bf47cd988-5pgh4" Jul 22 16:32:07.694305 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:32:07.694254 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5bf47cd988-5pgh4" podStartSLOduration=1.9543267800000002 podStartE2EDuration="3.69423606s" totalImagesPullingTime="1.73990928s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:32:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:32:07.693551527 +0000 UTC m=+579.795167110" watchObservedRunningTime="2026-07-22 16:32:07.69423606 +0000 UTC m=+579.795851636" Jul 22 16:32:12.707367 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:32:12.707317 2568 generic.go:356] "Generic (PLEG): container finished" podID="30013739-f498-4418-b2e0-90ce6285ad42" containerID="d51995e77a96bba6d8d415157de9581166700dfa2bf595e49835f6dcde0b8fd8" exitCode=0 Jul 22 16:32:12.707909 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:32:12.707398 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-z87c4" event={"ID":"30013739-f498-4418-b2e0-90ce6285ad42","Type":"ContainerDied","Data":"d51995e77a96bba6d8d415157de9581166700dfa2bf595e49835f6dcde0b8fd8"} Jul 22 16:32:12.707909 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:32:12.707890 2568 scope.go:117] "RemoveContainer" containerID="d51995e77a96bba6d8d415157de9581166700dfa2bf595e49835f6dcde0b8fd8" Jul 22 16:32:12.708970 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:32:12.708932 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 16:32:12.709033 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:32:12.709013 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 16:32:12.709070 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:32:12.709051 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 16:32:13.714868 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:32:13.714833 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-z87c4" event={"ID":"30013739-f498-4418-b2e0-90ce6285ad42","Type":"ContainerStarted","Data":"c4809db27388ff3871e499f32f15a5aa0cfd1ac3a642e59d6259ae22d3cba4d9"} Jul 22 16:32:13.910420 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:32:13.910386 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-z87c4" Jul 22 16:32:13.910625 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:32:13.910607 2568 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-z87c4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body= Jul 22 16:32:13.910673 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:32:13.910647 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-z87c4" podUID="30013739-f498-4418-b2e0-90ce6285ad42" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" Jul 22 16:32:14.910427 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:32:14.910391 2568 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-z87c4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body= Jul 22 16:32:14.910837 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:32:14.910462 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-z87c4" podUID="30013739-f498-4418-b2e0-90ce6285ad42" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" Jul 22 16:32:15.910657 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:32:15.910620 2568 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-z87c4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body= Jul 22 16:32:15.911052 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:32:15.910689 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-z87c4" podUID="30013739-f498-4418-b2e0-90ce6285ad42" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" Jul 22 16:32:16.910010 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:32:16.909966 2568 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-z87c4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body= Jul 22 16:32:16.910230 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:32:16.910026 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-z87c4" podUID="30013739-f498-4418-b2e0-90ce6285ad42" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" Jul 22 16:32:17.914713 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:32:17.914677 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-z87c4" Jul 22 16:32:17.915174 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:32:17.914976 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-z87c4" Jul 22 16:32:17.915751 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:32:17.915734 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-z87c4" Jul 22 16:32:18.685284 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:32:18.685255 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5bf47cd988-5pgh4" Jul 22 16:32:25.395719 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:32:25.395676 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9mmh7"] Jul 22 16:32:25.399994 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:32:25.399976 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9mmh7" Jul 22 16:32:25.404437 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:32:25.404252 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-wr8qt\"" Jul 22 16:32:25.404437 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:32:25.404252 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jul 22 16:32:25.404437 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:32:25.404290 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 22 16:32:25.404437 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:32:25.404253 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 22 16:32:25.408539 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:32:25.408518 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9mmh7"] Jul 22 16:32:25.497018 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:32:25.496981 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5fb411dd-033a-454c-bc33-42ef5e7d7ee3-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9mmh7\" (UID: \"5fb411dd-033a-454c-bc33-42ef5e7d7ee3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9mmh7" Jul 22 16:32:25.497191 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:32:25.497067 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5fb411dd-033a-454c-bc33-42ef5e7d7ee3-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9mmh7\" (UID: \"5fb411dd-033a-454c-bc33-42ef5e7d7ee3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9mmh7" Jul 22 16:32:25.497191 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:32:25.497102 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5fb411dd-033a-454c-bc33-42ef5e7d7ee3-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9mmh7\" (UID: \"5fb411dd-033a-454c-bc33-42ef5e7d7ee3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9mmh7" Jul 22 16:32:25.497322 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:32:25.497286 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9t7wq\" (UniqueName: \"kubernetes.io/projected/5fb411dd-033a-454c-bc33-42ef5e7d7ee3-kube-api-access-9t7wq\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9mmh7\" (UID: \"5fb411dd-033a-454c-bc33-42ef5e7d7ee3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9mmh7" Jul 22 16:32:25.497502 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:32:25.497411 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5fb411dd-033a-454c-bc33-42ef5e7d7ee3-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9mmh7\" (UID: \"5fb411dd-033a-454c-bc33-42ef5e7d7ee3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9mmh7" Jul 22 16:32:25.497502 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:32:25.497479 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5fb411dd-033a-454c-bc33-42ef5e7d7ee3-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9mmh7\" (UID: \"5fb411dd-033a-454c-bc33-42ef5e7d7ee3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9mmh7" Jul 22 16:32:25.598940 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:32:25.598904 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9t7wq\" (UniqueName: \"kubernetes.io/projected/5fb411dd-033a-454c-bc33-42ef5e7d7ee3-kube-api-access-9t7wq\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9mmh7\" (UID: \"5fb411dd-033a-454c-bc33-42ef5e7d7ee3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9mmh7" Jul 22 16:32:25.599127 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:32:25.598970 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5fb411dd-033a-454c-bc33-42ef5e7d7ee3-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9mmh7\" (UID: \"5fb411dd-033a-454c-bc33-42ef5e7d7ee3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9mmh7" Jul 22 16:32:25.599127 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:32:25.598990 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5fb411dd-033a-454c-bc33-42ef5e7d7ee3-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9mmh7\" (UID: \"5fb411dd-033a-454c-bc33-42ef5e7d7ee3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9mmh7" Jul 22 16:32:25.599127 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:32:25.599020 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5fb411dd-033a-454c-bc33-42ef5e7d7ee3-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9mmh7\" (UID: \"5fb411dd-033a-454c-bc33-42ef5e7d7ee3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9mmh7" Jul 22 16:32:25.599127 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:32:25.599061 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5fb411dd-033a-454c-bc33-42ef5e7d7ee3-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9mmh7\" (UID: \"5fb411dd-033a-454c-bc33-42ef5e7d7ee3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9mmh7" Jul 22 16:32:25.599127 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:32:25.599093 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5fb411dd-033a-454c-bc33-42ef5e7d7ee3-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9mmh7\" (UID: \"5fb411dd-033a-454c-bc33-42ef5e7d7ee3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9mmh7" Jul 22 16:32:25.599602 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:32:25.599567 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5fb411dd-033a-454c-bc33-42ef5e7d7ee3-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9mmh7\" (UID: \"5fb411dd-033a-454c-bc33-42ef5e7d7ee3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9mmh7" Jul 22 16:32:25.599602 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:32:25.599585 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5fb411dd-033a-454c-bc33-42ef5e7d7ee3-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9mmh7\" (UID: \"5fb411dd-033a-454c-bc33-42ef5e7d7ee3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9mmh7" Jul 22 16:32:25.599796 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:32:25.599624 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5fb411dd-033a-454c-bc33-42ef5e7d7ee3-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9mmh7\" (UID: \"5fb411dd-033a-454c-bc33-42ef5e7d7ee3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9mmh7" Jul 22 16:32:25.601146 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:32:25.601124 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5fb411dd-033a-454c-bc33-42ef5e7d7ee3-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9mmh7\" (UID: \"5fb411dd-033a-454c-bc33-42ef5e7d7ee3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9mmh7" Jul 22 16:32:25.601464 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:32:25.601446 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5fb411dd-033a-454c-bc33-42ef5e7d7ee3-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9mmh7\" (UID: \"5fb411dd-033a-454c-bc33-42ef5e7d7ee3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9mmh7" Jul 22 16:32:25.606639 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:32:25.606604 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9t7wq\" (UniqueName: \"kubernetes.io/projected/5fb411dd-033a-454c-bc33-42ef5e7d7ee3-kube-api-access-9t7wq\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9mmh7\" (UID: \"5fb411dd-033a-454c-bc33-42ef5e7d7ee3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9mmh7" Jul 22 16:32:25.712093 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:32:25.712005 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9mmh7" Jul 22 16:32:25.865322 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:32:25.865293 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9mmh7"] Jul 22 16:32:25.866946 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:32:25.866919 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fb411dd_033a_454c_bc33_42ef5e7d7ee3.slice/crio-ddf52acb531808e84cdd3a82efe663110acb0a851198ef5fd2b4ab41e656547a WatchSource:0}: Error finding container ddf52acb531808e84cdd3a82efe663110acb0a851198ef5fd2b4ab41e656547a: Status 404 returned error can't find the container with id ddf52acb531808e84cdd3a82efe663110acb0a851198ef5fd2b4ab41e656547a Jul 22 16:32:26.793004 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:32:26.792957 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9mmh7" event={"ID":"5fb411dd-033a-454c-bc33-42ef5e7d7ee3","Type":"ContainerStarted","Data":"ddf52acb531808e84cdd3a82efe663110acb0a851198ef5fd2b4ab41e656547a"} Jul 22 16:32:27.800005 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:32:27.799969 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9mmh7" event={"ID":"5fb411dd-033a-454c-bc33-42ef5e7d7ee3","Type":"ContainerStarted","Data":"d1de1dbd0431b80c1776ca3db783ee8227a7ac14cb6539927a871c6d980c9c74"} Jul 22 16:32:27.818992 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:32:27.818940 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9mmh7" podStartSLOduration=1.745129227 podStartE2EDuration="2.818922927s" totalImagesPullingTime="1.0737937s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:32:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:32:27.817059709 +0000 UTC m=+599.918675285" watchObservedRunningTime="2026-07-22 16:32:27.818922927 +0000 UTC m=+599.920538502" Jul 22 16:32:28.357643 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:32:28.357608 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-lfqs8_816518f1-790a-4350-ae15-18287e06323a/console-operator/2.log" Jul 22 16:32:28.360837 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:32:28.360812 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-lfqs8_816518f1-790a-4350-ae15-18287e06323a/console-operator/2.log" Jul 22 16:32:35.713094 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:32:35.713063 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9mmh7" Jul 22 16:32:35.713638 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:32:35.713118 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9mmh7" Jul 22 16:32:35.726140 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:32:35.726111 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9mmh7" Jul 22 16:32:35.854758 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:32:35.854730 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9mmh7" Jul 22 16:32:45.694717 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:32:45.694670 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-fbspp"] Jul 22 16:32:45.697889 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:32:45.697863 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fbspp" Jul 22 16:32:45.700551 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:32:45.700524 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 22 16:32:45.708040 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:32:45.708011 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-fbspp"] Jul 22 16:32:45.777444 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:32:45.777400 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5e3aadda-4bea-4ad8-b92a-ec1989752a8a-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fbspp\" (UID: \"5e3aadda-4bea-4ad8-b92a-ec1989752a8a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fbspp" Jul 22 16:32:45.777603 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:32:45.777461 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5e3aadda-4bea-4ad8-b92a-ec1989752a8a-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fbspp\" (UID: \"5e3aadda-4bea-4ad8-b92a-ec1989752a8a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fbspp" Jul 22 16:32:45.777603 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:32:45.777534 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5e3aadda-4bea-4ad8-b92a-ec1989752a8a-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fbspp\" (UID: \"5e3aadda-4bea-4ad8-b92a-ec1989752a8a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fbspp" Jul 22 16:32:45.777603 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:32:45.777560 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5e3aadda-4bea-4ad8-b92a-ec1989752a8a-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fbspp\" (UID: \"5e3aadda-4bea-4ad8-b92a-ec1989752a8a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fbspp" Jul 22 16:32:45.777727 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:32:45.777612 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5e3aadda-4bea-4ad8-b92a-ec1989752a8a-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fbspp\" (UID: \"5e3aadda-4bea-4ad8-b92a-ec1989752a8a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fbspp" Jul 22 16:32:45.777727 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:32:45.777663 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxg9d\" (UniqueName: \"kubernetes.io/projected/5e3aadda-4bea-4ad8-b92a-ec1989752a8a-kube-api-access-sxg9d\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fbspp\" (UID: \"5e3aadda-4bea-4ad8-b92a-ec1989752a8a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fbspp" Jul 22 16:32:45.878928 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:32:45.878893 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5e3aadda-4bea-4ad8-b92a-ec1989752a8a-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fbspp\" (UID: \"5e3aadda-4bea-4ad8-b92a-ec1989752a8a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fbspp" Jul 22 16:32:45.879117 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:32:45.878936 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5e3aadda-4bea-4ad8-b92a-ec1989752a8a-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fbspp\" (UID: \"5e3aadda-4bea-4ad8-b92a-ec1989752a8a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fbspp" Jul 22 16:32:45.879117 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:32:45.878974 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5e3aadda-4bea-4ad8-b92a-ec1989752a8a-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fbspp\" (UID: \"5e3aadda-4bea-4ad8-b92a-ec1989752a8a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fbspp" Jul 22 16:32:45.879117 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:32:45.878998 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5e3aadda-4bea-4ad8-b92a-ec1989752a8a-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fbspp\" (UID: \"5e3aadda-4bea-4ad8-b92a-ec1989752a8a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fbspp" Jul 22 16:32:45.879117 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:32:45.879041 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5e3aadda-4bea-4ad8-b92a-ec1989752a8a-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fbspp\" (UID: \"5e3aadda-4bea-4ad8-b92a-ec1989752a8a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fbspp" Jul 22 16:32:45.879117 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:32:45.879088 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxg9d\" (UniqueName: \"kubernetes.io/projected/5e3aadda-4bea-4ad8-b92a-ec1989752a8a-kube-api-access-sxg9d\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fbspp\" (UID: \"5e3aadda-4bea-4ad8-b92a-ec1989752a8a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fbspp" Jul 22 16:32:45.879486 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:32:45.879463 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5e3aadda-4bea-4ad8-b92a-ec1989752a8a-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fbspp\" (UID: \"5e3aadda-4bea-4ad8-b92a-ec1989752a8a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fbspp" Jul 22 16:32:45.879563 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:32:45.879522 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5e3aadda-4bea-4ad8-b92a-ec1989752a8a-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fbspp\" (UID: \"5e3aadda-4bea-4ad8-b92a-ec1989752a8a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fbspp" Jul 22 16:32:45.879604 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:32:45.879570 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5e3aadda-4bea-4ad8-b92a-ec1989752a8a-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fbspp\" (UID: \"5e3aadda-4bea-4ad8-b92a-ec1989752a8a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fbspp" Jul 22 16:32:45.881197 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:32:45.881178 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5e3aadda-4bea-4ad8-b92a-ec1989752a8a-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fbspp\" (UID: \"5e3aadda-4bea-4ad8-b92a-ec1989752a8a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fbspp" Jul 22 16:32:45.881570 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:32:45.881553 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5e3aadda-4bea-4ad8-b92a-ec1989752a8a-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fbspp\" (UID: \"5e3aadda-4bea-4ad8-b92a-ec1989752a8a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fbspp" Jul 22 16:32:45.888106 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:32:45.888078 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxg9d\" (UniqueName: \"kubernetes.io/projected/5e3aadda-4bea-4ad8-b92a-ec1989752a8a-kube-api-access-sxg9d\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fbspp\" (UID: \"5e3aadda-4bea-4ad8-b92a-ec1989752a8a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fbspp" Jul 22 16:32:46.009702 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:32:46.009658 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fbspp" Jul 22 16:32:46.148646 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:32:46.148612 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-fbspp"] Jul 22 16:32:46.150301 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:32:46.150276 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e3aadda_4bea_4ad8_b92a_ec1989752a8a.slice/crio-0c415c9bc1afaafc79362f35d5faae841bf5d382fdd6dc9a33f446949e41b684 WatchSource:0}: Error finding container 0c415c9bc1afaafc79362f35d5faae841bf5d382fdd6dc9a33f446949e41b684: Status 404 returned error can't find the container with id 0c415c9bc1afaafc79362f35d5faae841bf5d382fdd6dc9a33f446949e41b684 Jul 22 16:32:46.152148 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:32:46.152129 2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 22 16:32:46.906188 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:32:46.906147 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fbspp" event={"ID":"5e3aadda-4bea-4ad8-b92a-ec1989752a8a","Type":"ContainerStarted","Data":"21b5cd1466edd5a5cb7fbc92d380b7cb6fcec27f4f75dc129195df172f0fcf8c"} Jul 22 16:32:46.906620 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:32:46.906213 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fbspp" event={"ID":"5e3aadda-4bea-4ad8-b92a-ec1989752a8a","Type":"ContainerStarted","Data":"0c415c9bc1afaafc79362f35d5faae841bf5d382fdd6dc9a33f446949e41b684"} Jul 22 16:32:46.923063 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:32:46.923011 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fbspp" podStartSLOduration=1.74244241 podStartE2EDuration="1.922994528s" totalImagesPullingTime="180.552118ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:32:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:32:46.921974899 +0000 UTC m=+619.023590477" watchObservedRunningTime="2026-07-22 16:32:46.922994528 +0000 UTC m=+619.024610103" Jul 22 16:32:56.010849 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:32:56.010762 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fbspp" Jul 22 16:32:56.010849 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:32:56.010818 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fbspp" Jul 22 16:32:56.023414 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:32:56.023384 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fbspp" Jul 22 16:32:56.980431 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:32:56.980406 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fbspp" Jul 22 16:33:09.109789 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:33:09.109742 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-zjxxd"] Jul 22 16:33:09.115129 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:33:09.115098 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zjxxd" Jul 22 16:33:09.118457 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:33:09.118423 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 22 16:33:09.123996 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:33:09.123692 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-zjxxd"] Jul 22 16:33:09.195516 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:33:09.195478 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/144deb48-5ef3-492b-8052-0441bb8f633f-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zjxxd\" (UID: \"144deb48-5ef3-492b-8052-0441bb8f633f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zjxxd" Jul 22 16:33:09.195516 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:33:09.195518 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/144deb48-5ef3-492b-8052-0441bb8f633f-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zjxxd\" (UID: \"144deb48-5ef3-492b-8052-0441bb8f633f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zjxxd" Jul 22 16:33:09.195766 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:33:09.195579 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pccxh\" (UniqueName: \"kubernetes.io/projected/144deb48-5ef3-492b-8052-0441bb8f633f-kube-api-access-pccxh\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zjxxd\" (UID: \"144deb48-5ef3-492b-8052-0441bb8f633f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zjxxd" Jul 22 16:33:09.195766 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:33:09.195678 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/144deb48-5ef3-492b-8052-0441bb8f633f-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zjxxd\" (UID: \"144deb48-5ef3-492b-8052-0441bb8f633f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zjxxd" Jul 22 16:33:09.195766 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:33:09.195716 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/144deb48-5ef3-492b-8052-0441bb8f633f-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zjxxd\" (UID: \"144deb48-5ef3-492b-8052-0441bb8f633f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zjxxd" Jul 22 16:33:09.195870 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:33:09.195800 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/144deb48-5ef3-492b-8052-0441bb8f633f-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zjxxd\" (UID: \"144deb48-5ef3-492b-8052-0441bb8f633f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zjxxd" Jul 22 16:33:09.297114 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:33:09.297084 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/144deb48-5ef3-492b-8052-0441bb8f633f-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zjxxd\" (UID: \"144deb48-5ef3-492b-8052-0441bb8f633f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zjxxd" Jul 22 16:33:09.297114 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:33:09.297117 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/144deb48-5ef3-492b-8052-0441bb8f633f-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zjxxd\" (UID: \"144deb48-5ef3-492b-8052-0441bb8f633f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zjxxd" Jul 22 16:33:09.297336 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:33:09.297268 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/144deb48-5ef3-492b-8052-0441bb8f633f-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zjxxd\" (UID: \"144deb48-5ef3-492b-8052-0441bb8f633f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zjxxd" Jul 22 16:33:09.297336 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:33:09.297329 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/144deb48-5ef3-492b-8052-0441bb8f633f-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zjxxd\" (UID: \"144deb48-5ef3-492b-8052-0441bb8f633f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zjxxd" Jul 22 16:33:09.297457 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:33:09.297386 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/144deb48-5ef3-492b-8052-0441bb8f633f-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zjxxd\" (UID: \"144deb48-5ef3-492b-8052-0441bb8f633f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zjxxd" Jul 22 16:33:09.297457 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:33:09.297438 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pccxh\" (UniqueName: \"kubernetes.io/projected/144deb48-5ef3-492b-8052-0441bb8f633f-kube-api-access-pccxh\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zjxxd\" (UID: \"144deb48-5ef3-492b-8052-0441bb8f633f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zjxxd" Jul 22 16:33:09.297569 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:33:09.297548 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/144deb48-5ef3-492b-8052-0441bb8f633f-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zjxxd\" (UID: \"144deb48-5ef3-492b-8052-0441bb8f633f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zjxxd" Jul 22 16:33:09.297657 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:33:09.297639 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/144deb48-5ef3-492b-8052-0441bb8f633f-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zjxxd\" (UID: \"144deb48-5ef3-492b-8052-0441bb8f633f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zjxxd" Jul 22 16:33:09.297779 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:33:09.297758 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/144deb48-5ef3-492b-8052-0441bb8f633f-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zjxxd\" (UID: \"144deb48-5ef3-492b-8052-0441bb8f633f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zjxxd" Jul 22 16:33:09.299514 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:33:09.299494 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/144deb48-5ef3-492b-8052-0441bb8f633f-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zjxxd\" (UID: \"144deb48-5ef3-492b-8052-0441bb8f633f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zjxxd" Jul 22 16:33:09.299842 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:33:09.299823 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/144deb48-5ef3-492b-8052-0441bb8f633f-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zjxxd\" (UID: \"144deb48-5ef3-492b-8052-0441bb8f633f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zjxxd" Jul 22 16:33:09.305576 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:33:09.305551 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pccxh\" (UniqueName: \"kubernetes.io/projected/144deb48-5ef3-492b-8052-0441bb8f633f-kube-api-access-pccxh\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zjxxd\" (UID: \"144deb48-5ef3-492b-8052-0441bb8f633f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zjxxd" Jul 22 16:33:09.428367 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:33:09.428264 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zjxxd" Jul 22 16:33:09.579392 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:33:09.579337 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-zjxxd"] Jul 22 16:33:09.579935 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:33:09.579906 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod144deb48_5ef3_492b_8052_0441bb8f633f.slice/crio-c396a22a6ab3340ba6ed6ab65fc4e8e514e4f96772d7beeee752f764e45f9edf WatchSource:0}: Error finding container c396a22a6ab3340ba6ed6ab65fc4e8e514e4f96772d7beeee752f764e45f9edf: Status 404 returned error can't find the container with id c396a22a6ab3340ba6ed6ab65fc4e8e514e4f96772d7beeee752f764e45f9edf Jul 22 16:33:10.044817 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:33:10.044777 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zjxxd" event={"ID":"144deb48-5ef3-492b-8052-0441bb8f633f","Type":"ContainerStarted","Data":"896c7cbde029ea3a9b2459780ac3da151c96fe4961040f765d96befbe453964d"} Jul 22 16:33:10.044982 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:33:10.044876 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zjxxd" event={"ID":"144deb48-5ef3-492b-8052-0441bb8f633f","Type":"ContainerStarted","Data":"c396a22a6ab3340ba6ed6ab65fc4e8e514e4f96772d7beeee752f764e45f9edf"} Jul 22 16:33:10.062105 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:33:10.062047 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zjxxd" podStartSLOduration=0.66915485 podStartE2EDuration="1.062030426s" totalImagesPullingTime="392.875576ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:33:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:33:10.060929375 +0000 UTC m=+642.162544951" watchObservedRunningTime="2026-07-22 16:33:10.062030426 +0000 UTC m=+642.163646001" Jul 22 16:33:19.428834 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:33:19.428797 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zjxxd" Jul 22 16:33:19.429308 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:33:19.428873 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zjxxd" Jul 22 16:33:19.442735 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:33:19.442709 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zjxxd" Jul 22 16:33:20.114493 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:33:20.114464 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zjxxd" Jul 22 16:34:19.597830 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:34:19.597783 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-668797cd4c-k8phx"] Jul 22 16:34:19.601621 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:34:19.601603 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-668797cd4c-k8phx" Jul 22 16:34:19.609049 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:34:19.608864 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-668797cd4c-k8phx"] Jul 22 16:34:19.648537 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:34:19.648500 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qpf2s\" (UniqueName: \"kubernetes.io/projected/f6715f89-ea5d-470d-802e-12ffdbbf7dde-kube-api-access-qpf2s\") pod \"authorino-668797cd4c-k8phx\" (UID: \"f6715f89-ea5d-470d-802e-12ffdbbf7dde\") " pod="kuadrant-system/authorino-668797cd4c-k8phx" Jul 22 16:34:19.648698 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:34:19.648574 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f6715f89-ea5d-470d-802e-12ffdbbf7dde-tls-cert\") pod \"authorino-668797cd4c-k8phx\" (UID: \"f6715f89-ea5d-470d-802e-12ffdbbf7dde\") " pod="kuadrant-system/authorino-668797cd4c-k8phx" Jul 22 16:34:19.749241 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:34:19.749209 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qpf2s\" (UniqueName: \"kubernetes.io/projected/f6715f89-ea5d-470d-802e-12ffdbbf7dde-kube-api-access-qpf2s\") pod \"authorino-668797cd4c-k8phx\" (UID: \"f6715f89-ea5d-470d-802e-12ffdbbf7dde\") " pod="kuadrant-system/authorino-668797cd4c-k8phx" Jul 22 16:34:19.749458 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:34:19.749392 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f6715f89-ea5d-470d-802e-12ffdbbf7dde-tls-cert\") pod \"authorino-668797cd4c-k8phx\" (UID: \"f6715f89-ea5d-470d-802e-12ffdbbf7dde\") " pod="kuadrant-system/authorino-668797cd4c-k8phx" Jul 22 16:34:19.751846 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:34:19.751821 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f6715f89-ea5d-470d-802e-12ffdbbf7dde-tls-cert\") pod \"authorino-668797cd4c-k8phx\" (UID: \"f6715f89-ea5d-470d-802e-12ffdbbf7dde\") " pod="kuadrant-system/authorino-668797cd4c-k8phx" Jul 22 16:34:19.757323 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:34:19.757295 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qpf2s\" (UniqueName: \"kubernetes.io/projected/f6715f89-ea5d-470d-802e-12ffdbbf7dde-kube-api-access-qpf2s\") pod \"authorino-668797cd4c-k8phx\" (UID: \"f6715f89-ea5d-470d-802e-12ffdbbf7dde\") " pod="kuadrant-system/authorino-668797cd4c-k8phx" Jul 22 16:34:19.911595 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:34:19.911510 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-668797cd4c-k8phx" Jul 22 16:34:20.049668 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:34:20.049632 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf6715f89_ea5d_470d_802e_12ffdbbf7dde.slice/crio-24ff53d98dbc3a50be6fe27fcd9fd86662bb659a7705504f077a0d038f5abbec WatchSource:0}: Error finding container 24ff53d98dbc3a50be6fe27fcd9fd86662bb659a7705504f077a0d038f5abbec: Status 404 returned error can't find the container with id 24ff53d98dbc3a50be6fe27fcd9fd86662bb659a7705504f077a0d038f5abbec Jul 22 16:34:20.049828 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:34:20.049805 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-668797cd4c-k8phx"] Jul 22 16:34:20.466307 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:34:20.466258 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-668797cd4c-k8phx" event={"ID":"f6715f89-ea5d-470d-802e-12ffdbbf7dde","Type":"ContainerStarted","Data":"24ff53d98dbc3a50be6fe27fcd9fd86662bb659a7705504f077a0d038f5abbec"} Jul 22 16:34:21.474142 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:34:21.474105 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-668797cd4c-k8phx" event={"ID":"f6715f89-ea5d-470d-802e-12ffdbbf7dde","Type":"ContainerStarted","Data":"16d431b12e60078158c809d78e364ddaa3b42a568a92b31921a82e30c851ed35"} Jul 22 16:34:21.492552 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:34:21.492489 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-668797cd4c-k8phx" podStartSLOduration=2.08344573 podStartE2EDuration="2.492469287s" totalImagesPullingTime="409.023557ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:34:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:34:21.489160244 +0000 UTC m=+713.590775821" watchObservedRunningTime="2026-07-22 16:34:21.492469287 +0000 UTC m=+713.594084864" Jul 22 16:34:21.515174 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:34:21.515135 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7c659676cd-6wlss"] Jul 22 16:34:21.515419 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:34:21.515393 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-7c659676cd-6wlss" podUID="b03b100c-fc34-4401-9fb1-9c3d6604ba58" containerName="authorino" containerID="cri-o://a79155add68b4eea36a8948711de60c7757a906482dd49efc36d2860f3e5d8a7" gracePeriod=30 Jul 22 16:34:21.778846 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:34:21.778819 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7c659676cd-6wlss" Jul 22 16:34:21.871588 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:34:21.871549 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b03b100c-fc34-4401-9fb1-9c3d6604ba58-tls-cert\") pod \"b03b100c-fc34-4401-9fb1-9c3d6604ba58\" (UID: \"b03b100c-fc34-4401-9fb1-9c3d6604ba58\") " Jul 22 16:34:21.871834 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:34:21.871673 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f5pcb\" (UniqueName: \"kubernetes.io/projected/b03b100c-fc34-4401-9fb1-9c3d6604ba58-kube-api-access-f5pcb\") pod \"b03b100c-fc34-4401-9fb1-9c3d6604ba58\" (UID: \"b03b100c-fc34-4401-9fb1-9c3d6604ba58\") " Jul 22 16:34:21.873707 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:34:21.873673 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b03b100c-fc34-4401-9fb1-9c3d6604ba58-kube-api-access-f5pcb" (OuterVolumeSpecName: "kube-api-access-f5pcb") pod "b03b100c-fc34-4401-9fb1-9c3d6604ba58" (UID: "b03b100c-fc34-4401-9fb1-9c3d6604ba58"). InnerVolumeSpecName "kube-api-access-f5pcb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 16:34:21.882980 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:34:21.882943 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b03b100c-fc34-4401-9fb1-9c3d6604ba58-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "b03b100c-fc34-4401-9fb1-9c3d6604ba58" (UID: "b03b100c-fc34-4401-9fb1-9c3d6604ba58"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 16:34:21.972756 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:34:21.972725 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f5pcb\" (UniqueName: \"kubernetes.io/projected/b03b100c-fc34-4401-9fb1-9c3d6604ba58-kube-api-access-f5pcb\") on node \"ip-10-0-133-47.ec2.internal\" DevicePath \"\"" Jul 22 16:34:21.972756 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:34:21.972753 2568 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b03b100c-fc34-4401-9fb1-9c3d6604ba58-tls-cert\") on node \"ip-10-0-133-47.ec2.internal\" DevicePath \"\"" Jul 22 16:34:22.483898 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:34:22.483855 2568 generic.go:356] "Generic (PLEG): container finished" podID="b03b100c-fc34-4401-9fb1-9c3d6604ba58" containerID="a79155add68b4eea36a8948711de60c7757a906482dd49efc36d2860f3e5d8a7" exitCode=0 Jul 22 16:34:22.484306 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:34:22.483909 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7c659676cd-6wlss" Jul 22 16:34:22.484306 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:34:22.483941 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7c659676cd-6wlss" event={"ID":"b03b100c-fc34-4401-9fb1-9c3d6604ba58","Type":"ContainerDied","Data":"a79155add68b4eea36a8948711de60c7757a906482dd49efc36d2860f3e5d8a7"} Jul 22 16:34:22.484306 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:34:22.483987 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7c659676cd-6wlss" event={"ID":"b03b100c-fc34-4401-9fb1-9c3d6604ba58","Type":"ContainerDied","Data":"00b15cedf94ccbf29f336bc2fbe968fb23c6811947766a09c6d276ee40510850"} Jul 22 16:34:22.484306 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:34:22.484018 2568 scope.go:117] "RemoveContainer" containerID="a79155add68b4eea36a8948711de60c7757a906482dd49efc36d2860f3e5d8a7" Jul 22 16:34:22.499824 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:34:22.499727 2568 scope.go:117] "RemoveContainer" containerID="a79155add68b4eea36a8948711de60c7757a906482dd49efc36d2860f3e5d8a7" Jul 22 16:34:22.500414 ip-10-0-133-47 kubenswrapper[2568]: E0722 16:34:22.500383 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a79155add68b4eea36a8948711de60c7757a906482dd49efc36d2860f3e5d8a7\": container with ID starting with a79155add68b4eea36a8948711de60c7757a906482dd49efc36d2860f3e5d8a7 not found: ID does not exist" containerID="a79155add68b4eea36a8948711de60c7757a906482dd49efc36d2860f3e5d8a7" Jul 22 16:34:22.500593 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:34:22.500566 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a79155add68b4eea36a8948711de60c7757a906482dd49efc36d2860f3e5d8a7"} err="failed to get container status \"a79155add68b4eea36a8948711de60c7757a906482dd49efc36d2860f3e5d8a7\": rpc error: code = NotFound desc = could not find container \"a79155add68b4eea36a8948711de60c7757a906482dd49efc36d2860f3e5d8a7\": container with ID starting with a79155add68b4eea36a8948711de60c7757a906482dd49efc36d2860f3e5d8a7 not found: ID does not exist" Jul 22 16:34:22.504708 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:34:22.504668 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7c659676cd-6wlss"] Jul 22 16:34:22.507145 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:34:22.507119 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7c659676cd-6wlss"] Jul 22 16:34:24.410615 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:34:24.410584 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b03b100c-fc34-4401-9fb1-9c3d6604ba58" path="/var/lib/kubelet/pods/b03b100c-fc34-4401-9fb1-9c3d6604ba58/volumes" Jul 22 16:37:28.400515 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:37:28.400438 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-lfqs8_816518f1-790a-4350-ae15-18287e06323a/console-operator/2.log" Jul 22 16:37:28.400515 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:37:28.400463 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-lfqs8_816518f1-790a-4350-ae15-18287e06323a/console-operator/2.log" Jul 22 16:41:24.367706 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:41:24.367666 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r795k"] Jul 22 16:41:24.368329 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:41:24.367898 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r795k" podUID="6d0ea298-5bd8-4f65-9e07-82c929eccdb6" containerName="manager" containerID="cri-o://8abfe062c7fa7a80d5ece6ace36560df082ab860ca12b638768c53a1076f0912" gracePeriod=10 Jul 22 16:41:28.010101 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:41:28.010066 2568 generic.go:356] "Generic (PLEG): container finished" podID="6d0ea298-5bd8-4f65-9e07-82c929eccdb6" containerID="8abfe062c7fa7a80d5ece6ace36560df082ab860ca12b638768c53a1076f0912" exitCode=0 Jul 22 16:41:28.010501 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:41:28.010122 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r795k" event={"ID":"6d0ea298-5bd8-4f65-9e07-82c929eccdb6","Type":"ContainerDied","Data":"8abfe062c7fa7a80d5ece6ace36560df082ab860ca12b638768c53a1076f0912"} Jul 22 16:41:28.134672 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:41:28.134647 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r795k" Jul 22 16:41:28.254364 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:41:28.254310 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6d0ea298-5bd8-4f65-9e07-82c929eccdb6-extensions-socket-volume\") pod \"6d0ea298-5bd8-4f65-9e07-82c929eccdb6\" (UID: \"6d0ea298-5bd8-4f65-9e07-82c929eccdb6\") " Jul 22 16:41:28.254541 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:41:28.254468 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jtlw5\" (UniqueName: \"kubernetes.io/projected/6d0ea298-5bd8-4f65-9e07-82c929eccdb6-kube-api-access-jtlw5\") pod \"6d0ea298-5bd8-4f65-9e07-82c929eccdb6\" (UID: \"6d0ea298-5bd8-4f65-9e07-82c929eccdb6\") " Jul 22 16:41:28.254706 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:41:28.254682 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d0ea298-5bd8-4f65-9e07-82c929eccdb6-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "6d0ea298-5bd8-4f65-9e07-82c929eccdb6" (UID: "6d0ea298-5bd8-4f65-9e07-82c929eccdb6"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 16:41:28.256500 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:41:28.256478 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d0ea298-5bd8-4f65-9e07-82c929eccdb6-kube-api-access-jtlw5" (OuterVolumeSpecName: "kube-api-access-jtlw5") pod "6d0ea298-5bd8-4f65-9e07-82c929eccdb6" (UID: "6d0ea298-5bd8-4f65-9e07-82c929eccdb6"). InnerVolumeSpecName "kube-api-access-jtlw5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 16:41:28.355710 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:41:28.355676 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jtlw5\" (UniqueName: \"kubernetes.io/projected/6d0ea298-5bd8-4f65-9e07-82c929eccdb6-kube-api-access-jtlw5\") on node \"ip-10-0-133-47.ec2.internal\" DevicePath \"\"" Jul 22 16:41:28.355710 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:41:28.355706 2568 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6d0ea298-5bd8-4f65-9e07-82c929eccdb6-extensions-socket-volume\") on node \"ip-10-0-133-47.ec2.internal\" DevicePath \"\"" Jul 22 16:41:28.503653 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:41:28.503619 2568 scope.go:117] "RemoveContainer" containerID="8abfe062c7fa7a80d5ece6ace36560df082ab860ca12b638768c53a1076f0912" Jul 22 16:41:29.015832 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:41:29.015798 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r795k" Jul 22 16:41:29.016280 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:41:29.015836 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r795k" event={"ID":"6d0ea298-5bd8-4f65-9e07-82c929eccdb6","Type":"ContainerDied","Data":"1b120807239cde6793a5763bc9ecf6929cd63eb4b5c6a2acf0e15d85b5cc856e"} Jul 22 16:41:29.047147 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:41:29.047112 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r795k"] Jul 22 16:41:29.050556 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:41:29.050530 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r795k"] Jul 22 16:41:30.410824 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:41:30.410794 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6d0ea298-5bd8-4f65-9e07-82c929eccdb6" path="/var/lib/kubelet/pods/6d0ea298-5bd8-4f65-9e07-82c929eccdb6/volumes" Jul 22 16:42:25.576129 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:42:25.576084 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m2zhm"] Jul 22 16:42:25.576739 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:42:25.576723 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d0ea298-5bd8-4f65-9e07-82c929eccdb6" containerName="manager" Jul 22 16:42:25.576786 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:42:25.576742 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d0ea298-5bd8-4f65-9e07-82c929eccdb6" containerName="manager" Jul 22 16:42:25.576786 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:42:25.576766 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b03b100c-fc34-4401-9fb1-9c3d6604ba58" containerName="authorino" Jul 22 16:42:25.576786 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:42:25.576775 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="b03b100c-fc34-4401-9fb1-9c3d6604ba58" containerName="authorino" Jul 22 16:42:25.576883 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:42:25.576866 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="6d0ea298-5bd8-4f65-9e07-82c929eccdb6" containerName="manager" Jul 22 16:42:25.576883 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:42:25.576879 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="b03b100c-fc34-4401-9fb1-9c3d6604ba58" containerName="authorino" Jul 22 16:42:25.580521 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:42:25.580501 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m2zhm" Jul 22 16:42:25.583534 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:42:25.583506 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-stkvr\"" Jul 22 16:42:25.592259 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:42:25.592213 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m2zhm"] Jul 22 16:42:25.676571 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:42:25.676535 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6bb2e2dd-9c5d-4764-acbd-6d419e8484bc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-m2zhm\" (UID: \"6bb2e2dd-9c5d-4764-acbd-6d419e8484bc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m2zhm" Jul 22 16:42:25.676773 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:42:25.676619 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bpjjv\" (UniqueName: \"kubernetes.io/projected/6bb2e2dd-9c5d-4764-acbd-6d419e8484bc-kube-api-access-bpjjv\") pod \"kuadrant-operator-controller-manager-86878c769f-m2zhm\" (UID: \"6bb2e2dd-9c5d-4764-acbd-6d419e8484bc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m2zhm" Jul 22 16:42:25.777631 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:42:25.777581 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6bb2e2dd-9c5d-4764-acbd-6d419e8484bc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-m2zhm\" (UID: \"6bb2e2dd-9c5d-4764-acbd-6d419e8484bc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m2zhm" Jul 22 16:42:25.777819 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:42:25.777674 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bpjjv\" (UniqueName: \"kubernetes.io/projected/6bb2e2dd-9c5d-4764-acbd-6d419e8484bc-kube-api-access-bpjjv\") pod \"kuadrant-operator-controller-manager-86878c769f-m2zhm\" (UID: \"6bb2e2dd-9c5d-4764-acbd-6d419e8484bc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m2zhm" Jul 22 16:42:25.777991 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:42:25.777972 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6bb2e2dd-9c5d-4764-acbd-6d419e8484bc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-m2zhm\" (UID: \"6bb2e2dd-9c5d-4764-acbd-6d419e8484bc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m2zhm" Jul 22 16:42:25.787774 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:42:25.787746 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bpjjv\" (UniqueName: \"kubernetes.io/projected/6bb2e2dd-9c5d-4764-acbd-6d419e8484bc-kube-api-access-bpjjv\") pod \"kuadrant-operator-controller-manager-86878c769f-m2zhm\" (UID: \"6bb2e2dd-9c5d-4764-acbd-6d419e8484bc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m2zhm" Jul 22 16:42:25.893450 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:42:25.893328 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m2zhm" Jul 22 16:42:26.065415 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:42:26.065078 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m2zhm"] Jul 22 16:42:26.068385 ip-10-0-133-47 kubenswrapper[2568]: W0722 16:42:26.068341 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6bb2e2dd_9c5d_4764_acbd_6d419e8484bc.slice/crio-d38de1ec995e859452e8f15096e02c86c07b54c014ccbb968d21f76284a72461 WatchSource:0}: Error finding container d38de1ec995e859452e8f15096e02c86c07b54c014ccbb968d21f76284a72461: Status 404 returned error can't find the container with id d38de1ec995e859452e8f15096e02c86c07b54c014ccbb968d21f76284a72461 Jul 22 16:42:26.341776 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:42:26.341737 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m2zhm" event={"ID":"6bb2e2dd-9c5d-4764-acbd-6d419e8484bc","Type":"ContainerStarted","Data":"5489d6ab13fa5e02ac6b8e58eea48c675055494b453b83fe1340169078c6640a"} Jul 22 16:42:26.341987 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:42:26.341795 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m2zhm" event={"ID":"6bb2e2dd-9c5d-4764-acbd-6d419e8484bc","Type":"ContainerStarted","Data":"d38de1ec995e859452e8f15096e02c86c07b54c014ccbb968d21f76284a72461"} Jul 22 16:42:26.341987 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:42:26.341815 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m2zhm" Jul 22 16:42:26.365279 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:42:26.365226 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m2zhm" podStartSLOduration=1.365209511 podStartE2EDuration="1.365209511s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:42:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:42:26.362930772 +0000 UTC m=+1198.464546358" watchObservedRunningTime="2026-07-22 16:42:26.365209511 +0000 UTC m=+1198.466825086" Jul 22 16:42:28.441998 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:42:28.441889 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-lfqs8_816518f1-790a-4350-ae15-18287e06323a/console-operator/2.log" Jul 22 16:42:28.454458 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:42:28.443410 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-lfqs8_816518f1-790a-4350-ae15-18287e06323a/console-operator/2.log" Jul 22 16:42:37.349024 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:42:37.348991 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m2zhm" Jul 22 16:47:28.479974 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:47:28.479932 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-lfqs8_816518f1-790a-4350-ae15-18287e06323a/console-operator/2.log" Jul 22 16:47:28.483535 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:47:28.483510 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-lfqs8_816518f1-790a-4350-ae15-18287e06323a/console-operator/2.log" Jul 22 16:52:28.517996 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:52:28.517892 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-lfqs8_816518f1-790a-4350-ae15-18287e06323a/console-operator/2.log" Jul 22 16:52:28.522959 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:52:28.522565 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-lfqs8_816518f1-790a-4350-ae15-18287e06323a/console-operator/2.log" Jul 22 16:57:28.557493 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:57:28.557384 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-lfqs8_816518f1-790a-4350-ae15-18287e06323a/console-operator/2.log" Jul 22 16:57:28.564476 ip-10-0-133-47 kubenswrapper[2568]: I0722 16:57:28.564451 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-lfqs8_816518f1-790a-4350-ae15-18287e06323a/console-operator/2.log" Jul 22 17:00:00.143383 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:00:00.143264 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-6608f1-29745660-9zphj"] Jul 22 17:00:00.147867 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:00:00.147838 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-b4259e-29745660-57fck"] Jul 22 17:00:00.148040 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:00:00.147952 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-6608f1-29745660-9zphj" Jul 22 17:00:00.150683 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:00:00.150663 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-sh5d4\"" Jul 22 17:00:00.151379 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:00:00.151327 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29745660-8nnfm"] Jul 22 17:00:00.151503 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:00:00.151458 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-b4259e-29745660-57fck" Jul 22 17:00:00.156373 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:00:00.155834 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-6608f1-29745660-9zphj"] Jul 22 17:00:00.156373 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:00:00.155950 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29745660-8nnfm" Jul 22 17:00:00.160276 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:00:00.160146 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-b4259e-29745660-57fck"] Jul 22 17:00:00.163792 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:00:00.163758 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29745660-8nnfm"] Jul 22 17:00:00.164396 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:00:00.164374 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-6608f1-29745660-9zphj" Jul 22 17:00:00.173605 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:00:00.173577 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-b4259e-29745660-57fck" Jul 22 17:00:00.217267 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:00:00.217232 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29745660-8nnfm" Jul 22 17:00:00.337327 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:00:00.337304 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-6608f1-29745660-9zphj"] Jul 22 17:00:00.339534 ip-10-0-133-47 kubenswrapper[2568]: W0722 17:00:00.339502 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65ee25b3_301a_43d4_9cdf_77cd54a8332d.slice/crio-42787210fac39e5eac90ecb5530de91c5e4ff0c6d77aaf9c767c00fe9d0cd4c4 WatchSource:0}: Error finding container 42787210fac39e5eac90ecb5530de91c5e4ff0c6d77aaf9c767c00fe9d0cd4c4: Status 404 returned error can't find the container with id 42787210fac39e5eac90ecb5530de91c5e4ff0c6d77aaf9c767c00fe9d0cd4c4 Jul 22 17:00:00.341980 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:00:00.341950 2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 22 17:00:00.394194 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:00:00.394136 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29745660-8nnfm"] Jul 22 17:00:00.395095 ip-10-0-133-47 kubenswrapper[2568]: W0722 17:00:00.395066 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6bdbe5b_9e84_4664_9b08_68322ccfb263.slice/crio-e35beb3fc61a562135d2dc32dfe2a6159705e4c6a3bf64afa5d2f7d62ea1627c WatchSource:0}: Error finding container e35beb3fc61a562135d2dc32dfe2a6159705e4c6a3bf64afa5d2f7d62ea1627c: Status 404 returned error can't find the container with id e35beb3fc61a562135d2dc32dfe2a6159705e4c6a3bf64afa5d2f7d62ea1627c Jul 22 17:00:00.569631 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:00:00.569597 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-b4259e-29745660-57fck"] Jul 22 17:00:00.571739 ip-10-0-133-47 kubenswrapper[2568]: W0722 17:00:00.571713 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod536e7402_9c77_4a31_8ead_ee82f6456ce0.slice/crio-54e5e2bc947df638b79e9f6fc44a12ea4b62c81fca970dee6ff09f8c51069c3b WatchSource:0}: Error finding container 54e5e2bc947df638b79e9f6fc44a12ea4b62c81fca970dee6ff09f8c51069c3b: Status 404 returned error can't find the container with id 54e5e2bc947df638b79e9f6fc44a12ea4b62c81fca970dee6ff09f8c51069c3b Jul 22 17:00:00.574883 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:00:00.574856 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29745660-8nnfm" event={"ID":"d6bdbe5b-9e84-4664-9b08-68322ccfb263","Type":"ContainerStarted","Data":"e35beb3fc61a562135d2dc32dfe2a6159705e4c6a3bf64afa5d2f7d62ea1627c"} Jul 22 17:00:00.576227 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:00:00.576184 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-6608f1-29745660-9zphj" event={"ID":"65ee25b3-301a-43d4-9cdf-77cd54a8332d","Type":"ContainerStarted","Data":"42787210fac39e5eac90ecb5530de91c5e4ff0c6d77aaf9c767c00fe9d0cd4c4"} Jul 22 17:00:01.584999 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:00:01.584957 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-b4259e-29745660-57fck" event={"ID":"536e7402-9c77-4a31-8ead-ee82f6456ce0","Type":"ContainerStarted","Data":"54e5e2bc947df638b79e9f6fc44a12ea4b62c81fca970dee6ff09f8c51069c3b"} Jul 22 17:00:03.601293 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:00:03.601185 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-6608f1-29745660-9zphj" event={"ID":"65ee25b3-301a-43d4-9cdf-77cd54a8332d","Type":"ContainerStarted","Data":"bf8c5b980ccc8b58cee09f622f0dc087d807def103a2b9193e5a45f1a1ae1dac"} Jul 22 17:00:03.602683 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:00:03.602654 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-b4259e-29745660-57fck" event={"ID":"536e7402-9c77-4a31-8ead-ee82f6456ce0","Type":"ContainerStarted","Data":"8e4e3e1a0c17eb292ee7288a4a8f67a9ae9f3755ceda25257fda183158f05acf"} Jul 22 17:00:03.604201 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:00:03.604166 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29745660-8nnfm" event={"ID":"d6bdbe5b-9e84-4664-9b08-68322ccfb263","Type":"ContainerStarted","Data":"683abbd7ddbf1c955461d3f51f2d1edd870feed36978ca5f39f627adf2c8f300"} Jul 22 17:00:03.617130 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:00:03.617079 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-6608f1-29745660-9zphj" podStartSLOduration=0.995333936 podStartE2EDuration="3.617064604s" totalImagesPullingTime="2.621730668s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 17:00:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 17:00:03.61632295 +0000 UTC m=+2255.717938525" watchObservedRunningTime="2026-07-22 17:00:03.617064604 +0000 UTC m=+2255.718680179" Jul 22 17:00:03.632406 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:00:03.632336 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-b4259e-29745660-57fck" podStartSLOduration=1.247728831 podStartE2EDuration="3.632318413s" totalImagesPullingTime="2.384589582s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 17:00:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 17:00:03.629878686 +0000 UTC m=+2255.731494262" watchObservedRunningTime="2026-07-22 17:00:03.632318413 +0000 UTC m=+2255.733934026" Jul 22 17:00:03.643755 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:00:03.643702 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29745660-8nnfm" podStartSLOduration=0.936669664 podStartE2EDuration="3.643686161s" totalImagesPullingTime="2.707016497s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 17:00:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 17:00:03.642174689 +0000 UTC m=+2255.743790268" watchObservedRunningTime="2026-07-22 17:00:03.643686161 +0000 UTC m=+2255.745301736" Jul 22 17:00:04.611163 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:00:04.611123 2568 generic.go:356] "Generic (PLEG): container finished" podID="d6bdbe5b-9e84-4664-9b08-68322ccfb263" containerID="683abbd7ddbf1c955461d3f51f2d1edd870feed36978ca5f39f627adf2c8f300" exitCode=0 Jul 22 17:00:04.611657 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:00:04.611169 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29745660-8nnfm" event={"ID":"d6bdbe5b-9e84-4664-9b08-68322ccfb263","Type":"ContainerDied","Data":"683abbd7ddbf1c955461d3f51f2d1edd870feed36978ca5f39f627adf2c8f300"} Jul 22 17:00:04.612763 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:00:04.612740 2568 generic.go:356] "Generic (PLEG): container finished" podID="65ee25b3-301a-43d4-9cdf-77cd54a8332d" containerID="bf8c5b980ccc8b58cee09f622f0dc087d807def103a2b9193e5a45f1a1ae1dac" exitCode=0 Jul 22 17:00:04.612832 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:00:04.612818 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-6608f1-29745660-9zphj" event={"ID":"65ee25b3-301a-43d4-9cdf-77cd54a8332d","Type":"ContainerDied","Data":"bf8c5b980ccc8b58cee09f622f0dc087d807def103a2b9193e5a45f1a1ae1dac"} Jul 22 17:00:04.614165 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:00:04.614146 2568 generic.go:356] "Generic (PLEG): container finished" podID="536e7402-9c77-4a31-8ead-ee82f6456ce0" containerID="8e4e3e1a0c17eb292ee7288a4a8f67a9ae9f3755ceda25257fda183158f05acf" exitCode=0 Jul 22 17:00:04.614217 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:00:04.614200 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-b4259e-29745660-57fck" event={"ID":"536e7402-9c77-4a31-8ead-ee82f6456ce0","Type":"ContainerDied","Data":"8e4e3e1a0c17eb292ee7288a4a8f67a9ae9f3755ceda25257fda183158f05acf"} Jul 22 17:00:05.783426 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:00:05.783391 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-6608f1-29745660-9zphj" Jul 22 17:00:05.829321 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:00:05.829297 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29745660-8nnfm" Jul 22 17:00:05.832938 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:00:05.832911 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-b4259e-29745660-57fck" Jul 22 17:00:06.626886 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:00:06.626853 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-6608f1-29745660-9zphj" Jul 22 17:00:06.626886 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:00:06.626863 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-6608f1-29745660-9zphj" event={"ID":"65ee25b3-301a-43d4-9cdf-77cd54a8332d","Type":"ContainerDied","Data":"42787210fac39e5eac90ecb5530de91c5e4ff0c6d77aaf9c767c00fe9d0cd4c4"} Jul 22 17:00:06.627109 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:00:06.626941 2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="42787210fac39e5eac90ecb5530de91c5e4ff0c6d77aaf9c767c00fe9d0cd4c4" Jul 22 17:00:06.628315 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:00:06.628291 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-b4259e-29745660-57fck" Jul 22 17:00:06.628315 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:00:06.628304 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-b4259e-29745660-57fck" event={"ID":"536e7402-9c77-4a31-8ead-ee82f6456ce0","Type":"ContainerDied","Data":"54e5e2bc947df638b79e9f6fc44a12ea4b62c81fca970dee6ff09f8c51069c3b"} Jul 22 17:00:06.628550 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:00:06.628342 2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="54e5e2bc947df638b79e9f6fc44a12ea4b62c81fca970dee6ff09f8c51069c3b" Jul 22 17:00:06.629814 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:00:06.629799 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29745660-8nnfm" Jul 22 17:00:06.629814 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:00:06.629798 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29745660-8nnfm" event={"ID":"d6bdbe5b-9e84-4664-9b08-68322ccfb263","Type":"ContainerDied","Data":"e35beb3fc61a562135d2dc32dfe2a6159705e4c6a3bf64afa5d2f7d62ea1627c"} Jul 22 17:00:06.629957 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:00:06.629836 2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e35beb3fc61a562135d2dc32dfe2a6159705e4c6a3bf64afa5d2f7d62ea1627c" Jul 22 17:00:16.871471 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:00:16.871428 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-b4259e-lgjgw"] Jul 22 17:00:16.871977 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:00:16.871960 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="536e7402-9c77-4a31-8ead-ee82f6456ce0" containerName="cleanup" Jul 22 17:00:16.872023 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:00:16.871980 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="536e7402-9c77-4a31-8ead-ee82f6456ce0" containerName="cleanup" Jul 22 17:00:16.872023 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:00:16.871996 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65ee25b3-301a-43d4-9cdf-77cd54a8332d" containerName="cleanup" Jul 22 17:00:16.872023 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:00:16.872003 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="65ee25b3-301a-43d4-9cdf-77cd54a8332d" containerName="cleanup" Jul 22 17:00:16.872023 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:00:16.872011 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6bdbe5b-9e84-4664-9b08-68322ccfb263" containerName="cleanup" Jul 22 17:00:16.872023 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:00:16.872017 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6bdbe5b-9e84-4664-9b08-68322ccfb263" containerName="cleanup" Jul 22 17:00:16.872176 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:00:16.872094 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="536e7402-9c77-4a31-8ead-ee82f6456ce0" containerName="cleanup" Jul 22 17:00:16.872176 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:00:16.872102 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="d6bdbe5b-9e84-4664-9b08-68322ccfb263" containerName="cleanup" Jul 22 17:00:16.872176 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:00:16.872109 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="65ee25b3-301a-43d4-9cdf-77cd54a8332d" containerName="cleanup" Jul 22 17:00:16.875271 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:00:16.875251 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-b4259e-lgjgw" Jul 22 17:00:16.878002 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:00:16.877976 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-sh5d4\"" Jul 22 17:00:16.882031 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:00:16.881998 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-b4259e-lgjgw"] Jul 22 17:00:16.956379 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:00:16.956319 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c2bbb504-dbed-40bb-83f7-725105370e79-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-b4259e-lgjgw\" (UID: \"c2bbb504-dbed-40bb-83f7-725105370e79\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-b4259e-lgjgw" Jul 22 17:00:17.057793 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:00:17.057753 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c2bbb504-dbed-40bb-83f7-725105370e79-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-b4259e-lgjgw\" (UID: \"c2bbb504-dbed-40bb-83f7-725105370e79\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-b4259e-lgjgw" Jul 22 17:00:17.058341 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:00:17.058324 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c2bbb504-dbed-40bb-83f7-725105370e79-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-b4259e-lgjgw\" (UID: \"c2bbb504-dbed-40bb-83f7-725105370e79\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-b4259e-lgjgw" Jul 22 17:00:17.188798 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:00:17.188705 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-b4259e-lgjgw" Jul 22 17:00:17.337406 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:00:17.337371 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-b4259e-lgjgw"] Jul 22 17:00:17.339761 ip-10-0-133-47 kubenswrapper[2568]: W0722 17:00:17.339720 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2bbb504_dbed_40bb_83f7_725105370e79.slice/crio-83314752d7d36384e30d652bdefdb1e224fdb0003061126e5d19e2a1a2b72bdd WatchSource:0}: Error finding container 83314752d7d36384e30d652bdefdb1e224fdb0003061126e5d19e2a1a2b72bdd: Status 404 returned error can't find the container with id 83314752d7d36384e30d652bdefdb1e224fdb0003061126e5d19e2a1a2b72bdd Jul 22 17:00:17.696960 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:00:17.696916 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-b4259e-lgjgw" event={"ID":"c2bbb504-dbed-40bb-83f7-725105370e79","Type":"ContainerStarted","Data":"a7f50c7223f158c696f0d186ed9f7084650a2e0970960fdbf4dcb49190d18056"} Jul 22 17:00:17.697110 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:00:17.696986 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-b4259e-lgjgw" event={"ID":"c2bbb504-dbed-40bb-83f7-725105370e79","Type":"ContainerStarted","Data":"83314752d7d36384e30d652bdefdb1e224fdb0003061126e5d19e2a1a2b72bdd"} Jul 22 17:00:17.714966 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:00:17.714914 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-b4259e-lgjgw" podStartSLOduration=1.714895173 podStartE2EDuration="1.714895173s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 17:00:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 17:00:17.712438032 +0000 UTC m=+2269.814053622" watchObservedRunningTime="2026-07-22 17:00:17.714895173 +0000 UTC m=+2269.816510748" Jul 22 17:00:18.704315 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:00:18.704222 2568 generic.go:356] "Generic (PLEG): container finished" podID="c2bbb504-dbed-40bb-83f7-725105370e79" containerID="a7f50c7223f158c696f0d186ed9f7084650a2e0970960fdbf4dcb49190d18056" exitCode=0 Jul 22 17:00:18.704689 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:00:18.704308 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-b4259e-lgjgw" event={"ID":"c2bbb504-dbed-40bb-83f7-725105370e79","Type":"ContainerDied","Data":"a7f50c7223f158c696f0d186ed9f7084650a2e0970960fdbf4dcb49190d18056"} Jul 22 17:00:19.863830 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:00:19.863802 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-b4259e-lgjgw" Jul 22 17:00:19.984245 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:00:19.984212 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c2bbb504-dbed-40bb-83f7-725105370e79-maas-api-service-ca\") pod \"c2bbb504-dbed-40bb-83f7-725105370e79\" (UID: \"c2bbb504-dbed-40bb-83f7-725105370e79\") " Jul 22 17:00:19.984600 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:00:19.984576 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c2bbb504-dbed-40bb-83f7-725105370e79-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c2bbb504-dbed-40bb-83f7-725105370e79" (UID: "c2bbb504-dbed-40bb-83f7-725105370e79"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 17:00:20.085136 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:00:20.085101 2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c2bbb504-dbed-40bb-83f7-725105370e79-maas-api-service-ca\") on node \"ip-10-0-133-47.ec2.internal\" DevicePath \"\"" Jul 22 17:00:20.719546 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:00:20.719518 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-b4259e-lgjgw" Jul 22 17:00:20.719709 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:00:20.719549 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-b4259e-lgjgw" event={"ID":"c2bbb504-dbed-40bb-83f7-725105370e79","Type":"ContainerDied","Data":"83314752d7d36384e30d652bdefdb1e224fdb0003061126e5d19e2a1a2b72bdd"} Jul 22 17:00:20.719709 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:00:20.719603 2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="83314752d7d36384e30d652bdefdb1e224fdb0003061126e5d19e2a1a2b72bdd" Jul 22 17:00:27.378723 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:00:27.378685 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-b4259e-29745660-57fck"] Jul 22 17:00:27.381203 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:00:27.381178 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-b4259e-29745660-57fck"] Jul 22 17:00:28.410452 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:00:28.410414 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="536e7402-9c77-4a31-8ead-ee82f6456ce0" path="/var/lib/kubelet/pods/536e7402-9c77-4a31-8ead-ee82f6456ce0/volumes" Jul 22 17:00:31.958005 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:00:31.957965 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-b4259e-lgjgw"] Jul 22 17:00:31.960423 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:00:31.960398 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-b4259e-lgjgw"] Jul 22 17:00:32.410931 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:00:32.410902 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c2bbb504-dbed-40bb-83f7-725105370e79" path="/var/lib/kubelet/pods/c2bbb504-dbed-40bb-83f7-725105370e79/volumes" Jul 22 17:00:49.204837 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:00:49.204801 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-6608f1-29745660-9zphj"] Jul 22 17:00:49.208207 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:00:49.208174 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-6608f1-29745660-9zphj"] Jul 22 17:00:50.411017 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:00:50.410978 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="65ee25b3-301a-43d4-9cdf-77cd54a8332d" path="/var/lib/kubelet/pods/65ee25b3-301a-43d4-9cdf-77cd54a8332d/volumes" Jul 22 17:02:28.598452 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:02:28.598312 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-lfqs8_816518f1-790a-4350-ae15-18287e06323a/console-operator/2.log" Jul 22 17:02:28.609453 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:02:28.609426 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-lfqs8_816518f1-790a-4350-ae15-18287e06323a/console-operator/2.log" Jul 22 17:06:28.757658 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:06:28.757567 2568 scope.go:117] "RemoveContainer" containerID="a7f50c7223f158c696f0d186ed9f7084650a2e0970960fdbf4dcb49190d18056" Jul 22 17:06:28.766890 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:06:28.766865 2568 scope.go:117] "RemoveContainer" containerID="8e4e3e1a0c17eb292ee7288a4a8f67a9ae9f3755ceda25257fda183158f05acf" Jul 22 17:06:28.775579 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:06:28.775557 2568 scope.go:117] "RemoveContainer" containerID="bf8c5b980ccc8b58cee09f622f0dc087d807def103a2b9193e5a45f1a1ae1dac" Jul 22 17:07:28.640122 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:07:28.640008 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-lfqs8_816518f1-790a-4350-ae15-18287e06323a/console-operator/2.log" Jul 22 17:07:28.652760 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:07:28.652733 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-lfqs8_816518f1-790a-4350-ae15-18287e06323a/console-operator/2.log" Jul 22 17:08:03.100016 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:08:03.099976 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7547-140387932559664"] Jul 22 17:08:03.100529 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:08:03.100392 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2bbb504-dbed-40bb-83f7-725105370e79" containerName="revoke-keys" Jul 22 17:08:03.100529 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:08:03.100405 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2bbb504-dbed-40bb-83f7-725105370e79" containerName="revoke-keys" Jul 22 17:08:03.100529 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:08:03.100488 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="c2bbb504-dbed-40bb-83f7-725105370e79" containerName="revoke-keys" Jul 22 17:08:03.103677 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:08:03.103658 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7547-140387932559664" Jul 22 17:08:03.106560 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:08:03.106532 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-ptmwt\"" Jul 22 17:08:03.109520 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:08:03.109496 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7547-140387932559664"] Jul 22 17:08:03.250053 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:08:03.250020 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wh6w9\" (UniqueName: \"kubernetes.io/projected/cfe6d5cb-0d36-40a2-8461-c6a9016e1ee1-kube-api-access-wh6w9\") pod \"test-curl-7547-140387932559664\" (UID: \"cfe6d5cb-0d36-40a2-8461-c6a9016e1ee1\") " pod="opendatahub/test-curl-7547-140387932559664" Jul 22 17:08:03.351327 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:08:03.351233 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wh6w9\" (UniqueName: \"kubernetes.io/projected/cfe6d5cb-0d36-40a2-8461-c6a9016e1ee1-kube-api-access-wh6w9\") pod \"test-curl-7547-140387932559664\" (UID: \"cfe6d5cb-0d36-40a2-8461-c6a9016e1ee1\") " pod="opendatahub/test-curl-7547-140387932559664" Jul 22 17:08:03.359796 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:08:03.359763 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wh6w9\" (UniqueName: \"kubernetes.io/projected/cfe6d5cb-0d36-40a2-8461-c6a9016e1ee1-kube-api-access-wh6w9\") pod \"test-curl-7547-140387932559664\" (UID: \"cfe6d5cb-0d36-40a2-8461-c6a9016e1ee1\") " pod="opendatahub/test-curl-7547-140387932559664" Jul 22 17:08:03.415035 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:08:03.414992 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7547-140387932559664" Jul 22 17:08:03.560136 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:08:03.560104 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7547-140387932559664"] Jul 22 17:08:03.562014 ip-10-0-133-47 kubenswrapper[2568]: W0722 17:08:03.561983 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcfe6d5cb_0d36_40a2_8461_c6a9016e1ee1.slice/crio-fba2db6755fa08758b33d3d9df2d696c029fd339a33102d3b8bd7f2fa3b33517 WatchSource:0}: Error finding container fba2db6755fa08758b33d3d9df2d696c029fd339a33102d3b8bd7f2fa3b33517: Status 404 returned error can't find the container with id fba2db6755fa08758b33d3d9df2d696c029fd339a33102d3b8bd7f2fa3b33517 Jul 22 17:08:03.563413 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:08:03.563393 2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 22 17:08:03.575096 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:08:03.575058 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7547-140387932559664" event={"ID":"cfe6d5cb-0d36-40a2-8461-c6a9016e1ee1","Type":"ContainerStarted","Data":"fba2db6755fa08758b33d3d9df2d696c029fd339a33102d3b8bd7f2fa3b33517"} Jul 22 17:08:04.582239 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:08:04.582141 2568 generic.go:356] "Generic (PLEG): container finished" podID="cfe6d5cb-0d36-40a2-8461-c6a9016e1ee1" containerID="e68894828642b7e01487cce072a012aae007d373f38f2e9ac074b9925f4f6679" exitCode=0 Jul 22 17:08:04.582874 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:08:04.582227 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7547-140387932559664" event={"ID":"cfe6d5cb-0d36-40a2-8461-c6a9016e1ee1","Type":"ContainerDied","Data":"e68894828642b7e01487cce072a012aae007d373f38f2e9ac074b9925f4f6679"} Jul 22 17:08:05.738461 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:08:05.738435 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7547-140387932559664" Jul 22 17:08:05.771505 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:08:05.771477 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7547-140387932559664_cfe6d5cb-0d36-40a2-8461-c6a9016e1ee1/test-curl-7547-140387932559664/0.log" Jul 22 17:08:05.793094 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:08:05.793064 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7547-140387932559664"] Jul 22 17:08:05.795498 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:08:05.795477 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7547-140387932559664"] Jul 22 17:08:05.875593 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:08:05.875506 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wh6w9\" (UniqueName: \"kubernetes.io/projected/cfe6d5cb-0d36-40a2-8461-c6a9016e1ee1-kube-api-access-wh6w9\") pod \"cfe6d5cb-0d36-40a2-8461-c6a9016e1ee1\" (UID: \"cfe6d5cb-0d36-40a2-8461-c6a9016e1ee1\") " Jul 22 17:08:05.877599 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:08:05.877569 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cfe6d5cb-0d36-40a2-8461-c6a9016e1ee1-kube-api-access-wh6w9" (OuterVolumeSpecName: "kube-api-access-wh6w9") pod "cfe6d5cb-0d36-40a2-8461-c6a9016e1ee1" (UID: "cfe6d5cb-0d36-40a2-8461-c6a9016e1ee1"). InnerVolumeSpecName "kube-api-access-wh6w9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 17:08:05.913447 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:08:05.913415 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7547-140387932558128"] Jul 22 17:08:05.913884 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:08:05.913870 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cfe6d5cb-0d36-40a2-8461-c6a9016e1ee1" containerName="test-curl-7547-140387932559664" Jul 22 17:08:05.913934 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:08:05.913886 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="cfe6d5cb-0d36-40a2-8461-c6a9016e1ee1" containerName="test-curl-7547-140387932559664" Jul 22 17:08:05.913969 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:08:05.913960 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="cfe6d5cb-0d36-40a2-8461-c6a9016e1ee1" containerName="test-curl-7547-140387932559664" Jul 22 17:08:05.917040 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:08:05.917024 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7547-140387932558128" Jul 22 17:08:05.922924 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:08:05.922896 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7547-140387932558128"] Jul 22 17:08:05.977168 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:08:05.977126 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wh6w9\" (UniqueName: \"kubernetes.io/projected/cfe6d5cb-0d36-40a2-8461-c6a9016e1ee1-kube-api-access-wh6w9\") on node \"ip-10-0-133-47.ec2.internal\" DevicePath \"\"" Jul 22 17:08:06.077627 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:08:06.077596 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvp58\" (UniqueName: \"kubernetes.io/projected/6650df34-78c7-42b9-9891-49b1da2474fc-kube-api-access-tvp58\") pod \"test-curl-7547-140387932558128\" (UID: \"6650df34-78c7-42b9-9891-49b1da2474fc\") " pod="opendatahub/test-curl-7547-140387932558128" Jul 22 17:08:06.178448 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:08:06.178338 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvp58\" (UniqueName: \"kubernetes.io/projected/6650df34-78c7-42b9-9891-49b1da2474fc-kube-api-access-tvp58\") pod \"test-curl-7547-140387932558128\" (UID: \"6650df34-78c7-42b9-9891-49b1da2474fc\") " pod="opendatahub/test-curl-7547-140387932558128" Jul 22 17:08:06.186642 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:08:06.186611 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvp58\" (UniqueName: \"kubernetes.io/projected/6650df34-78c7-42b9-9891-49b1da2474fc-kube-api-access-tvp58\") pod \"test-curl-7547-140387932558128\" (UID: \"6650df34-78c7-42b9-9891-49b1da2474fc\") " pod="opendatahub/test-curl-7547-140387932558128" Jul 22 17:08:06.227824 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:08:06.227786 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7547-140387932558128" Jul 22 17:08:06.376603 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:08:06.376557 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7547-140387932558128"] Jul 22 17:08:06.378171 ip-10-0-133-47 kubenswrapper[2568]: W0722 17:08:06.378136 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6650df34_78c7_42b9_9891_49b1da2474fc.slice/crio-f20e55b7caea619fce278d3c99b5240391e1c49e94351cdbccc29b4ac9702e20 WatchSource:0}: Error finding container f20e55b7caea619fce278d3c99b5240391e1c49e94351cdbccc29b4ac9702e20: Status 404 returned error can't find the container with id f20e55b7caea619fce278d3c99b5240391e1c49e94351cdbccc29b4ac9702e20 Jul 22 17:08:06.410596 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:08:06.410562 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cfe6d5cb-0d36-40a2-8461-c6a9016e1ee1" path="/var/lib/kubelet/pods/cfe6d5cb-0d36-40a2-8461-c6a9016e1ee1/volumes" Jul 22 17:08:06.594598 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:08:06.594561 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7547-140387932558128" event={"ID":"6650df34-78c7-42b9-9891-49b1da2474fc","Type":"ContainerStarted","Data":"f20e55b7caea619fce278d3c99b5240391e1c49e94351cdbccc29b4ac9702e20"} Jul 22 17:08:06.595894 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:08:06.595871 2568 scope.go:117] "RemoveContainer" containerID="e68894828642b7e01487cce072a012aae007d373f38f2e9ac074b9925f4f6679" Jul 22 17:08:06.595894 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:08:06.595884 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7547-140387932559664" Jul 22 17:08:07.604230 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:08:07.604189 2568 generic.go:356] "Generic (PLEG): container finished" podID="6650df34-78c7-42b9-9891-49b1da2474fc" containerID="cadc2b78eeae3abd23a990b7e09d7d78cefc65f9f2039cbc8d0fb55aa8190618" exitCode=0 Jul 22 17:08:07.604648 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:08:07.604235 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7547-140387932558128" event={"ID":"6650df34-78c7-42b9-9891-49b1da2474fc","Type":"ContainerDied","Data":"cadc2b78eeae3abd23a990b7e09d7d78cefc65f9f2039cbc8d0fb55aa8190618"} Jul 22 17:08:08.756875 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:08:08.756845 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7547-140387932558128" Jul 22 17:08:08.778362 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:08:08.778322 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7547-140387932558128_6650df34-78c7-42b9-9891-49b1da2474fc/test-curl-7547-140387932558128/0.log" Jul 22 17:08:08.801990 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:08:08.801954 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7547-140387932558128"] Jul 22 17:08:08.804404 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:08:08.804384 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7547-140387932558128"] Jul 22 17:08:08.902032 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:08:08.901932 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tvp58\" (UniqueName: \"kubernetes.io/projected/6650df34-78c7-42b9-9891-49b1da2474fc-kube-api-access-tvp58\") pod \"6650df34-78c7-42b9-9891-49b1da2474fc\" (UID: \"6650df34-78c7-42b9-9891-49b1da2474fc\") " Jul 22 17:08:08.903994 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:08:08.903965 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6650df34-78c7-42b9-9891-49b1da2474fc-kube-api-access-tvp58" (OuterVolumeSpecName: "kube-api-access-tvp58") pod "6650df34-78c7-42b9-9891-49b1da2474fc" (UID: "6650df34-78c7-42b9-9891-49b1da2474fc"). InnerVolumeSpecName "kube-api-access-tvp58". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 17:08:08.959181 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:08:08.959149 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7547-140387932512304"] Jul 22 17:08:08.959581 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:08:08.959567 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6650df34-78c7-42b9-9891-49b1da2474fc" containerName="test-curl-7547-140387932558128" Jul 22 17:08:08.959642 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:08:08.959583 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="6650df34-78c7-42b9-9891-49b1da2474fc" containerName="test-curl-7547-140387932558128" Jul 22 17:08:08.959681 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:08:08.959657 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="6650df34-78c7-42b9-9891-49b1da2474fc" containerName="test-curl-7547-140387932558128" Jul 22 17:08:08.970281 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:08:08.970247 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7547-140387932512304"] Jul 22 17:08:08.970461 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:08:08.970386 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7547-140387932512304" Jul 22 17:08:09.002874 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:08:09.002837 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tvp58\" (UniqueName: \"kubernetes.io/projected/6650df34-78c7-42b9-9891-49b1da2474fc-kube-api-access-tvp58\") on node \"ip-10-0-133-47.ec2.internal\" DevicePath \"\"" Jul 22 17:08:09.104149 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:08:09.104110 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-srjrm\" (UniqueName: \"kubernetes.io/projected/f64eb251-c06a-42a9-b9ec-8a254ad63d7e-kube-api-access-srjrm\") pod \"test-curl-7547-140387932512304\" (UID: \"f64eb251-c06a-42a9-b9ec-8a254ad63d7e\") " pod="opendatahub/test-curl-7547-140387932512304" Jul 22 17:08:09.205058 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:08:09.204960 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-srjrm\" (UniqueName: \"kubernetes.io/projected/f64eb251-c06a-42a9-b9ec-8a254ad63d7e-kube-api-access-srjrm\") pod \"test-curl-7547-140387932512304\" (UID: \"f64eb251-c06a-42a9-b9ec-8a254ad63d7e\") " pod="opendatahub/test-curl-7547-140387932512304" Jul 22 17:08:09.213164 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:08:09.213135 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-srjrm\" (UniqueName: \"kubernetes.io/projected/f64eb251-c06a-42a9-b9ec-8a254ad63d7e-kube-api-access-srjrm\") pod \"test-curl-7547-140387932512304\" (UID: \"f64eb251-c06a-42a9-b9ec-8a254ad63d7e\") " pod="opendatahub/test-curl-7547-140387932512304" Jul 22 17:08:09.280514 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:08:09.280470 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7547-140387932512304" Jul 22 17:08:09.417219 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:08:09.417181 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7547-140387932512304"] Jul 22 17:08:09.418219 ip-10-0-133-47 kubenswrapper[2568]: W0722 17:08:09.418194 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf64eb251_c06a_42a9_b9ec_8a254ad63d7e.slice/crio-9fa8981dc12f9e20c1c353273ee74df16ea1f30228d0abc7472e912e2a071288 WatchSource:0}: Error finding container 9fa8981dc12f9e20c1c353273ee74df16ea1f30228d0abc7472e912e2a071288: Status 404 returned error can't find the container with id 9fa8981dc12f9e20c1c353273ee74df16ea1f30228d0abc7472e912e2a071288 Jul 22 17:08:09.618117 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:08:09.618076 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7547-140387932512304" event={"ID":"f64eb251-c06a-42a9-b9ec-8a254ad63d7e","Type":"ContainerStarted","Data":"9fa8981dc12f9e20c1c353273ee74df16ea1f30228d0abc7472e912e2a071288"} Jul 22 17:08:09.619357 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:08:09.619324 2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f20e55b7caea619fce278d3c99b5240391e1c49e94351cdbccc29b4ac9702e20" Jul 22 17:08:09.619440 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:08:09.619340 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7547-140387932558128" Jul 22 17:08:09.629869 ip-10-0-133-47 kubenswrapper[2568]: E0722 17:08:09.629842 2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7547-140387932558128\" is forbidden: User \"system:node:ip-10-0-133-47.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-133-47.ec2.internal' and this object" podUID="6650df34-78c7-42b9-9891-49b1da2474fc" pod="opendatahub/test-curl-7547-140387932558128" Jul 22 17:08:10.410723 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:08:10.410691 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6650df34-78c7-42b9-9891-49b1da2474fc" path="/var/lib/kubelet/pods/6650df34-78c7-42b9-9891-49b1da2474fc/volumes" Jul 22 17:08:10.627127 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:08:10.627091 2568 generic.go:356] "Generic (PLEG): container finished" podID="f64eb251-c06a-42a9-b9ec-8a254ad63d7e" containerID="76c2a32f0d4fc37b9ef0696ac98842f521e0e988d47e1a655416122bcbb1847f" exitCode=0 Jul 22 17:08:10.627308 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:08:10.627137 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7547-140387932512304" event={"ID":"f64eb251-c06a-42a9-b9ec-8a254ad63d7e","Type":"ContainerDied","Data":"76c2a32f0d4fc37b9ef0696ac98842f521e0e988d47e1a655416122bcbb1847f"} Jul 22 17:08:11.772944 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:08:11.772916 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7547-140387932512304" Jul 22 17:08:11.792065 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:08:11.792029 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7547-140387932512304_f64eb251-c06a-42a9-b9ec-8a254ad63d7e/test-curl-7547-140387932512304/0.log" Jul 22 17:08:11.814644 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:08:11.814608 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7547-140387932512304"] Jul 22 17:08:11.817818 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:08:11.817787 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7547-140387932512304"] Jul 22 17:08:11.928869 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:08:11.928790 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7547-140387932512304"] Jul 22 17:08:11.929246 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:08:11.929232 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f64eb251-c06a-42a9-b9ec-8a254ad63d7e" containerName="test-curl-7547-140387932512304" Jul 22 17:08:11.929290 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:08:11.929249 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="f64eb251-c06a-42a9-b9ec-8a254ad63d7e" containerName="test-curl-7547-140387932512304" Jul 22 17:08:11.929330 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:08:11.929320 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="f64eb251-c06a-42a9-b9ec-8a254ad63d7e" containerName="test-curl-7547-140387932512304" Jul 22 17:08:11.930203 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:08:11.930183 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-srjrm\" (UniqueName: \"kubernetes.io/projected/f64eb251-c06a-42a9-b9ec-8a254ad63d7e-kube-api-access-srjrm\") pod \"f64eb251-c06a-42a9-b9ec-8a254ad63d7e\" (UID: \"f64eb251-c06a-42a9-b9ec-8a254ad63d7e\") " Jul 22 17:08:11.932194 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:08:11.932168 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f64eb251-c06a-42a9-b9ec-8a254ad63d7e-kube-api-access-srjrm" (OuterVolumeSpecName: "kube-api-access-srjrm") pod "f64eb251-c06a-42a9-b9ec-8a254ad63d7e" (UID: "f64eb251-c06a-42a9-b9ec-8a254ad63d7e"). InnerVolumeSpecName "kube-api-access-srjrm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 17:08:11.932458 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:08:11.932440 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7547-140387932512304" Jul 22 17:08:11.936391 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:08:11.936363 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7547-140387932512304"] Jul 22 17:08:12.031769 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:08:12.031723 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vcf8k\" (UniqueName: \"kubernetes.io/projected/bdba1807-866d-4775-b724-86ebc4c28222-kube-api-access-vcf8k\") pod \"test-curl-7547-140387932512304\" (UID: \"bdba1807-866d-4775-b724-86ebc4c28222\") " pod="opendatahub/test-curl-7547-140387932512304" Jul 22 17:08:12.031950 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:08:12.031841 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-srjrm\" (UniqueName: \"kubernetes.io/projected/f64eb251-c06a-42a9-b9ec-8a254ad63d7e-kube-api-access-srjrm\") on node \"ip-10-0-133-47.ec2.internal\" DevicePath \"\"" Jul 22 17:08:12.132812 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:08:12.132776 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vcf8k\" (UniqueName: \"kubernetes.io/projected/bdba1807-866d-4775-b724-86ebc4c28222-kube-api-access-vcf8k\") pod \"test-curl-7547-140387932512304\" (UID: \"bdba1807-866d-4775-b724-86ebc4c28222\") " pod="opendatahub/test-curl-7547-140387932512304" Jul 22 17:08:12.141577 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:08:12.141538 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vcf8k\" (UniqueName: \"kubernetes.io/projected/bdba1807-866d-4775-b724-86ebc4c28222-kube-api-access-vcf8k\") pod \"test-curl-7547-140387932512304\" (UID: \"bdba1807-866d-4775-b724-86ebc4c28222\") " pod="opendatahub/test-curl-7547-140387932512304" Jul 22 17:08:12.255743 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:08:12.255705 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7547-140387932512304" Jul 22 17:08:12.402995 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:08:12.402964 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7547-140387932512304"] Jul 22 17:08:12.404417 ip-10-0-133-47 kubenswrapper[2568]: W0722 17:08:12.404384 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbdba1807_866d_4775_b724_86ebc4c28222.slice/crio-01c57864914ff0deeb12b2dc06b223be8e09601ca10d440fd738c1dff4885026 WatchSource:0}: Error finding container 01c57864914ff0deeb12b2dc06b223be8e09601ca10d440fd738c1dff4885026: Status 404 returned error can't find the container with id 01c57864914ff0deeb12b2dc06b223be8e09601ca10d440fd738c1dff4885026 Jul 22 17:08:12.411414 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:08:12.411390 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f64eb251-c06a-42a9-b9ec-8a254ad63d7e" path="/var/lib/kubelet/pods/f64eb251-c06a-42a9-b9ec-8a254ad63d7e/volumes" Jul 22 17:08:12.641588 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:08:12.641473 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7547-140387932512304" event={"ID":"bdba1807-866d-4775-b724-86ebc4c28222","Type":"ContainerStarted","Data":"01c57864914ff0deeb12b2dc06b223be8e09601ca10d440fd738c1dff4885026"} Jul 22 17:08:12.642932 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:08:12.642908 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7547-140387932512304" Jul 22 17:08:12.643098 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:08:12.642959 2568 scope.go:117] "RemoveContainer" containerID="76c2a32f0d4fc37b9ef0696ac98842f521e0e988d47e1a655416122bcbb1847f" Jul 22 17:08:13.652083 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:08:13.652044 2568 generic.go:356] "Generic (PLEG): container finished" podID="bdba1807-866d-4775-b724-86ebc4c28222" containerID="4f33e9cd352c869f4076f3358cceba95b0c15bf4a774b5d0f5a17bac8a9dbbc1" exitCode=0 Jul 22 17:08:13.652503 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:08:13.652110 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7547-140387932512304" event={"ID":"bdba1807-866d-4775-b724-86ebc4c28222","Type":"ContainerDied","Data":"4f33e9cd352c869f4076f3358cceba95b0c15bf4a774b5d0f5a17bac8a9dbbc1"} Jul 22 17:08:14.806527 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:08:14.806495 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7547-140387932512304" Jul 22 17:08:14.825677 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:08:14.825648 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7547-140387932512304_bdba1807-866d-4775-b724-86ebc4c28222/test-curl-7547-140387932512304/0.log" Jul 22 17:08:14.851100 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:08:14.851057 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7547-140387932512304"] Jul 22 17:08:14.854214 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:08:14.854183 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7547-140387932512304"] Jul 22 17:08:14.961763 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:08:14.961663 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vcf8k\" (UniqueName: \"kubernetes.io/projected/bdba1807-866d-4775-b724-86ebc4c28222-kube-api-access-vcf8k\") pod \"bdba1807-866d-4775-b724-86ebc4c28222\" (UID: \"bdba1807-866d-4775-b724-86ebc4c28222\") " Jul 22 17:08:14.963719 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:08:14.963694 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bdba1807-866d-4775-b724-86ebc4c28222-kube-api-access-vcf8k" (OuterVolumeSpecName: "kube-api-access-vcf8k") pod "bdba1807-866d-4775-b724-86ebc4c28222" (UID: "bdba1807-866d-4775-b724-86ebc4c28222"). InnerVolumeSpecName "kube-api-access-vcf8k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 17:08:14.971729 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:08:14.971705 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7547-140387932386192"] Jul 22 17:08:14.972157 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:08:14.972140 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bdba1807-866d-4775-b724-86ebc4c28222" containerName="test-curl-7547-140387932512304" Jul 22 17:08:14.972257 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:08:14.972160 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="bdba1807-866d-4775-b724-86ebc4c28222" containerName="test-curl-7547-140387932512304" Jul 22 17:08:14.972318 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:08:14.972273 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="bdba1807-866d-4775-b724-86ebc4c28222" containerName="test-curl-7547-140387932512304" Jul 22 17:08:14.975432 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:08:14.975411 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7547-140387932386192" Jul 22 17:08:14.978632 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:08:14.978613 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7547-140387932386192"] Jul 22 17:08:15.062788 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:08:15.062759 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vcf8k\" (UniqueName: \"kubernetes.io/projected/bdba1807-866d-4775-b724-86ebc4c28222-kube-api-access-vcf8k\") on node \"ip-10-0-133-47.ec2.internal\" DevicePath \"\"" Jul 22 17:08:15.163659 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:08:15.163623 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nvnhq\" (UniqueName: \"kubernetes.io/projected/2343e443-fe53-4939-b6fa-973a728640fa-kube-api-access-nvnhq\") pod \"test-curl-7547-140387932386192\" (UID: \"2343e443-fe53-4939-b6fa-973a728640fa\") " pod="opendatahub/test-curl-7547-140387932386192" Jul 22 17:08:15.264899 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:08:15.264856 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nvnhq\" (UniqueName: \"kubernetes.io/projected/2343e443-fe53-4939-b6fa-973a728640fa-kube-api-access-nvnhq\") pod \"test-curl-7547-140387932386192\" (UID: \"2343e443-fe53-4939-b6fa-973a728640fa\") " pod="opendatahub/test-curl-7547-140387932386192" Jul 22 17:08:15.272670 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:08:15.272637 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nvnhq\" (UniqueName: \"kubernetes.io/projected/2343e443-fe53-4939-b6fa-973a728640fa-kube-api-access-nvnhq\") pod \"test-curl-7547-140387932386192\" (UID: \"2343e443-fe53-4939-b6fa-973a728640fa\") " pod="opendatahub/test-curl-7547-140387932386192" Jul 22 17:08:15.285586 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:08:15.285549 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7547-140387932386192" Jul 22 17:08:15.427743 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:08:15.427715 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7547-140387932386192"] Jul 22 17:08:15.429236 ip-10-0-133-47 kubenswrapper[2568]: W0722 17:08:15.429209 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2343e443_fe53_4939_b6fa_973a728640fa.slice/crio-2ada3c69af851e0320c056fb06eccd313a6cb649b2248b33c9da7659e43c4878 WatchSource:0}: Error finding container 2ada3c69af851e0320c056fb06eccd313a6cb649b2248b33c9da7659e43c4878: Status 404 returned error can't find the container with id 2ada3c69af851e0320c056fb06eccd313a6cb649b2248b33c9da7659e43c4878 Jul 22 17:08:15.664907 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:08:15.664818 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7547-140387932386192" event={"ID":"2343e443-fe53-4939-b6fa-973a728640fa","Type":"ContainerStarted","Data":"2ada3c69af851e0320c056fb06eccd313a6cb649b2248b33c9da7659e43c4878"} Jul 22 17:08:15.666187 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:08:15.666167 2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="01c57864914ff0deeb12b2dc06b223be8e09601ca10d440fd738c1dff4885026" Jul 22 17:08:15.666187 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:08:15.666177 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7547-140387932512304" Jul 22 17:08:15.676996 ip-10-0-133-47 kubenswrapper[2568]: E0722 17:08:15.676968 2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7547-140387932512304\" is forbidden: User \"system:node:ip-10-0-133-47.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-133-47.ec2.internal' and this object" podUID="bdba1807-866d-4775-b724-86ebc4c28222" pod="opendatahub/test-curl-7547-140387932512304" Jul 22 17:08:16.411177 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:08:16.411143 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bdba1807-866d-4775-b724-86ebc4c28222" path="/var/lib/kubelet/pods/bdba1807-866d-4775-b724-86ebc4c28222/volumes" Jul 22 17:08:16.674299 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:08:16.674206 2568 generic.go:356] "Generic (PLEG): container finished" podID="2343e443-fe53-4939-b6fa-973a728640fa" containerID="22fd424270112557badb7c84e5283e5515552f8d2c6f79139e1fd7fbf840d9bd" exitCode=0 Jul 22 17:08:16.674299 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:08:16.674289 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7547-140387932386192" event={"ID":"2343e443-fe53-4939-b6fa-973a728640fa","Type":"ContainerDied","Data":"22fd424270112557badb7c84e5283e5515552f8d2c6f79139e1fd7fbf840d9bd"} Jul 22 17:08:17.824284 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:08:17.824258 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7547-140387932386192" Jul 22 17:08:17.846453 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:08:17.846404 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7547-140387932386192_2343e443-fe53-4939-b6fa-973a728640fa/test-curl-7547-140387932386192/0.log" Jul 22 17:08:17.871921 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:08:17.871887 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7547-140387932386192"] Jul 22 17:08:17.875408 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:08:17.875379 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7547-140387932386192"] Jul 22 17:08:17.889146 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:08:17.889116 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nvnhq\" (UniqueName: \"kubernetes.io/projected/2343e443-fe53-4939-b6fa-973a728640fa-kube-api-access-nvnhq\") pod \"2343e443-fe53-4939-b6fa-973a728640fa\" (UID: \"2343e443-fe53-4939-b6fa-973a728640fa\") " Jul 22 17:08:17.891251 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:08:17.891225 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2343e443-fe53-4939-b6fa-973a728640fa-kube-api-access-nvnhq" (OuterVolumeSpecName: "kube-api-access-nvnhq") pod "2343e443-fe53-4939-b6fa-973a728640fa" (UID: "2343e443-fe53-4939-b6fa-973a728640fa"). InnerVolumeSpecName "kube-api-access-nvnhq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 17:08:17.990321 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:08:17.990291 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nvnhq\" (UniqueName: \"kubernetes.io/projected/2343e443-fe53-4939-b6fa-973a728640fa-kube-api-access-nvnhq\") on node \"ip-10-0-133-47.ec2.internal\" DevicePath \"\"" Jul 22 17:08:17.999206 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:08:17.999170 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7547-140387932386192"] Jul 22 17:08:17.999610 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:08:17.999596 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2343e443-fe53-4939-b6fa-973a728640fa" containerName="test-curl-7547-140387932386192" Jul 22 17:08:17.999652 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:08:17.999611 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="2343e443-fe53-4939-b6fa-973a728640fa" containerName="test-curl-7547-140387932386192" Jul 22 17:08:17.999697 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:08:17.999682 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="2343e443-fe53-4939-b6fa-973a728640fa" containerName="test-curl-7547-140387932386192" Jul 22 17:08:18.002724 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:08:18.002705 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7547-140387932386192" Jul 22 17:08:18.009707 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:08:18.009655 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7547-140387932386192"] Jul 22 17:08:18.091510 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:08:18.091471 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7wrgv\" (UniqueName: \"kubernetes.io/projected/bc38418c-6be7-4b8e-a938-d524bf6cda11-kube-api-access-7wrgv\") pod \"test-curl-7547-140387932386192\" (UID: \"bc38418c-6be7-4b8e-a938-d524bf6cda11\") " pod="opendatahub/test-curl-7547-140387932386192" Jul 22 17:08:18.192968 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:08:18.192927 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7wrgv\" (UniqueName: \"kubernetes.io/projected/bc38418c-6be7-4b8e-a938-d524bf6cda11-kube-api-access-7wrgv\") pod \"test-curl-7547-140387932386192\" (UID: \"bc38418c-6be7-4b8e-a938-d524bf6cda11\") " pod="opendatahub/test-curl-7547-140387932386192" Jul 22 17:08:18.201302 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:08:18.201266 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7wrgv\" (UniqueName: \"kubernetes.io/projected/bc38418c-6be7-4b8e-a938-d524bf6cda11-kube-api-access-7wrgv\") pod \"test-curl-7547-140387932386192\" (UID: \"bc38418c-6be7-4b8e-a938-d524bf6cda11\") " pod="opendatahub/test-curl-7547-140387932386192" Jul 22 17:08:18.312973 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:08:18.312877 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7547-140387932386192" Jul 22 17:08:18.413467 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:08:18.413428 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2343e443-fe53-4939-b6fa-973a728640fa" path="/var/lib/kubelet/pods/2343e443-fe53-4939-b6fa-973a728640fa/volumes" Jul 22 17:08:18.457975 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:08:18.457945 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7547-140387932386192"] Jul 22 17:08:18.460320 ip-10-0-133-47 kubenswrapper[2568]: W0722 17:08:18.460287 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbc38418c_6be7_4b8e_a938_d524bf6cda11.slice/crio-38ccc6812a51df19804c5d521831fc58177aa994cb3b0ed3fedba83bf6121585 WatchSource:0}: Error finding container 38ccc6812a51df19804c5d521831fc58177aa994cb3b0ed3fedba83bf6121585: Status 404 returned error can't find the container with id 38ccc6812a51df19804c5d521831fc58177aa994cb3b0ed3fedba83bf6121585 Jul 22 17:08:18.688567 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:08:18.688487 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7547-140387932386192" Jul 22 17:08:18.689673 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:08:18.688515 2568 scope.go:117] "RemoveContainer" containerID="22fd424270112557badb7c84e5283e5515552f8d2c6f79139e1fd7fbf840d9bd" Jul 22 17:08:18.689980 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:08:18.689946 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7547-140387932386192" event={"ID":"bc38418c-6be7-4b8e-a938-d524bf6cda11","Type":"ContainerStarted","Data":"38ccc6812a51df19804c5d521831fc58177aa994cb3b0ed3fedba83bf6121585"} Jul 22 17:08:19.697912 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:08:19.697877 2568 generic.go:356] "Generic (PLEG): container finished" podID="bc38418c-6be7-4b8e-a938-d524bf6cda11" containerID="6fda4ebfca0c593f8482636c8ec9515cc53b145de1666cf0303fd10c7df32cdd" exitCode=0 Jul 22 17:08:19.698331 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:08:19.697961 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7547-140387932386192" event={"ID":"bc38418c-6be7-4b8e-a938-d524bf6cda11","Type":"ContainerDied","Data":"6fda4ebfca0c593f8482636c8ec9515cc53b145de1666cf0303fd10c7df32cdd"} Jul 22 17:08:20.846471 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:08:20.846439 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7547-140387932386192" Jul 22 17:08:20.866275 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:08:20.866247 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7547-140387932386192_bc38418c-6be7-4b8e-a938-d524bf6cda11/test-curl-7547-140387932386192/0.log" Jul 22 17:08:20.889757 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:08:20.889721 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7547-140387932386192"] Jul 22 17:08:20.894896 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:08:20.894868 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7547-140387932386192"] Jul 22 17:08:20.914678 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:08:20.914644 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7wrgv\" (UniqueName: \"kubernetes.io/projected/bc38418c-6be7-4b8e-a938-d524bf6cda11-kube-api-access-7wrgv\") pod \"bc38418c-6be7-4b8e-a938-d524bf6cda11\" (UID: \"bc38418c-6be7-4b8e-a938-d524bf6cda11\") " Jul 22 17:08:20.916784 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:08:20.916759 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc38418c-6be7-4b8e-a938-d524bf6cda11-kube-api-access-7wrgv" (OuterVolumeSpecName: "kube-api-access-7wrgv") pod "bc38418c-6be7-4b8e-a938-d524bf6cda11" (UID: "bc38418c-6be7-4b8e-a938-d524bf6cda11"). InnerVolumeSpecName "kube-api-access-7wrgv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 17:08:21.015754 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:08:21.015721 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7wrgv\" (UniqueName: \"kubernetes.io/projected/bc38418c-6be7-4b8e-a938-d524bf6cda11-kube-api-access-7wrgv\") on node \"ip-10-0-133-47.ec2.internal\" DevicePath \"\"" Jul 22 17:08:21.712918 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:08:21.712891 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7547-140387932386192" Jul 22 17:08:21.713081 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:08:21.712939 2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="38ccc6812a51df19804c5d521831fc58177aa994cb3b0ed3fedba83bf6121585" Jul 22 17:08:21.723309 ip-10-0-133-47 kubenswrapper[2568]: E0722 17:08:21.723269 2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7547-140387932386192\" is forbidden: User \"system:node:ip-10-0-133-47.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-133-47.ec2.internal' and this object" podUID="bc38418c-6be7-4b8e-a938-d524bf6cda11" pod="opendatahub/test-curl-7547-140387932386192" Jul 22 17:08:22.411099 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:08:22.411064 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bc38418c-6be7-4b8e-a938-d524bf6cda11" path="/var/lib/kubelet/pods/bc38418c-6be7-4b8e-a938-d524bf6cda11/volumes" Jul 22 17:09:05.218637 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:09:05.218499 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-668797cd4c-k8phx_f6715f89-ea5d-470d-802e-12ffdbbf7dde/authorino/0.log" Jul 22 17:09:10.414530 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:09:10.414493 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-bffnb_9ed4ef31-1079-41d0-beb1-2951df187ab0/manager/0.log" Jul 22 17:09:10.522226 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:09:10.522196 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-f24q7_97c084d7-ae84-450a-a13d-4ccfebd6703f/manager/0.log" Jul 22 17:09:10.764545 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:09:10.764517 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-pqr2k_92d843b6-a1c9-4669-8735-fe7e1c413996/server/0.log" Jul 22 17:09:10.876813 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:09:10.876784 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-j9j8t_9578018a-266d-45a6-82e1-1d5596fedd92/manager/0.log" Jul 22 17:09:11.104105 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:09:11.104031 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9b566c8c6-l8x88_8a1f1d5a-dceb-4e26-a019-8add8aeac28d/copy-manifests/0.log" Jul 22 17:09:11.116106 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:09:11.116056 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9b566c8c6-l8x88_8a1f1d5a-dceb-4e26-a019-8add8aeac28d/manager/0.log" Jul 22 17:09:11.804847 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:09:11.804820 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29745660-8nnfm_d6bdbe5b-9e84-4664-9b08-68322ccfb263/cleanup/0.log" Jul 22 17:09:11.919481 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:09:11.919453 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-ncv64_f1906eb2-31d0-4d2e-bb0d-d8de70414877/postgres/0.log" Jul 22 17:09:12.673416 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:09:12.673387 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75998xhm_f2074d1f-a84f-4534-84ce-828e9fd12963/util/0.log" Jul 22 17:09:12.679327 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:09:12.679304 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75998xhm_f2074d1f-a84f-4534-84ce-828e9fd12963/pull/0.log" Jul 22 17:09:12.684854 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:09:12.684836 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75998xhm_f2074d1f-a84f-4534-84ce-828e9fd12963/extract/0.log" Jul 22 17:09:12.795186 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:09:12.795155 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ffg42_344287ba-b88d-4668-87cd-3b268afeb07d/util/0.log" Jul 22 17:09:12.801639 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:09:12.801598 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ffg42_344287ba-b88d-4668-87cd-3b268afeb07d/pull/0.log" Jul 22 17:09:12.807158 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:09:12.807124 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ffg42_344287ba-b88d-4668-87cd-3b268afeb07d/extract/0.log" Jul 22 17:09:12.917259 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:09:12.917234 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x7lf2_a001a5ac-8967-4f5c-b0f4-9326356ac5b5/util/0.log" Jul 22 17:09:12.922783 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:09:12.922760 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x7lf2_a001a5ac-8967-4f5c-b0f4-9326356ac5b5/pull/0.log" Jul 22 17:09:12.928483 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:09:12.928430 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x7lf2_a001a5ac-8967-4f5c-b0f4-9326356ac5b5/extract/0.log" Jul 22 17:09:13.037735 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:09:13.037709 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c95cw_37c0e045-28be-4674-ad82-91268755751f/util/0.log" Jul 22 17:09:13.043757 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:09:13.043734 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c95cw_37c0e045-28be-4674-ad82-91268755751f/pull/0.log" Jul 22 17:09:13.049402 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:09:13.049386 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c95cw_37c0e045-28be-4674-ad82-91268755751f/extract/0.log" Jul 22 17:09:13.168976 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:09:13.168940 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-668797cd4c-k8phx_f6715f89-ea5d-470d-802e-12ffdbbf7dde/authorino/0.log" Jul 22 17:09:13.289375 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:09:13.289317 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-kfcmk_a515d563-6944-405f-83fb-4150cc57b2dc/manager/0.log" Jul 22 17:09:13.397277 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:09:13.397236 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-8p94r_4d9edac5-f5eb-4430-9754-af308c5b6928/manager/0.log" Jul 22 17:09:13.506329 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:09:13.506301 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-dntbc_c5c8cbc0-f7a9-4470-b489-682ad60673ac/kuadrant-console-plugin/0.log" Jul 22 17:09:13.618170 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:09:13.618071 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-gtcgq_5698664d-d86b-4968-8d3d-17c2550b3ccc/registry-server/0.log" Jul 22 17:09:13.734078 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:09:13.734035 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-m2zhm_6bb2e2dd-9c5d-4764-acbd-6d419e8484bc/manager/0.log" Jul 22 17:09:14.547602 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:09:14.547578 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6d7df686d9-c4mq7_d0b5e0f7-623d-4a3e-a536-43bc6b1408a8/kube-auth-proxy/0.log" Jul 22 17:09:14.767136 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:09:14.767086 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-z87c4_30013739-f498-4418-b2e0-90ce6285ad42/istio-proxy/1.log" Jul 22 17:09:14.993570 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:09:14.993535 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-5pgh4_8fa9b53d-fb76-4f4c-a6f3-d5d0c0735a60/payload-processing/0.log" Jul 22 17:09:15.100918 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:09:15.100890 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-57b96c888d-pxl85_8273b4e7-b4e0-4338-b8f1-ad7e1e7dae27/router/0.log" Jul 22 17:09:15.440409 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:09:15.440314 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-9mmh7_5fb411dd-033a-454c-bc33-42ef5e7d7ee3/main/0.log" Jul 22 17:09:15.672453 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:09:15.672424 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-fbspp_5e3aadda-4bea-4ad8-b92a-ec1989752a8a/main/0.log" Jul 22 17:09:15.888750 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:09:15.888722 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-zjxxd_144deb48-5ef3-492b-8052-0441bb8f633f/main/0.log" Jul 22 17:09:24.109319 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:09:24.109284 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-vtpvm_e16caaed-7d7c-44de-8a3d-c45cbfa12b72/global-pull-secret-syncer/0.log" Jul 22 17:09:24.241607 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:09:24.241577 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-8qfgq_13fb19fd-9a49-4a7f-9c2f-aa4814848b48/konnectivity-agent/0.log" Jul 22 17:09:24.295728 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:09:24.295698 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-47.ec2.internal_aa9e2291606c92d6ab1f0ef1e722964e/haproxy/0.log" Jul 22 17:09:28.809525 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:09:28.809494 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75998xhm_f2074d1f-a84f-4534-84ce-828e9fd12963/extract/0.log" Jul 22 17:09:28.832719 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:09:28.832689 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75998xhm_f2074d1f-a84f-4534-84ce-828e9fd12963/util/0.log" Jul 22 17:09:28.856063 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:09:28.856034 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75998xhm_f2074d1f-a84f-4534-84ce-828e9fd12963/pull/0.log" Jul 22 17:09:28.883989 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:09:28.883964 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ffg42_344287ba-b88d-4668-87cd-3b268afeb07d/extract/0.log" Jul 22 17:09:28.917786 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:09:28.917747 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ffg42_344287ba-b88d-4668-87cd-3b268afeb07d/util/0.log" Jul 22 17:09:28.940259 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:09:28.940234 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ffg42_344287ba-b88d-4668-87cd-3b268afeb07d/pull/0.log" Jul 22 17:09:28.970457 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:09:28.970431 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x7lf2_a001a5ac-8967-4f5c-b0f4-9326356ac5b5/extract/0.log" Jul 22 17:09:28.989589 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:09:28.989564 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x7lf2_a001a5ac-8967-4f5c-b0f4-9326356ac5b5/util/0.log" Jul 22 17:09:29.011231 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:09:29.011205 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x7lf2_a001a5ac-8967-4f5c-b0f4-9326356ac5b5/pull/0.log" Jul 22 17:09:29.037271 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:09:29.037200 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c95cw_37c0e045-28be-4674-ad82-91268755751f/extract/0.log" Jul 22 17:09:29.060303 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:09:29.060275 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c95cw_37c0e045-28be-4674-ad82-91268755751f/util/0.log" Jul 22 17:09:29.081982 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:09:29.081956 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c95cw_37c0e045-28be-4674-ad82-91268755751f/pull/0.log" Jul 22 17:09:29.441822 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:09:29.441733 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-668797cd4c-k8phx_f6715f89-ea5d-470d-802e-12ffdbbf7dde/authorino/0.log" Jul 22 17:09:29.469505 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:09:29.469469 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-kfcmk_a515d563-6944-405f-83fb-4150cc57b2dc/manager/0.log" Jul 22 17:09:29.494733 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:09:29.494704 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-8p94r_4d9edac5-f5eb-4430-9754-af308c5b6928/manager/0.log" Jul 22 17:09:29.549970 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:09:29.549943 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-dntbc_c5c8cbc0-f7a9-4470-b489-682ad60673ac/kuadrant-console-plugin/0.log" Jul 22 17:09:29.594599 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:09:29.594562 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-gtcgq_5698664d-d86b-4968-8d3d-17c2550b3ccc/registry-server/0.log" Jul 22 17:09:29.772557 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:09:29.772524 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-m2zhm_6bb2e2dd-9c5d-4764-acbd-6d419e8484bc/manager/0.log" Jul 22 17:09:31.670110 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:09:31.670079 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-76cf8966f8-mrs47_15d71c24-3074-4145-a424-c032a1e16f90/cluster-monitoring-operator/0.log" Jul 22 17:09:31.841173 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:09:31.841147 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hfxmd_1cd78a30-9e6a-4ccb-856e-bd4f679ec2d8/node-exporter/0.log" Jul 22 17:09:31.865504 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:09:31.865473 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hfxmd_1cd78a30-9e6a-4ccb-856e-bd4f679ec2d8/kube-rbac-proxy/0.log" Jul 22 17:09:31.894953 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:09:31.894918 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hfxmd_1cd78a30-9e6a-4ccb-856e-bd4f679ec2d8/init-textfile/0.log" Jul 22 17:09:33.837691 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:09:33.837659 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-7bc7489cb5-dd5l9_7e2887e8-0300-4255-bfb9-265e48b18be4/networking-console-plugin/0.log" Jul 22 17:09:34.068093 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:09:34.068043 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-s2qjm/perf-node-gather-daemonset-hftdk"] Jul 22 17:09:34.068587 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:09:34.068569 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc38418c-6be7-4b8e-a938-d524bf6cda11" containerName="test-curl-7547-140387932386192" Jul 22 17:09:34.068587 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:09:34.068589 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc38418c-6be7-4b8e-a938-d524bf6cda11" containerName="test-curl-7547-140387932386192" Jul 22 17:09:34.068698 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:09:34.068665 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc38418c-6be7-4b8e-a938-d524bf6cda11" containerName="test-curl-7547-140387932386192" Jul 22 17:09:34.072119 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:09:34.072100 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-s2qjm/perf-node-gather-daemonset-hftdk" Jul 22 17:09:34.075069 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:09:34.075041 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-s2qjm\"/\"kube-root-ca.crt\"" Jul 22 17:09:34.075255 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:09:34.075190 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-s2qjm\"/\"openshift-service-ca.crt\"" Jul 22 17:09:34.076114 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:09:34.076098 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-s2qjm\"/\"default-dockercfg-2dmcn\"" Jul 22 17:09:34.081423 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:09:34.081399 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-s2qjm/perf-node-gather-daemonset-hftdk"] Jul 22 17:09:34.215285 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:09:34.215183 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vwhrm\" (UniqueName: \"kubernetes.io/projected/8fa4595f-fb74-40d9-949c-16e0f19be042-kube-api-access-vwhrm\") pod \"perf-node-gather-daemonset-hftdk\" (UID: \"8fa4595f-fb74-40d9-949c-16e0f19be042\") " pod="openshift-must-gather-s2qjm/perf-node-gather-daemonset-hftdk" Jul 22 17:09:34.215285 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:09:34.215240 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8fa4595f-fb74-40d9-949c-16e0f19be042-podres\") pod \"perf-node-gather-daemonset-hftdk\" (UID: \"8fa4595f-fb74-40d9-949c-16e0f19be042\") " pod="openshift-must-gather-s2qjm/perf-node-gather-daemonset-hftdk" Jul 22 17:09:34.215582 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:09:34.215384 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8fa4595f-fb74-40d9-949c-16e0f19be042-sys\") pod \"perf-node-gather-daemonset-hftdk\" (UID: \"8fa4595f-fb74-40d9-949c-16e0f19be042\") " pod="openshift-must-gather-s2qjm/perf-node-gather-daemonset-hftdk" Jul 22 17:09:34.215582 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:09:34.215424 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8fa4595f-fb74-40d9-949c-16e0f19be042-proc\") pod \"perf-node-gather-daemonset-hftdk\" (UID: \"8fa4595f-fb74-40d9-949c-16e0f19be042\") " pod="openshift-must-gather-s2qjm/perf-node-gather-daemonset-hftdk" Jul 22 17:09:34.215582 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:09:34.215513 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8fa4595f-fb74-40d9-949c-16e0f19be042-lib-modules\") pod \"perf-node-gather-daemonset-hftdk\" (UID: \"8fa4595f-fb74-40d9-949c-16e0f19be042\") " pod="openshift-must-gather-s2qjm/perf-node-gather-daemonset-hftdk" Jul 22 17:09:34.316871 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:09:34.316831 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8fa4595f-fb74-40d9-949c-16e0f19be042-sys\") pod \"perf-node-gather-daemonset-hftdk\" (UID: \"8fa4595f-fb74-40d9-949c-16e0f19be042\") " pod="openshift-must-gather-s2qjm/perf-node-gather-daemonset-hftdk" Jul 22 17:09:34.316871 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:09:34.316873 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8fa4595f-fb74-40d9-949c-16e0f19be042-proc\") pod \"perf-node-gather-daemonset-hftdk\" (UID: \"8fa4595f-fb74-40d9-949c-16e0f19be042\") " pod="openshift-must-gather-s2qjm/perf-node-gather-daemonset-hftdk" Jul 22 17:09:34.317124 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:09:34.316919 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8fa4595f-fb74-40d9-949c-16e0f19be042-lib-modules\") pod \"perf-node-gather-daemonset-hftdk\" (UID: \"8fa4595f-fb74-40d9-949c-16e0f19be042\") " pod="openshift-must-gather-s2qjm/perf-node-gather-daemonset-hftdk" Jul 22 17:09:34.317124 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:09:34.316941 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vwhrm\" (UniqueName: \"kubernetes.io/projected/8fa4595f-fb74-40d9-949c-16e0f19be042-kube-api-access-vwhrm\") pod \"perf-node-gather-daemonset-hftdk\" (UID: \"8fa4595f-fb74-40d9-949c-16e0f19be042\") " pod="openshift-must-gather-s2qjm/perf-node-gather-daemonset-hftdk" Jul 22 17:09:34.317124 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:09:34.316965 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8fa4595f-fb74-40d9-949c-16e0f19be042-sys\") pod \"perf-node-gather-daemonset-hftdk\" (UID: \"8fa4595f-fb74-40d9-949c-16e0f19be042\") " pod="openshift-must-gather-s2qjm/perf-node-gather-daemonset-hftdk" Jul 22 17:09:34.317124 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:09:34.316982 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8fa4595f-fb74-40d9-949c-16e0f19be042-podres\") pod \"perf-node-gather-daemonset-hftdk\" (UID: \"8fa4595f-fb74-40d9-949c-16e0f19be042\") " pod="openshift-must-gather-s2qjm/perf-node-gather-daemonset-hftdk" Jul 22 17:09:34.317124 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:09:34.317042 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8fa4595f-fb74-40d9-949c-16e0f19be042-proc\") pod \"perf-node-gather-daemonset-hftdk\" (UID: \"8fa4595f-fb74-40d9-949c-16e0f19be042\") " pod="openshift-must-gather-s2qjm/perf-node-gather-daemonset-hftdk" Jul 22 17:09:34.317124 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:09:34.317103 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8fa4595f-fb74-40d9-949c-16e0f19be042-podres\") pod \"perf-node-gather-daemonset-hftdk\" (UID: \"8fa4595f-fb74-40d9-949c-16e0f19be042\") " pod="openshift-must-gather-s2qjm/perf-node-gather-daemonset-hftdk" Jul 22 17:09:34.317124 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:09:34.317105 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8fa4595f-fb74-40d9-949c-16e0f19be042-lib-modules\") pod \"perf-node-gather-daemonset-hftdk\" (UID: \"8fa4595f-fb74-40d9-949c-16e0f19be042\") " pod="openshift-must-gather-s2qjm/perf-node-gather-daemonset-hftdk" Jul 22 17:09:34.325292 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:09:34.325266 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vwhrm\" (UniqueName: \"kubernetes.io/projected/8fa4595f-fb74-40d9-949c-16e0f19be042-kube-api-access-vwhrm\") pod \"perf-node-gather-daemonset-hftdk\" (UID: \"8fa4595f-fb74-40d9-949c-16e0f19be042\") " pod="openshift-must-gather-s2qjm/perf-node-gather-daemonset-hftdk" Jul 22 17:09:34.383410 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:09:34.383374 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-s2qjm/perf-node-gather-daemonset-hftdk" Jul 22 17:09:34.477891 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:09:34.477861 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-lfqs8_816518f1-790a-4350-ae15-18287e06323a/console-operator/2.log" Jul 22 17:09:34.482602 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:09:34.482572 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-lfqs8_816518f1-790a-4350-ae15-18287e06323a/console-operator/3.log" Jul 22 17:09:34.524624 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:09:34.524596 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-s2qjm/perf-node-gather-daemonset-hftdk"] Jul 22 17:09:34.526690 ip-10-0-133-47 kubenswrapper[2568]: W0722 17:09:34.526657 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod8fa4595f_fb74_40d9_949c_16e0f19be042.slice/crio-230165f479817c477d8d32759917dc83af0203f7b16a031a8be3b9962cfb8b7e WatchSource:0}: Error finding container 230165f479817c477d8d32759917dc83af0203f7b16a031a8be3b9962cfb8b7e: Status 404 returned error can't find the container with id 230165f479817c477d8d32759917dc83af0203f7b16a031a8be3b9962cfb8b7e Jul 22 17:09:35.053495 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:09:35.053468 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6569ccbcd8-rwnqw_170d2c8f-b493-4ab3-bd22-567765a39616/console/0.log" Jul 22 17:09:35.085191 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:09:35.085162 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-5bc67dcd46-8qjkk_31360bae-3541-43b7-8f55-aa268c7ee53b/download-server/0.log" Jul 22 17:09:35.152930 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:09:35.152897 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-s2qjm/perf-node-gather-daemonset-hftdk" event={"ID":"8fa4595f-fb74-40d9-949c-16e0f19be042","Type":"ContainerStarted","Data":"9b0a14b08f4940d1bbd486dba7e4b1af04d7fc259a0c1d4697a61c0c31a559a4"} Jul 22 17:09:35.153097 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:09:35.152948 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-s2qjm/perf-node-gather-daemonset-hftdk" event={"ID":"8fa4595f-fb74-40d9-949c-16e0f19be042","Type":"ContainerStarted","Data":"230165f479817c477d8d32759917dc83af0203f7b16a031a8be3b9962cfb8b7e"} Jul 22 17:09:35.153097 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:09:35.153014 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-s2qjm/perf-node-gather-daemonset-hftdk" Jul 22 17:09:35.169692 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:09:35.169639 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-s2qjm/perf-node-gather-daemonset-hftdk" podStartSLOduration=1.169622519 podStartE2EDuration="1.169622519s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 17:09:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 17:09:35.168457353 +0000 UTC m=+2827.270072931" watchObservedRunningTime="2026-07-22 17:09:35.169622519 +0000 UTC m=+2827.271238094" Jul 22 17:09:35.627172 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:09:35.627143 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78cf4c6f6-p2ppt_05a2bd49-c888-4088-b738-3c824d606966/volume-data-source-validator/0.log" Jul 22 17:09:36.615634 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:09:36.615603 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-b2qn2_d5c01298-8e46-4810-8190-c75c64e59cdd/dns/0.log" Jul 22 17:09:36.639179 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:09:36.639147 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-b2qn2_d5c01298-8e46-4810-8190-c75c64e59cdd/kube-rbac-proxy/0.log" Jul 22 17:09:36.789818 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:09:36.789783 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-mzcc2_61d5f4c6-746e-4e0f-b35f-7befc6da325f/dns-node-resolver/0.log" Jul 22 17:09:37.407557 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:09:37.407525 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-v887c_b8064dd5-313d-433d-8efe-5035350319bf/node-ca/0.log" Jul 22 17:09:38.641199 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:09:38.641168 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6d7df686d9-c4mq7_d0b5e0f7-623d-4a3e-a536-43bc6b1408a8/kube-auth-proxy/0.log" Jul 22 17:09:38.692814 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:09:38.692781 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-z87c4_30013739-f498-4418-b2e0-90ce6285ad42/istio-proxy/0.log" Jul 22 17:09:38.718408 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:09:38.718375 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-z87c4_30013739-f498-4418-b2e0-90ce6285ad42/istio-proxy/1.log" Jul 22 17:09:38.782030 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:09:38.781998 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-5pgh4_8fa9b53d-fb76-4f4c-a6f3-d5d0c0735a60/payload-processing/0.log" Jul 22 17:09:38.804007 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:09:38.803979 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-57b96c888d-pxl85_8273b4e7-b4e0-4338-b8f1-ad7e1e7dae27/router/0.log" Jul 22 17:09:39.473498 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:09:39.473466 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6q9l7_13340988-afe9-464b-a66e-eb09a8694a8c/serve-healthcheck-canary/0.log" Jul 22 17:09:39.966535 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:09:39.966445 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-njgfd_2fc23598-8762-408d-b678-1eba72c5e867/insights-operator/0.log" Jul 22 17:09:39.968334 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:09:39.968313 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-njgfd_2fc23598-8762-408d-b678-1eba72c5e867/insights-operator/1.log" Jul 22 17:09:39.989979 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:09:39.989958 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6vgpb_75011229-cada-4038-bd30-f9cafb82061c/kube-rbac-proxy/0.log" Jul 22 17:09:40.011845 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:09:40.011825 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6vgpb_75011229-cada-4038-bd30-f9cafb82061c/exporter/0.log" Jul 22 17:09:40.037431 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:09:40.037400 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6vgpb_75011229-cada-4038-bd30-f9cafb82061c/extractor/0.log" Jul 22 17:09:41.169133 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:09:41.169103 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-s2qjm/perf-node-gather-daemonset-hftdk" Jul 22 17:09:42.247877 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:09:42.247847 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-bffnb_9ed4ef31-1079-41d0-beb1-2951df187ab0/manager/0.log" Jul 22 17:09:42.422305 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:09:42.422277 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-f24q7_97c084d7-ae84-450a-a13d-4ccfebd6703f/manager/0.log" Jul 22 17:09:42.567679 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:09:42.567605 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-pqr2k_92d843b6-a1c9-4669-8735-fe7e1c413996/server/0.log" Jul 22 17:09:42.636313 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:09:42.636283 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-j9j8t_9578018a-266d-45a6-82e1-1d5596fedd92/manager/0.log" Jul 22 17:09:42.767654 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:09:42.767618 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9b566c8c6-l8x88_8a1f1d5a-dceb-4e26-a019-8add8aeac28d/manager/0.log" Jul 22 17:09:42.785007 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:09:42.784981 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9b566c8c6-l8x88_8a1f1d5a-dceb-4e26-a019-8add8aeac28d/copy-manifests/0.log" Jul 22 17:09:44.313564 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:09:44.313481 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-qvqcr_1eca6662-01af-4c64-acdf-7fb466edb219/openshift-lws-operator/0.log" Jul 22 17:09:44.880104 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:09:44.880076 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6d7df686d9-c4mq7_d0b5e0f7-623d-4a3e-a536-43bc6b1408a8/kube-auth-proxy/0.log" Jul 22 17:09:44.911703 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:09:44.911676 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-z87c4_30013739-f498-4418-b2e0-90ce6285ad42/istio-proxy/0.log" Jul 22 17:09:44.936934 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:09:44.936901 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-z87c4_30013739-f498-4418-b2e0-90ce6285ad42/istio-proxy/1.log" Jul 22 17:09:44.978884 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:09:44.978856 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-5pgh4_8fa9b53d-fb76-4f4c-a6f3-d5d0c0735a60/payload-processing/0.log" Jul 22 17:09:44.995084 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:09:44.995058 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-57b96c888d-pxl85_8273b4e7-b4e0-4338-b8f1-ad7e1e7dae27/router/0.log" Jul 22 17:09:46.433653 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:09:46.433626 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6d7df686d9-c4mq7_d0b5e0f7-623d-4a3e-a536-43bc6b1408a8/kube-auth-proxy/0.log" Jul 22 17:09:46.470415 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:09:46.470383 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-z87c4_30013739-f498-4418-b2e0-90ce6285ad42/istio-proxy/0.log" Jul 22 17:09:46.497034 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:09:46.496999 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-z87c4_30013739-f498-4418-b2e0-90ce6285ad42/istio-proxy/1.log" Jul 22 17:09:46.538439 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:09:46.538402 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-5pgh4_8fa9b53d-fb76-4f4c-a6f3-d5d0c0735a60/payload-processing/0.log" Jul 22 17:09:46.553078 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:09:46.553053 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-57b96c888d-pxl85_8273b4e7-b4e0-4338-b8f1-ad7e1e7dae27/router/0.log" Jul 22 17:09:49.600674 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:09:49.600615 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-s4wdv_743b9a0c-6a6a-4e95-8289-84d715effd40/kube-storage-version-migrator-operator/1.log" Jul 22 17:09:49.601556 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:09:49.601526 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-s4wdv_743b9a0c-6a6a-4e95-8289-84d715effd40/kube-storage-version-migrator-operator/0.log" Jul 22 17:09:50.548585 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:09:50.548555 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-2gf2v_0c475b43-8ce3-4769-bf39-7a7c07dd92e1/kube-multus/0.log" Jul 22 17:09:50.991412 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:09:50.991384 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-swk9r_4834a81b-7ace-458e-8d65-6278acbd40bf/kube-multus-additional-cni-plugins/0.log" Jul 22 17:09:51.012908 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:09:51.012878 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-swk9r_4834a81b-7ace-458e-8d65-6278acbd40bf/egress-router-binary-copy/0.log" Jul 22 17:09:51.037481 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:09:51.037451 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-swk9r_4834a81b-7ace-458e-8d65-6278acbd40bf/cni-plugins/0.log" Jul 22 17:09:51.059061 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:09:51.059037 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-swk9r_4834a81b-7ace-458e-8d65-6278acbd40bf/bond-cni-plugin/0.log" Jul 22 17:09:51.080287 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:09:51.080259 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-swk9r_4834a81b-7ace-458e-8d65-6278acbd40bf/routeoverride-cni/0.log" Jul 22 17:09:51.100854 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:09:51.100830 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-swk9r_4834a81b-7ace-458e-8d65-6278acbd40bf/whereabouts-cni-bincopy/0.log" Jul 22 17:09:51.122396 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:09:51.122332 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-swk9r_4834a81b-7ace-458e-8d65-6278acbd40bf/whereabouts-cni/0.log" Jul 22 17:09:51.180230 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:09:51.180204 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-bknjp_919e9190-67ad-4d7e-9076-4645b095a315/network-metrics-daemon/0.log" Jul 22 17:09:51.199178 ip-10-0-133-47 kubenswrapper[2568]: I0722 17:09:51.199148 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-bknjp_919e9190-67ad-4d7e-9076-4645b095a315/kube-rbac-proxy/0.log"