Jul 11 03:00:44.583908 ip-10-0-141-141 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 11 03:00:44.583919 ip-10-0-141-141 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 11 03:00:44.583928 ip-10-0-141-141 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 11 03:00:44.584235 ip-10-0-141-141 systemd[1]: Failed to start Kubernetes Kubelet. Jul 11 03:00:54.671409 ip-10-0-141-141 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 11 03:00:54.671426 ip-10-0-141-141 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 7bab53b0fd174a2bbf02c90132e8d67c -- Jul 11 03:02:55.910283 ip-10-0-141-141 systemd[1]: Starting Kubernetes Kubelet... Jul 11 03:02:56.346489 ip-10-0-141-141 kubenswrapper[2559]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 11 03:02:56.346489 ip-10-0-141-141 kubenswrapper[2559]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 11 03:02:56.346489 ip-10-0-141-141 kubenswrapper[2559]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 11 03:02:56.346489 ip-10-0-141-141 kubenswrapper[2559]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 11 03:02:56.346489 ip-10-0-141-141 kubenswrapper[2559]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 11 03:02:56.347164 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.346555 2559 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 11 03:02:56.350811 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.350794 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 11 03:02:56.350811 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.350811 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 11 03:02:56.350876 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.350814 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 11 03:02:56.350876 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.350817 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 11 03:02:56.350876 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.350820 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 11 03:02:56.350876 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.350823 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 11 03:02:56.350876 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.350826 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 11 03:02:56.350876 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.350829 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 11 03:02:56.350876 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.350831 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 11 03:02:56.350876 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.350834 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 11 03:02:56.350876 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.350836 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 11 03:02:56.350876 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.350838 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 11 03:02:56.350876 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.350841 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 11 03:02:56.350876 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.350851 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 11 03:02:56.350876 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.350854 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 11 03:02:56.350876 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.350856 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 11 03:02:56.350876 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.350858 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 11 03:02:56.350876 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.350861 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 11 03:02:56.350876 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.350863 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 11 03:02:56.350876 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.350866 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 11 03:02:56.350876 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.350868 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 11 03:02:56.350876 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.350871 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 11 03:02:56.351391 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.350873 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 11 03:02:56.351391 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.350877 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 11 03:02:56.351391 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.350879 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 11 03:02:56.351391 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.350882 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 11 03:02:56.351391 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.350885 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jul 11 03:02:56.351391 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.350888 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 11 03:02:56.351391 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.350891 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 11 03:02:56.351391 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.350893 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 11 03:02:56.351391 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.350896 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 11 03:02:56.351391 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.350898 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 11 03:02:56.351391 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.350901 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 11 03:02:56.351391 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.350903 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 11 03:02:56.351391 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.350905 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 11 03:02:56.351391 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.350908 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 11 03:02:56.351391 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.350911 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 11 03:02:56.351391 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.350913 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 11 03:02:56.351391 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.350918 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 11 03:02:56.351391 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.350920 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 11 03:02:56.351391 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.350923 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 11 03:02:56.351391 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.350925 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 11 03:02:56.351874 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.350928 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 11 03:02:56.351874 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.350931 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 11 03:02:56.351874 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.350934 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 11 03:02:56.351874 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.350938 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 11 03:02:56.351874 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.350942 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 11 03:02:56.351874 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.350945 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 11 03:02:56.351874 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.350947 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 11 03:02:56.351874 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.350950 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 11 03:02:56.351874 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.350952 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 11 03:02:56.351874 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.350971 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 11 03:02:56.351874 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.350976 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 11 03:02:56.351874 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.350980 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 11 03:02:56.351874 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.350985 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 11 03:02:56.351874 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.350989 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 11 03:02:56.351874 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.350992 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 11 03:02:56.351874 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.350995 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 11 03:02:56.351874 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.350998 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 11 03:02:56.351874 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.351000 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 11 03:02:56.351874 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.351003 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 11 03:02:56.351874 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.351005 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 11 03:02:56.352376 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.351008 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 11 03:02:56.352376 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.351011 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 11 03:02:56.352376 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.351013 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 11 03:02:56.352376 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.351016 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 11 03:02:56.352376 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.351019 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 11 03:02:56.352376 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.351022 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 11 03:02:56.352376 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.351025 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 11 03:02:56.352376 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.351028 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 11 03:02:56.352376 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.351032 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 11 03:02:56.352376 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.351036 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 11 03:02:56.352376 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.351039 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 11 03:02:56.352376 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.351042 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 11 03:02:56.352376 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.351045 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 11 03:02:56.352376 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.351048 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 11 03:02:56.352376 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.351051 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 11 03:02:56.352376 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.351054 2559 feature_gate.go:328] unrecognized feature gate: Example Jul 11 03:02:56.352376 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.351057 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 11 03:02:56.352376 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.351060 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 11 03:02:56.352376 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.351062 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 11 03:02:56.352821 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.351065 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 11 03:02:56.352821 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.351068 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 11 03:02:56.352821 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.351070 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 11 03:02:56.352821 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.351073 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 11 03:02:56.352821 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.351075 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 11 03:02:56.352821 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.351078 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 11 03:02:56.352821 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.351081 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 11 03:02:56.352821 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.351084 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 11 03:02:56.352821 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.351087 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 11 03:02:56.352821 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.351090 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 11 03:02:56.352821 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.351093 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 11 03:02:56.352821 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.351096 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 11 03:02:56.352821 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.351098 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 11 03:02:56.352821 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.351101 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 11 03:02:56.352821 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.351104 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 11 03:02:56.352821 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.351106 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 11 03:02:56.352821 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.351109 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 11 03:02:56.352821 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.351112 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 11 03:02:56.352821 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.351845 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 11 03:02:56.352821 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.351853 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 11 03:02:56.353301 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.351856 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 11 03:02:56.353301 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.351858 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 11 03:02:56.353301 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.351861 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 11 03:02:56.353301 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.351864 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 11 03:02:56.353301 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.351867 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 11 03:02:56.353301 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.351869 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 11 03:02:56.353301 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.351872 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 11 03:02:56.353301 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.351875 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 11 03:02:56.353301 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.351878 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 11 03:02:56.353301 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.351880 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 11 03:02:56.353301 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.351883 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 11 03:02:56.353301 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.351885 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 11 03:02:56.353301 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.351888 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 11 03:02:56.353301 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.351890 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 11 03:02:56.353301 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.351893 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 11 03:02:56.353301 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.351895 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 11 03:02:56.353301 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.351897 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 11 03:02:56.353301 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.351900 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 11 03:02:56.353301 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.351904 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 11 03:02:56.353301 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.351906 2559 feature_gate.go:328] unrecognized feature gate: Example Jul 11 03:02:56.353785 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.351909 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 11 03:02:56.353785 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.351912 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 11 03:02:56.353785 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.351914 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 11 03:02:56.353785 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.351917 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 11 03:02:56.353785 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.351919 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 11 03:02:56.353785 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.351921 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 11 03:02:56.353785 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.351924 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 11 03:02:56.353785 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.351926 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 11 03:02:56.353785 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.351929 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 11 03:02:56.353785 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.351931 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 11 03:02:56.353785 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.351934 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 11 03:02:56.353785 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.351936 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 11 03:02:56.353785 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.351939 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 11 03:02:56.353785 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.351941 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 11 03:02:56.353785 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.351943 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 11 03:02:56.353785 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.351946 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 11 03:02:56.353785 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.351949 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 11 03:02:56.353785 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.351951 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 11 03:02:56.353785 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.351969 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 11 03:02:56.353785 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.351972 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jul 11 03:02:56.354294 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.351975 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 11 03:02:56.354294 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.351977 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 11 03:02:56.354294 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.351980 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 11 03:02:56.354294 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.351982 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 11 03:02:56.354294 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.351985 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 11 03:02:56.354294 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.351987 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 11 03:02:56.354294 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.351989 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 11 03:02:56.354294 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.351992 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 11 03:02:56.354294 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.351995 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 11 03:02:56.354294 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.351998 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 11 03:02:56.354294 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.352000 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 11 03:02:56.354294 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.352003 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 11 03:02:56.354294 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.352006 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 11 03:02:56.354294 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.352008 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 11 03:02:56.354294 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.352014 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 11 03:02:56.354294 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.352018 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 11 03:02:56.354294 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.352021 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 11 03:02:56.354294 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.352024 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 11 03:02:56.354294 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.352027 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 11 03:02:56.354753 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.352030 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 11 03:02:56.354753 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.352033 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 11 03:02:56.354753 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.352035 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 11 03:02:56.354753 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.352038 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 11 03:02:56.354753 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.352042 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 11 03:02:56.354753 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.352044 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 11 03:02:56.354753 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.352047 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 11 03:02:56.354753 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.352050 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 11 03:02:56.354753 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.352053 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 11 03:02:56.354753 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.352055 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 11 03:02:56.354753 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.352058 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 11 03:02:56.354753 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.352061 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 11 03:02:56.354753 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.352064 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 11 03:02:56.354753 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.352066 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 11 03:02:56.354753 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.352068 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 11 03:02:56.354753 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.352071 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 11 03:02:56.354753 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.352073 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 11 03:02:56.354753 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.352076 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 11 03:02:56.354753 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.352078 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 11 03:02:56.354753 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.352080 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 11 03:02:56.355266 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.352083 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 11 03:02:56.355266 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.352087 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 11 03:02:56.355266 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.352093 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 11 03:02:56.355266 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.352096 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 11 03:02:56.355266 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.352099 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 11 03:02:56.355266 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.352103 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 11 03:02:56.355266 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.352106 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 11 03:02:56.355266 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.352108 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 11 03:02:56.355266 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.352111 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 11 03:02:56.355266 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.352113 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 11 03:02:56.355266 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.352116 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 11 03:02:56.355266 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.352118 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 11 03:02:56.355266 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.352121 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 11 03:02:56.355266 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.352124 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 11 03:02:56.355266 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.352126 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 11 03:02:56.355266 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.352129 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 11 03:02:56.355266 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.352131 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 11 03:02:56.355266 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.352134 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 11 03:02:56.355266 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.352523 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 11 03:02:56.355717 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.352528 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 11 03:02:56.355717 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.352532 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 11 03:02:56.355717 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.352535 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 11 03:02:56.355717 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.352538 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 11 03:02:56.355717 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.352541 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 11 03:02:56.355717 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.352544 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 11 03:02:56.355717 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.352546 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 11 03:02:56.355717 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.352549 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 11 03:02:56.355717 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.352551 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 11 03:02:56.355717 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.352554 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 11 03:02:56.355717 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.352557 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 11 03:02:56.355717 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.352559 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 11 03:02:56.355717 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.352561 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 11 03:02:56.355717 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.352564 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 11 03:02:56.355717 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.352567 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 11 03:02:56.355717 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.352570 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 11 03:02:56.355717 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.352573 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 11 03:02:56.355717 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.352575 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 11 03:02:56.355717 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.352578 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 11 03:02:56.355717 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.352581 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 11 03:02:56.356244 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.352583 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 11 03:02:56.356244 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.352586 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 11 03:02:56.356244 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.352588 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 11 03:02:56.356244 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.352590 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 11 03:02:56.356244 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.352593 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 11 03:02:56.356244 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.352595 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 11 03:02:56.356244 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.352597 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 11 03:02:56.356244 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.352600 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 11 03:02:56.356244 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.352602 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 11 03:02:56.356244 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.352605 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 11 03:02:56.356244 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.352607 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 11 03:02:56.356244 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.352610 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 11 03:02:56.356244 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.352612 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 11 03:02:56.356244 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.352614 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 11 03:02:56.356244 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.352617 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 11 03:02:56.356244 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.352619 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 11 03:02:56.356244 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.352622 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 11 03:02:56.356244 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.352625 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 11 03:02:56.356244 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.352627 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 11 03:02:56.356700 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.352630 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 11 03:02:56.356700 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.352632 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 11 03:02:56.356700 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.352634 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 11 03:02:56.356700 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.352636 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 11 03:02:56.356700 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.352639 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 11 03:02:56.356700 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.352642 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 11 03:02:56.356700 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.352646 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 11 03:02:56.356700 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.352650 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 11 03:02:56.356700 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.352653 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 11 03:02:56.356700 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.352655 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 11 03:02:56.356700 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.352658 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 11 03:02:56.356700 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.352660 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 11 03:02:56.356700 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.352662 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 11 03:02:56.356700 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.352665 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 11 03:02:56.356700 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.352667 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 11 03:02:56.356700 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.352669 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 11 03:02:56.356700 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.352672 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 11 03:02:56.356700 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.352674 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 11 03:02:56.356700 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.352677 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 11 03:02:56.356700 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.352679 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 11 03:02:56.357198 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.352682 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 11 03:02:56.357198 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.352685 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 11 03:02:56.357198 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.352687 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 11 03:02:56.357198 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.352690 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 11 03:02:56.357198 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.352692 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 11 03:02:56.357198 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.352695 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 11 03:02:56.357198 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.352699 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 11 03:02:56.357198 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.352702 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 11 03:02:56.357198 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.352706 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 11 03:02:56.357198 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.352709 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 11 03:02:56.357198 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.352712 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 11 03:02:56.357198 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.352715 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 11 03:02:56.357198 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.352718 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 11 03:02:56.357198 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.352721 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 11 03:02:56.357198 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.352724 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 11 03:02:56.357198 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.352727 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 11 03:02:56.357198 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.352729 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 11 03:02:56.357198 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.352732 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 11 03:02:56.357198 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.352734 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 11 03:02:56.357674 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.352737 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 11 03:02:56.357674 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.352740 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 11 03:02:56.357674 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.352742 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 11 03:02:56.357674 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.352745 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jul 11 03:02:56.357674 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.352747 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 11 03:02:56.357674 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.352750 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 11 03:02:56.357674 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.352753 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 11 03:02:56.357674 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.352755 2559 feature_gate.go:328] unrecognized feature gate: Example Jul 11 03:02:56.357674 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.352758 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 11 03:02:56.357674 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.352760 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 11 03:02:56.357674 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.352763 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 11 03:02:56.357674 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.352765 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 11 03:02:56.357674 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.352768 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 11 03:02:56.357674 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.352770 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 11 03:02:56.357674 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.352772 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 11 03:02:56.357674 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.352775 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 11 03:02:56.357674 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.352777 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 11 03:02:56.357674 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.352780 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 11 03:02:56.357674 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.352782 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 11 03:02:56.357674 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.352788 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 11 03:02:56.358232 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.352865 2559 flags.go:64] FLAG: --address="0.0.0.0" Jul 11 03:02:56.358232 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.352876 2559 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 11 03:02:56.358232 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.352885 2559 flags.go:64] FLAG: --anonymous-auth="true" Jul 11 03:02:56.358232 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.352892 2559 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 11 03:02:56.358232 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.352902 2559 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 11 03:02:56.358232 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.352907 2559 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 11 03:02:56.358232 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.352911 2559 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 11 03:02:56.358232 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.352915 2559 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 11 03:02:56.358232 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.352918 2559 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 11 03:02:56.358232 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.352921 2559 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 11 03:02:56.358232 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.352924 2559 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 11 03:02:56.358232 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.352928 2559 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 11 03:02:56.358232 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.352931 2559 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 11 03:02:56.358232 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.352934 2559 flags.go:64] FLAG: --cgroup-root="" Jul 11 03:02:56.358232 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.352936 2559 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 11 03:02:56.358232 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.352939 2559 flags.go:64] FLAG: --client-ca-file="" Jul 11 03:02:56.358232 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.352942 2559 flags.go:64] FLAG: --cloud-provider="external" Jul 11 03:02:56.358232 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.352945 2559 flags.go:64] FLAG: --cluster-dns="[]" Jul 11 03:02:56.358232 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.352950 2559 flags.go:64] FLAG: --cluster-domain="" Jul 11 03:02:56.358232 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.352953 2559 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 11 03:02:56.358232 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.352970 2559 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 11 03:02:56.358232 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.352973 2559 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 11 03:02:56.358232 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.352976 2559 flags.go:64] FLAG: --container-log-max-files="5" Jul 11 03:02:56.358232 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.352980 2559 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 11 03:02:56.358815 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.352983 2559 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 11 03:02:56.358815 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.352986 2559 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 11 03:02:56.358815 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.352989 2559 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 11 03:02:56.358815 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.352992 2559 flags.go:64] FLAG: --contention-profiling="false" Jul 11 03:02:56.358815 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.352995 2559 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 11 03:02:56.358815 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.352997 2559 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 11 03:02:56.358815 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.353001 2559 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 11 03:02:56.358815 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.353004 2559 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 11 03:02:56.358815 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.353008 2559 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 11 03:02:56.358815 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.353012 2559 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 11 03:02:56.358815 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.353015 2559 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 11 03:02:56.358815 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.353017 2559 flags.go:64] FLAG: --enable-load-reader="false" Jul 11 03:02:56.358815 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.353022 2559 flags.go:64] FLAG: --enable-server="true" Jul 11 03:02:56.358815 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.353025 2559 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 11 03:02:56.358815 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.353030 2559 flags.go:64] FLAG: --event-burst="100" Jul 11 03:02:56.358815 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.353033 2559 flags.go:64] FLAG: --event-qps="50" Jul 11 03:02:56.358815 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.353036 2559 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 11 03:02:56.358815 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.353039 2559 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 11 03:02:56.358815 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.353041 2559 flags.go:64] FLAG: --eviction-hard="" Jul 11 03:02:56.358815 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.353045 2559 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 11 03:02:56.358815 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.353048 2559 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 11 03:02:56.358815 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.353051 2559 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 11 03:02:56.358815 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.353054 2559 flags.go:64] FLAG: --eviction-soft="" Jul 11 03:02:56.358815 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.353056 2559 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 11 03:02:56.358815 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.353059 2559 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 11 03:02:56.359439 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.353062 2559 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 11 03:02:56.359439 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.353065 2559 flags.go:64] FLAG: --experimental-mounter-path="" Jul 11 03:02:56.359439 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.353068 2559 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 11 03:02:56.359439 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.353070 2559 flags.go:64] FLAG: --fail-swap-on="true" Jul 11 03:02:56.359439 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.353073 2559 flags.go:64] FLAG: --feature-gates="" Jul 11 03:02:56.359439 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.353077 2559 flags.go:64] FLAG: --file-check-frequency="20s" Jul 11 03:02:56.359439 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.353080 2559 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 11 03:02:56.359439 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.353083 2559 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 11 03:02:56.359439 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.353086 2559 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 11 03:02:56.359439 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.353089 2559 flags.go:64] FLAG: --healthz-port="10248" Jul 11 03:02:56.359439 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.353092 2559 flags.go:64] FLAG: --help="false" Jul 11 03:02:56.359439 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.353094 2559 flags.go:64] FLAG: --hostname-override="ip-10-0-141-141.ec2.internal" Jul 11 03:02:56.359439 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.353097 2559 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 11 03:02:56.359439 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.353100 2559 flags.go:64] FLAG: --http-check-frequency="20s" Jul 11 03:02:56.359439 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.353103 2559 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 11 03:02:56.359439 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.353107 2559 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 11 03:02:56.359439 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.353110 2559 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 11 03:02:56.359439 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.353113 2559 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 11 03:02:56.359439 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.353116 2559 flags.go:64] FLAG: --image-service-endpoint="" Jul 11 03:02:56.359439 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.353120 2559 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 11 03:02:56.359439 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.353123 2559 flags.go:64] FLAG: --kube-api-burst="100" Jul 11 03:02:56.359439 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.353126 2559 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 11 03:02:56.359439 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.353130 2559 flags.go:64] FLAG: --kube-api-qps="50" Jul 11 03:02:56.359439 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.353133 2559 flags.go:64] FLAG: --kube-reserved="" Jul 11 03:02:56.360049 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.353135 2559 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 11 03:02:56.360049 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.353138 2559 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 11 03:02:56.360049 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.353141 2559 flags.go:64] FLAG: --kubelet-cgroups="" Jul 11 03:02:56.360049 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.353144 2559 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 11 03:02:56.360049 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.353147 2559 flags.go:64] FLAG: --lock-file="" Jul 11 03:02:56.360049 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.353164 2559 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 11 03:02:56.360049 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.353167 2559 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 11 03:02:56.360049 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.353171 2559 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 11 03:02:56.360049 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.353177 2559 flags.go:64] FLAG: --log-json-split-stream="false" Jul 11 03:02:56.360049 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.353180 2559 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 11 03:02:56.360049 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.353183 2559 flags.go:64] FLAG: --log-text-split-stream="false" Jul 11 03:02:56.360049 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.353186 2559 flags.go:64] FLAG: --logging-format="text" Jul 11 03:02:56.360049 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.353189 2559 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 11 03:02:56.360049 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.353192 2559 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 11 03:02:56.360049 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.353195 2559 flags.go:64] FLAG: --manifest-url="" Jul 11 03:02:56.360049 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.353198 2559 flags.go:64] FLAG: --manifest-url-header="" Jul 11 03:02:56.360049 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.353202 2559 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 11 03:02:56.360049 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.353205 2559 flags.go:64] FLAG: --max-open-files="1000000" Jul 11 03:02:56.360049 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.353209 2559 flags.go:64] FLAG: --max-pods="110" Jul 11 03:02:56.360049 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.353212 2559 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 11 03:02:56.360049 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.353215 2559 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 11 03:02:56.360049 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.353217 2559 flags.go:64] FLAG: --memory-manager-policy="None" Jul 11 03:02:56.360049 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.353221 2559 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 11 03:02:56.360049 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.353224 2559 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 11 03:02:56.360049 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.353226 2559 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 11 03:02:56.360653 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.353229 2559 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 11 03:02:56.360653 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.353236 2559 flags.go:64] FLAG: --node-status-max-images="50" Jul 11 03:02:56.360653 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.353244 2559 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 11 03:02:56.360653 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.353247 2559 flags.go:64] FLAG: --oom-score-adj="-999" Jul 11 03:02:56.360653 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.353250 2559 flags.go:64] FLAG: --pod-cidr="" Jul 11 03:02:56.360653 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.353254 2559 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 11 03:02:56.360653 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.353263 2559 flags.go:64] FLAG: --pod-manifest-path="" Jul 11 03:02:56.360653 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.353266 2559 flags.go:64] FLAG: --pod-max-pids="-1" Jul 11 03:02:56.360653 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.353269 2559 flags.go:64] FLAG: --pods-per-core="0" Jul 11 03:02:56.360653 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.353272 2559 flags.go:64] FLAG: --port="10250" Jul 11 03:02:56.360653 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.353275 2559 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 11 03:02:56.360653 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.353278 2559 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-01ba67980265bd63e" Jul 11 03:02:56.360653 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.353281 2559 flags.go:64] FLAG: --qos-reserved="" Jul 11 03:02:56.360653 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.353284 2559 flags.go:64] FLAG: --read-only-port="10255" Jul 11 03:02:56.360653 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.353287 2559 flags.go:64] FLAG: --register-node="true" Jul 11 03:02:56.360653 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.353290 2559 flags.go:64] FLAG: --register-with-taints="" Jul 11 03:02:56.360653 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.353293 2559 flags.go:64] FLAG: --registry-burst="10" Jul 11 03:02:56.360653 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.353296 2559 flags.go:64] FLAG: --registry-qps="5" Jul 11 03:02:56.360653 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.353298 2559 flags.go:64] FLAG: --reserved-cpus="" Jul 11 03:02:56.360653 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.353301 2559 flags.go:64] FLAG: --reserved-memory="" Jul 11 03:02:56.360653 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.353305 2559 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 11 03:02:56.360653 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.353308 2559 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 11 03:02:56.360653 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.353311 2559 flags.go:64] FLAG: --rotate-certificates="false" Jul 11 03:02:56.360653 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.353314 2559 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 11 03:02:56.360653 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.353317 2559 flags.go:64] FLAG: --runonce="false" Jul 11 03:02:56.361308 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.353319 2559 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 11 03:02:56.361308 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.353322 2559 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 11 03:02:56.361308 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.353325 2559 flags.go:64] FLAG: --seccomp-default="false" Jul 11 03:02:56.361308 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.353328 2559 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 11 03:02:56.361308 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.353330 2559 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 11 03:02:56.361308 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.353333 2559 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 11 03:02:56.361308 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.353336 2559 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 11 03:02:56.361308 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.353339 2559 flags.go:64] FLAG: --storage-driver-password="root" Jul 11 03:02:56.361308 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.353342 2559 flags.go:64] FLAG: --storage-driver-secure="false" Jul 11 03:02:56.361308 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.353347 2559 flags.go:64] FLAG: --storage-driver-table="stats" Jul 11 03:02:56.361308 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.353349 2559 flags.go:64] FLAG: --storage-driver-user="root" Jul 11 03:02:56.361308 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.353353 2559 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 11 03:02:56.361308 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.353356 2559 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 11 03:02:56.361308 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.353359 2559 flags.go:64] FLAG: --system-cgroups="" Jul 11 03:02:56.361308 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.353362 2559 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 11 03:02:56.361308 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.353367 2559 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 11 03:02:56.361308 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.353370 2559 flags.go:64] FLAG: --tls-cert-file="" Jul 11 03:02:56.361308 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.353372 2559 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 11 03:02:56.361308 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.353377 2559 flags.go:64] FLAG: --tls-min-version="" Jul 11 03:02:56.361308 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.353379 2559 flags.go:64] FLAG: --tls-private-key-file="" Jul 11 03:02:56.361308 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.353382 2559 flags.go:64] FLAG: --topology-manager-policy="none" Jul 11 03:02:56.361308 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.353385 2559 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 11 03:02:56.361308 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.353388 2559 flags.go:64] FLAG: --topology-manager-scope="container" Jul 11 03:02:56.361308 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.353390 2559 flags.go:64] FLAG: --v="2" Jul 11 03:02:56.361308 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.353394 2559 flags.go:64] FLAG: --version="false" Jul 11 03:02:56.361917 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.353398 2559 flags.go:64] FLAG: --vmodule="" Jul 11 03:02:56.361917 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.353401 2559 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 11 03:02:56.361917 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.353404 2559 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 11 03:02:56.361917 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.353522 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 11 03:02:56.361917 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.353525 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 11 03:02:56.361917 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.353528 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 11 03:02:56.361917 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.353531 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 11 03:02:56.361917 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.353533 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 11 03:02:56.361917 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.353536 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 11 03:02:56.361917 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.353539 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 11 03:02:56.361917 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.353541 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 11 03:02:56.361917 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.353545 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 11 03:02:56.361917 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.353547 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 11 03:02:56.361917 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.353550 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 11 03:02:56.361917 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.353552 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 11 03:02:56.361917 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.353555 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 11 03:02:56.361917 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.353559 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 11 03:02:56.361917 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.353562 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 11 03:02:56.361917 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.353566 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 11 03:02:56.362413 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.353569 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 11 03:02:56.362413 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.353572 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 11 03:02:56.362413 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.353576 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 11 03:02:56.362413 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.353579 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 11 03:02:56.362413 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.353581 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 11 03:02:56.362413 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.353584 2559 feature_gate.go:328] unrecognized feature gate: Example Jul 11 03:02:56.362413 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.353587 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 11 03:02:56.362413 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.353590 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jul 11 03:02:56.362413 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.353592 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 11 03:02:56.362413 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.353595 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 11 03:02:56.362413 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.353598 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 11 03:02:56.362413 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.353600 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 11 03:02:56.362413 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.353602 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 11 03:02:56.362413 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.353605 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 11 03:02:56.362413 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.353607 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 11 03:02:56.362413 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.353610 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 11 03:02:56.362413 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.353612 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 11 03:02:56.362413 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.353614 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 11 03:02:56.362413 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.353617 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 11 03:02:56.362413 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.353619 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 11 03:02:56.362904 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.353622 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 11 03:02:56.362904 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.353624 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 11 03:02:56.362904 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.353627 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 11 03:02:56.362904 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.353629 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 11 03:02:56.362904 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.353633 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 11 03:02:56.362904 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.353635 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 11 03:02:56.362904 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.353638 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 11 03:02:56.362904 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.353640 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 11 03:02:56.362904 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.353643 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 11 03:02:56.362904 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.353648 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 11 03:02:56.362904 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.353651 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 11 03:02:56.362904 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.353654 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 11 03:02:56.362904 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.353657 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 11 03:02:56.362904 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.353660 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 11 03:02:56.362904 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.353663 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 11 03:02:56.362904 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.353666 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 11 03:02:56.362904 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.353669 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 11 03:02:56.362904 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.353671 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 11 03:02:56.362904 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.353674 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 11 03:02:56.362904 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.353676 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 11 03:02:56.363422 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.353679 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 11 03:02:56.363422 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.353681 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 11 03:02:56.363422 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.353684 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 11 03:02:56.363422 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.353686 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 11 03:02:56.363422 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.353689 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 11 03:02:56.363422 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.353692 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 11 03:02:56.363422 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.353694 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 11 03:02:56.363422 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.353697 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 11 03:02:56.363422 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.353699 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 11 03:02:56.363422 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.353701 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 11 03:02:56.363422 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.353704 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 11 03:02:56.363422 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.353706 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 11 03:02:56.363422 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.353709 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 11 03:02:56.363422 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.353711 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 11 03:02:56.363422 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.353714 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 11 03:02:56.363422 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.353716 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 11 03:02:56.363422 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.353720 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 11 03:02:56.363422 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.353722 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 11 03:02:56.363422 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.353725 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 11 03:02:56.363422 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.353727 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 11 03:02:56.363915 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.353730 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 11 03:02:56.363915 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.353734 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 11 03:02:56.363915 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.353736 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 11 03:02:56.363915 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.353739 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 11 03:02:56.363915 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.353741 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 11 03:02:56.363915 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.353744 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 11 03:02:56.363915 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.353746 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 11 03:02:56.363915 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.353748 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 11 03:02:56.363915 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.353751 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 11 03:02:56.363915 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.353754 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 11 03:02:56.363915 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.353756 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 11 03:02:56.363915 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.353759 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 11 03:02:56.363915 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.353763 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 11 03:02:56.363915 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.353766 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 11 03:02:56.363915 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.353769 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 11 03:02:56.363915 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.353771 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 11 03:02:56.363915 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.353774 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 11 03:02:56.363915 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.353776 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 11 03:02:56.363915 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.353779 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 11 03:02:56.363915 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.353781 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 11 03:02:56.364422 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.353783 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 11 03:02:56.364422 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.353786 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 11 03:02:56.364422 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.353788 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 11 03:02:56.364422 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.353794 2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 11 03:02:56.364422 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.360693 2559 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 11 03:02:56.364422 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.360805 2559 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 11 03:02:56.364422 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.361664 2559 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 11 03:02:56.364422 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.361672 2559 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 11 03:02:56.364422 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.361734 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jul 11 03:02:56.364422 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.361740 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 11 03:02:56.364422 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.361743 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 11 03:02:56.364422 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.361746 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 11 03:02:56.364422 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.361749 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 11 03:02:56.364422 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.361752 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 11 03:02:56.364772 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.361754 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 11 03:02:56.364772 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.361757 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 11 03:02:56.364772 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.361760 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 11 03:02:56.364772 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.361762 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 11 03:02:56.364772 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.361765 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 11 03:02:56.364772 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.361767 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 11 03:02:56.364772 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.361771 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 11 03:02:56.364772 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.361774 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 11 03:02:56.364772 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.361776 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 11 03:02:56.364772 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.361779 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 11 03:02:56.364772 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.361781 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 11 03:02:56.364772 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.361784 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 11 03:02:56.364772 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.361786 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 11 03:02:56.364772 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.361789 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 11 03:02:56.364772 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.361791 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 11 03:02:56.364772 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.361794 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 11 03:02:56.364772 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.361798 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 11 03:02:56.364772 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.361802 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 11 03:02:56.364772 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.361805 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 11 03:02:56.365314 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.361808 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 11 03:02:56.365314 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.361811 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 11 03:02:56.365314 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.361814 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 11 03:02:56.365314 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.361817 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 11 03:02:56.365314 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.361820 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 11 03:02:56.365314 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.361823 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 11 03:02:56.365314 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.361826 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 11 03:02:56.365314 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.361829 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 11 03:02:56.365314 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.361831 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 11 03:02:56.365314 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.361834 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 11 03:02:56.365314 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.361836 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 11 03:02:56.365314 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.361838 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 11 03:02:56.365314 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.361842 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 11 03:02:56.365314 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.361844 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 11 03:02:56.365314 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.361847 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 11 03:02:56.365314 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.361849 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 11 03:02:56.365314 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.361852 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 11 03:02:56.365314 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.361855 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 11 03:02:56.365314 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.361858 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 11 03:02:56.365314 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.361860 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 11 03:02:56.365808 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.361864 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 11 03:02:56.365808 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.361866 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 11 03:02:56.365808 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.361869 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 11 03:02:56.365808 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.361872 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 11 03:02:56.365808 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.361874 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 11 03:02:56.365808 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.361877 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 11 03:02:56.365808 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.361879 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 11 03:02:56.365808 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.361882 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 11 03:02:56.365808 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.361886 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 11 03:02:56.365808 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.361889 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 11 03:02:56.365808 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.361892 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 11 03:02:56.365808 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.361894 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 11 03:02:56.365808 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.361897 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 11 03:02:56.365808 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.361900 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 11 03:02:56.365808 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.361902 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 11 03:02:56.365808 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.361904 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 11 03:02:56.365808 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.361908 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 11 03:02:56.365808 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.361912 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 11 03:02:56.365808 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.361916 2559 feature_gate.go:328] unrecognized feature gate: Example Jul 11 03:02:56.366283 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.361919 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 11 03:02:56.366283 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.361922 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 11 03:02:56.366283 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.361924 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 11 03:02:56.366283 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.361927 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 11 03:02:56.366283 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.361930 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 11 03:02:56.366283 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.361932 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 11 03:02:56.366283 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.361935 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 11 03:02:56.366283 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.361937 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 11 03:02:56.366283 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.361939 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 11 03:02:56.366283 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.361942 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 11 03:02:56.366283 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.361944 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 11 03:02:56.366283 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.361947 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 11 03:02:56.366283 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.361949 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 11 03:02:56.366283 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.361952 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 11 03:02:56.366283 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.361966 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 11 03:02:56.366283 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.361969 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 11 03:02:56.366283 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.361972 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 11 03:02:56.366283 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.361974 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 11 03:02:56.366283 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.361977 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 11 03:02:56.366283 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.361980 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 11 03:02:56.366774 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.361982 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 11 03:02:56.366774 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.361985 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 11 03:02:56.366774 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.361987 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 11 03:02:56.366774 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.361990 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 11 03:02:56.366774 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.361992 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 11 03:02:56.366774 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.361995 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 11 03:02:56.366774 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.361997 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 11 03:02:56.366774 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.362000 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 11 03:02:56.366774 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.362003 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 11 03:02:56.366774 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.362006 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 11 03:02:56.366774 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.362009 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 11 03:02:56.366774 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.362012 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 11 03:02:56.366774 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.362014 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 11 03:02:56.366774 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.362017 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 11 03:02:56.366774 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.362020 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 11 03:02:56.367165 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.362025 2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 11 03:02:56.367165 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.362139 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 11 03:02:56.367165 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.362144 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 11 03:02:56.367165 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.362148 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 11 03:02:56.367165 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.362150 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 11 03:02:56.367165 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.362153 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 11 03:02:56.367165 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.362156 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 11 03:02:56.367165 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.362158 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 11 03:02:56.367165 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.362161 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 11 03:02:56.367165 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.362164 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 11 03:02:56.367165 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.362166 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 11 03:02:56.367165 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.362169 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 11 03:02:56.367165 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.362171 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 11 03:02:56.367165 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.362174 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 11 03:02:56.367165 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.362177 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 11 03:02:56.367541 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.362179 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 11 03:02:56.367541 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.362182 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 11 03:02:56.367541 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.362184 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 11 03:02:56.367541 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.362187 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 11 03:02:56.367541 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.362190 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 11 03:02:56.367541 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.362193 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 11 03:02:56.367541 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.362195 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 11 03:02:56.367541 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.362198 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 11 03:02:56.367541 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.362200 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 11 03:02:56.367541 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.362203 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 11 03:02:56.367541 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.362206 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 11 03:02:56.367541 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.362208 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 11 03:02:56.367541 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.362211 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 11 03:02:56.367541 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.362214 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 11 03:02:56.367541 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.362216 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 11 03:02:56.367541 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.362219 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 11 03:02:56.367541 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.362222 2559 feature_gate.go:328] unrecognized feature gate: Example Jul 11 03:02:56.367541 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.362224 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 11 03:02:56.367541 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.362226 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 11 03:02:56.367541 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.362229 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 11 03:02:56.368063 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.362231 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 11 03:02:56.368063 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.362234 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 11 03:02:56.368063 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.362236 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 11 03:02:56.368063 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.362238 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 11 03:02:56.368063 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.362241 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 11 03:02:56.368063 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.362243 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 11 03:02:56.368063 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.362254 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 11 03:02:56.368063 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.362258 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 11 03:02:56.368063 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.362261 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 11 03:02:56.368063 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.362263 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 11 03:02:56.368063 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.362267 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 11 03:02:56.368063 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.362269 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 11 03:02:56.368063 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.362272 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 11 03:02:56.368063 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.362275 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 11 03:02:56.368063 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.362277 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 11 03:02:56.368063 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.362279 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 11 03:02:56.368063 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.362282 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 11 03:02:56.368063 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.362284 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 11 03:02:56.368063 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.362287 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 11 03:02:56.368519 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.362289 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 11 03:02:56.368519 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.362291 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 11 03:02:56.368519 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.362294 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 11 03:02:56.368519 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.362297 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 11 03:02:56.368519 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.362299 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 11 03:02:56.368519 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.362302 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 11 03:02:56.368519 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.362305 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 11 03:02:56.368519 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.362307 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 11 03:02:56.368519 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.362310 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 11 03:02:56.368519 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.362312 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 11 03:02:56.368519 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.362315 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 11 03:02:56.368519 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.362317 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 11 03:02:56.368519 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.362320 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 11 03:02:56.368519 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.362322 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 11 03:02:56.368519 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.362325 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 11 03:02:56.368519 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.362327 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 11 03:02:56.368519 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.362330 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 11 03:02:56.368519 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.362334 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 11 03:02:56.368519 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.362337 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 11 03:02:56.369019 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.362340 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 11 03:02:56.369019 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.362342 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 11 03:02:56.369019 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.362346 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 11 03:02:56.369019 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.362349 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 11 03:02:56.369019 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.362352 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 11 03:02:56.369019 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.362355 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 11 03:02:56.369019 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.362358 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 11 03:02:56.369019 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.362361 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 11 03:02:56.369019 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.362364 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 11 03:02:56.369019 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.362366 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 11 03:02:56.369019 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.362369 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 11 03:02:56.369019 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.362372 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 11 03:02:56.369019 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.362375 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 11 03:02:56.369019 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.362377 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 11 03:02:56.369019 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.362380 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 11 03:02:56.369019 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.362383 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 11 03:02:56.369019 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.362386 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 11 03:02:56.369019 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.362389 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 11 03:02:56.369019 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.362391 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 11 03:02:56.369478 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.362394 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 11 03:02:56.369478 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.362397 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 11 03:02:56.369478 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.362400 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 11 03:02:56.369478 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.362403 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 11 03:02:56.369478 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.362405 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 11 03:02:56.369478 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.362408 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 11 03:02:56.369478 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.362411 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 11 03:02:56.369478 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:56.362414 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jul 11 03:02:56.369478 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.362419 2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 11 03:02:56.369478 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.362543 2559 server.go:962] "Client rotation is on, will bootstrap in background" Jul 11 03:02:56.369478 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.365249 2559 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 11 03:02:56.369478 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.366434 2559 server.go:1019] "Starting client certificate rotation" Jul 11 03:02:56.369478 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.366546 2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 11 03:02:56.369478 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.366602 2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 11 03:02:56.369846 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.369628 2559 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 11 03:02:56.373844 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.373816 2559 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 11 03:02:56.382360 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.382340 2559 log.go:25] "Validated CRI v1 runtime API" Jul 11 03:02:56.384494 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.384476 2559 log.go:25] "Validated CRI v1 image API" Jul 11 03:02:56.387368 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.387348 2559 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 11 03:02:56.390944 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.390924 2559 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 d5f017cf-9d29-4638-ba78-6fb6975654aa:/dev/nvme0n1p4 f790d3bd-a62b-4bc5-9185-8cf466a39d7c:/dev/nvme0n1p3] Jul 11 03:02:56.391009 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.390945 2559 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 11 03:02:56.396094 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.396078 2559 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 11 03:02:56.397091 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.396983 2559 manager.go:216] Machine: {Timestamp:2026-07-11 03:02:56.395032339 +0000 UTC m=+0.363644780 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098539 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec29867884d2d3c1f24b78d06ddd8453 SystemUUID:ec298678-84d2-d3c1-f24b-78d06ddd8453 BootID:7bab53b0-fd17-4a2b-bf02-c90132e8d67c Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:80:f1:87:60:13 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:80:f1:87:60:13 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:fa:6e:70:7b:7f:14 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 11 03:02:56.397091 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.397091 2559 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 11 03:02:56.397235 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.397223 2559 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 11 03:02:56.400849 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.400826 2559 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 11 03:02:56.401002 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.400853 2559 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-141.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 11 03:02:56.401702 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.401692 2559 topology_manager.go:138] "Creating topology manager with none policy" Jul 11 03:02:56.401737 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.401705 2559 container_manager_linux.go:309] "Creating device plugin manager" Jul 11 03:02:56.401737 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.401712 2559 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 11 03:02:56.402813 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.402801 2559 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 11 03:02:56.404490 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.404480 2559 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 11 03:02:56.407414 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.407403 2559 state_mem.go:36] "Initialized new in-memory state store" Jul 11 03:02:56.407525 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.407516 2559 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 11 03:02:56.407559 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.407546 2559 kubelet.go:486] "Attempting to sync node with API server" Jul 11 03:02:56.407587 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.407563 2559 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 11 03:02:56.407587 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.407577 2559 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 11 03:02:56.407636 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.407589 2559 kubelet.go:398] "Adding apiserver pod source" Jul 11 03:02:56.407636 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.407597 2559 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 11 03:02:56.408019 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.408008 2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 11 03:02:56.408058 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.408029 2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 11 03:02:56.411229 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.411212 2559 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 11 03:02:56.413228 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.413214 2559 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 11 03:02:56.413269 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.413245 2559 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 11 03:02:56.413425 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.413410 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 11 03:02:56.413454 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.413435 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 11 03:02:56.413454 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.413443 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 11 03:02:56.413454 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.413449 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 11 03:02:56.413528 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.413457 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 11 03:02:56.413528 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.413463 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 11 03:02:56.414128 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.414117 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 11 03:02:56.414158 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.414132 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 11 03:02:56.414158 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.414142 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 11 03:02:56.414158 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.414147 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 11 03:02:56.414158 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.414155 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 11 03:02:56.414268 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.414164 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 11 03:02:56.415573 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.415563 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 11 03:02:56.415603 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.415575 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 11 03:02:56.418413 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.418380 2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-86cgz" Jul 11 03:02:56.419235 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:02:56.419199 2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-141.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 11 03:02:56.419328 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:02:56.419200 2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 11 03:02:56.421624 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.421608 2559 server.go:1268] "Started kubelet" Jul 11 03:02:56.421753 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.421681 2559 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 11 03:02:56.421862 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.421716 2559 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 11 03:02:56.421862 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.421802 2559 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 11 03:02:56.422519 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.422497 2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-86cgz" Jul 11 03:02:56.422649 ip-10-0-141-141 systemd[1]: Started Kubernetes Kubelet. Jul 11 03:02:56.423666 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.423651 2559 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 11 03:02:56.423883 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.423869 2559 server.go:310] "Adding debug handlers to kubelet server" Jul 11 03:02:56.426016 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:02:56.425996 2559 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 11 03:02:56.427841 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.427824 2559 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-141.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 11 03:02:56.428926 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:02:56.427836 2559 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-141.ec2.internal.18c11d25fda07bf7 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-141.ec2.internal,UID:ip-10-0-141-141.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-141.ec2.internal,},FirstTimestamp:2026-07-11 03:02:56.421575671 +0000 UTC m=+0.390188113,LastTimestamp:2026-07-11 03:02:56.421575671 +0000 UTC m=+0.390188113,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-141.ec2.internal,}" Jul 11 03:02:56.430030 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.430011 2559 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 11 03:02:56.430030 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.430017 2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 11 03:02:56.430159 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:02:56.430124 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-141.ec2.internal\" not found" Jul 11 03:02:56.430664 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.430644 2559 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 11 03:02:56.430664 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.430665 2559 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 11 03:02:56.430768 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.430725 2559 reconstruct.go:97] "Volume reconstruction finished" Jul 11 03:02:56.430768 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.430734 2559 reconciler.go:29] "Reconciler: start to sync state" Jul 11 03:02:56.430768 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.430763 2559 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 11 03:02:56.430902 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.430801 2559 factory.go:55] Registering systemd factory Jul 11 03:02:56.430902 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.430818 2559 factory.go:223] Registration of the systemd container factory successfully Jul 11 03:02:56.431179 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.431036 2559 factory.go:153] Registering CRI-O factory Jul 11 03:02:56.431179 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.431049 2559 factory.go:223] Registration of the crio container factory successfully Jul 11 03:02:56.431179 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.431104 2559 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 11 03:02:56.431179 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.431130 2559 factory.go:103] Registering Raw factory Jul 11 03:02:56.431179 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.431146 2559 manager.go:1196] Started watching for new ooms in manager Jul 11 03:02:56.431531 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.431514 2559 manager.go:349] Starting recovery of all containers Jul 11 03:02:56.435239 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.435220 2559 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 11 03:02:56.438092 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:02:56.438069 2559 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-141-141.ec2.internal\" not found" node="ip-10-0-141-141.ec2.internal" Jul 11 03:02:56.442536 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.442514 2559 manager.go:354] Recovery completed Jul 11 03:02:56.447943 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.447925 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 11 03:02:56.453601 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.453583 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-141.ec2.internal" event="NodeHasSufficientMemory" Jul 11 03:02:56.453675 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.453614 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-141.ec2.internal" event="NodeHasNoDiskPressure" Jul 11 03:02:56.453675 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.453624 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-141.ec2.internal" event="NodeHasSufficientPID" Jul 11 03:02:56.454228 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.454210 2559 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 11 03:02:56.454304 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.454229 2559 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 11 03:02:56.454304 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.454216 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 11 03:02:56.454304 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.454256 2559 state_mem.go:36] "Initialized new in-memory state store" Jul 11 03:02:56.455031 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.455012 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-141.ec2.internal" event="NodeHasSufficientMemory" Jul 11 03:02:56.455125 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.455053 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-141.ec2.internal" event="NodeHasNoDiskPressure" Jul 11 03:02:56.455125 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.455067 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-141.ec2.internal" event="NodeHasSufficientPID" Jul 11 03:02:56.455888 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.455872 2559 policy_none.go:49] "None policy: Start" Jul 11 03:02:56.455888 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.455890 2559 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 11 03:02:56.456016 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.455921 2559 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 11 03:02:56.456920 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.456910 2559 policy_none.go:47] "Start" Jul 11 03:02:56.488647 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.488630 2559 manager.go:337] "Starting Device Plugin manager" Jul 11 03:02:56.488743 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:02:56.488663 2559 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 11 03:02:56.488743 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.488673 2559 server.go:87] "Starting device plugin registration server" Jul 11 03:02:56.488971 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.488942 2559 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 11 03:02:56.489038 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.488977 2559 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 11 03:02:56.489091 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.489080 2559 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 11 03:02:56.489159 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.489141 2559 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 11 03:02:56.489159 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.489155 2559 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 11 03:02:56.490428 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:02:56.489610 2559 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 11 03:02:56.490428 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:02:56.489648 2559 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-141.ec2.internal\" not found" Jul 11 03:02:56.589410 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.589366 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 11 03:02:56.590544 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.590435 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-141.ec2.internal" event="NodeHasSufficientMemory" Jul 11 03:02:56.590544 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.590474 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-141.ec2.internal" event="NodeHasNoDiskPressure" Jul 11 03:02:56.590544 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.590484 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-141.ec2.internal" event="NodeHasSufficientPID" Jul 11 03:02:56.590544 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.590509 2559 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-141.ec2.internal" Jul 11 03:02:56.596030 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.596014 2559 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-141.ec2.internal" Jul 11 03:02:56.596094 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:02:56.596038 2559 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-141.ec2.internal\": node \"ip-10-0-141-141.ec2.internal\" not found" Jul 11 03:02:56.607273 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.607211 2559 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 11 03:02:56.608562 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.608543 2559 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 11 03:02:56.608628 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.608590 2559 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 11 03:02:56.608628 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.608613 2559 kubelet.go:2448] "Starting kubelet main sync loop" Jul 11 03:02:56.608717 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:02:56.608708 2559 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 11 03:02:56.609382 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:02:56.609365 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-141.ec2.internal\" not found" Jul 11 03:02:56.610588 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.610567 2559 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 11 03:02:56.708836 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.708800 2559 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-141.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-141.ec2.internal"] Jul 11 03:02:56.709027 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.708879 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 11 03:02:56.710180 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:02:56.710161 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-141.ec2.internal\" not found" Jul 11 03:02:56.712457 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.712441 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-141.ec2.internal" event="NodeHasSufficientMemory" Jul 11 03:02:56.712507 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.712472 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-141.ec2.internal" event="NodeHasNoDiskPressure" Jul 11 03:02:56.712507 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.712482 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-141.ec2.internal" event="NodeHasSufficientPID" Jul 11 03:02:56.713802 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.713790 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 11 03:02:56.713932 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.713917 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-141.ec2.internal" Jul 11 03:02:56.713983 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.713948 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 11 03:02:56.714682 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.714664 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-141.ec2.internal" event="NodeHasSufficientMemory" Jul 11 03:02:56.714775 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.714687 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-141.ec2.internal" event="NodeHasNoDiskPressure" Jul 11 03:02:56.714775 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.714697 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-141.ec2.internal" event="NodeHasSufficientPID" Jul 11 03:02:56.714775 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.714667 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-141.ec2.internal" event="NodeHasSufficientMemory" Jul 11 03:02:56.714775 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.714764 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-141.ec2.internal" event="NodeHasNoDiskPressure" Jul 11 03:02:56.714775 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.714776 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-141.ec2.internal" event="NodeHasSufficientPID" Jul 11 03:02:56.715920 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.715903 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-141.ec2.internal" Jul 11 03:02:56.715987 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.715936 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 11 03:02:56.716664 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.716649 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-141.ec2.internal" event="NodeHasSufficientMemory" Jul 11 03:02:56.716739 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.716672 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-141.ec2.internal" event="NodeHasNoDiskPressure" Jul 11 03:02:56.716739 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.716683 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-141.ec2.internal" event="NodeHasSufficientPID" Jul 11 03:02:56.732233 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.732207 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7832d055872458363fd84090a1330a4f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-141.ec2.internal\" (UID: \"7832d055872458363fd84090a1330a4f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-141.ec2.internal" Jul 11 03:02:56.732354 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.732239 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f78a7cbe224856398af387ef37689630-config\") pod \"kube-apiserver-proxy-ip-10-0-141-141.ec2.internal\" (UID: \"f78a7cbe224856398af387ef37689630\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-141.ec2.internal" Jul 11 03:02:56.732354 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.732256 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7832d055872458363fd84090a1330a4f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-141.ec2.internal\" (UID: \"7832d055872458363fd84090a1330a4f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-141.ec2.internal" Jul 11 03:02:56.742665 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:02:56.742636 2559 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-141.ec2.internal\" not found" node="ip-10-0-141-141.ec2.internal" Jul 11 03:02:56.747192 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:02:56.747171 2559 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-141.ec2.internal\" not found" node="ip-10-0-141-141.ec2.internal" Jul 11 03:02:56.810385 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:02:56.810355 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-141.ec2.internal\" not found" Jul 11 03:02:56.833387 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.833353 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f78a7cbe224856398af387ef37689630-config\") pod \"kube-apiserver-proxy-ip-10-0-141-141.ec2.internal\" (UID: \"f78a7cbe224856398af387ef37689630\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-141.ec2.internal" Jul 11 03:02:56.833387 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.833385 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7832d055872458363fd84090a1330a4f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-141.ec2.internal\" (UID: \"7832d055872458363fd84090a1330a4f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-141.ec2.internal" Jul 11 03:02:56.833535 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.833402 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7832d055872458363fd84090a1330a4f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-141.ec2.internal\" (UID: \"7832d055872458363fd84090a1330a4f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-141.ec2.internal" Jul 11 03:02:56.833535 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.833449 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7832d055872458363fd84090a1330a4f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-141.ec2.internal\" (UID: \"7832d055872458363fd84090a1330a4f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-141.ec2.internal" Jul 11 03:02:56.833535 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.833480 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7832d055872458363fd84090a1330a4f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-141.ec2.internal\" (UID: \"7832d055872458363fd84090a1330a4f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-141.ec2.internal" Jul 11 03:02:56.833535 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:56.833480 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f78a7cbe224856398af387ef37689630-config\") pod \"kube-apiserver-proxy-ip-10-0-141-141.ec2.internal\" (UID: \"f78a7cbe224856398af387ef37689630\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-141.ec2.internal" Jul 11 03:02:56.910937 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:02:56.910856 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-141.ec2.internal\" not found" Jul 11 03:02:57.011361 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:02:57.011326 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-141.ec2.internal\" not found" Jul 11 03:02:57.044916 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:57.044889 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-141.ec2.internal" Jul 11 03:02:57.050038 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:57.050019 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-141.ec2.internal" Jul 11 03:02:57.112126 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:02:57.112084 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-141.ec2.internal\" not found" Jul 11 03:02:57.217450 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:02:57.217380 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-141.ec2.internal\" not found" Jul 11 03:02:57.320466 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:02:57.320426 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-141.ec2.internal\" not found" Jul 11 03:02:57.367427 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:57.367397 2559 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 11 03:02:57.368196 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:57.367587 2559 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 11 03:02:57.368196 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:57.367612 2559 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 11 03:02:57.420843 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:02:57.420801 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-141.ec2.internal\" not found" Jul 11 03:02:57.428530 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:57.428494 2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-10 02:57:56 +0000 UTC" deadline="2028-03-11 04:42:46.304743566 +0000 UTC" Jul 11 03:02:57.428530 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:57.428523 2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14617h39m48.876223794s" Jul 11 03:02:57.521576 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:02:57.521508 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-141.ec2.internal\" not found" Jul 11 03:02:57.622860 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:02:57.622673 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-141.ec2.internal\" not found" Jul 11 03:02:57.652817 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:57.652777 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7832d055872458363fd84090a1330a4f.slice/crio-826f665d605f14db3faf968157bac05ab20596ca37215d84c8ac8c92ea1ad456 WatchSource:0}: Error finding container 826f665d605f14db3faf968157bac05ab20596ca37215d84c8ac8c92ea1ad456: Status 404 returned error can't find the container with id 826f665d605f14db3faf968157bac05ab20596ca37215d84c8ac8c92ea1ad456 Jul 11 03:02:57.653212 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:57.653189 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf78a7cbe224856398af387ef37689630.slice/crio-4f64a15eceb795b2765e389419687d10764a2b8a2f9cc6068b2237e73fae8b3d WatchSource:0}: Error finding container 4f64a15eceb795b2765e389419687d10764a2b8a2f9cc6068b2237e73fae8b3d: Status 404 returned error can't find the container with id 4f64a15eceb795b2765e389419687d10764a2b8a2f9cc6068b2237e73fae8b3d Jul 11 03:02:57.658044 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:57.658025 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 11 03:02:57.722256 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:57.722220 2559 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 11 03:02:57.722937 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:02:57.722915 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-141.ec2.internal\" not found" Jul 11 03:02:57.749670 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:57.749644 2559 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 11 03:02:57.831019 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:57.830990 2559 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-141.ec2.internal" Jul 11 03:02:57.841463 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:57.841445 2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 11 03:02:57.842694 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:57.842681 2559 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-141.ec2.internal" Jul 11 03:02:57.852056 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:57.852028 2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 11 03:02:58.237594 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.237476 2559 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 11 03:02:58.409644 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.409604 2559 apiserver.go:52] "Watching apiserver" Jul 11 03:02:58.418002 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.417971 2559 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 11 03:02:58.418472 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.418441 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-fvldx","kube-system/kube-apiserver-proxy-ip-10-0-141-141.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rkhst","openshift-cluster-node-tuning-operator/tuned-zznc5","openshift-dns/node-resolver-t56cx","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-141.ec2.internal","openshift-multus/network-metrics-daemon-v9zw2","openshift-image-registry/node-ca-w6296","openshift-multus/multus-additional-cni-plugins-f7sb8","openshift-multus/multus-wg5xr","openshift-network-diagnostics/network-check-target-t96p7","openshift-network-operator/iptables-alerter-fkzq2","openshift-ovn-kubernetes/ovnkube-node-hb24z","kube-system/global-pull-secret-syncer-z7wb6"] Jul 11 03:02:58.420701 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.420348 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v9zw2" Jul 11 03:02:58.420701 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:02:58.420432 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v9zw2" podUID="e1553e4e-4895-4ef5-9027-14635923ec65" Jul 11 03:02:58.421621 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.421597 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-hb24z" Jul 11 03:02:58.423470 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.423446 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rkhst" Jul 11 03:02:58.425232 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.425165 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-zznc5" Jul 11 03:02:58.425503 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.425193 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-qfcg8\"" Jul 11 03:02:58.425814 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.425791 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 11 03:02:58.425901 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.425862 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 11 03:02:58.426055 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.426040 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 11 03:02:58.426141 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.426116 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 11 03:02:58.426199 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.426169 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 11 03:02:58.426254 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.426226 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 11 03:02:58.426313 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.426262 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-gkgh8\"" Jul 11 03:02:58.426367 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.426354 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 11 03:02:58.426472 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.426452 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 11 03:02:58.426538 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.426462 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 11 03:02:58.427818 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.427796 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-jkbwb\"" Jul 11 03:02:58.428041 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.428013 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 11 03:02:58.428225 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.428055 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 11 03:02:58.431472 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.430780 2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 11 03:02:58.431472 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.431439 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-t56cx" Jul 11 03:02:58.433688 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.433667 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z7wb6" Jul 11 03:02:58.433801 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:02:58.433727 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z7wb6" podUID="3f82cf26-f769-4fc3-ad0f-b1042b1f63c0" Jul 11 03:02:58.434253 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.434231 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-jxdl9\"" Jul 11 03:02:58.434422 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.434406 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 11 03:02:58.434497 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.434412 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 11 03:02:58.435317 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.435292 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-f7sb8" Jul 11 03:02:58.437340 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.437321 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-fvldx" Jul 11 03:02:58.438742 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.438353 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 11 03:02:58.438742 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.438360 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 11 03:02:58.438976 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.438957 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 11 03:02:58.439291 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.439269 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 11 03:02:58.439391 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.439332 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-s2g64\"" Jul 11 03:02:58.439450 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.439273 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 11 03:02:58.440399 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.439765 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-w6296" Jul 11 03:02:58.440399 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.440060 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-t9dh5\"" Jul 11 03:02:58.440399 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.440357 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 11 03:02:58.440612 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.440437 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 11 03:02:58.446283 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.446256 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 11 03:02:58.446817 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.446801 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-vm8tf\"" Jul 11 03:02:58.447101 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.447080 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 11 03:02:58.447216 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.447188 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 11 03:02:58.447471 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.447445 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-wg5xr" Jul 11 03:02:58.447903 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.447869 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3f82cf26-f769-4fc3-ad0f-b1042b1f63c0-kubelet-config\") pod \"global-pull-secret-syncer-z7wb6\" (UID: \"3f82cf26-f769-4fc3-ad0f-b1042b1f63c0\") " pod="kube-system/global-pull-secret-syncer-z7wb6" Jul 11 03:02:58.447994 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.447931 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/baacd8ba-d2a4-4bdf-8a48-6b822f219325-etc-sysctl-d\") pod \"tuned-zznc5\" (UID: \"baacd8ba-d2a4-4bdf-8a48-6b822f219325\") " pod="openshift-cluster-node-tuning-operator/tuned-zznc5" Jul 11 03:02:58.447994 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.447962 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/baacd8ba-d2a4-4bdf-8a48-6b822f219325-etc-systemd\") pod \"tuned-zznc5\" (UID: \"baacd8ba-d2a4-4bdf-8a48-6b822f219325\") " pod="openshift-cluster-node-tuning-operator/tuned-zznc5" Jul 11 03:02:58.448158 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.447994 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/baacd8ba-d2a4-4bdf-8a48-6b822f219325-sys\") pod \"tuned-zznc5\" (UID: \"baacd8ba-d2a4-4bdf-8a48-6b822f219325\") " pod="openshift-cluster-node-tuning-operator/tuned-zznc5" Jul 11 03:02:58.448158 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.448045 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/baacd8ba-d2a4-4bdf-8a48-6b822f219325-etc-tuned\") pod \"tuned-zznc5\" (UID: \"baacd8ba-d2a4-4bdf-8a48-6b822f219325\") " pod="openshift-cluster-node-tuning-operator/tuned-zznc5" Jul 11 03:02:58.448158 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.448078 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3f82cf26-f769-4fc3-ad0f-b1042b1f63c0-dbus\") pod \"global-pull-secret-syncer-z7wb6\" (UID: \"3f82cf26-f769-4fc3-ad0f-b1042b1f63c0\") " pod="kube-system/global-pull-secret-syncer-z7wb6" Jul 11 03:02:58.448158 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.448113 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3f82cf26-f769-4fc3-ad0f-b1042b1f63c0-original-pull-secret\") pod \"global-pull-secret-syncer-z7wb6\" (UID: \"3f82cf26-f769-4fc3-ad0f-b1042b1f63c0\") " pod="kube-system/global-pull-secret-syncer-z7wb6" Jul 11 03:02:58.448158 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.448144 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvcwh\" (UniqueName: \"kubernetes.io/projected/bc91021e-ef93-462d-a80d-130775629ff9-kube-api-access-fvcwh\") pod \"node-resolver-t56cx\" (UID: \"bc91021e-ef93-462d-a80d-130775629ff9\") " pod="openshift-dns/node-resolver-t56cx" Jul 11 03:02:58.448512 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.448179 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/baacd8ba-d2a4-4bdf-8a48-6b822f219325-etc-sysconfig\") pod \"tuned-zznc5\" (UID: \"baacd8ba-d2a4-4bdf-8a48-6b822f219325\") " pod="openshift-cluster-node-tuning-operator/tuned-zznc5" Jul 11 03:02:58.448512 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.448208 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/baacd8ba-d2a4-4bdf-8a48-6b822f219325-run\") pod \"tuned-zznc5\" (UID: \"baacd8ba-d2a4-4bdf-8a48-6b822f219325\") " pod="openshift-cluster-node-tuning-operator/tuned-zznc5" Jul 11 03:02:58.448512 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.448238 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/baacd8ba-d2a4-4bdf-8a48-6b822f219325-var-lib-kubelet\") pod \"tuned-zznc5\" (UID: \"baacd8ba-d2a4-4bdf-8a48-6b822f219325\") " pod="openshift-cluster-node-tuning-operator/tuned-zznc5" Jul 11 03:02:58.448512 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.448273 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rhsx5\" (UniqueName: \"kubernetes.io/projected/baacd8ba-d2a4-4bdf-8a48-6b822f219325-kube-api-access-rhsx5\") pod \"tuned-zznc5\" (UID: \"baacd8ba-d2a4-4bdf-8a48-6b822f219325\") " pod="openshift-cluster-node-tuning-operator/tuned-zznc5" Jul 11 03:02:58.448512 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.448301 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/bc91021e-ef93-462d-a80d-130775629ff9-hosts-file\") pod \"node-resolver-t56cx\" (UID: \"bc91021e-ef93-462d-a80d-130775629ff9\") " pod="openshift-dns/node-resolver-t56cx" Jul 11 03:02:58.448512 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.448337 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e1553e4e-4895-4ef5-9027-14635923ec65-metrics-certs\") pod \"network-metrics-daemon-v9zw2\" (UID: \"e1553e4e-4895-4ef5-9027-14635923ec65\") " pod="openshift-multus/network-metrics-daemon-v9zw2" Jul 11 03:02:58.448512 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.448453 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ns2mz\" (UniqueName: \"kubernetes.io/projected/e1553e4e-4895-4ef5-9027-14635923ec65-kube-api-access-ns2mz\") pod \"network-metrics-daemon-v9zw2\" (UID: \"e1553e4e-4895-4ef5-9027-14635923ec65\") " pod="openshift-multus/network-metrics-daemon-v9zw2" Jul 11 03:02:58.448512 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.448485 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/cd48fb79-15d0-42c4-9db6-cc93fbc68ec4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rkhst\" (UID: \"cd48fb79-15d0-42c4-9db6-cc93fbc68ec4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rkhst" Jul 11 03:02:58.448951 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.448519 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t96p7" Jul 11 03:02:58.448951 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:02:58.448611 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t96p7" podUID="56f1263c-c5a9-491e-af1e-32394171afec" Jul 11 03:02:58.448951 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.448518 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/cd48fb79-15d0-42c4-9db6-cc93fbc68ec4-socket-dir\") pod \"aws-ebs-csi-driver-node-rkhst\" (UID: \"cd48fb79-15d0-42c4-9db6-cc93fbc68ec4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rkhst" Jul 11 03:02:58.448951 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.448738 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/cd48fb79-15d0-42c4-9db6-cc93fbc68ec4-etc-selinux\") pod \"aws-ebs-csi-driver-node-rkhst\" (UID: \"cd48fb79-15d0-42c4-9db6-cc93fbc68ec4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rkhst" Jul 11 03:02:58.448951 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.448768 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4287b506-42a9-4b1d-85e8-91008605fd2c-host-kubelet\") pod \"ovnkube-node-hb24z\" (UID: \"4287b506-42a9-4b1d-85e8-91008605fd2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hb24z" Jul 11 03:02:58.448951 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.448796 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4287b506-42a9-4b1d-85e8-91008605fd2c-host-run-netns\") pod \"ovnkube-node-hb24z\" (UID: \"4287b506-42a9-4b1d-85e8-91008605fd2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hb24z" Jul 11 03:02:58.448951 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.448833 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4287b506-42a9-4b1d-85e8-91008605fd2c-var-lib-openvswitch\") pod \"ovnkube-node-hb24z\" (UID: \"4287b506-42a9-4b1d-85e8-91008605fd2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hb24z" Jul 11 03:02:58.448951 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.448892 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4287b506-42a9-4b1d-85e8-91008605fd2c-host-cni-bin\") pod \"ovnkube-node-hb24z\" (UID: \"4287b506-42a9-4b1d-85e8-91008605fd2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hb24z" Jul 11 03:02:58.448951 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.448924 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4287b506-42a9-4b1d-85e8-91008605fd2c-ovn-node-metrics-cert\") pod \"ovnkube-node-hb24z\" (UID: \"4287b506-42a9-4b1d-85e8-91008605fd2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hb24z" Jul 11 03:02:58.448951 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.448956 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/cd48fb79-15d0-42c4-9db6-cc93fbc68ec4-device-dir\") pod \"aws-ebs-csi-driver-node-rkhst\" (UID: \"cd48fb79-15d0-42c4-9db6-cc93fbc68ec4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rkhst" Jul 11 03:02:58.449480 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.449013 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/baacd8ba-d2a4-4bdf-8a48-6b822f219325-lib-modules\") pod \"tuned-zznc5\" (UID: \"baacd8ba-d2a4-4bdf-8a48-6b822f219325\") " pod="openshift-cluster-node-tuning-operator/tuned-zznc5" Jul 11 03:02:58.449480 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.449102 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4287b506-42a9-4b1d-85e8-91008605fd2c-systemd-units\") pod \"ovnkube-node-hb24z\" (UID: \"4287b506-42a9-4b1d-85e8-91008605fd2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hb24z" Jul 11 03:02:58.449480 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.449136 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4287b506-42a9-4b1d-85e8-91008605fd2c-etc-openvswitch\") pod \"ovnkube-node-hb24z\" (UID: \"4287b506-42a9-4b1d-85e8-91008605fd2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hb24z" Jul 11 03:02:58.449480 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.449162 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4287b506-42a9-4b1d-85e8-91008605fd2c-run-openvswitch\") pod \"ovnkube-node-hb24z\" (UID: \"4287b506-42a9-4b1d-85e8-91008605fd2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hb24z" Jul 11 03:02:58.449480 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.449193 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4287b506-42a9-4b1d-85e8-91008605fd2c-node-log\") pod \"ovnkube-node-hb24z\" (UID: \"4287b506-42a9-4b1d-85e8-91008605fd2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hb24z" Jul 11 03:02:58.449480 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.449276 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4287b506-42a9-4b1d-85e8-91008605fd2c-host-run-ovn-kubernetes\") pod \"ovnkube-node-hb24z\" (UID: \"4287b506-42a9-4b1d-85e8-91008605fd2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hb24z" Jul 11 03:02:58.449480 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.449322 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4287b506-42a9-4b1d-85e8-91008605fd2c-host-cni-netd\") pod \"ovnkube-node-hb24z\" (UID: \"4287b506-42a9-4b1d-85e8-91008605fd2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hb24z" Jul 11 03:02:58.449480 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.449396 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/cd48fb79-15d0-42c4-9db6-cc93fbc68ec4-registration-dir\") pod \"aws-ebs-csi-driver-node-rkhst\" (UID: \"cd48fb79-15d0-42c4-9db6-cc93fbc68ec4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rkhst" Jul 11 03:02:58.449480 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.449444 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/baacd8ba-d2a4-4bdf-8a48-6b822f219325-etc-sysctl-conf\") pod \"tuned-zznc5\" (UID: \"baacd8ba-d2a4-4bdf-8a48-6b822f219325\") " pod="openshift-cluster-node-tuning-operator/tuned-zznc5" Jul 11 03:02:58.450105 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.449482 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4287b506-42a9-4b1d-85e8-91008605fd2c-run-ovn\") pod \"ovnkube-node-hb24z\" (UID: \"4287b506-42a9-4b1d-85e8-91008605fd2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hb24z" Jul 11 03:02:58.450105 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.449548 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4287b506-42a9-4b1d-85e8-91008605fd2c-ovnkube-script-lib\") pod \"ovnkube-node-hb24z\" (UID: \"4287b506-42a9-4b1d-85e8-91008605fd2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hb24z" Jul 11 03:02:58.450105 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.449792 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bscp4\" (UniqueName: \"kubernetes.io/projected/cd48fb79-15d0-42c4-9db6-cc93fbc68ec4-kube-api-access-bscp4\") pod \"aws-ebs-csi-driver-node-rkhst\" (UID: \"cd48fb79-15d0-42c4-9db6-cc93fbc68ec4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rkhst" Jul 11 03:02:58.450105 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.449854 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/baacd8ba-d2a4-4bdf-8a48-6b822f219325-etc-kubernetes\") pod \"tuned-zznc5\" (UID: \"baacd8ba-d2a4-4bdf-8a48-6b822f219325\") " pod="openshift-cluster-node-tuning-operator/tuned-zznc5" Jul 11 03:02:58.450105 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.449894 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bc91021e-ef93-462d-a80d-130775629ff9-tmp-dir\") pod \"node-resolver-t56cx\" (UID: \"bc91021e-ef93-462d-a80d-130775629ff9\") " pod="openshift-dns/node-resolver-t56cx" Jul 11 03:02:58.450105 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.449942 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4287b506-42a9-4b1d-85e8-91008605fd2c-run-systemd\") pod \"ovnkube-node-hb24z\" (UID: \"4287b506-42a9-4b1d-85e8-91008605fd2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hb24z" Jul 11 03:02:58.450105 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.449965 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-gz89q\"" Jul 11 03:02:58.450105 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.449991 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4287b506-42a9-4b1d-85e8-91008605fd2c-ovnkube-config\") pod \"ovnkube-node-hb24z\" (UID: \"4287b506-42a9-4b1d-85e8-91008605fd2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hb24z" Jul 11 03:02:58.450105 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.450020 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 11 03:02:58.450105 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.450054 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ncbvd\" (UniqueName: \"kubernetes.io/projected/4287b506-42a9-4b1d-85e8-91008605fd2c-kube-api-access-ncbvd\") pod \"ovnkube-node-hb24z\" (UID: \"4287b506-42a9-4b1d-85e8-91008605fd2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hb24z" Jul 11 03:02:58.450105 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.450108 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/cd48fb79-15d0-42c4-9db6-cc93fbc68ec4-sys-fs\") pod \"aws-ebs-csi-driver-node-rkhst\" (UID: \"cd48fb79-15d0-42c4-9db6-cc93fbc68ec4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rkhst" Jul 11 03:02:58.450685 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.450134 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/baacd8ba-d2a4-4bdf-8a48-6b822f219325-etc-modprobe-d\") pod \"tuned-zznc5\" (UID: \"baacd8ba-d2a4-4bdf-8a48-6b822f219325\") " pod="openshift-cluster-node-tuning-operator/tuned-zznc5" Jul 11 03:02:58.450685 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.450152 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/baacd8ba-d2a4-4bdf-8a48-6b822f219325-host\") pod \"tuned-zznc5\" (UID: \"baacd8ba-d2a4-4bdf-8a48-6b822f219325\") " pod="openshift-cluster-node-tuning-operator/tuned-zznc5" Jul 11 03:02:58.450685 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.450196 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/baacd8ba-d2a4-4bdf-8a48-6b822f219325-tmp\") pod \"tuned-zznc5\" (UID: \"baacd8ba-d2a4-4bdf-8a48-6b822f219325\") " pod="openshift-cluster-node-tuning-operator/tuned-zznc5" Jul 11 03:02:58.450685 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.450367 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4287b506-42a9-4b1d-85e8-91008605fd2c-host-slash\") pod \"ovnkube-node-hb24z\" (UID: \"4287b506-42a9-4b1d-85e8-91008605fd2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hb24z" Jul 11 03:02:58.450685 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.450415 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4287b506-42a9-4b1d-85e8-91008605fd2c-log-socket\") pod \"ovnkube-node-hb24z\" (UID: \"4287b506-42a9-4b1d-85e8-91008605fd2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hb24z" Jul 11 03:02:58.450685 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.450485 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4287b506-42a9-4b1d-85e8-91008605fd2c-env-overrides\") pod \"ovnkube-node-hb24z\" (UID: \"4287b506-42a9-4b1d-85e8-91008605fd2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hb24z" Jul 11 03:02:58.450685 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.450524 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4287b506-42a9-4b1d-85e8-91008605fd2c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hb24z\" (UID: \"4287b506-42a9-4b1d-85e8-91008605fd2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hb24z" Jul 11 03:02:58.450998 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.450780 2559 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 11 03:02:58.450998 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.450826 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-fkzq2" Jul 11 03:02:58.453498 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.453302 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 11 03:02:58.453498 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.453316 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-r7wtg\"" Jul 11 03:02:58.453621 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.453563 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 11 03:02:58.454250 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.454192 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 11 03:02:58.468707 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.468661 2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-kwf4l" Jul 11 03:02:58.474318 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.474221 2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-kwf4l" Jul 11 03:02:58.532532 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.532502 2559 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 11 03:02:58.543163 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.543128 2559 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 11 03:02:58.551210 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.551172 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4287b506-42a9-4b1d-85e8-91008605fd2c-ovnkube-script-lib\") pod \"ovnkube-node-hb24z\" (UID: \"4287b506-42a9-4b1d-85e8-91008605fd2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hb24z" Jul 11 03:02:58.551380 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.551222 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/baacd8ba-d2a4-4bdf-8a48-6b822f219325-run\") pod \"tuned-zznc5\" (UID: \"baacd8ba-d2a4-4bdf-8a48-6b822f219325\") " pod="openshift-cluster-node-tuning-operator/tuned-zznc5" Jul 11 03:02:58.551380 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.551253 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/baacd8ba-d2a4-4bdf-8a48-6b822f219325-var-lib-kubelet\") pod \"tuned-zznc5\" (UID: \"baacd8ba-d2a4-4bdf-8a48-6b822f219325\") " pod="openshift-cluster-node-tuning-operator/tuned-zznc5" Jul 11 03:02:58.551380 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.551283 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rhsx5\" (UniqueName: \"kubernetes.io/projected/baacd8ba-d2a4-4bdf-8a48-6b822f219325-kube-api-access-rhsx5\") pod \"tuned-zznc5\" (UID: \"baacd8ba-d2a4-4bdf-8a48-6b822f219325\") " pod="openshift-cluster-node-tuning-operator/tuned-zznc5" Jul 11 03:02:58.551380 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.551324 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e1553e4e-4895-4ef5-9027-14635923ec65-metrics-certs\") pod \"network-metrics-daemon-v9zw2\" (UID: \"e1553e4e-4895-4ef5-9027-14635923ec65\") " pod="openshift-multus/network-metrics-daemon-v9zw2" Jul 11 03:02:58.551380 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.551338 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/baacd8ba-d2a4-4bdf-8a48-6b822f219325-run\") pod \"tuned-zznc5\" (UID: \"baacd8ba-d2a4-4bdf-8a48-6b822f219325\") " pod="openshift-cluster-node-tuning-operator/tuned-zznc5" Jul 11 03:02:58.551380 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.551350 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ns2mz\" (UniqueName: \"kubernetes.io/projected/e1553e4e-4895-4ef5-9027-14635923ec65-kube-api-access-ns2mz\") pod \"network-metrics-daemon-v9zw2\" (UID: \"e1553e4e-4895-4ef5-9027-14635923ec65\") " pod="openshift-multus/network-metrics-daemon-v9zw2" Jul 11 03:02:58.551380 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.551381 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b9e9a007-7d90-418e-b327-13b3f2ed817f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-f7sb8\" (UID: \"b9e9a007-7d90-418e-b327-13b3f2ed817f\") " pod="openshift-multus/multus-additional-cni-plugins-f7sb8" Jul 11 03:02:58.551756 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.551406 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4287b506-42a9-4b1d-85e8-91008605fd2c-host-kubelet\") pod \"ovnkube-node-hb24z\" (UID: \"4287b506-42a9-4b1d-85e8-91008605fd2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hb24z" Jul 11 03:02:58.551756 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.551429 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/994a29f5-0a6e-4e78-a413-99d5eb63cad7-system-cni-dir\") pod \"multus-wg5xr\" (UID: \"994a29f5-0a6e-4e78-a413-99d5eb63cad7\") " pod="openshift-multus/multus-wg5xr" Jul 11 03:02:58.551756 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.551456 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/17eb44fc-30b2-4501-9d2c-2294891bc4d8-host-slash\") pod \"iptables-alerter-fkzq2\" (UID: \"17eb44fc-30b2-4501-9d2c-2294891bc4d8\") " pod="openshift-network-operator/iptables-alerter-fkzq2" Jul 11 03:02:58.551756 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.551481 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/baacd8ba-d2a4-4bdf-8a48-6b822f219325-lib-modules\") pod \"tuned-zznc5\" (UID: \"baacd8ba-d2a4-4bdf-8a48-6b822f219325\") " pod="openshift-cluster-node-tuning-operator/tuned-zznc5" Jul 11 03:02:58.551756 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.551504 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4287b506-42a9-4b1d-85e8-91008605fd2c-etc-openvswitch\") pod \"ovnkube-node-hb24z\" (UID: \"4287b506-42a9-4b1d-85e8-91008605fd2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hb24z" Jul 11 03:02:58.551756 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.551528 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kcvkl\" (UniqueName: \"kubernetes.io/projected/b9e9a007-7d90-418e-b327-13b3f2ed817f-kube-api-access-kcvkl\") pod \"multus-additional-cni-plugins-f7sb8\" (UID: \"b9e9a007-7d90-418e-b327-13b3f2ed817f\") " pod="openshift-multus/multus-additional-cni-plugins-f7sb8" Jul 11 03:02:58.551756 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.551554 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/994a29f5-0a6e-4e78-a413-99d5eb63cad7-host-var-lib-kubelet\") pod \"multus-wg5xr\" (UID: \"994a29f5-0a6e-4e78-a413-99d5eb63cad7\") " pod="openshift-multus/multus-wg5xr" Jul 11 03:02:58.551756 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.551582 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/baacd8ba-d2a4-4bdf-8a48-6b822f219325-etc-sysctl-conf\") pod \"tuned-zznc5\" (UID: \"baacd8ba-d2a4-4bdf-8a48-6b822f219325\") " pod="openshift-cluster-node-tuning-operator/tuned-zznc5" Jul 11 03:02:58.551756 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.551604 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/29122b3c-c77b-45e1-97db-b2332bfd92cc-host\") pod \"node-ca-w6296\" (UID: \"29122b3c-c77b-45e1-97db-b2332bfd92cc\") " pod="openshift-image-registry/node-ca-w6296" Jul 11 03:02:58.551756 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.551630 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/baacd8ba-d2a4-4bdf-8a48-6b822f219325-etc-kubernetes\") pod \"tuned-zznc5\" (UID: \"baacd8ba-d2a4-4bdf-8a48-6b822f219325\") " pod="openshift-cluster-node-tuning-operator/tuned-zznc5" Jul 11 03:02:58.551756 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.551656 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bc91021e-ef93-462d-a80d-130775629ff9-tmp-dir\") pod \"node-resolver-t56cx\" (UID: \"bc91021e-ef93-462d-a80d-130775629ff9\") " pod="openshift-dns/node-resolver-t56cx" Jul 11 03:02:58.551756 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.551680 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/baacd8ba-d2a4-4bdf-8a48-6b822f219325-var-lib-kubelet\") pod \"tuned-zznc5\" (UID: \"baacd8ba-d2a4-4bdf-8a48-6b822f219325\") " pod="openshift-cluster-node-tuning-operator/tuned-zznc5" Jul 11 03:02:58.551756 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.551709 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b9e9a007-7d90-418e-b327-13b3f2ed817f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-f7sb8\" (UID: \"b9e9a007-7d90-418e-b327-13b3f2ed817f\") " pod="openshift-multus/multus-additional-cni-plugins-f7sb8" Jul 11 03:02:58.551756 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.551735 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/994a29f5-0a6e-4e78-a413-99d5eb63cad7-multus-cni-dir\") pod \"multus-wg5xr\" (UID: \"994a29f5-0a6e-4e78-a413-99d5eb63cad7\") " pod="openshift-multus/multus-wg5xr" Jul 11 03:02:58.551756 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.551758 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/cd48fb79-15d0-42c4-9db6-cc93fbc68ec4-sys-fs\") pod \"aws-ebs-csi-driver-node-rkhst\" (UID: \"cd48fb79-15d0-42c4-9db6-cc93fbc68ec4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rkhst" Jul 11 03:02:58.552625 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.551779 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/baacd8ba-d2a4-4bdf-8a48-6b822f219325-host\") pod \"tuned-zznc5\" (UID: \"baacd8ba-d2a4-4bdf-8a48-6b822f219325\") " pod="openshift-cluster-node-tuning-operator/tuned-zznc5" Jul 11 03:02:58.552625 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.551797 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4287b506-42a9-4b1d-85e8-91008605fd2c-ovnkube-script-lib\") pod \"ovnkube-node-hb24z\" (UID: \"4287b506-42a9-4b1d-85e8-91008605fd2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hb24z" Jul 11 03:02:58.552625 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.551804 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4287b506-42a9-4b1d-85e8-91008605fd2c-host-slash\") pod \"ovnkube-node-hb24z\" (UID: \"4287b506-42a9-4b1d-85e8-91008605fd2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hb24z" Jul 11 03:02:58.552625 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.551814 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/baacd8ba-d2a4-4bdf-8a48-6b822f219325-lib-modules\") pod \"tuned-zznc5\" (UID: \"baacd8ba-d2a4-4bdf-8a48-6b822f219325\") " pod="openshift-cluster-node-tuning-operator/tuned-zznc5" Jul 11 03:02:58.552625 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.551829 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4287b506-42a9-4b1d-85e8-91008605fd2c-log-socket\") pod \"ovnkube-node-hb24z\" (UID: \"4287b506-42a9-4b1d-85e8-91008605fd2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hb24z" Jul 11 03:02:58.552625 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.551855 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b9e9a007-7d90-418e-b327-13b3f2ed817f-system-cni-dir\") pod \"multus-additional-cni-plugins-f7sb8\" (UID: \"b9e9a007-7d90-418e-b327-13b3f2ed817f\") " pod="openshift-multus/multus-additional-cni-plugins-f7sb8" Jul 11 03:02:58.552625 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.551879 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4287b506-42a9-4b1d-85e8-91008605fd2c-host-kubelet\") pod \"ovnkube-node-hb24z\" (UID: \"4287b506-42a9-4b1d-85e8-91008605fd2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hb24z" Jul 11 03:02:58.552625 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.551880 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e01a98e9-1445-401c-b9c5-8cd0ef77d1e6-agent-certs\") pod \"konnectivity-agent-fvldx\" (UID: \"e01a98e9-1445-401c-b9c5-8cd0ef77d1e6\") " pod="kube-system/konnectivity-agent-fvldx" Jul 11 03:02:58.552625 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.551911 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/994a29f5-0a6e-4e78-a413-99d5eb63cad7-os-release\") pod \"multus-wg5xr\" (UID: \"994a29f5-0a6e-4e78-a413-99d5eb63cad7\") " pod="openshift-multus/multus-wg5xr" Jul 11 03:02:58.552625 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.551934 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/994a29f5-0a6e-4e78-a413-99d5eb63cad7-cni-binary-copy\") pod \"multus-wg5xr\" (UID: \"994a29f5-0a6e-4e78-a413-99d5eb63cad7\") " pod="openshift-multus/multus-wg5xr" Jul 11 03:02:58.552625 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:02:58.551950 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 11 03:02:58.552625 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.551960 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/994a29f5-0a6e-4e78-a413-99d5eb63cad7-host-run-k8s-cni-cncf-io\") pod \"multus-wg5xr\" (UID: \"994a29f5-0a6e-4e78-a413-99d5eb63cad7\") " pod="openshift-multus/multus-wg5xr" Jul 11 03:02:58.552625 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.551985 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/994a29f5-0a6e-4e78-a413-99d5eb63cad7-host-var-lib-cni-bin\") pod \"multus-wg5xr\" (UID: \"994a29f5-0a6e-4e78-a413-99d5eb63cad7\") " pod="openshift-multus/multus-wg5xr" Jul 11 03:02:58.552625 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:02:58.551997 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1553e4e-4895-4ef5-9027-14635923ec65-metrics-certs podName:e1553e4e-4895-4ef5-9027-14635923ec65 nodeName:}" failed. No retries permitted until 2026-07-11 03:02:59.051981742 +0000 UTC m=+3.020594172 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e1553e4e-4895-4ef5-9027-14635923ec65-metrics-certs") pod "network-metrics-daemon-v9zw2" (UID: "e1553e4e-4895-4ef5-9027-14635923ec65") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 11 03:02:58.552625 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.552024 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/994a29f5-0a6e-4e78-a413-99d5eb63cad7-host-var-lib-cni-multus\") pod \"multus-wg5xr\" (UID: \"994a29f5-0a6e-4e78-a413-99d5eb63cad7\") " pod="openshift-multus/multus-wg5xr" Jul 11 03:02:58.552625 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.552140 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/994a29f5-0a6e-4e78-a413-99d5eb63cad7-multus-daemon-config\") pod \"multus-wg5xr\" (UID: \"994a29f5-0a6e-4e78-a413-99d5eb63cad7\") " pod="openshift-multus/multus-wg5xr" Jul 11 03:02:58.552625 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.552187 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4287b506-42a9-4b1d-85e8-91008605fd2c-run-openvswitch\") pod \"ovnkube-node-hb24z\" (UID: \"4287b506-42a9-4b1d-85e8-91008605fd2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hb24z" Jul 11 03:02:58.553521 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.552244 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4287b506-42a9-4b1d-85e8-91008605fd2c-host-run-ovn-kubernetes\") pod \"ovnkube-node-hb24z\" (UID: \"4287b506-42a9-4b1d-85e8-91008605fd2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hb24z" Jul 11 03:02:58.553521 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.552268 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/baacd8ba-d2a4-4bdf-8a48-6b822f219325-etc-sysctl-conf\") pod \"tuned-zznc5\" (UID: \"baacd8ba-d2a4-4bdf-8a48-6b822f219325\") " pod="openshift-cluster-node-tuning-operator/tuned-zznc5" Jul 11 03:02:58.553521 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.552279 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3f82cf26-f769-4fc3-ad0f-b1042b1f63c0-kubelet-config\") pod \"global-pull-secret-syncer-z7wb6\" (UID: \"3f82cf26-f769-4fc3-ad0f-b1042b1f63c0\") " pod="kube-system/global-pull-secret-syncer-z7wb6" Jul 11 03:02:58.553521 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.552301 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4287b506-42a9-4b1d-85e8-91008605fd2c-etc-openvswitch\") pod \"ovnkube-node-hb24z\" (UID: \"4287b506-42a9-4b1d-85e8-91008605fd2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hb24z" Jul 11 03:02:58.553521 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.552327 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3f82cf26-f769-4fc3-ad0f-b1042b1f63c0-original-pull-secret\") pod \"global-pull-secret-syncer-z7wb6\" (UID: \"3f82cf26-f769-4fc3-ad0f-b1042b1f63c0\") " pod="kube-system/global-pull-secret-syncer-z7wb6" Jul 11 03:02:58.553521 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.552335 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4287b506-42a9-4b1d-85e8-91008605fd2c-host-slash\") pod \"ovnkube-node-hb24z\" (UID: \"4287b506-42a9-4b1d-85e8-91008605fd2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hb24z" Jul 11 03:02:58.553521 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.552369 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/baacd8ba-d2a4-4bdf-8a48-6b822f219325-host\") pod \"tuned-zznc5\" (UID: \"baacd8ba-d2a4-4bdf-8a48-6b822f219325\") " pod="openshift-cluster-node-tuning-operator/tuned-zznc5" Jul 11 03:02:58.553521 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.552394 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2q88j\" (UniqueName: \"kubernetes.io/projected/994a29f5-0a6e-4e78-a413-99d5eb63cad7-kube-api-access-2q88j\") pod \"multus-wg5xr\" (UID: \"994a29f5-0a6e-4e78-a413-99d5eb63cad7\") " pod="openshift-multus/multus-wg5xr" Jul 11 03:02:58.553521 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.552400 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bc91021e-ef93-462d-a80d-130775629ff9-tmp-dir\") pod \"node-resolver-t56cx\" (UID: \"bc91021e-ef93-462d-a80d-130775629ff9\") " pod="openshift-dns/node-resolver-t56cx" Jul 11 03:02:58.553521 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:02:58.552416 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 11 03:02:58.553521 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.552455 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4287b506-42a9-4b1d-85e8-91008605fd2c-host-run-ovn-kubernetes\") pod \"ovnkube-node-hb24z\" (UID: \"4287b506-42a9-4b1d-85e8-91008605fd2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hb24z" Jul 11 03:02:58.553521 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.552458 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4287b506-42a9-4b1d-85e8-91008605fd2c-host-run-netns\") pod \"ovnkube-node-hb24z\" (UID: \"4287b506-42a9-4b1d-85e8-91008605fd2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hb24z" Jul 11 03:02:58.553521 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.552477 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/cd48fb79-15d0-42c4-9db6-cc93fbc68ec4-sys-fs\") pod \"aws-ebs-csi-driver-node-rkhst\" (UID: \"cd48fb79-15d0-42c4-9db6-cc93fbc68ec4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rkhst" Jul 11 03:02:58.553521 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.552494 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4287b506-42a9-4b1d-85e8-91008605fd2c-var-lib-openvswitch\") pod \"ovnkube-node-hb24z\" (UID: \"4287b506-42a9-4b1d-85e8-91008605fd2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hb24z" Jul 11 03:02:58.553521 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.552500 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/baacd8ba-d2a4-4bdf-8a48-6b822f219325-etc-kubernetes\") pod \"tuned-zznc5\" (UID: \"baacd8ba-d2a4-4bdf-8a48-6b822f219325\") " pod="openshift-cluster-node-tuning-operator/tuned-zznc5" Jul 11 03:02:58.553521 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.552523 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvcwh\" (UniqueName: \"kubernetes.io/projected/bc91021e-ef93-462d-a80d-130775629ff9-kube-api-access-fvcwh\") pod \"node-resolver-t56cx\" (UID: \"bc91021e-ef93-462d-a80d-130775629ff9\") " pod="openshift-dns/node-resolver-t56cx" Jul 11 03:02:58.553521 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.552531 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4287b506-42a9-4b1d-85e8-91008605fd2c-run-openvswitch\") pod \"ovnkube-node-hb24z\" (UID: \"4287b506-42a9-4b1d-85e8-91008605fd2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hb24z" Jul 11 03:02:58.553521 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.552537 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3f82cf26-f769-4fc3-ad0f-b1042b1f63c0-kubelet-config\") pod \"global-pull-secret-syncer-z7wb6\" (UID: \"3f82cf26-f769-4fc3-ad0f-b1042b1f63c0\") " pod="kube-system/global-pull-secret-syncer-z7wb6" Jul 11 03:02:58.554455 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.552558 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/baacd8ba-d2a4-4bdf-8a48-6b822f219325-etc-sysconfig\") pod \"tuned-zznc5\" (UID: \"baacd8ba-d2a4-4bdf-8a48-6b822f219325\") " pod="openshift-cluster-node-tuning-operator/tuned-zznc5" Jul 11 03:02:58.554455 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:02:58.552583 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f82cf26-f769-4fc3-ad0f-b1042b1f63c0-original-pull-secret podName:3f82cf26-f769-4fc3-ad0f-b1042b1f63c0 nodeName:}" failed. No retries permitted until 2026-07-11 03:02:59.052570629 +0000 UTC m=+3.021183060 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3f82cf26-f769-4fc3-ad0f-b1042b1f63c0-original-pull-secret") pod "global-pull-secret-syncer-z7wb6" (UID: "3f82cf26-f769-4fc3-ad0f-b1042b1f63c0") : object "kube-system"/"original-pull-secret" not registered Jul 11 03:02:58.554455 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.552610 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4287b506-42a9-4b1d-85e8-91008605fd2c-var-lib-openvswitch\") pod \"ovnkube-node-hb24z\" (UID: \"4287b506-42a9-4b1d-85e8-91008605fd2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hb24z" Jul 11 03:02:58.554455 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.552615 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/bc91021e-ef93-462d-a80d-130775629ff9-hosts-file\") pod \"node-resolver-t56cx\" (UID: \"bc91021e-ef93-462d-a80d-130775629ff9\") " pod="openshift-dns/node-resolver-t56cx" Jul 11 03:02:58.554455 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.552637 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4287b506-42a9-4b1d-85e8-91008605fd2c-host-run-netns\") pod \"ovnkube-node-hb24z\" (UID: \"4287b506-42a9-4b1d-85e8-91008605fd2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hb24z" Jul 11 03:02:58.554455 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.552653 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4287b506-42a9-4b1d-85e8-91008605fd2c-log-socket\") pod \"ovnkube-node-hb24z\" (UID: \"4287b506-42a9-4b1d-85e8-91008605fd2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hb24z" Jul 11 03:02:58.554455 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.552665 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9m8f\" (UniqueName: \"kubernetes.io/projected/29122b3c-c77b-45e1-97db-b2332bfd92cc-kube-api-access-h9m8f\") pod \"node-ca-w6296\" (UID: \"29122b3c-c77b-45e1-97db-b2332bfd92cc\") " pod="openshift-image-registry/node-ca-w6296" Jul 11 03:02:58.554455 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.552705 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/bc91021e-ef93-462d-a80d-130775629ff9-hosts-file\") pod \"node-resolver-t56cx\" (UID: \"bc91021e-ef93-462d-a80d-130775629ff9\") " pod="openshift-dns/node-resolver-t56cx" Jul 11 03:02:58.554455 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.552706 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/cd48fb79-15d0-42c4-9db6-cc93fbc68ec4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rkhst\" (UID: \"cd48fb79-15d0-42c4-9db6-cc93fbc68ec4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rkhst" Jul 11 03:02:58.554455 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.552744 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/cd48fb79-15d0-42c4-9db6-cc93fbc68ec4-socket-dir\") pod \"aws-ebs-csi-driver-node-rkhst\" (UID: \"cd48fb79-15d0-42c4-9db6-cc93fbc68ec4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rkhst" Jul 11 03:02:58.554455 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.552753 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/cd48fb79-15d0-42c4-9db6-cc93fbc68ec4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rkhst\" (UID: \"cd48fb79-15d0-42c4-9db6-cc93fbc68ec4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rkhst" Jul 11 03:02:58.554455 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.552761 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/baacd8ba-d2a4-4bdf-8a48-6b822f219325-etc-sysconfig\") pod \"tuned-zznc5\" (UID: \"baacd8ba-d2a4-4bdf-8a48-6b822f219325\") " pod="openshift-cluster-node-tuning-operator/tuned-zznc5" Jul 11 03:02:58.554455 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.552807 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/cd48fb79-15d0-42c4-9db6-cc93fbc68ec4-etc-selinux\") pod \"aws-ebs-csi-driver-node-rkhst\" (UID: \"cd48fb79-15d0-42c4-9db6-cc93fbc68ec4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rkhst" Jul 11 03:02:58.554455 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.552846 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4287b506-42a9-4b1d-85e8-91008605fd2c-host-cni-bin\") pod \"ovnkube-node-hb24z\" (UID: \"4287b506-42a9-4b1d-85e8-91008605fd2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hb24z" Jul 11 03:02:58.554455 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.552877 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/cd48fb79-15d0-42c4-9db6-cc93fbc68ec4-socket-dir\") pod \"aws-ebs-csi-driver-node-rkhst\" (UID: \"cd48fb79-15d0-42c4-9db6-cc93fbc68ec4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rkhst" Jul 11 03:02:58.554455 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.552878 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/cd48fb79-15d0-42c4-9db6-cc93fbc68ec4-etc-selinux\") pod \"aws-ebs-csi-driver-node-rkhst\" (UID: \"cd48fb79-15d0-42c4-9db6-cc93fbc68ec4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rkhst" Jul 11 03:02:58.555288 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.552936 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/17eb44fc-30b2-4501-9d2c-2294891bc4d8-iptables-alerter-script\") pod \"iptables-alerter-fkzq2\" (UID: \"17eb44fc-30b2-4501-9d2c-2294891bc4d8\") " pod="openshift-network-operator/iptables-alerter-fkzq2" Jul 11 03:02:58.555288 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.552992 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/cd48fb79-15d0-42c4-9db6-cc93fbc68ec4-device-dir\") pod \"aws-ebs-csi-driver-node-rkhst\" (UID: \"cd48fb79-15d0-42c4-9db6-cc93fbc68ec4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rkhst" Jul 11 03:02:58.555288 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.553040 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4287b506-42a9-4b1d-85e8-91008605fd2c-systemd-units\") pod \"ovnkube-node-hb24z\" (UID: \"4287b506-42a9-4b1d-85e8-91008605fd2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hb24z" Jul 11 03:02:58.555288 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.553068 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b9e9a007-7d90-418e-b327-13b3f2ed817f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-f7sb8\" (UID: \"b9e9a007-7d90-418e-b327-13b3f2ed817f\") " pod="openshift-multus/multus-additional-cni-plugins-f7sb8" Jul 11 03:02:58.555288 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.553071 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4287b506-42a9-4b1d-85e8-91008605fd2c-host-cni-bin\") pod \"ovnkube-node-hb24z\" (UID: \"4287b506-42a9-4b1d-85e8-91008605fd2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hb24z" Jul 11 03:02:58.555288 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.553100 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cgcrt\" (UniqueName: \"kubernetes.io/projected/17eb44fc-30b2-4501-9d2c-2294891bc4d8-kube-api-access-cgcrt\") pod \"iptables-alerter-fkzq2\" (UID: \"17eb44fc-30b2-4501-9d2c-2294891bc4d8\") " pod="openshift-network-operator/iptables-alerter-fkzq2" Jul 11 03:02:58.555288 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.553184 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/cd48fb79-15d0-42c4-9db6-cc93fbc68ec4-device-dir\") pod \"aws-ebs-csi-driver-node-rkhst\" (UID: \"cd48fb79-15d0-42c4-9db6-cc93fbc68ec4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rkhst" Jul 11 03:02:58.555288 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.553219 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/cd48fb79-15d0-42c4-9db6-cc93fbc68ec4-registration-dir\") pod \"aws-ebs-csi-driver-node-rkhst\" (UID: \"cd48fb79-15d0-42c4-9db6-cc93fbc68ec4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rkhst" Jul 11 03:02:58.555288 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.553246 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4287b506-42a9-4b1d-85e8-91008605fd2c-run-ovn\") pod \"ovnkube-node-hb24z\" (UID: \"4287b506-42a9-4b1d-85e8-91008605fd2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hb24z" Jul 11 03:02:58.555288 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.553273 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b9e9a007-7d90-418e-b327-13b3f2ed817f-cnibin\") pod \"multus-additional-cni-plugins-f7sb8\" (UID: \"b9e9a007-7d90-418e-b327-13b3f2ed817f\") " pod="openshift-multus/multus-additional-cni-plugins-f7sb8" Jul 11 03:02:58.555288 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.553301 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b9e9a007-7d90-418e-b327-13b3f2ed817f-os-release\") pod \"multus-additional-cni-plugins-f7sb8\" (UID: \"b9e9a007-7d90-418e-b327-13b3f2ed817f\") " pod="openshift-multus/multus-additional-cni-plugins-f7sb8" Jul 11 03:02:58.555288 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.553328 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b9e9a007-7d90-418e-b327-13b3f2ed817f-cni-binary-copy\") pod \"multus-additional-cni-plugins-f7sb8\" (UID: \"b9e9a007-7d90-418e-b327-13b3f2ed817f\") " pod="openshift-multus/multus-additional-cni-plugins-f7sb8" Jul 11 03:02:58.555288 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.553391 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-slk7g\" (UniqueName: \"kubernetes.io/projected/56f1263c-c5a9-491e-af1e-32394171afec-kube-api-access-slk7g\") pod \"network-check-target-t96p7\" (UID: \"56f1263c-c5a9-491e-af1e-32394171afec\") " pod="openshift-network-diagnostics/network-check-target-t96p7" Jul 11 03:02:58.555288 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.553420 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/994a29f5-0a6e-4e78-a413-99d5eb63cad7-etc-kubernetes\") pod \"multus-wg5xr\" (UID: \"994a29f5-0a6e-4e78-a413-99d5eb63cad7\") " pod="openshift-multus/multus-wg5xr" Jul 11 03:02:58.555288 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.553427 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4287b506-42a9-4b1d-85e8-91008605fd2c-systemd-units\") pod \"ovnkube-node-hb24z\" (UID: \"4287b506-42a9-4b1d-85e8-91008605fd2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hb24z" Jul 11 03:02:58.555288 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.553453 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bscp4\" (UniqueName: \"kubernetes.io/projected/cd48fb79-15d0-42c4-9db6-cc93fbc68ec4-kube-api-access-bscp4\") pod \"aws-ebs-csi-driver-node-rkhst\" (UID: \"cd48fb79-15d0-42c4-9db6-cc93fbc68ec4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rkhst" Jul 11 03:02:58.555994 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.553490 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/cd48fb79-15d0-42c4-9db6-cc93fbc68ec4-registration-dir\") pod \"aws-ebs-csi-driver-node-rkhst\" (UID: \"cd48fb79-15d0-42c4-9db6-cc93fbc68ec4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rkhst" Jul 11 03:02:58.555994 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.553528 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4287b506-42a9-4b1d-85e8-91008605fd2c-run-systemd\") pod \"ovnkube-node-hb24z\" (UID: \"4287b506-42a9-4b1d-85e8-91008605fd2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hb24z" Jul 11 03:02:58.555994 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.553556 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4287b506-42a9-4b1d-85e8-91008605fd2c-ovnkube-config\") pod \"ovnkube-node-hb24z\" (UID: \"4287b506-42a9-4b1d-85e8-91008605fd2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hb24z" Jul 11 03:02:58.555994 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.553584 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ncbvd\" (UniqueName: \"kubernetes.io/projected/4287b506-42a9-4b1d-85e8-91008605fd2c-kube-api-access-ncbvd\") pod \"ovnkube-node-hb24z\" (UID: \"4287b506-42a9-4b1d-85e8-91008605fd2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hb24z" Jul 11 03:02:58.555994 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.553613 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e01a98e9-1445-401c-b9c5-8cd0ef77d1e6-konnectivity-ca\") pod \"konnectivity-agent-fvldx\" (UID: \"e01a98e9-1445-401c-b9c5-8cd0ef77d1e6\") " pod="kube-system/konnectivity-agent-fvldx" Jul 11 03:02:58.555994 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.553676 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/29122b3c-c77b-45e1-97db-b2332bfd92cc-serviceca\") pod \"node-ca-w6296\" (UID: \"29122b3c-c77b-45e1-97db-b2332bfd92cc\") " pod="openshift-image-registry/node-ca-w6296" Jul 11 03:02:58.555994 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.553706 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/994a29f5-0a6e-4e78-a413-99d5eb63cad7-multus-conf-dir\") pod \"multus-wg5xr\" (UID: \"994a29f5-0a6e-4e78-a413-99d5eb63cad7\") " pod="openshift-multus/multus-wg5xr" Jul 11 03:02:58.555994 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.553713 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4287b506-42a9-4b1d-85e8-91008605fd2c-run-systemd\") pod \"ovnkube-node-hb24z\" (UID: \"4287b506-42a9-4b1d-85e8-91008605fd2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hb24z" Jul 11 03:02:58.555994 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.553749 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/baacd8ba-d2a4-4bdf-8a48-6b822f219325-etc-modprobe-d\") pod \"tuned-zznc5\" (UID: \"baacd8ba-d2a4-4bdf-8a48-6b822f219325\") " pod="openshift-cluster-node-tuning-operator/tuned-zznc5" Jul 11 03:02:58.555994 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.553805 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/baacd8ba-d2a4-4bdf-8a48-6b822f219325-tmp\") pod \"tuned-zznc5\" (UID: \"baacd8ba-d2a4-4bdf-8a48-6b822f219325\") " pod="openshift-cluster-node-tuning-operator/tuned-zznc5" Jul 11 03:02:58.555994 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.553866 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4287b506-42a9-4b1d-85e8-91008605fd2c-env-overrides\") pod \"ovnkube-node-hb24z\" (UID: \"4287b506-42a9-4b1d-85e8-91008605fd2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hb24z" Jul 11 03:02:58.555994 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.553897 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/994a29f5-0a6e-4e78-a413-99d5eb63cad7-cnibin\") pod \"multus-wg5xr\" (UID: \"994a29f5-0a6e-4e78-a413-99d5eb63cad7\") " pod="openshift-multus/multus-wg5xr" Jul 11 03:02:58.555994 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.553927 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/994a29f5-0a6e-4e78-a413-99d5eb63cad7-host-run-netns\") pod \"multus-wg5xr\" (UID: \"994a29f5-0a6e-4e78-a413-99d5eb63cad7\") " pod="openshift-multus/multus-wg5xr" Jul 11 03:02:58.555994 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.553955 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/994a29f5-0a6e-4e78-a413-99d5eb63cad7-hostroot\") pod \"multus-wg5xr\" (UID: \"994a29f5-0a6e-4e78-a413-99d5eb63cad7\") " pod="openshift-multus/multus-wg5xr" Jul 11 03:02:58.555994 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.553984 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4287b506-42a9-4b1d-85e8-91008605fd2c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hb24z\" (UID: \"4287b506-42a9-4b1d-85e8-91008605fd2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hb24z" Jul 11 03:02:58.555994 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.554014 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/994a29f5-0a6e-4e78-a413-99d5eb63cad7-host-run-multus-certs\") pod \"multus-wg5xr\" (UID: \"994a29f5-0a6e-4e78-a413-99d5eb63cad7\") " pod="openshift-multus/multus-wg5xr" Jul 11 03:02:58.555994 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.554094 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4287b506-42a9-4b1d-85e8-91008605fd2c-node-log\") pod \"ovnkube-node-hb24z\" (UID: \"4287b506-42a9-4b1d-85e8-91008605fd2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hb24z" Jul 11 03:02:58.556949 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.554123 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4287b506-42a9-4b1d-85e8-91008605fd2c-host-cni-netd\") pod \"ovnkube-node-hb24z\" (UID: \"4287b506-42a9-4b1d-85e8-91008605fd2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hb24z" Jul 11 03:02:58.556949 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.554154 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/baacd8ba-d2a4-4bdf-8a48-6b822f219325-etc-sysctl-d\") pod \"tuned-zznc5\" (UID: \"baacd8ba-d2a4-4bdf-8a48-6b822f219325\") " pod="openshift-cluster-node-tuning-operator/tuned-zznc5" Jul 11 03:02:58.556949 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.554180 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/baacd8ba-d2a4-4bdf-8a48-6b822f219325-etc-systemd\") pod \"tuned-zznc5\" (UID: \"baacd8ba-d2a4-4bdf-8a48-6b822f219325\") " pod="openshift-cluster-node-tuning-operator/tuned-zznc5" Jul 11 03:02:58.556949 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.554207 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/baacd8ba-d2a4-4bdf-8a48-6b822f219325-sys\") pod \"tuned-zznc5\" (UID: \"baacd8ba-d2a4-4bdf-8a48-6b822f219325\") " pod="openshift-cluster-node-tuning-operator/tuned-zznc5" Jul 11 03:02:58.556949 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.554232 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/baacd8ba-d2a4-4bdf-8a48-6b822f219325-etc-tuned\") pod \"tuned-zznc5\" (UID: \"baacd8ba-d2a4-4bdf-8a48-6b822f219325\") " pod="openshift-cluster-node-tuning-operator/tuned-zznc5" Jul 11 03:02:58.556949 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.554233 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4287b506-42a9-4b1d-85e8-91008605fd2c-ovnkube-config\") pod \"ovnkube-node-hb24z\" (UID: \"4287b506-42a9-4b1d-85e8-91008605fd2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hb24z" Jul 11 03:02:58.556949 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.554293 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3f82cf26-f769-4fc3-ad0f-b1042b1f63c0-dbus\") pod \"global-pull-secret-syncer-z7wb6\" (UID: \"3f82cf26-f769-4fc3-ad0f-b1042b1f63c0\") " pod="kube-system/global-pull-secret-syncer-z7wb6" Jul 11 03:02:58.556949 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.554323 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/994a29f5-0a6e-4e78-a413-99d5eb63cad7-multus-socket-dir-parent\") pod \"multus-wg5xr\" (UID: \"994a29f5-0a6e-4e78-a413-99d5eb63cad7\") " pod="openshift-multus/multus-wg5xr" Jul 11 03:02:58.556949 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.554354 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4287b506-42a9-4b1d-85e8-91008605fd2c-ovn-node-metrics-cert\") pod \"ovnkube-node-hb24z\" (UID: \"4287b506-42a9-4b1d-85e8-91008605fd2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hb24z" Jul 11 03:02:58.556949 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.554357 2559 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 11 03:02:58.556949 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.554480 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/baacd8ba-d2a4-4bdf-8a48-6b822f219325-etc-modprobe-d\") pod \"tuned-zznc5\" (UID: \"baacd8ba-d2a4-4bdf-8a48-6b822f219325\") " pod="openshift-cluster-node-tuning-operator/tuned-zznc5" Jul 11 03:02:58.556949 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.554545 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4287b506-42a9-4b1d-85e8-91008605fd2c-run-ovn\") pod \"ovnkube-node-hb24z\" (UID: \"4287b506-42a9-4b1d-85e8-91008605fd2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hb24z" Jul 11 03:02:58.556949 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.554634 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4287b506-42a9-4b1d-85e8-91008605fd2c-env-overrides\") pod \"ovnkube-node-hb24z\" (UID: \"4287b506-42a9-4b1d-85e8-91008605fd2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hb24z" Jul 11 03:02:58.556949 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.554708 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/baacd8ba-d2a4-4bdf-8a48-6b822f219325-etc-systemd\") pod \"tuned-zznc5\" (UID: \"baacd8ba-d2a4-4bdf-8a48-6b822f219325\") " pod="openshift-cluster-node-tuning-operator/tuned-zznc5" Jul 11 03:02:58.556949 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.554719 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4287b506-42a9-4b1d-85e8-91008605fd2c-node-log\") pod \"ovnkube-node-hb24z\" (UID: \"4287b506-42a9-4b1d-85e8-91008605fd2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hb24z" Jul 11 03:02:58.556949 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.554752 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4287b506-42a9-4b1d-85e8-91008605fd2c-host-cni-netd\") pod \"ovnkube-node-hb24z\" (UID: \"4287b506-42a9-4b1d-85e8-91008605fd2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hb24z" Jul 11 03:02:58.556949 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.554885 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/baacd8ba-d2a4-4bdf-8a48-6b822f219325-etc-sysctl-d\") pod \"tuned-zznc5\" (UID: \"baacd8ba-d2a4-4bdf-8a48-6b822f219325\") " pod="openshift-cluster-node-tuning-operator/tuned-zznc5" Jul 11 03:02:58.556949 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.554937 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/baacd8ba-d2a4-4bdf-8a48-6b822f219325-sys\") pod \"tuned-zznc5\" (UID: \"baacd8ba-d2a4-4bdf-8a48-6b822f219325\") " pod="openshift-cluster-node-tuning-operator/tuned-zznc5" Jul 11 03:02:58.558122 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.555498 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4287b506-42a9-4b1d-85e8-91008605fd2c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hb24z\" (UID: \"4287b506-42a9-4b1d-85e8-91008605fd2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hb24z" Jul 11 03:02:58.558122 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.556078 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3f82cf26-f769-4fc3-ad0f-b1042b1f63c0-dbus\") pod \"global-pull-secret-syncer-z7wb6\" (UID: \"3f82cf26-f769-4fc3-ad0f-b1042b1f63c0\") " pod="kube-system/global-pull-secret-syncer-z7wb6" Jul 11 03:02:58.559118 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.559071 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/baacd8ba-d2a4-4bdf-8a48-6b822f219325-etc-tuned\") pod \"tuned-zznc5\" (UID: \"baacd8ba-d2a4-4bdf-8a48-6b822f219325\") " pod="openshift-cluster-node-tuning-operator/tuned-zznc5" Jul 11 03:02:58.559287 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.559267 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4287b506-42a9-4b1d-85e8-91008605fd2c-ovn-node-metrics-cert\") pod \"ovnkube-node-hb24z\" (UID: \"4287b506-42a9-4b1d-85e8-91008605fd2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hb24z" Jul 11 03:02:58.560809 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.560782 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/baacd8ba-d2a4-4bdf-8a48-6b822f219325-tmp\") pod \"tuned-zznc5\" (UID: \"baacd8ba-d2a4-4bdf-8a48-6b822f219325\") " pod="openshift-cluster-node-tuning-operator/tuned-zznc5" Jul 11 03:02:58.561959 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.561895 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rhsx5\" (UniqueName: \"kubernetes.io/projected/baacd8ba-d2a4-4bdf-8a48-6b822f219325-kube-api-access-rhsx5\") pod \"tuned-zznc5\" (UID: \"baacd8ba-d2a4-4bdf-8a48-6b822f219325\") " pod="openshift-cluster-node-tuning-operator/tuned-zznc5" Jul 11 03:02:58.562330 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.562308 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ns2mz\" (UniqueName: \"kubernetes.io/projected/e1553e4e-4895-4ef5-9027-14635923ec65-kube-api-access-ns2mz\") pod \"network-metrics-daemon-v9zw2\" (UID: \"e1553e4e-4895-4ef5-9027-14635923ec65\") " pod="openshift-multus/network-metrics-daemon-v9zw2" Jul 11 03:02:58.562405 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.562353 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bscp4\" (UniqueName: \"kubernetes.io/projected/cd48fb79-15d0-42c4-9db6-cc93fbc68ec4-kube-api-access-bscp4\") pod \"aws-ebs-csi-driver-node-rkhst\" (UID: \"cd48fb79-15d0-42c4-9db6-cc93fbc68ec4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rkhst" Jul 11 03:02:58.562405 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.562383 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvcwh\" (UniqueName: \"kubernetes.io/projected/bc91021e-ef93-462d-a80d-130775629ff9-kube-api-access-fvcwh\") pod \"node-resolver-t56cx\" (UID: \"bc91021e-ef93-462d-a80d-130775629ff9\") " pod="openshift-dns/node-resolver-t56cx" Jul 11 03:02:58.562949 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.562931 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ncbvd\" (UniqueName: \"kubernetes.io/projected/4287b506-42a9-4b1d-85e8-91008605fd2c-kube-api-access-ncbvd\") pod \"ovnkube-node-hb24z\" (UID: \"4287b506-42a9-4b1d-85e8-91008605fd2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hb24z" Jul 11 03:02:58.617480 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.617418 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-141.ec2.internal" event={"ID":"7832d055872458363fd84090a1330a4f","Type":"ContainerStarted","Data":"826f665d605f14db3faf968157bac05ab20596ca37215d84c8ac8c92ea1ad456"} Jul 11 03:02:58.618711 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.618671 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-141.ec2.internal" event={"ID":"f78a7cbe224856398af387ef37689630","Type":"ContainerStarted","Data":"4f64a15eceb795b2765e389419687d10764a2b8a2f9cc6068b2237e73fae8b3d"} Jul 11 03:02:58.655267 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.655219 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9m8f\" (UniqueName: \"kubernetes.io/projected/29122b3c-c77b-45e1-97db-b2332bfd92cc-kube-api-access-h9m8f\") pod \"node-ca-w6296\" (UID: \"29122b3c-c77b-45e1-97db-b2332bfd92cc\") " pod="openshift-image-registry/node-ca-w6296" Jul 11 03:02:58.655469 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.655278 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/17eb44fc-30b2-4501-9d2c-2294891bc4d8-iptables-alerter-script\") pod \"iptables-alerter-fkzq2\" (UID: \"17eb44fc-30b2-4501-9d2c-2294891bc4d8\") " pod="openshift-network-operator/iptables-alerter-fkzq2" Jul 11 03:02:58.655469 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.655314 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b9e9a007-7d90-418e-b327-13b3f2ed817f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-f7sb8\" (UID: \"b9e9a007-7d90-418e-b327-13b3f2ed817f\") " pod="openshift-multus/multus-additional-cni-plugins-f7sb8" Jul 11 03:02:58.655469 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.655338 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cgcrt\" (UniqueName: \"kubernetes.io/projected/17eb44fc-30b2-4501-9d2c-2294891bc4d8-kube-api-access-cgcrt\") pod \"iptables-alerter-fkzq2\" (UID: \"17eb44fc-30b2-4501-9d2c-2294891bc4d8\") " pod="openshift-network-operator/iptables-alerter-fkzq2" Jul 11 03:02:58.655469 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.655364 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b9e9a007-7d90-418e-b327-13b3f2ed817f-cnibin\") pod \"multus-additional-cni-plugins-f7sb8\" (UID: \"b9e9a007-7d90-418e-b327-13b3f2ed817f\") " pod="openshift-multus/multus-additional-cni-plugins-f7sb8" Jul 11 03:02:58.655469 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.655387 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b9e9a007-7d90-418e-b327-13b3f2ed817f-os-release\") pod \"multus-additional-cni-plugins-f7sb8\" (UID: \"b9e9a007-7d90-418e-b327-13b3f2ed817f\") " pod="openshift-multus/multus-additional-cni-plugins-f7sb8" Jul 11 03:02:58.655469 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.655410 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b9e9a007-7d90-418e-b327-13b3f2ed817f-cni-binary-copy\") pod \"multus-additional-cni-plugins-f7sb8\" (UID: \"b9e9a007-7d90-418e-b327-13b3f2ed817f\") " pod="openshift-multus/multus-additional-cni-plugins-f7sb8" Jul 11 03:02:58.655469 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.655437 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-slk7g\" (UniqueName: \"kubernetes.io/projected/56f1263c-c5a9-491e-af1e-32394171afec-kube-api-access-slk7g\") pod \"network-check-target-t96p7\" (UID: \"56f1263c-c5a9-491e-af1e-32394171afec\") " pod="openshift-network-diagnostics/network-check-target-t96p7" Jul 11 03:02:58.655469 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.655468 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/994a29f5-0a6e-4e78-a413-99d5eb63cad7-etc-kubernetes\") pod \"multus-wg5xr\" (UID: \"994a29f5-0a6e-4e78-a413-99d5eb63cad7\") " pod="openshift-multus/multus-wg5xr" Jul 11 03:02:58.655795 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.655498 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e01a98e9-1445-401c-b9c5-8cd0ef77d1e6-konnectivity-ca\") pod \"konnectivity-agent-fvldx\" (UID: \"e01a98e9-1445-401c-b9c5-8cd0ef77d1e6\") " pod="kube-system/konnectivity-agent-fvldx" Jul 11 03:02:58.655795 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.655521 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/29122b3c-c77b-45e1-97db-b2332bfd92cc-serviceca\") pod \"node-ca-w6296\" (UID: \"29122b3c-c77b-45e1-97db-b2332bfd92cc\") " pod="openshift-image-registry/node-ca-w6296" Jul 11 03:02:58.655795 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.655550 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/994a29f5-0a6e-4e78-a413-99d5eb63cad7-multus-conf-dir\") pod \"multus-wg5xr\" (UID: \"994a29f5-0a6e-4e78-a413-99d5eb63cad7\") " pod="openshift-multus/multus-wg5xr" Jul 11 03:02:58.655795 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.655578 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/994a29f5-0a6e-4e78-a413-99d5eb63cad7-cnibin\") pod \"multus-wg5xr\" (UID: \"994a29f5-0a6e-4e78-a413-99d5eb63cad7\") " pod="openshift-multus/multus-wg5xr" Jul 11 03:02:58.655795 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.655602 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/994a29f5-0a6e-4e78-a413-99d5eb63cad7-host-run-netns\") pod \"multus-wg5xr\" (UID: \"994a29f5-0a6e-4e78-a413-99d5eb63cad7\") " pod="openshift-multus/multus-wg5xr" Jul 11 03:02:58.655795 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.655625 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/994a29f5-0a6e-4e78-a413-99d5eb63cad7-hostroot\") pod \"multus-wg5xr\" (UID: \"994a29f5-0a6e-4e78-a413-99d5eb63cad7\") " pod="openshift-multus/multus-wg5xr" Jul 11 03:02:58.655795 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.655650 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/994a29f5-0a6e-4e78-a413-99d5eb63cad7-host-run-multus-certs\") pod \"multus-wg5xr\" (UID: \"994a29f5-0a6e-4e78-a413-99d5eb63cad7\") " pod="openshift-multus/multus-wg5xr" Jul 11 03:02:58.655795 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.655678 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/994a29f5-0a6e-4e78-a413-99d5eb63cad7-multus-socket-dir-parent\") pod \"multus-wg5xr\" (UID: \"994a29f5-0a6e-4e78-a413-99d5eb63cad7\") " pod="openshift-multus/multus-wg5xr" Jul 11 03:02:58.655795 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.655719 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b9e9a007-7d90-418e-b327-13b3f2ed817f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-f7sb8\" (UID: \"b9e9a007-7d90-418e-b327-13b3f2ed817f\") " pod="openshift-multus/multus-additional-cni-plugins-f7sb8" Jul 11 03:02:58.655795 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.655746 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/994a29f5-0a6e-4e78-a413-99d5eb63cad7-system-cni-dir\") pod \"multus-wg5xr\" (UID: \"994a29f5-0a6e-4e78-a413-99d5eb63cad7\") " pod="openshift-multus/multus-wg5xr" Jul 11 03:02:58.655795 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.655766 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/17eb44fc-30b2-4501-9d2c-2294891bc4d8-host-slash\") pod \"iptables-alerter-fkzq2\" (UID: \"17eb44fc-30b2-4501-9d2c-2294891bc4d8\") " pod="openshift-network-operator/iptables-alerter-fkzq2" Jul 11 03:02:58.655795 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.655784 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kcvkl\" (UniqueName: \"kubernetes.io/projected/b9e9a007-7d90-418e-b327-13b3f2ed817f-kube-api-access-kcvkl\") pod \"multus-additional-cni-plugins-f7sb8\" (UID: \"b9e9a007-7d90-418e-b327-13b3f2ed817f\") " pod="openshift-multus/multus-additional-cni-plugins-f7sb8" Jul 11 03:02:58.656354 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.655800 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/994a29f5-0a6e-4e78-a413-99d5eb63cad7-host-var-lib-kubelet\") pod \"multus-wg5xr\" (UID: \"994a29f5-0a6e-4e78-a413-99d5eb63cad7\") " pod="openshift-multus/multus-wg5xr" Jul 11 03:02:58.656354 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.655836 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/29122b3c-c77b-45e1-97db-b2332bfd92cc-host\") pod \"node-ca-w6296\" (UID: \"29122b3c-c77b-45e1-97db-b2332bfd92cc\") " pod="openshift-image-registry/node-ca-w6296" Jul 11 03:02:58.656354 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.655854 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b9e9a007-7d90-418e-b327-13b3f2ed817f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-f7sb8\" (UID: \"b9e9a007-7d90-418e-b327-13b3f2ed817f\") " pod="openshift-multus/multus-additional-cni-plugins-f7sb8" Jul 11 03:02:58.656354 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.655870 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/994a29f5-0a6e-4e78-a413-99d5eb63cad7-multus-cni-dir\") pod \"multus-wg5xr\" (UID: \"994a29f5-0a6e-4e78-a413-99d5eb63cad7\") " pod="openshift-multus/multus-wg5xr" Jul 11 03:02:58.656354 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.655899 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b9e9a007-7d90-418e-b327-13b3f2ed817f-system-cni-dir\") pod \"multus-additional-cni-plugins-f7sb8\" (UID: \"b9e9a007-7d90-418e-b327-13b3f2ed817f\") " pod="openshift-multus/multus-additional-cni-plugins-f7sb8" Jul 11 03:02:58.656354 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.655927 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e01a98e9-1445-401c-b9c5-8cd0ef77d1e6-agent-certs\") pod \"konnectivity-agent-fvldx\" (UID: \"e01a98e9-1445-401c-b9c5-8cd0ef77d1e6\") " pod="kube-system/konnectivity-agent-fvldx" Jul 11 03:02:58.656354 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.655945 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/994a29f5-0a6e-4e78-a413-99d5eb63cad7-os-release\") pod \"multus-wg5xr\" (UID: \"994a29f5-0a6e-4e78-a413-99d5eb63cad7\") " pod="openshift-multus/multus-wg5xr" Jul 11 03:02:58.656354 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.655971 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/994a29f5-0a6e-4e78-a413-99d5eb63cad7-cni-binary-copy\") pod \"multus-wg5xr\" (UID: \"994a29f5-0a6e-4e78-a413-99d5eb63cad7\") " pod="openshift-multus/multus-wg5xr" Jul 11 03:02:58.656354 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.655999 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/994a29f5-0a6e-4e78-a413-99d5eb63cad7-host-run-k8s-cni-cncf-io\") pod \"multus-wg5xr\" (UID: \"994a29f5-0a6e-4e78-a413-99d5eb63cad7\") " pod="openshift-multus/multus-wg5xr" Jul 11 03:02:58.656354 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.656025 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/994a29f5-0a6e-4e78-a413-99d5eb63cad7-host-var-lib-cni-bin\") pod \"multus-wg5xr\" (UID: \"994a29f5-0a6e-4e78-a413-99d5eb63cad7\") " pod="openshift-multus/multus-wg5xr" Jul 11 03:02:58.656354 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.656062 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/994a29f5-0a6e-4e78-a413-99d5eb63cad7-host-var-lib-cni-multus\") pod \"multus-wg5xr\" (UID: \"994a29f5-0a6e-4e78-a413-99d5eb63cad7\") " pod="openshift-multus/multus-wg5xr" Jul 11 03:02:58.656354 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.656080 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/994a29f5-0a6e-4e78-a413-99d5eb63cad7-multus-daemon-config\") pod \"multus-wg5xr\" (UID: \"994a29f5-0a6e-4e78-a413-99d5eb63cad7\") " pod="openshift-multus/multus-wg5xr" Jul 11 03:02:58.656354 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.656116 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2q88j\" (UniqueName: \"kubernetes.io/projected/994a29f5-0a6e-4e78-a413-99d5eb63cad7-kube-api-access-2q88j\") pod \"multus-wg5xr\" (UID: \"994a29f5-0a6e-4e78-a413-99d5eb63cad7\") " pod="openshift-multus/multus-wg5xr" Jul 11 03:02:58.657181 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.657158 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/17eb44fc-30b2-4501-9d2c-2294891bc4d8-iptables-alerter-script\") pod \"iptables-alerter-fkzq2\" (UID: \"17eb44fc-30b2-4501-9d2c-2294891bc4d8\") " pod="openshift-network-operator/iptables-alerter-fkzq2" Jul 11 03:02:58.657343 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.657326 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b9e9a007-7d90-418e-b327-13b3f2ed817f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-f7sb8\" (UID: \"b9e9a007-7d90-418e-b327-13b3f2ed817f\") " pod="openshift-multus/multus-additional-cni-plugins-f7sb8" Jul 11 03:02:58.657601 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.657564 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b9e9a007-7d90-418e-b327-13b3f2ed817f-cnibin\") pod \"multus-additional-cni-plugins-f7sb8\" (UID: \"b9e9a007-7d90-418e-b327-13b3f2ed817f\") " pod="openshift-multus/multus-additional-cni-plugins-f7sb8" Jul 11 03:02:58.657725 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.657642 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b9e9a007-7d90-418e-b327-13b3f2ed817f-os-release\") pod \"multus-additional-cni-plugins-f7sb8\" (UID: \"b9e9a007-7d90-418e-b327-13b3f2ed817f\") " pod="openshift-multus/multus-additional-cni-plugins-f7sb8" Jul 11 03:02:58.658092 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.658062 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/17eb44fc-30b2-4501-9d2c-2294891bc4d8-host-slash\") pod \"iptables-alerter-fkzq2\" (UID: \"17eb44fc-30b2-4501-9d2c-2294891bc4d8\") " pod="openshift-network-operator/iptables-alerter-fkzq2" Jul 11 03:02:58.658215 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.658192 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b9e9a007-7d90-418e-b327-13b3f2ed817f-cni-binary-copy\") pod \"multus-additional-cni-plugins-f7sb8\" (UID: \"b9e9a007-7d90-418e-b327-13b3f2ed817f\") " pod="openshift-multus/multus-additional-cni-plugins-f7sb8" Jul 11 03:02:58.658349 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.658324 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/994a29f5-0a6e-4e78-a413-99d5eb63cad7-etc-kubernetes\") pod \"multus-wg5xr\" (UID: \"994a29f5-0a6e-4e78-a413-99d5eb63cad7\") " pod="openshift-multus/multus-wg5xr" Jul 11 03:02:58.658468 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.658406 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/994a29f5-0a6e-4e78-a413-99d5eb63cad7-host-var-lib-kubelet\") pod \"multus-wg5xr\" (UID: \"994a29f5-0a6e-4e78-a413-99d5eb63cad7\") " pod="openshift-multus/multus-wg5xr" Jul 11 03:02:58.658468 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.658454 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/29122b3c-c77b-45e1-97db-b2332bfd92cc-host\") pod \"node-ca-w6296\" (UID: \"29122b3c-c77b-45e1-97db-b2332bfd92cc\") " pod="openshift-image-registry/node-ca-w6296" Jul 11 03:02:58.658939 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.658909 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e01a98e9-1445-401c-b9c5-8cd0ef77d1e6-konnectivity-ca\") pod \"konnectivity-agent-fvldx\" (UID: \"e01a98e9-1445-401c-b9c5-8cd0ef77d1e6\") " pod="kube-system/konnectivity-agent-fvldx" Jul 11 03:02:58.659064 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.658909 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b9e9a007-7d90-418e-b327-13b3f2ed817f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-f7sb8\" (UID: \"b9e9a007-7d90-418e-b327-13b3f2ed817f\") " pod="openshift-multus/multus-additional-cni-plugins-f7sb8" Jul 11 03:02:58.659064 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.658985 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/994a29f5-0a6e-4e78-a413-99d5eb63cad7-multus-cni-dir\") pod \"multus-wg5xr\" (UID: \"994a29f5-0a6e-4e78-a413-99d5eb63cad7\") " pod="openshift-multus/multus-wg5xr" Jul 11 03:02:58.659064 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.659054 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/994a29f5-0a6e-4e78-a413-99d5eb63cad7-host-run-k8s-cni-cncf-io\") pod \"multus-wg5xr\" (UID: \"994a29f5-0a6e-4e78-a413-99d5eb63cad7\") " pod="openshift-multus/multus-wg5xr" Jul 11 03:02:58.659217 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.659097 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/994a29f5-0a6e-4e78-a413-99d5eb63cad7-host-var-lib-cni-bin\") pod \"multus-wg5xr\" (UID: \"994a29f5-0a6e-4e78-a413-99d5eb63cad7\") " pod="openshift-multus/multus-wg5xr" Jul 11 03:02:58.659217 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.659115 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/994a29f5-0a6e-4e78-a413-99d5eb63cad7-os-release\") pod \"multus-wg5xr\" (UID: \"994a29f5-0a6e-4e78-a413-99d5eb63cad7\") " pod="openshift-multus/multus-wg5xr" Jul 11 03:02:58.659217 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.659143 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/994a29f5-0a6e-4e78-a413-99d5eb63cad7-host-var-lib-cni-multus\") pod \"multus-wg5xr\" (UID: \"994a29f5-0a6e-4e78-a413-99d5eb63cad7\") " pod="openshift-multus/multus-wg5xr" Jul 11 03:02:58.659217 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.659111 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b9e9a007-7d90-418e-b327-13b3f2ed817f-system-cni-dir\") pod \"multus-additional-cni-plugins-f7sb8\" (UID: \"b9e9a007-7d90-418e-b327-13b3f2ed817f\") " pod="openshift-multus/multus-additional-cni-plugins-f7sb8" Jul 11 03:02:58.659217 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.659177 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/994a29f5-0a6e-4e78-a413-99d5eb63cad7-hostroot\") pod \"multus-wg5xr\" (UID: \"994a29f5-0a6e-4e78-a413-99d5eb63cad7\") " pod="openshift-multus/multus-wg5xr" Jul 11 03:02:58.659217 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.659200 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/994a29f5-0a6e-4e78-a413-99d5eb63cad7-cnibin\") pod \"multus-wg5xr\" (UID: \"994a29f5-0a6e-4e78-a413-99d5eb63cad7\") " pod="openshift-multus/multus-wg5xr" Jul 11 03:02:58.659510 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.659229 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/994a29f5-0a6e-4e78-a413-99d5eb63cad7-host-run-netns\") pod \"multus-wg5xr\" (UID: \"994a29f5-0a6e-4e78-a413-99d5eb63cad7\") " pod="openshift-multus/multus-wg5xr" Jul 11 03:02:58.659510 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.659239 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/994a29f5-0a6e-4e78-a413-99d5eb63cad7-multus-conf-dir\") pod \"multus-wg5xr\" (UID: \"994a29f5-0a6e-4e78-a413-99d5eb63cad7\") " pod="openshift-multus/multus-wg5xr" Jul 11 03:02:58.659510 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.659283 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/994a29f5-0a6e-4e78-a413-99d5eb63cad7-host-run-multus-certs\") pod \"multus-wg5xr\" (UID: \"994a29f5-0a6e-4e78-a413-99d5eb63cad7\") " pod="openshift-multus/multus-wg5xr" Jul 11 03:02:58.659510 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.659282 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/994a29f5-0a6e-4e78-a413-99d5eb63cad7-multus-socket-dir-parent\") pod \"multus-wg5xr\" (UID: \"994a29f5-0a6e-4e78-a413-99d5eb63cad7\") " pod="openshift-multus/multus-wg5xr" Jul 11 03:02:58.659510 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.659354 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/994a29f5-0a6e-4e78-a413-99d5eb63cad7-system-cni-dir\") pod \"multus-wg5xr\" (UID: \"994a29f5-0a6e-4e78-a413-99d5eb63cad7\") " pod="openshift-multus/multus-wg5xr" Jul 11 03:02:58.659510 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.659399 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/29122b3c-c77b-45e1-97db-b2332bfd92cc-serviceca\") pod \"node-ca-w6296\" (UID: \"29122b3c-c77b-45e1-97db-b2332bfd92cc\") " pod="openshift-image-registry/node-ca-w6296" Jul 11 03:02:58.659752 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.659734 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/994a29f5-0a6e-4e78-a413-99d5eb63cad7-multus-daemon-config\") pod \"multus-wg5xr\" (UID: \"994a29f5-0a6e-4e78-a413-99d5eb63cad7\") " pod="openshift-multus/multus-wg5xr" Jul 11 03:02:58.659817 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.659796 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b9e9a007-7d90-418e-b327-13b3f2ed817f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-f7sb8\" (UID: \"b9e9a007-7d90-418e-b327-13b3f2ed817f\") " pod="openshift-multus/multus-additional-cni-plugins-f7sb8" Jul 11 03:02:58.660358 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.660323 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/994a29f5-0a6e-4e78-a413-99d5eb63cad7-cni-binary-copy\") pod \"multus-wg5xr\" (UID: \"994a29f5-0a6e-4e78-a413-99d5eb63cad7\") " pod="openshift-multus/multus-wg5xr" Jul 11 03:02:58.662975 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.662176 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e01a98e9-1445-401c-b9c5-8cd0ef77d1e6-agent-certs\") pod \"konnectivity-agent-fvldx\" (UID: \"e01a98e9-1445-401c-b9c5-8cd0ef77d1e6\") " pod="kube-system/konnectivity-agent-fvldx" Jul 11 03:02:58.666027 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:02:58.666001 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 11 03:02:58.666027 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:02:58.666027 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 11 03:02:58.666027 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:02:58.666041 2559 projected.go:196] Error preparing data for projected volume kube-api-access-slk7g for pod openshift-network-diagnostics/network-check-target-t96p7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 11 03:02:58.666355 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:02:58.666125 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/56f1263c-c5a9-491e-af1e-32394171afec-kube-api-access-slk7g podName:56f1263c-c5a9-491e-af1e-32394171afec nodeName:}" failed. No retries permitted until 2026-07-11 03:02:59.166107156 +0000 UTC m=+3.134719609 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-slk7g" (UniqueName: "kubernetes.io/projected/56f1263c-c5a9-491e-af1e-32394171afec-kube-api-access-slk7g") pod "network-check-target-t96p7" (UID: "56f1263c-c5a9-491e-af1e-32394171afec") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 11 03:02:58.668809 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.668779 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9m8f\" (UniqueName: \"kubernetes.io/projected/29122b3c-c77b-45e1-97db-b2332bfd92cc-kube-api-access-h9m8f\") pod \"node-ca-w6296\" (UID: \"29122b3c-c77b-45e1-97db-b2332bfd92cc\") " pod="openshift-image-registry/node-ca-w6296" Jul 11 03:02:58.669854 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.669823 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cgcrt\" (UniqueName: \"kubernetes.io/projected/17eb44fc-30b2-4501-9d2c-2294891bc4d8-kube-api-access-cgcrt\") pod \"iptables-alerter-fkzq2\" (UID: \"17eb44fc-30b2-4501-9d2c-2294891bc4d8\") " pod="openshift-network-operator/iptables-alerter-fkzq2" Jul 11 03:02:58.670443 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.670402 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kcvkl\" (UniqueName: \"kubernetes.io/projected/b9e9a007-7d90-418e-b327-13b3f2ed817f-kube-api-access-kcvkl\") pod \"multus-additional-cni-plugins-f7sb8\" (UID: \"b9e9a007-7d90-418e-b327-13b3f2ed817f\") " pod="openshift-multus/multus-additional-cni-plugins-f7sb8" Jul 11 03:02:58.670781 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.670704 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2q88j\" (UniqueName: \"kubernetes.io/projected/994a29f5-0a6e-4e78-a413-99d5eb63cad7-kube-api-access-2q88j\") pod \"multus-wg5xr\" (UID: \"994a29f5-0a6e-4e78-a413-99d5eb63cad7\") " pod="openshift-multus/multus-wg5xr" Jul 11 03:02:58.737332 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.737295 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-hb24z" Jul 11 03:02:58.753221 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.753185 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rkhst" Jul 11 03:02:58.768617 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.768581 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-zznc5" Jul 11 03:02:58.771813 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.771789 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-t56cx" Jul 11 03:02:58.781862 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.781833 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-f7sb8" Jul 11 03:02:58.794181 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.794149 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-fvldx" Jul 11 03:02:58.803498 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.803474 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-w6296" Jul 11 03:02:58.811847 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.811810 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-wg5xr" Jul 11 03:02:58.821073 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:58.821047 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-fkzq2" Jul 11 03:02:59.058943 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:59.058914 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e1553e4e-4895-4ef5-9027-14635923ec65-metrics-certs\") pod \"network-metrics-daemon-v9zw2\" (UID: \"e1553e4e-4895-4ef5-9027-14635923ec65\") " pod="openshift-multus/network-metrics-daemon-v9zw2" Jul 11 03:02:59.059160 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:59.058961 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3f82cf26-f769-4fc3-ad0f-b1042b1f63c0-original-pull-secret\") pod \"global-pull-secret-syncer-z7wb6\" (UID: \"3f82cf26-f769-4fc3-ad0f-b1042b1f63c0\") " pod="kube-system/global-pull-secret-syncer-z7wb6" Jul 11 03:02:59.059160 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:02:59.059091 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 11 03:02:59.059160 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:02:59.059091 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 11 03:02:59.059160 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:02:59.059160 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1553e4e-4895-4ef5-9027-14635923ec65-metrics-certs podName:e1553e4e-4895-4ef5-9027-14635923ec65 nodeName:}" failed. No retries permitted until 2026-07-11 03:03:00.059138894 +0000 UTC m=+4.027751340 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e1553e4e-4895-4ef5-9027-14635923ec65-metrics-certs") pod "network-metrics-daemon-v9zw2" (UID: "e1553e4e-4895-4ef5-9027-14635923ec65") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 11 03:02:59.059365 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:02:59.059181 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f82cf26-f769-4fc3-ad0f-b1042b1f63c0-original-pull-secret podName:3f82cf26-f769-4fc3-ad0f-b1042b1f63c0 nodeName:}" failed. No retries permitted until 2026-07-11 03:03:00.059170998 +0000 UTC m=+4.027783435 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3f82cf26-f769-4fc3-ad0f-b1042b1f63c0-original-pull-secret") pod "global-pull-secret-syncer-z7wb6" (UID: "3f82cf26-f769-4fc3-ad0f-b1042b1f63c0") : object "kube-system"/"original-pull-secret" not registered Jul 11 03:02:59.260226 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:59.260194 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-slk7g\" (UniqueName: \"kubernetes.io/projected/56f1263c-c5a9-491e-af1e-32394171afec-kube-api-access-slk7g\") pod \"network-check-target-t96p7\" (UID: \"56f1263c-c5a9-491e-af1e-32394171afec\") " pod="openshift-network-diagnostics/network-check-target-t96p7" Jul 11 03:02:59.260387 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:02:59.260345 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 11 03:02:59.260387 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:02:59.260366 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 11 03:02:59.260387 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:02:59.260377 2559 projected.go:196] Error preparing data for projected volume kube-api-access-slk7g for pod openshift-network-diagnostics/network-check-target-t96p7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 11 03:02:59.260509 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:02:59.260434 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/56f1263c-c5a9-491e-af1e-32394171afec-kube-api-access-slk7g podName:56f1263c-c5a9-491e-af1e-32394171afec nodeName:}" failed. No retries permitted until 2026-07-11 03:03:00.260419478 +0000 UTC m=+4.229031908 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-slk7g" (UniqueName: "kubernetes.io/projected/56f1263c-c5a9-491e-af1e-32394171afec-kube-api-access-slk7g") pod "network-check-target-t96p7" (UID: "56f1263c-c5a9-491e-af1e-32394171afec") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 11 03:02:59.477442 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:59.477397 2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-10 02:57:58 +0000 UTC" deadline="2028-01-22 19:24:09.597626389 +0000 UTC" Jul 11 03:02:59.477442 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:59.477441 2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13456h21m10.120190575s" Jul 11 03:02:59.610005 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:59.609948 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9e9a007_7d90_418e_b327_13b3f2ed817f.slice/crio-4780897bc85173f7e4080c9ddb17096acca87415d35f34ada6297a3594f39dcf WatchSource:0}: Error finding container 4780897bc85173f7e4080c9ddb17096acca87415d35f34ada6297a3594f39dcf: Status 404 returned error can't find the container with id 4780897bc85173f7e4080c9ddb17096acca87415d35f34ada6297a3594f39dcf Jul 11 03:02:59.623619 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:02:59.621697 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f7sb8" event={"ID":"b9e9a007-7d90-418e-b327-13b3f2ed817f","Type":"ContainerStarted","Data":"4780897bc85173f7e4080c9ddb17096acca87415d35f34ada6297a3594f39dcf"} Jul 11 03:02:59.623916 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:59.623893 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod994a29f5_0a6e_4e78_a413_99d5eb63cad7.slice/crio-4b62dc927a980c51acfc1364a4d592dc4bb9df5973c625076247171ba609c073 WatchSource:0}: Error finding container 4b62dc927a980c51acfc1364a4d592dc4bb9df5973c625076247171ba609c073: Status 404 returned error can't find the container with id 4b62dc927a980c51acfc1364a4d592dc4bb9df5973c625076247171ba609c073 Jul 11 03:02:59.629380 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:59.629357 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4287b506_42a9_4b1d_85e8_91008605fd2c.slice/crio-d9ecd0f096541ccf0f3bf8ce4f364aef67aadd1851534ba1edebff270181c01f WatchSource:0}: Error finding container d9ecd0f096541ccf0f3bf8ce4f364aef67aadd1851534ba1edebff270181c01f: Status 404 returned error can't find the container with id d9ecd0f096541ccf0f3bf8ce4f364aef67aadd1851534ba1edebff270181c01f Jul 11 03:02:59.630639 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:59.630604 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode01a98e9_1445_401c_b9c5_8cd0ef77d1e6.slice/crio-22c7d6b66b8227adae5041a78cac17ee4f8f101902935e0844072f281514731e WatchSource:0}: Error finding container 22c7d6b66b8227adae5041a78cac17ee4f8f101902935e0844072f281514731e: Status 404 returned error can't find the container with id 22c7d6b66b8227adae5041a78cac17ee4f8f101902935e0844072f281514731e Jul 11 03:02:59.631529 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:59.631509 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd48fb79_15d0_42c4_9db6_cc93fbc68ec4.slice/crio-6b9289d58ea3a1e36e8f1547c05a5012419269d1bb92594e6f408f220e874049 WatchSource:0}: Error finding container 6b9289d58ea3a1e36e8f1547c05a5012419269d1bb92594e6f408f220e874049: Status 404 returned error can't find the container with id 6b9289d58ea3a1e36e8f1547c05a5012419269d1bb92594e6f408f220e874049 Jul 11 03:02:59.633135 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:59.633114 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc91021e_ef93_462d_a80d_130775629ff9.slice/crio-a9887cd4eb3fbe4bacc5940cb729490a1cc0a62fa2b1a40db4e5cc91454fa224 WatchSource:0}: Error finding container a9887cd4eb3fbe4bacc5940cb729490a1cc0a62fa2b1a40db4e5cc91454fa224: Status 404 returned error can't find the container with id a9887cd4eb3fbe4bacc5940cb729490a1cc0a62fa2b1a40db4e5cc91454fa224 Jul 11 03:02:59.633878 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:59.633855 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbaacd8ba_d2a4_4bdf_8a48_6b822f219325.slice/crio-a652a57fd88301c8c6387437c007580ff39fbb075ec1f75e09578c5ef5a311f2 WatchSource:0}: Error finding container a652a57fd88301c8c6387437c007580ff39fbb075ec1f75e09578c5ef5a311f2: Status 404 returned error can't find the container with id a652a57fd88301c8c6387437c007580ff39fbb075ec1f75e09578c5ef5a311f2 Jul 11 03:02:59.635075 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:02:59.634819 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29122b3c_c77b_45e1_97db_b2332bfd92cc.slice/crio-594f329bcb6957a73d186324c96eaeb4b5cdab89258142442e8f869b5c19458e WatchSource:0}: Error finding container 594f329bcb6957a73d186324c96eaeb4b5cdab89258142442e8f869b5c19458e: Status 404 returned error can't find the container with id 594f329bcb6957a73d186324c96eaeb4b5cdab89258142442e8f869b5c19458e Jul 11 03:03:00.067599 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:00.067544 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3f82cf26-f769-4fc3-ad0f-b1042b1f63c0-original-pull-secret\") pod \"global-pull-secret-syncer-z7wb6\" (UID: \"3f82cf26-f769-4fc3-ad0f-b1042b1f63c0\") " pod="kube-system/global-pull-secret-syncer-z7wb6" Jul 11 03:03:00.067779 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:00.067645 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e1553e4e-4895-4ef5-9027-14635923ec65-metrics-certs\") pod \"network-metrics-daemon-v9zw2\" (UID: \"e1553e4e-4895-4ef5-9027-14635923ec65\") " pod="openshift-multus/network-metrics-daemon-v9zw2" Jul 11 03:03:00.067779 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:03:00.067771 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 11 03:03:00.067896 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:03:00.067837 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1553e4e-4895-4ef5-9027-14635923ec65-metrics-certs podName:e1553e4e-4895-4ef5-9027-14635923ec65 nodeName:}" failed. No retries permitted until 2026-07-11 03:03:02.067816357 +0000 UTC m=+6.036428788 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e1553e4e-4895-4ef5-9027-14635923ec65-metrics-certs") pod "network-metrics-daemon-v9zw2" (UID: "e1553e4e-4895-4ef5-9027-14635923ec65") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 11 03:03:00.068272 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:03:00.068251 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 11 03:03:00.068411 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:03:00.068309 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f82cf26-f769-4fc3-ad0f-b1042b1f63c0-original-pull-secret podName:3f82cf26-f769-4fc3-ad0f-b1042b1f63c0 nodeName:}" failed. No retries permitted until 2026-07-11 03:03:02.068292679 +0000 UTC m=+6.036905126 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3f82cf26-f769-4fc3-ad0f-b1042b1f63c0-original-pull-secret") pod "global-pull-secret-syncer-z7wb6" (UID: "3f82cf26-f769-4fc3-ad0f-b1042b1f63c0") : object "kube-system"/"original-pull-secret" not registered Jul 11 03:03:00.270139 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:00.269413 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-slk7g\" (UniqueName: \"kubernetes.io/projected/56f1263c-c5a9-491e-af1e-32394171afec-kube-api-access-slk7g\") pod \"network-check-target-t96p7\" (UID: \"56f1263c-c5a9-491e-af1e-32394171afec\") " pod="openshift-network-diagnostics/network-check-target-t96p7" Jul 11 03:03:00.270139 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:03:00.269635 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 11 03:03:00.270139 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:03:00.269658 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 11 03:03:00.270139 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:03:00.269670 2559 projected.go:196] Error preparing data for projected volume kube-api-access-slk7g for pod openshift-network-diagnostics/network-check-target-t96p7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 11 03:03:00.270139 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:03:00.269727 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/56f1263c-c5a9-491e-af1e-32394171afec-kube-api-access-slk7g podName:56f1263c-c5a9-491e-af1e-32394171afec nodeName:}" failed. No retries permitted until 2026-07-11 03:03:02.269709331 +0000 UTC m=+6.238321764 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-slk7g" (UniqueName: "kubernetes.io/projected/56f1263c-c5a9-491e-af1e-32394171afec-kube-api-access-slk7g") pod "network-check-target-t96p7" (UID: "56f1263c-c5a9-491e-af1e-32394171afec") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 11 03:03:00.477785 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:00.477698 2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-10 02:57:58 +0000 UTC" deadline="2027-12-14 07:46:48.434899493 +0000 UTC" Jul 11 03:03:00.477785 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:00.477753 2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12508h43m47.957149998s" Jul 11 03:03:00.616207 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:00.616167 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z7wb6" Jul 11 03:03:00.616385 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:03:00.616290 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z7wb6" podUID="3f82cf26-f769-4fc3-ad0f-b1042b1f63c0" Jul 11 03:03:00.616704 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:00.616682 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v9zw2" Jul 11 03:03:00.616928 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:03:00.616906 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v9zw2" podUID="e1553e4e-4895-4ef5-9027-14635923ec65" Jul 11 03:03:00.617020 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:00.617005 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t96p7" Jul 11 03:03:00.617101 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:03:00.617083 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t96p7" podUID="56f1263c-c5a9-491e-af1e-32394171afec" Jul 11 03:03:00.635021 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:00.634982 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rkhst" event={"ID":"cd48fb79-15d0-42c4-9db6-cc93fbc68ec4","Type":"ContainerStarted","Data":"6b9289d58ea3a1e36e8f1547c05a5012419269d1bb92594e6f408f220e874049"} Jul 11 03:03:00.639513 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:00.639395 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hb24z" event={"ID":"4287b506-42a9-4b1d-85e8-91008605fd2c","Type":"ContainerStarted","Data":"d9ecd0f096541ccf0f3bf8ce4f364aef67aadd1851534ba1edebff270181c01f"} Jul 11 03:03:00.642574 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:00.642478 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-wg5xr" event={"ID":"994a29f5-0a6e-4e78-a413-99d5eb63cad7","Type":"ContainerStarted","Data":"4b62dc927a980c51acfc1364a4d592dc4bb9df5973c625076247171ba609c073"} Jul 11 03:03:00.661522 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:00.660279 2559 generic.go:356] "Generic (PLEG): container finished" podID="7832d055872458363fd84090a1330a4f" containerID="81515b7bb48ce524697cba6020140ebcd074616e86e36f3f4eb9c40d9be42623" exitCode=0 Jul 11 03:03:00.661522 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:00.660391 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-141.ec2.internal" event={"ID":"7832d055872458363fd84090a1330a4f","Type":"ContainerDied","Data":"81515b7bb48ce524697cba6020140ebcd074616e86e36f3f4eb9c40d9be42623"} Jul 11 03:03:00.679447 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:00.679406 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-fkzq2" event={"ID":"17eb44fc-30b2-4501-9d2c-2294891bc4d8","Type":"ContainerStarted","Data":"c6486b12a0d3a992e271f543ec22cdca83d14f8db65c3179806fad363c4c1957"} Jul 11 03:03:00.693044 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:00.689798 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-w6296" event={"ID":"29122b3c-c77b-45e1-97db-b2332bfd92cc","Type":"ContainerStarted","Data":"594f329bcb6957a73d186324c96eaeb4b5cdab89258142442e8f869b5c19458e"} Jul 11 03:03:00.694482 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:00.694420 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-zznc5" event={"ID":"baacd8ba-d2a4-4bdf-8a48-6b822f219325","Type":"ContainerStarted","Data":"a652a57fd88301c8c6387437c007580ff39fbb075ec1f75e09578c5ef5a311f2"} Jul 11 03:03:00.706585 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:00.706555 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-t56cx" event={"ID":"bc91021e-ef93-462d-a80d-130775629ff9","Type":"ContainerStarted","Data":"a9887cd4eb3fbe4bacc5940cb729490a1cc0a62fa2b1a40db4e5cc91454fa224"} Jul 11 03:03:00.727336 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:00.726846 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-fvldx" event={"ID":"e01a98e9-1445-401c-b9c5-8cd0ef77d1e6","Type":"ContainerStarted","Data":"22c7d6b66b8227adae5041a78cac17ee4f8f101902935e0844072f281514731e"} Jul 11 03:03:00.737789 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:00.737753 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-141.ec2.internal" event={"ID":"f78a7cbe224856398af387ef37689630","Type":"ContainerStarted","Data":"6106dc746122492ab4d85376b1c0c9ebcb00fe38996b69432cc3d5eaec6648ce"} Jul 11 03:03:00.751110 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:00.751051 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-141.ec2.internal" podStartSLOduration=3.751031791 podStartE2EDuration="3.751031791s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 03:02:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:03:00.750845558 +0000 UTC m=+4.719458011" watchObservedRunningTime="2026-07-11 03:03:00.751031791 +0000 UTC m=+4.719644242" Jul 11 03:03:01.766056 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:01.766022 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-141.ec2.internal" event={"ID":"7832d055872458363fd84090a1330a4f","Type":"ContainerStarted","Data":"2a4d9538e2313105716152a1c94351dea66fb10482ab2287e1450228e2bfec01"} Jul 11 03:03:02.089482 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:02.089443 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3f82cf26-f769-4fc3-ad0f-b1042b1f63c0-original-pull-secret\") pod \"global-pull-secret-syncer-z7wb6\" (UID: \"3f82cf26-f769-4fc3-ad0f-b1042b1f63c0\") " pod="kube-system/global-pull-secret-syncer-z7wb6" Jul 11 03:03:02.089667 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:02.089533 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e1553e4e-4895-4ef5-9027-14635923ec65-metrics-certs\") pod \"network-metrics-daemon-v9zw2\" (UID: \"e1553e4e-4895-4ef5-9027-14635923ec65\") " pod="openshift-multus/network-metrics-daemon-v9zw2" Jul 11 03:03:02.089724 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:03:02.089664 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 11 03:03:02.089774 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:03:02.089727 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1553e4e-4895-4ef5-9027-14635923ec65-metrics-certs podName:e1553e4e-4895-4ef5-9027-14635923ec65 nodeName:}" failed. No retries permitted until 2026-07-11 03:03:06.089705513 +0000 UTC m=+10.058317948 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e1553e4e-4895-4ef5-9027-14635923ec65-metrics-certs") pod "network-metrics-daemon-v9zw2" (UID: "e1553e4e-4895-4ef5-9027-14635923ec65") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 11 03:03:02.090155 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:03:02.090133 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 11 03:03:02.090269 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:03:02.090192 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f82cf26-f769-4fc3-ad0f-b1042b1f63c0-original-pull-secret podName:3f82cf26-f769-4fc3-ad0f-b1042b1f63c0 nodeName:}" failed. No retries permitted until 2026-07-11 03:03:06.090176991 +0000 UTC m=+10.058789425 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3f82cf26-f769-4fc3-ad0f-b1042b1f63c0-original-pull-secret") pod "global-pull-secret-syncer-z7wb6" (UID: "3f82cf26-f769-4fc3-ad0f-b1042b1f63c0") : object "kube-system"/"original-pull-secret" not registered Jul 11 03:03:02.290665 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:02.290613 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-slk7g\" (UniqueName: \"kubernetes.io/projected/56f1263c-c5a9-491e-af1e-32394171afec-kube-api-access-slk7g\") pod \"network-check-target-t96p7\" (UID: \"56f1263c-c5a9-491e-af1e-32394171afec\") " pod="openshift-network-diagnostics/network-check-target-t96p7" Jul 11 03:03:02.290880 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:03:02.290820 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 11 03:03:02.290880 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:03:02.290838 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 11 03:03:02.290880 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:03:02.290850 2559 projected.go:196] Error preparing data for projected volume kube-api-access-slk7g for pod openshift-network-diagnostics/network-check-target-t96p7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 11 03:03:02.291135 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:03:02.290908 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/56f1263c-c5a9-491e-af1e-32394171afec-kube-api-access-slk7g podName:56f1263c-c5a9-491e-af1e-32394171afec nodeName:}" failed. No retries permitted until 2026-07-11 03:03:06.290889962 +0000 UTC m=+10.259502391 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-slk7g" (UniqueName: "kubernetes.io/projected/56f1263c-c5a9-491e-af1e-32394171afec-kube-api-access-slk7g") pod "network-check-target-t96p7" (UID: "56f1263c-c5a9-491e-af1e-32394171afec") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 11 03:03:02.611920 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:02.611841 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t96p7" Jul 11 03:03:02.612116 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:03:02.612036 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t96p7" podUID="56f1263c-c5a9-491e-af1e-32394171afec" Jul 11 03:03:02.612430 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:02.612407 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z7wb6" Jul 11 03:03:02.612527 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:03:02.612509 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z7wb6" podUID="3f82cf26-f769-4fc3-ad0f-b1042b1f63c0" Jul 11 03:03:02.612590 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:02.612562 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v9zw2" Jul 11 03:03:02.612733 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:03:02.612705 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v9zw2" podUID="e1553e4e-4895-4ef5-9027-14635923ec65" Jul 11 03:03:04.611278 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:04.611248 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v9zw2" Jul 11 03:03:04.611869 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:03:04.611363 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v9zw2" podUID="e1553e4e-4895-4ef5-9027-14635923ec65" Jul 11 03:03:04.611869 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:04.611721 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t96p7" Jul 11 03:03:04.611869 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:03:04.611820 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t96p7" podUID="56f1263c-c5a9-491e-af1e-32394171afec" Jul 11 03:03:04.612071 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:04.611885 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z7wb6" Jul 11 03:03:04.612071 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:03:04.611983 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z7wb6" podUID="3f82cf26-f769-4fc3-ad0f-b1042b1f63c0" Jul 11 03:03:06.122545 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:06.122506 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e1553e4e-4895-4ef5-9027-14635923ec65-metrics-certs\") pod \"network-metrics-daemon-v9zw2\" (UID: \"e1553e4e-4895-4ef5-9027-14635923ec65\") " pod="openshift-multus/network-metrics-daemon-v9zw2" Jul 11 03:03:06.123035 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:06.122582 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3f82cf26-f769-4fc3-ad0f-b1042b1f63c0-original-pull-secret\") pod \"global-pull-secret-syncer-z7wb6\" (UID: \"3f82cf26-f769-4fc3-ad0f-b1042b1f63c0\") " pod="kube-system/global-pull-secret-syncer-z7wb6" Jul 11 03:03:06.123035 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:03:06.122687 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 11 03:03:06.123035 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:03:06.122692 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 11 03:03:06.123035 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:03:06.122740 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f82cf26-f769-4fc3-ad0f-b1042b1f63c0-original-pull-secret podName:3f82cf26-f769-4fc3-ad0f-b1042b1f63c0 nodeName:}" failed. No retries permitted until 2026-07-11 03:03:14.122722762 +0000 UTC m=+18.091335194 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3f82cf26-f769-4fc3-ad0f-b1042b1f63c0-original-pull-secret") pod "global-pull-secret-syncer-z7wb6" (UID: "3f82cf26-f769-4fc3-ad0f-b1042b1f63c0") : object "kube-system"/"original-pull-secret" not registered Jul 11 03:03:06.123035 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:03:06.122767 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1553e4e-4895-4ef5-9027-14635923ec65-metrics-certs podName:e1553e4e-4895-4ef5-9027-14635923ec65 nodeName:}" failed. No retries permitted until 2026-07-11 03:03:14.122749338 +0000 UTC m=+18.091361786 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e1553e4e-4895-4ef5-9027-14635923ec65-metrics-certs") pod "network-metrics-daemon-v9zw2" (UID: "e1553e4e-4895-4ef5-9027-14635923ec65") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 11 03:03:06.324009 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:06.323950 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-slk7g\" (UniqueName: \"kubernetes.io/projected/56f1263c-c5a9-491e-af1e-32394171afec-kube-api-access-slk7g\") pod \"network-check-target-t96p7\" (UID: \"56f1263c-c5a9-491e-af1e-32394171afec\") " pod="openshift-network-diagnostics/network-check-target-t96p7" Jul 11 03:03:06.324193 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:03:06.324150 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 11 03:03:06.324193 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:03:06.324176 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 11 03:03:06.324193 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:03:06.324190 2559 projected.go:196] Error preparing data for projected volume kube-api-access-slk7g for pod openshift-network-diagnostics/network-check-target-t96p7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 11 03:03:06.324301 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:03:06.324247 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/56f1263c-c5a9-491e-af1e-32394171afec-kube-api-access-slk7g podName:56f1263c-c5a9-491e-af1e-32394171afec nodeName:}" failed. No retries permitted until 2026-07-11 03:03:14.324228622 +0000 UTC m=+18.292841068 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-slk7g" (UniqueName: "kubernetes.io/projected/56f1263c-c5a9-491e-af1e-32394171afec-kube-api-access-slk7g") pod "network-check-target-t96p7" (UID: "56f1263c-c5a9-491e-af1e-32394171afec") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 11 03:03:06.610899 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:06.610423 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v9zw2" Jul 11 03:03:06.610899 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:03:06.610549 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v9zw2" podUID="e1553e4e-4895-4ef5-9027-14635923ec65" Jul 11 03:03:06.610899 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:06.610608 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t96p7" Jul 11 03:03:06.610899 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:03:06.610714 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t96p7" podUID="56f1263c-c5a9-491e-af1e-32394171afec" Jul 11 03:03:06.610899 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:06.610742 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z7wb6" Jul 11 03:03:06.610899 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:03:06.610849 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z7wb6" podUID="3f82cf26-f769-4fc3-ad0f-b1042b1f63c0" Jul 11 03:03:08.610113 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:08.610079 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z7wb6" Jul 11 03:03:08.610559 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:08.610077 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t96p7" Jul 11 03:03:08.610559 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:03:08.610206 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z7wb6" podUID="3f82cf26-f769-4fc3-ad0f-b1042b1f63c0" Jul 11 03:03:08.610559 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:08.610224 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v9zw2" Jul 11 03:03:08.610559 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:03:08.610306 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t96p7" podUID="56f1263c-c5a9-491e-af1e-32394171afec" Jul 11 03:03:08.610559 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:03:08.610389 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v9zw2" podUID="e1553e4e-4895-4ef5-9027-14635923ec65" Jul 11 03:03:10.609946 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:10.609912 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t96p7" Jul 11 03:03:10.610476 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:10.609978 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v9zw2" Jul 11 03:03:10.610476 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:10.609982 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z7wb6" Jul 11 03:03:10.610476 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:03:10.610066 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t96p7" podUID="56f1263c-c5a9-491e-af1e-32394171afec" Jul 11 03:03:10.610476 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:03:10.610174 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v9zw2" podUID="e1553e4e-4895-4ef5-9027-14635923ec65" Jul 11 03:03:10.610476 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:03:10.610272 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z7wb6" podUID="3f82cf26-f769-4fc3-ad0f-b1042b1f63c0" Jul 11 03:03:12.608951 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:12.608914 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z7wb6" Jul 11 03:03:12.608951 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:12.608939 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v9zw2" Jul 11 03:03:12.609472 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:03:12.609055 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z7wb6" podUID="3f82cf26-f769-4fc3-ad0f-b1042b1f63c0" Jul 11 03:03:12.609472 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:03:12.609152 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v9zw2" podUID="e1553e4e-4895-4ef5-9027-14635923ec65" Jul 11 03:03:12.609472 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:12.609229 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t96p7" Jul 11 03:03:12.609472 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:03:12.609310 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t96p7" podUID="56f1263c-c5a9-491e-af1e-32394171afec" Jul 11 03:03:14.186483 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:14.186434 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e1553e4e-4895-4ef5-9027-14635923ec65-metrics-certs\") pod \"network-metrics-daemon-v9zw2\" (UID: \"e1553e4e-4895-4ef5-9027-14635923ec65\") " pod="openshift-multus/network-metrics-daemon-v9zw2" Jul 11 03:03:14.186483 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:14.186491 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3f82cf26-f769-4fc3-ad0f-b1042b1f63c0-original-pull-secret\") pod \"global-pull-secret-syncer-z7wb6\" (UID: \"3f82cf26-f769-4fc3-ad0f-b1042b1f63c0\") " pod="kube-system/global-pull-secret-syncer-z7wb6" Jul 11 03:03:14.187054 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:03:14.186613 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 11 03:03:14.187054 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:03:14.186674 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1553e4e-4895-4ef5-9027-14635923ec65-metrics-certs podName:e1553e4e-4895-4ef5-9027-14635923ec65 nodeName:}" failed. No retries permitted until 2026-07-11 03:03:30.186660781 +0000 UTC m=+34.155273210 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e1553e4e-4895-4ef5-9027-14635923ec65-metrics-certs") pod "network-metrics-daemon-v9zw2" (UID: "e1553e4e-4895-4ef5-9027-14635923ec65") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 11 03:03:14.187054 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:03:14.186613 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 11 03:03:14.187054 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:03:14.186732 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f82cf26-f769-4fc3-ad0f-b1042b1f63c0-original-pull-secret podName:3f82cf26-f769-4fc3-ad0f-b1042b1f63c0 nodeName:}" failed. No retries permitted until 2026-07-11 03:03:30.186719358 +0000 UTC m=+34.155331788 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3f82cf26-f769-4fc3-ad0f-b1042b1f63c0-original-pull-secret") pod "global-pull-secret-syncer-z7wb6" (UID: "3f82cf26-f769-4fc3-ad0f-b1042b1f63c0") : object "kube-system"/"original-pull-secret" not registered Jul 11 03:03:14.388225 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:14.388178 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-slk7g\" (UniqueName: \"kubernetes.io/projected/56f1263c-c5a9-491e-af1e-32394171afec-kube-api-access-slk7g\") pod \"network-check-target-t96p7\" (UID: \"56f1263c-c5a9-491e-af1e-32394171afec\") " pod="openshift-network-diagnostics/network-check-target-t96p7" Jul 11 03:03:14.388412 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:03:14.388365 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 11 03:03:14.388412 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:03:14.388388 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 11 03:03:14.388412 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:03:14.388398 2559 projected.go:196] Error preparing data for projected volume kube-api-access-slk7g for pod openshift-network-diagnostics/network-check-target-t96p7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 11 03:03:14.388530 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:03:14.388453 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/56f1263c-c5a9-491e-af1e-32394171afec-kube-api-access-slk7g podName:56f1263c-c5a9-491e-af1e-32394171afec nodeName:}" failed. No retries permitted until 2026-07-11 03:03:30.388439823 +0000 UTC m=+34.357052277 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-slk7g" (UniqueName: "kubernetes.io/projected/56f1263c-c5a9-491e-af1e-32394171afec-kube-api-access-slk7g") pod "network-check-target-t96p7" (UID: "56f1263c-c5a9-491e-af1e-32394171afec") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 11 03:03:14.609295 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:14.609256 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z7wb6" Jul 11 03:03:14.609461 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:14.609261 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v9zw2" Jul 11 03:03:14.609461 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:03:14.609380 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z7wb6" podUID="3f82cf26-f769-4fc3-ad0f-b1042b1f63c0" Jul 11 03:03:14.609559 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:03:14.609487 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v9zw2" podUID="e1553e4e-4895-4ef5-9027-14635923ec65" Jul 11 03:03:14.609559 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:14.609256 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t96p7" Jul 11 03:03:14.609622 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:03:14.609566 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t96p7" podUID="56f1263c-c5a9-491e-af1e-32394171afec" Jul 11 03:03:16.610314 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:16.609825 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v9zw2" Jul 11 03:03:16.610314 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:16.609945 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t96p7" Jul 11 03:03:16.610314 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:03:16.609975 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v9zw2" podUID="e1553e4e-4895-4ef5-9027-14635923ec65" Jul 11 03:03:16.610314 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:03:16.610035 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t96p7" podUID="56f1263c-c5a9-491e-af1e-32394171afec" Jul 11 03:03:16.610314 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:16.610054 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z7wb6" Jul 11 03:03:16.610314 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:03:16.610157 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z7wb6" podUID="3f82cf26-f769-4fc3-ad0f-b1042b1f63c0" Jul 11 03:03:18.610012 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:18.609195 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t96p7" Jul 11 03:03:18.610012 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:03:18.609318 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t96p7" podUID="56f1263c-c5a9-491e-af1e-32394171afec" Jul 11 03:03:18.610012 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:18.609710 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z7wb6" Jul 11 03:03:18.610012 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:03:18.609808 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z7wb6" podUID="3f82cf26-f769-4fc3-ad0f-b1042b1f63c0" Jul 11 03:03:18.610012 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:18.609863 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v9zw2" Jul 11 03:03:18.610012 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:03:18.609939 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v9zw2" podUID="e1553e4e-4895-4ef5-9027-14635923ec65" Jul 11 03:03:18.801046 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:18.800796 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-w6296" event={"ID":"29122b3c-c77b-45e1-97db-b2332bfd92cc","Type":"ContainerStarted","Data":"4b9136c572bc92d5a3e518d3fade0df67badbd112d1b53d21fe64f831a7ff4ad"} Jul 11 03:03:18.802277 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:18.802231 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-zznc5" event={"ID":"baacd8ba-d2a4-4bdf-8a48-6b822f219325","Type":"ContainerStarted","Data":"f93828d3487ae418bff43b98836a885c55972f9391a45bb0abdc8ae842629e93"} Jul 11 03:03:18.804109 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:18.804083 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-t56cx" event={"ID":"bc91021e-ef93-462d-a80d-130775629ff9","Type":"ContainerStarted","Data":"54992341fbf493e5f922063c266561fe6cb0824a1ed4c22a1de04c5afc6c8d18"} Jul 11 03:03:18.805488 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:18.805465 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-fvldx" event={"ID":"e01a98e9-1445-401c-b9c5-8cd0ef77d1e6","Type":"ContainerStarted","Data":"7c6f5328471ea86143ac3cf5179c2cf7a3314dfae15a8271e206bd42cebd1450"} Jul 11 03:03:18.806905 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:18.806881 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f7sb8" event={"ID":"b9e9a007-7d90-418e-b327-13b3f2ed817f","Type":"ContainerStarted","Data":"ce3c702124fbcefbb464a9b77acc4af2482b765e53f2a93667d5fcd628f3f508"} Jul 11 03:03:18.808590 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:18.808461 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rkhst" event={"ID":"cd48fb79-15d0-42c4-9db6-cc93fbc68ec4","Type":"ContainerStarted","Data":"fdfdbc99aa097d269d7cdd01c69e74bb6e27cd7d998e2c486ce80660da625aee"} Jul 11 03:03:18.810241 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:18.810218 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hb24z" event={"ID":"4287b506-42a9-4b1d-85e8-91008605fd2c","Type":"ContainerStarted","Data":"2c642c9c34a6c115fa768b347c04b73a8a7e01fcebeeda54d844ee3261c5347c"} Jul 11 03:03:18.810337 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:18.810272 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hb24z" event={"ID":"4287b506-42a9-4b1d-85e8-91008605fd2c","Type":"ContainerStarted","Data":"83e9fedc80ec38a037dcc46ace815f60edabfda5e51ea0e1ad0b3290f1a1aa24"} Jul 11 03:03:18.811610 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:18.811585 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-wg5xr" event={"ID":"994a29f5-0a6e-4e78-a413-99d5eb63cad7","Type":"ContainerStarted","Data":"fb8d85ea76253dc3b5be9bf1b9b3283ef730569ea3dfd775d65ac995bf7fe31f"} Jul 11 03:03:18.821431 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:18.821378 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-141.ec2.internal" podStartSLOduration=21.821358206 podStartE2EDuration="21.821358206s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 03:02:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:03:01.780858347 +0000 UTC m=+5.749470803" watchObservedRunningTime="2026-07-11 03:03:18.821358206 +0000 UTC m=+22.789970663" Jul 11 03:03:18.821573 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:18.821544 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-w6296" podStartSLOduration=4.021616709 podStartE2EDuration="22.821537177s" totalImagesPullingTime="18.799920468s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 03:02:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:03:18.820922843 +0000 UTC m=+22.789535296" watchObservedRunningTime="2026-07-11 03:03:18.821537177 +0000 UTC m=+22.790149629" Jul 11 03:03:18.853364 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:18.853317 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-zznc5" podStartSLOduration=4.035818706 podStartE2EDuration="22.853301434s" totalImagesPullingTime="18.817482728s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 03:02:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:03:18.853217294 +0000 UTC m=+22.821829773" watchObservedRunningTime="2026-07-11 03:03:18.853301434 +0000 UTC m=+22.821913884" Jul 11 03:03:18.853701 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:18.853663 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-wg5xr" podStartSLOduration=3.980645798 podStartE2EDuration="22.853650638s" totalImagesPullingTime="18.87300484s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 03:02:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:03:18.836491015 +0000 UTC m=+22.805103481" watchObservedRunningTime="2026-07-11 03:03:18.853650638 +0000 UTC m=+22.822263090" Jul 11 03:03:18.867351 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:18.867300 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-t56cx" podStartSLOduration=4.04982676 podStartE2EDuration="22.867283191s" totalImagesPullingTime="18.817456431s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 03:02:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:03:18.86703447 +0000 UTC m=+22.835646922" watchObservedRunningTime="2026-07-11 03:03:18.867283191 +0000 UTC m=+22.835895641" Jul 11 03:03:18.902042 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:18.901989 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-fvldx" podStartSLOduration=4.457484288 podStartE2EDuration="22.901972769s" totalImagesPullingTime="18.444488481s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:02:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:03:18.901883262 +0000 UTC m=+22.870495713" watchObservedRunningTime="2026-07-11 03:03:18.901972769 +0000 UTC m=+22.870585211" Jul 11 03:03:19.807517 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:19.807354 2559 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 11 03:03:19.831555 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:19.831527 2559 generic.go:356] "Generic (PLEG): container finished" podID="b9e9a007-7d90-418e-b327-13b3f2ed817f" containerID="ce3c702124fbcefbb464a9b77acc4af2482b765e53f2a93667d5fcd628f3f508" exitCode=0 Jul 11 03:03:19.831739 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:19.831596 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f7sb8" event={"ID":"b9e9a007-7d90-418e-b327-13b3f2ed817f","Type":"ContainerDied","Data":"ce3c702124fbcefbb464a9b77acc4af2482b765e53f2a93667d5fcd628f3f508"} Jul 11 03:03:19.833517 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:19.833490 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rkhst" event={"ID":"cd48fb79-15d0-42c4-9db6-cc93fbc68ec4","Type":"ContainerStarted","Data":"4de4047cc620aec857390e15c990909af73109b83a05692e4b548e2bb4bd4812"} Jul 11 03:03:19.836450 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:19.836430 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hb24z_4287b506-42a9-4b1d-85e8-91008605fd2c/ovn-acl-logging/0.log" Jul 11 03:03:19.836805 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:19.836780 2559 generic.go:356] "Generic (PLEG): container finished" podID="4287b506-42a9-4b1d-85e8-91008605fd2c" containerID="2c642c9c34a6c115fa768b347c04b73a8a7e01fcebeeda54d844ee3261c5347c" exitCode=1 Jul 11 03:03:19.836947 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:19.836867 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hb24z" event={"ID":"4287b506-42a9-4b1d-85e8-91008605fd2c","Type":"ContainerDied","Data":"2c642c9c34a6c115fa768b347c04b73a8a7e01fcebeeda54d844ee3261c5347c"} Jul 11 03:03:19.836947 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:19.836935 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hb24z" event={"ID":"4287b506-42a9-4b1d-85e8-91008605fd2c","Type":"ContainerStarted","Data":"93cd73be19bda44318ab2adce7c135d6d901c03717c0aac24f61dce36af042ce"} Jul 11 03:03:19.837051 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:19.836987 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hb24z" event={"ID":"4287b506-42a9-4b1d-85e8-91008605fd2c","Type":"ContainerStarted","Data":"ab28c1d1a323013890c87ce57e591f5ab3a766165e1019559789eafb0c2f6635"} Jul 11 03:03:19.837051 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:19.837019 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hb24z" event={"ID":"4287b506-42a9-4b1d-85e8-91008605fd2c","Type":"ContainerStarted","Data":"d4c7f2e1116fa08159f6ee9b92d1d847e30ec1bdffb46d6e1caaa162238db9e2"} Jul 11 03:03:19.837110 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:19.837057 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hb24z" event={"ID":"4287b506-42a9-4b1d-85e8-91008605fd2c","Type":"ContainerStarted","Data":"48aaa93d633694430cf1be79ba93f9484f4d69823e1dd00692b53ea6fab88b7b"} Jul 11 03:03:20.499376 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:20.499197 2559 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-11T03:03:19.807511903Z","UUID":"692ee520-4efb-48cf-8810-580c89bf03e0","Handler":null,"Name":"","Endpoint":""} Jul 11 03:03:20.501552 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:20.501199 2559 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 11 03:03:20.501552 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:20.501243 2559 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 11 03:03:20.609115 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:20.609084 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t96p7" Jul 11 03:03:20.609302 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:20.609088 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z7wb6" Jul 11 03:03:20.609302 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:03:20.609191 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t96p7" podUID="56f1263c-c5a9-491e-af1e-32394171afec" Jul 11 03:03:20.609302 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:03:20.609272 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z7wb6" podUID="3f82cf26-f769-4fc3-ad0f-b1042b1f63c0" Jul 11 03:03:20.609451 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:20.609384 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v9zw2" Jul 11 03:03:20.609502 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:03:20.609476 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v9zw2" podUID="e1553e4e-4895-4ef5-9027-14635923ec65" Jul 11 03:03:20.841602 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:20.841567 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-fkzq2" event={"ID":"17eb44fc-30b2-4501-9d2c-2294891bc4d8","Type":"ContainerStarted","Data":"336094b0cdb66ee7b404ad0dd16c2ca17cf82eec7ef83a2bca86520f31a847ce"} Jul 11 03:03:20.855457 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:20.855409 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-fkzq2" podStartSLOduration=6.038874418 podStartE2EDuration="24.855392115s" totalImagesPullingTime="18.816517697s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 03:02:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:03:20.855218779 +0000 UTC m=+24.823831230" watchObservedRunningTime="2026-07-11 03:03:20.855392115 +0000 UTC m=+24.824004566" Jul 11 03:03:21.847744 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:21.847716 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hb24z_4287b506-42a9-4b1d-85e8-91008605fd2c/ovn-acl-logging/0.log" Jul 11 03:03:21.848285 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:21.848154 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hb24z" event={"ID":"4287b506-42a9-4b1d-85e8-91008605fd2c","Type":"ContainerStarted","Data":"5d73a0d72c5b5adfcd4730a4ac6d312cd9cfca73bcf7b285fda4e5b40963ec41"} Jul 11 03:03:21.850572 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:21.850532 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rkhst" event={"ID":"cd48fb79-15d0-42c4-9db6-cc93fbc68ec4","Type":"ContainerStarted","Data":"1035b00c21d8753fbace8423fe01c39a989d03a3645c9487a37b82ef974a3f93"} Jul 11 03:03:21.868421 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:21.868366 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rkhst" podStartSLOduration=4.922132523 podStartE2EDuration="25.868351484s" totalImagesPullingTime="20.946218961s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 03:02:56 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:03:21.868044242 +0000 UTC m=+25.836656693" watchObservedRunningTime="2026-07-11 03:03:21.868351484 +0000 UTC m=+25.836963936" Jul 11 03:03:22.042226 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:22.042189 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-fvldx" Jul 11 03:03:22.042769 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:22.042743 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-fvldx" Jul 11 03:03:22.609542 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:22.609511 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v9zw2" Jul 11 03:03:22.609701 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:22.609511 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z7wb6" Jul 11 03:03:22.609701 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:03:22.609649 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v9zw2" podUID="e1553e4e-4895-4ef5-9027-14635923ec65" Jul 11 03:03:22.609817 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:22.609511 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t96p7" Jul 11 03:03:22.609817 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:03:22.609712 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z7wb6" podUID="3f82cf26-f769-4fc3-ad0f-b1042b1f63c0" Jul 11 03:03:22.609817 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:03:22.609788 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t96p7" podUID="56f1263c-c5a9-491e-af1e-32394171afec" Jul 11 03:03:22.853550 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:22.853507 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-fvldx" Jul 11 03:03:22.854148 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:22.853814 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-fvldx" Jul 11 03:03:24.609300 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:24.609067 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t96p7" Jul 11 03:03:24.609754 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:24.609073 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z7wb6" Jul 11 03:03:24.609754 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:03:24.609329 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t96p7" podUID="56f1263c-c5a9-491e-af1e-32394171afec" Jul 11 03:03:24.609754 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:03:24.609425 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z7wb6" podUID="3f82cf26-f769-4fc3-ad0f-b1042b1f63c0" Jul 11 03:03:24.609754 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:24.609073 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v9zw2" Jul 11 03:03:24.609754 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:03:24.609538 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v9zw2" podUID="e1553e4e-4895-4ef5-9027-14635923ec65" Jul 11 03:03:24.859106 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:24.859072 2559 generic.go:356] "Generic (PLEG): container finished" podID="b9e9a007-7d90-418e-b327-13b3f2ed817f" containerID="8b96052abcc703e0c5637815d0d8411daab423ae608e9c9d3f5940aa9a7b2f5a" exitCode=0 Jul 11 03:03:24.859252 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:24.859157 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f7sb8" event={"ID":"b9e9a007-7d90-418e-b327-13b3f2ed817f","Type":"ContainerDied","Data":"8b96052abcc703e0c5637815d0d8411daab423ae608e9c9d3f5940aa9a7b2f5a"} Jul 11 03:03:24.865333 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:24.865314 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hb24z_4287b506-42a9-4b1d-85e8-91008605fd2c/ovn-acl-logging/0.log" Jul 11 03:03:24.865698 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:24.865671 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hb24z" event={"ID":"4287b506-42a9-4b1d-85e8-91008605fd2c","Type":"ContainerStarted","Data":"d04363583a39ffa185d5e5f841119bf8a98099931e945c65830dfa751e1ed1c1"} Jul 11 03:03:24.866087 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:24.866072 2559 scope.go:117] "RemoveContainer" containerID="2c642c9c34a6c115fa768b347c04b73a8a7e01fcebeeda54d844ee3261c5347c" Jul 11 03:03:25.870629 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:25.870599 2559 generic.go:356] "Generic (PLEG): container finished" podID="b9e9a007-7d90-418e-b327-13b3f2ed817f" containerID="a46a5ca5968b9426dec8d43120dcc91e5803bfacc87330f5e339df31f6a01a8d" exitCode=0 Jul 11 03:03:25.871297 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:25.870687 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f7sb8" event={"ID":"b9e9a007-7d90-418e-b327-13b3f2ed817f","Type":"ContainerDied","Data":"a46a5ca5968b9426dec8d43120dcc91e5803bfacc87330f5e339df31f6a01a8d"} Jul 11 03:03:25.874823 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:25.874808 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hb24z_4287b506-42a9-4b1d-85e8-91008605fd2c/ovn-acl-logging/0.log" Jul 11 03:03:25.877346 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:25.875575 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hb24z" event={"ID":"4287b506-42a9-4b1d-85e8-91008605fd2c","Type":"ContainerStarted","Data":"a766740d90d772287ebb3e73c43621a4c8b62d21de9b71608a6ad39a62779fb2"} Jul 11 03:03:25.877346 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:25.876723 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hb24z" Jul 11 03:03:25.877346 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:25.876792 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hb24z" Jul 11 03:03:25.877346 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:25.876837 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hb24z" Jul 11 03:03:25.893415 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:25.893388 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hb24z" Jul 11 03:03:25.893560 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:25.893524 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hb24z" Jul 11 03:03:25.923781 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:25.923729 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-hb24z" podStartSLOduration=11.062242171 podStartE2EDuration="29.923713934s" totalImagesPullingTime="18.861471763s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 03:02:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:03:25.92219514 +0000 UTC m=+29.890807590" watchObservedRunningTime="2026-07-11 03:03:25.923713934 +0000 UTC m=+29.892326385" Jul 11 03:03:26.295544 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:26.295512 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-t96p7"] Jul 11 03:03:26.295740 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:26.295615 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-z7wb6"] Jul 11 03:03:26.295740 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:26.295638 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-v9zw2"] Jul 11 03:03:26.295740 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:26.295735 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v9zw2" Jul 11 03:03:26.295914 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:03:26.295846 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v9zw2" podUID="e1553e4e-4895-4ef5-9027-14635923ec65" Jul 11 03:03:26.296325 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:26.296257 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t96p7" Jul 11 03:03:26.296436 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:03:26.296347 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t96p7" podUID="56f1263c-c5a9-491e-af1e-32394171afec" Jul 11 03:03:26.296436 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:26.296407 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z7wb6" Jul 11 03:03:26.296544 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:03:26.296474 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z7wb6" podUID="3f82cf26-f769-4fc3-ad0f-b1042b1f63c0" Jul 11 03:03:26.880346 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:26.880312 2559 generic.go:356] "Generic (PLEG): container finished" podID="b9e9a007-7d90-418e-b327-13b3f2ed817f" containerID="c721ddc9bf05c3fe2293c98a5e555511e696f4a6b7a1c0df9b4375f90b507c3d" exitCode=0 Jul 11 03:03:26.881047 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:26.880394 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f7sb8" event={"ID":"b9e9a007-7d90-418e-b327-13b3f2ed817f","Type":"ContainerDied","Data":"c721ddc9bf05c3fe2293c98a5e555511e696f4a6b7a1c0df9b4375f90b507c3d"} Jul 11 03:03:27.608857 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:27.608829 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v9zw2" Jul 11 03:03:27.608952 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:27.608830 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z7wb6" Jul 11 03:03:27.609014 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:03:27.608986 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v9zw2" podUID="e1553e4e-4895-4ef5-9027-14635923ec65" Jul 11 03:03:27.609084 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:03:27.609064 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z7wb6" podUID="3f82cf26-f769-4fc3-ad0f-b1042b1f63c0" Jul 11 03:03:28.609754 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:28.609714 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t96p7" Jul 11 03:03:28.610220 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:03:28.609848 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t96p7" podUID="56f1263c-c5a9-491e-af1e-32394171afec" Jul 11 03:03:29.609666 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:29.609455 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z7wb6" Jul 11 03:03:29.609830 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:29.609460 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v9zw2" Jul 11 03:03:29.609830 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:03:29.609760 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z7wb6" podUID="3f82cf26-f769-4fc3-ad0f-b1042b1f63c0" Jul 11 03:03:29.610234 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:03:29.609852 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v9zw2" podUID="e1553e4e-4895-4ef5-9027-14635923ec65" Jul 11 03:03:30.203331 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:30.203296 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3f82cf26-f769-4fc3-ad0f-b1042b1f63c0-original-pull-secret\") pod \"global-pull-secret-syncer-z7wb6\" (UID: \"3f82cf26-f769-4fc3-ad0f-b1042b1f63c0\") " pod="kube-system/global-pull-secret-syncer-z7wb6" Jul 11 03:03:30.203544 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:30.203389 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e1553e4e-4895-4ef5-9027-14635923ec65-metrics-certs\") pod \"network-metrics-daemon-v9zw2\" (UID: \"e1553e4e-4895-4ef5-9027-14635923ec65\") " pod="openshift-multus/network-metrics-daemon-v9zw2" Jul 11 03:03:30.203544 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:03:30.203488 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 11 03:03:30.203544 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:03:30.203488 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 11 03:03:30.203697 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:03:30.203547 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1553e4e-4895-4ef5-9027-14635923ec65-metrics-certs podName:e1553e4e-4895-4ef5-9027-14635923ec65 nodeName:}" failed. No retries permitted until 2026-07-11 03:04:02.203529435 +0000 UTC m=+66.172141864 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e1553e4e-4895-4ef5-9027-14635923ec65-metrics-certs") pod "network-metrics-daemon-v9zw2" (UID: "e1553e4e-4895-4ef5-9027-14635923ec65") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 11 03:03:30.203697 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:03:30.203567 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f82cf26-f769-4fc3-ad0f-b1042b1f63c0-original-pull-secret podName:3f82cf26-f769-4fc3-ad0f-b1042b1f63c0 nodeName:}" failed. No retries permitted until 2026-07-11 03:04:02.203557969 +0000 UTC m=+66.172170398 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3f82cf26-f769-4fc3-ad0f-b1042b1f63c0-original-pull-secret") pod "global-pull-secret-syncer-z7wb6" (UID: "3f82cf26-f769-4fc3-ad0f-b1042b1f63c0") : object "kube-system"/"original-pull-secret" not registered Jul 11 03:03:30.404370 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:30.404319 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-slk7g\" (UniqueName: \"kubernetes.io/projected/56f1263c-c5a9-491e-af1e-32394171afec-kube-api-access-slk7g\") pod \"network-check-target-t96p7\" (UID: \"56f1263c-c5a9-491e-af1e-32394171afec\") " pod="openshift-network-diagnostics/network-check-target-t96p7" Jul 11 03:03:30.404571 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:03:30.404475 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 11 03:03:30.404571 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:03:30.404494 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 11 03:03:30.404571 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:03:30.404506 2559 projected.go:196] Error preparing data for projected volume kube-api-access-slk7g for pod openshift-network-diagnostics/network-check-target-t96p7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 11 03:03:30.404571 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:03:30.404562 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/56f1263c-c5a9-491e-af1e-32394171afec-kube-api-access-slk7g podName:56f1263c-c5a9-491e-af1e-32394171afec nodeName:}" failed. No retries permitted until 2026-07-11 03:04:02.404543177 +0000 UTC m=+66.373155606 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-slk7g" (UniqueName: "kubernetes.io/projected/56f1263c-c5a9-491e-af1e-32394171afec-kube-api-access-slk7g") pod "network-check-target-t96p7" (UID: "56f1263c-c5a9-491e-af1e-32394171afec") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 11 03:03:30.609168 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:30.609122 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t96p7" Jul 11 03:03:30.609356 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:03:30.609250 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t96p7" podUID="56f1263c-c5a9-491e-af1e-32394171afec" Jul 11 03:03:31.310365 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:31.310337 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-141.ec2.internal" event="NodeReady" Jul 11 03:03:31.310751 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:31.310458 2559 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 11 03:03:31.362638 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:31.362609 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-n2kth"] Jul 11 03:03:31.387284 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:31.387214 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-lctnz"] Jul 11 03:03:31.387897 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:31.387881 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-n2kth" Jul 11 03:03:31.390608 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:31.390583 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 11 03:03:31.391035 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:31.391013 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 11 03:03:31.391169 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:31.391102 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-r5f9b\"" Jul 11 03:03:31.401196 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:31.401172 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-n2kth"] Jul 11 03:03:31.401292 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:31.401204 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-lctnz"] Jul 11 03:03:31.401292 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:31.401279 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-lctnz" Jul 11 03:03:31.404084 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:31.404060 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 11 03:03:31.404195 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:31.404097 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-bplh5\"" Jul 11 03:03:31.404243 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:31.404198 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 11 03:03:31.404243 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:31.404198 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 11 03:03:31.511803 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:31.511756 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cc8bfa4f-eaf4-4b7e-bc00-bff618dfeacd-config-volume\") pod \"dns-default-n2kth\" (UID: \"cc8bfa4f-eaf4-4b7e-bc00-bff618dfeacd\") " pod="openshift-dns/dns-default-n2kth" Jul 11 03:03:31.511803 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:31.511790 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cc8bfa4f-eaf4-4b7e-bc00-bff618dfeacd-tmp-dir\") pod \"dns-default-n2kth\" (UID: \"cc8bfa4f-eaf4-4b7e-bc00-bff618dfeacd\") " pod="openshift-dns/dns-default-n2kth" Jul 11 03:03:31.511803 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:31.511813 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7dft\" (UniqueName: \"kubernetes.io/projected/252b2aed-79e7-440f-bcc4-1f147e071cbf-kube-api-access-x7dft\") pod \"ingress-canary-lctnz\" (UID: \"252b2aed-79e7-440f-bcc4-1f147e071cbf\") " pod="openshift-ingress-canary/ingress-canary-lctnz" Jul 11 03:03:31.512174 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:31.511893 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwb22\" (UniqueName: \"kubernetes.io/projected/cc8bfa4f-eaf4-4b7e-bc00-bff618dfeacd-kube-api-access-hwb22\") pod \"dns-default-n2kth\" (UID: \"cc8bfa4f-eaf4-4b7e-bc00-bff618dfeacd\") " pod="openshift-dns/dns-default-n2kth" Jul 11 03:03:31.512174 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:31.511944 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/252b2aed-79e7-440f-bcc4-1f147e071cbf-cert\") pod \"ingress-canary-lctnz\" (UID: \"252b2aed-79e7-440f-bcc4-1f147e071cbf\") " pod="openshift-ingress-canary/ingress-canary-lctnz" Jul 11 03:03:31.512174 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:31.511995 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cc8bfa4f-eaf4-4b7e-bc00-bff618dfeacd-metrics-tls\") pod \"dns-default-n2kth\" (UID: \"cc8bfa4f-eaf4-4b7e-bc00-bff618dfeacd\") " pod="openshift-dns/dns-default-n2kth" Jul 11 03:03:31.609120 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:31.609087 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z7wb6" Jul 11 03:03:31.609280 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:31.609129 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v9zw2" Jul 11 03:03:31.611699 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:31.611680 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 11 03:03:31.611788 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:31.611713 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 11 03:03:31.611839 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:31.611818 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6jspr\"" Jul 11 03:03:31.612652 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:31.612634 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cc8bfa4f-eaf4-4b7e-bc00-bff618dfeacd-config-volume\") pod \"dns-default-n2kth\" (UID: \"cc8bfa4f-eaf4-4b7e-bc00-bff618dfeacd\") " pod="openshift-dns/dns-default-n2kth" Jul 11 03:03:31.612731 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:31.612666 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cc8bfa4f-eaf4-4b7e-bc00-bff618dfeacd-tmp-dir\") pod \"dns-default-n2kth\" (UID: \"cc8bfa4f-eaf4-4b7e-bc00-bff618dfeacd\") " pod="openshift-dns/dns-default-n2kth" Jul 11 03:03:31.612731 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:31.612706 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x7dft\" (UniqueName: \"kubernetes.io/projected/252b2aed-79e7-440f-bcc4-1f147e071cbf-kube-api-access-x7dft\") pod \"ingress-canary-lctnz\" (UID: \"252b2aed-79e7-440f-bcc4-1f147e071cbf\") " pod="openshift-ingress-canary/ingress-canary-lctnz" Jul 11 03:03:31.612835 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:31.612757 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwb22\" (UniqueName: \"kubernetes.io/projected/cc8bfa4f-eaf4-4b7e-bc00-bff618dfeacd-kube-api-access-hwb22\") pod \"dns-default-n2kth\" (UID: \"cc8bfa4f-eaf4-4b7e-bc00-bff618dfeacd\") " pod="openshift-dns/dns-default-n2kth" Jul 11 03:03:31.612835 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:31.612801 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/252b2aed-79e7-440f-bcc4-1f147e071cbf-cert\") pod \"ingress-canary-lctnz\" (UID: \"252b2aed-79e7-440f-bcc4-1f147e071cbf\") " pod="openshift-ingress-canary/ingress-canary-lctnz" Jul 11 03:03:31.612932 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:31.612836 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cc8bfa4f-eaf4-4b7e-bc00-bff618dfeacd-metrics-tls\") pod \"dns-default-n2kth\" (UID: \"cc8bfa4f-eaf4-4b7e-bc00-bff618dfeacd\") " pod="openshift-dns/dns-default-n2kth" Jul 11 03:03:31.613000 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:03:31.612986 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 11 03:03:31.613053 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:03:31.613043 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc8bfa4f-eaf4-4b7e-bc00-bff618dfeacd-metrics-tls podName:cc8bfa4f-eaf4-4b7e-bc00-bff618dfeacd nodeName:}" failed. No retries permitted until 2026-07-11 03:03:32.113023555 +0000 UTC m=+36.081635984 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cc8bfa4f-eaf4-4b7e-bc00-bff618dfeacd-metrics-tls") pod "dns-default-n2kth" (UID: "cc8bfa4f-eaf4-4b7e-bc00-bff618dfeacd") : secret "dns-default-metrics-tls" not found Jul 11 03:03:31.613116 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:31.613062 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cc8bfa4f-eaf4-4b7e-bc00-bff618dfeacd-tmp-dir\") pod \"dns-default-n2kth\" (UID: \"cc8bfa4f-eaf4-4b7e-bc00-bff618dfeacd\") " pod="openshift-dns/dns-default-n2kth" Jul 11 03:03:31.613291 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:31.613274 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cc8bfa4f-eaf4-4b7e-bc00-bff618dfeacd-config-volume\") pod \"dns-default-n2kth\" (UID: \"cc8bfa4f-eaf4-4b7e-bc00-bff618dfeacd\") " pod="openshift-dns/dns-default-n2kth" Jul 11 03:03:31.617296 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:31.617277 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/252b2aed-79e7-440f-bcc4-1f147e071cbf-cert\") pod \"ingress-canary-lctnz\" (UID: \"252b2aed-79e7-440f-bcc4-1f147e071cbf\") " pod="openshift-ingress-canary/ingress-canary-lctnz" Jul 11 03:03:31.623596 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:31.623571 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwb22\" (UniqueName: \"kubernetes.io/projected/cc8bfa4f-eaf4-4b7e-bc00-bff618dfeacd-kube-api-access-hwb22\") pod \"dns-default-n2kth\" (UID: \"cc8bfa4f-eaf4-4b7e-bc00-bff618dfeacd\") " pod="openshift-dns/dns-default-n2kth" Jul 11 03:03:31.623683 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:31.623601 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7dft\" (UniqueName: \"kubernetes.io/projected/252b2aed-79e7-440f-bcc4-1f147e071cbf-kube-api-access-x7dft\") pod \"ingress-canary-lctnz\" (UID: \"252b2aed-79e7-440f-bcc4-1f147e071cbf\") " pod="openshift-ingress-canary/ingress-canary-lctnz" Jul 11 03:03:31.720195 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:31.720110 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-lctnz" Jul 11 03:03:31.896489 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:31.896454 2559 generic.go:356] "Generic (PLEG): container finished" podID="b9e9a007-7d90-418e-b327-13b3f2ed817f" containerID="eb99cdde11338d303ee5f7294f8ae1b408f7b1282842f4d35825675094588ac2" exitCode=0 Jul 11 03:03:31.896649 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:31.896545 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f7sb8" event={"ID":"b9e9a007-7d90-418e-b327-13b3f2ed817f","Type":"ContainerDied","Data":"eb99cdde11338d303ee5f7294f8ae1b408f7b1282842f4d35825675094588ac2"} Jul 11 03:03:31.911927 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:31.911898 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-lctnz"] Jul 11 03:03:31.915164 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:03:31.915138 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod252b2aed_79e7_440f_bcc4_1f147e071cbf.slice/crio-04740c3e5695584b6ddc426b6d5f4b48dbf5f4efa564c4c1b3c918dd43fa1846 WatchSource:0}: Error finding container 04740c3e5695584b6ddc426b6d5f4b48dbf5f4efa564c4c1b3c918dd43fa1846: Status 404 returned error can't find the container with id 04740c3e5695584b6ddc426b6d5f4b48dbf5f4efa564c4c1b3c918dd43fa1846 Jul 11 03:03:32.115861 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:32.115670 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cc8bfa4f-eaf4-4b7e-bc00-bff618dfeacd-metrics-tls\") pod \"dns-default-n2kth\" (UID: \"cc8bfa4f-eaf4-4b7e-bc00-bff618dfeacd\") " pod="openshift-dns/dns-default-n2kth" Jul 11 03:03:32.116066 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:03:32.115823 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 11 03:03:32.116066 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:03:32.116004 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc8bfa4f-eaf4-4b7e-bc00-bff618dfeacd-metrics-tls podName:cc8bfa4f-eaf4-4b7e-bc00-bff618dfeacd nodeName:}" failed. No retries permitted until 2026-07-11 03:03:33.115988351 +0000 UTC m=+37.084600793 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cc8bfa4f-eaf4-4b7e-bc00-bff618dfeacd-metrics-tls") pod "dns-default-n2kth" (UID: "cc8bfa4f-eaf4-4b7e-bc00-bff618dfeacd") : secret "dns-default-metrics-tls" not found Jul 11 03:03:32.609687 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:32.609543 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t96p7" Jul 11 03:03:32.612082 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:32.612059 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 11 03:03:32.612324 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:32.612307 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 11 03:03:32.612437 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:32.612340 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-62276\"" Jul 11 03:03:32.901090 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:32.900994 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-lctnz" event={"ID":"252b2aed-79e7-440f-bcc4-1f147e071cbf","Type":"ContainerStarted","Data":"04740c3e5695584b6ddc426b6d5f4b48dbf5f4efa564c4c1b3c918dd43fa1846"} Jul 11 03:03:32.904536 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:32.904441 2559 generic.go:356] "Generic (PLEG): container finished" podID="b9e9a007-7d90-418e-b327-13b3f2ed817f" containerID="6ce1abb4c51408df761ffcfa47c19861afbbc4cfa1cbb0b94be5c9829d735cb9" exitCode=0 Jul 11 03:03:32.904536 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:32.904489 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f7sb8" event={"ID":"b9e9a007-7d90-418e-b327-13b3f2ed817f","Type":"ContainerDied","Data":"6ce1abb4c51408df761ffcfa47c19861afbbc4cfa1cbb0b94be5c9829d735cb9"} Jul 11 03:03:33.122421 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:33.122376 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cc8bfa4f-eaf4-4b7e-bc00-bff618dfeacd-metrics-tls\") pod \"dns-default-n2kth\" (UID: \"cc8bfa4f-eaf4-4b7e-bc00-bff618dfeacd\") " pod="openshift-dns/dns-default-n2kth" Jul 11 03:03:33.122598 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:03:33.122558 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 11 03:03:33.122663 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:03:33.122637 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc8bfa4f-eaf4-4b7e-bc00-bff618dfeacd-metrics-tls podName:cc8bfa4f-eaf4-4b7e-bc00-bff618dfeacd nodeName:}" failed. No retries permitted until 2026-07-11 03:03:35.122614138 +0000 UTC m=+39.091226571 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cc8bfa4f-eaf4-4b7e-bc00-bff618dfeacd-metrics-tls") pod "dns-default-n2kth" (UID: "cc8bfa4f-eaf4-4b7e-bc00-bff618dfeacd") : secret "dns-default-metrics-tls" not found Jul 11 03:03:33.911388 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:33.911351 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f7sb8" event={"ID":"b9e9a007-7d90-418e-b327-13b3f2ed817f","Type":"ContainerStarted","Data":"032643a9d123bf63d59a318eef02f66e5c2de469b4d98d3dd763625d0e242e45"} Jul 11 03:03:33.934137 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:33.934075 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-f7sb8" podStartSLOduration=9.174448065 podStartE2EDuration="37.934053011s" totalImagesPullingTime="28.759604946s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 03:02:56 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:03:33.933724586 +0000 UTC m=+37.902337049" watchObservedRunningTime="2026-07-11 03:03:33.934053011 +0000 UTC m=+37.902665454" Jul 11 03:03:34.915342 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:34.915248 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-lctnz" event={"ID":"252b2aed-79e7-440f-bcc4-1f147e071cbf","Type":"ContainerStarted","Data":"3cadccecd1e22e109f0c87b6f633a908b8f6605231cb062603b4a85bec8542b5"} Jul 11 03:03:34.931196 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:34.931146 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-lctnz" podStartSLOduration=1.308573229 podStartE2EDuration="3.931129884s" totalImagesPullingTime="2.622556655s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:03:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:03:34.930135706 +0000 UTC m=+38.898748156" watchObservedRunningTime="2026-07-11 03:03:34.931129884 +0000 UTC m=+38.899742326" Jul 11 03:03:35.138599 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:35.138542 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cc8bfa4f-eaf4-4b7e-bc00-bff618dfeacd-metrics-tls\") pod \"dns-default-n2kth\" (UID: \"cc8bfa4f-eaf4-4b7e-bc00-bff618dfeacd\") " pod="openshift-dns/dns-default-n2kth" Jul 11 03:03:35.138763 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:03:35.138676 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 11 03:03:35.138763 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:03:35.138740 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc8bfa4f-eaf4-4b7e-bc00-bff618dfeacd-metrics-tls podName:cc8bfa4f-eaf4-4b7e-bc00-bff618dfeacd nodeName:}" failed. No retries permitted until 2026-07-11 03:03:39.138725278 +0000 UTC m=+43.107337707 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cc8bfa4f-eaf4-4b7e-bc00-bff618dfeacd-metrics-tls") pod "dns-default-n2kth" (UID: "cc8bfa4f-eaf4-4b7e-bc00-bff618dfeacd") : secret "dns-default-metrics-tls" not found Jul 11 03:03:39.167824 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:39.167778 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cc8bfa4f-eaf4-4b7e-bc00-bff618dfeacd-metrics-tls\") pod \"dns-default-n2kth\" (UID: \"cc8bfa4f-eaf4-4b7e-bc00-bff618dfeacd\") " pod="openshift-dns/dns-default-n2kth" Jul 11 03:03:39.168219 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:03:39.167922 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 11 03:03:39.168219 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:03:39.168005 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc8bfa4f-eaf4-4b7e-bc00-bff618dfeacd-metrics-tls podName:cc8bfa4f-eaf4-4b7e-bc00-bff618dfeacd nodeName:}" failed. No retries permitted until 2026-07-11 03:03:47.167988585 +0000 UTC m=+51.136601014 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cc8bfa4f-eaf4-4b7e-bc00-bff618dfeacd-metrics-tls") pod "dns-default-n2kth" (UID: "cc8bfa4f-eaf4-4b7e-bc00-bff618dfeacd") : secret "dns-default-metrics-tls" not found Jul 11 03:03:47.228719 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:47.228682 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cc8bfa4f-eaf4-4b7e-bc00-bff618dfeacd-metrics-tls\") pod \"dns-default-n2kth\" (UID: \"cc8bfa4f-eaf4-4b7e-bc00-bff618dfeacd\") " pod="openshift-dns/dns-default-n2kth" Jul 11 03:03:47.229129 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:03:47.228836 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 11 03:03:47.229129 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:03:47.228900 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc8bfa4f-eaf4-4b7e-bc00-bff618dfeacd-metrics-tls podName:cc8bfa4f-eaf4-4b7e-bc00-bff618dfeacd nodeName:}" failed. No retries permitted until 2026-07-11 03:04:03.228884903 +0000 UTC m=+67.197497332 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cc8bfa4f-eaf4-4b7e-bc00-bff618dfeacd-metrics-tls") pod "dns-default-n2kth" (UID: "cc8bfa4f-eaf4-4b7e-bc00-bff618dfeacd") : secret "dns-default-metrics-tls" not found Jul 11 03:03:49.744773 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:49.744728 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7456896c56-s2kxt"] Jul 11 03:03:49.766442 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:49.766413 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bf7968d5-g9xdk"] Jul 11 03:03:49.766623 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:49.766564 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7456896c56-s2kxt" Jul 11 03:03:49.769148 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:49.769118 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 11 03:03:49.769148 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:49.769120 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 11 03:03:49.769341 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:49.769209 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 11 03:03:49.769341 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:49.769307 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 11 03:03:49.769563 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:49.769547 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 11 03:03:49.770189 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:49.770172 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 11 03:03:49.770275 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:49.770233 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 11 03:03:49.783341 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:49.783314 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bf7968d5-g9xdk"] Jul 11 03:03:49.783467 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:49.783457 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7456896c56-s2kxt"] Jul 11 03:03:49.783569 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:49.783554 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bf7968d5-g9xdk" Jul 11 03:03:49.786024 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:49.786003 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 11 03:03:49.949887 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:49.949849 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/290fba72-89d9-43c6-acb6-f69aa7beb9d9-ca\") pod \"cluster-proxy-proxy-agent-7456896c56-s2kxt\" (UID: \"290fba72-89d9-43c6-acb6-f69aa7beb9d9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7456896c56-s2kxt" Jul 11 03:03:49.949887 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:49.949896 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/290fba72-89d9-43c6-acb6-f69aa7beb9d9-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7456896c56-s2kxt\" (UID: \"290fba72-89d9-43c6-acb6-f69aa7beb9d9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7456896c56-s2kxt" Jul 11 03:03:49.950129 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:49.949916 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/290fba72-89d9-43c6-acb6-f69aa7beb9d9-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7456896c56-s2kxt\" (UID: \"290fba72-89d9-43c6-acb6-f69aa7beb9d9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7456896c56-s2kxt" Jul 11 03:03:49.950129 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:49.949989 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jh54k\" (UniqueName: \"kubernetes.io/projected/290fba72-89d9-43c6-acb6-f69aa7beb9d9-kube-api-access-jh54k\") pod \"cluster-proxy-proxy-agent-7456896c56-s2kxt\" (UID: \"290fba72-89d9-43c6-acb6-f69aa7beb9d9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7456896c56-s2kxt" Jul 11 03:03:49.950129 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:49.950035 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/290fba72-89d9-43c6-acb6-f69aa7beb9d9-hub\") pod \"cluster-proxy-proxy-agent-7456896c56-s2kxt\" (UID: \"290fba72-89d9-43c6-acb6-f69aa7beb9d9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7456896c56-s2kxt" Jul 11 03:03:49.950129 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:49.950091 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qgtfm\" (UniqueName: \"kubernetes.io/projected/6f413b3b-4205-4b06-a3a6-96b76a2ea827-kube-api-access-qgtfm\") pod \"klusterlet-addon-workmgr-6bf7968d5-g9xdk\" (UID: \"6f413b3b-4205-4b06-a3a6-96b76a2ea827\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bf7968d5-g9xdk" Jul 11 03:03:49.950252 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:49.950158 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/6f413b3b-4205-4b06-a3a6-96b76a2ea827-klusterlet-config\") pod \"klusterlet-addon-workmgr-6bf7968d5-g9xdk\" (UID: \"6f413b3b-4205-4b06-a3a6-96b76a2ea827\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bf7968d5-g9xdk" Jul 11 03:03:49.950252 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:49.950198 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/290fba72-89d9-43c6-acb6-f69aa7beb9d9-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7456896c56-s2kxt\" (UID: \"290fba72-89d9-43c6-acb6-f69aa7beb9d9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7456896c56-s2kxt" Jul 11 03:03:49.950252 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:49.950220 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6f413b3b-4205-4b06-a3a6-96b76a2ea827-tmp\") pod \"klusterlet-addon-workmgr-6bf7968d5-g9xdk\" (UID: \"6f413b3b-4205-4b06-a3a6-96b76a2ea827\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bf7968d5-g9xdk" Jul 11 03:03:50.051119 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:50.051083 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/290fba72-89d9-43c6-acb6-f69aa7beb9d9-ca\") pod \"cluster-proxy-proxy-agent-7456896c56-s2kxt\" (UID: \"290fba72-89d9-43c6-acb6-f69aa7beb9d9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7456896c56-s2kxt" Jul 11 03:03:50.051119 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:50.051119 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/290fba72-89d9-43c6-acb6-f69aa7beb9d9-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7456896c56-s2kxt\" (UID: \"290fba72-89d9-43c6-acb6-f69aa7beb9d9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7456896c56-s2kxt" Jul 11 03:03:50.051341 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:50.051138 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/290fba72-89d9-43c6-acb6-f69aa7beb9d9-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7456896c56-s2kxt\" (UID: \"290fba72-89d9-43c6-acb6-f69aa7beb9d9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7456896c56-s2kxt" Jul 11 03:03:50.051341 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:50.051156 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jh54k\" (UniqueName: \"kubernetes.io/projected/290fba72-89d9-43c6-acb6-f69aa7beb9d9-kube-api-access-jh54k\") pod \"cluster-proxy-proxy-agent-7456896c56-s2kxt\" (UID: \"290fba72-89d9-43c6-acb6-f69aa7beb9d9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7456896c56-s2kxt" Jul 11 03:03:50.051425 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:50.051390 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/290fba72-89d9-43c6-acb6-f69aa7beb9d9-hub\") pod \"cluster-proxy-proxy-agent-7456896c56-s2kxt\" (UID: \"290fba72-89d9-43c6-acb6-f69aa7beb9d9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7456896c56-s2kxt" Jul 11 03:03:50.051483 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:50.051464 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qgtfm\" (UniqueName: \"kubernetes.io/projected/6f413b3b-4205-4b06-a3a6-96b76a2ea827-kube-api-access-qgtfm\") pod \"klusterlet-addon-workmgr-6bf7968d5-g9xdk\" (UID: \"6f413b3b-4205-4b06-a3a6-96b76a2ea827\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bf7968d5-g9xdk" Jul 11 03:03:50.051542 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:50.051524 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/6f413b3b-4205-4b06-a3a6-96b76a2ea827-klusterlet-config\") pod \"klusterlet-addon-workmgr-6bf7968d5-g9xdk\" (UID: \"6f413b3b-4205-4b06-a3a6-96b76a2ea827\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bf7968d5-g9xdk" Jul 11 03:03:50.051583 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:50.051574 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/290fba72-89d9-43c6-acb6-f69aa7beb9d9-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7456896c56-s2kxt\" (UID: \"290fba72-89d9-43c6-acb6-f69aa7beb9d9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7456896c56-s2kxt" Jul 11 03:03:50.051634 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:50.051599 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6f413b3b-4205-4b06-a3a6-96b76a2ea827-tmp\") pod \"klusterlet-addon-workmgr-6bf7968d5-g9xdk\" (UID: \"6f413b3b-4205-4b06-a3a6-96b76a2ea827\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bf7968d5-g9xdk" Jul 11 03:03:50.052063 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:50.052034 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/290fba72-89d9-43c6-acb6-f69aa7beb9d9-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7456896c56-s2kxt\" (UID: \"290fba72-89d9-43c6-acb6-f69aa7beb9d9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7456896c56-s2kxt" Jul 11 03:03:50.052183 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:50.052046 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6f413b3b-4205-4b06-a3a6-96b76a2ea827-tmp\") pod \"klusterlet-addon-workmgr-6bf7968d5-g9xdk\" (UID: \"6f413b3b-4205-4b06-a3a6-96b76a2ea827\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bf7968d5-g9xdk" Jul 11 03:03:50.055147 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:50.055121 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/290fba72-89d9-43c6-acb6-f69aa7beb9d9-ca\") pod \"cluster-proxy-proxy-agent-7456896c56-s2kxt\" (UID: \"290fba72-89d9-43c6-acb6-f69aa7beb9d9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7456896c56-s2kxt" Jul 11 03:03:50.055256 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:50.055133 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/290fba72-89d9-43c6-acb6-f69aa7beb9d9-hub\") pod \"cluster-proxy-proxy-agent-7456896c56-s2kxt\" (UID: \"290fba72-89d9-43c6-acb6-f69aa7beb9d9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7456896c56-s2kxt" Jul 11 03:03:50.055256 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:50.055187 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/290fba72-89d9-43c6-acb6-f69aa7beb9d9-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7456896c56-s2kxt\" (UID: \"290fba72-89d9-43c6-acb6-f69aa7beb9d9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7456896c56-s2kxt" Jul 11 03:03:50.055256 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:50.055242 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/290fba72-89d9-43c6-acb6-f69aa7beb9d9-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7456896c56-s2kxt\" (UID: \"290fba72-89d9-43c6-acb6-f69aa7beb9d9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7456896c56-s2kxt" Jul 11 03:03:50.055464 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:50.055242 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/6f413b3b-4205-4b06-a3a6-96b76a2ea827-klusterlet-config\") pod \"klusterlet-addon-workmgr-6bf7968d5-g9xdk\" (UID: \"6f413b3b-4205-4b06-a3a6-96b76a2ea827\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bf7968d5-g9xdk" Jul 11 03:03:50.059052 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:50.059029 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qgtfm\" (UniqueName: \"kubernetes.io/projected/6f413b3b-4205-4b06-a3a6-96b76a2ea827-kube-api-access-qgtfm\") pod \"klusterlet-addon-workmgr-6bf7968d5-g9xdk\" (UID: \"6f413b3b-4205-4b06-a3a6-96b76a2ea827\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bf7968d5-g9xdk" Jul 11 03:03:50.059240 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:50.059222 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jh54k\" (UniqueName: \"kubernetes.io/projected/290fba72-89d9-43c6-acb6-f69aa7beb9d9-kube-api-access-jh54k\") pod \"cluster-proxy-proxy-agent-7456896c56-s2kxt\" (UID: \"290fba72-89d9-43c6-acb6-f69aa7beb9d9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7456896c56-s2kxt" Jul 11 03:03:50.083112 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:50.083077 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7456896c56-s2kxt" Jul 11 03:03:50.092219 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:50.092194 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bf7968d5-g9xdk" Jul 11 03:03:50.252551 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:50.252516 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7456896c56-s2kxt"] Jul 11 03:03:50.255687 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:03:50.255659 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod290fba72_89d9_43c6_acb6_f69aa7beb9d9.slice/crio-ab27dfc361ab4ba8b203444a004da2e20143abbf84f0a67c41fab4551572f449 WatchSource:0}: Error finding container ab27dfc361ab4ba8b203444a004da2e20143abbf84f0a67c41fab4551572f449: Status 404 returned error can't find the container with id ab27dfc361ab4ba8b203444a004da2e20143abbf84f0a67c41fab4551572f449 Jul 11 03:03:50.275567 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:50.275538 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bf7968d5-g9xdk"] Jul 11 03:03:50.278392 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:03:50.278367 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f413b3b_4205_4b06_a3a6_96b76a2ea827.slice/crio-65a685f3468f8895bc678bdf8620f2f0182ade17f2a22604db72c08a1d382e0d WatchSource:0}: Error finding container 65a685f3468f8895bc678bdf8620f2f0182ade17f2a22604db72c08a1d382e0d: Status 404 returned error can't find the container with id 65a685f3468f8895bc678bdf8620f2f0182ade17f2a22604db72c08a1d382e0d Jul 11 03:03:50.955928 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:50.955866 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bf7968d5-g9xdk" event={"ID":"6f413b3b-4205-4b06-a3a6-96b76a2ea827","Type":"ContainerStarted","Data":"65a685f3468f8895bc678bdf8620f2f0182ade17f2a22604db72c08a1d382e0d"} Jul 11 03:03:50.957881 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:50.957849 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7456896c56-s2kxt" event={"ID":"290fba72-89d9-43c6-acb6-f69aa7beb9d9","Type":"ContainerStarted","Data":"ab27dfc361ab4ba8b203444a004da2e20143abbf84f0a67c41fab4551572f449"} Jul 11 03:03:55.971760 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:55.971726 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bf7968d5-g9xdk" event={"ID":"6f413b3b-4205-4b06-a3a6-96b76a2ea827","Type":"ContainerStarted","Data":"f6dfe10c16374b961da31cb767da5c3130649f9473f8ccca0196570870aeb148"} Jul 11 03:03:55.972221 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:55.971970 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bf7968d5-g9xdk" Jul 11 03:03:55.973825 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:55.973804 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bf7968d5-g9xdk" Jul 11 03:03:55.974330 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:55.974306 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7456896c56-s2kxt" event={"ID":"290fba72-89d9-43c6-acb6-f69aa7beb9d9","Type":"ContainerStarted","Data":"fd4fff2b6d20f003faa86c50b553e33693460f20d380276a63ca92ad7d669e3a"} Jul 11 03:03:55.974423 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:55.974344 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7456896c56-s2kxt" event={"ID":"290fba72-89d9-43c6-acb6-f69aa7beb9d9","Type":"ContainerStarted","Data":"6294b1d77bbe5fbb40d26bc5dddf3aaa173a6fcdc37c4aef5902346e2c535553"} Jul 11 03:03:55.974423 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:55.974357 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7456896c56-s2kxt" event={"ID":"290fba72-89d9-43c6-acb6-f69aa7beb9d9","Type":"ContainerStarted","Data":"aa8e86405071f6f3496fad8759f68e3d63bc736074aceed0e08571cbc6555f62"} Jul 11 03:03:55.987734 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:55.987694 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bf7968d5-g9xdk" podStartSLOduration=1.8966941400000001 podStartE2EDuration="6.987681077s" totalImagesPullingTime="5.090986937s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:03:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:03:55.987014058 +0000 UTC m=+59.955626510" watchObservedRunningTime="2026-07-11 03:03:55.987681077 +0000 UTC m=+59.956293506" Jul 11 03:03:56.019650 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:56.019595 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7456896c56-s2kxt" podStartSLOduration=1.9075220590000002 podStartE2EDuration="7.019565923s" totalImagesPullingTime="5.112043864s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:03:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:03:56.018566345 +0000 UTC m=+59.987178796" watchObservedRunningTime="2026-07-11 03:03:56.019565923 +0000 UTC m=+59.988178374" Jul 11 03:03:57.893460 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:03:57.893424 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hb24z" Jul 11 03:04:02.254351 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:04:02.254288 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e1553e4e-4895-4ef5-9027-14635923ec65-metrics-certs\") pod \"network-metrics-daemon-v9zw2\" (UID: \"e1553e4e-4895-4ef5-9027-14635923ec65\") " pod="openshift-multus/network-metrics-daemon-v9zw2" Jul 11 03:04:02.254833 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:04:02.254362 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3f82cf26-f769-4fc3-ad0f-b1042b1f63c0-original-pull-secret\") pod \"global-pull-secret-syncer-z7wb6\" (UID: \"3f82cf26-f769-4fc3-ad0f-b1042b1f63c0\") " pod="kube-system/global-pull-secret-syncer-z7wb6" Jul 11 03:04:02.257169 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:04:02.257148 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 11 03:04:02.257232 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:04:02.257178 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 11 03:04:02.265311 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:04:02.265286 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 11 03:04:02.265371 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:04:02.265355 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1553e4e-4895-4ef5-9027-14635923ec65-metrics-certs podName:e1553e4e-4895-4ef5-9027-14635923ec65 nodeName:}" failed. No retries permitted until 2026-07-11 03:05:06.265336915 +0000 UTC m=+130.233949344 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e1553e4e-4895-4ef5-9027-14635923ec65-metrics-certs") pod "network-metrics-daemon-v9zw2" (UID: "e1553e4e-4895-4ef5-9027-14635923ec65") : secret "metrics-daemon-secret" not found Jul 11 03:04:02.267515 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:04:02.267492 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3f82cf26-f769-4fc3-ad0f-b1042b1f63c0-original-pull-secret\") pod \"global-pull-secret-syncer-z7wb6\" (UID: \"3f82cf26-f769-4fc3-ad0f-b1042b1f63c0\") " pod="kube-system/global-pull-secret-syncer-z7wb6" Jul 11 03:04:02.455753 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:04:02.455717 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-slk7g\" (UniqueName: \"kubernetes.io/projected/56f1263c-c5a9-491e-af1e-32394171afec-kube-api-access-slk7g\") pod \"network-check-target-t96p7\" (UID: \"56f1263c-c5a9-491e-af1e-32394171afec\") " pod="openshift-network-diagnostics/network-check-target-t96p7" Jul 11 03:04:02.458488 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:04:02.458468 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 11 03:04:02.469495 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:04:02.469466 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 11 03:04:02.480158 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:04:02.480125 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-slk7g\" (UniqueName: \"kubernetes.io/projected/56f1263c-c5a9-491e-af1e-32394171afec-kube-api-access-slk7g\") pod \"network-check-target-t96p7\" (UID: \"56f1263c-c5a9-491e-af1e-32394171afec\") " pod="openshift-network-diagnostics/network-check-target-t96p7" Jul 11 03:04:02.523146 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:04:02.523056 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z7wb6" Jul 11 03:04:02.624935 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:04:02.624306 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-62276\"" Jul 11 03:04:02.632981 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:04:02.631054 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t96p7" Jul 11 03:04:02.707607 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:04:02.707578 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-z7wb6"] Jul 11 03:04:02.710484 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:04:02.710459 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f82cf26_f769_4fc3_ad0f_b1042b1f63c0.slice/crio-aecb50e2af303aeb0be404e72ec82d93b7e77df3611f54d0b4b43232193786f3 WatchSource:0}: Error finding container aecb50e2af303aeb0be404e72ec82d93b7e77df3611f54d0b4b43232193786f3: Status 404 returned error can't find the container with id aecb50e2af303aeb0be404e72ec82d93b7e77df3611f54d0b4b43232193786f3 Jul 11 03:04:02.776044 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:04:02.776020 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-t96p7"] Jul 11 03:04:02.779238 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:04:02.779207 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56f1263c_c5a9_491e_af1e_32394171afec.slice/crio-72a6abbd7d07a962f2ec8717fb3acfd810cdc2c6f0f354252fde558d6afb2144 WatchSource:0}: Error finding container 72a6abbd7d07a962f2ec8717fb3acfd810cdc2c6f0f354252fde558d6afb2144: Status 404 returned error can't find the container with id 72a6abbd7d07a962f2ec8717fb3acfd810cdc2c6f0f354252fde558d6afb2144 Jul 11 03:04:02.992275 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:04:02.992241 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-t96p7" event={"ID":"56f1263c-c5a9-491e-af1e-32394171afec","Type":"ContainerStarted","Data":"72a6abbd7d07a962f2ec8717fb3acfd810cdc2c6f0f354252fde558d6afb2144"} Jul 11 03:04:02.993489 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:04:02.993466 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-z7wb6" event={"ID":"3f82cf26-f769-4fc3-ad0f-b1042b1f63c0","Type":"ContainerStarted","Data":"aecb50e2af303aeb0be404e72ec82d93b7e77df3611f54d0b4b43232193786f3"} Jul 11 03:04:03.262859 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:04:03.262768 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cc8bfa4f-eaf4-4b7e-bc00-bff618dfeacd-metrics-tls\") pod \"dns-default-n2kth\" (UID: \"cc8bfa4f-eaf4-4b7e-bc00-bff618dfeacd\") " pod="openshift-dns/dns-default-n2kth" Jul 11 03:04:03.263306 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:04:03.262933 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 11 03:04:03.263306 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:04:03.263036 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc8bfa4f-eaf4-4b7e-bc00-bff618dfeacd-metrics-tls podName:cc8bfa4f-eaf4-4b7e-bc00-bff618dfeacd nodeName:}" failed. No retries permitted until 2026-07-11 03:04:35.263012408 +0000 UTC m=+99.231624842 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cc8bfa4f-eaf4-4b7e-bc00-bff618dfeacd-metrics-tls") pod "dns-default-n2kth" (UID: "cc8bfa4f-eaf4-4b7e-bc00-bff618dfeacd") : secret "dns-default-metrics-tls" not found Jul 11 03:04:06.005697 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:04:06.005658 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-t96p7" event={"ID":"56f1263c-c5a9-491e-af1e-32394171afec","Type":"ContainerStarted","Data":"0b4a7326d097b4e7ccdd4ceaa5e8bc446827d6ef997fda50141fbba1ffff232f"} Jul 11 03:04:06.006143 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:04:06.005782 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-t96p7" Jul 11 03:04:06.022507 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:04:06.022454 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-t96p7" podStartSLOduration=67.021844467 podStartE2EDuration="1m10.022434165s" totalImagesPullingTime="3.000589698s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:02:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:04:06.021391052 +0000 UTC m=+69.990003505" watchObservedRunningTime="2026-07-11 03:04:06.022434165 +0000 UTC m=+69.991046619" Jul 11 03:04:08.013584 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:04:08.013546 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-z7wb6" event={"ID":"3f82cf26-f769-4fc3-ad0f-b1042b1f63c0","Type":"ContainerStarted","Data":"03e7ba5a4369520d8b83945c38129a739b132884e694eff46f637c0fdb117650"} Jul 11 03:04:08.027246 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:04:08.027191 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-z7wb6" podStartSLOduration=67.340255534 podStartE2EDuration="1m12.027168638s" totalImagesPullingTime="4.686913104s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 03:02:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:04:08.027003852 +0000 UTC m=+71.995616303" watchObservedRunningTime="2026-07-11 03:04:08.027168638 +0000 UTC m=+71.995781090" Jul 11 03:04:35.290448 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:04:35.290310 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cc8bfa4f-eaf4-4b7e-bc00-bff618dfeacd-metrics-tls\") pod \"dns-default-n2kth\" (UID: \"cc8bfa4f-eaf4-4b7e-bc00-bff618dfeacd\") " pod="openshift-dns/dns-default-n2kth" Jul 11 03:04:35.290910 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:04:35.290464 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 11 03:04:35.290910 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:04:35.290547 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc8bfa4f-eaf4-4b7e-bc00-bff618dfeacd-metrics-tls podName:cc8bfa4f-eaf4-4b7e-bc00-bff618dfeacd nodeName:}" failed. No retries permitted until 2026-07-11 03:05:39.290527492 +0000 UTC m=+163.259139921 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cc8bfa4f-eaf4-4b7e-bc00-bff618dfeacd-metrics-tls") pod "dns-default-n2kth" (UID: "cc8bfa4f-eaf4-4b7e-bc00-bff618dfeacd") : secret "dns-default-metrics-tls" not found Jul 11 03:04:37.012604 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:04:37.012567 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-t96p7" Jul 11 03:05:06.306453 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:05:06.306396 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e1553e4e-4895-4ef5-9027-14635923ec65-metrics-certs\") pod \"network-metrics-daemon-v9zw2\" (UID: \"e1553e4e-4895-4ef5-9027-14635923ec65\") " pod="openshift-multus/network-metrics-daemon-v9zw2" Jul 11 03:05:06.306891 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:05:06.306553 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 11 03:05:06.306891 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:05:06.306646 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1553e4e-4895-4ef5-9027-14635923ec65-metrics-certs podName:e1553e4e-4895-4ef5-9027-14635923ec65 nodeName:}" failed. No retries permitted until 2026-07-11 03:07:08.306628505 +0000 UTC m=+252.275240934 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e1553e4e-4895-4ef5-9027-14635923ec65-metrics-certs") pod "network-metrics-daemon-v9zw2" (UID: "e1553e4e-4895-4ef5-9027-14635923ec65") : secret "metrics-daemon-secret" not found Jul 11 03:05:34.399296 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:05:34.399238 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-n2kth" podUID="cc8bfa4f-eaf4-4b7e-bc00-bff618dfeacd" Jul 11 03:05:34.634084 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:05:34.634036 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-v9zw2" podUID="e1553e4e-4895-4ef5-9027-14635923ec65" Jul 11 03:05:35.262228 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:05:35.262200 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-n2kth" Jul 11 03:05:39.332136 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:05:39.332079 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cc8bfa4f-eaf4-4b7e-bc00-bff618dfeacd-metrics-tls\") pod \"dns-default-n2kth\" (UID: \"cc8bfa4f-eaf4-4b7e-bc00-bff618dfeacd\") " pod="openshift-dns/dns-default-n2kth" Jul 11 03:05:39.332563 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:05:39.332216 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 11 03:05:39.332563 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:05:39.332279 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc8bfa4f-eaf4-4b7e-bc00-bff618dfeacd-metrics-tls podName:cc8bfa4f-eaf4-4b7e-bc00-bff618dfeacd nodeName:}" failed. No retries permitted until 2026-07-11 03:07:41.332261463 +0000 UTC m=+285.300873893 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cc8bfa4f-eaf4-4b7e-bc00-bff618dfeacd-metrics-tls") pod "dns-default-n2kth" (UID: "cc8bfa4f-eaf4-4b7e-bc00-bff618dfeacd") : secret "dns-default-metrics-tls" not found Jul 11 03:05:45.608987 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:05:45.608926 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v9zw2" Jul 11 03:05:55.972920 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:05:55.972871 2559 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bf7968d5-g9xdk" podUID="6f413b3b-4205-4b06-a3a6-96b76a2ea827" containerName="acm-agent" probeResult="failure" output="Get \"http://10.134.0.9:8000/readyz\": dial tcp 10.134.0.9:8000: connect: connection refused" Jul 11 03:05:56.327884 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:05:56.327853 2559 generic.go:356] "Generic (PLEG): container finished" podID="6f413b3b-4205-4b06-a3a6-96b76a2ea827" containerID="f6dfe10c16374b961da31cb767da5c3130649f9473f8ccca0196570870aeb148" exitCode=1 Jul 11 03:05:56.328061 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:05:56.327893 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bf7968d5-g9xdk" event={"ID":"6f413b3b-4205-4b06-a3a6-96b76a2ea827","Type":"ContainerDied","Data":"f6dfe10c16374b961da31cb767da5c3130649f9473f8ccca0196570870aeb148"} Jul 11 03:05:56.328254 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:05:56.328231 2559 scope.go:117] "RemoveContainer" containerID="f6dfe10c16374b961da31cb767da5c3130649f9473f8ccca0196570870aeb148" Jul 11 03:05:57.332156 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:05:57.332120 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bf7968d5-g9xdk" event={"ID":"6f413b3b-4205-4b06-a3a6-96b76a2ea827","Type":"ContainerStarted","Data":"dc5579cf8b1b0bd01edfb9b79170472ae545d2a6cd1a5d356585e82d36627b9a"} Jul 11 03:05:57.332537 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:05:57.332415 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bf7968d5-g9xdk" Jul 11 03:05:57.333050 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:05:57.333023 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bf7968d5-g9xdk" Jul 11 03:06:46.296146 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:06:46.296106 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-sl7bx"] Jul 11 03:06:46.298347 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:06:46.298330 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-sl7bx" Jul 11 03:06:46.301257 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:06:46.301232 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 11 03:06:46.301257 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:06:46.301256 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 11 03:06:46.302253 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:06:46.302234 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 11 03:06:46.302364 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:06:46.302233 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 11 03:06:46.302364 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:06:46.302237 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-x2gcg\"" Jul 11 03:06:46.310745 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:06:46.310725 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-sl7bx"] Jul 11 03:06:46.403781 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:06:46.403748 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1c439238-aae6-48ae-ba56-d6fe883732c2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sl7bx\" (UID: \"1c439238-aae6-48ae-ba56-d6fe883732c2\") " pod="openshift-insights/insights-runtime-extractor-sl7bx" Jul 11 03:06:46.403781 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:06:46.403788 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1c439238-aae6-48ae-ba56-d6fe883732c2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sl7bx\" (UID: \"1c439238-aae6-48ae-ba56-d6fe883732c2\") " pod="openshift-insights/insights-runtime-extractor-sl7bx" Jul 11 03:06:46.404042 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:06:46.403831 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hv2bh\" (UniqueName: \"kubernetes.io/projected/1c439238-aae6-48ae-ba56-d6fe883732c2-kube-api-access-hv2bh\") pod \"insights-runtime-extractor-sl7bx\" (UID: \"1c439238-aae6-48ae-ba56-d6fe883732c2\") " pod="openshift-insights/insights-runtime-extractor-sl7bx" Jul 11 03:06:46.404042 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:06:46.403873 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1c439238-aae6-48ae-ba56-d6fe883732c2-crio-socket\") pod \"insights-runtime-extractor-sl7bx\" (UID: \"1c439238-aae6-48ae-ba56-d6fe883732c2\") " pod="openshift-insights/insights-runtime-extractor-sl7bx" Jul 11 03:06:46.404042 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:06:46.403893 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1c439238-aae6-48ae-ba56-d6fe883732c2-data-volume\") pod \"insights-runtime-extractor-sl7bx\" (UID: \"1c439238-aae6-48ae-ba56-d6fe883732c2\") " pod="openshift-insights/insights-runtime-extractor-sl7bx" Jul 11 03:06:46.505153 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:06:46.505119 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1c439238-aae6-48ae-ba56-d6fe883732c2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sl7bx\" (UID: \"1c439238-aae6-48ae-ba56-d6fe883732c2\") " pod="openshift-insights/insights-runtime-extractor-sl7bx" Jul 11 03:06:46.505153 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:06:46.505156 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1c439238-aae6-48ae-ba56-d6fe883732c2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sl7bx\" (UID: \"1c439238-aae6-48ae-ba56-d6fe883732c2\") " pod="openshift-insights/insights-runtime-extractor-sl7bx" Jul 11 03:06:46.505398 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:06:46.505205 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hv2bh\" (UniqueName: \"kubernetes.io/projected/1c439238-aae6-48ae-ba56-d6fe883732c2-kube-api-access-hv2bh\") pod \"insights-runtime-extractor-sl7bx\" (UID: \"1c439238-aae6-48ae-ba56-d6fe883732c2\") " pod="openshift-insights/insights-runtime-extractor-sl7bx" Jul 11 03:06:46.505398 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:06:46.505231 2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 11 03:06:46.505398 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:06:46.505284 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1c439238-aae6-48ae-ba56-d6fe883732c2-crio-socket\") pod \"insights-runtime-extractor-sl7bx\" (UID: \"1c439238-aae6-48ae-ba56-d6fe883732c2\") " pod="openshift-insights/insights-runtime-extractor-sl7bx" Jul 11 03:06:46.505398 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:06:46.505235 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1c439238-aae6-48ae-ba56-d6fe883732c2-crio-socket\") pod \"insights-runtime-extractor-sl7bx\" (UID: \"1c439238-aae6-48ae-ba56-d6fe883732c2\") " pod="openshift-insights/insights-runtime-extractor-sl7bx" Jul 11 03:06:46.505398 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:06:46.505302 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1c439238-aae6-48ae-ba56-d6fe883732c2-kube-rbac-proxy-cm podName:1c439238-aae6-48ae-ba56-d6fe883732c2 nodeName:}" failed. No retries permitted until 2026-07-11 03:06:47.005281781 +0000 UTC m=+230.973894216 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1c439238-aae6-48ae-ba56-d6fe883732c2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-sl7bx" (UID: "1c439238-aae6-48ae-ba56-d6fe883732c2") : configmap "kube-rbac-proxy" not found Jul 11 03:06:46.505398 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:06:46.505335 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1c439238-aae6-48ae-ba56-d6fe883732c2-data-volume\") pod \"insights-runtime-extractor-sl7bx\" (UID: \"1c439238-aae6-48ae-ba56-d6fe883732c2\") " pod="openshift-insights/insights-runtime-extractor-sl7bx" Jul 11 03:06:46.505398 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:06:46.505340 2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 11 03:06:46.505627 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:06:46.505409 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c439238-aae6-48ae-ba56-d6fe883732c2-insights-runtime-extractor-tls podName:1c439238-aae6-48ae-ba56-d6fe883732c2 nodeName:}" failed. No retries permitted until 2026-07-11 03:06:47.005392755 +0000 UTC m=+230.974005197 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1c439238-aae6-48ae-ba56-d6fe883732c2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-sl7bx" (UID: "1c439238-aae6-48ae-ba56-d6fe883732c2") : secret "insights-runtime-extractor-tls" not found Jul 11 03:06:46.505627 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:06:46.505609 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1c439238-aae6-48ae-ba56-d6fe883732c2-data-volume\") pod \"insights-runtime-extractor-sl7bx\" (UID: \"1c439238-aae6-48ae-ba56-d6fe883732c2\") " pod="openshift-insights/insights-runtime-extractor-sl7bx" Jul 11 03:06:46.513473 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:06:46.513440 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hv2bh\" (UniqueName: \"kubernetes.io/projected/1c439238-aae6-48ae-ba56-d6fe883732c2-kube-api-access-hv2bh\") pod \"insights-runtime-extractor-sl7bx\" (UID: \"1c439238-aae6-48ae-ba56-d6fe883732c2\") " pod="openshift-insights/insights-runtime-extractor-sl7bx" Jul 11 03:06:47.010259 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:06:47.010228 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1c439238-aae6-48ae-ba56-d6fe883732c2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sl7bx\" (UID: \"1c439238-aae6-48ae-ba56-d6fe883732c2\") " pod="openshift-insights/insights-runtime-extractor-sl7bx" Jul 11 03:06:47.010439 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:06:47.010266 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1c439238-aae6-48ae-ba56-d6fe883732c2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sl7bx\" (UID: \"1c439238-aae6-48ae-ba56-d6fe883732c2\") " pod="openshift-insights/insights-runtime-extractor-sl7bx" Jul 11 03:06:47.010439 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:06:47.010371 2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 11 03:06:47.010439 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:06:47.010393 2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 11 03:06:47.010625 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:06:47.010452 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c439238-aae6-48ae-ba56-d6fe883732c2-insights-runtime-extractor-tls podName:1c439238-aae6-48ae-ba56-d6fe883732c2 nodeName:}" failed. No retries permitted until 2026-07-11 03:06:48.010432678 +0000 UTC m=+231.979045123 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1c439238-aae6-48ae-ba56-d6fe883732c2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-sl7bx" (UID: "1c439238-aae6-48ae-ba56-d6fe883732c2") : secret "insights-runtime-extractor-tls" not found Jul 11 03:06:47.010625 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:06:47.010473 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1c439238-aae6-48ae-ba56-d6fe883732c2-kube-rbac-proxy-cm podName:1c439238-aae6-48ae-ba56-d6fe883732c2 nodeName:}" failed. No retries permitted until 2026-07-11 03:06:48.010462883 +0000 UTC m=+231.979075311 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1c439238-aae6-48ae-ba56-d6fe883732c2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-sl7bx" (UID: "1c439238-aae6-48ae-ba56-d6fe883732c2") : configmap "kube-rbac-proxy" not found Jul 11 03:06:48.018416 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:06:48.018379 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1c439238-aae6-48ae-ba56-d6fe883732c2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sl7bx\" (UID: \"1c439238-aae6-48ae-ba56-d6fe883732c2\") " pod="openshift-insights/insights-runtime-extractor-sl7bx" Jul 11 03:06:48.018416 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:06:48.018423 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1c439238-aae6-48ae-ba56-d6fe883732c2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sl7bx\" (UID: \"1c439238-aae6-48ae-ba56-d6fe883732c2\") " pod="openshift-insights/insights-runtime-extractor-sl7bx" Jul 11 03:06:48.018834 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:06:48.018521 2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 11 03:06:48.018834 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:06:48.018539 2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 11 03:06:48.018834 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:06:48.018603 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c439238-aae6-48ae-ba56-d6fe883732c2-insights-runtime-extractor-tls podName:1c439238-aae6-48ae-ba56-d6fe883732c2 nodeName:}" failed. No retries permitted until 2026-07-11 03:06:50.018589976 +0000 UTC m=+233.987202404 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1c439238-aae6-48ae-ba56-d6fe883732c2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-sl7bx" (UID: "1c439238-aae6-48ae-ba56-d6fe883732c2") : secret "insights-runtime-extractor-tls" not found Jul 11 03:06:48.018834 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:06:48.018616 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1c439238-aae6-48ae-ba56-d6fe883732c2-kube-rbac-proxy-cm podName:1c439238-aae6-48ae-ba56-d6fe883732c2 nodeName:}" failed. No retries permitted until 2026-07-11 03:06:50.018609454 +0000 UTC m=+233.987221883 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1c439238-aae6-48ae-ba56-d6fe883732c2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-sl7bx" (UID: "1c439238-aae6-48ae-ba56-d6fe883732c2") : configmap "kube-rbac-proxy" not found Jul 11 03:06:48.278390 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:06:48.278368 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-t56cx_bc91021e-ef93-462d-a80d-130775629ff9/dns-node-resolver/0.log" Jul 11 03:06:49.479640 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:06:49.479613 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-w6296_29122b3c-c77b-45e1-97db-b2332bfd92cc/node-ca/0.log" Jul 11 03:06:49.878934 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:06:49.878904 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-lctnz_252b2aed-79e7-440f-bcc4-1f147e071cbf/serve-healthcheck-canary/0.log" Jul 11 03:06:50.032323 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:06:50.032276 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1c439238-aae6-48ae-ba56-d6fe883732c2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sl7bx\" (UID: \"1c439238-aae6-48ae-ba56-d6fe883732c2\") " pod="openshift-insights/insights-runtime-extractor-sl7bx" Jul 11 03:06:50.032323 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:06:50.032328 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1c439238-aae6-48ae-ba56-d6fe883732c2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sl7bx\" (UID: \"1c439238-aae6-48ae-ba56-d6fe883732c2\") " pod="openshift-insights/insights-runtime-extractor-sl7bx" Jul 11 03:06:50.032571 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:06:50.032418 2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 11 03:06:50.032571 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:06:50.032468 2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 11 03:06:50.032571 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:06:50.032491 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1c439238-aae6-48ae-ba56-d6fe883732c2-kube-rbac-proxy-cm podName:1c439238-aae6-48ae-ba56-d6fe883732c2 nodeName:}" failed. No retries permitted until 2026-07-11 03:06:54.032473377 +0000 UTC m=+238.001085809 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1c439238-aae6-48ae-ba56-d6fe883732c2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-sl7bx" (UID: "1c439238-aae6-48ae-ba56-d6fe883732c2") : configmap "kube-rbac-proxy" not found Jul 11 03:06:50.032571 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:06:50.032515 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c439238-aae6-48ae-ba56-d6fe883732c2-insights-runtime-extractor-tls podName:1c439238-aae6-48ae-ba56-d6fe883732c2 nodeName:}" failed. No retries permitted until 2026-07-11 03:06:54.032502962 +0000 UTC m=+238.001115397 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1c439238-aae6-48ae-ba56-d6fe883732c2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-sl7bx" (UID: "1c439238-aae6-48ae-ba56-d6fe883732c2") : secret "insights-runtime-extractor-tls" not found Jul 11 03:06:54.065075 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:06:54.065034 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1c439238-aae6-48ae-ba56-d6fe883732c2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sl7bx\" (UID: \"1c439238-aae6-48ae-ba56-d6fe883732c2\") " pod="openshift-insights/insights-runtime-extractor-sl7bx" Jul 11 03:06:54.065075 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:06:54.065081 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1c439238-aae6-48ae-ba56-d6fe883732c2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sl7bx\" (UID: \"1c439238-aae6-48ae-ba56-d6fe883732c2\") " pod="openshift-insights/insights-runtime-extractor-sl7bx" Jul 11 03:06:54.065574 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:06:54.065163 2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 11 03:06:54.065574 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:06:54.065204 2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 11 03:06:54.065574 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:06:54.065229 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1c439238-aae6-48ae-ba56-d6fe883732c2-kube-rbac-proxy-cm podName:1c439238-aae6-48ae-ba56-d6fe883732c2 nodeName:}" failed. No retries permitted until 2026-07-11 03:07:02.065213431 +0000 UTC m=+246.033825860 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1c439238-aae6-48ae-ba56-d6fe883732c2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-sl7bx" (UID: "1c439238-aae6-48ae-ba56-d6fe883732c2") : configmap "kube-rbac-proxy" not found Jul 11 03:06:54.065574 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:06:54.065250 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c439238-aae6-48ae-ba56-d6fe883732c2-insights-runtime-extractor-tls podName:1c439238-aae6-48ae-ba56-d6fe883732c2 nodeName:}" failed. No retries permitted until 2026-07-11 03:07:02.065239241 +0000 UTC m=+246.033851670 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1c439238-aae6-48ae-ba56-d6fe883732c2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-sl7bx" (UID: "1c439238-aae6-48ae-ba56-d6fe883732c2") : secret "insights-runtime-extractor-tls" not found Jul 11 03:07:02.126775 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:02.126723 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1c439238-aae6-48ae-ba56-d6fe883732c2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sl7bx\" (UID: \"1c439238-aae6-48ae-ba56-d6fe883732c2\") " pod="openshift-insights/insights-runtime-extractor-sl7bx" Jul 11 03:07:02.126775 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:02.126788 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1c439238-aae6-48ae-ba56-d6fe883732c2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sl7bx\" (UID: \"1c439238-aae6-48ae-ba56-d6fe883732c2\") " pod="openshift-insights/insights-runtime-extractor-sl7bx" Jul 11 03:07:02.127378 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:02.127358 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1c439238-aae6-48ae-ba56-d6fe883732c2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sl7bx\" (UID: \"1c439238-aae6-48ae-ba56-d6fe883732c2\") " pod="openshift-insights/insights-runtime-extractor-sl7bx" Jul 11 03:07:02.129249 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:02.129229 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1c439238-aae6-48ae-ba56-d6fe883732c2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sl7bx\" (UID: \"1c439238-aae6-48ae-ba56-d6fe883732c2\") " pod="openshift-insights/insights-runtime-extractor-sl7bx" Jul 11 03:07:02.209470 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:02.209437 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-x2gcg\"" Jul 11 03:07:02.217637 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:02.217611 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-sl7bx" Jul 11 03:07:02.346781 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:02.346747 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-sl7bx"] Jul 11 03:07:02.349795 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:07:02.349769 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c439238_aae6_48ae_ba56_d6fe883732c2.slice/crio-c3ffdf4ac6b764984d60af3f5189412739300334c81849cb71683515d6b1561f WatchSource:0}: Error finding container c3ffdf4ac6b764984d60af3f5189412739300334c81849cb71683515d6b1561f: Status 404 returned error can't find the container with id c3ffdf4ac6b764984d60af3f5189412739300334c81849cb71683515d6b1561f Jul 11 03:07:02.509750 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:02.509657 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-sl7bx" event={"ID":"1c439238-aae6-48ae-ba56-d6fe883732c2","Type":"ContainerStarted","Data":"c3ffdf4ac6b764984d60af3f5189412739300334c81849cb71683515d6b1561f"} Jul 11 03:07:06.525228 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:06.525198 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-sl7bx" event={"ID":"1c439238-aae6-48ae-ba56-d6fe883732c2","Type":"ContainerStarted","Data":"d7e50f3f26942188ffa019dbee309b74202d0f6a89580bc67579a9ee9997cda2"} Jul 11 03:07:07.530509 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:07.530473 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-sl7bx" event={"ID":"1c439238-aae6-48ae-ba56-d6fe883732c2","Type":"ContainerStarted","Data":"a11baa3fe5c549f3b269d5cba8271b741a2a4d42205e5d8a481f01fcdeeb5c88"} Jul 11 03:07:08.376662 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:08.376625 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e1553e4e-4895-4ef5-9027-14635923ec65-metrics-certs\") pod \"network-metrics-daemon-v9zw2\" (UID: \"e1553e4e-4895-4ef5-9027-14635923ec65\") " pod="openshift-multus/network-metrics-daemon-v9zw2" Jul 11 03:07:08.379216 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:08.379184 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e1553e4e-4895-4ef5-9027-14635923ec65-metrics-certs\") pod \"network-metrics-daemon-v9zw2\" (UID: \"e1553e4e-4895-4ef5-9027-14635923ec65\") " pod="openshift-multus/network-metrics-daemon-v9zw2" Jul 11 03:07:08.412537 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:08.412511 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6jspr\"" Jul 11 03:07:08.420721 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:08.420697 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v9zw2" Jul 11 03:07:09.533059 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:09.533031 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-v9zw2"] Jul 11 03:07:09.535483 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:07:09.535450 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1553e4e_4895_4ef5_9027_14635923ec65.slice/crio-d3999a3e921c3bd04b2e39d4522ed32e5c7efda0f8398a1f64659d64f3d6e000 WatchSource:0}: Error finding container d3999a3e921c3bd04b2e39d4522ed32e5c7efda0f8398a1f64659d64f3d6e000: Status 404 returned error can't find the container with id d3999a3e921c3bd04b2e39d4522ed32e5c7efda0f8398a1f64659d64f3d6e000 Jul 11 03:07:10.542250 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:10.542216 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-v9zw2" event={"ID":"e1553e4e-4895-4ef5-9027-14635923ec65","Type":"ContainerStarted","Data":"9cdfcbea12a26c5bf5bb5dcc35e0d1eb76a8aaf1afd00ee906c354218af9280a"} Jul 11 03:07:10.542710 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:10.542276 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-v9zw2" event={"ID":"e1553e4e-4895-4ef5-9027-14635923ec65","Type":"ContainerStarted","Data":"d3999a3e921c3bd04b2e39d4522ed32e5c7efda0f8398a1f64659d64f3d6e000"} Jul 11 03:07:10.544307 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:10.544287 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-sl7bx" event={"ID":"1c439238-aae6-48ae-ba56-d6fe883732c2","Type":"ContainerStarted","Data":"03432cf495c75992d707bae6b3aa4624c1fe23cdddd24fa151ab4ac85653a16d"} Jul 11 03:07:10.561508 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:10.561459 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-sl7bx" podStartSLOduration=17.560537642 podStartE2EDuration="24.561441504s" totalImagesPullingTime="7.000903862s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 03:06:46 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:07:10.56054719 +0000 UTC m=+254.529159642" watchObservedRunningTime="2026-07-11 03:07:10.561441504 +0000 UTC m=+254.530053955" Jul 11 03:07:11.079672 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:11.079635 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-68db5c7c66-v5d5w"] Jul 11 03:07:11.082405 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:11.082387 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-68db5c7c66-v5d5w" Jul 11 03:07:11.085290 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:11.085261 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-49v75\"" Jul 11 03:07:11.085436 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:11.085315 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 11 03:07:11.085436 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:11.085324 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 11 03:07:11.085436 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:11.085372 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 11 03:07:11.091323 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:11.091300 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 11 03:07:11.095182 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:11.095161 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-68db5c7c66-v5d5w"] Jul 11 03:07:11.197610 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:11.197576 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/31daaeaf-20c6-4b42-9aa7-5abba272b150-trusted-ca\") pod \"image-registry-68db5c7c66-v5d5w\" (UID: \"31daaeaf-20c6-4b42-9aa7-5abba272b150\") " pod="openshift-image-registry/image-registry-68db5c7c66-v5d5w" Jul 11 03:07:11.197610 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:11.197609 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/31daaeaf-20c6-4b42-9aa7-5abba272b150-registry-certificates\") pod \"image-registry-68db5c7c66-v5d5w\" (UID: \"31daaeaf-20c6-4b42-9aa7-5abba272b150\") " pod="openshift-image-registry/image-registry-68db5c7c66-v5d5w" Jul 11 03:07:11.197866 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:11.197639 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/31daaeaf-20c6-4b42-9aa7-5abba272b150-bound-sa-token\") pod \"image-registry-68db5c7c66-v5d5w\" (UID: \"31daaeaf-20c6-4b42-9aa7-5abba272b150\") " pod="openshift-image-registry/image-registry-68db5c7c66-v5d5w" Jul 11 03:07:11.197866 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:11.197717 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/31daaeaf-20c6-4b42-9aa7-5abba272b150-registry-tls\") pod \"image-registry-68db5c7c66-v5d5w\" (UID: \"31daaeaf-20c6-4b42-9aa7-5abba272b150\") " pod="openshift-image-registry/image-registry-68db5c7c66-v5d5w" Jul 11 03:07:11.197866 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:11.197761 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/31daaeaf-20c6-4b42-9aa7-5abba272b150-installation-pull-secrets\") pod \"image-registry-68db5c7c66-v5d5w\" (UID: \"31daaeaf-20c6-4b42-9aa7-5abba272b150\") " pod="openshift-image-registry/image-registry-68db5c7c66-v5d5w" Jul 11 03:07:11.197866 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:11.197798 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f24t8\" (UniqueName: \"kubernetes.io/projected/31daaeaf-20c6-4b42-9aa7-5abba272b150-kube-api-access-f24t8\") pod \"image-registry-68db5c7c66-v5d5w\" (UID: \"31daaeaf-20c6-4b42-9aa7-5abba272b150\") " pod="openshift-image-registry/image-registry-68db5c7c66-v5d5w" Jul 11 03:07:11.197866 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:11.197827 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/31daaeaf-20c6-4b42-9aa7-5abba272b150-image-registry-private-configuration\") pod \"image-registry-68db5c7c66-v5d5w\" (UID: \"31daaeaf-20c6-4b42-9aa7-5abba272b150\") " pod="openshift-image-registry/image-registry-68db5c7c66-v5d5w" Jul 11 03:07:11.197866 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:11.197857 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/31daaeaf-20c6-4b42-9aa7-5abba272b150-ca-trust-extracted\") pod \"image-registry-68db5c7c66-v5d5w\" (UID: \"31daaeaf-20c6-4b42-9aa7-5abba272b150\") " pod="openshift-image-registry/image-registry-68db5c7c66-v5d5w" Jul 11 03:07:11.299149 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:11.299116 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/31daaeaf-20c6-4b42-9aa7-5abba272b150-installation-pull-secrets\") pod \"image-registry-68db5c7c66-v5d5w\" (UID: \"31daaeaf-20c6-4b42-9aa7-5abba272b150\") " pod="openshift-image-registry/image-registry-68db5c7c66-v5d5w" Jul 11 03:07:11.299149 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:11.299150 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f24t8\" (UniqueName: \"kubernetes.io/projected/31daaeaf-20c6-4b42-9aa7-5abba272b150-kube-api-access-f24t8\") pod \"image-registry-68db5c7c66-v5d5w\" (UID: \"31daaeaf-20c6-4b42-9aa7-5abba272b150\") " pod="openshift-image-registry/image-registry-68db5c7c66-v5d5w" Jul 11 03:07:11.299396 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:11.299170 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/31daaeaf-20c6-4b42-9aa7-5abba272b150-image-registry-private-configuration\") pod \"image-registry-68db5c7c66-v5d5w\" (UID: \"31daaeaf-20c6-4b42-9aa7-5abba272b150\") " pod="openshift-image-registry/image-registry-68db5c7c66-v5d5w" Jul 11 03:07:11.299396 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:11.299220 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/31daaeaf-20c6-4b42-9aa7-5abba272b150-ca-trust-extracted\") pod \"image-registry-68db5c7c66-v5d5w\" (UID: \"31daaeaf-20c6-4b42-9aa7-5abba272b150\") " pod="openshift-image-registry/image-registry-68db5c7c66-v5d5w" Jul 11 03:07:11.299396 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:11.299275 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/31daaeaf-20c6-4b42-9aa7-5abba272b150-trusted-ca\") pod \"image-registry-68db5c7c66-v5d5w\" (UID: \"31daaeaf-20c6-4b42-9aa7-5abba272b150\") " pod="openshift-image-registry/image-registry-68db5c7c66-v5d5w" Jul 11 03:07:11.299396 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:11.299301 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/31daaeaf-20c6-4b42-9aa7-5abba272b150-registry-certificates\") pod \"image-registry-68db5c7c66-v5d5w\" (UID: \"31daaeaf-20c6-4b42-9aa7-5abba272b150\") " pod="openshift-image-registry/image-registry-68db5c7c66-v5d5w" Jul 11 03:07:11.299396 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:11.299336 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/31daaeaf-20c6-4b42-9aa7-5abba272b150-bound-sa-token\") pod \"image-registry-68db5c7c66-v5d5w\" (UID: \"31daaeaf-20c6-4b42-9aa7-5abba272b150\") " pod="openshift-image-registry/image-registry-68db5c7c66-v5d5w" Jul 11 03:07:11.299396 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:11.299378 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/31daaeaf-20c6-4b42-9aa7-5abba272b150-registry-tls\") pod \"image-registry-68db5c7c66-v5d5w\" (UID: \"31daaeaf-20c6-4b42-9aa7-5abba272b150\") " pod="openshift-image-registry/image-registry-68db5c7c66-v5d5w" Jul 11 03:07:11.299816 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:11.299788 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/31daaeaf-20c6-4b42-9aa7-5abba272b150-ca-trust-extracted\") pod \"image-registry-68db5c7c66-v5d5w\" (UID: \"31daaeaf-20c6-4b42-9aa7-5abba272b150\") " pod="openshift-image-registry/image-registry-68db5c7c66-v5d5w" Jul 11 03:07:11.300458 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:11.300434 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/31daaeaf-20c6-4b42-9aa7-5abba272b150-trusted-ca\") pod \"image-registry-68db5c7c66-v5d5w\" (UID: \"31daaeaf-20c6-4b42-9aa7-5abba272b150\") " pod="openshift-image-registry/image-registry-68db5c7c66-v5d5w" Jul 11 03:07:11.300553 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:11.300503 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/31daaeaf-20c6-4b42-9aa7-5abba272b150-registry-certificates\") pod \"image-registry-68db5c7c66-v5d5w\" (UID: \"31daaeaf-20c6-4b42-9aa7-5abba272b150\") " pod="openshift-image-registry/image-registry-68db5c7c66-v5d5w" Jul 11 03:07:11.301761 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:11.301736 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/31daaeaf-20c6-4b42-9aa7-5abba272b150-image-registry-private-configuration\") pod \"image-registry-68db5c7c66-v5d5w\" (UID: \"31daaeaf-20c6-4b42-9aa7-5abba272b150\") " pod="openshift-image-registry/image-registry-68db5c7c66-v5d5w" Jul 11 03:07:11.301994 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:11.301951 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/31daaeaf-20c6-4b42-9aa7-5abba272b150-registry-tls\") pod \"image-registry-68db5c7c66-v5d5w\" (UID: \"31daaeaf-20c6-4b42-9aa7-5abba272b150\") " pod="openshift-image-registry/image-registry-68db5c7c66-v5d5w" Jul 11 03:07:11.302072 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:11.301976 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/31daaeaf-20c6-4b42-9aa7-5abba272b150-installation-pull-secrets\") pod \"image-registry-68db5c7c66-v5d5w\" (UID: \"31daaeaf-20c6-4b42-9aa7-5abba272b150\") " pod="openshift-image-registry/image-registry-68db5c7c66-v5d5w" Jul 11 03:07:11.308429 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:11.308409 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/31daaeaf-20c6-4b42-9aa7-5abba272b150-bound-sa-token\") pod \"image-registry-68db5c7c66-v5d5w\" (UID: \"31daaeaf-20c6-4b42-9aa7-5abba272b150\") " pod="openshift-image-registry/image-registry-68db5c7c66-v5d5w" Jul 11 03:07:11.308429 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:11.308412 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f24t8\" (UniqueName: \"kubernetes.io/projected/31daaeaf-20c6-4b42-9aa7-5abba272b150-kube-api-access-f24t8\") pod \"image-registry-68db5c7c66-v5d5w\" (UID: \"31daaeaf-20c6-4b42-9aa7-5abba272b150\") " pod="openshift-image-registry/image-registry-68db5c7c66-v5d5w" Jul 11 03:07:11.391818 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:11.391730 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-68db5c7c66-v5d5w" Jul 11 03:07:11.521749 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:11.521576 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-68db5c7c66-v5d5w"] Jul 11 03:07:11.523969 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:07:11.523931 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31daaeaf_20c6_4b42_9aa7_5abba272b150.slice/crio-e955c6a469b859e146690e300d6a6b08e735b8419dea2eebbb749226fe9cd2f1 WatchSource:0}: Error finding container e955c6a469b859e146690e300d6a6b08e735b8419dea2eebbb749226fe9cd2f1: Status 404 returned error can't find the container with id e955c6a469b859e146690e300d6a6b08e735b8419dea2eebbb749226fe9cd2f1 Jul 11 03:07:11.548701 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:11.548665 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-v9zw2" event={"ID":"e1553e4e-4895-4ef5-9027-14635923ec65","Type":"ContainerStarted","Data":"0e0ba43c0c8a3310096111456694c845e77a750e0e57d43de5b7c0da8b26c7a1"} Jul 11 03:07:11.549707 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:11.549679 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-68db5c7c66-v5d5w" event={"ID":"31daaeaf-20c6-4b42-9aa7-5abba272b150","Type":"ContainerStarted","Data":"e955c6a469b859e146690e300d6a6b08e735b8419dea2eebbb749226fe9cd2f1"} Jul 11 03:07:11.563418 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:11.563372 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-v9zw2" podStartSLOduration=254.680693978 podStartE2EDuration="4m15.563350826s" totalImagesPullingTime="882.656848ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:02:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:07:11.562888498 +0000 UTC m=+255.531500950" watchObservedRunningTime="2026-07-11 03:07:11.563350826 +0000 UTC m=+255.531963278" Jul 11 03:07:12.555733 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:12.555700 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-68db5c7c66-v5d5w" event={"ID":"31daaeaf-20c6-4b42-9aa7-5abba272b150","Type":"ContainerStarted","Data":"72b0d1efd3df0860efd2f669307831568e8a768cb5c181fe305b68e1a60c989c"} Jul 11 03:07:12.575364 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:12.575298 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-68db5c7c66-v5d5w" podStartSLOduration=1.575279519 podStartE2EDuration="1.575279519s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:07:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:07:12.574293526 +0000 UTC m=+256.542905976" watchObservedRunningTime="2026-07-11 03:07:12.575279519 +0000 UTC m=+256.543891961" Jul 11 03:07:13.559224 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:13.559193 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-68db5c7c66-v5d5w" Jul 11 03:07:19.459114 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:19.459035 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-zsnxt"] Jul 11 03:07:19.466162 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:19.466136 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-zsnxt" Jul 11 03:07:19.468695 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:19.468669 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 11 03:07:19.468939 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:19.468693 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 11 03:07:19.468939 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:19.468717 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 11 03:07:19.469129 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:19.468742 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 11 03:07:19.469129 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:19.468747 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 11 03:07:19.469129 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:19.468797 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 11 03:07:19.469721 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:19.469707 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-g84sx\"" Jul 11 03:07:19.562723 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:19.562692 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2f36027a-012a-4ff0-9879-d7ba45a44d24-node-exporter-accelerators-collector-config\") pod \"node-exporter-zsnxt\" (UID: \"2f36027a-012a-4ff0-9879-d7ba45a44d24\") " pod="openshift-monitoring/node-exporter-zsnxt" Jul 11 03:07:19.562723 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:19.562724 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2f36027a-012a-4ff0-9879-d7ba45a44d24-node-exporter-wtmp\") pod \"node-exporter-zsnxt\" (UID: \"2f36027a-012a-4ff0-9879-d7ba45a44d24\") " pod="openshift-monitoring/node-exporter-zsnxt" Jul 11 03:07:19.562927 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:19.562741 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2f36027a-012a-4ff0-9879-d7ba45a44d24-root\") pod \"node-exporter-zsnxt\" (UID: \"2f36027a-012a-4ff0-9879-d7ba45a44d24\") " pod="openshift-monitoring/node-exporter-zsnxt" Jul 11 03:07:19.562927 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:19.562762 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2f36027a-012a-4ff0-9879-d7ba45a44d24-node-exporter-tls\") pod \"node-exporter-zsnxt\" (UID: \"2f36027a-012a-4ff0-9879-d7ba45a44d24\") " pod="openshift-monitoring/node-exporter-zsnxt" Jul 11 03:07:19.562927 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:19.562807 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2f36027a-012a-4ff0-9879-d7ba45a44d24-metrics-client-ca\") pod \"node-exporter-zsnxt\" (UID: \"2f36027a-012a-4ff0-9879-d7ba45a44d24\") " pod="openshift-monitoring/node-exporter-zsnxt" Jul 11 03:07:19.562927 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:19.562836 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2f36027a-012a-4ff0-9879-d7ba45a44d24-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zsnxt\" (UID: \"2f36027a-012a-4ff0-9879-d7ba45a44d24\") " pod="openshift-monitoring/node-exporter-zsnxt" Jul 11 03:07:19.562927 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:19.562869 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ts9qn\" (UniqueName: \"kubernetes.io/projected/2f36027a-012a-4ff0-9879-d7ba45a44d24-kube-api-access-ts9qn\") pod \"node-exporter-zsnxt\" (UID: \"2f36027a-012a-4ff0-9879-d7ba45a44d24\") " pod="openshift-monitoring/node-exporter-zsnxt" Jul 11 03:07:19.562927 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:19.562900 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2f36027a-012a-4ff0-9879-d7ba45a44d24-node-exporter-textfile\") pod \"node-exporter-zsnxt\" (UID: \"2f36027a-012a-4ff0-9879-d7ba45a44d24\") " pod="openshift-monitoring/node-exporter-zsnxt" Jul 11 03:07:19.563122 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:19.562976 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2f36027a-012a-4ff0-9879-d7ba45a44d24-sys\") pod \"node-exporter-zsnxt\" (UID: \"2f36027a-012a-4ff0-9879-d7ba45a44d24\") " pod="openshift-monitoring/node-exporter-zsnxt" Jul 11 03:07:19.664120 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:19.664075 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ts9qn\" (UniqueName: \"kubernetes.io/projected/2f36027a-012a-4ff0-9879-d7ba45a44d24-kube-api-access-ts9qn\") pod \"node-exporter-zsnxt\" (UID: \"2f36027a-012a-4ff0-9879-d7ba45a44d24\") " pod="openshift-monitoring/node-exporter-zsnxt" Jul 11 03:07:19.664120 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:19.664124 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2f36027a-012a-4ff0-9879-d7ba45a44d24-node-exporter-textfile\") pod \"node-exporter-zsnxt\" (UID: \"2f36027a-012a-4ff0-9879-d7ba45a44d24\") " pod="openshift-monitoring/node-exporter-zsnxt" Jul 11 03:07:19.664376 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:19.664162 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2f36027a-012a-4ff0-9879-d7ba45a44d24-sys\") pod \"node-exporter-zsnxt\" (UID: \"2f36027a-012a-4ff0-9879-d7ba45a44d24\") " pod="openshift-monitoring/node-exporter-zsnxt" Jul 11 03:07:19.664376 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:19.664185 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2f36027a-012a-4ff0-9879-d7ba45a44d24-node-exporter-accelerators-collector-config\") pod \"node-exporter-zsnxt\" (UID: \"2f36027a-012a-4ff0-9879-d7ba45a44d24\") " pod="openshift-monitoring/node-exporter-zsnxt" Jul 11 03:07:19.664376 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:19.664203 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2f36027a-012a-4ff0-9879-d7ba45a44d24-node-exporter-wtmp\") pod \"node-exporter-zsnxt\" (UID: \"2f36027a-012a-4ff0-9879-d7ba45a44d24\") " pod="openshift-monitoring/node-exporter-zsnxt" Jul 11 03:07:19.664376 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:19.664229 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2f36027a-012a-4ff0-9879-d7ba45a44d24-root\") pod \"node-exporter-zsnxt\" (UID: \"2f36027a-012a-4ff0-9879-d7ba45a44d24\") " pod="openshift-monitoring/node-exporter-zsnxt" Jul 11 03:07:19.664376 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:19.664248 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2f36027a-012a-4ff0-9879-d7ba45a44d24-node-exporter-tls\") pod \"node-exporter-zsnxt\" (UID: \"2f36027a-012a-4ff0-9879-d7ba45a44d24\") " pod="openshift-monitoring/node-exporter-zsnxt" Jul 11 03:07:19.664376 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:19.664258 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2f36027a-012a-4ff0-9879-d7ba45a44d24-sys\") pod \"node-exporter-zsnxt\" (UID: \"2f36027a-012a-4ff0-9879-d7ba45a44d24\") " pod="openshift-monitoring/node-exporter-zsnxt" Jul 11 03:07:19.664376 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:19.664264 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2f36027a-012a-4ff0-9879-d7ba45a44d24-metrics-client-ca\") pod \"node-exporter-zsnxt\" (UID: \"2f36027a-012a-4ff0-9879-d7ba45a44d24\") " pod="openshift-monitoring/node-exporter-zsnxt" Jul 11 03:07:19.664376 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:19.664321 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2f36027a-012a-4ff0-9879-d7ba45a44d24-root\") pod \"node-exporter-zsnxt\" (UID: \"2f36027a-012a-4ff0-9879-d7ba45a44d24\") " pod="openshift-monitoring/node-exporter-zsnxt" Jul 11 03:07:19.664376 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:19.664322 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2f36027a-012a-4ff0-9879-d7ba45a44d24-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zsnxt\" (UID: \"2f36027a-012a-4ff0-9879-d7ba45a44d24\") " pod="openshift-monitoring/node-exporter-zsnxt" Jul 11 03:07:19.664728 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:19.664390 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2f36027a-012a-4ff0-9879-d7ba45a44d24-node-exporter-wtmp\") pod \"node-exporter-zsnxt\" (UID: \"2f36027a-012a-4ff0-9879-d7ba45a44d24\") " pod="openshift-monitoring/node-exporter-zsnxt" Jul 11 03:07:19.664728 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:19.664584 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2f36027a-012a-4ff0-9879-d7ba45a44d24-node-exporter-textfile\") pod \"node-exporter-zsnxt\" (UID: \"2f36027a-012a-4ff0-9879-d7ba45a44d24\") " pod="openshift-monitoring/node-exporter-zsnxt" Jul 11 03:07:19.664997 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:19.664946 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2f36027a-012a-4ff0-9879-d7ba45a44d24-metrics-client-ca\") pod \"node-exporter-zsnxt\" (UID: \"2f36027a-012a-4ff0-9879-d7ba45a44d24\") " pod="openshift-monitoring/node-exporter-zsnxt" Jul 11 03:07:19.665109 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:19.664946 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2f36027a-012a-4ff0-9879-d7ba45a44d24-node-exporter-accelerators-collector-config\") pod \"node-exporter-zsnxt\" (UID: \"2f36027a-012a-4ff0-9879-d7ba45a44d24\") " pod="openshift-monitoring/node-exporter-zsnxt" Jul 11 03:07:19.666782 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:19.666765 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2f36027a-012a-4ff0-9879-d7ba45a44d24-node-exporter-tls\") pod \"node-exporter-zsnxt\" (UID: \"2f36027a-012a-4ff0-9879-d7ba45a44d24\") " pod="openshift-monitoring/node-exporter-zsnxt" Jul 11 03:07:19.666842 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:19.666804 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2f36027a-012a-4ff0-9879-d7ba45a44d24-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zsnxt\" (UID: \"2f36027a-012a-4ff0-9879-d7ba45a44d24\") " pod="openshift-monitoring/node-exporter-zsnxt" Jul 11 03:07:19.671424 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:19.671404 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ts9qn\" (UniqueName: \"kubernetes.io/projected/2f36027a-012a-4ff0-9879-d7ba45a44d24-kube-api-access-ts9qn\") pod \"node-exporter-zsnxt\" (UID: \"2f36027a-012a-4ff0-9879-d7ba45a44d24\") " pod="openshift-monitoring/node-exporter-zsnxt" Jul 11 03:07:19.775150 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:19.775070 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-zsnxt" Jul 11 03:07:19.785976 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:07:19.785937 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f36027a_012a_4ff0_9879_d7ba45a44d24.slice/crio-4e282ce7db1a55fc32cc8f419352b90e5408b2374e116e94a3d094d22fcb038f WatchSource:0}: Error finding container 4e282ce7db1a55fc32cc8f419352b90e5408b2374e116e94a3d094d22fcb038f: Status 404 returned error can't find the container with id 4e282ce7db1a55fc32cc8f419352b90e5408b2374e116e94a3d094d22fcb038f Jul 11 03:07:20.581201 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:20.581166 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zsnxt" event={"ID":"2f36027a-012a-4ff0-9879-d7ba45a44d24","Type":"ContainerStarted","Data":"4e282ce7db1a55fc32cc8f419352b90e5408b2374e116e94a3d094d22fcb038f"} Jul 11 03:07:21.585760 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:21.585726 2559 generic.go:356] "Generic (PLEG): container finished" podID="2f36027a-012a-4ff0-9879-d7ba45a44d24" containerID="ab2cc8feaeca9ffb860cea3fec1d11a431adf32ea271beec1a3527b377b4bd3f" exitCode=0 Jul 11 03:07:21.586164 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:21.585778 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zsnxt" event={"ID":"2f36027a-012a-4ff0-9879-d7ba45a44d24","Type":"ContainerDied","Data":"ab2cc8feaeca9ffb860cea3fec1d11a431adf32ea271beec1a3527b377b4bd3f"} Jul 11 03:07:22.591532 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:22.591498 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zsnxt" event={"ID":"2f36027a-012a-4ff0-9879-d7ba45a44d24","Type":"ContainerStarted","Data":"bc691e8ad015167a2cd61639941ed971272f667929a3b5aae5e153afb1703846"} Jul 11 03:07:22.591916 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:22.591579 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zsnxt" event={"ID":"2f36027a-012a-4ff0-9879-d7ba45a44d24","Type":"ContainerStarted","Data":"827c92213dc9c5eb7244e1e89fde5e523657c4064031b3a160e64d64291c7140"} Jul 11 03:07:22.610673 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:22.610620 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-zsnxt" podStartSLOduration=2.709952005 podStartE2EDuration="3.610603409s" totalImagesPullingTime="829.471426ms" totalInitContainerRuntime="71.179978ms" isStatefulPod=true podCreationTimestamp="2026-07-11 03:07:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:07:22.608758965 +0000 UTC m=+266.577371417" watchObservedRunningTime="2026-07-11 03:07:22.610603409 +0000 UTC m=+266.579215860" Jul 11 03:07:23.834719 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:23.834683 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-66f475786-wj46m"] Jul 11 03:07:23.939136 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:23.939071 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-66f475786-wj46m"] Jul 11 03:07:23.939302 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:23.939154 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-66f475786-wj46m" Jul 11 03:07:23.941890 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:23.941864 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 11 03:07:23.941890 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:23.941883 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-q76jppql50rg\"" Jul 11 03:07:23.942975 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:23.942943 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 11 03:07:23.943077 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:23.943033 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-8wt7c\"" Jul 11 03:07:23.943077 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:23.943042 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 11 03:07:23.943197 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:23.942949 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 11 03:07:23.998457 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:23.998418 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/4fc67bd8-4094-4629-b494-da78210fa48b-metrics-server-audit-profiles\") pod \"metrics-server-66f475786-wj46m\" (UID: \"4fc67bd8-4094-4629-b494-da78210fa48b\") " pod="openshift-monitoring/metrics-server-66f475786-wj46m" Jul 11 03:07:23.998614 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:23.998515 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4fc67bd8-4094-4629-b494-da78210fa48b-client-ca-bundle\") pod \"metrics-server-66f475786-wj46m\" (UID: \"4fc67bd8-4094-4629-b494-da78210fa48b\") " pod="openshift-monitoring/metrics-server-66f475786-wj46m" Jul 11 03:07:23.998614 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:23.998543 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gzrdx\" (UniqueName: \"kubernetes.io/projected/4fc67bd8-4094-4629-b494-da78210fa48b-kube-api-access-gzrdx\") pod \"metrics-server-66f475786-wj46m\" (UID: \"4fc67bd8-4094-4629-b494-da78210fa48b\") " pod="openshift-monitoring/metrics-server-66f475786-wj46m" Jul 11 03:07:23.998614 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:23.998569 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/4fc67bd8-4094-4629-b494-da78210fa48b-secret-metrics-server-client-certs\") pod \"metrics-server-66f475786-wj46m\" (UID: \"4fc67bd8-4094-4629-b494-da78210fa48b\") " pod="openshift-monitoring/metrics-server-66f475786-wj46m" Jul 11 03:07:23.998614 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:23.998604 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4fc67bd8-4094-4629-b494-da78210fa48b-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-66f475786-wj46m\" (UID: \"4fc67bd8-4094-4629-b494-da78210fa48b\") " pod="openshift-monitoring/metrics-server-66f475786-wj46m" Jul 11 03:07:23.998773 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:23.998641 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/4fc67bd8-4094-4629-b494-da78210fa48b-secret-metrics-server-tls\") pod \"metrics-server-66f475786-wj46m\" (UID: \"4fc67bd8-4094-4629-b494-da78210fa48b\") " pod="openshift-monitoring/metrics-server-66f475786-wj46m" Jul 11 03:07:23.998773 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:23.998666 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/4fc67bd8-4094-4629-b494-da78210fa48b-audit-log\") pod \"metrics-server-66f475786-wj46m\" (UID: \"4fc67bd8-4094-4629-b494-da78210fa48b\") " pod="openshift-monitoring/metrics-server-66f475786-wj46m" Jul 11 03:07:24.099513 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:24.099432 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/4fc67bd8-4094-4629-b494-da78210fa48b-audit-log\") pod \"metrics-server-66f475786-wj46m\" (UID: \"4fc67bd8-4094-4629-b494-da78210fa48b\") " pod="openshift-monitoring/metrics-server-66f475786-wj46m" Jul 11 03:07:24.099513 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:24.099477 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/4fc67bd8-4094-4629-b494-da78210fa48b-metrics-server-audit-profiles\") pod \"metrics-server-66f475786-wj46m\" (UID: \"4fc67bd8-4094-4629-b494-da78210fa48b\") " pod="openshift-monitoring/metrics-server-66f475786-wj46m" Jul 11 03:07:24.099682 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:24.099618 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4fc67bd8-4094-4629-b494-da78210fa48b-client-ca-bundle\") pod \"metrics-server-66f475786-wj46m\" (UID: \"4fc67bd8-4094-4629-b494-da78210fa48b\") " pod="openshift-monitoring/metrics-server-66f475786-wj46m" Jul 11 03:07:24.099682 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:24.099653 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gzrdx\" (UniqueName: \"kubernetes.io/projected/4fc67bd8-4094-4629-b494-da78210fa48b-kube-api-access-gzrdx\") pod \"metrics-server-66f475786-wj46m\" (UID: \"4fc67bd8-4094-4629-b494-da78210fa48b\") " pod="openshift-monitoring/metrics-server-66f475786-wj46m" Jul 11 03:07:24.099754 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:24.099681 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/4fc67bd8-4094-4629-b494-da78210fa48b-secret-metrics-server-client-certs\") pod \"metrics-server-66f475786-wj46m\" (UID: \"4fc67bd8-4094-4629-b494-da78210fa48b\") " pod="openshift-monitoring/metrics-server-66f475786-wj46m" Jul 11 03:07:24.099754 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:24.099713 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4fc67bd8-4094-4629-b494-da78210fa48b-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-66f475786-wj46m\" (UID: \"4fc67bd8-4094-4629-b494-da78210fa48b\") " pod="openshift-monitoring/metrics-server-66f475786-wj46m" Jul 11 03:07:24.099754 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:24.099748 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/4fc67bd8-4094-4629-b494-da78210fa48b-secret-metrics-server-tls\") pod \"metrics-server-66f475786-wj46m\" (UID: \"4fc67bd8-4094-4629-b494-da78210fa48b\") " pod="openshift-monitoring/metrics-server-66f475786-wj46m" Jul 11 03:07:24.099884 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:24.099839 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/4fc67bd8-4094-4629-b494-da78210fa48b-audit-log\") pod \"metrics-server-66f475786-wj46m\" (UID: \"4fc67bd8-4094-4629-b494-da78210fa48b\") " pod="openshift-monitoring/metrics-server-66f475786-wj46m" Jul 11 03:07:24.100513 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:24.100491 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/4fc67bd8-4094-4629-b494-da78210fa48b-metrics-server-audit-profiles\") pod \"metrics-server-66f475786-wj46m\" (UID: \"4fc67bd8-4094-4629-b494-da78210fa48b\") " pod="openshift-monitoring/metrics-server-66f475786-wj46m" Jul 11 03:07:24.100669 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:24.100612 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4fc67bd8-4094-4629-b494-da78210fa48b-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-66f475786-wj46m\" (UID: \"4fc67bd8-4094-4629-b494-da78210fa48b\") " pod="openshift-monitoring/metrics-server-66f475786-wj46m" Jul 11 03:07:24.102181 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:24.102152 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4fc67bd8-4094-4629-b494-da78210fa48b-client-ca-bundle\") pod \"metrics-server-66f475786-wj46m\" (UID: \"4fc67bd8-4094-4629-b494-da78210fa48b\") " pod="openshift-monitoring/metrics-server-66f475786-wj46m" Jul 11 03:07:24.102290 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:24.102219 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/4fc67bd8-4094-4629-b494-da78210fa48b-secret-metrics-server-client-certs\") pod \"metrics-server-66f475786-wj46m\" (UID: \"4fc67bd8-4094-4629-b494-da78210fa48b\") " pod="openshift-monitoring/metrics-server-66f475786-wj46m" Jul 11 03:07:24.102290 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:24.102253 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/4fc67bd8-4094-4629-b494-da78210fa48b-secret-metrics-server-tls\") pod \"metrics-server-66f475786-wj46m\" (UID: \"4fc67bd8-4094-4629-b494-da78210fa48b\") " pod="openshift-monitoring/metrics-server-66f475786-wj46m" Jul 11 03:07:24.107043 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:24.107024 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gzrdx\" (UniqueName: \"kubernetes.io/projected/4fc67bd8-4094-4629-b494-da78210fa48b-kube-api-access-gzrdx\") pod \"metrics-server-66f475786-wj46m\" (UID: \"4fc67bd8-4094-4629-b494-da78210fa48b\") " pod="openshift-monitoring/metrics-server-66f475786-wj46m" Jul 11 03:07:24.249052 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:24.249009 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-66f475786-wj46m" Jul 11 03:07:24.414398 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:24.414375 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-66f475786-wj46m"] Jul 11 03:07:24.416478 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:07:24.416449 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4fc67bd8_4094_4629_b494_da78210fa48b.slice/crio-a577ec65e48d4812440fc9a0e4ffaecdbc16ac435beeb96a3cb1913bec1ba5c7 WatchSource:0}: Error finding container a577ec65e48d4812440fc9a0e4ffaecdbc16ac435beeb96a3cb1913bec1ba5c7: Status 404 returned error can't find the container with id a577ec65e48d4812440fc9a0e4ffaecdbc16ac435beeb96a3cb1913bec1ba5c7 Jul 11 03:07:24.599105 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:24.599065 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-66f475786-wj46m" event={"ID":"4fc67bd8-4094-4629-b494-da78210fa48b","Type":"ContainerStarted","Data":"a577ec65e48d4812440fc9a0e4ffaecdbc16ac435beeb96a3cb1913bec1ba5c7"} Jul 11 03:07:26.606240 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:26.606201 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-66f475786-wj46m" event={"ID":"4fc67bd8-4094-4629-b494-da78210fa48b","Type":"ContainerStarted","Data":"112b6871a6c6a2a9db7f6ea1f8e0e54241e350cbed89baed9fb14712ac0e8565"} Jul 11 03:07:26.622708 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:26.622660 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-66f475786-wj46m" podStartSLOduration=2.011243835 podStartE2EDuration="3.622643682s" totalImagesPullingTime="1.611399847s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:07:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:07:26.622335712 +0000 UTC m=+270.590948170" watchObservedRunningTime="2026-07-11 03:07:26.622643682 +0000 UTC m=+270.591256132" Jul 11 03:07:31.395888 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:31.395854 2559 patch_prober.go:28] interesting pod/image-registry-68db5c7c66-v5d5w container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 11 03:07:31.396344 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:31.395914 2559 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-68db5c7c66-v5d5w" podUID="31daaeaf-20c6-4b42-9aa7-5abba272b150" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 11 03:07:34.566857 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:34.566819 2559 patch_prober.go:28] interesting pod/image-registry-68db5c7c66-v5d5w container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 11 03:07:34.567241 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:34.566881 2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-68db5c7c66-v5d5w" podUID="31daaeaf-20c6-4b42-9aa7-5abba272b150" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 11 03:07:38.263109 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:07:38.263060 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-n2kth" podUID="cc8bfa4f-eaf4-4b7e-bc00-bff618dfeacd" Jul 11 03:07:38.648795 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:38.648758 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-n2kth" Jul 11 03:07:40.084892 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:40.084852 2559 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7456896c56-s2kxt" podUID="290fba72-89d9-43c6-acb6-f69aa7beb9d9" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 11 03:07:41.396421 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:41.396384 2559 patch_prober.go:28] interesting pod/image-registry-68db5c7c66-v5d5w container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 11 03:07:41.396791 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:41.396444 2559 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-68db5c7c66-v5d5w" podUID="31daaeaf-20c6-4b42-9aa7-5abba272b150" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 11 03:07:41.424905 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:41.424869 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cc8bfa4f-eaf4-4b7e-bc00-bff618dfeacd-metrics-tls\") pod \"dns-default-n2kth\" (UID: \"cc8bfa4f-eaf4-4b7e-bc00-bff618dfeacd\") " pod="openshift-dns/dns-default-n2kth" Jul 11 03:07:41.427304 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:41.427286 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cc8bfa4f-eaf4-4b7e-bc00-bff618dfeacd-metrics-tls\") pod \"dns-default-n2kth\" (UID: \"cc8bfa4f-eaf4-4b7e-bc00-bff618dfeacd\") " pod="openshift-dns/dns-default-n2kth" Jul 11 03:07:41.652035 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:41.651921 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-r5f9b\"" Jul 11 03:07:41.659899 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:41.659875 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-n2kth" Jul 11 03:07:41.789389 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:41.789337 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-n2kth"] Jul 11 03:07:41.791810 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:07:41.791785 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc8bfa4f_eaf4_4b7e_bc00_bff618dfeacd.slice/crio-1cf21faf6845ee240103bc5e8d3d4a3f378a0791a0c9d74e9365083bb10a1077 WatchSource:0}: Error finding container 1cf21faf6845ee240103bc5e8d3d4a3f378a0791a0c9d74e9365083bb10a1077: Status 404 returned error can't find the container with id 1cf21faf6845ee240103bc5e8d3d4a3f378a0791a0c9d74e9365083bb10a1077 Jul 11 03:07:42.663932 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:42.663899 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-n2kth" event={"ID":"cc8bfa4f-eaf4-4b7e-bc00-bff618dfeacd","Type":"ContainerStarted","Data":"1cf21faf6845ee240103bc5e8d3d4a3f378a0791a0c9d74e9365083bb10a1077"} Jul 11 03:07:43.669330 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:43.669292 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-n2kth" event={"ID":"cc8bfa4f-eaf4-4b7e-bc00-bff618dfeacd","Type":"ContainerStarted","Data":"e7ca619162c5fc7b23508afcaacb34ec26f27a6104390df2adb7b6170883bceb"} Jul 11 03:07:43.669698 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:43.669347 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-n2kth" event={"ID":"cc8bfa4f-eaf4-4b7e-bc00-bff618dfeacd","Type":"ContainerStarted","Data":"4727810469d2c374182627ebaa4ef92454c084e0ad6534c0259c4228f462b13c"} Jul 11 03:07:43.669698 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:43.669386 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-n2kth" Jul 11 03:07:43.685813 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:43.685757 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-n2kth" podStartSLOduration=251.025784536 podStartE2EDuration="4m12.685741003s" totalImagesPullingTime="1.659956467s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:03:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:07:43.684059015 +0000 UTC m=+287.652671466" watchObservedRunningTime="2026-07-11 03:07:43.685741003 +0000 UTC m=+287.654353454" Jul 11 03:07:44.249573 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:44.249528 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-66f475786-wj46m" Jul 11 03:07:44.249755 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:44.249639 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-66f475786-wj46m" Jul 11 03:07:44.566797 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:44.566773 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-68db5c7c66-v5d5w" Jul 11 03:07:50.084505 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:50.084462 2559 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7456896c56-s2kxt" podUID="290fba72-89d9-43c6-acb6-f69aa7beb9d9" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 11 03:07:53.674457 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:53.674424 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-n2kth" Jul 11 03:07:56.443083 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:56.443004 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hb24z_4287b506-42a9-4b1d-85e8-91008605fd2c/ovn-acl-logging/0.log" Jul 11 03:07:56.445907 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:56.445882 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hb24z_4287b506-42a9-4b1d-85e8-91008605fd2c/ovn-acl-logging/0.log" Jul 11 03:07:56.448189 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:56.448166 2559 kubelet.go:1648] "Image garbage collection succeeded" Jul 11 03:07:57.002548 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:57.002514 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5cc9f4758c-bl5ff"] Jul 11 03:07:57.004537 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:57.004519 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cc9f4758c-bl5ff" Jul 11 03:07:57.007027 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:57.006999 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 11 03:07:57.007176 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:57.007100 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 11 03:07:57.007236 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:57.007183 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 11 03:07:57.007369 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:57.007354 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 11 03:07:57.008234 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:57.008213 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 11 03:07:57.008351 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:57.008278 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 11 03:07:57.008711 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:57.008696 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 11 03:07:57.009104 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:57.009087 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-g2w8p\"" Jul 11 03:07:57.013641 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:57.013598 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 11 03:07:57.015949 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:57.015926 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5cc9f4758c-bl5ff"] Jul 11 03:07:57.040833 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:57.040799 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8e6cbfd-7c23-41f5-9337-ed6be1e92c2a-trusted-ca-bundle\") pod \"console-5cc9f4758c-bl5ff\" (UID: \"e8e6cbfd-7c23-41f5-9337-ed6be1e92c2a\") " pod="openshift-console/console-5cc9f4758c-bl5ff" Jul 11 03:07:57.040833 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:57.040843 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4lhtv\" (UniqueName: \"kubernetes.io/projected/e8e6cbfd-7c23-41f5-9337-ed6be1e92c2a-kube-api-access-4lhtv\") pod \"console-5cc9f4758c-bl5ff\" (UID: \"e8e6cbfd-7c23-41f5-9337-ed6be1e92c2a\") " pod="openshift-console/console-5cc9f4758c-bl5ff" Jul 11 03:07:57.041118 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:57.040907 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e8e6cbfd-7c23-41f5-9337-ed6be1e92c2a-console-serving-cert\") pod \"console-5cc9f4758c-bl5ff\" (UID: \"e8e6cbfd-7c23-41f5-9337-ed6be1e92c2a\") " pod="openshift-console/console-5cc9f4758c-bl5ff" Jul 11 03:07:57.041118 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:57.041014 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e8e6cbfd-7c23-41f5-9337-ed6be1e92c2a-console-oauth-config\") pod \"console-5cc9f4758c-bl5ff\" (UID: \"e8e6cbfd-7c23-41f5-9337-ed6be1e92c2a\") " pod="openshift-console/console-5cc9f4758c-bl5ff" Jul 11 03:07:57.041118 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:57.041042 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e8e6cbfd-7c23-41f5-9337-ed6be1e92c2a-service-ca\") pod \"console-5cc9f4758c-bl5ff\" (UID: \"e8e6cbfd-7c23-41f5-9337-ed6be1e92c2a\") " pod="openshift-console/console-5cc9f4758c-bl5ff" Jul 11 03:07:57.041118 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:57.041094 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e8e6cbfd-7c23-41f5-9337-ed6be1e92c2a-oauth-serving-cert\") pod \"console-5cc9f4758c-bl5ff\" (UID: \"e8e6cbfd-7c23-41f5-9337-ed6be1e92c2a\") " pod="openshift-console/console-5cc9f4758c-bl5ff" Jul 11 03:07:57.041254 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:57.041130 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e8e6cbfd-7c23-41f5-9337-ed6be1e92c2a-console-config\") pod \"console-5cc9f4758c-bl5ff\" (UID: \"e8e6cbfd-7c23-41f5-9337-ed6be1e92c2a\") " pod="openshift-console/console-5cc9f4758c-bl5ff" Jul 11 03:07:57.142135 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:57.142090 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8e6cbfd-7c23-41f5-9337-ed6be1e92c2a-trusted-ca-bundle\") pod \"console-5cc9f4758c-bl5ff\" (UID: \"e8e6cbfd-7c23-41f5-9337-ed6be1e92c2a\") " pod="openshift-console/console-5cc9f4758c-bl5ff" Jul 11 03:07:57.142327 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:57.142187 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4lhtv\" (UniqueName: \"kubernetes.io/projected/e8e6cbfd-7c23-41f5-9337-ed6be1e92c2a-kube-api-access-4lhtv\") pod \"console-5cc9f4758c-bl5ff\" (UID: \"e8e6cbfd-7c23-41f5-9337-ed6be1e92c2a\") " pod="openshift-console/console-5cc9f4758c-bl5ff" Jul 11 03:07:57.142327 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:57.142264 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e8e6cbfd-7c23-41f5-9337-ed6be1e92c2a-console-serving-cert\") pod \"console-5cc9f4758c-bl5ff\" (UID: \"e8e6cbfd-7c23-41f5-9337-ed6be1e92c2a\") " pod="openshift-console/console-5cc9f4758c-bl5ff" Jul 11 03:07:57.142327 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:57.142293 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e8e6cbfd-7c23-41f5-9337-ed6be1e92c2a-console-oauth-config\") pod \"console-5cc9f4758c-bl5ff\" (UID: \"e8e6cbfd-7c23-41f5-9337-ed6be1e92c2a\") " pod="openshift-console/console-5cc9f4758c-bl5ff" Jul 11 03:07:57.142327 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:57.142309 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e8e6cbfd-7c23-41f5-9337-ed6be1e92c2a-service-ca\") pod \"console-5cc9f4758c-bl5ff\" (UID: \"e8e6cbfd-7c23-41f5-9337-ed6be1e92c2a\") " pod="openshift-console/console-5cc9f4758c-bl5ff" Jul 11 03:07:57.142521 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:57.142339 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e8e6cbfd-7c23-41f5-9337-ed6be1e92c2a-oauth-serving-cert\") pod \"console-5cc9f4758c-bl5ff\" (UID: \"e8e6cbfd-7c23-41f5-9337-ed6be1e92c2a\") " pod="openshift-console/console-5cc9f4758c-bl5ff" Jul 11 03:07:57.142521 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:57.142377 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e8e6cbfd-7c23-41f5-9337-ed6be1e92c2a-console-config\") pod \"console-5cc9f4758c-bl5ff\" (UID: \"e8e6cbfd-7c23-41f5-9337-ed6be1e92c2a\") " pod="openshift-console/console-5cc9f4758c-bl5ff" Jul 11 03:07:57.143113 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:57.143085 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e8e6cbfd-7c23-41f5-9337-ed6be1e92c2a-oauth-serving-cert\") pod \"console-5cc9f4758c-bl5ff\" (UID: \"e8e6cbfd-7c23-41f5-9337-ed6be1e92c2a\") " pod="openshift-console/console-5cc9f4758c-bl5ff" Jul 11 03:07:57.143113 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:57.143106 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e8e6cbfd-7c23-41f5-9337-ed6be1e92c2a-console-config\") pod \"console-5cc9f4758c-bl5ff\" (UID: \"e8e6cbfd-7c23-41f5-9337-ed6be1e92c2a\") " pod="openshift-console/console-5cc9f4758c-bl5ff" Jul 11 03:07:57.143283 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:57.143085 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e8e6cbfd-7c23-41f5-9337-ed6be1e92c2a-service-ca\") pod \"console-5cc9f4758c-bl5ff\" (UID: \"e8e6cbfd-7c23-41f5-9337-ed6be1e92c2a\") " pod="openshift-console/console-5cc9f4758c-bl5ff" Jul 11 03:07:57.143320 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:57.143288 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8e6cbfd-7c23-41f5-9337-ed6be1e92c2a-trusted-ca-bundle\") pod \"console-5cc9f4758c-bl5ff\" (UID: \"e8e6cbfd-7c23-41f5-9337-ed6be1e92c2a\") " pod="openshift-console/console-5cc9f4758c-bl5ff" Jul 11 03:07:57.144758 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:57.144731 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e8e6cbfd-7c23-41f5-9337-ed6be1e92c2a-console-serving-cert\") pod \"console-5cc9f4758c-bl5ff\" (UID: \"e8e6cbfd-7c23-41f5-9337-ed6be1e92c2a\") " pod="openshift-console/console-5cc9f4758c-bl5ff" Jul 11 03:07:57.144948 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:57.144929 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e8e6cbfd-7c23-41f5-9337-ed6be1e92c2a-console-oauth-config\") pod \"console-5cc9f4758c-bl5ff\" (UID: \"e8e6cbfd-7c23-41f5-9337-ed6be1e92c2a\") " pod="openshift-console/console-5cc9f4758c-bl5ff" Jul 11 03:07:57.150761 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:57.150741 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4lhtv\" (UniqueName: \"kubernetes.io/projected/e8e6cbfd-7c23-41f5-9337-ed6be1e92c2a-kube-api-access-4lhtv\") pod \"console-5cc9f4758c-bl5ff\" (UID: \"e8e6cbfd-7c23-41f5-9337-ed6be1e92c2a\") " pod="openshift-console/console-5cc9f4758c-bl5ff" Jul 11 03:07:57.315711 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:57.315664 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cc9f4758c-bl5ff" Jul 11 03:07:57.449858 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:57.449835 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5cc9f4758c-bl5ff"] Jul 11 03:07:57.452142 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:07:57.452115 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8e6cbfd_7c23_41f5_9337_ed6be1e92c2a.slice/crio-1d185c3f174c4b95d9a604037c0cd9f1d920e6b097fadce9688508331340daab WatchSource:0}: Error finding container 1d185c3f174c4b95d9a604037c0cd9f1d920e6b097fadce9688508331340daab: Status 404 returned error can't find the container with id 1d185c3f174c4b95d9a604037c0cd9f1d920e6b097fadce9688508331340daab Jul 11 03:07:57.715431 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:07:57.715344 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cc9f4758c-bl5ff" event={"ID":"e8e6cbfd-7c23-41f5-9337-ed6be1e92c2a","Type":"ContainerStarted","Data":"1d185c3f174c4b95d9a604037c0cd9f1d920e6b097fadce9688508331340daab"} Jul 11 03:08:00.085073 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:08:00.085017 2559 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7456896c56-s2kxt" podUID="290fba72-89d9-43c6-acb6-f69aa7beb9d9" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 11 03:08:00.085535 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:08:00.085117 2559 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7456896c56-s2kxt" Jul 11 03:08:00.085727 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:08:00.085679 2559 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"fd4fff2b6d20f003faa86c50b553e33693460f20d380276a63ca92ad7d669e3a"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7456896c56-s2kxt" containerMessage="Container service-proxy failed liveness probe, will be restarted" Jul 11 03:08:00.085851 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:08:00.085742 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7456896c56-s2kxt" podUID="290fba72-89d9-43c6-acb6-f69aa7beb9d9" containerName="service-proxy" containerID="cri-o://fd4fff2b6d20f003faa86c50b553e33693460f20d380276a63ca92ad7d669e3a" gracePeriod=30 Jul 11 03:08:00.729440 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:08:00.729408 2559 generic.go:356] "Generic (PLEG): container finished" podID="290fba72-89d9-43c6-acb6-f69aa7beb9d9" containerID="fd4fff2b6d20f003faa86c50b553e33693460f20d380276a63ca92ad7d669e3a" exitCode=2 Jul 11 03:08:00.729623 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:08:00.729478 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7456896c56-s2kxt" event={"ID":"290fba72-89d9-43c6-acb6-f69aa7beb9d9","Type":"ContainerDied","Data":"fd4fff2b6d20f003faa86c50b553e33693460f20d380276a63ca92ad7d669e3a"} Jul 11 03:08:00.729623 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:08:00.729519 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7456896c56-s2kxt" event={"ID":"290fba72-89d9-43c6-acb6-f69aa7beb9d9","Type":"ContainerStarted","Data":"59ed04fe12b453ae2a55ef38090b2752ffae7fbdda4497bfd9ca17b3b29a2da7"} Jul 11 03:08:00.731023 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:08:00.730998 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cc9f4758c-bl5ff" event={"ID":"e8e6cbfd-7c23-41f5-9337-ed6be1e92c2a","Type":"ContainerStarted","Data":"2bc25898bdb6439d73237dc1d488f79b93d635108ad1d4ab86c4523d8add13c8"} Jul 11 03:08:00.765012 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:08:00.764796 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5cc9f4758c-bl5ff" podStartSLOduration=2.069838185 podStartE2EDuration="4.7647765s" totalImagesPullingTime="2.694938315s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:07:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:08:00.763287166 +0000 UTC m=+304.731899647" watchObservedRunningTime="2026-07-11 03:08:00.7647765 +0000 UTC m=+304.733388930" Jul 11 03:08:04.255249 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:08:04.255222 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-66f475786-wj46m" Jul 11 03:08:04.259234 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:08:04.259208 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-66f475786-wj46m" Jul 11 03:08:07.315866 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:08:07.315823 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5cc9f4758c-bl5ff" Jul 11 03:08:07.316278 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:08:07.315922 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5cc9f4758c-bl5ff" Jul 11 03:08:07.320460 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:08:07.320434 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5cc9f4758c-bl5ff" Jul 11 03:08:07.757422 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:08:07.757337 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5cc9f4758c-bl5ff" Jul 11 03:08:10.383085 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:08:10.383054 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-66f475786-wj46m_4fc67bd8-4094-4629-b494-da78210fa48b/metrics-server/0.log" Jul 11 03:08:11.982857 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:08:11.982828 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zsnxt_2f36027a-012a-4ff0-9879-d7ba45a44d24/init-textfile/0.log" Jul 11 03:08:12.183811 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:08:12.183782 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zsnxt_2f36027a-012a-4ff0-9879-d7ba45a44d24/node-exporter/0.log" Jul 11 03:08:12.383293 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:08:12.383263 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zsnxt_2f36027a-012a-4ff0-9879-d7ba45a44d24/kube-rbac-proxy/0.log" Jul 11 03:08:17.583291 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:08:17.583262 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5cc9f4758c-bl5ff_e8e6cbfd-7c23-41f5-9337-ed6be1e92c2a/console/0.log" Jul 11 03:08:18.382369 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:08:18.382336 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-lctnz_252b2aed-79e7-440f-bcc4-1f147e071cbf/serve-healthcheck-canary/0.log" Jul 11 03:08:47.725816 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:08:47.725737 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5cc9f4758c-bl5ff"] Jul 11 03:09:12.746738 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:09:12.746676 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5cc9f4758c-bl5ff" podUID="e8e6cbfd-7c23-41f5-9337-ed6be1e92c2a" containerName="console" containerID="cri-o://2bc25898bdb6439d73237dc1d488f79b93d635108ad1d4ab86c4523d8add13c8" gracePeriod=15 Jul 11 03:09:12.974778 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:09:12.974751 2559 generic.go:356] "Generic (PLEG): container finished" podID="e8e6cbfd-7c23-41f5-9337-ed6be1e92c2a" containerID="2bc25898bdb6439d73237dc1d488f79b93d635108ad1d4ab86c4523d8add13c8" exitCode=0 Jul 11 03:09:12.974860 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:09:12.974828 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cc9f4758c-bl5ff" event={"ID":"e8e6cbfd-7c23-41f5-9337-ed6be1e92c2a","Type":"ContainerDied","Data":"2bc25898bdb6439d73237dc1d488f79b93d635108ad1d4ab86c4523d8add13c8"} Jul 11 03:09:12.988336 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:09:12.988313 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cc9f4758c-bl5ff" Jul 11 03:09:13.097352 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:09:13.097318 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8e6cbfd-7c23-41f5-9337-ed6be1e92c2a-trusted-ca-bundle\") pod \"e8e6cbfd-7c23-41f5-9337-ed6be1e92c2a\" (UID: \"e8e6cbfd-7c23-41f5-9337-ed6be1e92c2a\") " Jul 11 03:09:13.097552 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:09:13.097380 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e8e6cbfd-7c23-41f5-9337-ed6be1e92c2a-service-ca\") pod \"e8e6cbfd-7c23-41f5-9337-ed6be1e92c2a\" (UID: \"e8e6cbfd-7c23-41f5-9337-ed6be1e92c2a\") " Jul 11 03:09:13.097552 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:09:13.097415 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e8e6cbfd-7c23-41f5-9337-ed6be1e92c2a-console-serving-cert\") pod \"e8e6cbfd-7c23-41f5-9337-ed6be1e92c2a\" (UID: \"e8e6cbfd-7c23-41f5-9337-ed6be1e92c2a\") " Jul 11 03:09:13.097552 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:09:13.097439 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e8e6cbfd-7c23-41f5-9337-ed6be1e92c2a-console-config\") pod \"e8e6cbfd-7c23-41f5-9337-ed6be1e92c2a\" (UID: \"e8e6cbfd-7c23-41f5-9337-ed6be1e92c2a\") " Jul 11 03:09:13.097552 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:09:13.097454 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e8e6cbfd-7c23-41f5-9337-ed6be1e92c2a-oauth-serving-cert\") pod \"e8e6cbfd-7c23-41f5-9337-ed6be1e92c2a\" (UID: \"e8e6cbfd-7c23-41f5-9337-ed6be1e92c2a\") " Jul 11 03:09:13.097552 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:09:13.097473 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4lhtv\" (UniqueName: \"kubernetes.io/projected/e8e6cbfd-7c23-41f5-9337-ed6be1e92c2a-kube-api-access-4lhtv\") pod \"e8e6cbfd-7c23-41f5-9337-ed6be1e92c2a\" (UID: \"e8e6cbfd-7c23-41f5-9337-ed6be1e92c2a\") " Jul 11 03:09:13.097552 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:09:13.097489 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e8e6cbfd-7c23-41f5-9337-ed6be1e92c2a-console-oauth-config\") pod \"e8e6cbfd-7c23-41f5-9337-ed6be1e92c2a\" (UID: \"e8e6cbfd-7c23-41f5-9337-ed6be1e92c2a\") " Jul 11 03:09:13.097858 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:09:13.097780 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e8e6cbfd-7c23-41f5-9337-ed6be1e92c2a-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "e8e6cbfd-7c23-41f5-9337-ed6be1e92c2a" (UID: "e8e6cbfd-7c23-41f5-9337-ed6be1e92c2a"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 11 03:09:13.097911 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:09:13.097864 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e8e6cbfd-7c23-41f5-9337-ed6be1e92c2a-service-ca" (OuterVolumeSpecName: "service-ca") pod "e8e6cbfd-7c23-41f5-9337-ed6be1e92c2a" (UID: "e8e6cbfd-7c23-41f5-9337-ed6be1e92c2a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 11 03:09:13.097911 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:09:13.097893 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e8e6cbfd-7c23-41f5-9337-ed6be1e92c2a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e8e6cbfd-7c23-41f5-9337-ed6be1e92c2a" (UID: "e8e6cbfd-7c23-41f5-9337-ed6be1e92c2a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 11 03:09:13.098022 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:09:13.097901 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e8e6cbfd-7c23-41f5-9337-ed6be1e92c2a-console-config" (OuterVolumeSpecName: "console-config") pod "e8e6cbfd-7c23-41f5-9337-ed6be1e92c2a" (UID: "e8e6cbfd-7c23-41f5-9337-ed6be1e92c2a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 11 03:09:13.099923 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:09:13.099894 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e8e6cbfd-7c23-41f5-9337-ed6be1e92c2a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e8e6cbfd-7c23-41f5-9337-ed6be1e92c2a" (UID: "e8e6cbfd-7c23-41f5-9337-ed6be1e92c2a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 11 03:09:13.099923 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:09:13.099915 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e8e6cbfd-7c23-41f5-9337-ed6be1e92c2a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e8e6cbfd-7c23-41f5-9337-ed6be1e92c2a" (UID: "e8e6cbfd-7c23-41f5-9337-ed6be1e92c2a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 11 03:09:13.100072 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:09:13.099916 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8e6cbfd-7c23-41f5-9337-ed6be1e92c2a-kube-api-access-4lhtv" (OuterVolumeSpecName: "kube-api-access-4lhtv") pod "e8e6cbfd-7c23-41f5-9337-ed6be1e92c2a" (UID: "e8e6cbfd-7c23-41f5-9337-ed6be1e92c2a"). InnerVolumeSpecName "kube-api-access-4lhtv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 11 03:09:13.198458 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:09:13.198420 2559 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8e6cbfd-7c23-41f5-9337-ed6be1e92c2a-trusted-ca-bundle\") on node \"ip-10-0-141-141.ec2.internal\" DevicePath \"\"" Jul 11 03:09:13.198458 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:09:13.198451 2559 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e8e6cbfd-7c23-41f5-9337-ed6be1e92c2a-service-ca\") on node \"ip-10-0-141-141.ec2.internal\" DevicePath \"\"" Jul 11 03:09:13.198458 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:09:13.198460 2559 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e8e6cbfd-7c23-41f5-9337-ed6be1e92c2a-console-serving-cert\") on node \"ip-10-0-141-141.ec2.internal\" DevicePath \"\"" Jul 11 03:09:13.198458 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:09:13.198469 2559 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e8e6cbfd-7c23-41f5-9337-ed6be1e92c2a-console-config\") on node \"ip-10-0-141-141.ec2.internal\" DevicePath \"\"" Jul 11 03:09:13.198711 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:09:13.198479 2559 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e8e6cbfd-7c23-41f5-9337-ed6be1e92c2a-oauth-serving-cert\") on node \"ip-10-0-141-141.ec2.internal\" DevicePath \"\"" Jul 11 03:09:13.198711 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:09:13.198487 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4lhtv\" (UniqueName: \"kubernetes.io/projected/e8e6cbfd-7c23-41f5-9337-ed6be1e92c2a-kube-api-access-4lhtv\") on node \"ip-10-0-141-141.ec2.internal\" DevicePath \"\"" Jul 11 03:09:13.198711 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:09:13.198495 2559 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e8e6cbfd-7c23-41f5-9337-ed6be1e92c2a-console-oauth-config\") on node \"ip-10-0-141-141.ec2.internal\" DevicePath \"\"" Jul 11 03:09:13.979089 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:09:13.979051 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cc9f4758c-bl5ff" event={"ID":"e8e6cbfd-7c23-41f5-9337-ed6be1e92c2a","Type":"ContainerDied","Data":"1d185c3f174c4b95d9a604037c0cd9f1d920e6b097fadce9688508331340daab"} Jul 11 03:09:13.979089 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:09:13.979083 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cc9f4758c-bl5ff" Jul 11 03:09:13.979565 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:09:13.979135 2559 scope.go:117] "RemoveContainer" containerID="2bc25898bdb6439d73237dc1d488f79b93d635108ad1d4ab86c4523d8add13c8" Jul 11 03:09:13.998304 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:09:13.998279 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5cc9f4758c-bl5ff"] Jul 11 03:09:14.001953 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:09:14.001932 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5cc9f4758c-bl5ff"] Jul 11 03:09:14.613370 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:09:14.613338 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e8e6cbfd-7c23-41f5-9337-ed6be1e92c2a" path="/var/lib/kubelet/pods/e8e6cbfd-7c23-41f5-9337-ed6be1e92c2a/volumes" Jul 11 03:09:19.726146 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:09:19.726106 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s7qdl"] Jul 11 03:09:19.726612 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:09:19.726333 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8e6cbfd-7c23-41f5-9337-ed6be1e92c2a" containerName="console" Jul 11 03:09:19.726612 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:09:19.726343 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8e6cbfd-7c23-41f5-9337-ed6be1e92c2a" containerName="console" Jul 11 03:09:19.726612 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:09:19.726397 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="e8e6cbfd-7c23-41f5-9337-ed6be1e92c2a" containerName="console" Jul 11 03:09:19.729287 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:09:19.729271 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s7qdl" Jul 11 03:09:19.731819 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:09:19.731795 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 11 03:09:19.731976 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:09:19.731834 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 11 03:09:19.731976 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:09:19.731803 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-n7lfr\"" Jul 11 03:09:19.739346 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:09:19.739319 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s7qdl"] Jul 11 03:09:19.847940 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:09:19.847897 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ntfsf\" (UniqueName: \"kubernetes.io/projected/be85f804-e965-4107-8c88-cf8b6d07cb15-kube-api-access-ntfsf\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s7qdl\" (UID: \"be85f804-e965-4107-8c88-cf8b6d07cb15\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s7qdl" Jul 11 03:09:19.847940 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:09:19.847949 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/be85f804-e965-4107-8c88-cf8b6d07cb15-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s7qdl\" (UID: \"be85f804-e965-4107-8c88-cf8b6d07cb15\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s7qdl" Jul 11 03:09:19.848214 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:09:19.848019 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/be85f804-e965-4107-8c88-cf8b6d07cb15-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s7qdl\" (UID: \"be85f804-e965-4107-8c88-cf8b6d07cb15\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s7qdl" Jul 11 03:09:19.949256 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:09:19.949222 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ntfsf\" (UniqueName: \"kubernetes.io/projected/be85f804-e965-4107-8c88-cf8b6d07cb15-kube-api-access-ntfsf\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s7qdl\" (UID: \"be85f804-e965-4107-8c88-cf8b6d07cb15\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s7qdl" Jul 11 03:09:19.949420 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:09:19.949269 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/be85f804-e965-4107-8c88-cf8b6d07cb15-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s7qdl\" (UID: \"be85f804-e965-4107-8c88-cf8b6d07cb15\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s7qdl" Jul 11 03:09:19.949420 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:09:19.949286 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/be85f804-e965-4107-8c88-cf8b6d07cb15-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s7qdl\" (UID: \"be85f804-e965-4107-8c88-cf8b6d07cb15\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s7qdl" Jul 11 03:09:19.949629 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:09:19.949612 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/be85f804-e965-4107-8c88-cf8b6d07cb15-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s7qdl\" (UID: \"be85f804-e965-4107-8c88-cf8b6d07cb15\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s7qdl" Jul 11 03:09:19.949694 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:09:19.949679 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/be85f804-e965-4107-8c88-cf8b6d07cb15-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s7qdl\" (UID: \"be85f804-e965-4107-8c88-cf8b6d07cb15\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s7qdl" Jul 11 03:09:19.957386 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:09:19.957359 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ntfsf\" (UniqueName: \"kubernetes.io/projected/be85f804-e965-4107-8c88-cf8b6d07cb15-kube-api-access-ntfsf\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s7qdl\" (UID: \"be85f804-e965-4107-8c88-cf8b6d07cb15\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s7qdl" Jul 11 03:09:20.038576 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:09:20.038541 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s7qdl" Jul 11 03:09:20.176329 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:09:20.176302 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s7qdl"] Jul 11 03:09:20.178826 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:09:20.178799 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe85f804_e965_4107_8c88_cf8b6d07cb15.slice/crio-b385259a982c03f6986db2e80371fc7e3fcad6be67ed7008c5505ac9782e721c WatchSource:0}: Error finding container b385259a982c03f6986db2e80371fc7e3fcad6be67ed7008c5505ac9782e721c: Status 404 returned error can't find the container with id b385259a982c03f6986db2e80371fc7e3fcad6be67ed7008c5505ac9782e721c Jul 11 03:09:20.180597 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:09:20.180579 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 11 03:09:21.003421 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:09:21.003387 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s7qdl" event={"ID":"be85f804-e965-4107-8c88-cf8b6d07cb15","Type":"ContainerStarted","Data":"b385259a982c03f6986db2e80371fc7e3fcad6be67ed7008c5505ac9782e721c"} Jul 11 03:09:29.036593 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:09:29.036549 2559 generic.go:356] "Generic (PLEG): container finished" podID="be85f804-e965-4107-8c88-cf8b6d07cb15" containerID="f4dc1f0be6ded5a6b1582c53b857daa9d249f44201f832f5c8d9ad86a846ea71" exitCode=0 Jul 11 03:09:29.036994 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:09:29.036628 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s7qdl" event={"ID":"be85f804-e965-4107-8c88-cf8b6d07cb15","Type":"ContainerDied","Data":"f4dc1f0be6ded5a6b1582c53b857daa9d249f44201f832f5c8d9ad86a846ea71"} Jul 11 03:09:32.049351 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:09:32.049315 2559 generic.go:356] "Generic (PLEG): container finished" podID="be85f804-e965-4107-8c88-cf8b6d07cb15" containerID="c8514f857d0d8fd002fa0435faba4880ccefa92e05c49f8a5d5ec4b235a164f8" exitCode=0 Jul 11 03:09:32.049721 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:09:32.049402 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s7qdl" event={"ID":"be85f804-e965-4107-8c88-cf8b6d07cb15","Type":"ContainerDied","Data":"c8514f857d0d8fd002fa0435faba4880ccefa92e05c49f8a5d5ec4b235a164f8"} Jul 11 03:09:41.086704 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:09:41.086664 2559 generic.go:356] "Generic (PLEG): container finished" podID="be85f804-e965-4107-8c88-cf8b6d07cb15" containerID="442ed3ccf8df023390b79aeefc1c239535b9252a3624d6168fb6b815a208283a" exitCode=0 Jul 11 03:09:41.087139 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:09:41.086762 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s7qdl" event={"ID":"be85f804-e965-4107-8c88-cf8b6d07cb15","Type":"ContainerDied","Data":"442ed3ccf8df023390b79aeefc1c239535b9252a3624d6168fb6b815a208283a"} Jul 11 03:09:42.272610 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:09:42.272566 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s7qdl" Jul 11 03:09:42.429254 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:09:42.429159 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/be85f804-e965-4107-8c88-cf8b6d07cb15-bundle\") pod \"be85f804-e965-4107-8c88-cf8b6d07cb15\" (UID: \"be85f804-e965-4107-8c88-cf8b6d07cb15\") " Jul 11 03:09:42.429254 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:09:42.429204 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/be85f804-e965-4107-8c88-cf8b6d07cb15-util\") pod \"be85f804-e965-4107-8c88-cf8b6d07cb15\" (UID: \"be85f804-e965-4107-8c88-cf8b6d07cb15\") " Jul 11 03:09:42.429254 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:09:42.429252 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ntfsf\" (UniqueName: \"kubernetes.io/projected/be85f804-e965-4107-8c88-cf8b6d07cb15-kube-api-access-ntfsf\") pod \"be85f804-e965-4107-8c88-cf8b6d07cb15\" (UID: \"be85f804-e965-4107-8c88-cf8b6d07cb15\") " Jul 11 03:09:42.429790 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:09:42.429764 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be85f804-e965-4107-8c88-cf8b6d07cb15-bundle" (OuterVolumeSpecName: "bundle") pod "be85f804-e965-4107-8c88-cf8b6d07cb15" (UID: "be85f804-e965-4107-8c88-cf8b6d07cb15"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 11 03:09:42.431669 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:09:42.431641 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be85f804-e965-4107-8c88-cf8b6d07cb15-kube-api-access-ntfsf" (OuterVolumeSpecName: "kube-api-access-ntfsf") pod "be85f804-e965-4107-8c88-cf8b6d07cb15" (UID: "be85f804-e965-4107-8c88-cf8b6d07cb15"). InnerVolumeSpecName "kube-api-access-ntfsf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 11 03:09:42.434109 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:09:42.434085 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be85f804-e965-4107-8c88-cf8b6d07cb15-util" (OuterVolumeSpecName: "util") pod "be85f804-e965-4107-8c88-cf8b6d07cb15" (UID: "be85f804-e965-4107-8c88-cf8b6d07cb15"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 11 03:09:42.530216 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:09:42.530179 2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/be85f804-e965-4107-8c88-cf8b6d07cb15-util\") on node \"ip-10-0-141-141.ec2.internal\" DevicePath \"\"" Jul 11 03:09:42.530216 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:09:42.530213 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ntfsf\" (UniqueName: \"kubernetes.io/projected/be85f804-e965-4107-8c88-cf8b6d07cb15-kube-api-access-ntfsf\") on node \"ip-10-0-141-141.ec2.internal\" DevicePath \"\"" Jul 11 03:09:42.530216 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:09:42.530225 2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/be85f804-e965-4107-8c88-cf8b6d07cb15-bundle\") on node \"ip-10-0-141-141.ec2.internal\" DevicePath \"\"" Jul 11 03:09:43.094949 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:09:43.094910 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s7qdl" event={"ID":"be85f804-e965-4107-8c88-cf8b6d07cb15","Type":"ContainerDied","Data":"b385259a982c03f6986db2e80371fc7e3fcad6be67ed7008c5505ac9782e721c"} Jul 11 03:09:43.095149 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:09:43.094928 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s7qdl" Jul 11 03:09:43.095149 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:09:43.095010 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b385259a982c03f6986db2e80371fc7e3fcad6be67ed7008c5505ac9782e721c" Jul 11 03:10:01.823746 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:10:01.823702 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-wjjz9"] Jul 11 03:10:01.824250 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:10:01.824053 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be85f804-e965-4107-8c88-cf8b6d07cb15" containerName="util" Jul 11 03:10:01.824250 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:10:01.824072 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="be85f804-e965-4107-8c88-cf8b6d07cb15" containerName="util" Jul 11 03:10:01.824250 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:10:01.824092 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be85f804-e965-4107-8c88-cf8b6d07cb15" containerName="pull" Jul 11 03:10:01.824250 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:10:01.824100 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="be85f804-e965-4107-8c88-cf8b6d07cb15" containerName="pull" Jul 11 03:10:01.824250 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:10:01.824110 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be85f804-e965-4107-8c88-cf8b6d07cb15" containerName="extract" Jul 11 03:10:01.824250 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:10:01.824117 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="be85f804-e965-4107-8c88-cf8b6d07cb15" containerName="extract" Jul 11 03:10:01.824250 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:10:01.824182 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="be85f804-e965-4107-8c88-cf8b6d07cb15" containerName="extract" Jul 11 03:10:01.826562 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:10:01.826538 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-wjjz9" Jul 11 03:10:01.828984 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:10:01.828945 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 11 03:10:01.829087 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:10:01.828949 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 11 03:10:01.829849 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:10:01.829835 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-fbfkv\"" Jul 11 03:10:01.837805 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:10:01.837777 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-wjjz9"] Jul 11 03:10:01.966272 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:10:01.966231 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e2961584-15b7-4d90-9c9c-7d006a22f359-bound-sa-token\") pod \"cert-manager-55b4d954d5-wjjz9\" (UID: \"e2961584-15b7-4d90-9c9c-7d006a22f359\") " pod="cert-manager/cert-manager-55b4d954d5-wjjz9" Jul 11 03:10:01.966443 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:10:01.966303 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nlmml\" (UniqueName: \"kubernetes.io/projected/e2961584-15b7-4d90-9c9c-7d006a22f359-kube-api-access-nlmml\") pod \"cert-manager-55b4d954d5-wjjz9\" (UID: \"e2961584-15b7-4d90-9c9c-7d006a22f359\") " pod="cert-manager/cert-manager-55b4d954d5-wjjz9" Jul 11 03:10:02.067499 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:10:02.067453 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nlmml\" (UniqueName: \"kubernetes.io/projected/e2961584-15b7-4d90-9c9c-7d006a22f359-kube-api-access-nlmml\") pod \"cert-manager-55b4d954d5-wjjz9\" (UID: \"e2961584-15b7-4d90-9c9c-7d006a22f359\") " pod="cert-manager/cert-manager-55b4d954d5-wjjz9" Jul 11 03:10:02.067499 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:10:02.067507 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e2961584-15b7-4d90-9c9c-7d006a22f359-bound-sa-token\") pod \"cert-manager-55b4d954d5-wjjz9\" (UID: \"e2961584-15b7-4d90-9c9c-7d006a22f359\") " pod="cert-manager/cert-manager-55b4d954d5-wjjz9" Jul 11 03:10:02.075497 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:10:02.075425 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nlmml\" (UniqueName: \"kubernetes.io/projected/e2961584-15b7-4d90-9c9c-7d006a22f359-kube-api-access-nlmml\") pod \"cert-manager-55b4d954d5-wjjz9\" (UID: \"e2961584-15b7-4d90-9c9c-7d006a22f359\") " pod="cert-manager/cert-manager-55b4d954d5-wjjz9" Jul 11 03:10:02.075497 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:10:02.075428 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e2961584-15b7-4d90-9c9c-7d006a22f359-bound-sa-token\") pod \"cert-manager-55b4d954d5-wjjz9\" (UID: \"e2961584-15b7-4d90-9c9c-7d006a22f359\") " pod="cert-manager/cert-manager-55b4d954d5-wjjz9" Jul 11 03:10:02.138423 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:10:02.138378 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-wjjz9" Jul 11 03:10:02.271641 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:10:02.271610 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-wjjz9"] Jul 11 03:10:02.274609 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:10:02.274583 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode2961584_15b7_4d90_9c9c_7d006a22f359.slice/crio-fb900da6381949e9a65b29b95690e98daf43f3a5388b68a0cfb983b94d7a7b7a WatchSource:0}: Error finding container fb900da6381949e9a65b29b95690e98daf43f3a5388b68a0cfb983b94d7a7b7a: Status 404 returned error can't find the container with id fb900da6381949e9a65b29b95690e98daf43f3a5388b68a0cfb983b94d7a7b7a Jul 11 03:10:03.168443 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:10:03.168407 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-wjjz9" event={"ID":"e2961584-15b7-4d90-9c9c-7d006a22f359","Type":"ContainerStarted","Data":"fb900da6381949e9a65b29b95690e98daf43f3a5388b68a0cfb983b94d7a7b7a"} Jul 11 03:10:05.177159 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:10:05.177112 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-wjjz9" event={"ID":"e2961584-15b7-4d90-9c9c-7d006a22f359","Type":"ContainerStarted","Data":"8c3cf50844ee5fd01882544c05e64b92c4e8da3ef594c2b787fb59d75fed3654"} Jul 11 03:10:05.193875 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:10:05.193816 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-wjjz9" podStartSLOduration=1.385492814 podStartE2EDuration="4.193798358s" totalImagesPullingTime="2.808305544s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:10:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:10:05.19308821 +0000 UTC m=+429.161700664" watchObservedRunningTime="2026-07-11 03:10:05.193798358 +0000 UTC m=+429.162410809" Jul 11 03:10:36.641825 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:10:36.641741 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjfl85"] Jul 11 03:10:36.644005 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:10:36.643984 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjfl85" Jul 11 03:10:36.646368 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:10:36.646345 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 11 03:10:36.646509 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:10:36.646347 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 11 03:10:36.646509 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:10:36.646347 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-n7lfr\"" Jul 11 03:10:36.653532 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:10:36.653510 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjfl85"] Jul 11 03:10:36.709336 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:10:36.709294 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/80d67cd5-1ac0-46c4-8b7a-97ff83bc3c0f-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjfl85\" (UID: \"80d67cd5-1ac0-46c4-8b7a-97ff83bc3c0f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjfl85" Jul 11 03:10:36.709518 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:10:36.709345 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/80d67cd5-1ac0-46c4-8b7a-97ff83bc3c0f-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjfl85\" (UID: \"80d67cd5-1ac0-46c4-8b7a-97ff83bc3c0f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjfl85" Jul 11 03:10:36.709518 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:10:36.709486 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmpcn\" (UniqueName: \"kubernetes.io/projected/80d67cd5-1ac0-46c4-8b7a-97ff83bc3c0f-kube-api-access-pmpcn\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjfl85\" (UID: \"80d67cd5-1ac0-46c4-8b7a-97ff83bc3c0f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjfl85" Jul 11 03:10:36.810669 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:10:36.810620 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/80d67cd5-1ac0-46c4-8b7a-97ff83bc3c0f-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjfl85\" (UID: \"80d67cd5-1ac0-46c4-8b7a-97ff83bc3c0f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjfl85" Jul 11 03:10:36.810859 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:10:36.810676 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/80d67cd5-1ac0-46c4-8b7a-97ff83bc3c0f-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjfl85\" (UID: \"80d67cd5-1ac0-46c4-8b7a-97ff83bc3c0f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjfl85" Jul 11 03:10:36.810859 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:10:36.810745 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pmpcn\" (UniqueName: \"kubernetes.io/projected/80d67cd5-1ac0-46c4-8b7a-97ff83bc3c0f-kube-api-access-pmpcn\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjfl85\" (UID: \"80d67cd5-1ac0-46c4-8b7a-97ff83bc3c0f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjfl85" Jul 11 03:10:36.811113 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:10:36.811088 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/80d67cd5-1ac0-46c4-8b7a-97ff83bc3c0f-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjfl85\" (UID: \"80d67cd5-1ac0-46c4-8b7a-97ff83bc3c0f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjfl85" Jul 11 03:10:36.811209 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:10:36.811113 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/80d67cd5-1ac0-46c4-8b7a-97ff83bc3c0f-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjfl85\" (UID: \"80d67cd5-1ac0-46c4-8b7a-97ff83bc3c0f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjfl85" Jul 11 03:10:36.822562 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:10:36.822536 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmpcn\" (UniqueName: \"kubernetes.io/projected/80d67cd5-1ac0-46c4-8b7a-97ff83bc3c0f-kube-api-access-pmpcn\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjfl85\" (UID: \"80d67cd5-1ac0-46c4-8b7a-97ff83bc3c0f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjfl85" Jul 11 03:10:36.954098 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:10:36.953997 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjfl85" Jul 11 03:10:37.092653 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:10:37.092617 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjfl85"] Jul 11 03:10:37.096148 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:10:37.096112 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80d67cd5_1ac0_46c4_8b7a_97ff83bc3c0f.slice/crio-09cbc32ed39fb2950d8a46184a5ad59cfd60b45cbfe51694908951187e5f0d47 WatchSource:0}: Error finding container 09cbc32ed39fb2950d8a46184a5ad59cfd60b45cbfe51694908951187e5f0d47: Status 404 returned error can't find the container with id 09cbc32ed39fb2950d8a46184a5ad59cfd60b45cbfe51694908951187e5f0d47 Jul 11 03:10:37.287596 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:10:37.287565 2559 generic.go:356] "Generic (PLEG): container finished" podID="80d67cd5-1ac0-46c4-8b7a-97ff83bc3c0f" containerID="8c873d8ac9f06cb011a7894c1a355003e640d187312b287b7c6e01e8d15f6539" exitCode=0 Jul 11 03:10:37.287785 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:10:37.287647 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjfl85" event={"ID":"80d67cd5-1ac0-46c4-8b7a-97ff83bc3c0f","Type":"ContainerDied","Data":"8c873d8ac9f06cb011a7894c1a355003e640d187312b287b7c6e01e8d15f6539"} Jul 11 03:10:37.287785 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:10:37.287694 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjfl85" event={"ID":"80d67cd5-1ac0-46c4-8b7a-97ff83bc3c0f","Type":"ContainerStarted","Data":"09cbc32ed39fb2950d8a46184a5ad59cfd60b45cbfe51694908951187e5f0d47"} Jul 11 03:10:38.293168 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:10:38.293130 2559 generic.go:356] "Generic (PLEG): container finished" podID="80d67cd5-1ac0-46c4-8b7a-97ff83bc3c0f" containerID="42d234f67d92d990b9a33ffba1db8123b74be894072eebb5f294229b03491203" exitCode=0 Jul 11 03:10:38.293538 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:10:38.293198 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjfl85" event={"ID":"80d67cd5-1ac0-46c4-8b7a-97ff83bc3c0f","Type":"ContainerDied","Data":"42d234f67d92d990b9a33ffba1db8123b74be894072eebb5f294229b03491203"} Jul 11 03:10:39.299452 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:10:39.299410 2559 generic.go:356] "Generic (PLEG): container finished" podID="80d67cd5-1ac0-46c4-8b7a-97ff83bc3c0f" containerID="330019673dfeec821c826d4224f82d4e983403b59c3acb2712a0a6590f5492d6" exitCode=0 Jul 11 03:10:39.299869 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:10:39.299508 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjfl85" event={"ID":"80d67cd5-1ac0-46c4-8b7a-97ff83bc3c0f","Type":"ContainerDied","Data":"330019673dfeec821c826d4224f82d4e983403b59c3acb2712a0a6590f5492d6"} Jul 11 03:10:40.433953 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:10:40.433925 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjfl85" Jul 11 03:10:40.541614 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:10:40.541575 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/80d67cd5-1ac0-46c4-8b7a-97ff83bc3c0f-util\") pod \"80d67cd5-1ac0-46c4-8b7a-97ff83bc3c0f\" (UID: \"80d67cd5-1ac0-46c4-8b7a-97ff83bc3c0f\") " Jul 11 03:10:40.541808 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:10:40.541633 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pmpcn\" (UniqueName: \"kubernetes.io/projected/80d67cd5-1ac0-46c4-8b7a-97ff83bc3c0f-kube-api-access-pmpcn\") pod \"80d67cd5-1ac0-46c4-8b7a-97ff83bc3c0f\" (UID: \"80d67cd5-1ac0-46c4-8b7a-97ff83bc3c0f\") " Jul 11 03:10:40.541808 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:10:40.541693 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/80d67cd5-1ac0-46c4-8b7a-97ff83bc3c0f-bundle\") pod \"80d67cd5-1ac0-46c4-8b7a-97ff83bc3c0f\" (UID: \"80d67cd5-1ac0-46c4-8b7a-97ff83bc3c0f\") " Jul 11 03:10:40.542608 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:10:40.542578 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80d67cd5-1ac0-46c4-8b7a-97ff83bc3c0f-bundle" (OuterVolumeSpecName: "bundle") pod "80d67cd5-1ac0-46c4-8b7a-97ff83bc3c0f" (UID: "80d67cd5-1ac0-46c4-8b7a-97ff83bc3c0f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 11 03:10:40.543942 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:10:40.543921 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80d67cd5-1ac0-46c4-8b7a-97ff83bc3c0f-kube-api-access-pmpcn" (OuterVolumeSpecName: "kube-api-access-pmpcn") pod "80d67cd5-1ac0-46c4-8b7a-97ff83bc3c0f" (UID: "80d67cd5-1ac0-46c4-8b7a-97ff83bc3c0f"). InnerVolumeSpecName "kube-api-access-pmpcn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 11 03:10:40.547762 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:10:40.547721 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80d67cd5-1ac0-46c4-8b7a-97ff83bc3c0f-util" (OuterVolumeSpecName: "util") pod "80d67cd5-1ac0-46c4-8b7a-97ff83bc3c0f" (UID: "80d67cd5-1ac0-46c4-8b7a-97ff83bc3c0f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 11 03:10:40.642792 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:10:40.642749 2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/80d67cd5-1ac0-46c4-8b7a-97ff83bc3c0f-bundle\") on node \"ip-10-0-141-141.ec2.internal\" DevicePath \"\"" Jul 11 03:10:40.642792 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:10:40.642783 2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/80d67cd5-1ac0-46c4-8b7a-97ff83bc3c0f-util\") on node \"ip-10-0-141-141.ec2.internal\" DevicePath \"\"" Jul 11 03:10:40.642792 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:10:40.642795 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pmpcn\" (UniqueName: \"kubernetes.io/projected/80d67cd5-1ac0-46c4-8b7a-97ff83bc3c0f-kube-api-access-pmpcn\") on node \"ip-10-0-141-141.ec2.internal\" DevicePath \"\"" Jul 11 03:10:41.308549 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:10:41.308522 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjfl85" Jul 11 03:10:41.308717 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:10:41.308516 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjfl85" event={"ID":"80d67cd5-1ac0-46c4-8b7a-97ff83bc3c0f","Type":"ContainerDied","Data":"09cbc32ed39fb2950d8a46184a5ad59cfd60b45cbfe51694908951187e5f0d47"} Jul 11 03:10:41.308717 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:10:41.308647 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="09cbc32ed39fb2950d8a46184a5ad59cfd60b45cbfe51694908951187e5f0d47" Jul 11 03:10:51.512170 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:10:51.512121 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7dc498c8d4-94dv5"] Jul 11 03:10:51.512638 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:10:51.512388 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80d67cd5-1ac0-46c4-8b7a-97ff83bc3c0f" containerName="pull" Jul 11 03:10:51.512638 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:10:51.512402 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="80d67cd5-1ac0-46c4-8b7a-97ff83bc3c0f" containerName="pull" Jul 11 03:10:51.512638 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:10:51.512416 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80d67cd5-1ac0-46c4-8b7a-97ff83bc3c0f" containerName="util" Jul 11 03:10:51.512638 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:10:51.512423 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="80d67cd5-1ac0-46c4-8b7a-97ff83bc3c0f" containerName="util" Jul 11 03:10:51.512638 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:10:51.512434 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80d67cd5-1ac0-46c4-8b7a-97ff83bc3c0f" containerName="extract" Jul 11 03:10:51.512638 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:10:51.512439 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="80d67cd5-1ac0-46c4-8b7a-97ff83bc3c0f" containerName="extract" Jul 11 03:10:51.512638 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:10:51.512489 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="80d67cd5-1ac0-46c4-8b7a-97ff83bc3c0f" containerName="extract" Jul 11 03:10:51.514417 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:10:51.514399 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7dc498c8d4-94dv5" Jul 11 03:10:51.517116 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:10:51.517090 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 11 03:10:51.517116 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:10:51.517090 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 11 03:10:51.517116 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:10:51.517093 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 11 03:10:51.517116 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:10:51.517141 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-4qj7w\"" Jul 11 03:10:51.517470 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:10:51.517145 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 11 03:10:51.529757 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:10:51.529732 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7dc498c8d4-94dv5"] Jul 11 03:10:51.618343 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:10:51.618302 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a278b7ab-fb28-4fcf-afd0-f942b720fb20-manifests\") pod \"opendatahub-operator-controller-manager-7dc498c8d4-94dv5\" (UID: \"a278b7ab-fb28-4fcf-afd0-f942b720fb20\") " pod="opendatahub/opendatahub-operator-controller-manager-7dc498c8d4-94dv5" Jul 11 03:10:51.618343 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:10:51.618343 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a278b7ab-fb28-4fcf-afd0-f942b720fb20-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7dc498c8d4-94dv5\" (UID: \"a278b7ab-fb28-4fcf-afd0-f942b720fb20\") " pod="opendatahub/opendatahub-operator-controller-manager-7dc498c8d4-94dv5" Jul 11 03:10:51.618558 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:10:51.618417 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a278b7ab-fb28-4fcf-afd0-f942b720fb20-tmp\") pod \"opendatahub-operator-controller-manager-7dc498c8d4-94dv5\" (UID: \"a278b7ab-fb28-4fcf-afd0-f942b720fb20\") " pod="opendatahub/opendatahub-operator-controller-manager-7dc498c8d4-94dv5" Jul 11 03:10:51.618558 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:10:51.618476 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a278b7ab-fb28-4fcf-afd0-f942b720fb20-webhook-cert\") pod \"opendatahub-operator-controller-manager-7dc498c8d4-94dv5\" (UID: \"a278b7ab-fb28-4fcf-afd0-f942b720fb20\") " pod="opendatahub/opendatahub-operator-controller-manager-7dc498c8d4-94dv5" Jul 11 03:10:51.618558 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:10:51.618547 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kc4rq\" (UniqueName: \"kubernetes.io/projected/a278b7ab-fb28-4fcf-afd0-f942b720fb20-kube-api-access-kc4rq\") pod \"opendatahub-operator-controller-manager-7dc498c8d4-94dv5\" (UID: \"a278b7ab-fb28-4fcf-afd0-f942b720fb20\") " pod="opendatahub/opendatahub-operator-controller-manager-7dc498c8d4-94dv5" Jul 11 03:10:51.719180 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:10:51.719129 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a278b7ab-fb28-4fcf-afd0-f942b720fb20-manifests\") pod \"opendatahub-operator-controller-manager-7dc498c8d4-94dv5\" (UID: \"a278b7ab-fb28-4fcf-afd0-f942b720fb20\") " pod="opendatahub/opendatahub-operator-controller-manager-7dc498c8d4-94dv5" Jul 11 03:10:51.719180 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:10:51.719181 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a278b7ab-fb28-4fcf-afd0-f942b720fb20-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7dc498c8d4-94dv5\" (UID: \"a278b7ab-fb28-4fcf-afd0-f942b720fb20\") " pod="opendatahub/opendatahub-operator-controller-manager-7dc498c8d4-94dv5" Jul 11 03:10:51.719432 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:10:51.719204 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a278b7ab-fb28-4fcf-afd0-f942b720fb20-tmp\") pod \"opendatahub-operator-controller-manager-7dc498c8d4-94dv5\" (UID: \"a278b7ab-fb28-4fcf-afd0-f942b720fb20\") " pod="opendatahub/opendatahub-operator-controller-manager-7dc498c8d4-94dv5" Jul 11 03:10:51.719432 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:10:51.719236 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a278b7ab-fb28-4fcf-afd0-f942b720fb20-webhook-cert\") pod \"opendatahub-operator-controller-manager-7dc498c8d4-94dv5\" (UID: \"a278b7ab-fb28-4fcf-afd0-f942b720fb20\") " pod="opendatahub/opendatahub-operator-controller-manager-7dc498c8d4-94dv5" Jul 11 03:10:51.719432 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:10:51.719274 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kc4rq\" (UniqueName: \"kubernetes.io/projected/a278b7ab-fb28-4fcf-afd0-f942b720fb20-kube-api-access-kc4rq\") pod \"opendatahub-operator-controller-manager-7dc498c8d4-94dv5\" (UID: \"a278b7ab-fb28-4fcf-afd0-f942b720fb20\") " pod="opendatahub/opendatahub-operator-controller-manager-7dc498c8d4-94dv5" Jul 11 03:10:51.719619 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:10:51.719593 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a278b7ab-fb28-4fcf-afd0-f942b720fb20-manifests\") pod \"opendatahub-operator-controller-manager-7dc498c8d4-94dv5\" (UID: \"a278b7ab-fb28-4fcf-afd0-f942b720fb20\") " pod="opendatahub/opendatahub-operator-controller-manager-7dc498c8d4-94dv5" Jul 11 03:10:51.721605 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:10:51.721574 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a278b7ab-fb28-4fcf-afd0-f942b720fb20-tmp\") pod \"opendatahub-operator-controller-manager-7dc498c8d4-94dv5\" (UID: \"a278b7ab-fb28-4fcf-afd0-f942b720fb20\") " pod="opendatahub/opendatahub-operator-controller-manager-7dc498c8d4-94dv5" Jul 11 03:10:51.722017 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:10:51.721995 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a278b7ab-fb28-4fcf-afd0-f942b720fb20-webhook-cert\") pod \"opendatahub-operator-controller-manager-7dc498c8d4-94dv5\" (UID: \"a278b7ab-fb28-4fcf-afd0-f942b720fb20\") " pod="opendatahub/opendatahub-operator-controller-manager-7dc498c8d4-94dv5" Jul 11 03:10:51.722091 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:10:51.721995 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a278b7ab-fb28-4fcf-afd0-f942b720fb20-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7dc498c8d4-94dv5\" (UID: \"a278b7ab-fb28-4fcf-afd0-f942b720fb20\") " pod="opendatahub/opendatahub-operator-controller-manager-7dc498c8d4-94dv5" Jul 11 03:10:51.730432 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:10:51.730404 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kc4rq\" (UniqueName: \"kubernetes.io/projected/a278b7ab-fb28-4fcf-afd0-f942b720fb20-kube-api-access-kc4rq\") pod \"opendatahub-operator-controller-manager-7dc498c8d4-94dv5\" (UID: \"a278b7ab-fb28-4fcf-afd0-f942b720fb20\") " pod="opendatahub/opendatahub-operator-controller-manager-7dc498c8d4-94dv5" Jul 11 03:10:51.824765 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:10:51.824736 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7dc498c8d4-94dv5" Jul 11 03:10:51.975216 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:10:51.975187 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7dc498c8d4-94dv5"] Jul 11 03:10:51.977988 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:10:51.977932 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda278b7ab_fb28_4fcf_afd0_f942b720fb20.slice/crio-0b63ee0ab353dbc6b9d05dee02981995afe1c5bd5c60e809cf5bbda7dc064143 WatchSource:0}: Error finding container 0b63ee0ab353dbc6b9d05dee02981995afe1c5bd5c60e809cf5bbda7dc064143: Status 404 returned error can't find the container with id 0b63ee0ab353dbc6b9d05dee02981995afe1c5bd5c60e809cf5bbda7dc064143 Jul 11 03:10:52.349246 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:10:52.349215 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7dc498c8d4-94dv5" event={"ID":"a278b7ab-fb28-4fcf-afd0-f942b720fb20","Type":"ContainerStarted","Data":"0b63ee0ab353dbc6b9d05dee02981995afe1c5bd5c60e809cf5bbda7dc064143"} Jul 11 03:10:56.366380 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:10:56.366343 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7dc498c8d4-94dv5" event={"ID":"a278b7ab-fb28-4fcf-afd0-f942b720fb20","Type":"ContainerStarted","Data":"20ba313cc0584a0fe5968e13c368201592cd9b762f51070ed6d7f3cae0199876"} Jul 11 03:10:57.371036 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:10:57.371000 2559 generic.go:356] "Generic (PLEG): container finished" podID="a278b7ab-fb28-4fcf-afd0-f942b720fb20" containerID="20ba313cc0584a0fe5968e13c368201592cd9b762f51070ed6d7f3cae0199876" exitCode=0 Jul 11 03:10:57.371445 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:10:57.371048 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7dc498c8d4-94dv5" event={"ID":"a278b7ab-fb28-4fcf-afd0-f942b720fb20","Type":"ContainerDied","Data":"20ba313cc0584a0fe5968e13c368201592cd9b762f51070ed6d7f3cae0199876"} Jul 11 03:10:58.377263 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:10:58.377225 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7dc498c8d4-94dv5" event={"ID":"a278b7ab-fb28-4fcf-afd0-f942b720fb20","Type":"ContainerStarted","Data":"ecb89e6af9690493ee594970653a3b1b7e8d24d250ee948ff718bdf8fed08a9e"} Jul 11 03:10:58.377748 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:10:58.377373 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7dc498c8d4-94dv5" Jul 11 03:10:58.396977 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:10:58.396908 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7dc498c8d4-94dv5" podStartSLOduration=2.558775764 podStartE2EDuration="7.396889598s" totalImagesPullingTime="3.809936865s" totalInitContainerRuntime="1.028176969s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:10:51 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:10:58.395501558 +0000 UTC m=+482.364114006" watchObservedRunningTime="2026-07-11 03:10:58.396889598 +0000 UTC m=+482.365502050" Jul 11 03:11:09.382638 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:09.382607 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7dc498c8d4-94dv5" Jul 11 03:11:11.590289 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:11.590255 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-bz22q"] Jul 11 03:11:11.626252 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:11.626212 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-bz22q"] Jul 11 03:11:11.626410 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:11.626344 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-bz22q" Jul 11 03:11:11.628982 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:11.628930 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jul 11 03:11:11.629124 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:11.629053 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-wg8tt\"" Jul 11 03:11:11.778832 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:11.778795 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/335bea99-4f0c-472a-9c94-82b4a1f0338d-cert\") pod \"odh-model-controller-7998c67dc4-bz22q\" (UID: \"335bea99-4f0c-472a-9c94-82b4a1f0338d\") " pod="opendatahub/odh-model-controller-7998c67dc4-bz22q" Jul 11 03:11:11.779068 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:11.778861 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mczh5\" (UniqueName: \"kubernetes.io/projected/335bea99-4f0c-472a-9c94-82b4a1f0338d-kube-api-access-mczh5\") pod \"odh-model-controller-7998c67dc4-bz22q\" (UID: \"335bea99-4f0c-472a-9c94-82b4a1f0338d\") " pod="opendatahub/odh-model-controller-7998c67dc4-bz22q" Jul 11 03:11:11.879513 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:11.879409 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/335bea99-4f0c-472a-9c94-82b4a1f0338d-cert\") pod \"odh-model-controller-7998c67dc4-bz22q\" (UID: \"335bea99-4f0c-472a-9c94-82b4a1f0338d\") " pod="opendatahub/odh-model-controller-7998c67dc4-bz22q" Jul 11 03:11:11.879513 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:11.879480 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mczh5\" (UniqueName: \"kubernetes.io/projected/335bea99-4f0c-472a-9c94-82b4a1f0338d-kube-api-access-mczh5\") pod \"odh-model-controller-7998c67dc4-bz22q\" (UID: \"335bea99-4f0c-472a-9c94-82b4a1f0338d\") " pod="opendatahub/odh-model-controller-7998c67dc4-bz22q" Jul 11 03:11:11.879757 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:11:11.879567 2559 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jul 11 03:11:11.879757 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:11:11.879638 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/335bea99-4f0c-472a-9c94-82b4a1f0338d-cert podName:335bea99-4f0c-472a-9c94-82b4a1f0338d nodeName:}" failed. No retries permitted until 2026-07-11 03:11:12.379618451 +0000 UTC m=+496.348230896 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/335bea99-4f0c-472a-9c94-82b4a1f0338d-cert") pod "odh-model-controller-7998c67dc4-bz22q" (UID: "335bea99-4f0c-472a-9c94-82b4a1f0338d") : secret "odh-model-controller-webhook-cert" not found Jul 11 03:11:11.888291 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:11.888258 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mczh5\" (UniqueName: \"kubernetes.io/projected/335bea99-4f0c-472a-9c94-82b4a1f0338d-kube-api-access-mczh5\") pod \"odh-model-controller-7998c67dc4-bz22q\" (UID: \"335bea99-4f0c-472a-9c94-82b4a1f0338d\") " pod="opendatahub/odh-model-controller-7998c67dc4-bz22q" Jul 11 03:11:12.010719 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:12.010679 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-88p9z"] Jul 11 03:11:12.013070 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:12.013049 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-88p9z" Jul 11 03:11:12.015944 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:12.015921 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jul 11 03:11:12.016396 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:12.016091 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-rsrcz\"" Jul 11 03:11:12.023288 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:12.023259 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-88p9z"] Jul 11 03:11:12.080268 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:12.080231 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0a9cd581-d709-4a53-a68a-5e1f42e2df53-tls-certs\") pod \"model-serving-api-54d89bd5fc-88p9z\" (UID: \"0a9cd581-d709-4a53-a68a-5e1f42e2df53\") " pod="opendatahub/model-serving-api-54d89bd5fc-88p9z" Jul 11 03:11:12.080454 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:12.080323 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bz8vf\" (UniqueName: \"kubernetes.io/projected/0a9cd581-d709-4a53-a68a-5e1f42e2df53-kube-api-access-bz8vf\") pod \"model-serving-api-54d89bd5fc-88p9z\" (UID: \"0a9cd581-d709-4a53-a68a-5e1f42e2df53\") " pod="opendatahub/model-serving-api-54d89bd5fc-88p9z" Jul 11 03:11:12.181394 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:12.181307 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0a9cd581-d709-4a53-a68a-5e1f42e2df53-tls-certs\") pod \"model-serving-api-54d89bd5fc-88p9z\" (UID: \"0a9cd581-d709-4a53-a68a-5e1f42e2df53\") " pod="opendatahub/model-serving-api-54d89bd5fc-88p9z" Jul 11 03:11:12.181543 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:12.181395 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bz8vf\" (UniqueName: \"kubernetes.io/projected/0a9cd581-d709-4a53-a68a-5e1f42e2df53-kube-api-access-bz8vf\") pod \"model-serving-api-54d89bd5fc-88p9z\" (UID: \"0a9cd581-d709-4a53-a68a-5e1f42e2df53\") " pod="opendatahub/model-serving-api-54d89bd5fc-88p9z" Jul 11 03:11:12.181543 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:11:12.181477 2559 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Jul 11 03:11:12.181613 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:11:12.181542 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a9cd581-d709-4a53-a68a-5e1f42e2df53-tls-certs podName:0a9cd581-d709-4a53-a68a-5e1f42e2df53 nodeName:}" failed. No retries permitted until 2026-07-11 03:11:12.681523684 +0000 UTC m=+496.650136113 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/0a9cd581-d709-4a53-a68a-5e1f42e2df53-tls-certs") pod "model-serving-api-54d89bd5fc-88p9z" (UID: "0a9cd581-d709-4a53-a68a-5e1f42e2df53") : secret "model-serving-api-tls" not found Jul 11 03:11:12.192345 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:12.192317 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bz8vf\" (UniqueName: \"kubernetes.io/projected/0a9cd581-d709-4a53-a68a-5e1f42e2df53-kube-api-access-bz8vf\") pod \"model-serving-api-54d89bd5fc-88p9z\" (UID: \"0a9cd581-d709-4a53-a68a-5e1f42e2df53\") " pod="opendatahub/model-serving-api-54d89bd5fc-88p9z" Jul 11 03:11:12.382640 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:12.382594 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/335bea99-4f0c-472a-9c94-82b4a1f0338d-cert\") pod \"odh-model-controller-7998c67dc4-bz22q\" (UID: \"335bea99-4f0c-472a-9c94-82b4a1f0338d\") " pod="opendatahub/odh-model-controller-7998c67dc4-bz22q" Jul 11 03:11:12.385161 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:12.385142 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/335bea99-4f0c-472a-9c94-82b4a1f0338d-cert\") pod \"odh-model-controller-7998c67dc4-bz22q\" (UID: \"335bea99-4f0c-472a-9c94-82b4a1f0338d\") " pod="opendatahub/odh-model-controller-7998c67dc4-bz22q" Jul 11 03:11:12.536388 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:12.536349 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-bz22q" Jul 11 03:11:12.666606 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:12.666472 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-bz22q"] Jul 11 03:11:12.668747 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:11:12.668708 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod335bea99_4f0c_472a_9c94_82b4a1f0338d.slice/crio-c79c5529631ae6fdd0e7e6de2924da495a01f52b0cc019a46d673f564ea2957a WatchSource:0}: Error finding container c79c5529631ae6fdd0e7e6de2924da495a01f52b0cc019a46d673f564ea2957a: Status 404 returned error can't find the container with id c79c5529631ae6fdd0e7e6de2924da495a01f52b0cc019a46d673f564ea2957a Jul 11 03:11:12.685995 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:12.685952 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0a9cd581-d709-4a53-a68a-5e1f42e2df53-tls-certs\") pod \"model-serving-api-54d89bd5fc-88p9z\" (UID: \"0a9cd581-d709-4a53-a68a-5e1f42e2df53\") " pod="opendatahub/model-serving-api-54d89bd5fc-88p9z" Jul 11 03:11:12.688361 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:12.688343 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0a9cd581-d709-4a53-a68a-5e1f42e2df53-tls-certs\") pod \"model-serving-api-54d89bd5fc-88p9z\" (UID: \"0a9cd581-d709-4a53-a68a-5e1f42e2df53\") " pod="opendatahub/model-serving-api-54d89bd5fc-88p9z" Jul 11 03:11:12.925031 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:12.924904 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-88p9z" Jul 11 03:11:13.056074 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:13.056046 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-88p9z"] Jul 11 03:11:13.058511 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:11:13.058475 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a9cd581_d709_4a53_a68a_5e1f42e2df53.slice/crio-eebf7d5d689fd0149b1434b2737c33379946a76a38132ddd1104061441d2804b WatchSource:0}: Error finding container eebf7d5d689fd0149b1434b2737c33379946a76a38132ddd1104061441d2804b: Status 404 returned error can't find the container with id eebf7d5d689fd0149b1434b2737c33379946a76a38132ddd1104061441d2804b Jul 11 03:11:13.434630 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:13.434582 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-bz22q" event={"ID":"335bea99-4f0c-472a-9c94-82b4a1f0338d","Type":"ContainerStarted","Data":"c79c5529631ae6fdd0e7e6de2924da495a01f52b0cc019a46d673f564ea2957a"} Jul 11 03:11:13.436137 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:13.436103 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-88p9z" event={"ID":"0a9cd581-d709-4a53-a68a-5e1f42e2df53","Type":"ContainerStarted","Data":"eebf7d5d689fd0149b1434b2737c33379946a76a38132ddd1104061441d2804b"} Jul 11 03:11:14.566209 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:14.565569 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7566565894-c2brf"] Jul 11 03:11:14.571513 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:14.571484 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7566565894-c2brf" Jul 11 03:11:14.573931 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:14.573903 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 11 03:11:14.573931 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:14.573925 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 11 03:11:14.575306 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:14.575106 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 11 03:11:14.575306 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:14.575115 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 11 03:11:14.577191 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:14.577166 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7566565894-c2brf"] Jul 11 03:11:14.703980 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:14.703920 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1972c53a-6d99-4094-9453-b6007073590f-tls-certs\") pod \"kube-auth-proxy-7566565894-c2brf\" (UID: \"1972c53a-6d99-4094-9453-b6007073590f\") " pod="openshift-ingress/kube-auth-proxy-7566565894-c2brf" Jul 11 03:11:14.704151 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:14.704012 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zbzgt\" (UniqueName: \"kubernetes.io/projected/1972c53a-6d99-4094-9453-b6007073590f-kube-api-access-zbzgt\") pod \"kube-auth-proxy-7566565894-c2brf\" (UID: \"1972c53a-6d99-4094-9453-b6007073590f\") " pod="openshift-ingress/kube-auth-proxy-7566565894-c2brf" Jul 11 03:11:14.704151 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:14.704039 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1972c53a-6d99-4094-9453-b6007073590f-tmp\") pod \"kube-auth-proxy-7566565894-c2brf\" (UID: \"1972c53a-6d99-4094-9453-b6007073590f\") " pod="openshift-ingress/kube-auth-proxy-7566565894-c2brf" Jul 11 03:11:14.805093 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:14.805060 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1972c53a-6d99-4094-9453-b6007073590f-tls-certs\") pod \"kube-auth-proxy-7566565894-c2brf\" (UID: \"1972c53a-6d99-4094-9453-b6007073590f\") " pod="openshift-ingress/kube-auth-proxy-7566565894-c2brf" Jul 11 03:11:14.805273 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:14.805105 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zbzgt\" (UniqueName: \"kubernetes.io/projected/1972c53a-6d99-4094-9453-b6007073590f-kube-api-access-zbzgt\") pod \"kube-auth-proxy-7566565894-c2brf\" (UID: \"1972c53a-6d99-4094-9453-b6007073590f\") " pod="openshift-ingress/kube-auth-proxy-7566565894-c2brf" Jul 11 03:11:14.805273 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:14.805238 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1972c53a-6d99-4094-9453-b6007073590f-tmp\") pod \"kube-auth-proxy-7566565894-c2brf\" (UID: \"1972c53a-6d99-4094-9453-b6007073590f\") " pod="openshift-ingress/kube-auth-proxy-7566565894-c2brf" Jul 11 03:11:14.807757 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:14.807724 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1972c53a-6d99-4094-9453-b6007073590f-tmp\") pod \"kube-auth-proxy-7566565894-c2brf\" (UID: \"1972c53a-6d99-4094-9453-b6007073590f\") " pod="openshift-ingress/kube-auth-proxy-7566565894-c2brf" Jul 11 03:11:14.808048 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:14.808030 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1972c53a-6d99-4094-9453-b6007073590f-tls-certs\") pod \"kube-auth-proxy-7566565894-c2brf\" (UID: \"1972c53a-6d99-4094-9453-b6007073590f\") " pod="openshift-ingress/kube-auth-proxy-7566565894-c2brf" Jul 11 03:11:14.812846 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:14.812817 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zbzgt\" (UniqueName: \"kubernetes.io/projected/1972c53a-6d99-4094-9453-b6007073590f-kube-api-access-zbzgt\") pod \"kube-auth-proxy-7566565894-c2brf\" (UID: \"1972c53a-6d99-4094-9453-b6007073590f\") " pod="openshift-ingress/kube-auth-proxy-7566565894-c2brf" Jul 11 03:11:14.884620 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:14.884543 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7566565894-c2brf" Jul 11 03:11:15.518586 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:15.518545 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-scchg"] Jul 11 03:11:15.520746 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:15.520710 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-scchg" Jul 11 03:11:15.523172 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:15.523137 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 11 03:11:15.523337 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:15.523307 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 11 03:11:15.523570 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:15.523547 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-dvs27\"" Jul 11 03:11:15.523695 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:15.523582 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 11 03:11:15.523695 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:15.523580 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 11 03:11:15.535101 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:15.535057 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-scchg"] Jul 11 03:11:15.613710 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:15.613671 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e399dfb6-928b-4c30-a0f1-64d9b9fbd592-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-scchg\" (UID: \"e399dfb6-928b-4c30-a0f1-64d9b9fbd592\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-scchg" Jul 11 03:11:15.614172 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:15.613730 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e399dfb6-928b-4c30-a0f1-64d9b9fbd592-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-scchg\" (UID: \"e399dfb6-928b-4c30-a0f1-64d9b9fbd592\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-scchg" Jul 11 03:11:15.614172 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:15.613793 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e399dfb6-928b-4c30-a0f1-64d9b9fbd592-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-scchg\" (UID: \"e399dfb6-928b-4c30-a0f1-64d9b9fbd592\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-scchg" Jul 11 03:11:15.614172 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:15.613897 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e399dfb6-928b-4c30-a0f1-64d9b9fbd592-local-certs\") pod \"istiod-openshift-gateway-7574459656-scchg\" (UID: \"e399dfb6-928b-4c30-a0f1-64d9b9fbd592\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-scchg" Jul 11 03:11:15.614172 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:15.613933 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e399dfb6-928b-4c30-a0f1-64d9b9fbd592-cacerts\") pod \"istiod-openshift-gateway-7574459656-scchg\" (UID: \"e399dfb6-928b-4c30-a0f1-64d9b9fbd592\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-scchg" Jul 11 03:11:15.614172 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:15.613989 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e399dfb6-928b-4c30-a0f1-64d9b9fbd592-istio-token\") pod \"istiod-openshift-gateway-7574459656-scchg\" (UID: \"e399dfb6-928b-4c30-a0f1-64d9b9fbd592\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-scchg" Jul 11 03:11:15.614172 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:15.614033 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tnlmw\" (UniqueName: \"kubernetes.io/projected/e399dfb6-928b-4c30-a0f1-64d9b9fbd592-kube-api-access-tnlmw\") pod \"istiod-openshift-gateway-7574459656-scchg\" (UID: \"e399dfb6-928b-4c30-a0f1-64d9b9fbd592\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-scchg" Jul 11 03:11:15.716686 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:15.714999 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e399dfb6-928b-4c30-a0f1-64d9b9fbd592-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-scchg\" (UID: \"e399dfb6-928b-4c30-a0f1-64d9b9fbd592\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-scchg" Jul 11 03:11:15.716686 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:15.715064 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e399dfb6-928b-4c30-a0f1-64d9b9fbd592-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-scchg\" (UID: \"e399dfb6-928b-4c30-a0f1-64d9b9fbd592\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-scchg" Jul 11 03:11:15.716686 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:15.715108 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e399dfb6-928b-4c30-a0f1-64d9b9fbd592-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-scchg\" (UID: \"e399dfb6-928b-4c30-a0f1-64d9b9fbd592\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-scchg" Jul 11 03:11:15.716686 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:15.715175 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e399dfb6-928b-4c30-a0f1-64d9b9fbd592-local-certs\") pod \"istiod-openshift-gateway-7574459656-scchg\" (UID: \"e399dfb6-928b-4c30-a0f1-64d9b9fbd592\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-scchg" Jul 11 03:11:15.716686 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:15.715203 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e399dfb6-928b-4c30-a0f1-64d9b9fbd592-cacerts\") pod \"istiod-openshift-gateway-7574459656-scchg\" (UID: \"e399dfb6-928b-4c30-a0f1-64d9b9fbd592\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-scchg" Jul 11 03:11:15.716686 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:15.715235 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e399dfb6-928b-4c30-a0f1-64d9b9fbd592-istio-token\") pod \"istiod-openshift-gateway-7574459656-scchg\" (UID: \"e399dfb6-928b-4c30-a0f1-64d9b9fbd592\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-scchg" Jul 11 03:11:15.716686 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:15.715288 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tnlmw\" (UniqueName: \"kubernetes.io/projected/e399dfb6-928b-4c30-a0f1-64d9b9fbd592-kube-api-access-tnlmw\") pod \"istiod-openshift-gateway-7574459656-scchg\" (UID: \"e399dfb6-928b-4c30-a0f1-64d9b9fbd592\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-scchg" Jul 11 03:11:15.716686 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:15.716305 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e399dfb6-928b-4c30-a0f1-64d9b9fbd592-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-scchg\" (UID: \"e399dfb6-928b-4c30-a0f1-64d9b9fbd592\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-scchg" Jul 11 03:11:15.721232 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:15.720923 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e399dfb6-928b-4c30-a0f1-64d9b9fbd592-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-scchg\" (UID: \"e399dfb6-928b-4c30-a0f1-64d9b9fbd592\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-scchg" Jul 11 03:11:15.721862 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:15.721812 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e399dfb6-928b-4c30-a0f1-64d9b9fbd592-local-certs\") pod \"istiod-openshift-gateway-7574459656-scchg\" (UID: \"e399dfb6-928b-4c30-a0f1-64d9b9fbd592\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-scchg" Jul 11 03:11:15.722160 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:15.722135 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e399dfb6-928b-4c30-a0f1-64d9b9fbd592-cacerts\") pod \"istiod-openshift-gateway-7574459656-scchg\" (UID: \"e399dfb6-928b-4c30-a0f1-64d9b9fbd592\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-scchg" Jul 11 03:11:15.722259 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:15.722179 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e399dfb6-928b-4c30-a0f1-64d9b9fbd592-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-scchg\" (UID: \"e399dfb6-928b-4c30-a0f1-64d9b9fbd592\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-scchg" Jul 11 03:11:15.724452 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:15.724422 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tnlmw\" (UniqueName: \"kubernetes.io/projected/e399dfb6-928b-4c30-a0f1-64d9b9fbd592-kube-api-access-tnlmw\") pod \"istiod-openshift-gateway-7574459656-scchg\" (UID: \"e399dfb6-928b-4c30-a0f1-64d9b9fbd592\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-scchg" Jul 11 03:11:15.727420 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:15.727399 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e399dfb6-928b-4c30-a0f1-64d9b9fbd592-istio-token\") pod \"istiod-openshift-gateway-7574459656-scchg\" (UID: \"e399dfb6-928b-4c30-a0f1-64d9b9fbd592\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-scchg" Jul 11 03:11:15.832637 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:15.832597 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-scchg" Jul 11 03:11:16.148015 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:16.147977 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7566565894-c2brf"] Jul 11 03:11:16.152067 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:11:16.152037 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1972c53a_6d99_4094_9453_b6007073590f.slice/crio-9bd941b7a0d6c79e5f345834c99f4400802e9b2d297af6b21729b56ba894c530 WatchSource:0}: Error finding container 9bd941b7a0d6c79e5f345834c99f4400802e9b2d297af6b21729b56ba894c530: Status 404 returned error can't find the container with id 9bd941b7a0d6c79e5f345834c99f4400802e9b2d297af6b21729b56ba894c530 Jul 11 03:11:16.169535 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:16.169463 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-scchg"] Jul 11 03:11:16.171752 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:11:16.171714 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode399dfb6_928b_4c30_a0f1_64d9b9fbd592.slice/crio-19bb6928be454bdf0cabaf5740d48fe84f9e6238da1fa0f4dacb47c74ae59ef9 WatchSource:0}: Error finding container 19bb6928be454bdf0cabaf5740d48fe84f9e6238da1fa0f4dacb47c74ae59ef9: Status 404 returned error can't find the container with id 19bb6928be454bdf0cabaf5740d48fe84f9e6238da1fa0f4dacb47c74ae59ef9 Jul 11 03:11:16.450996 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:16.450894 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-scchg" event={"ID":"e399dfb6-928b-4c30-a0f1-64d9b9fbd592","Type":"ContainerStarted","Data":"19bb6928be454bdf0cabaf5740d48fe84f9e6238da1fa0f4dacb47c74ae59ef9"} Jul 11 03:11:16.452327 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:16.452298 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-88p9z" event={"ID":"0a9cd581-d709-4a53-a68a-5e1f42e2df53","Type":"ContainerStarted","Data":"57e24bf389f1aeed94723726d2f6c2d30bbd14f861faf34846aaa7e98a53c53d"} Jul 11 03:11:16.452461 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:16.452444 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-88p9z" Jul 11 03:11:16.453450 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:16.453425 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7566565894-c2brf" event={"ID":"1972c53a-6d99-4094-9453-b6007073590f","Type":"ContainerStarted","Data":"9bd941b7a0d6c79e5f345834c99f4400802e9b2d297af6b21729b56ba894c530"} Jul 11 03:11:16.454771 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:16.454750 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-bz22q" event={"ID":"335bea99-4f0c-472a-9c94-82b4a1f0338d","Type":"ContainerStarted","Data":"0123933911eebcdd8b6e08aad34fec33cb4621196a62f748b6b9b1c90a163b24"} Jul 11 03:11:16.454892 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:16.454880 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-bz22q" Jul 11 03:11:16.469010 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:16.468935 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-88p9z" podStartSLOduration=2.5386885169999998 podStartE2EDuration="5.468919114s" totalImagesPullingTime="2.930230597s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:11:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:11:16.4674782 +0000 UTC m=+500.436090651" watchObservedRunningTime="2026-07-11 03:11:16.468919114 +0000 UTC m=+500.437531565" Jul 11 03:11:16.483944 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:16.483889 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-bz22q" podStartSLOduration=2.150039495 podStartE2EDuration="5.483873332s" totalImagesPullingTime="3.333833837s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:11:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:11:16.482081726 +0000 UTC m=+500.450694176" watchObservedRunningTime="2026-07-11 03:11:16.483873332 +0000 UTC m=+500.452485804" Jul 11 03:11:19.177746 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:19.177709 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 11 03:11:19.178091 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:19.177775 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 11 03:11:19.473032 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:19.472898 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-scchg" event={"ID":"e399dfb6-928b-4c30-a0f1-64d9b9fbd592","Type":"ContainerStarted","Data":"0967604c883e78f0a2f37b0045ae30a5935db04ffa4ad60400df02b39b51fbae"} Jul 11 03:11:19.473032 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:19.472980 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-scchg" Jul 11 03:11:19.474331 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:19.474295 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7566565894-c2brf" event={"ID":"1972c53a-6d99-4094-9453-b6007073590f","Type":"ContainerStarted","Data":"ddb4bd86fe8a881a0642a2e2bf9eccf1c6fc4d461b00d931ab7b8a58f7c88e93"} Jul 11 03:11:19.493485 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:19.493428 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-scchg" podStartSLOduration=1.489671778 podStartE2EDuration="4.493410178s" totalImagesPullingTime="3.0037384s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:11:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:11:19.491598327 +0000 UTC m=+503.460210772" watchObservedRunningTime="2026-07-11 03:11:19.493410178 +0000 UTC m=+503.462022629" Jul 11 03:11:19.517714 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:19.517657 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7566565894-c2brf" podStartSLOduration=2.494633388 podStartE2EDuration="5.517639413s" totalImagesPullingTime="3.023006025s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:11:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:11:19.516240206 +0000 UTC m=+503.484852668" watchObservedRunningTime="2026-07-11 03:11:19.517639413 +0000 UTC m=+503.486251864" Jul 11 03:11:20.079030 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:20.078990 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6788k5rl"] Jul 11 03:11:20.081199 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:20.081183 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6788k5rl" Jul 11 03:11:20.084165 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:20.084137 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-6xtt8\"" Jul 11 03:11:20.114422 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:20.114379 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6788k5rl"] Jul 11 03:11:20.257413 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:20.257362 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fee6d489-76a7-47d1-b44e-549cbad94d98-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6788k5rl\" (UID: \"fee6d489-76a7-47d1-b44e-549cbad94d98\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6788k5rl" Jul 11 03:11:20.257882 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:20.257427 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fee6d489-76a7-47d1-b44e-549cbad94d98-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6788k5rl\" (UID: \"fee6d489-76a7-47d1-b44e-549cbad94d98\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6788k5rl" Jul 11 03:11:20.257882 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:20.257547 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fee6d489-76a7-47d1-b44e-549cbad94d98-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6788k5rl\" (UID: \"fee6d489-76a7-47d1-b44e-549cbad94d98\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6788k5rl" Jul 11 03:11:20.257882 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:20.257618 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fee6d489-76a7-47d1-b44e-549cbad94d98-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6788k5rl\" (UID: \"fee6d489-76a7-47d1-b44e-549cbad94d98\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6788k5rl" Jul 11 03:11:20.257882 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:20.257702 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fee6d489-76a7-47d1-b44e-549cbad94d98-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6788k5rl\" (UID: \"fee6d489-76a7-47d1-b44e-549cbad94d98\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6788k5rl" Jul 11 03:11:20.257882 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:20.257728 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fee6d489-76a7-47d1-b44e-549cbad94d98-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6788k5rl\" (UID: \"fee6d489-76a7-47d1-b44e-549cbad94d98\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6788k5rl" Jul 11 03:11:20.257882 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:20.257745 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fee6d489-76a7-47d1-b44e-549cbad94d98-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6788k5rl\" (UID: \"fee6d489-76a7-47d1-b44e-549cbad94d98\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6788k5rl" Jul 11 03:11:20.257882 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:20.257773 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fee6d489-76a7-47d1-b44e-549cbad94d98-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6788k5rl\" (UID: \"fee6d489-76a7-47d1-b44e-549cbad94d98\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6788k5rl" Jul 11 03:11:20.257882 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:20.257788 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s8fxt\" (UniqueName: \"kubernetes.io/projected/fee6d489-76a7-47d1-b44e-549cbad94d98-kube-api-access-s8fxt\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6788k5rl\" (UID: \"fee6d489-76a7-47d1-b44e-549cbad94d98\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6788k5rl" Jul 11 03:11:20.359291 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:20.359186 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fee6d489-76a7-47d1-b44e-549cbad94d98-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6788k5rl\" (UID: \"fee6d489-76a7-47d1-b44e-549cbad94d98\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6788k5rl" Jul 11 03:11:20.359291 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:20.359236 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s8fxt\" (UniqueName: \"kubernetes.io/projected/fee6d489-76a7-47d1-b44e-549cbad94d98-kube-api-access-s8fxt\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6788k5rl\" (UID: \"fee6d489-76a7-47d1-b44e-549cbad94d98\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6788k5rl" Jul 11 03:11:20.359291 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:20.359267 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fee6d489-76a7-47d1-b44e-549cbad94d98-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6788k5rl\" (UID: \"fee6d489-76a7-47d1-b44e-549cbad94d98\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6788k5rl" Jul 11 03:11:20.359291 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:20.359295 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fee6d489-76a7-47d1-b44e-549cbad94d98-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6788k5rl\" (UID: \"fee6d489-76a7-47d1-b44e-549cbad94d98\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6788k5rl" Jul 11 03:11:20.359620 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:20.359331 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fee6d489-76a7-47d1-b44e-549cbad94d98-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6788k5rl\" (UID: \"fee6d489-76a7-47d1-b44e-549cbad94d98\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6788k5rl" Jul 11 03:11:20.359620 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:20.359375 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fee6d489-76a7-47d1-b44e-549cbad94d98-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6788k5rl\" (UID: \"fee6d489-76a7-47d1-b44e-549cbad94d98\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6788k5rl" Jul 11 03:11:20.359620 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:20.359433 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fee6d489-76a7-47d1-b44e-549cbad94d98-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6788k5rl\" (UID: \"fee6d489-76a7-47d1-b44e-549cbad94d98\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6788k5rl" Jul 11 03:11:20.359620 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:20.359456 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fee6d489-76a7-47d1-b44e-549cbad94d98-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6788k5rl\" (UID: \"fee6d489-76a7-47d1-b44e-549cbad94d98\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6788k5rl" Jul 11 03:11:20.359620 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:20.359479 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fee6d489-76a7-47d1-b44e-549cbad94d98-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6788k5rl\" (UID: \"fee6d489-76a7-47d1-b44e-549cbad94d98\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6788k5rl" Jul 11 03:11:20.359867 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:20.359785 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fee6d489-76a7-47d1-b44e-549cbad94d98-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6788k5rl\" (UID: \"fee6d489-76a7-47d1-b44e-549cbad94d98\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6788k5rl" Jul 11 03:11:20.360018 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:20.359918 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fee6d489-76a7-47d1-b44e-549cbad94d98-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6788k5rl\" (UID: \"fee6d489-76a7-47d1-b44e-549cbad94d98\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6788k5rl" Jul 11 03:11:20.360113 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:20.360047 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fee6d489-76a7-47d1-b44e-549cbad94d98-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6788k5rl\" (UID: \"fee6d489-76a7-47d1-b44e-549cbad94d98\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6788k5rl" Jul 11 03:11:20.360113 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:20.360061 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fee6d489-76a7-47d1-b44e-549cbad94d98-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6788k5rl\" (UID: \"fee6d489-76a7-47d1-b44e-549cbad94d98\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6788k5rl" Jul 11 03:11:20.360259 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:20.360241 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fee6d489-76a7-47d1-b44e-549cbad94d98-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6788k5rl\" (UID: \"fee6d489-76a7-47d1-b44e-549cbad94d98\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6788k5rl" Jul 11 03:11:20.361681 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:20.361658 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fee6d489-76a7-47d1-b44e-549cbad94d98-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6788k5rl\" (UID: \"fee6d489-76a7-47d1-b44e-549cbad94d98\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6788k5rl" Jul 11 03:11:20.361882 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:20.361863 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fee6d489-76a7-47d1-b44e-549cbad94d98-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6788k5rl\" (UID: \"fee6d489-76a7-47d1-b44e-549cbad94d98\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6788k5rl" Jul 11 03:11:20.376147 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:20.376110 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fee6d489-76a7-47d1-b44e-549cbad94d98-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6788k5rl\" (UID: \"fee6d489-76a7-47d1-b44e-549cbad94d98\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6788k5rl" Jul 11 03:11:20.376457 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:20.376436 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s8fxt\" (UniqueName: \"kubernetes.io/projected/fee6d489-76a7-47d1-b44e-549cbad94d98-kube-api-access-s8fxt\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6788k5rl\" (UID: \"fee6d489-76a7-47d1-b44e-549cbad94d98\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6788k5rl" Jul 11 03:11:20.391400 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:20.391370 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6788k5rl" Jul 11 03:11:20.480466 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:20.480437 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-scchg" Jul 11 03:11:20.531228 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:20.531199 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6788k5rl"] Jul 11 03:11:20.534406 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:11:20.534366 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfee6d489_76a7_47d1_b44e_549cbad94d98.slice/crio-5c892e40cf80325a984fc8845877d9e9fb33619b35b5bd5353f0924f76075985 WatchSource:0}: Error finding container 5c892e40cf80325a984fc8845877d9e9fb33619b35b5bd5353f0924f76075985: Status 404 returned error can't find the container with id 5c892e40cf80325a984fc8845877d9e9fb33619b35b5bd5353f0924f76075985 Jul 11 03:11:21.316921 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:21.316889 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-86x9k"] Jul 11 03:11:21.319168 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:21.319136 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-86x9k" Jul 11 03:11:21.321973 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:21.321934 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jul 11 03:11:21.321973 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:21.321966 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-2w9kc\"" Jul 11 03:11:21.338320 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:21.338261 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-hs557"] Jul 11 03:11:21.340528 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:21.340505 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-86x9k"] Jul 11 03:11:21.340643 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:21.340595 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-hs557" Jul 11 03:11:21.344489 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:21.344469 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jul 11 03:11:21.344640 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:21.344547 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-wgqcr\"" Jul 11 03:11:21.353365 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:21.353333 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-hs557"] Jul 11 03:11:21.470044 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:21.470002 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c94207ff-0897-4648-8265-7ba6892a2cf6-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-hs557\" (UID: \"c94207ff-0897-4648-8265-7ba6892a2cf6\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-hs557" Jul 11 03:11:21.470233 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:21.470055 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdls2\" (UniqueName: \"kubernetes.io/projected/3ce00c6e-26bd-436e-8bcf-7d9641f767cc-kube-api-access-cdls2\") pod \"kserve-controller-manager-d6f4b65b8-86x9k\" (UID: \"3ce00c6e-26bd-436e-8bcf-7d9641f767cc\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-86x9k" Jul 11 03:11:21.470233 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:21.470131 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3ce00c6e-26bd-436e-8bcf-7d9641f767cc-cert\") pod \"kserve-controller-manager-d6f4b65b8-86x9k\" (UID: \"3ce00c6e-26bd-436e-8bcf-7d9641f767cc\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-86x9k" Jul 11 03:11:21.470233 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:21.470172 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rwm76\" (UniqueName: \"kubernetes.io/projected/c94207ff-0897-4648-8265-7ba6892a2cf6-kube-api-access-rwm76\") pod \"llmisvc-controller-manager-777c6bd7d5-hs557\" (UID: \"c94207ff-0897-4648-8265-7ba6892a2cf6\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-hs557" Jul 11 03:11:21.484683 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:21.484623 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6788k5rl" event={"ID":"fee6d489-76a7-47d1-b44e-549cbad94d98","Type":"ContainerStarted","Data":"5c892e40cf80325a984fc8845877d9e9fb33619b35b5bd5353f0924f76075985"} Jul 11 03:11:21.571126 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:21.571040 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rwm76\" (UniqueName: \"kubernetes.io/projected/c94207ff-0897-4648-8265-7ba6892a2cf6-kube-api-access-rwm76\") pod \"llmisvc-controller-manager-777c6bd7d5-hs557\" (UID: \"c94207ff-0897-4648-8265-7ba6892a2cf6\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-hs557" Jul 11 03:11:21.571300 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:21.571130 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c94207ff-0897-4648-8265-7ba6892a2cf6-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-hs557\" (UID: \"c94207ff-0897-4648-8265-7ba6892a2cf6\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-hs557" Jul 11 03:11:21.571300 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:21.571170 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdls2\" (UniqueName: \"kubernetes.io/projected/3ce00c6e-26bd-436e-8bcf-7d9641f767cc-kube-api-access-cdls2\") pod \"kserve-controller-manager-d6f4b65b8-86x9k\" (UID: \"3ce00c6e-26bd-436e-8bcf-7d9641f767cc\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-86x9k" Jul 11 03:11:21.571300 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:21.571229 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3ce00c6e-26bd-436e-8bcf-7d9641f767cc-cert\") pod \"kserve-controller-manager-d6f4b65b8-86x9k\" (UID: \"3ce00c6e-26bd-436e-8bcf-7d9641f767cc\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-86x9k" Jul 11 03:11:21.574167 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:21.574133 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3ce00c6e-26bd-436e-8bcf-7d9641f767cc-cert\") pod \"kserve-controller-manager-d6f4b65b8-86x9k\" (UID: \"3ce00c6e-26bd-436e-8bcf-7d9641f767cc\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-86x9k" Jul 11 03:11:21.574167 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:21.574155 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c94207ff-0897-4648-8265-7ba6892a2cf6-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-hs557\" (UID: \"c94207ff-0897-4648-8265-7ba6892a2cf6\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-hs557" Jul 11 03:11:21.586581 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:21.586552 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cdls2\" (UniqueName: \"kubernetes.io/projected/3ce00c6e-26bd-436e-8bcf-7d9641f767cc-kube-api-access-cdls2\") pod \"kserve-controller-manager-d6f4b65b8-86x9k\" (UID: \"3ce00c6e-26bd-436e-8bcf-7d9641f767cc\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-86x9k" Jul 11 03:11:21.586754 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:21.586732 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rwm76\" (UniqueName: \"kubernetes.io/projected/c94207ff-0897-4648-8265-7ba6892a2cf6-kube-api-access-rwm76\") pod \"llmisvc-controller-manager-777c6bd7d5-hs557\" (UID: \"c94207ff-0897-4648-8265-7ba6892a2cf6\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-hs557" Jul 11 03:11:21.630231 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:21.630192 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-86x9k" Jul 11 03:11:21.651007 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:21.650950 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-hs557" Jul 11 03:11:21.822525 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:21.822163 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-86x9k"] Jul 11 03:11:21.825656 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:11:21.825618 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ce00c6e_26bd_436e_8bcf_7d9641f767cc.slice/crio-1bd2d76e61decd6aee6e211e1710cec1dce3fbefcabe7ef71f4a3b64ca765ff9 WatchSource:0}: Error finding container 1bd2d76e61decd6aee6e211e1710cec1dce3fbefcabe7ef71f4a3b64ca765ff9: Status 404 returned error can't find the container with id 1bd2d76e61decd6aee6e211e1710cec1dce3fbefcabe7ef71f4a3b64ca765ff9 Jul 11 03:11:21.858641 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:21.858612 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-hs557"] Jul 11 03:11:21.861472 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:11:21.861438 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podc94207ff_0897_4648_8265_7ba6892a2cf6.slice/crio-632ca2f0096cf5cafab6f59d92e48fd92904e618e7e367e04192337665a2fa22 WatchSource:0}: Error finding container 632ca2f0096cf5cafab6f59d92e48fd92904e618e7e367e04192337665a2fa22: Status 404 returned error can't find the container with id 632ca2f0096cf5cafab6f59d92e48fd92904e618e7e367e04192337665a2fa22 Jul 11 03:11:22.492854 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:22.492811 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-hs557" event={"ID":"c94207ff-0897-4648-8265-7ba6892a2cf6","Type":"ContainerStarted","Data":"632ca2f0096cf5cafab6f59d92e48fd92904e618e7e367e04192337665a2fa22"} Jul 11 03:11:22.494639 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:22.494607 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-86x9k" event={"ID":"3ce00c6e-26bd-436e-8bcf-7d9641f767cc","Type":"ContainerStarted","Data":"1bd2d76e61decd6aee6e211e1710cec1dce3fbefcabe7ef71f4a3b64ca765ff9"} Jul 11 03:11:23.380166 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:23.380128 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 11 03:11:23.380267 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:23.380204 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 11 03:11:23.380267 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:23.380233 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 11 03:11:23.422148 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:23.422120 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-scchg"] Jul 11 03:11:23.422340 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:23.422319 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-scchg" podUID="e399dfb6-928b-4c30-a0f1-64d9b9fbd592" containerName="discovery" containerID="cri-o://0967604c883e78f0a2f37b0045ae30a5935db04ffa4ad60400df02b39b51fbae" gracePeriod=30 Jul 11 03:11:23.479308 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:23.479270 2559 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-scchg container/discovery namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.21:8080/ready\": dial tcp 10.134.0.21:8080: connect: connection refused" start-of-body= Jul 11 03:11:23.479478 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:23.479345 2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-scchg" podUID="e399dfb6-928b-4c30-a0f1-64d9b9fbd592" containerName="discovery" probeResult="failure" output="Get \"http://10.134.0.21:8080/ready\": dial tcp 10.134.0.21:8080: connect: connection refused" Jul 11 03:11:23.730179 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:23.730146 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-scchg" Jul 11 03:11:23.895116 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:23.895075 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e399dfb6-928b-4c30-a0f1-64d9b9fbd592-istio-csr-ca-configmap\") pod \"e399dfb6-928b-4c30-a0f1-64d9b9fbd592\" (UID: \"e399dfb6-928b-4c30-a0f1-64d9b9fbd592\") " Jul 11 03:11:23.895283 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:23.895133 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e399dfb6-928b-4c30-a0f1-64d9b9fbd592-istio-token\") pod \"e399dfb6-928b-4c30-a0f1-64d9b9fbd592\" (UID: \"e399dfb6-928b-4c30-a0f1-64d9b9fbd592\") " Jul 11 03:11:23.895283 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:23.895156 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e399dfb6-928b-4c30-a0f1-64d9b9fbd592-istio-kubeconfig\") pod \"e399dfb6-928b-4c30-a0f1-64d9b9fbd592\" (UID: \"e399dfb6-928b-4c30-a0f1-64d9b9fbd592\") " Jul 11 03:11:23.895283 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:23.895190 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e399dfb6-928b-4c30-a0f1-64d9b9fbd592-istio-csr-dns-cert\") pod \"e399dfb6-928b-4c30-a0f1-64d9b9fbd592\" (UID: \"e399dfb6-928b-4c30-a0f1-64d9b9fbd592\") " Jul 11 03:11:23.895283 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:23.895212 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e399dfb6-928b-4c30-a0f1-64d9b9fbd592-local-certs\") pod \"e399dfb6-928b-4c30-a0f1-64d9b9fbd592\" (UID: \"e399dfb6-928b-4c30-a0f1-64d9b9fbd592\") " Jul 11 03:11:23.895283 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:23.895244 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e399dfb6-928b-4c30-a0f1-64d9b9fbd592-cacerts\") pod \"e399dfb6-928b-4c30-a0f1-64d9b9fbd592\" (UID: \"e399dfb6-928b-4c30-a0f1-64d9b9fbd592\") " Jul 11 03:11:23.895283 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:23.895282 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tnlmw\" (UniqueName: \"kubernetes.io/projected/e399dfb6-928b-4c30-a0f1-64d9b9fbd592-kube-api-access-tnlmw\") pod \"e399dfb6-928b-4c30-a0f1-64d9b9fbd592\" (UID: \"e399dfb6-928b-4c30-a0f1-64d9b9fbd592\") " Jul 11 03:11:23.895788 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:23.895740 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e399dfb6-928b-4c30-a0f1-64d9b9fbd592-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "e399dfb6-928b-4c30-a0f1-64d9b9fbd592" (UID: "e399dfb6-928b-4c30-a0f1-64d9b9fbd592"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 11 03:11:23.898619 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:23.898588 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e399dfb6-928b-4c30-a0f1-64d9b9fbd592-istio-token" (OuterVolumeSpecName: "istio-token") pod "e399dfb6-928b-4c30-a0f1-64d9b9fbd592" (UID: "e399dfb6-928b-4c30-a0f1-64d9b9fbd592"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 11 03:11:23.898759 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:23.898631 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e399dfb6-928b-4c30-a0f1-64d9b9fbd592-kube-api-access-tnlmw" (OuterVolumeSpecName: "kube-api-access-tnlmw") pod "e399dfb6-928b-4c30-a0f1-64d9b9fbd592" (UID: "e399dfb6-928b-4c30-a0f1-64d9b9fbd592"). InnerVolumeSpecName "kube-api-access-tnlmw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 11 03:11:23.898828 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:23.898798 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e399dfb6-928b-4c30-a0f1-64d9b9fbd592-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "e399dfb6-928b-4c30-a0f1-64d9b9fbd592" (UID: "e399dfb6-928b-4c30-a0f1-64d9b9fbd592"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 11 03:11:23.898884 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:23.898835 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e399dfb6-928b-4c30-a0f1-64d9b9fbd592-local-certs" (OuterVolumeSpecName: "local-certs") pod "e399dfb6-928b-4c30-a0f1-64d9b9fbd592" (UID: "e399dfb6-928b-4c30-a0f1-64d9b9fbd592"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 11 03:11:23.898884 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:23.898868 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e399dfb6-928b-4c30-a0f1-64d9b9fbd592-cacerts" (OuterVolumeSpecName: "cacerts") pod "e399dfb6-928b-4c30-a0f1-64d9b9fbd592" (UID: "e399dfb6-928b-4c30-a0f1-64d9b9fbd592"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 11 03:11:23.899052 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:23.899032 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e399dfb6-928b-4c30-a0f1-64d9b9fbd592-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "e399dfb6-928b-4c30-a0f1-64d9b9fbd592" (UID: "e399dfb6-928b-4c30-a0f1-64d9b9fbd592"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 11 03:11:23.996739 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:23.996639 2559 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e399dfb6-928b-4c30-a0f1-64d9b9fbd592-istio-kubeconfig\") on node \"ip-10-0-141-141.ec2.internal\" DevicePath \"\"" Jul 11 03:11:23.996739 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:23.996674 2559 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e399dfb6-928b-4c30-a0f1-64d9b9fbd592-istio-csr-dns-cert\") on node \"ip-10-0-141-141.ec2.internal\" DevicePath \"\"" Jul 11 03:11:23.996739 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:23.996690 2559 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e399dfb6-928b-4c30-a0f1-64d9b9fbd592-local-certs\") on node \"ip-10-0-141-141.ec2.internal\" DevicePath \"\"" Jul 11 03:11:23.996739 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:23.996702 2559 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e399dfb6-928b-4c30-a0f1-64d9b9fbd592-cacerts\") on node \"ip-10-0-141-141.ec2.internal\" DevicePath \"\"" Jul 11 03:11:23.996739 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:23.996713 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tnlmw\" (UniqueName: \"kubernetes.io/projected/e399dfb6-928b-4c30-a0f1-64d9b9fbd592-kube-api-access-tnlmw\") on node \"ip-10-0-141-141.ec2.internal\" DevicePath \"\"" Jul 11 03:11:23.996739 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:23.996726 2559 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e399dfb6-928b-4c30-a0f1-64d9b9fbd592-istio-csr-ca-configmap\") on node \"ip-10-0-141-141.ec2.internal\" DevicePath \"\"" Jul 11 03:11:23.996739 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:23.996738 2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e399dfb6-928b-4c30-a0f1-64d9b9fbd592-istio-token\") on node \"ip-10-0-141-141.ec2.internal\" DevicePath \"\"" Jul 11 03:11:24.507858 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:24.507819 2559 generic.go:356] "Generic (PLEG): container finished" podID="e399dfb6-928b-4c30-a0f1-64d9b9fbd592" containerID="0967604c883e78f0a2f37b0045ae30a5935db04ffa4ad60400df02b39b51fbae" exitCode=0 Jul 11 03:11:24.508056 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:24.507867 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-scchg" Jul 11 03:11:24.508056 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:24.507899 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-scchg" event={"ID":"e399dfb6-928b-4c30-a0f1-64d9b9fbd592","Type":"ContainerDied","Data":"0967604c883e78f0a2f37b0045ae30a5935db04ffa4ad60400df02b39b51fbae"} Jul 11 03:11:24.508056 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:24.507948 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-scchg" event={"ID":"e399dfb6-928b-4c30-a0f1-64d9b9fbd592","Type":"ContainerDied","Data":"19bb6928be454bdf0cabaf5740d48fe84f9e6238da1fa0f4dacb47c74ae59ef9"} Jul 11 03:11:24.508056 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:24.507993 2559 scope.go:117] "RemoveContainer" containerID="0967604c883e78f0a2f37b0045ae30a5935db04ffa4ad60400df02b39b51fbae" Jul 11 03:11:24.509886 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:24.509854 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6788k5rl" event={"ID":"fee6d489-76a7-47d1-b44e-549cbad94d98","Type":"ContainerStarted","Data":"c0e1f88cdac3f0fbe212ed5e64893769887670e80680319ad847a92075890daf"} Jul 11 03:11:24.527120 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:24.527097 2559 scope.go:117] "RemoveContainer" containerID="0967604c883e78f0a2f37b0045ae30a5935db04ffa4ad60400df02b39b51fbae" Jul 11 03:11:24.527450 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:11:24.527427 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0967604c883e78f0a2f37b0045ae30a5935db04ffa4ad60400df02b39b51fbae\": container with ID starting with 0967604c883e78f0a2f37b0045ae30a5935db04ffa4ad60400df02b39b51fbae not found: ID does not exist" containerID="0967604c883e78f0a2f37b0045ae30a5935db04ffa4ad60400df02b39b51fbae" Jul 11 03:11:24.527488 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:24.527463 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0967604c883e78f0a2f37b0045ae30a5935db04ffa4ad60400df02b39b51fbae"} err="failed to get container status \"0967604c883e78f0a2f37b0045ae30a5935db04ffa4ad60400df02b39b51fbae\": rpc error: code = NotFound desc = could not find container \"0967604c883e78f0a2f37b0045ae30a5935db04ffa4ad60400df02b39b51fbae\": container with ID starting with 0967604c883e78f0a2f37b0045ae30a5935db04ffa4ad60400df02b39b51fbae not found: ID does not exist" Jul 11 03:11:24.536430 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:24.536383 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6788k5rl" podStartSLOduration=1.693070895 podStartE2EDuration="4.536365737s" totalImagesPullingTime="2.843294842s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:11:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:11:24.535441593 +0000 UTC m=+508.504054044" watchObservedRunningTime="2026-07-11 03:11:24.536365737 +0000 UTC m=+508.504978187" Jul 11 03:11:24.550821 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:24.550791 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-scchg"] Jul 11 03:11:24.554114 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:24.554085 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-scchg"] Jul 11 03:11:24.619434 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:24.619401 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e399dfb6-928b-4c30-a0f1-64d9b9fbd592" path="/var/lib/kubelet/pods/e399dfb6-928b-4c30-a0f1-64d9b9fbd592/volumes" Jul 11 03:11:25.391938 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:25.391899 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6788k5rl" Jul 11 03:11:25.397013 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:25.396987 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6788k5rl" Jul 11 03:11:25.518078 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:25.518038 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-86x9k" event={"ID":"3ce00c6e-26bd-436e-8bcf-7d9641f767cc","Type":"ContainerStarted","Data":"c842c79bda1f3691ae05ce8142161e9dd2c88298a31ae7d6f3f1cf4271feb359"} Jul 11 03:11:25.518263 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:25.518146 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-86x9k" Jul 11 03:11:25.519383 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:25.519357 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6788k5rl" Jul 11 03:11:25.520366 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:25.520345 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6788k5rl" Jul 11 03:11:25.534060 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:25.534006 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-86x9k" podStartSLOduration=1.7944324699999998 podStartE2EDuration="4.533987817s" totalImagesPullingTime="2.739555347s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:11:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:11:25.532638724 +0000 UTC m=+509.501251167" watchObservedRunningTime="2026-07-11 03:11:25.533987817 +0000 UTC m=+509.502600267" Jul 11 03:11:27.464600 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:27.464568 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-bz22q" Jul 11 03:11:27.466628 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:27.466602 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-88p9z" Jul 11 03:11:27.529330 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:27.529299 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-hs557" event={"ID":"c94207ff-0897-4648-8265-7ba6892a2cf6","Type":"ContainerStarted","Data":"382330db8fe9e7a7a66621fbc77fafd01af2dff1c4ba66d799ce88bb50e9a28f"} Jul 11 03:11:27.545570 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:27.545520 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-hs557" podStartSLOduration=1.959775364 podStartE2EDuration="6.545497578s" totalImagesPullingTime="4.585722214s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:11:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:11:27.544241145 +0000 UTC m=+511.512853599" watchObservedRunningTime="2026-07-11 03:11:27.545497578 +0000 UTC m=+511.514110030" Jul 11 03:11:28.534161 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:28.534132 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-hs557" Jul 11 03:11:56.529316 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:56.529282 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-86x9k" Jul 11 03:11:59.541614 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:11:59.541584 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-hs557" Jul 11 03:12:12.477746 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:12.477709 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-2jft2"] Jul 11 03:12:12.478153 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:12.478033 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e399dfb6-928b-4c30-a0f1-64d9b9fbd592" containerName="discovery" Jul 11 03:12:12.478153 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:12.478045 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="e399dfb6-928b-4c30-a0f1-64d9b9fbd592" containerName="discovery" Jul 11 03:12:12.478153 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:12.478114 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="e399dfb6-928b-4c30-a0f1-64d9b9fbd592" containerName="discovery" Jul 11 03:12:12.490700 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:12.490655 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-2jft2"] Jul 11 03:12:12.490848 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:12.490780 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-2jft2" Jul 11 03:12:12.493268 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:12.493233 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 11 03:12:12.494332 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:12.494310 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 11 03:12:12.494463 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:12.494334 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-wv7n5\"" Jul 11 03:12:12.606148 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:12.606113 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9plp\" (UniqueName: \"kubernetes.io/projected/ba62de8d-53aa-46f2-8bb4-64ce464c61a9-kube-api-access-b9plp\") pod \"kuadrant-operator-catalog-2jft2\" (UID: \"ba62de8d-53aa-46f2-8bb4-64ce464c61a9\") " pod="kuadrant-system/kuadrant-operator-catalog-2jft2" Jul 11 03:12:12.706922 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:12.706888 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9plp\" (UniqueName: \"kubernetes.io/projected/ba62de8d-53aa-46f2-8bb4-64ce464c61a9-kube-api-access-b9plp\") pod \"kuadrant-operator-catalog-2jft2\" (UID: \"ba62de8d-53aa-46f2-8bb4-64ce464c61a9\") " pod="kuadrant-system/kuadrant-operator-catalog-2jft2" Jul 11 03:12:12.715331 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:12.715304 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9plp\" (UniqueName: \"kubernetes.io/projected/ba62de8d-53aa-46f2-8bb4-64ce464c61a9-kube-api-access-b9plp\") pod \"kuadrant-operator-catalog-2jft2\" (UID: \"ba62de8d-53aa-46f2-8bb4-64ce464c61a9\") " pod="kuadrant-system/kuadrant-operator-catalog-2jft2" Jul 11 03:12:12.801821 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:12.801785 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-2jft2" Jul 11 03:12:12.852934 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:12.852439 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-2jft2"] Jul 11 03:12:12.932619 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:12.932591 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-2jft2"] Jul 11 03:12:12.936584 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:12:12.936553 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba62de8d_53aa_46f2_8bb4_64ce464c61a9.slice/crio-e7eed605962bd7a52c3f54b852920be5f4f70caf0a5eb09a1e1b4fb4003b138a WatchSource:0}: Error finding container e7eed605962bd7a52c3f54b852920be5f4f70caf0a5eb09a1e1b4fb4003b138a: Status 404 returned error can't find the container with id e7eed605962bd7a52c3f54b852920be5f4f70caf0a5eb09a1e1b4fb4003b138a Jul 11 03:12:13.059628 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:13.059542 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-m8zn7"] Jul 11 03:12:13.062220 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:13.062203 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-m8zn7" Jul 11 03:12:13.070655 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:13.070625 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-m8zn7"] Jul 11 03:12:13.211119 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:13.211084 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6trq2\" (UniqueName: \"kubernetes.io/projected/fa092c01-89d8-4a0c-a4a6-20c31ca5eff9-kube-api-access-6trq2\") pod \"kuadrant-operator-catalog-m8zn7\" (UID: \"fa092c01-89d8-4a0c-a4a6-20c31ca5eff9\") " pod="kuadrant-system/kuadrant-operator-catalog-m8zn7" Jul 11 03:12:13.312369 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:13.312287 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6trq2\" (UniqueName: \"kubernetes.io/projected/fa092c01-89d8-4a0c-a4a6-20c31ca5eff9-kube-api-access-6trq2\") pod \"kuadrant-operator-catalog-m8zn7\" (UID: \"fa092c01-89d8-4a0c-a4a6-20c31ca5eff9\") " pod="kuadrant-system/kuadrant-operator-catalog-m8zn7" Jul 11 03:12:13.320139 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:13.320116 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6trq2\" (UniqueName: \"kubernetes.io/projected/fa092c01-89d8-4a0c-a4a6-20c31ca5eff9-kube-api-access-6trq2\") pod \"kuadrant-operator-catalog-m8zn7\" (UID: \"fa092c01-89d8-4a0c-a4a6-20c31ca5eff9\") " pod="kuadrant-system/kuadrant-operator-catalog-m8zn7" Jul 11 03:12:13.372327 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:13.372289 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-m8zn7" Jul 11 03:12:13.510270 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:13.510048 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-m8zn7"] Jul 11 03:12:13.546615 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:12:13.546575 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa092c01_89d8_4a0c_a4a6_20c31ca5eff9.slice/crio-76535dac5f2d33bce990e1511bacfbb1de33d1797f7c07fea99f913aa9f03563 WatchSource:0}: Error finding container 76535dac5f2d33bce990e1511bacfbb1de33d1797f7c07fea99f913aa9f03563: Status 404 returned error can't find the container with id 76535dac5f2d33bce990e1511bacfbb1de33d1797f7c07fea99f913aa9f03563 Jul 11 03:12:13.722903 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:13.722788 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-2jft2" event={"ID":"ba62de8d-53aa-46f2-8bb4-64ce464c61a9","Type":"ContainerStarted","Data":"e7eed605962bd7a52c3f54b852920be5f4f70caf0a5eb09a1e1b4fb4003b138a"} Jul 11 03:12:13.725431 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:13.725392 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-m8zn7" event={"ID":"fa092c01-89d8-4a0c-a4a6-20c31ca5eff9","Type":"ContainerStarted","Data":"76535dac5f2d33bce990e1511bacfbb1de33d1797f7c07fea99f913aa9f03563"} Jul 11 03:12:15.743690 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:15.743653 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-m8zn7" event={"ID":"fa092c01-89d8-4a0c-a4a6-20c31ca5eff9","Type":"ContainerStarted","Data":"b665f945bff1b0de9cb71e1e933d918aa9d721362fa6238f71adb2d20b129848"} Jul 11 03:12:15.745429 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:15.745401 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-2jft2" event={"ID":"ba62de8d-53aa-46f2-8bb4-64ce464c61a9","Type":"ContainerStarted","Data":"a12aec38a0cf3da8876c4269c8deda40938addd01538954f6d3d825db5960391"} Jul 11 03:12:15.745547 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:15.745478 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-2jft2" podUID="ba62de8d-53aa-46f2-8bb4-64ce464c61a9" containerName="registry-server" containerID="cri-o://a12aec38a0cf3da8876c4269c8deda40938addd01538954f6d3d825db5960391" gracePeriod=2 Jul 11 03:12:15.761726 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:15.761681 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-m8zn7" podStartSLOduration=1.346140015 podStartE2EDuration="2.761666393s" totalImagesPullingTime="1.415526378s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:12:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:12:15.76056607 +0000 UTC m=+559.729178521" watchObservedRunningTime="2026-07-11 03:12:15.761666393 +0000 UTC m=+559.730278838" Jul 11 03:12:15.779861 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:15.779806 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-2jft2" podStartSLOduration=1.756948508 podStartE2EDuration="3.779787684s" totalImagesPullingTime="2.022839176s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:12:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:12:15.778357276 +0000 UTC m=+559.746969740" watchObservedRunningTime="2026-07-11 03:12:15.779787684 +0000 UTC m=+559.748400136" Jul 11 03:12:15.996940 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:15.996877 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-2jft2" Jul 11 03:12:16.137842 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:16.137803 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b9plp\" (UniqueName: \"kubernetes.io/projected/ba62de8d-53aa-46f2-8bb4-64ce464c61a9-kube-api-access-b9plp\") pod \"ba62de8d-53aa-46f2-8bb4-64ce464c61a9\" (UID: \"ba62de8d-53aa-46f2-8bb4-64ce464c61a9\") " Jul 11 03:12:16.140266 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:16.140236 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba62de8d-53aa-46f2-8bb4-64ce464c61a9-kube-api-access-b9plp" (OuterVolumeSpecName: "kube-api-access-b9plp") pod "ba62de8d-53aa-46f2-8bb4-64ce464c61a9" (UID: "ba62de8d-53aa-46f2-8bb4-64ce464c61a9"). InnerVolumeSpecName "kube-api-access-b9plp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 11 03:12:16.238881 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:16.238835 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b9plp\" (UniqueName: \"kubernetes.io/projected/ba62de8d-53aa-46f2-8bb4-64ce464c61a9-kube-api-access-b9plp\") on node \"ip-10-0-141-141.ec2.internal\" DevicePath \"\"" Jul 11 03:12:16.751489 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:16.751450 2559 generic.go:356] "Generic (PLEG): container finished" podID="ba62de8d-53aa-46f2-8bb4-64ce464c61a9" containerID="a12aec38a0cf3da8876c4269c8deda40938addd01538954f6d3d825db5960391" exitCode=0 Jul 11 03:12:16.751887 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:16.751497 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-2jft2" Jul 11 03:12:16.751887 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:16.751537 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-2jft2" event={"ID":"ba62de8d-53aa-46f2-8bb4-64ce464c61a9","Type":"ContainerDied","Data":"a12aec38a0cf3da8876c4269c8deda40938addd01538954f6d3d825db5960391"} Jul 11 03:12:16.751887 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:16.751589 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-2jft2" event={"ID":"ba62de8d-53aa-46f2-8bb4-64ce464c61a9","Type":"ContainerDied","Data":"e7eed605962bd7a52c3f54b852920be5f4f70caf0a5eb09a1e1b4fb4003b138a"} Jul 11 03:12:16.751887 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:16.751610 2559 scope.go:117] "RemoveContainer" containerID="a12aec38a0cf3da8876c4269c8deda40938addd01538954f6d3d825db5960391" Jul 11 03:12:16.760479 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:16.760454 2559 scope.go:117] "RemoveContainer" containerID="a12aec38a0cf3da8876c4269c8deda40938addd01538954f6d3d825db5960391" Jul 11 03:12:16.760770 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:12:16.760741 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a12aec38a0cf3da8876c4269c8deda40938addd01538954f6d3d825db5960391\": container with ID starting with a12aec38a0cf3da8876c4269c8deda40938addd01538954f6d3d825db5960391 not found: ID does not exist" containerID="a12aec38a0cf3da8876c4269c8deda40938addd01538954f6d3d825db5960391" Jul 11 03:12:16.760850 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:16.760774 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a12aec38a0cf3da8876c4269c8deda40938addd01538954f6d3d825db5960391"} err="failed to get container status \"a12aec38a0cf3da8876c4269c8deda40938addd01538954f6d3d825db5960391\": rpc error: code = NotFound desc = could not find container \"a12aec38a0cf3da8876c4269c8deda40938addd01538954f6d3d825db5960391\": container with ID starting with a12aec38a0cf3da8876c4269c8deda40938addd01538954f6d3d825db5960391 not found: ID does not exist" Jul 11 03:12:16.767688 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:16.767662 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-2jft2"] Jul 11 03:12:16.773256 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:16.773228 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-2jft2"] Jul 11 03:12:18.614708 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:18.614664 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ba62de8d-53aa-46f2-8bb4-64ce464c61a9" path="/var/lib/kubelet/pods/ba62de8d-53aa-46f2-8bb4-64ce464c61a9/volumes" Jul 11 03:12:23.373190 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:23.373132 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-m8zn7" Jul 11 03:12:23.373616 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:23.373212 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-m8zn7" Jul 11 03:12:23.396402 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:23.396374 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-m8zn7" Jul 11 03:12:23.807953 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:23.807925 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-m8zn7" Jul 11 03:12:28.133145 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:28.133102 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fvkg4"] Jul 11 03:12:28.133652 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:28.133529 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba62de8d-53aa-46f2-8bb4-64ce464c61a9" containerName="registry-server" Jul 11 03:12:28.133652 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:28.133546 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba62de8d-53aa-46f2-8bb4-64ce464c61a9" containerName="registry-server" Jul 11 03:12:28.133652 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:28.133616 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba62de8d-53aa-46f2-8bb4-64ce464c61a9" containerName="registry-server" Jul 11 03:12:28.136915 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:28.136892 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fvkg4" Jul 11 03:12:28.139278 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:28.139259 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-x2kpg\"" Jul 11 03:12:28.144196 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:28.144153 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fvkg4"] Jul 11 03:12:28.233507 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:28.233472 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7583a6a9-23c6-4e26-9c3f-180abd47fe6f-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fvkg4\" (UID: \"7583a6a9-23c6-4e26-9c3f-180abd47fe6f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fvkg4" Jul 11 03:12:28.233689 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:28.233514 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lfc8f\" (UniqueName: \"kubernetes.io/projected/7583a6a9-23c6-4e26-9c3f-180abd47fe6f-kube-api-access-lfc8f\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fvkg4\" (UID: \"7583a6a9-23c6-4e26-9c3f-180abd47fe6f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fvkg4" Jul 11 03:12:28.233689 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:28.233640 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7583a6a9-23c6-4e26-9c3f-180abd47fe6f-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fvkg4\" (UID: \"7583a6a9-23c6-4e26-9c3f-180abd47fe6f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fvkg4" Jul 11 03:12:28.334157 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:28.334119 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7583a6a9-23c6-4e26-9c3f-180abd47fe6f-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fvkg4\" (UID: \"7583a6a9-23c6-4e26-9c3f-180abd47fe6f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fvkg4" Jul 11 03:12:28.334297 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:28.334165 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7583a6a9-23c6-4e26-9c3f-180abd47fe6f-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fvkg4\" (UID: \"7583a6a9-23c6-4e26-9c3f-180abd47fe6f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fvkg4" Jul 11 03:12:28.334297 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:28.334192 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lfc8f\" (UniqueName: \"kubernetes.io/projected/7583a6a9-23c6-4e26-9c3f-180abd47fe6f-kube-api-access-lfc8f\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fvkg4\" (UID: \"7583a6a9-23c6-4e26-9c3f-180abd47fe6f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fvkg4" Jul 11 03:12:28.334592 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:28.334565 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7583a6a9-23c6-4e26-9c3f-180abd47fe6f-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fvkg4\" (UID: \"7583a6a9-23c6-4e26-9c3f-180abd47fe6f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fvkg4" Jul 11 03:12:28.334592 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:28.334579 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7583a6a9-23c6-4e26-9c3f-180abd47fe6f-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fvkg4\" (UID: \"7583a6a9-23c6-4e26-9c3f-180abd47fe6f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fvkg4" Jul 11 03:12:28.342601 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:28.342577 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lfc8f\" (UniqueName: \"kubernetes.io/projected/7583a6a9-23c6-4e26-9c3f-180abd47fe6f-kube-api-access-lfc8f\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fvkg4\" (UID: \"7583a6a9-23c6-4e26-9c3f-180abd47fe6f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fvkg4" Jul 11 03:12:28.447725 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:28.447608 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fvkg4" Jul 11 03:12:28.581784 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:28.581757 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fvkg4"] Jul 11 03:12:28.584485 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:12:28.584456 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7583a6a9_23c6_4e26_9c3f_180abd47fe6f.slice/crio-c33a70769508220b7c96dca7f71f3e9a45b086c5048d307c818626bb43ccec85 WatchSource:0}: Error finding container c33a70769508220b7c96dca7f71f3e9a45b086c5048d307c818626bb43ccec85: Status 404 returned error can't find the container with id c33a70769508220b7c96dca7f71f3e9a45b086c5048d307c818626bb43ccec85 Jul 11 03:12:28.807981 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:28.807923 2559 generic.go:356] "Generic (PLEG): container finished" podID="7583a6a9-23c6-4e26-9c3f-180abd47fe6f" containerID="11c72792bcc992a99e6e427225fca78107ff695d097469a94a3caab99db12b31" exitCode=0 Jul 11 03:12:28.808151 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:28.808003 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fvkg4" event={"ID":"7583a6a9-23c6-4e26-9c3f-180abd47fe6f","Type":"ContainerDied","Data":"11c72792bcc992a99e6e427225fca78107ff695d097469a94a3caab99db12b31"} Jul 11 03:12:28.808151 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:28.808051 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fvkg4" event={"ID":"7583a6a9-23c6-4e26-9c3f-180abd47fe6f","Type":"ContainerStarted","Data":"c33a70769508220b7c96dca7f71f3e9a45b086c5048d307c818626bb43ccec85"} Jul 11 03:12:28.894578 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:28.894543 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t66nr"] Jul 11 03:12:28.897967 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:28.897940 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t66nr" Jul 11 03:12:28.905847 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:28.905815 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t66nr"] Jul 11 03:12:28.938927 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:28.938890 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4606cc70-243f-4873-908e-0ab132049f4e-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t66nr\" (UID: \"4606cc70-243f-4873-908e-0ab132049f4e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t66nr" Jul 11 03:12:28.939123 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:28.938950 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4606cc70-243f-4873-908e-0ab132049f4e-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t66nr\" (UID: \"4606cc70-243f-4873-908e-0ab132049f4e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t66nr" Jul 11 03:12:28.939123 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:28.939023 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvtmf\" (UniqueName: \"kubernetes.io/projected/4606cc70-243f-4873-908e-0ab132049f4e-kube-api-access-wvtmf\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t66nr\" (UID: \"4606cc70-243f-4873-908e-0ab132049f4e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t66nr" Jul 11 03:12:29.039754 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:29.039721 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4606cc70-243f-4873-908e-0ab132049f4e-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t66nr\" (UID: \"4606cc70-243f-4873-908e-0ab132049f4e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t66nr" Jul 11 03:12:29.039908 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:29.039780 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvtmf\" (UniqueName: \"kubernetes.io/projected/4606cc70-243f-4873-908e-0ab132049f4e-kube-api-access-wvtmf\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t66nr\" (UID: \"4606cc70-243f-4873-908e-0ab132049f4e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t66nr" Jul 11 03:12:29.039908 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:29.039812 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4606cc70-243f-4873-908e-0ab132049f4e-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t66nr\" (UID: \"4606cc70-243f-4873-908e-0ab132049f4e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t66nr" Jul 11 03:12:29.040135 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:29.040117 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4606cc70-243f-4873-908e-0ab132049f4e-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t66nr\" (UID: \"4606cc70-243f-4873-908e-0ab132049f4e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t66nr" Jul 11 03:12:29.040195 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:29.040179 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4606cc70-243f-4873-908e-0ab132049f4e-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t66nr\" (UID: \"4606cc70-243f-4873-908e-0ab132049f4e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t66nr" Jul 11 03:12:29.049271 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:29.049244 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvtmf\" (UniqueName: \"kubernetes.io/projected/4606cc70-243f-4873-908e-0ab132049f4e-kube-api-access-wvtmf\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t66nr\" (UID: \"4606cc70-243f-4873-908e-0ab132049f4e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t66nr" Jul 11 03:12:29.207635 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:29.207550 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t66nr" Jul 11 03:12:29.342163 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:29.342134 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t66nr"] Jul 11 03:12:29.344202 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:12:29.344169 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4606cc70_243f_4873_908e_0ab132049f4e.slice/crio-908dad34eb157c7f61e0c6e660555305f3014af6adb68f5e8e9193b2273329b8 WatchSource:0}: Error finding container 908dad34eb157c7f61e0c6e660555305f3014af6adb68f5e8e9193b2273329b8: Status 404 returned error can't find the container with id 908dad34eb157c7f61e0c6e660555305f3014af6adb68f5e8e9193b2273329b8 Jul 11 03:12:29.492806 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:29.492741 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7342kbc"] Jul 11 03:12:29.495858 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:29.495837 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7342kbc" Jul 11 03:12:29.504197 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:29.504168 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7342kbc"] Jul 11 03:12:29.542644 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:29.542598 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0d799ed7-e4cb-4d50-b6a6-77ae1dba8fba-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7342kbc\" (UID: \"0d799ed7-e4cb-4d50-b6a6-77ae1dba8fba\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7342kbc" Jul 11 03:12:29.542826 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:29.542655 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jstxw\" (UniqueName: \"kubernetes.io/projected/0d799ed7-e4cb-4d50-b6a6-77ae1dba8fba-kube-api-access-jstxw\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7342kbc\" (UID: \"0d799ed7-e4cb-4d50-b6a6-77ae1dba8fba\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7342kbc" Jul 11 03:12:29.542826 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:29.542775 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0d799ed7-e4cb-4d50-b6a6-77ae1dba8fba-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7342kbc\" (UID: \"0d799ed7-e4cb-4d50-b6a6-77ae1dba8fba\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7342kbc" Jul 11 03:12:29.643479 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:29.643457 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0d799ed7-e4cb-4d50-b6a6-77ae1dba8fba-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7342kbc\" (UID: \"0d799ed7-e4cb-4d50-b6a6-77ae1dba8fba\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7342kbc" Jul 11 03:12:29.643570 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:29.643491 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0d799ed7-e4cb-4d50-b6a6-77ae1dba8fba-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7342kbc\" (UID: \"0d799ed7-e4cb-4d50-b6a6-77ae1dba8fba\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7342kbc" Jul 11 03:12:29.643570 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:29.643514 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jstxw\" (UniqueName: \"kubernetes.io/projected/0d799ed7-e4cb-4d50-b6a6-77ae1dba8fba-kube-api-access-jstxw\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7342kbc\" (UID: \"0d799ed7-e4cb-4d50-b6a6-77ae1dba8fba\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7342kbc" Jul 11 03:12:29.643875 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:29.643854 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0d799ed7-e4cb-4d50-b6a6-77ae1dba8fba-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7342kbc\" (UID: \"0d799ed7-e4cb-4d50-b6a6-77ae1dba8fba\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7342kbc" Jul 11 03:12:29.643920 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:29.643898 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0d799ed7-e4cb-4d50-b6a6-77ae1dba8fba-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7342kbc\" (UID: \"0d799ed7-e4cb-4d50-b6a6-77ae1dba8fba\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7342kbc" Jul 11 03:12:29.651948 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:29.651925 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jstxw\" (UniqueName: \"kubernetes.io/projected/0d799ed7-e4cb-4d50-b6a6-77ae1dba8fba-kube-api-access-jstxw\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7342kbc\" (UID: \"0d799ed7-e4cb-4d50-b6a6-77ae1dba8fba\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7342kbc" Jul 11 03:12:29.808786 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:29.808748 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7342kbc" Jul 11 03:12:29.814242 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:29.814215 2559 generic.go:356] "Generic (PLEG): container finished" podID="4606cc70-243f-4873-908e-0ab132049f4e" containerID="06ada9f09c8ae5c58078eccf038dca705e3865665139baae9e8ab8fbb2c5566b" exitCode=0 Jul 11 03:12:29.814353 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:29.814307 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t66nr" event={"ID":"4606cc70-243f-4873-908e-0ab132049f4e","Type":"ContainerDied","Data":"06ada9f09c8ae5c58078eccf038dca705e3865665139baae9e8ab8fbb2c5566b"} Jul 11 03:12:29.814411 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:29.814365 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t66nr" event={"ID":"4606cc70-243f-4873-908e-0ab132049f4e","Type":"ContainerStarted","Data":"908dad34eb157c7f61e0c6e660555305f3014af6adb68f5e8e9193b2273329b8"} Jul 11 03:12:29.816326 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:29.816301 2559 generic.go:356] "Generic (PLEG): container finished" podID="7583a6a9-23c6-4e26-9c3f-180abd47fe6f" containerID="edb979732969048ffca85fe4a0f9db3c3fbf076c590da6b57b8a387d7d0e2c03" exitCode=0 Jul 11 03:12:29.816422 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:29.816347 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fvkg4" event={"ID":"7583a6a9-23c6-4e26-9c3f-180abd47fe6f","Type":"ContainerDied","Data":"edb979732969048ffca85fe4a0f9db3c3fbf076c590da6b57b8a387d7d0e2c03"} Jul 11 03:12:29.897777 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:29.897750 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cjsr5"] Jul 11 03:12:29.901855 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:29.901834 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cjsr5" Jul 11 03:12:29.910719 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:29.909787 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cjsr5"] Jul 11 03:12:29.945871 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:29.945832 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0419b137-a8a6-4b40-842b-946847959ed0-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cjsr5\" (UID: \"0419b137-a8a6-4b40-842b-946847959ed0\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cjsr5" Jul 11 03:12:29.945871 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:29.945868 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0419b137-a8a6-4b40-842b-946847959ed0-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cjsr5\" (UID: \"0419b137-a8a6-4b40-842b-946847959ed0\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cjsr5" Jul 11 03:12:29.946092 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:29.945973 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4twjd\" (UniqueName: \"kubernetes.io/projected/0419b137-a8a6-4b40-842b-946847959ed0-kube-api-access-4twjd\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cjsr5\" (UID: \"0419b137-a8a6-4b40-842b-946847959ed0\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cjsr5" Jul 11 03:12:29.955684 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:29.955584 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7342kbc"] Jul 11 03:12:29.958288 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:12:29.958255 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d799ed7_e4cb_4d50_b6a6_77ae1dba8fba.slice/crio-2c1df2398872ef58d1a05afea2bc80feb98b19db369a798f10e196168204c9b6 WatchSource:0}: Error finding container 2c1df2398872ef58d1a05afea2bc80feb98b19db369a798f10e196168204c9b6: Status 404 returned error can't find the container with id 2c1df2398872ef58d1a05afea2bc80feb98b19db369a798f10e196168204c9b6 Jul 11 03:12:30.047135 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:30.047093 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4twjd\" (UniqueName: \"kubernetes.io/projected/0419b137-a8a6-4b40-842b-946847959ed0-kube-api-access-4twjd\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cjsr5\" (UID: \"0419b137-a8a6-4b40-842b-946847959ed0\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cjsr5" Jul 11 03:12:30.047220 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:30.047156 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0419b137-a8a6-4b40-842b-946847959ed0-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cjsr5\" (UID: \"0419b137-a8a6-4b40-842b-946847959ed0\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cjsr5" Jul 11 03:12:30.047220 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:30.047172 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0419b137-a8a6-4b40-842b-946847959ed0-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cjsr5\" (UID: \"0419b137-a8a6-4b40-842b-946847959ed0\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cjsr5" Jul 11 03:12:30.047477 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:30.047460 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0419b137-a8a6-4b40-842b-946847959ed0-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cjsr5\" (UID: \"0419b137-a8a6-4b40-842b-946847959ed0\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cjsr5" Jul 11 03:12:30.047553 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:30.047531 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0419b137-a8a6-4b40-842b-946847959ed0-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cjsr5\" (UID: \"0419b137-a8a6-4b40-842b-946847959ed0\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cjsr5" Jul 11 03:12:30.058993 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:30.058890 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4twjd\" (UniqueName: \"kubernetes.io/projected/0419b137-a8a6-4b40-842b-946847959ed0-kube-api-access-4twjd\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cjsr5\" (UID: \"0419b137-a8a6-4b40-842b-946847959ed0\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cjsr5" Jul 11 03:12:30.213363 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:30.213314 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cjsr5" Jul 11 03:12:30.348624 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:30.348520 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cjsr5"] Jul 11 03:12:30.351149 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:12:30.351109 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0419b137_a8a6_4b40_842b_946847959ed0.slice/crio-a136f9be2fd8c1b9cec61ae49280b8d3be185f1f9e62f5dd8be3c5a2da7d4a38 WatchSource:0}: Error finding container a136f9be2fd8c1b9cec61ae49280b8d3be185f1f9e62f5dd8be3c5a2da7d4a38: Status 404 returned error can't find the container with id a136f9be2fd8c1b9cec61ae49280b8d3be185f1f9e62f5dd8be3c5a2da7d4a38 Jul 11 03:12:30.822012 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:30.821977 2559 generic.go:356] "Generic (PLEG): container finished" podID="4606cc70-243f-4873-908e-0ab132049f4e" containerID="e9a6da7ae419d5ce369ef5f6aa9df46492c6cf9b3b5213a105864f6e2f083b10" exitCode=0 Jul 11 03:12:30.822249 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:30.822059 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t66nr" event={"ID":"4606cc70-243f-4873-908e-0ab132049f4e","Type":"ContainerDied","Data":"e9a6da7ae419d5ce369ef5f6aa9df46492c6cf9b3b5213a105864f6e2f083b10"} Jul 11 03:12:30.823693 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:30.823547 2559 generic.go:356] "Generic (PLEG): container finished" podID="0d799ed7-e4cb-4d50-b6a6-77ae1dba8fba" containerID="498630b8a47ba813edbd7ed19c38bf8e2b6f99d6098dddb8dcacf33e58771330" exitCode=0 Jul 11 03:12:30.823693 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:30.823602 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7342kbc" event={"ID":"0d799ed7-e4cb-4d50-b6a6-77ae1dba8fba","Type":"ContainerDied","Data":"498630b8a47ba813edbd7ed19c38bf8e2b6f99d6098dddb8dcacf33e58771330"} Jul 11 03:12:30.823693 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:30.823663 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7342kbc" event={"ID":"0d799ed7-e4cb-4d50-b6a6-77ae1dba8fba","Type":"ContainerStarted","Data":"2c1df2398872ef58d1a05afea2bc80feb98b19db369a798f10e196168204c9b6"} Jul 11 03:12:30.825409 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:30.825385 2559 generic.go:356] "Generic (PLEG): container finished" podID="0419b137-a8a6-4b40-842b-946847959ed0" containerID="7d5f2b69db8f221cb309c0bd81588721a024d8067139864419262a6b50881bf7" exitCode=0 Jul 11 03:12:30.825519 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:30.825464 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cjsr5" event={"ID":"0419b137-a8a6-4b40-842b-946847959ed0","Type":"ContainerDied","Data":"7d5f2b69db8f221cb309c0bd81588721a024d8067139864419262a6b50881bf7"} Jul 11 03:12:30.825519 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:30.825508 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cjsr5" event={"ID":"0419b137-a8a6-4b40-842b-946847959ed0","Type":"ContainerStarted","Data":"a136f9be2fd8c1b9cec61ae49280b8d3be185f1f9e62f5dd8be3c5a2da7d4a38"} Jul 11 03:12:30.827915 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:30.827890 2559 generic.go:356] "Generic (PLEG): container finished" podID="7583a6a9-23c6-4e26-9c3f-180abd47fe6f" containerID="95ef9bb45cc1aaac9a1588736435d2bde46ebfc44c56128db5d9e68362a8c415" exitCode=0 Jul 11 03:12:30.828035 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:30.827988 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fvkg4" event={"ID":"7583a6a9-23c6-4e26-9c3f-180abd47fe6f","Type":"ContainerDied","Data":"95ef9bb45cc1aaac9a1588736435d2bde46ebfc44c56128db5d9e68362a8c415"} Jul 11 03:12:31.834129 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:31.834095 2559 generic.go:356] "Generic (PLEG): container finished" podID="4606cc70-243f-4873-908e-0ab132049f4e" containerID="7a58b5c36b47660d6b50313cb31da3490a656c77a8c88bdaa886a074a16418e1" exitCode=0 Jul 11 03:12:31.834525 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:31.834179 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t66nr" event={"ID":"4606cc70-243f-4873-908e-0ab132049f4e","Type":"ContainerDied","Data":"7a58b5c36b47660d6b50313cb31da3490a656c77a8c88bdaa886a074a16418e1"} Jul 11 03:12:31.835768 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:31.835744 2559 generic.go:356] "Generic (PLEG): container finished" podID="0d799ed7-e4cb-4d50-b6a6-77ae1dba8fba" containerID="9766c157e7ad3e09b6a2bf652609742e94868c4e185f83f93d2f76f8668d0cba" exitCode=0 Jul 11 03:12:31.835886 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:31.835835 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7342kbc" event={"ID":"0d799ed7-e4cb-4d50-b6a6-77ae1dba8fba","Type":"ContainerDied","Data":"9766c157e7ad3e09b6a2bf652609742e94868c4e185f83f93d2f76f8668d0cba"} Jul 11 03:12:31.837590 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:31.837569 2559 generic.go:356] "Generic (PLEG): container finished" podID="0419b137-a8a6-4b40-842b-946847959ed0" containerID="bc359ffb31b9579bfc5df28e33d6d937d05038f02a80d7e0de9b7a39071dc459" exitCode=0 Jul 11 03:12:31.837690 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:31.837651 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cjsr5" event={"ID":"0419b137-a8a6-4b40-842b-946847959ed0","Type":"ContainerDied","Data":"bc359ffb31b9579bfc5df28e33d6d937d05038f02a80d7e0de9b7a39071dc459"} Jul 11 03:12:31.974027 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:31.973997 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fvkg4" Jul 11 03:12:32.065750 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:32.065715 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7583a6a9-23c6-4e26-9c3f-180abd47fe6f-util\") pod \"7583a6a9-23c6-4e26-9c3f-180abd47fe6f\" (UID: \"7583a6a9-23c6-4e26-9c3f-180abd47fe6f\") " Jul 11 03:12:32.065950 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:32.065781 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lfc8f\" (UniqueName: \"kubernetes.io/projected/7583a6a9-23c6-4e26-9c3f-180abd47fe6f-kube-api-access-lfc8f\") pod \"7583a6a9-23c6-4e26-9c3f-180abd47fe6f\" (UID: \"7583a6a9-23c6-4e26-9c3f-180abd47fe6f\") " Jul 11 03:12:32.065950 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:32.065807 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7583a6a9-23c6-4e26-9c3f-180abd47fe6f-bundle\") pod \"7583a6a9-23c6-4e26-9c3f-180abd47fe6f\" (UID: \"7583a6a9-23c6-4e26-9c3f-180abd47fe6f\") " Jul 11 03:12:32.066332 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:32.066310 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7583a6a9-23c6-4e26-9c3f-180abd47fe6f-bundle" (OuterVolumeSpecName: "bundle") pod "7583a6a9-23c6-4e26-9c3f-180abd47fe6f" (UID: "7583a6a9-23c6-4e26-9c3f-180abd47fe6f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 11 03:12:32.067992 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:32.067952 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7583a6a9-23c6-4e26-9c3f-180abd47fe6f-kube-api-access-lfc8f" (OuterVolumeSpecName: "kube-api-access-lfc8f") pod "7583a6a9-23c6-4e26-9c3f-180abd47fe6f" (UID: "7583a6a9-23c6-4e26-9c3f-180abd47fe6f"). InnerVolumeSpecName "kube-api-access-lfc8f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 11 03:12:32.070813 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:32.070788 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7583a6a9-23c6-4e26-9c3f-180abd47fe6f-util" (OuterVolumeSpecName: "util") pod "7583a6a9-23c6-4e26-9c3f-180abd47fe6f" (UID: "7583a6a9-23c6-4e26-9c3f-180abd47fe6f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 11 03:12:32.166869 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:32.166782 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lfc8f\" (UniqueName: \"kubernetes.io/projected/7583a6a9-23c6-4e26-9c3f-180abd47fe6f-kube-api-access-lfc8f\") on node \"ip-10-0-141-141.ec2.internal\" DevicePath \"\"" Jul 11 03:12:32.166869 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:32.166816 2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7583a6a9-23c6-4e26-9c3f-180abd47fe6f-bundle\") on node \"ip-10-0-141-141.ec2.internal\" DevicePath \"\"" Jul 11 03:12:32.166869 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:32.166825 2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7583a6a9-23c6-4e26-9c3f-180abd47fe6f-util\") on node \"ip-10-0-141-141.ec2.internal\" DevicePath \"\"" Jul 11 03:12:32.844488 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:32.844452 2559 generic.go:356] "Generic (PLEG): container finished" podID="0d799ed7-e4cb-4d50-b6a6-77ae1dba8fba" containerID="ba6ffff44cf145ff4098744ef214504b4b908d6589b82fdda14c823aa739da7f" exitCode=0 Jul 11 03:12:32.844921 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:32.844538 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7342kbc" event={"ID":"0d799ed7-e4cb-4d50-b6a6-77ae1dba8fba","Type":"ContainerDied","Data":"ba6ffff44cf145ff4098744ef214504b4b908d6589b82fdda14c823aa739da7f"} Jul 11 03:12:32.846304 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:32.846283 2559 generic.go:356] "Generic (PLEG): container finished" podID="0419b137-a8a6-4b40-842b-946847959ed0" containerID="20a1b1d7bc0e1f41aa1856d241391989a6309b3c013f5a9f1ca2096901262e5f" exitCode=0 Jul 11 03:12:32.846428 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:32.846359 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cjsr5" event={"ID":"0419b137-a8a6-4b40-842b-946847959ed0","Type":"ContainerDied","Data":"20a1b1d7bc0e1f41aa1856d241391989a6309b3c013f5a9f1ca2096901262e5f"} Jul 11 03:12:32.848110 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:32.848091 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fvkg4" Jul 11 03:12:32.848203 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:32.848113 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fvkg4" event={"ID":"7583a6a9-23c6-4e26-9c3f-180abd47fe6f","Type":"ContainerDied","Data":"c33a70769508220b7c96dca7f71f3e9a45b086c5048d307c818626bb43ccec85"} Jul 11 03:12:32.848203 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:32.848148 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c33a70769508220b7c96dca7f71f3e9a45b086c5048d307c818626bb43ccec85" Jul 11 03:12:32.983429 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:32.983404 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t66nr" Jul 11 03:12:33.075158 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:33.075124 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wvtmf\" (UniqueName: \"kubernetes.io/projected/4606cc70-243f-4873-908e-0ab132049f4e-kube-api-access-wvtmf\") pod \"4606cc70-243f-4873-908e-0ab132049f4e\" (UID: \"4606cc70-243f-4873-908e-0ab132049f4e\") " Jul 11 03:12:33.075359 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:33.075190 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4606cc70-243f-4873-908e-0ab132049f4e-bundle\") pod \"4606cc70-243f-4873-908e-0ab132049f4e\" (UID: \"4606cc70-243f-4873-908e-0ab132049f4e\") " Jul 11 03:12:33.075359 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:33.075221 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4606cc70-243f-4873-908e-0ab132049f4e-util\") pod \"4606cc70-243f-4873-908e-0ab132049f4e\" (UID: \"4606cc70-243f-4873-908e-0ab132049f4e\") " Jul 11 03:12:33.075816 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:33.075781 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4606cc70-243f-4873-908e-0ab132049f4e-bundle" (OuterVolumeSpecName: "bundle") pod "4606cc70-243f-4873-908e-0ab132049f4e" (UID: "4606cc70-243f-4873-908e-0ab132049f4e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 11 03:12:33.077570 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:33.077542 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4606cc70-243f-4873-908e-0ab132049f4e-kube-api-access-wvtmf" (OuterVolumeSpecName: "kube-api-access-wvtmf") pod "4606cc70-243f-4873-908e-0ab132049f4e" (UID: "4606cc70-243f-4873-908e-0ab132049f4e"). InnerVolumeSpecName "kube-api-access-wvtmf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 11 03:12:33.080628 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:33.080608 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4606cc70-243f-4873-908e-0ab132049f4e-util" (OuterVolumeSpecName: "util") pod "4606cc70-243f-4873-908e-0ab132049f4e" (UID: "4606cc70-243f-4873-908e-0ab132049f4e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 11 03:12:33.176240 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:33.176138 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wvtmf\" (UniqueName: \"kubernetes.io/projected/4606cc70-243f-4873-908e-0ab132049f4e-kube-api-access-wvtmf\") on node \"ip-10-0-141-141.ec2.internal\" DevicePath \"\"" Jul 11 03:12:33.176240 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:33.176183 2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4606cc70-243f-4873-908e-0ab132049f4e-bundle\") on node \"ip-10-0-141-141.ec2.internal\" DevicePath \"\"" Jul 11 03:12:33.176240 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:33.176192 2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4606cc70-243f-4873-908e-0ab132049f4e-util\") on node \"ip-10-0-141-141.ec2.internal\" DevicePath \"\"" Jul 11 03:12:33.854177 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:33.854148 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t66nr" Jul 11 03:12:33.854177 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:33.854165 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t66nr" event={"ID":"4606cc70-243f-4873-908e-0ab132049f4e","Type":"ContainerDied","Data":"908dad34eb157c7f61e0c6e660555305f3014af6adb68f5e8e9193b2273329b8"} Jul 11 03:12:33.854603 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:33.854209 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="908dad34eb157c7f61e0c6e660555305f3014af6adb68f5e8e9193b2273329b8" Jul 11 03:12:33.990712 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:33.990686 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cjsr5" Jul 11 03:12:34.050635 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:34.050612 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7342kbc" Jul 11 03:12:34.084106 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:34.084075 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0d799ed7-e4cb-4d50-b6a6-77ae1dba8fba-util\") pod \"0d799ed7-e4cb-4d50-b6a6-77ae1dba8fba\" (UID: \"0d799ed7-e4cb-4d50-b6a6-77ae1dba8fba\") " Jul 11 03:12:34.084106 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:34.084111 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jstxw\" (UniqueName: \"kubernetes.io/projected/0d799ed7-e4cb-4d50-b6a6-77ae1dba8fba-kube-api-access-jstxw\") pod \"0d799ed7-e4cb-4d50-b6a6-77ae1dba8fba\" (UID: \"0d799ed7-e4cb-4d50-b6a6-77ae1dba8fba\") " Jul 11 03:12:34.084352 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:34.084136 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0d799ed7-e4cb-4d50-b6a6-77ae1dba8fba-bundle\") pod \"0d799ed7-e4cb-4d50-b6a6-77ae1dba8fba\" (UID: \"0d799ed7-e4cb-4d50-b6a6-77ae1dba8fba\") " Jul 11 03:12:34.084352 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:34.084190 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0419b137-a8a6-4b40-842b-946847959ed0-util\") pod \"0419b137-a8a6-4b40-842b-946847959ed0\" (UID: \"0419b137-a8a6-4b40-842b-946847959ed0\") " Jul 11 03:12:34.084352 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:34.084215 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0419b137-a8a6-4b40-842b-946847959ed0-bundle\") pod \"0419b137-a8a6-4b40-842b-946847959ed0\" (UID: \"0419b137-a8a6-4b40-842b-946847959ed0\") " Jul 11 03:12:34.084352 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:34.084275 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4twjd\" (UniqueName: \"kubernetes.io/projected/0419b137-a8a6-4b40-842b-946847959ed0-kube-api-access-4twjd\") pod \"0419b137-a8a6-4b40-842b-946847959ed0\" (UID: \"0419b137-a8a6-4b40-842b-946847959ed0\") " Jul 11 03:12:34.084995 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:34.084899 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0419b137-a8a6-4b40-842b-946847959ed0-bundle" (OuterVolumeSpecName: "bundle") pod "0419b137-a8a6-4b40-842b-946847959ed0" (UID: "0419b137-a8a6-4b40-842b-946847959ed0"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 11 03:12:34.084995 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:34.084906 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d799ed7-e4cb-4d50-b6a6-77ae1dba8fba-bundle" (OuterVolumeSpecName: "bundle") pod "0d799ed7-e4cb-4d50-b6a6-77ae1dba8fba" (UID: "0d799ed7-e4cb-4d50-b6a6-77ae1dba8fba"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 11 03:12:34.086787 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:34.086760 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d799ed7-e4cb-4d50-b6a6-77ae1dba8fba-kube-api-access-jstxw" (OuterVolumeSpecName: "kube-api-access-jstxw") pod "0d799ed7-e4cb-4d50-b6a6-77ae1dba8fba" (UID: "0d799ed7-e4cb-4d50-b6a6-77ae1dba8fba"). InnerVolumeSpecName "kube-api-access-jstxw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 11 03:12:34.086890 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:34.086870 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0419b137-a8a6-4b40-842b-946847959ed0-kube-api-access-4twjd" (OuterVolumeSpecName: "kube-api-access-4twjd") pod "0419b137-a8a6-4b40-842b-946847959ed0" (UID: "0419b137-a8a6-4b40-842b-946847959ed0"). InnerVolumeSpecName "kube-api-access-4twjd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 11 03:12:34.091083 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:34.091061 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d799ed7-e4cb-4d50-b6a6-77ae1dba8fba-util" (OuterVolumeSpecName: "util") pod "0d799ed7-e4cb-4d50-b6a6-77ae1dba8fba" (UID: "0d799ed7-e4cb-4d50-b6a6-77ae1dba8fba"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 11 03:12:34.091269 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:34.091248 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0419b137-a8a6-4b40-842b-946847959ed0-util" (OuterVolumeSpecName: "util") pod "0419b137-a8a6-4b40-842b-946847959ed0" (UID: "0419b137-a8a6-4b40-842b-946847959ed0"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 11 03:12:34.185055 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:34.184945 2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0419b137-a8a6-4b40-842b-946847959ed0-util\") on node \"ip-10-0-141-141.ec2.internal\" DevicePath \"\"" Jul 11 03:12:34.185055 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:34.184992 2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0419b137-a8a6-4b40-842b-946847959ed0-bundle\") on node \"ip-10-0-141-141.ec2.internal\" DevicePath \"\"" Jul 11 03:12:34.185055 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:34.185002 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4twjd\" (UniqueName: \"kubernetes.io/projected/0419b137-a8a6-4b40-842b-946847959ed0-kube-api-access-4twjd\") on node \"ip-10-0-141-141.ec2.internal\" DevicePath \"\"" Jul 11 03:12:34.185055 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:34.185035 2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0d799ed7-e4cb-4d50-b6a6-77ae1dba8fba-util\") on node \"ip-10-0-141-141.ec2.internal\" DevicePath \"\"" Jul 11 03:12:34.185055 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:34.185047 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jstxw\" (UniqueName: \"kubernetes.io/projected/0d799ed7-e4cb-4d50-b6a6-77ae1dba8fba-kube-api-access-jstxw\") on node \"ip-10-0-141-141.ec2.internal\" DevicePath \"\"" Jul 11 03:12:34.185055 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:34.185055 2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0d799ed7-e4cb-4d50-b6a6-77ae1dba8fba-bundle\") on node \"ip-10-0-141-141.ec2.internal\" DevicePath \"\"" Jul 11 03:12:34.860702 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:34.860671 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7342kbc" Jul 11 03:12:34.861091 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:34.860663 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7342kbc" event={"ID":"0d799ed7-e4cb-4d50-b6a6-77ae1dba8fba","Type":"ContainerDied","Data":"2c1df2398872ef58d1a05afea2bc80feb98b19db369a798f10e196168204c9b6"} Jul 11 03:12:34.861091 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:34.860788 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2c1df2398872ef58d1a05afea2bc80feb98b19db369a798f10e196168204c9b6" Jul 11 03:12:34.862732 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:34.862706 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cjsr5" event={"ID":"0419b137-a8a6-4b40-842b-946847959ed0","Type":"ContainerDied","Data":"a136f9be2fd8c1b9cec61ae49280b8d3be185f1f9e62f5dd8be3c5a2da7d4a38"} Jul 11 03:12:34.862855 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:34.862732 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cjsr5" Jul 11 03:12:34.862855 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:34.862748 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a136f9be2fd8c1b9cec61ae49280b8d3be185f1f9e62f5dd8be3c5a2da7d4a38" Jul 11 03:12:39.606685 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:39.604185 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-5b7pq"] Jul 11 03:12:39.606685 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:39.604815 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d799ed7-e4cb-4d50-b6a6-77ae1dba8fba" containerName="pull" Jul 11 03:12:39.606685 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:39.604841 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d799ed7-e4cb-4d50-b6a6-77ae1dba8fba" containerName="pull" Jul 11 03:12:39.606685 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:39.604857 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d799ed7-e4cb-4d50-b6a6-77ae1dba8fba" containerName="util" Jul 11 03:12:39.606685 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:39.604866 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d799ed7-e4cb-4d50-b6a6-77ae1dba8fba" containerName="util" Jul 11 03:12:39.606685 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:39.604875 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d799ed7-e4cb-4d50-b6a6-77ae1dba8fba" containerName="extract" Jul 11 03:12:39.606685 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:39.604884 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d799ed7-e4cb-4d50-b6a6-77ae1dba8fba" containerName="extract" Jul 11 03:12:39.606685 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:39.604906 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0419b137-a8a6-4b40-842b-946847959ed0" containerName="util" Jul 11 03:12:39.606685 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:39.604914 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="0419b137-a8a6-4b40-842b-946847959ed0" containerName="util" Jul 11 03:12:39.606685 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:39.604933 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7583a6a9-23c6-4e26-9c3f-180abd47fe6f" containerName="util" Jul 11 03:12:39.606685 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:39.604940 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="7583a6a9-23c6-4e26-9c3f-180abd47fe6f" containerName="util" Jul 11 03:12:39.606685 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:39.604949 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0419b137-a8a6-4b40-842b-946847959ed0" containerName="extract" Jul 11 03:12:39.606685 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:39.604986 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="0419b137-a8a6-4b40-842b-946847959ed0" containerName="extract" Jul 11 03:12:39.606685 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:39.605005 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4606cc70-243f-4873-908e-0ab132049f4e" containerName="util" Jul 11 03:12:39.606685 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:39.605013 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="4606cc70-243f-4873-908e-0ab132049f4e" containerName="util" Jul 11 03:12:39.606685 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:39.605024 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4606cc70-243f-4873-908e-0ab132049f4e" containerName="extract" Jul 11 03:12:39.606685 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:39.605031 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="4606cc70-243f-4873-908e-0ab132049f4e" containerName="extract" Jul 11 03:12:39.606685 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:39.605039 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0419b137-a8a6-4b40-842b-946847959ed0" containerName="pull" Jul 11 03:12:39.606685 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:39.605047 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="0419b137-a8a6-4b40-842b-946847959ed0" containerName="pull" Jul 11 03:12:39.606685 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:39.605065 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7583a6a9-23c6-4e26-9c3f-180abd47fe6f" containerName="pull" Jul 11 03:12:39.606685 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:39.605073 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="7583a6a9-23c6-4e26-9c3f-180abd47fe6f" containerName="pull" Jul 11 03:12:39.606685 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:39.605083 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4606cc70-243f-4873-908e-0ab132049f4e" containerName="pull" Jul 11 03:12:39.606685 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:39.605091 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="4606cc70-243f-4873-908e-0ab132049f4e" containerName="pull" Jul 11 03:12:39.606685 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:39.605108 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7583a6a9-23c6-4e26-9c3f-180abd47fe6f" containerName="extract" Jul 11 03:12:39.606685 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:39.605116 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="7583a6a9-23c6-4e26-9c3f-180abd47fe6f" containerName="extract" Jul 11 03:12:39.606685 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:39.605267 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="4606cc70-243f-4873-908e-0ab132049f4e" containerName="extract" Jul 11 03:12:39.606685 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:39.605281 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="7583a6a9-23c6-4e26-9c3f-180abd47fe6f" containerName="extract" Jul 11 03:12:39.606685 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:39.605292 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="0d799ed7-e4cb-4d50-b6a6-77ae1dba8fba" containerName="extract" Jul 11 03:12:39.606685 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:39.605302 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="0419b137-a8a6-4b40-842b-946847959ed0" containerName="extract" Jul 11 03:12:39.610351 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:39.610325 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-5b7pq" Jul 11 03:12:39.613389 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:39.613367 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-9cs9r\"" Jul 11 03:12:39.621131 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:39.621107 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-5b7pq"] Jul 11 03:12:39.626518 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:39.626491 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lrj2r\" (UniqueName: \"kubernetes.io/projected/91ed20fb-eb56-47eb-bb79-68ff9ce421b8-kube-api-access-lrj2r\") pod \"authorino-operator-75cc8d5cb7-5b7pq\" (UID: \"91ed20fb-eb56-47eb-bb79-68ff9ce421b8\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-5b7pq" Jul 11 03:12:39.727320 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:39.727272 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lrj2r\" (UniqueName: \"kubernetes.io/projected/91ed20fb-eb56-47eb-bb79-68ff9ce421b8-kube-api-access-lrj2r\") pod \"authorino-operator-75cc8d5cb7-5b7pq\" (UID: \"91ed20fb-eb56-47eb-bb79-68ff9ce421b8\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-5b7pq" Jul 11 03:12:39.743605 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:39.743572 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lrj2r\" (UniqueName: \"kubernetes.io/projected/91ed20fb-eb56-47eb-bb79-68ff9ce421b8-kube-api-access-lrj2r\") pod \"authorino-operator-75cc8d5cb7-5b7pq\" (UID: \"91ed20fb-eb56-47eb-bb79-68ff9ce421b8\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-5b7pq" Jul 11 03:12:39.920898 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:39.920809 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-5b7pq" Jul 11 03:12:40.060593 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:40.060570 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-5b7pq"] Jul 11 03:12:40.062770 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:12:40.062737 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91ed20fb_eb56_47eb_bb79_68ff9ce421b8.slice/crio-b34f53a6d39d6180ab6e55ac82290939ed1fea9edf502df199613f5c5a44de3a WatchSource:0}: Error finding container b34f53a6d39d6180ab6e55ac82290939ed1fea9edf502df199613f5c5a44de3a: Status 404 returned error can't find the container with id b34f53a6d39d6180ab6e55ac82290939ed1fea9edf502df199613f5c5a44de3a Jul 11 03:12:40.894679 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:40.894593 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-5b7pq" event={"ID":"91ed20fb-eb56-47eb-bb79-68ff9ce421b8","Type":"ContainerStarted","Data":"b34f53a6d39d6180ab6e55ac82290939ed1fea9edf502df199613f5c5a44de3a"} Jul 11 03:12:42.397857 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:42.397820 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-fm2pp"] Jul 11 03:12:42.401088 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:42.401068 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-fm2pp" Jul 11 03:12:42.403578 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:42.403555 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jul 11 03:12:42.403678 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:42.403637 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-qlvn5\"" Jul 11 03:12:42.418122 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:42.418095 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-fm2pp"] Jul 11 03:12:42.452905 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:42.452874 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqrbw\" (UniqueName: \"kubernetes.io/projected/17c60af8-bbf8-450f-8214-97db2a3cb84f-kube-api-access-lqrbw\") pod \"dns-operator-controller-manager-864dd78c4c-fm2pp\" (UID: \"17c60af8-bbf8-450f-8214-97db2a3cb84f\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-fm2pp" Jul 11 03:12:42.554250 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:42.554216 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lqrbw\" (UniqueName: \"kubernetes.io/projected/17c60af8-bbf8-450f-8214-97db2a3cb84f-kube-api-access-lqrbw\") pod \"dns-operator-controller-manager-864dd78c4c-fm2pp\" (UID: \"17c60af8-bbf8-450f-8214-97db2a3cb84f\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-fm2pp" Jul 11 03:12:42.564511 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:42.564474 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqrbw\" (UniqueName: \"kubernetes.io/projected/17c60af8-bbf8-450f-8214-97db2a3cb84f-kube-api-access-lqrbw\") pod \"dns-operator-controller-manager-864dd78c4c-fm2pp\" (UID: \"17c60af8-bbf8-450f-8214-97db2a3cb84f\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-fm2pp" Jul 11 03:12:42.710745 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:42.710714 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-fm2pp" Jul 11 03:12:42.846320 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:42.846296 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-fm2pp"] Jul 11 03:12:42.848504 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:12:42.848476 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17c60af8_bbf8_450f_8214_97db2a3cb84f.slice/crio-9a1341417ecffc4c4530d62428535ce3ab05b4ead579b6a75ef78e6750804c7c WatchSource:0}: Error finding container 9a1341417ecffc4c4530d62428535ce3ab05b4ead579b6a75ef78e6750804c7c: Status 404 returned error can't find the container with id 9a1341417ecffc4c4530d62428535ce3ab05b4ead579b6a75ef78e6750804c7c Jul 11 03:12:42.907788 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:42.907738 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-5b7pq" event={"ID":"91ed20fb-eb56-47eb-bb79-68ff9ce421b8","Type":"ContainerStarted","Data":"7cea1b0596df11f04932d18c79f2cbc12b7cec904d3ac580e9ee416cc1a84afc"} Jul 11 03:12:42.908011 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:42.907924 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-5b7pq" Jul 11 03:12:42.909132 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:42.909108 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-fm2pp" event={"ID":"17c60af8-bbf8-450f-8214-97db2a3cb84f","Type":"ContainerStarted","Data":"9a1341417ecffc4c4530d62428535ce3ab05b4ead579b6a75ef78e6750804c7c"} Jul 11 03:12:42.927194 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:42.927146 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-5b7pq" podStartSLOduration=1.746161575 podStartE2EDuration="3.92713064s" totalImagesPullingTime="2.180969065s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:12:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:12:42.92546326 +0000 UTC m=+586.894075724" watchObservedRunningTime="2026-07-11 03:12:42.92713064 +0000 UTC m=+586.895743092" Jul 11 03:12:45.928443 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:45.928402 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-fm2pp" event={"ID":"17c60af8-bbf8-450f-8214-97db2a3cb84f","Type":"ContainerStarted","Data":"5c95305f9f1a1942d27034a8cf886bbb9879e3a702298c37ac38174fdbe3d54e"} Jul 11 03:12:45.928905 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:45.928571 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-fm2pp" Jul 11 03:12:45.949063 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:45.949010 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-fm2pp" podStartSLOduration=1.602970316 podStartE2EDuration="3.948994314s" totalImagesPullingTime="2.346023998s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:12:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:12:45.947630419 +0000 UTC m=+589.916242871" watchObservedRunningTime="2026-07-11 03:12:45.948994314 +0000 UTC m=+589.917606764" Jul 11 03:12:46.212774 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:46.212689 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6ndp9"] Jul 11 03:12:46.245692 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:46.245642 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6ndp9"] Jul 11 03:12:46.245843 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:46.245778 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6ndp9" Jul 11 03:12:46.249686 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:46.249651 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-w2w92\"" Jul 11 03:12:46.288439 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:46.288408 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bndqj\" (UniqueName: \"kubernetes.io/projected/9b5246b1-622f-45eb-9415-3cd24733eede-kube-api-access-bndqj\") pod \"kuadrant-operator-controller-manager-8684c9ff49-6ndp9\" (UID: \"9b5246b1-622f-45eb-9415-3cd24733eede\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6ndp9" Jul 11 03:12:46.288610 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:46.288446 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9b5246b1-622f-45eb-9415-3cd24733eede-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-6ndp9\" (UID: \"9b5246b1-622f-45eb-9415-3cd24733eede\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6ndp9" Jul 11 03:12:46.389032 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:46.388990 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bndqj\" (UniqueName: \"kubernetes.io/projected/9b5246b1-622f-45eb-9415-3cd24733eede-kube-api-access-bndqj\") pod \"kuadrant-operator-controller-manager-8684c9ff49-6ndp9\" (UID: \"9b5246b1-622f-45eb-9415-3cd24733eede\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6ndp9" Jul 11 03:12:46.389032 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:46.389036 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9b5246b1-622f-45eb-9415-3cd24733eede-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-6ndp9\" (UID: \"9b5246b1-622f-45eb-9415-3cd24733eede\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6ndp9" Jul 11 03:12:46.389399 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:46.389382 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9b5246b1-622f-45eb-9415-3cd24733eede-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-6ndp9\" (UID: \"9b5246b1-622f-45eb-9415-3cd24733eede\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6ndp9" Jul 11 03:12:46.397509 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:46.397481 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bndqj\" (UniqueName: \"kubernetes.io/projected/9b5246b1-622f-45eb-9415-3cd24733eede-kube-api-access-bndqj\") pod \"kuadrant-operator-controller-manager-8684c9ff49-6ndp9\" (UID: \"9b5246b1-622f-45eb-9415-3cd24733eede\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6ndp9" Jul 11 03:12:46.556614 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:46.556575 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6ndp9" Jul 11 03:12:46.697924 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:46.697884 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6ndp9"] Jul 11 03:12:46.700907 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:12:46.700875 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b5246b1_622f_45eb_9415_3cd24733eede.slice/crio-6a3e0bb6260ab70e7ec8b887c9cb5a53e4d7429bf524b825f2605aaa2e0d377b WatchSource:0}: Error finding container 6a3e0bb6260ab70e7ec8b887c9cb5a53e4d7429bf524b825f2605aaa2e0d377b: Status 404 returned error can't find the container with id 6a3e0bb6260ab70e7ec8b887c9cb5a53e4d7429bf524b825f2605aaa2e0d377b Jul 11 03:12:46.934678 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:46.934575 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6ndp9" event={"ID":"9b5246b1-622f-45eb-9415-3cd24733eede","Type":"ContainerStarted","Data":"6a3e0bb6260ab70e7ec8b887c9cb5a53e4d7429bf524b825f2605aaa2e0d377b"} Jul 11 03:12:48.213141 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:48.213107 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jswhw"] Jul 11 03:12:48.215572 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:48.215550 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jswhw" Jul 11 03:12:48.218107 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:48.218081 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-qrcrz\"" Jul 11 03:12:48.230576 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:48.230522 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jswhw"] Jul 11 03:12:48.306869 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:48.306830 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-972lb\" (UniqueName: \"kubernetes.io/projected/eccac946-34aa-49ea-ae48-3035b5640a0e-kube-api-access-972lb\") pod \"limitador-operator-controller-manager-859d7b78bd-jswhw\" (UID: \"eccac946-34aa-49ea-ae48-3035b5640a0e\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jswhw" Jul 11 03:12:48.407297 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:48.407250 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-972lb\" (UniqueName: \"kubernetes.io/projected/eccac946-34aa-49ea-ae48-3035b5640a0e-kube-api-access-972lb\") pod \"limitador-operator-controller-manager-859d7b78bd-jswhw\" (UID: \"eccac946-34aa-49ea-ae48-3035b5640a0e\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jswhw" Jul 11 03:12:48.416614 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:48.416585 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-972lb\" (UniqueName: \"kubernetes.io/projected/eccac946-34aa-49ea-ae48-3035b5640a0e-kube-api-access-972lb\") pod \"limitador-operator-controller-manager-859d7b78bd-jswhw\" (UID: \"eccac946-34aa-49ea-ae48-3035b5640a0e\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jswhw" Jul 11 03:12:48.526687 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:48.526638 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jswhw" Jul 11 03:12:48.676466 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:48.676441 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jswhw"] Jul 11 03:12:48.678317 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:12:48.678290 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeccac946_34aa_49ea_ae48_3035b5640a0e.slice/crio-c57933e371e8e1917d520206bd0944e2a6380f4efa8c8f97dec2d2a534ed355a WatchSource:0}: Error finding container c57933e371e8e1917d520206bd0944e2a6380f4efa8c8f97dec2d2a534ed355a: Status 404 returned error can't find the container with id c57933e371e8e1917d520206bd0944e2a6380f4efa8c8f97dec2d2a534ed355a Jul 11 03:12:48.947335 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:48.947243 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jswhw" event={"ID":"eccac946-34aa-49ea-ae48-3035b5640a0e","Type":"ContainerStarted","Data":"c57933e371e8e1917d520206bd0944e2a6380f4efa8c8f97dec2d2a534ed355a"} Jul 11 03:12:50.960027 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:50.959987 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jswhw" event={"ID":"eccac946-34aa-49ea-ae48-3035b5640a0e","Type":"ContainerStarted","Data":"23610d18d52c8324c990c35e60dc6501af7405cca0dacd86efc409331764cc89"} Jul 11 03:12:50.960401 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:50.960055 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jswhw" Jul 11 03:12:50.977680 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:50.977620 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jswhw" podStartSLOduration=1.323292447 podStartE2EDuration="2.977601458s" totalImagesPullingTime="1.654309011s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:12:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:12:50.975662799 +0000 UTC m=+594.944275263" watchObservedRunningTime="2026-07-11 03:12:50.977601458 +0000 UTC m=+594.946213909" Jul 11 03:12:53.918785 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:53.918751 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-5b7pq" Jul 11 03:12:53.979213 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:53.979164 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6ndp9" event={"ID":"9b5246b1-622f-45eb-9415-3cd24733eede","Type":"ContainerStarted","Data":"daa6beed4408d7c7a37478ef881ece8099432cbdfd02672e87ec4efee5cab39c"} Jul 11 03:12:53.979401 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:53.979346 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6ndp9" Jul 11 03:12:53.997187 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:53.997134 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6ndp9" podStartSLOduration=1.181383465 podStartE2EDuration="7.997118139s" totalImagesPullingTime="6.815734674s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:12:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:12:53.995054881 +0000 UTC m=+597.963667336" watchObservedRunningTime="2026-07-11 03:12:53.997118139 +0000 UTC m=+597.965730589" Jul 11 03:12:56.483254 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:56.483146 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hb24z_4287b506-42a9-4b1d-85e8-91008605fd2c/ovn-acl-logging/0.log" Jul 11 03:12:56.483936 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:56.483913 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hb24z_4287b506-42a9-4b1d-85e8-91008605fd2c/ovn-acl-logging/0.log" Jul 11 03:12:56.937192 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:56.937158 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-fm2pp" Jul 11 03:12:57.328566 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:57.328524 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-69b94ddfdb-244hl"] Jul 11 03:12:57.330819 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:57.330797 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69b94ddfdb-244hl" Jul 11 03:12:57.333684 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:57.333659 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 11 03:12:57.333816 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:57.333659 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 11 03:12:57.333898 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:57.333881 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 11 03:12:57.333988 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:57.333952 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 11 03:12:57.334058 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:57.333991 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 11 03:12:57.334101 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:57.334090 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-g2w8p\"" Jul 11 03:12:57.334987 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:57.334939 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 11 03:12:57.335088 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:57.334997 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 11 03:12:57.338570 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:57.338549 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 11 03:12:57.344253 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:57.344181 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-69b94ddfdb-244hl"] Jul 11 03:12:57.384508 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:57.384464 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xcww9\" (UniqueName: \"kubernetes.io/projected/96c09329-e5bf-42c9-b6e5-fd188bf949eb-kube-api-access-xcww9\") pod \"console-69b94ddfdb-244hl\" (UID: \"96c09329-e5bf-42c9-b6e5-fd188bf949eb\") " pod="openshift-console/console-69b94ddfdb-244hl" Jul 11 03:12:57.384708 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:57.384524 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/96c09329-e5bf-42c9-b6e5-fd188bf949eb-console-config\") pod \"console-69b94ddfdb-244hl\" (UID: \"96c09329-e5bf-42c9-b6e5-fd188bf949eb\") " pod="openshift-console/console-69b94ddfdb-244hl" Jul 11 03:12:57.384708 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:57.384573 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/96c09329-e5bf-42c9-b6e5-fd188bf949eb-console-oauth-config\") pod \"console-69b94ddfdb-244hl\" (UID: \"96c09329-e5bf-42c9-b6e5-fd188bf949eb\") " pod="openshift-console/console-69b94ddfdb-244hl" Jul 11 03:12:57.384708 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:57.384616 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/96c09329-e5bf-42c9-b6e5-fd188bf949eb-console-serving-cert\") pod \"console-69b94ddfdb-244hl\" (UID: \"96c09329-e5bf-42c9-b6e5-fd188bf949eb\") " pod="openshift-console/console-69b94ddfdb-244hl" Jul 11 03:12:57.384708 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:57.384638 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/96c09329-e5bf-42c9-b6e5-fd188bf949eb-service-ca\") pod \"console-69b94ddfdb-244hl\" (UID: \"96c09329-e5bf-42c9-b6e5-fd188bf949eb\") " pod="openshift-console/console-69b94ddfdb-244hl" Jul 11 03:12:57.384850 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:57.384704 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/96c09329-e5bf-42c9-b6e5-fd188bf949eb-oauth-serving-cert\") pod \"console-69b94ddfdb-244hl\" (UID: \"96c09329-e5bf-42c9-b6e5-fd188bf949eb\") " pod="openshift-console/console-69b94ddfdb-244hl" Jul 11 03:12:57.384850 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:57.384745 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96c09329-e5bf-42c9-b6e5-fd188bf949eb-trusted-ca-bundle\") pod \"console-69b94ddfdb-244hl\" (UID: \"96c09329-e5bf-42c9-b6e5-fd188bf949eb\") " pod="openshift-console/console-69b94ddfdb-244hl" Jul 11 03:12:57.486111 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:57.486067 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/96c09329-e5bf-42c9-b6e5-fd188bf949eb-console-config\") pod \"console-69b94ddfdb-244hl\" (UID: \"96c09329-e5bf-42c9-b6e5-fd188bf949eb\") " pod="openshift-console/console-69b94ddfdb-244hl" Jul 11 03:12:57.486111 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:57.486117 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/96c09329-e5bf-42c9-b6e5-fd188bf949eb-console-oauth-config\") pod \"console-69b94ddfdb-244hl\" (UID: \"96c09329-e5bf-42c9-b6e5-fd188bf949eb\") " pod="openshift-console/console-69b94ddfdb-244hl" Jul 11 03:12:57.486600 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:57.486148 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/96c09329-e5bf-42c9-b6e5-fd188bf949eb-console-serving-cert\") pod \"console-69b94ddfdb-244hl\" (UID: \"96c09329-e5bf-42c9-b6e5-fd188bf949eb\") " pod="openshift-console/console-69b94ddfdb-244hl" Jul 11 03:12:57.486600 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:57.486164 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/96c09329-e5bf-42c9-b6e5-fd188bf949eb-service-ca\") pod \"console-69b94ddfdb-244hl\" (UID: \"96c09329-e5bf-42c9-b6e5-fd188bf949eb\") " pod="openshift-console/console-69b94ddfdb-244hl" Jul 11 03:12:57.486600 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:57.486198 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/96c09329-e5bf-42c9-b6e5-fd188bf949eb-oauth-serving-cert\") pod \"console-69b94ddfdb-244hl\" (UID: \"96c09329-e5bf-42c9-b6e5-fd188bf949eb\") " pod="openshift-console/console-69b94ddfdb-244hl" Jul 11 03:12:57.486600 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:57.486224 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96c09329-e5bf-42c9-b6e5-fd188bf949eb-trusted-ca-bundle\") pod \"console-69b94ddfdb-244hl\" (UID: \"96c09329-e5bf-42c9-b6e5-fd188bf949eb\") " pod="openshift-console/console-69b94ddfdb-244hl" Jul 11 03:12:57.486600 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:57.486257 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xcww9\" (UniqueName: \"kubernetes.io/projected/96c09329-e5bf-42c9-b6e5-fd188bf949eb-kube-api-access-xcww9\") pod \"console-69b94ddfdb-244hl\" (UID: \"96c09329-e5bf-42c9-b6e5-fd188bf949eb\") " pod="openshift-console/console-69b94ddfdb-244hl" Jul 11 03:12:57.487019 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:57.486991 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/96c09329-e5bf-42c9-b6e5-fd188bf949eb-console-config\") pod \"console-69b94ddfdb-244hl\" (UID: \"96c09329-e5bf-42c9-b6e5-fd188bf949eb\") " pod="openshift-console/console-69b94ddfdb-244hl" Jul 11 03:12:57.487079 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:57.486991 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/96c09329-e5bf-42c9-b6e5-fd188bf949eb-oauth-serving-cert\") pod \"console-69b94ddfdb-244hl\" (UID: \"96c09329-e5bf-42c9-b6e5-fd188bf949eb\") " pod="openshift-console/console-69b94ddfdb-244hl" Jul 11 03:12:57.487253 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:57.487230 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/96c09329-e5bf-42c9-b6e5-fd188bf949eb-service-ca\") pod \"console-69b94ddfdb-244hl\" (UID: \"96c09329-e5bf-42c9-b6e5-fd188bf949eb\") " pod="openshift-console/console-69b94ddfdb-244hl" Jul 11 03:12:57.487410 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:57.487389 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96c09329-e5bf-42c9-b6e5-fd188bf949eb-trusted-ca-bundle\") pod \"console-69b94ddfdb-244hl\" (UID: \"96c09329-e5bf-42c9-b6e5-fd188bf949eb\") " pod="openshift-console/console-69b94ddfdb-244hl" Jul 11 03:12:57.488944 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:57.488923 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/96c09329-e5bf-42c9-b6e5-fd188bf949eb-console-serving-cert\") pod \"console-69b94ddfdb-244hl\" (UID: \"96c09329-e5bf-42c9-b6e5-fd188bf949eb\") " pod="openshift-console/console-69b94ddfdb-244hl" Jul 11 03:12:57.488944 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:57.488940 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/96c09329-e5bf-42c9-b6e5-fd188bf949eb-console-oauth-config\") pod \"console-69b94ddfdb-244hl\" (UID: \"96c09329-e5bf-42c9-b6e5-fd188bf949eb\") " pod="openshift-console/console-69b94ddfdb-244hl" Jul 11 03:12:57.495132 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:57.495111 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xcww9\" (UniqueName: \"kubernetes.io/projected/96c09329-e5bf-42c9-b6e5-fd188bf949eb-kube-api-access-xcww9\") pod \"console-69b94ddfdb-244hl\" (UID: \"96c09329-e5bf-42c9-b6e5-fd188bf949eb\") " pod="openshift-console/console-69b94ddfdb-244hl" Jul 11 03:12:57.641469 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:57.641377 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69b94ddfdb-244hl" Jul 11 03:12:57.783355 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:57.783331 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-69b94ddfdb-244hl"] Jul 11 03:12:57.785394 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:12:57.785366 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96c09329_e5bf_42c9_b6e5_fd188bf949eb.slice/crio-22a1a9734f04ac0e281c045aa6cf946047084d8cfc3e5c10af655e132707d646 WatchSource:0}: Error finding container 22a1a9734f04ac0e281c045aa6cf946047084d8cfc3e5c10af655e132707d646: Status 404 returned error can't find the container with id 22a1a9734f04ac0e281c045aa6cf946047084d8cfc3e5c10af655e132707d646 Jul 11 03:12:58.001641 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:58.001550 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69b94ddfdb-244hl" event={"ID":"96c09329-e5bf-42c9-b6e5-fd188bf949eb","Type":"ContainerStarted","Data":"b2dcc50709fa6b5b3d3edcd11826569723582f4b307636db014da1cbf70a4e9a"} Jul 11 03:12:58.001641 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:58.001599 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69b94ddfdb-244hl" event={"ID":"96c09329-e5bf-42c9-b6e5-fd188bf949eb","Type":"ContainerStarted","Data":"22a1a9734f04ac0e281c045aa6cf946047084d8cfc3e5c10af655e132707d646"} Jul 11 03:12:58.020017 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:12:58.019945 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-69b94ddfdb-244hl" podStartSLOduration=1.019928306 podStartE2EDuration="1.019928306s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:12:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:12:58.017827923 +0000 UTC m=+601.986440397" watchObservedRunningTime="2026-07-11 03:12:58.019928306 +0000 UTC m=+601.988540756" Jul 11 03:13:01.968597 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:01.968561 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jswhw" Jul 11 03:13:04.987311 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:04.987278 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6ndp9" Jul 11 03:13:05.948189 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:05.948156 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mr2k7"] Jul 11 03:13:05.952003 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:05.951974 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mr2k7" Jul 11 03:13:05.964492 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:05.964464 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mr2k7"] Jul 11 03:13:06.061026 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:06.060984 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/94d6b57e-d578-467c-87c4-3f10728f5ec1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-mr2k7\" (UID: \"94d6b57e-d578-467c-87c4-3f10728f5ec1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mr2k7" Jul 11 03:13:06.061423 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:06.061089 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vh6rz\" (UniqueName: \"kubernetes.io/projected/94d6b57e-d578-467c-87c4-3f10728f5ec1-kube-api-access-vh6rz\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-mr2k7\" (UID: \"94d6b57e-d578-467c-87c4-3f10728f5ec1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mr2k7" Jul 11 03:13:06.162158 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:06.162105 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/94d6b57e-d578-467c-87c4-3f10728f5ec1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-mr2k7\" (UID: \"94d6b57e-d578-467c-87c4-3f10728f5ec1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mr2k7" Jul 11 03:13:06.162354 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:06.162198 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vh6rz\" (UniqueName: \"kubernetes.io/projected/94d6b57e-d578-467c-87c4-3f10728f5ec1-kube-api-access-vh6rz\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-mr2k7\" (UID: \"94d6b57e-d578-467c-87c4-3f10728f5ec1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mr2k7" Jul 11 03:13:06.162524 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:06.162504 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/94d6b57e-d578-467c-87c4-3f10728f5ec1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-mr2k7\" (UID: \"94d6b57e-d578-467c-87c4-3f10728f5ec1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mr2k7" Jul 11 03:13:06.173609 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:06.173575 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vh6rz\" (UniqueName: \"kubernetes.io/projected/94d6b57e-d578-467c-87c4-3f10728f5ec1-kube-api-access-vh6rz\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-mr2k7\" (UID: \"94d6b57e-d578-467c-87c4-3f10728f5ec1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mr2k7" Jul 11 03:13:06.263732 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:06.263641 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mr2k7" Jul 11 03:13:06.403002 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:06.402976 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mr2k7"] Jul 11 03:13:06.405330 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:13:06.405303 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94d6b57e_d578_467c_87c4_3f10728f5ec1.slice/crio-b5b98759757548343f51ebd1a64b716e6989213b489e691cd4240c227416f423 WatchSource:0}: Error finding container b5b98759757548343f51ebd1a64b716e6989213b489e691cd4240c227416f423: Status 404 returned error can't find the container with id b5b98759757548343f51ebd1a64b716e6989213b489e691cd4240c227416f423 Jul 11 03:13:06.628303 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:06.628268 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mr2k7"] Jul 11 03:13:06.636598 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:06.636555 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mr2k7"] Jul 11 03:13:06.647191 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:06.647153 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6ndp9"] Jul 11 03:13:06.647400 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:06.647373 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6ndp9" podUID="9b5246b1-622f-45eb-9415-3cd24733eede" containerName="manager" containerID="cri-o://daa6beed4408d7c7a37478ef881ece8099432cbdfd02672e87ec4efee5cab39c" gracePeriod=2 Jul 11 03:13:06.650405 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:06.650375 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-jgmts"] Jul 11 03:13:06.650898 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:06.650878 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94d6b57e-d578-467c-87c4-3f10728f5ec1" containerName="manager" Jul 11 03:13:06.650898 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:06.650899 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="94d6b57e-d578-467c-87c4-3f10728f5ec1" containerName="manager" Jul 11 03:13:06.651148 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:06.650992 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="94d6b57e-d578-467c-87c4-3f10728f5ec1" containerName="manager" Jul 11 03:13:06.653597 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:06.653573 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-jgmts" Jul 11 03:13:06.661788 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:06.661754 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6ndp9"] Jul 11 03:13:06.671256 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:13:06.671207 2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"9b5246b1-622f-45eb-9415-3cd24733eede\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-6ndp9\": pods \"kuadrant-operator-controller-manager-8684c9ff49-6ndp9\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6ndp9" Jul 11 03:13:06.672423 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:06.672395 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-jgmts"] Jul 11 03:13:06.682408 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:06.682370 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9fdv8"] Jul 11 03:13:06.682881 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:06.682860 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b5246b1-622f-45eb-9415-3cd24733eede" containerName="manager" Jul 11 03:13:06.682881 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:06.682882 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b5246b1-622f-45eb-9415-3cd24733eede" containerName="manager" Jul 11 03:13:06.683211 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:06.683126 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="9b5246b1-622f-45eb-9415-3cd24733eede" containerName="manager" Jul 11 03:13:06.685097 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:06.685076 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jswhw"] Jul 11 03:13:06.685209 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:06.685180 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9fdv8" Jul 11 03:13:06.685290 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:06.685266 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jswhw" podUID="eccac946-34aa-49ea-ae48-3035b5640a0e" containerName="manager" containerID="cri-o://23610d18d52c8324c990c35e60dc6501af7405cca0dacd86efc409331764cc89" gracePeriod=2 Jul 11 03:13:06.697098 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:06.697066 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9fdv8"] Jul 11 03:13:06.701723 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:06.701697 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jswhw"] Jul 11 03:13:06.711328 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:13:06.711259 2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-6ndp9\" is forbidden: User \"system:node:ip-10-0-141-141.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-141.ec2.internal' and this object" podUID="9b5246b1-622f-45eb-9415-3cd24733eede" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6ndp9" Jul 11 03:13:06.716176 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:13:06.716131 2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-jswhw\" is forbidden: User \"system:node:ip-10-0-141-141.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-141.ec2.internal' and this object" podUID="eccac946-34aa-49ea-ae48-3035b5640a0e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jswhw" Jul 11 03:13:06.718262 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:13:06.718230 2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-6ndp9\" is forbidden: User \"system:node:ip-10-0-141-141.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-141.ec2.internal' and this object" podUID="9b5246b1-622f-45eb-9415-3cd24733eede" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6ndp9" Jul 11 03:13:06.767793 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:06.767760 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nj4c2\" (UniqueName: \"kubernetes.io/projected/c7faf9a3-6bcf-4672-8890-74d01188f92e-kube-api-access-nj4c2\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-jgmts\" (UID: \"c7faf9a3-6bcf-4672-8890-74d01188f92e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-jgmts" Jul 11 03:13:06.767999 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:06.767803 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4cb89ac4-4b4c-4ab0-b476-5357cea0bc6f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9fdv8\" (UID: \"4cb89ac4-4b4c-4ab0-b476-5357cea0bc6f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9fdv8" Jul 11 03:13:06.767999 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:06.767829 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c7faf9a3-6bcf-4672-8890-74d01188f92e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-jgmts\" (UID: \"c7faf9a3-6bcf-4672-8890-74d01188f92e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-jgmts" Jul 11 03:13:06.767999 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:06.767912 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9l4fb\" (UniqueName: \"kubernetes.io/projected/4cb89ac4-4b4c-4ab0-b476-5357cea0bc6f-kube-api-access-9l4fb\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9fdv8\" (UID: \"4cb89ac4-4b4c-4ab0-b476-5357cea0bc6f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9fdv8" Jul 11 03:13:06.868777 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:06.868682 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9l4fb\" (UniqueName: \"kubernetes.io/projected/4cb89ac4-4b4c-4ab0-b476-5357cea0bc6f-kube-api-access-9l4fb\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9fdv8\" (UID: \"4cb89ac4-4b4c-4ab0-b476-5357cea0bc6f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9fdv8" Jul 11 03:13:06.868938 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:06.868783 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nj4c2\" (UniqueName: \"kubernetes.io/projected/c7faf9a3-6bcf-4672-8890-74d01188f92e-kube-api-access-nj4c2\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-jgmts\" (UID: \"c7faf9a3-6bcf-4672-8890-74d01188f92e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-jgmts" Jul 11 03:13:06.868938 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:06.868822 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4cb89ac4-4b4c-4ab0-b476-5357cea0bc6f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9fdv8\" (UID: \"4cb89ac4-4b4c-4ab0-b476-5357cea0bc6f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9fdv8" Jul 11 03:13:06.868938 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:06.868860 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c7faf9a3-6bcf-4672-8890-74d01188f92e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-jgmts\" (UID: \"c7faf9a3-6bcf-4672-8890-74d01188f92e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-jgmts" Jul 11 03:13:06.869376 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:06.869349 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c7faf9a3-6bcf-4672-8890-74d01188f92e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-jgmts\" (UID: \"c7faf9a3-6bcf-4672-8890-74d01188f92e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-jgmts" Jul 11 03:13:06.870190 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:06.870048 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4cb89ac4-4b4c-4ab0-b476-5357cea0bc6f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9fdv8\" (UID: \"4cb89ac4-4b4c-4ab0-b476-5357cea0bc6f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9fdv8" Jul 11 03:13:06.878302 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:06.878274 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9l4fb\" (UniqueName: \"kubernetes.io/projected/4cb89ac4-4b4c-4ab0-b476-5357cea0bc6f-kube-api-access-9l4fb\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9fdv8\" (UID: \"4cb89ac4-4b4c-4ab0-b476-5357cea0bc6f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9fdv8" Jul 11 03:13:06.878624 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:06.878281 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nj4c2\" (UniqueName: \"kubernetes.io/projected/c7faf9a3-6bcf-4672-8890-74d01188f92e-kube-api-access-nj4c2\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-jgmts\" (UID: \"c7faf9a3-6bcf-4672-8890-74d01188f92e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-jgmts" Jul 11 03:13:06.917023 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:06.916935 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6ndp9" Jul 11 03:13:06.919291 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:13:06.919249 2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-6ndp9\" is forbidden: User \"system:node:ip-10-0-141-141.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-141.ec2.internal' and this object" podUID="9b5246b1-622f-45eb-9415-3cd24733eede" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6ndp9" Jul 11 03:13:06.921128 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:13:06.921103 2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-jswhw\" is forbidden: User \"system:node:ip-10-0-141-141.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-141.ec2.internal' and this object" podUID="eccac946-34aa-49ea-ae48-3035b5640a0e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jswhw" Jul 11 03:13:06.924568 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:06.924549 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jswhw" Jul 11 03:13:06.926661 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:13:06.926636 2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-6ndp9\" is forbidden: User \"system:node:ip-10-0-141-141.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-141.ec2.internal' and this object" podUID="9b5246b1-622f-45eb-9415-3cd24733eede" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6ndp9" Jul 11 03:13:06.928445 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:13:06.928421 2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-jswhw\" is forbidden: User \"system:node:ip-10-0-141-141.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-141.ec2.internal' and this object" podUID="eccac946-34aa-49ea-ae48-3035b5640a0e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jswhw" Jul 11 03:13:07.047610 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:07.047579 2559 generic.go:356] "Generic (PLEG): container finished" podID="9b5246b1-622f-45eb-9415-3cd24733eede" containerID="daa6beed4408d7c7a37478ef881ece8099432cbdfd02672e87ec4efee5cab39c" exitCode=0 Jul 11 03:13:07.047819 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:07.047646 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6ndp9" Jul 11 03:13:07.047819 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:07.047686 2559 scope.go:117] "RemoveContainer" containerID="daa6beed4408d7c7a37478ef881ece8099432cbdfd02672e87ec4efee5cab39c" Jul 11 03:13:07.049201 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:07.049175 2559 generic.go:356] "Generic (PLEG): container finished" podID="eccac946-34aa-49ea-ae48-3035b5640a0e" containerID="23610d18d52c8324c990c35e60dc6501af7405cca0dacd86efc409331764cc89" exitCode=0 Jul 11 03:13:07.049314 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:07.049223 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jswhw" Jul 11 03:13:07.050131 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:13:07.050099 2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-jswhw\" is forbidden: User \"system:node:ip-10-0-141-141.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-141.ec2.internal' and this object" podUID="eccac946-34aa-49ea-ae48-3035b5640a0e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jswhw" Jul 11 03:13:07.051256 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:13:07.051238 2559 kuberuntime_manager.go:649] "Missing actuated resource record" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mr2k7" container="manager" Jul 11 03:13:07.052016 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:13:07.051991 2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-6ndp9\" is forbidden: User \"system:node:ip-10-0-141-141.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-141.ec2.internal' and this object" podUID="9b5246b1-622f-45eb-9415-3cd24733eede" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6ndp9" Jul 11 03:13:07.055377 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:13:07.055292 2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-6ndp9\" is forbidden: User \"system:node:ip-10-0-141-141.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-141.ec2.internal' and this object" podUID="9b5246b1-622f-45eb-9415-3cd24733eede" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6ndp9" Jul 11 03:13:07.057367 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:07.057345 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-jgmts" Jul 11 03:13:07.057533 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:13:07.057408 2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-jswhw\" is forbidden: User \"system:node:ip-10-0-141-141.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-141.ec2.internal' and this object" podUID="eccac946-34aa-49ea-ae48-3035b5640a0e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jswhw" Jul 11 03:13:07.058049 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:07.058032 2559 scope.go:117] "RemoveContainer" containerID="daa6beed4408d7c7a37478ef881ece8099432cbdfd02672e87ec4efee5cab39c" Jul 11 03:13:07.058390 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:13:07.058354 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"daa6beed4408d7c7a37478ef881ece8099432cbdfd02672e87ec4efee5cab39c\": container with ID starting with daa6beed4408d7c7a37478ef881ece8099432cbdfd02672e87ec4efee5cab39c not found: ID does not exist" containerID="daa6beed4408d7c7a37478ef881ece8099432cbdfd02672e87ec4efee5cab39c" Jul 11 03:13:07.058470 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:07.058392 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"daa6beed4408d7c7a37478ef881ece8099432cbdfd02672e87ec4efee5cab39c"} err="failed to get container status \"daa6beed4408d7c7a37478ef881ece8099432cbdfd02672e87ec4efee5cab39c\": rpc error: code = NotFound desc = could not find container \"daa6beed4408d7c7a37478ef881ece8099432cbdfd02672e87ec4efee5cab39c\": container with ID starting with daa6beed4408d7c7a37478ef881ece8099432cbdfd02672e87ec4efee5cab39c not found: ID does not exist" Jul 11 03:13:07.058470 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:07.058415 2559 scope.go:117] "RemoveContainer" containerID="23610d18d52c8324c990c35e60dc6501af7405cca0dacd86efc409331764cc89" Jul 11 03:13:07.059496 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:13:07.059271 2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-mr2k7\" is forbidden: User \"system:node:ip-10-0-141-141.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-141.ec2.internal' and this object" podUID="94d6b57e-d578-467c-87c4-3f10728f5ec1" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mr2k7" Jul 11 03:13:07.062987 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:07.062444 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9fdv8" Jul 11 03:13:07.070630 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:07.070608 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bndqj\" (UniqueName: \"kubernetes.io/projected/9b5246b1-622f-45eb-9415-3cd24733eede-kube-api-access-bndqj\") pod \"9b5246b1-622f-45eb-9415-3cd24733eede\" (UID: \"9b5246b1-622f-45eb-9415-3cd24733eede\") " Jul 11 03:13:07.070762 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:07.070653 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9b5246b1-622f-45eb-9415-3cd24733eede-extensions-socket-volume\") pod \"9b5246b1-622f-45eb-9415-3cd24733eede\" (UID: \"9b5246b1-622f-45eb-9415-3cd24733eede\") " Jul 11 03:13:07.070762 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:07.070716 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-972lb\" (UniqueName: \"kubernetes.io/projected/eccac946-34aa-49ea-ae48-3035b5640a0e-kube-api-access-972lb\") pod \"eccac946-34aa-49ea-ae48-3035b5640a0e\" (UID: \"eccac946-34aa-49ea-ae48-3035b5640a0e\") " Jul 11 03:13:07.071137 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:07.071109 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b5246b1-622f-45eb-9415-3cd24733eede-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "9b5246b1-622f-45eb-9415-3cd24733eede" (UID: "9b5246b1-622f-45eb-9415-3cd24733eede"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 11 03:13:07.073103 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:07.073061 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eccac946-34aa-49ea-ae48-3035b5640a0e-kube-api-access-972lb" (OuterVolumeSpecName: "kube-api-access-972lb") pod "eccac946-34aa-49ea-ae48-3035b5640a0e" (UID: "eccac946-34aa-49ea-ae48-3035b5640a0e"). InnerVolumeSpecName "kube-api-access-972lb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 11 03:13:07.073179 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:07.073155 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b5246b1-622f-45eb-9415-3cd24733eede-kube-api-access-bndqj" (OuterVolumeSpecName: "kube-api-access-bndqj") pod "9b5246b1-622f-45eb-9415-3cd24733eede" (UID: "9b5246b1-622f-45eb-9415-3cd24733eede"). InnerVolumeSpecName "kube-api-access-bndqj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 11 03:13:07.075890 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:07.075859 2559 scope.go:117] "RemoveContainer" containerID="23610d18d52c8324c990c35e60dc6501af7405cca0dacd86efc409331764cc89" Jul 11 03:13:07.076322 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:13:07.076300 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"23610d18d52c8324c990c35e60dc6501af7405cca0dacd86efc409331764cc89\": container with ID starting with 23610d18d52c8324c990c35e60dc6501af7405cca0dacd86efc409331764cc89 not found: ID does not exist" containerID="23610d18d52c8324c990c35e60dc6501af7405cca0dacd86efc409331764cc89" Jul 11 03:13:07.076415 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:07.076331 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"23610d18d52c8324c990c35e60dc6501af7405cca0dacd86efc409331764cc89"} err="failed to get container status \"23610d18d52c8324c990c35e60dc6501af7405cca0dacd86efc409331764cc89\": rpc error: code = NotFound desc = could not find container \"23610d18d52c8324c990c35e60dc6501af7405cca0dacd86efc409331764cc89\": container with ID starting with 23610d18d52c8324c990c35e60dc6501af7405cca0dacd86efc409331764cc89 not found: ID does not exist" Jul 11 03:13:07.171583 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:07.171552 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-972lb\" (UniqueName: \"kubernetes.io/projected/eccac946-34aa-49ea-ae48-3035b5640a0e-kube-api-access-972lb\") on node \"ip-10-0-141-141.ec2.internal\" DevicePath \"\"" Jul 11 03:13:07.171583 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:07.171583 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bndqj\" (UniqueName: \"kubernetes.io/projected/9b5246b1-622f-45eb-9415-3cd24733eede-kube-api-access-bndqj\") on node \"ip-10-0-141-141.ec2.internal\" DevicePath \"\"" Jul 11 03:13:07.171768 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:07.171593 2559 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9b5246b1-622f-45eb-9415-3cd24733eede-extensions-socket-volume\") on node \"ip-10-0-141-141.ec2.internal\" DevicePath \"\"" Jul 11 03:13:07.231160 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:07.231057 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-jgmts"] Jul 11 03:13:07.233678 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:13:07.233653 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7faf9a3_6bcf_4672_8890_74d01188f92e.slice/crio-1b9addbd5ed065ad589411c783afd61628be4cbe1134823348314a9b0f0be4cf WatchSource:0}: Error finding container 1b9addbd5ed065ad589411c783afd61628be4cbe1134823348314a9b0f0be4cf: Status 404 returned error can't find the container with id 1b9addbd5ed065ad589411c783afd61628be4cbe1134823348314a9b0f0be4cf Jul 11 03:13:07.246650 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:07.246619 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9fdv8"] Jul 11 03:13:07.247213 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:13:07.247188 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4cb89ac4_4b4c_4ab0_b476_5357cea0bc6f.slice/crio-ab64b8ff9a0b137d0ab10c2be71dae763f4f84691e973ce2a45067962f0483ed WatchSource:0}: Error finding container ab64b8ff9a0b137d0ab10c2be71dae763f4f84691e973ce2a45067962f0483ed: Status 404 returned error can't find the container with id ab64b8ff9a0b137d0ab10c2be71dae763f4f84691e973ce2a45067962f0483ed Jul 11 03:13:07.361278 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:13:07.361245 2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-6ndp9\" is forbidden: User \"system:node:ip-10-0-141-141.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-141.ec2.internal' and this object" podUID="9b5246b1-622f-45eb-9415-3cd24733eede" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6ndp9" Jul 11 03:13:07.363117 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:13:07.363088 2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-jswhw\" is forbidden: User \"system:node:ip-10-0-141-141.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-141.ec2.internal' and this object" podUID="eccac946-34aa-49ea-ae48-3035b5640a0e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jswhw" Jul 11 03:13:07.365049 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:13:07.365027 2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-mr2k7\" is forbidden: User \"system:node:ip-10-0-141-141.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-141.ec2.internal' and this object" podUID="94d6b57e-d578-467c-87c4-3f10728f5ec1" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mr2k7" Jul 11 03:13:07.366821 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:13:07.366798 2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-jswhw\" is forbidden: User \"system:node:ip-10-0-141-141.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-141.ec2.internal' and this object" podUID="eccac946-34aa-49ea-ae48-3035b5640a0e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jswhw" Jul 11 03:13:07.368745 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:13:07.368723 2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-mr2k7\" is forbidden: User \"system:node:ip-10-0-141-141.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-141.ec2.internal' and this object" podUID="94d6b57e-d578-467c-87c4-3f10728f5ec1" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mr2k7" Jul 11 03:13:07.370359 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:13:07.370338 2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-6ndp9\" is forbidden: User \"system:node:ip-10-0-141-141.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-141.ec2.internal' and this object" podUID="9b5246b1-622f-45eb-9415-3cd24733eede" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6ndp9" Jul 11 03:13:07.641641 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:07.641600 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-69b94ddfdb-244hl" Jul 11 03:13:07.641836 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:07.641681 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-69b94ddfdb-244hl" Jul 11 03:13:07.646542 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:07.646511 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-69b94ddfdb-244hl" Jul 11 03:13:07.649285 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:13:07.649258 2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-6ndp9\" is forbidden: User \"system:node:ip-10-0-141-141.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-141.ec2.internal' and this object" podUID="9b5246b1-622f-45eb-9415-3cd24733eede" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6ndp9" Jul 11 03:13:07.697183 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:13:07.697139 2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-jswhw\" is forbidden: User \"system:node:ip-10-0-141-141.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-141.ec2.internal' and this object" podUID="eccac946-34aa-49ea-ae48-3035b5640a0e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jswhw" Jul 11 03:13:07.700046 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:13:07.700019 2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-mr2k7\" is forbidden: User \"system:node:ip-10-0-141-141.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-141.ec2.internal' and this object" podUID="94d6b57e-d578-467c-87c4-3f10728f5ec1" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mr2k7" Jul 11 03:13:08.058325 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:08.058284 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9fdv8" event={"ID":"4cb89ac4-4b4c-4ab0-b476-5357cea0bc6f","Type":"ContainerStarted","Data":"211902bb9914b35f5efd01e0cf7afd5b35d53dc14b2c0766206472cbe7491461"} Jul 11 03:13:08.058501 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:08.058367 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9fdv8" Jul 11 03:13:08.058501 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:08.058391 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9fdv8" event={"ID":"4cb89ac4-4b4c-4ab0-b476-5357cea0bc6f","Type":"ContainerStarted","Data":"ab64b8ff9a0b137d0ab10c2be71dae763f4f84691e973ce2a45067962f0483ed"} Jul 11 03:13:08.060799 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:13:08.060766 2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-6ndp9\" is forbidden: User \"system:node:ip-10-0-141-141.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-141.ec2.internal' and this object" podUID="9b5246b1-622f-45eb-9415-3cd24733eede" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6ndp9" Jul 11 03:13:08.061060 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:08.060949 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-jgmts" event={"ID":"c7faf9a3-6bcf-4672-8890-74d01188f92e","Type":"ContainerStarted","Data":"cd6822f75a59a1540b2d2868521838a1d210a6ec5a3b61cf992a68aa3e4e2f0e"} Jul 11 03:13:08.061060 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:08.061025 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-jgmts" Jul 11 03:13:08.061060 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:08.061048 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-jgmts" event={"ID":"c7faf9a3-6bcf-4672-8890-74d01188f92e","Type":"ContainerStarted","Data":"1b9addbd5ed065ad589411c783afd61628be4cbe1134823348314a9b0f0be4cf"} Jul 11 03:13:08.063484 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:08.063453 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mr2k7" podUID="94d6b57e-d578-467c-87c4-3f10728f5ec1" containerName="manager" containerID="cri-o://5cd6ef07130936a1d263e4569bd44e89893fd67b2e28a8ee6830785106e8aae6" gracePeriod=2 Jul 11 03:13:08.067250 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:08.067230 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-69b94ddfdb-244hl" Jul 11 03:13:08.081826 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:08.081773 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9fdv8" podStartSLOduration=2.081753457 podStartE2EDuration="2.081753457s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:13:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:13:08.079412831 +0000 UTC m=+612.048025281" watchObservedRunningTime="2026-07-11 03:13:08.081753457 +0000 UTC m=+612.050365907" Jul 11 03:13:08.082533 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:13:08.082504 2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-jswhw\" is forbidden: User \"system:node:ip-10-0-141-141.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-141.ec2.internal' and this object" podUID="eccac946-34aa-49ea-ae48-3035b5640a0e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jswhw" Jul 11 03:13:08.084384 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:13:08.084360 2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-mr2k7\" is forbidden: User \"system:node:ip-10-0-141-141.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-141.ec2.internal' and this object" podUID="94d6b57e-d578-467c-87c4-3f10728f5ec1" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mr2k7" Jul 11 03:13:08.103077 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:08.103019 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-jgmts" podStartSLOduration=2.103002643 podStartE2EDuration="2.103002643s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:13:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:13:08.102635114 +0000 UTC m=+612.071247565" watchObservedRunningTime="2026-07-11 03:13:08.103002643 +0000 UTC m=+612.071615094" Jul 11 03:13:08.104544 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:13:08.104512 2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-jswhw\" is forbidden: User \"system:node:ip-10-0-141-141.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-141.ec2.internal' and this object" podUID="eccac946-34aa-49ea-ae48-3035b5640a0e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jswhw" Jul 11 03:13:08.106261 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:13:08.106237 2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-mr2k7\" is forbidden: User \"system:node:ip-10-0-141-141.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-141.ec2.internal' and this object" podUID="94d6b57e-d578-467c-87c4-3f10728f5ec1" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mr2k7" Jul 11 03:13:08.108009 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:13:08.107984 2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-6ndp9\" is forbidden: User \"system:node:ip-10-0-141-141.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-141.ec2.internal' and this object" podUID="9b5246b1-622f-45eb-9415-3cd24733eede" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6ndp9" Jul 11 03:13:08.308730 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:08.308661 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mr2k7" Jul 11 03:13:08.311175 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:13:08.311146 2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-jswhw\" is forbidden: User \"system:node:ip-10-0-141-141.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-141.ec2.internal' and this object" podUID="eccac946-34aa-49ea-ae48-3035b5640a0e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jswhw" Jul 11 03:13:08.312985 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:13:08.312937 2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-mr2k7\" is forbidden: User \"system:node:ip-10-0-141-141.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-141.ec2.internal' and this object" podUID="94d6b57e-d578-467c-87c4-3f10728f5ec1" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mr2k7" Jul 11 03:13:08.314750 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:13:08.314722 2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-6ndp9\" is forbidden: User \"system:node:ip-10-0-141-141.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-141.ec2.internal' and this object" podUID="9b5246b1-622f-45eb-9415-3cd24733eede" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6ndp9" Jul 11 03:13:08.381982 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:08.381927 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/94d6b57e-d578-467c-87c4-3f10728f5ec1-extensions-socket-volume\") pod \"94d6b57e-d578-467c-87c4-3f10728f5ec1\" (UID: \"94d6b57e-d578-467c-87c4-3f10728f5ec1\") " Jul 11 03:13:08.382151 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:08.382019 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vh6rz\" (UniqueName: \"kubernetes.io/projected/94d6b57e-d578-467c-87c4-3f10728f5ec1-kube-api-access-vh6rz\") pod \"94d6b57e-d578-467c-87c4-3f10728f5ec1\" (UID: \"94d6b57e-d578-467c-87c4-3f10728f5ec1\") " Jul 11 03:13:08.382227 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:08.382203 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94d6b57e-d578-467c-87c4-3f10728f5ec1-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "94d6b57e-d578-467c-87c4-3f10728f5ec1" (UID: "94d6b57e-d578-467c-87c4-3f10728f5ec1"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 11 03:13:08.384194 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:08.384173 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94d6b57e-d578-467c-87c4-3f10728f5ec1-kube-api-access-vh6rz" (OuterVolumeSpecName: "kube-api-access-vh6rz") pod "94d6b57e-d578-467c-87c4-3f10728f5ec1" (UID: "94d6b57e-d578-467c-87c4-3f10728f5ec1"). InnerVolumeSpecName "kube-api-access-vh6rz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 11 03:13:08.483583 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:08.483528 2559 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/94d6b57e-d578-467c-87c4-3f10728f5ec1-extensions-socket-volume\") on node \"ip-10-0-141-141.ec2.internal\" DevicePath \"\"" Jul 11 03:13:08.483583 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:08.483573 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vh6rz\" (UniqueName: \"kubernetes.io/projected/94d6b57e-d578-467c-87c4-3f10728f5ec1-kube-api-access-vh6rz\") on node \"ip-10-0-141-141.ec2.internal\" DevicePath \"\"" Jul 11 03:13:08.616529 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:08.616449 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="94d6b57e-d578-467c-87c4-3f10728f5ec1" path="/var/lib/kubelet/pods/94d6b57e-d578-467c-87c4-3f10728f5ec1/volumes" Jul 11 03:13:08.616814 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:08.616800 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9b5246b1-622f-45eb-9415-3cd24733eede" path="/var/lib/kubelet/pods/9b5246b1-622f-45eb-9415-3cd24733eede/volumes" Jul 11 03:13:08.617106 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:08.617094 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eccac946-34aa-49ea-ae48-3035b5640a0e" path="/var/lib/kubelet/pods/eccac946-34aa-49ea-ae48-3035b5640a0e/volumes" Jul 11 03:13:09.072617 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:09.072585 2559 generic.go:356] "Generic (PLEG): container finished" podID="94d6b57e-d578-467c-87c4-3f10728f5ec1" containerID="5cd6ef07130936a1d263e4569bd44e89893fd67b2e28a8ee6830785106e8aae6" exitCode=2 Jul 11 03:13:09.073058 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:09.072635 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mr2k7" Jul 11 03:13:09.073058 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:09.072704 2559 scope.go:117] "RemoveContainer" containerID="5cd6ef07130936a1d263e4569bd44e89893fd67b2e28a8ee6830785106e8aae6" Jul 11 03:13:09.077551 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:13:09.077505 2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-mr2k7\" is forbidden: User \"system:node:ip-10-0-141-141.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-141.ec2.internal' and this object" podUID="94d6b57e-d578-467c-87c4-3f10728f5ec1" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mr2k7" Jul 11 03:13:09.081736 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:09.081717 2559 scope.go:117] "RemoveContainer" containerID="5cd6ef07130936a1d263e4569bd44e89893fd67b2e28a8ee6830785106e8aae6" Jul 11 03:13:09.082087 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:13:09.082069 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5cd6ef07130936a1d263e4569bd44e89893fd67b2e28a8ee6830785106e8aae6\": container with ID starting with 5cd6ef07130936a1d263e4569bd44e89893fd67b2e28a8ee6830785106e8aae6 not found: ID does not exist" containerID="5cd6ef07130936a1d263e4569bd44e89893fd67b2e28a8ee6830785106e8aae6" Jul 11 03:13:09.082165 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:09.082096 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5cd6ef07130936a1d263e4569bd44e89893fd67b2e28a8ee6830785106e8aae6"} err="failed to get container status \"5cd6ef07130936a1d263e4569bd44e89893fd67b2e28a8ee6830785106e8aae6\": rpc error: code = NotFound desc = could not find container \"5cd6ef07130936a1d263e4569bd44e89893fd67b2e28a8ee6830785106e8aae6\": container with ID starting with 5cd6ef07130936a1d263e4569bd44e89893fd67b2e28a8ee6830785106e8aae6 not found: ID does not exist" Jul 11 03:13:19.075404 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:19.075325 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9fdv8" Jul 11 03:13:19.075884 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:19.075407 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-jgmts" Jul 11 03:13:19.141948 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:19.141914 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9fdv8"] Jul 11 03:13:19.142177 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:19.142151 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9fdv8" podUID="4cb89ac4-4b4c-4ab0-b476-5357cea0bc6f" containerName="manager" containerID="cri-o://211902bb9914b35f5efd01e0cf7afd5b35d53dc14b2c0766206472cbe7491461" gracePeriod=10 Jul 11 03:13:19.351441 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:19.351369 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rsnm4"] Jul 11 03:13:19.351707 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:19.351695 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eccac946-34aa-49ea-ae48-3035b5640a0e" containerName="manager" Jul 11 03:13:19.351747 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:19.351709 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="eccac946-34aa-49ea-ae48-3035b5640a0e" containerName="manager" Jul 11 03:13:19.351780 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:19.351766 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="eccac946-34aa-49ea-ae48-3035b5640a0e" containerName="manager" Jul 11 03:13:19.364686 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:19.364660 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rsnm4" Jul 11 03:13:19.370738 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:19.370705 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rsnm4"] Jul 11 03:13:19.425719 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:19.425689 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9fdv8" Jul 11 03:13:19.482356 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:19.482310 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/69c26b3f-fe3a-4d18-9869-5c81876f88e3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-rsnm4\" (UID: \"69c26b3f-fe3a-4d18-9869-5c81876f88e3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rsnm4" Jul 11 03:13:19.482356 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:19.482360 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nrc7w\" (UniqueName: \"kubernetes.io/projected/69c26b3f-fe3a-4d18-9869-5c81876f88e3-kube-api-access-nrc7w\") pod \"kuadrant-operator-controller-manager-86878c769f-rsnm4\" (UID: \"69c26b3f-fe3a-4d18-9869-5c81876f88e3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rsnm4" Jul 11 03:13:19.582890 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:19.582841 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4cb89ac4-4b4c-4ab0-b476-5357cea0bc6f-extensions-socket-volume\") pod \"4cb89ac4-4b4c-4ab0-b476-5357cea0bc6f\" (UID: \"4cb89ac4-4b4c-4ab0-b476-5357cea0bc6f\") " Jul 11 03:13:19.583117 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:19.582992 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9l4fb\" (UniqueName: \"kubernetes.io/projected/4cb89ac4-4b4c-4ab0-b476-5357cea0bc6f-kube-api-access-9l4fb\") pod \"4cb89ac4-4b4c-4ab0-b476-5357cea0bc6f\" (UID: \"4cb89ac4-4b4c-4ab0-b476-5357cea0bc6f\") " Jul 11 03:13:19.583187 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:19.583151 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/69c26b3f-fe3a-4d18-9869-5c81876f88e3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-rsnm4\" (UID: \"69c26b3f-fe3a-4d18-9869-5c81876f88e3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rsnm4" Jul 11 03:13:19.583247 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:19.583187 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrc7w\" (UniqueName: \"kubernetes.io/projected/69c26b3f-fe3a-4d18-9869-5c81876f88e3-kube-api-access-nrc7w\") pod \"kuadrant-operator-controller-manager-86878c769f-rsnm4\" (UID: \"69c26b3f-fe3a-4d18-9869-5c81876f88e3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rsnm4" Jul 11 03:13:19.583307 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:19.583277 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4cb89ac4-4b4c-4ab0-b476-5357cea0bc6f-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "4cb89ac4-4b4c-4ab0-b476-5357cea0bc6f" (UID: "4cb89ac4-4b4c-4ab0-b476-5357cea0bc6f"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 11 03:13:19.583513 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:19.583492 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/69c26b3f-fe3a-4d18-9869-5c81876f88e3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-rsnm4\" (UID: \"69c26b3f-fe3a-4d18-9869-5c81876f88e3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rsnm4" Jul 11 03:13:19.585258 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:19.585240 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4cb89ac4-4b4c-4ab0-b476-5357cea0bc6f-kube-api-access-9l4fb" (OuterVolumeSpecName: "kube-api-access-9l4fb") pod "4cb89ac4-4b4c-4ab0-b476-5357cea0bc6f" (UID: "4cb89ac4-4b4c-4ab0-b476-5357cea0bc6f"). InnerVolumeSpecName "kube-api-access-9l4fb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 11 03:13:19.591771 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:19.591749 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nrc7w\" (UniqueName: \"kubernetes.io/projected/69c26b3f-fe3a-4d18-9869-5c81876f88e3-kube-api-access-nrc7w\") pod \"kuadrant-operator-controller-manager-86878c769f-rsnm4\" (UID: \"69c26b3f-fe3a-4d18-9869-5c81876f88e3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rsnm4" Jul 11 03:13:19.678917 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:19.678822 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rsnm4" Jul 11 03:13:19.684588 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:19.684556 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9l4fb\" (UniqueName: \"kubernetes.io/projected/4cb89ac4-4b4c-4ab0-b476-5357cea0bc6f-kube-api-access-9l4fb\") on node \"ip-10-0-141-141.ec2.internal\" DevicePath \"\"" Jul 11 03:13:19.684659 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:19.684600 2559 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4cb89ac4-4b4c-4ab0-b476-5357cea0bc6f-extensions-socket-volume\") on node \"ip-10-0-141-141.ec2.internal\" DevicePath \"\"" Jul 11 03:13:19.837500 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:19.837474 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rsnm4"] Jul 11 03:13:19.840126 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:13:19.840097 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69c26b3f_fe3a_4d18_9869_5c81876f88e3.slice/crio-57519b763c20a789cc0c7ddeb48ade8d1cda16feae09d38ace6aed9b6d043dc7 WatchSource:0}: Error finding container 57519b763c20a789cc0c7ddeb48ade8d1cda16feae09d38ace6aed9b6d043dc7: Status 404 returned error can't find the container with id 57519b763c20a789cc0c7ddeb48ade8d1cda16feae09d38ace6aed9b6d043dc7 Jul 11 03:13:20.132211 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:20.132180 2559 generic.go:356] "Generic (PLEG): container finished" podID="4cb89ac4-4b4c-4ab0-b476-5357cea0bc6f" containerID="211902bb9914b35f5efd01e0cf7afd5b35d53dc14b2c0766206472cbe7491461" exitCode=0 Jul 11 03:13:20.132648 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:20.132231 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9fdv8" Jul 11 03:13:20.132648 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:20.132276 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9fdv8" event={"ID":"4cb89ac4-4b4c-4ab0-b476-5357cea0bc6f","Type":"ContainerDied","Data":"211902bb9914b35f5efd01e0cf7afd5b35d53dc14b2c0766206472cbe7491461"} Jul 11 03:13:20.132648 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:20.132341 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9fdv8" event={"ID":"4cb89ac4-4b4c-4ab0-b476-5357cea0bc6f","Type":"ContainerDied","Data":"ab64b8ff9a0b137d0ab10c2be71dae763f4f84691e973ce2a45067962f0483ed"} Jul 11 03:13:20.132648 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:20.132372 2559 scope.go:117] "RemoveContainer" containerID="211902bb9914b35f5efd01e0cf7afd5b35d53dc14b2c0766206472cbe7491461" Jul 11 03:13:20.134251 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:20.134227 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rsnm4" event={"ID":"69c26b3f-fe3a-4d18-9869-5c81876f88e3","Type":"ContainerStarted","Data":"e5dca4273817bb09d52b142fa270a5693f5c3b804d41760f1c1006649870f43f"} Jul 11 03:13:20.134357 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:20.134275 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rsnm4" event={"ID":"69c26b3f-fe3a-4d18-9869-5c81876f88e3","Type":"ContainerStarted","Data":"57519b763c20a789cc0c7ddeb48ade8d1cda16feae09d38ace6aed9b6d043dc7"} Jul 11 03:13:20.134433 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:20.134417 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rsnm4" Jul 11 03:13:20.142486 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:20.142469 2559 scope.go:117] "RemoveContainer" containerID="211902bb9914b35f5efd01e0cf7afd5b35d53dc14b2c0766206472cbe7491461" Jul 11 03:13:20.142771 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:13:20.142755 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"211902bb9914b35f5efd01e0cf7afd5b35d53dc14b2c0766206472cbe7491461\": container with ID starting with 211902bb9914b35f5efd01e0cf7afd5b35d53dc14b2c0766206472cbe7491461 not found: ID does not exist" containerID="211902bb9914b35f5efd01e0cf7afd5b35d53dc14b2c0766206472cbe7491461" Jul 11 03:13:20.142823 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:20.142781 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"211902bb9914b35f5efd01e0cf7afd5b35d53dc14b2c0766206472cbe7491461"} err="failed to get container status \"211902bb9914b35f5efd01e0cf7afd5b35d53dc14b2c0766206472cbe7491461\": rpc error: code = NotFound desc = could not find container \"211902bb9914b35f5efd01e0cf7afd5b35d53dc14b2c0766206472cbe7491461\": container with ID starting with 211902bb9914b35f5efd01e0cf7afd5b35d53dc14b2c0766206472cbe7491461 not found: ID does not exist" Jul 11 03:13:20.156314 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:20.156268 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rsnm4" podStartSLOduration=1.15625176 podStartE2EDuration="1.15625176s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:13:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:13:20.155366807 +0000 UTC m=+624.123979258" watchObservedRunningTime="2026-07-11 03:13:20.15625176 +0000 UTC m=+624.124864210" Jul 11 03:13:20.173603 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:20.173572 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9fdv8"] Jul 11 03:13:20.181196 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:20.181171 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9fdv8"] Jul 11 03:13:20.615344 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:20.615314 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4cb89ac4-4b4c-4ab0-b476-5357cea0bc6f" path="/var/lib/kubelet/pods/4cb89ac4-4b4c-4ab0-b476-5357cea0bc6f/volumes" Jul 11 03:13:31.143347 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:31.143313 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rsnm4" Jul 11 03:13:31.194601 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:31.194567 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-jgmts"] Jul 11 03:13:31.194848 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:31.194803 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-jgmts" podUID="c7faf9a3-6bcf-4672-8890-74d01188f92e" containerName="manager" containerID="cri-o://cd6822f75a59a1540b2d2868521838a1d210a6ec5a3b61cf992a68aa3e4e2f0e" gracePeriod=10 Jul 11 03:13:31.448714 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:31.448689 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-jgmts" Jul 11 03:13:31.477377 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:31.477347 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c7faf9a3-6bcf-4672-8890-74d01188f92e-extensions-socket-volume\") pod \"c7faf9a3-6bcf-4672-8890-74d01188f92e\" (UID: \"c7faf9a3-6bcf-4672-8890-74d01188f92e\") " Jul 11 03:13:31.477565 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:31.477406 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nj4c2\" (UniqueName: \"kubernetes.io/projected/c7faf9a3-6bcf-4672-8890-74d01188f92e-kube-api-access-nj4c2\") pod \"c7faf9a3-6bcf-4672-8890-74d01188f92e\" (UID: \"c7faf9a3-6bcf-4672-8890-74d01188f92e\") " Jul 11 03:13:31.477726 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:31.477701 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7faf9a3-6bcf-4672-8890-74d01188f92e-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "c7faf9a3-6bcf-4672-8890-74d01188f92e" (UID: "c7faf9a3-6bcf-4672-8890-74d01188f92e"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 11 03:13:31.479662 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:31.479639 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c7faf9a3-6bcf-4672-8890-74d01188f92e-kube-api-access-nj4c2" (OuterVolumeSpecName: "kube-api-access-nj4c2") pod "c7faf9a3-6bcf-4672-8890-74d01188f92e" (UID: "c7faf9a3-6bcf-4672-8890-74d01188f92e"). InnerVolumeSpecName "kube-api-access-nj4c2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 11 03:13:31.578820 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:31.578790 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nj4c2\" (UniqueName: \"kubernetes.io/projected/c7faf9a3-6bcf-4672-8890-74d01188f92e-kube-api-access-nj4c2\") on node \"ip-10-0-141-141.ec2.internal\" DevicePath \"\"" Jul 11 03:13:31.578820 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:31.578818 2559 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c7faf9a3-6bcf-4672-8890-74d01188f92e-extensions-socket-volume\") on node \"ip-10-0-141-141.ec2.internal\" DevicePath \"\"" Jul 11 03:13:32.195565 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:32.195524 2559 generic.go:356] "Generic (PLEG): container finished" podID="c7faf9a3-6bcf-4672-8890-74d01188f92e" containerID="cd6822f75a59a1540b2d2868521838a1d210a6ec5a3b61cf992a68aa3e4e2f0e" exitCode=0 Jul 11 03:13:32.195565 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:32.195572 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-jgmts" Jul 11 03:13:32.196044 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:32.195574 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-jgmts" event={"ID":"c7faf9a3-6bcf-4672-8890-74d01188f92e","Type":"ContainerDied","Data":"cd6822f75a59a1540b2d2868521838a1d210a6ec5a3b61cf992a68aa3e4e2f0e"} Jul 11 03:13:32.196044 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:32.195633 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-jgmts" event={"ID":"c7faf9a3-6bcf-4672-8890-74d01188f92e","Type":"ContainerDied","Data":"1b9addbd5ed065ad589411c783afd61628be4cbe1134823348314a9b0f0be4cf"} Jul 11 03:13:32.196044 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:32.195664 2559 scope.go:117] "RemoveContainer" containerID="cd6822f75a59a1540b2d2868521838a1d210a6ec5a3b61cf992a68aa3e4e2f0e" Jul 11 03:13:32.204804 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:32.204784 2559 scope.go:117] "RemoveContainer" containerID="cd6822f75a59a1540b2d2868521838a1d210a6ec5a3b61cf992a68aa3e4e2f0e" Jul 11 03:13:32.205114 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:13:32.205094 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cd6822f75a59a1540b2d2868521838a1d210a6ec5a3b61cf992a68aa3e4e2f0e\": container with ID starting with cd6822f75a59a1540b2d2868521838a1d210a6ec5a3b61cf992a68aa3e4e2f0e not found: ID does not exist" containerID="cd6822f75a59a1540b2d2868521838a1d210a6ec5a3b61cf992a68aa3e4e2f0e" Jul 11 03:13:32.205182 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:32.205123 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd6822f75a59a1540b2d2868521838a1d210a6ec5a3b61cf992a68aa3e4e2f0e"} err="failed to get container status \"cd6822f75a59a1540b2d2868521838a1d210a6ec5a3b61cf992a68aa3e4e2f0e\": rpc error: code = NotFound desc = could not find container \"cd6822f75a59a1540b2d2868521838a1d210a6ec5a3b61cf992a68aa3e4e2f0e\": container with ID starting with cd6822f75a59a1540b2d2868521838a1d210a6ec5a3b61cf992a68aa3e4e2f0e not found: ID does not exist" Jul 11 03:13:32.221597 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:32.221567 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-jgmts"] Jul 11 03:13:32.225072 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:32.225039 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-jgmts"] Jul 11 03:13:32.614789 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:32.614755 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c7faf9a3-6bcf-4672-8890-74d01188f92e" path="/var/lib/kubelet/pods/c7faf9a3-6bcf-4672-8890-74d01188f92e/volumes" Jul 11 03:13:35.461013 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:35.460953 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-jqwkk"] Jul 11 03:13:35.461370 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:35.461345 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7faf9a3-6bcf-4672-8890-74d01188f92e" containerName="manager" Jul 11 03:13:35.461370 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:35.461361 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7faf9a3-6bcf-4672-8890-74d01188f92e" containerName="manager" Jul 11 03:13:35.461450 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:35.461389 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4cb89ac4-4b4c-4ab0-b476-5357cea0bc6f" containerName="manager" Jul 11 03:13:35.461450 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:35.461395 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="4cb89ac4-4b4c-4ab0-b476-5357cea0bc6f" containerName="manager" Jul 11 03:13:35.461513 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:35.461452 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="c7faf9a3-6bcf-4672-8890-74d01188f92e" containerName="manager" Jul 11 03:13:35.461513 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:35.461462 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="4cb89ac4-4b4c-4ab0-b476-5357cea0bc6f" containerName="manager" Jul 11 03:13:35.464289 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:35.464269 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-jqwkk" Jul 11 03:13:35.466516 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:35.466489 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-hzhgw\"" Jul 11 03:13:35.480113 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:35.480080 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-jqwkk"] Jul 11 03:13:35.511185 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:35.511147 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b0c70ae8-fc23-4775-81a4-00b56a95b821-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-jqwkk\" (UID: \"b0c70ae8-fc23-4775-81a4-00b56a95b821\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-jqwkk" Jul 11 03:13:35.511185 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:35.511188 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b0c70ae8-fc23-4775-81a4-00b56a95b821-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-jqwkk\" (UID: \"b0c70ae8-fc23-4775-81a4-00b56a95b821\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-jqwkk" Jul 11 03:13:35.511398 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:35.511212 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b0c70ae8-fc23-4775-81a4-00b56a95b821-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-jqwkk\" (UID: \"b0c70ae8-fc23-4775-81a4-00b56a95b821\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-jqwkk" Jul 11 03:13:35.511398 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:35.511280 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0c70ae8-fc23-4775-81a4-00b56a95b821-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-jqwkk\" (UID: \"b0c70ae8-fc23-4775-81a4-00b56a95b821\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-jqwkk" Jul 11 03:13:35.511398 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:35.511305 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0c70ae8-fc23-4775-81a4-00b56a95b821-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-jqwkk\" (UID: \"b0c70ae8-fc23-4775-81a4-00b56a95b821\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-jqwkk" Jul 11 03:13:35.511398 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:35.511364 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9x6g\" (UniqueName: \"kubernetes.io/projected/b0c70ae8-fc23-4775-81a4-00b56a95b821-kube-api-access-t9x6g\") pod \"maas-default-gateway-openshift-default-5896d4dd49-jqwkk\" (UID: \"b0c70ae8-fc23-4775-81a4-00b56a95b821\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-jqwkk" Jul 11 03:13:35.511523 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:35.511420 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b0c70ae8-fc23-4775-81a4-00b56a95b821-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-jqwkk\" (UID: \"b0c70ae8-fc23-4775-81a4-00b56a95b821\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-jqwkk" Jul 11 03:13:35.511523 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:35.511455 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b0c70ae8-fc23-4775-81a4-00b56a95b821-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-jqwkk\" (UID: \"b0c70ae8-fc23-4775-81a4-00b56a95b821\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-jqwkk" Jul 11 03:13:35.511523 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:35.511471 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b0c70ae8-fc23-4775-81a4-00b56a95b821-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-jqwkk\" (UID: \"b0c70ae8-fc23-4775-81a4-00b56a95b821\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-jqwkk" Jul 11 03:13:35.612285 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:35.612243 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0c70ae8-fc23-4775-81a4-00b56a95b821-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-jqwkk\" (UID: \"b0c70ae8-fc23-4775-81a4-00b56a95b821\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-jqwkk" Jul 11 03:13:35.612285 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:35.612289 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0c70ae8-fc23-4775-81a4-00b56a95b821-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-jqwkk\" (UID: \"b0c70ae8-fc23-4775-81a4-00b56a95b821\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-jqwkk" Jul 11 03:13:35.612519 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:35.612305 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9x6g\" (UniqueName: \"kubernetes.io/projected/b0c70ae8-fc23-4775-81a4-00b56a95b821-kube-api-access-t9x6g\") pod \"maas-default-gateway-openshift-default-5896d4dd49-jqwkk\" (UID: \"b0c70ae8-fc23-4775-81a4-00b56a95b821\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-jqwkk" Jul 11 03:13:35.612519 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:35.612426 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b0c70ae8-fc23-4775-81a4-00b56a95b821-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-jqwkk\" (UID: \"b0c70ae8-fc23-4775-81a4-00b56a95b821\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-jqwkk" Jul 11 03:13:35.612519 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:35.612489 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b0c70ae8-fc23-4775-81a4-00b56a95b821-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-jqwkk\" (UID: \"b0c70ae8-fc23-4775-81a4-00b56a95b821\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-jqwkk" Jul 11 03:13:35.612674 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:35.612633 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b0c70ae8-fc23-4775-81a4-00b56a95b821-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-jqwkk\" (UID: \"b0c70ae8-fc23-4775-81a4-00b56a95b821\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-jqwkk" Jul 11 03:13:35.612730 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:35.612677 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0c70ae8-fc23-4775-81a4-00b56a95b821-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-jqwkk\" (UID: \"b0c70ae8-fc23-4775-81a4-00b56a95b821\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-jqwkk" Jul 11 03:13:35.612730 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:35.612705 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0c70ae8-fc23-4775-81a4-00b56a95b821-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-jqwkk\" (UID: \"b0c70ae8-fc23-4775-81a4-00b56a95b821\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-jqwkk" Jul 11 03:13:35.612832 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:35.612759 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b0c70ae8-fc23-4775-81a4-00b56a95b821-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-jqwkk\" (UID: \"b0c70ae8-fc23-4775-81a4-00b56a95b821\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-jqwkk" Jul 11 03:13:35.612832 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:35.612783 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b0c70ae8-fc23-4775-81a4-00b56a95b821-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-jqwkk\" (UID: \"b0c70ae8-fc23-4775-81a4-00b56a95b821\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-jqwkk" Jul 11 03:13:35.612832 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:35.612817 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b0c70ae8-fc23-4775-81a4-00b56a95b821-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-jqwkk\" (UID: \"b0c70ae8-fc23-4775-81a4-00b56a95b821\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-jqwkk" Jul 11 03:13:35.613123 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:35.613100 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b0c70ae8-fc23-4775-81a4-00b56a95b821-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-jqwkk\" (UID: \"b0c70ae8-fc23-4775-81a4-00b56a95b821\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-jqwkk" Jul 11 03:13:35.613249 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:35.613126 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b0c70ae8-fc23-4775-81a4-00b56a95b821-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-jqwkk\" (UID: \"b0c70ae8-fc23-4775-81a4-00b56a95b821\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-jqwkk" Jul 11 03:13:35.613249 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:35.613155 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b0c70ae8-fc23-4775-81a4-00b56a95b821-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-jqwkk\" (UID: \"b0c70ae8-fc23-4775-81a4-00b56a95b821\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-jqwkk" Jul 11 03:13:35.615061 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:35.615030 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b0c70ae8-fc23-4775-81a4-00b56a95b821-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-jqwkk\" (UID: \"b0c70ae8-fc23-4775-81a4-00b56a95b821\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-jqwkk" Jul 11 03:13:35.615223 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:35.615203 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b0c70ae8-fc23-4775-81a4-00b56a95b821-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-jqwkk\" (UID: \"b0c70ae8-fc23-4775-81a4-00b56a95b821\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-jqwkk" Jul 11 03:13:35.623175 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:35.623150 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b0c70ae8-fc23-4775-81a4-00b56a95b821-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-jqwkk\" (UID: \"b0c70ae8-fc23-4775-81a4-00b56a95b821\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-jqwkk" Jul 11 03:13:35.623501 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:35.623481 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9x6g\" (UniqueName: \"kubernetes.io/projected/b0c70ae8-fc23-4775-81a4-00b56a95b821-kube-api-access-t9x6g\") pod \"maas-default-gateway-openshift-default-5896d4dd49-jqwkk\" (UID: \"b0c70ae8-fc23-4775-81a4-00b56a95b821\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-jqwkk" Jul 11 03:13:35.783118 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:35.783088 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-jqwkk" Jul 11 03:13:35.926020 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:35.925994 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-jqwkk"] Jul 11 03:13:35.927792 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:13:35.927765 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0c70ae8_fc23_4775_81a4_00b56a95b821.slice/crio-e34ce230ddde3a644a1f656477219aa0fc69eff0dfaae740bc52c40d9240b542 WatchSource:0}: Error finding container e34ce230ddde3a644a1f656477219aa0fc69eff0dfaae740bc52c40d9240b542: Status 404 returned error can't find the container with id e34ce230ddde3a644a1f656477219aa0fc69eff0dfaae740bc52c40d9240b542 Jul 11 03:13:35.929671 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:35.929646 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 11 03:13:35.929722 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:35.929707 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 11 03:13:35.929758 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:35.929747 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 11 03:13:36.219798 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:36.219706 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-jqwkk" event={"ID":"b0c70ae8-fc23-4775-81a4-00b56a95b821","Type":"ContainerStarted","Data":"8394d06c1a5205396591b5e1078c8b4cc44210a6750edcbbf41236033230e270"} Jul 11 03:13:36.219798 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:36.219771 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-jqwkk" event={"ID":"b0c70ae8-fc23-4775-81a4-00b56a95b821","Type":"ContainerStarted","Data":"e34ce230ddde3a644a1f656477219aa0fc69eff0dfaae740bc52c40d9240b542"} Jul 11 03:13:36.239587 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:36.239534 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-jqwkk" podStartSLOduration=1.239513188 podStartE2EDuration="1.239513188s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:13:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:13:36.237716571 +0000 UTC m=+640.206329077" watchObservedRunningTime="2026-07-11 03:13:36.239513188 +0000 UTC m=+640.208125638" Jul 11 03:13:36.783783 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:36.783742 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-jqwkk" Jul 11 03:13:36.788909 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:36.788877 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-jqwkk" Jul 11 03:13:37.225068 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:37.224983 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-jqwkk" Jul 11 03:13:37.225919 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:37.225897 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-jqwkk" Jul 11 03:13:51.381839 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:51.381798 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-l4s58"] Jul 11 03:13:51.384331 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:51.384314 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-l4s58" Jul 11 03:13:51.386792 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:51.386767 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 11 03:13:51.386908 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:51.386871 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-x2kpg\"" Jul 11 03:13:51.394159 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:51.394134 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-l4s58"] Jul 11 03:13:51.455432 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:51.455400 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hv49c\" (UniqueName: \"kubernetes.io/projected/aee7303c-2c7e-4d9d-8fb7-e130c153f581-kube-api-access-hv49c\") pod \"limitador-limitador-64c94fd64f-l4s58\" (UID: \"aee7303c-2c7e-4d9d-8fb7-e130c153f581\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-l4s58" Jul 11 03:13:51.455596 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:51.455441 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/aee7303c-2c7e-4d9d-8fb7-e130c153f581-config-file\") pod \"limitador-limitador-64c94fd64f-l4s58\" (UID: \"aee7303c-2c7e-4d9d-8fb7-e130c153f581\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-l4s58" Jul 11 03:13:51.479187 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:51.479150 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-l4s58"] Jul 11 03:13:51.556852 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:51.556808 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hv49c\" (UniqueName: \"kubernetes.io/projected/aee7303c-2c7e-4d9d-8fb7-e130c153f581-kube-api-access-hv49c\") pod \"limitador-limitador-64c94fd64f-l4s58\" (UID: \"aee7303c-2c7e-4d9d-8fb7-e130c153f581\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-l4s58" Jul 11 03:13:51.556852 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:51.556860 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/aee7303c-2c7e-4d9d-8fb7-e130c153f581-config-file\") pod \"limitador-limitador-64c94fd64f-l4s58\" (UID: \"aee7303c-2c7e-4d9d-8fb7-e130c153f581\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-l4s58" Jul 11 03:13:51.557478 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:51.557458 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/aee7303c-2c7e-4d9d-8fb7-e130c153f581-config-file\") pod \"limitador-limitador-64c94fd64f-l4s58\" (UID: \"aee7303c-2c7e-4d9d-8fb7-e130c153f581\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-l4s58" Jul 11 03:13:51.564926 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:51.564894 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hv49c\" (UniqueName: \"kubernetes.io/projected/aee7303c-2c7e-4d9d-8fb7-e130c153f581-kube-api-access-hv49c\") pod \"limitador-limitador-64c94fd64f-l4s58\" (UID: \"aee7303c-2c7e-4d9d-8fb7-e130c153f581\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-l4s58" Jul 11 03:13:51.697245 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:51.697162 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-l4s58" Jul 11 03:13:51.838630 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:51.838603 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-l4s58"] Jul 11 03:13:51.841689 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:13:51.841659 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaee7303c_2c7e_4d9d_8fb7_e130c153f581.slice/crio-c1040169365ed7727960c8dfd5727c7d4b593fde41cd8f1f43ef6cbcd006332d WatchSource:0}: Error finding container c1040169365ed7727960c8dfd5727c7d4b593fde41cd8f1f43ef6cbcd006332d: Status 404 returned error can't find the container with id c1040169365ed7727960c8dfd5727c7d4b593fde41cd8f1f43ef6cbcd006332d Jul 11 03:13:52.168906 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:52.168867 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-zhrj2"] Jul 11 03:13:52.172468 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:52.172443 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-zhrj2" Jul 11 03:13:52.174663 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:52.174638 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-j7p44\"" Jul 11 03:13:52.178489 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:52.178468 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-zhrj2"] Jul 11 03:13:52.261844 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:52.261809 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9wsv\" (UniqueName: \"kubernetes.io/projected/42794db5-c5d2-45e7-b262-3d850545e397-kube-api-access-m9wsv\") pod \"authorino-58cd955675-zhrj2\" (UID: \"42794db5-c5d2-45e7-b262-3d850545e397\") " pod="kuadrant-system/authorino-58cd955675-zhrj2" Jul 11 03:13:52.303148 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:52.303109 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-l4s58" event={"ID":"aee7303c-2c7e-4d9d-8fb7-e130c153f581","Type":"ContainerStarted","Data":"c1040169365ed7727960c8dfd5727c7d4b593fde41cd8f1f43ef6cbcd006332d"} Jul 11 03:13:52.362523 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:52.362489 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9wsv\" (UniqueName: \"kubernetes.io/projected/42794db5-c5d2-45e7-b262-3d850545e397-kube-api-access-m9wsv\") pod \"authorino-58cd955675-zhrj2\" (UID: \"42794db5-c5d2-45e7-b262-3d850545e397\") " pod="kuadrant-system/authorino-58cd955675-zhrj2" Jul 11 03:13:52.372264 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:52.372234 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9wsv\" (UniqueName: \"kubernetes.io/projected/42794db5-c5d2-45e7-b262-3d850545e397-kube-api-access-m9wsv\") pod \"authorino-58cd955675-zhrj2\" (UID: \"42794db5-c5d2-45e7-b262-3d850545e397\") " pod="kuadrant-system/authorino-58cd955675-zhrj2" Jul 11 03:13:52.484324 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:52.484233 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-zhrj2" Jul 11 03:13:52.670492 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:52.670417 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-zhrj2"] Jul 11 03:13:53.314553 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:53.314425 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-zhrj2" event={"ID":"42794db5-c5d2-45e7-b262-3d850545e397","Type":"ContainerStarted","Data":"c10e53aedbfb7c0d7399d212e8aa533ee02945a56ce0ac8d762d2b8f1555c796"} Jul 11 03:13:56.213052 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:56.213006 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-zhrj2"] Jul 11 03:13:57.338591 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:57.338558 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-l4s58" event={"ID":"aee7303c-2c7e-4d9d-8fb7-e130c153f581","Type":"ContainerStarted","Data":"2a5f9c57793aad228ac496885112ba72eb0369336d2cc1f4c77441bf209d9e22"} Jul 11 03:13:57.339034 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:57.338689 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-l4s58" Jul 11 03:13:57.340207 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:57.340184 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-zhrj2" event={"ID":"42794db5-c5d2-45e7-b262-3d850545e397","Type":"ContainerStarted","Data":"3e4c90309f67fac2f001a717b32dda212746eb6db413709bdacf520bebb0c392"} Jul 11 03:13:57.340354 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:57.340228 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-zhrj2" podUID="42794db5-c5d2-45e7-b262-3d850545e397" containerName="authorino" containerID="cri-o://3e4c90309f67fac2f001a717b32dda212746eb6db413709bdacf520bebb0c392" gracePeriod=30 Jul 11 03:13:57.355237 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:57.355188 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-l4s58" podStartSLOduration=1.7155110869999999 podStartE2EDuration="6.355168684s" totalImagesPullingTime="4.639657597s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:13:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:13:57.353428604 +0000 UTC m=+661.322041058" watchObservedRunningTime="2026-07-11 03:13:57.355168684 +0000 UTC m=+661.323781152" Jul 11 03:13:57.366746 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:57.366694 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-zhrj2" podStartSLOduration=1.560876806 podStartE2EDuration="5.366665583s" totalImagesPullingTime="3.805788777s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:13:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:13:57.365506853 +0000 UTC m=+661.334119302" watchObservedRunningTime="2026-07-11 03:13:57.366665583 +0000 UTC m=+661.335278034" Jul 11 03:13:57.597584 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:57.597519 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-zhrj2" Jul 11 03:13:57.714042 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:57.714007 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m9wsv\" (UniqueName: \"kubernetes.io/projected/42794db5-c5d2-45e7-b262-3d850545e397-kube-api-access-m9wsv\") pod \"42794db5-c5d2-45e7-b262-3d850545e397\" (UID: \"42794db5-c5d2-45e7-b262-3d850545e397\") " Jul 11 03:13:57.716277 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:57.716249 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/42794db5-c5d2-45e7-b262-3d850545e397-kube-api-access-m9wsv" (OuterVolumeSpecName: "kube-api-access-m9wsv") pod "42794db5-c5d2-45e7-b262-3d850545e397" (UID: "42794db5-c5d2-45e7-b262-3d850545e397"). InnerVolumeSpecName "kube-api-access-m9wsv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 11 03:13:57.815062 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:57.815027 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m9wsv\" (UniqueName: \"kubernetes.io/projected/42794db5-c5d2-45e7-b262-3d850545e397-kube-api-access-m9wsv\") on node \"ip-10-0-141-141.ec2.internal\" DevicePath \"\"" Jul 11 03:13:58.345948 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:58.345913 2559 generic.go:356] "Generic (PLEG): container finished" podID="42794db5-c5d2-45e7-b262-3d850545e397" containerID="3e4c90309f67fac2f001a717b32dda212746eb6db413709bdacf520bebb0c392" exitCode=0 Jul 11 03:13:58.345948 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:58.345979 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-zhrj2" Jul 11 03:13:58.346464 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:58.346017 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-zhrj2" event={"ID":"42794db5-c5d2-45e7-b262-3d850545e397","Type":"ContainerDied","Data":"3e4c90309f67fac2f001a717b32dda212746eb6db413709bdacf520bebb0c392"} Jul 11 03:13:58.346464 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:58.346074 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-zhrj2" event={"ID":"42794db5-c5d2-45e7-b262-3d850545e397","Type":"ContainerDied","Data":"c10e53aedbfb7c0d7399d212e8aa533ee02945a56ce0ac8d762d2b8f1555c796"} Jul 11 03:13:58.346464 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:58.346104 2559 scope.go:117] "RemoveContainer" containerID="3e4c90309f67fac2f001a717b32dda212746eb6db413709bdacf520bebb0c392" Jul 11 03:13:58.357135 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:58.357118 2559 scope.go:117] "RemoveContainer" containerID="3e4c90309f67fac2f001a717b32dda212746eb6db413709bdacf520bebb0c392" Jul 11 03:13:58.357410 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:13:58.357392 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e4c90309f67fac2f001a717b32dda212746eb6db413709bdacf520bebb0c392\": container with ID starting with 3e4c90309f67fac2f001a717b32dda212746eb6db413709bdacf520bebb0c392 not found: ID does not exist" containerID="3e4c90309f67fac2f001a717b32dda212746eb6db413709bdacf520bebb0c392" Jul 11 03:13:58.357455 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:58.357420 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e4c90309f67fac2f001a717b32dda212746eb6db413709bdacf520bebb0c392"} err="failed to get container status \"3e4c90309f67fac2f001a717b32dda212746eb6db413709bdacf520bebb0c392\": rpc error: code = NotFound desc = could not find container \"3e4c90309f67fac2f001a717b32dda212746eb6db413709bdacf520bebb0c392\": container with ID starting with 3e4c90309f67fac2f001a717b32dda212746eb6db413709bdacf520bebb0c392 not found: ID does not exist" Jul 11 03:13:58.368855 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:58.368825 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-zhrj2"] Jul 11 03:13:58.373117 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:58.373089 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-zhrj2"] Jul 11 03:13:58.615760 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:13:58.615674 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="42794db5-c5d2-45e7-b262-3d850545e397" path="/var/lib/kubelet/pods/42794db5-c5d2-45e7-b262-3d850545e397/volumes" Jul 11 03:14:06.118664 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:06.118621 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-l4s58"] Jul 11 03:14:06.119200 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:06.118873 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-l4s58" podUID="aee7303c-2c7e-4d9d-8fb7-e130c153f581" containerName="limitador" containerID="cri-o://2a5f9c57793aad228ac496885112ba72eb0369336d2cc1f4c77441bf209d9e22" gracePeriod=30 Jul 11 03:14:06.119697 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:06.119680 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-l4s58" Jul 11 03:14:06.674488 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:06.674461 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-l4s58" Jul 11 03:14:06.801211 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:06.801175 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hv49c\" (UniqueName: \"kubernetes.io/projected/aee7303c-2c7e-4d9d-8fb7-e130c153f581-kube-api-access-hv49c\") pod \"aee7303c-2c7e-4d9d-8fb7-e130c153f581\" (UID: \"aee7303c-2c7e-4d9d-8fb7-e130c153f581\") " Jul 11 03:14:06.801619 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:06.801589 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/aee7303c-2c7e-4d9d-8fb7-e130c153f581-config-file\") pod \"aee7303c-2c7e-4d9d-8fb7-e130c153f581\" (UID: \"aee7303c-2c7e-4d9d-8fb7-e130c153f581\") " Jul 11 03:14:06.801991 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:06.801952 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aee7303c-2c7e-4d9d-8fb7-e130c153f581-config-file" (OuterVolumeSpecName: "config-file") pod "aee7303c-2c7e-4d9d-8fb7-e130c153f581" (UID: "aee7303c-2c7e-4d9d-8fb7-e130c153f581"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 11 03:14:06.804413 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:06.804388 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aee7303c-2c7e-4d9d-8fb7-e130c153f581-kube-api-access-hv49c" (OuterVolumeSpecName: "kube-api-access-hv49c") pod "aee7303c-2c7e-4d9d-8fb7-e130c153f581" (UID: "aee7303c-2c7e-4d9d-8fb7-e130c153f581"). InnerVolumeSpecName "kube-api-access-hv49c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 11 03:14:06.902642 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:06.902588 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hv49c\" (UniqueName: \"kubernetes.io/projected/aee7303c-2c7e-4d9d-8fb7-e130c153f581-kube-api-access-hv49c\") on node \"ip-10-0-141-141.ec2.internal\" DevicePath \"\"" Jul 11 03:14:06.902642 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:06.902637 2559 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/aee7303c-2c7e-4d9d-8fb7-e130c153f581-config-file\") on node \"ip-10-0-141-141.ec2.internal\" DevicePath \"\"" Jul 11 03:14:07.392410 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:07.392375 2559 generic.go:356] "Generic (PLEG): container finished" podID="aee7303c-2c7e-4d9d-8fb7-e130c153f581" containerID="2a5f9c57793aad228ac496885112ba72eb0369336d2cc1f4c77441bf209d9e22" exitCode=0 Jul 11 03:14:07.392785 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:07.392420 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-l4s58" Jul 11 03:14:07.392785 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:07.392465 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-l4s58" event={"ID":"aee7303c-2c7e-4d9d-8fb7-e130c153f581","Type":"ContainerDied","Data":"2a5f9c57793aad228ac496885112ba72eb0369336d2cc1f4c77441bf209d9e22"} Jul 11 03:14:07.392785 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:07.392547 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-l4s58" event={"ID":"aee7303c-2c7e-4d9d-8fb7-e130c153f581","Type":"ContainerDied","Data":"c1040169365ed7727960c8dfd5727c7d4b593fde41cd8f1f43ef6cbcd006332d"} Jul 11 03:14:07.392785 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:07.392575 2559 scope.go:117] "RemoveContainer" containerID="2a5f9c57793aad228ac496885112ba72eb0369336d2cc1f4c77441bf209d9e22" Jul 11 03:14:07.402133 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:07.402113 2559 scope.go:117] "RemoveContainer" containerID="2a5f9c57793aad228ac496885112ba72eb0369336d2cc1f4c77441bf209d9e22" Jul 11 03:14:07.402388 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:14:07.402360 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2a5f9c57793aad228ac496885112ba72eb0369336d2cc1f4c77441bf209d9e22\": container with ID starting with 2a5f9c57793aad228ac496885112ba72eb0369336d2cc1f4c77441bf209d9e22 not found: ID does not exist" containerID="2a5f9c57793aad228ac496885112ba72eb0369336d2cc1f4c77441bf209d9e22" Jul 11 03:14:07.402453 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:07.402398 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a5f9c57793aad228ac496885112ba72eb0369336d2cc1f4c77441bf209d9e22"} err="failed to get container status \"2a5f9c57793aad228ac496885112ba72eb0369336d2cc1f4c77441bf209d9e22\": rpc error: code = NotFound desc = could not find container \"2a5f9c57793aad228ac496885112ba72eb0369336d2cc1f4c77441bf209d9e22\": container with ID starting with 2a5f9c57793aad228ac496885112ba72eb0369336d2cc1f4c77441bf209d9e22 not found: ID does not exist" Jul 11 03:14:07.413737 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:07.413708 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-l4s58"] Jul 11 03:14:07.415574 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:07.415555 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-l4s58"] Jul 11 03:14:08.615171 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:08.615136 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aee7303c-2c7e-4d9d-8fb7-e130c153f581" path="/var/lib/kubelet/pods/aee7303c-2c7e-4d9d-8fb7-e130c153f581/volumes" Jul 11 03:14:09.161303 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:09.161273 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-bmlk2"] Jul 11 03:14:09.161677 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:09.161661 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aee7303c-2c7e-4d9d-8fb7-e130c153f581" containerName="limitador" Jul 11 03:14:09.161773 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:09.161680 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="aee7303c-2c7e-4d9d-8fb7-e130c153f581" containerName="limitador" Jul 11 03:14:09.161773 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:09.161699 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42794db5-c5d2-45e7-b262-3d850545e397" containerName="authorino" Jul 11 03:14:09.161773 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:09.161707 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="42794db5-c5d2-45e7-b262-3d850545e397" containerName="authorino" Jul 11 03:14:09.161916 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:09.161786 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="aee7303c-2c7e-4d9d-8fb7-e130c153f581" containerName="limitador" Jul 11 03:14:09.161916 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:09.161800 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="42794db5-c5d2-45e7-b262-3d850545e397" containerName="authorino" Jul 11 03:14:09.164863 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:09.164838 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-bmlk2" Jul 11 03:14:09.167411 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:09.167370 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 11 03:14:09.167568 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:09.167431 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\"" Jul 11 03:14:09.168479 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:09.168461 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-k6vbk\"" Jul 11 03:14:09.168581 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:09.168527 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 11 03:14:09.175647 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:09.175625 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-bmlk2"] Jul 11 03:14:09.324757 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:09.324725 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lbm5q\" (UniqueName: \"kubernetes.io/projected/cf62463e-c1bc-426f-a05d-10262082d66a-kube-api-access-lbm5q\") pod \"postgres-69fb4594cf-bmlk2\" (UID: \"cf62463e-c1bc-426f-a05d-10262082d66a\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-bmlk2" Jul 11 03:14:09.324925 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:09.324806 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/cf62463e-c1bc-426f-a05d-10262082d66a-data\") pod \"postgres-69fb4594cf-bmlk2\" (UID: \"cf62463e-c1bc-426f-a05d-10262082d66a\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-bmlk2" Jul 11 03:14:09.425902 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:09.425812 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/cf62463e-c1bc-426f-a05d-10262082d66a-data\") pod \"postgres-69fb4594cf-bmlk2\" (UID: \"cf62463e-c1bc-426f-a05d-10262082d66a\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-bmlk2" Jul 11 03:14:09.425902 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:09.425874 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbm5q\" (UniqueName: \"kubernetes.io/projected/cf62463e-c1bc-426f-a05d-10262082d66a-kube-api-access-lbm5q\") pod \"postgres-69fb4594cf-bmlk2\" (UID: \"cf62463e-c1bc-426f-a05d-10262082d66a\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-bmlk2" Jul 11 03:14:09.426229 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:09.426210 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/cf62463e-c1bc-426f-a05d-10262082d66a-data\") pod \"postgres-69fb4594cf-bmlk2\" (UID: \"cf62463e-c1bc-426f-a05d-10262082d66a\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-bmlk2" Jul 11 03:14:09.434582 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:09.434554 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lbm5q\" (UniqueName: \"kubernetes.io/projected/cf62463e-c1bc-426f-a05d-10262082d66a-kube-api-access-lbm5q\") pod \"postgres-69fb4594cf-bmlk2\" (UID: \"cf62463e-c1bc-426f-a05d-10262082d66a\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-bmlk2" Jul 11 03:14:09.476470 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:09.476429 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-bmlk2" Jul 11 03:14:09.613022 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:09.612996 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-bmlk2"] Jul 11 03:14:09.614846 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:14:09.614813 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf62463e_c1bc_426f_a05d_10262082d66a.slice/crio-f2d33ea3c3f6ecad0ce2464243f8f1fec4c018ff7d9f5e5a623f57ac5f74c100 WatchSource:0}: Error finding container f2d33ea3c3f6ecad0ce2464243f8f1fec4c018ff7d9f5e5a623f57ac5f74c100: Status 404 returned error can't find the container with id f2d33ea3c3f6ecad0ce2464243f8f1fec4c018ff7d9f5e5a623f57ac5f74c100 Jul 11 03:14:10.409298 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:10.409259 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-bmlk2" event={"ID":"cf62463e-c1bc-426f-a05d-10262082d66a","Type":"ContainerStarted","Data":"f2d33ea3c3f6ecad0ce2464243f8f1fec4c018ff7d9f5e5a623f57ac5f74c100"} Jul 11 03:14:15.444524 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:15.444487 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-bmlk2" event={"ID":"cf62463e-c1bc-426f-a05d-10262082d66a","Type":"ContainerStarted","Data":"540f4715c9802850cf45f8eb272ecf478e967c70370391da94fc2c794cf447ef"} Jul 11 03:14:15.445020 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:15.444566 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-bmlk2" Jul 11 03:14:15.462555 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:15.462498 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-bmlk2" podStartSLOduration=1.6001658970000001 podStartE2EDuration="6.462481063s" totalImagesPullingTime="4.862315166s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:14:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:14:15.459979312 +0000 UTC m=+679.428591756" watchObservedRunningTime="2026-07-11 03:14:15.462481063 +0000 UTC m=+679.431093513" Jul 11 03:14:21.480933 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:21.480896 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-bmlk2" Jul 11 03:14:21.992194 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:21.992158 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-qcnbm"] Jul 11 03:14:21.995653 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:21.995634 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-qcnbm" Jul 11 03:14:21.997905 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:21.997885 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-j7p44\"" Jul 11 03:14:22.004086 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:22.004064 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-qcnbm"] Jul 11 03:14:22.025660 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:22.025626 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ngtcg\" (UniqueName: \"kubernetes.io/projected/3f18c66b-a8f9-4fe6-a7d6-75cfb9c57d5b-kube-api-access-ngtcg\") pod \"authorino-5d4b67c446-qcnbm\" (UID: \"3f18c66b-a8f9-4fe6-a7d6-75cfb9c57d5b\") " pod="kuadrant-system/authorino-5d4b67c446-qcnbm" Jul 11 03:14:22.126285 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:22.126246 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ngtcg\" (UniqueName: \"kubernetes.io/projected/3f18c66b-a8f9-4fe6-a7d6-75cfb9c57d5b-kube-api-access-ngtcg\") pod \"authorino-5d4b67c446-qcnbm\" (UID: \"3f18c66b-a8f9-4fe6-a7d6-75cfb9c57d5b\") " pod="kuadrant-system/authorino-5d4b67c446-qcnbm" Jul 11 03:14:22.134409 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:22.134372 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ngtcg\" (UniqueName: \"kubernetes.io/projected/3f18c66b-a8f9-4fe6-a7d6-75cfb9c57d5b-kube-api-access-ngtcg\") pod \"authorino-5d4b67c446-qcnbm\" (UID: \"3f18c66b-a8f9-4fe6-a7d6-75cfb9c57d5b\") " pod="kuadrant-system/authorino-5d4b67c446-qcnbm" Jul 11 03:14:22.215902 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:22.215851 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-qcnbm"] Jul 11 03:14:22.216208 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:22.216192 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-qcnbm" Jul 11 03:14:22.244397 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:22.244319 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7bd76749cb-zcx4f"] Jul 11 03:14:22.248104 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:22.248078 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bd76749cb-zcx4f" Jul 11 03:14:22.255413 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:22.255384 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bd76749cb-zcx4f"] Jul 11 03:14:22.328179 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:22.328099 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nn5nl\" (UniqueName: \"kubernetes.io/projected/172df12d-dfc9-45b8-9dfd-237d838c8702-kube-api-access-nn5nl\") pod \"authorino-7bd76749cb-zcx4f\" (UID: \"172df12d-dfc9-45b8-9dfd-237d838c8702\") " pod="kuadrant-system/authorino-7bd76749cb-zcx4f" Jul 11 03:14:22.341804 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:22.341771 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bd76749cb-zcx4f"] Jul 11 03:14:22.342126 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:14:22.342099 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-nn5nl], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-7bd76749cb-zcx4f" podUID="172df12d-dfc9-45b8-9dfd-237d838c8702" Jul 11 03:14:22.361750 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:22.361715 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-85d64b9d8d-5s4mz"] Jul 11 03:14:22.365050 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:22.365025 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-85d64b9d8d-5s4mz" Jul 11 03:14:22.367374 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:22.367349 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 11 03:14:22.369123 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:22.369096 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-qcnbm"] Jul 11 03:14:22.370812 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:14:22.370790 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3f18c66b_a8f9_4fe6_a7d6_75cfb9c57d5b.slice/crio-c4a9a1279ac99c434bbc49572a0a2461a122368821735a398b4ccc0ed8ad2687 WatchSource:0}: Error finding container c4a9a1279ac99c434bbc49572a0a2461a122368821735a398b4ccc0ed8ad2687: Status 404 returned error can't find the container with id c4a9a1279ac99c434bbc49572a0a2461a122368821735a398b4ccc0ed8ad2687 Jul 11 03:14:22.372950 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:22.372930 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 11 03:14:22.374273 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:22.374253 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-85d64b9d8d-5s4mz"] Jul 11 03:14:22.429292 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:22.429253 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4zbm\" (UniqueName: \"kubernetes.io/projected/e60b1480-cbed-4acf-bf1a-e71a0c22174b-kube-api-access-j4zbm\") pod \"authorino-85d64b9d8d-5s4mz\" (UID: \"e60b1480-cbed-4acf-bf1a-e71a0c22174b\") " pod="kuadrant-system/authorino-85d64b9d8d-5s4mz" Jul 11 03:14:22.429474 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:22.429304 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e60b1480-cbed-4acf-bf1a-e71a0c22174b-tls-cert\") pod \"authorino-85d64b9d8d-5s4mz\" (UID: \"e60b1480-cbed-4acf-bf1a-e71a0c22174b\") " pod="kuadrant-system/authorino-85d64b9d8d-5s4mz" Jul 11 03:14:22.429474 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:22.429344 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nn5nl\" (UniqueName: \"kubernetes.io/projected/172df12d-dfc9-45b8-9dfd-237d838c8702-kube-api-access-nn5nl\") pod \"authorino-7bd76749cb-zcx4f\" (UID: \"172df12d-dfc9-45b8-9dfd-237d838c8702\") " pod="kuadrant-system/authorino-7bd76749cb-zcx4f" Jul 11 03:14:22.437543 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:22.437503 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nn5nl\" (UniqueName: \"kubernetes.io/projected/172df12d-dfc9-45b8-9dfd-237d838c8702-kube-api-access-nn5nl\") pod \"authorino-7bd76749cb-zcx4f\" (UID: \"172df12d-dfc9-45b8-9dfd-237d838c8702\") " pod="kuadrant-system/authorino-7bd76749cb-zcx4f" Jul 11 03:14:22.482297 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:22.482270 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bd76749cb-zcx4f" Jul 11 03:14:22.482770 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:22.482266 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-qcnbm" event={"ID":"3f18c66b-a8f9-4fe6-a7d6-75cfb9c57d5b","Type":"ContainerStarted","Data":"c4a9a1279ac99c434bbc49572a0a2461a122368821735a398b4ccc0ed8ad2687"} Jul 11 03:14:22.490305 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:22.490281 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bd76749cb-zcx4f" Jul 11 03:14:22.530176 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:22.530144 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nn5nl\" (UniqueName: \"kubernetes.io/projected/172df12d-dfc9-45b8-9dfd-237d838c8702-kube-api-access-nn5nl\") pod \"172df12d-dfc9-45b8-9dfd-237d838c8702\" (UID: \"172df12d-dfc9-45b8-9dfd-237d838c8702\") " Jul 11 03:14:22.530417 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:22.530264 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4zbm\" (UniqueName: \"kubernetes.io/projected/e60b1480-cbed-4acf-bf1a-e71a0c22174b-kube-api-access-j4zbm\") pod \"authorino-85d64b9d8d-5s4mz\" (UID: \"e60b1480-cbed-4acf-bf1a-e71a0c22174b\") " pod="kuadrant-system/authorino-85d64b9d8d-5s4mz" Jul 11 03:14:22.530417 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:22.530296 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e60b1480-cbed-4acf-bf1a-e71a0c22174b-tls-cert\") pod \"authorino-85d64b9d8d-5s4mz\" (UID: \"e60b1480-cbed-4acf-bf1a-e71a0c22174b\") " pod="kuadrant-system/authorino-85d64b9d8d-5s4mz" Jul 11 03:14:22.532611 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:22.532564 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/172df12d-dfc9-45b8-9dfd-237d838c8702-kube-api-access-nn5nl" (OuterVolumeSpecName: "kube-api-access-nn5nl") pod "172df12d-dfc9-45b8-9dfd-237d838c8702" (UID: "172df12d-dfc9-45b8-9dfd-237d838c8702"). InnerVolumeSpecName "kube-api-access-nn5nl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 11 03:14:22.532850 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:22.532831 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e60b1480-cbed-4acf-bf1a-e71a0c22174b-tls-cert\") pod \"authorino-85d64b9d8d-5s4mz\" (UID: \"e60b1480-cbed-4acf-bf1a-e71a0c22174b\") " pod="kuadrant-system/authorino-85d64b9d8d-5s4mz" Jul 11 03:14:22.537764 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:22.537738 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4zbm\" (UniqueName: \"kubernetes.io/projected/e60b1480-cbed-4acf-bf1a-e71a0c22174b-kube-api-access-j4zbm\") pod \"authorino-85d64b9d8d-5s4mz\" (UID: \"e60b1480-cbed-4acf-bf1a-e71a0c22174b\") " pod="kuadrant-system/authorino-85d64b9d8d-5s4mz" Jul 11 03:14:22.631460 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:22.631411 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nn5nl\" (UniqueName: \"kubernetes.io/projected/172df12d-dfc9-45b8-9dfd-237d838c8702-kube-api-access-nn5nl\") on node \"ip-10-0-141-141.ec2.internal\" DevicePath \"\"" Jul 11 03:14:22.684228 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:22.684186 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-85d64b9d8d-5s4mz" Jul 11 03:14:22.831262 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:22.831237 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-85d64b9d8d-5s4mz"] Jul 11 03:14:22.833213 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:14:22.833170 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode60b1480_cbed_4acf_bf1a_e71a0c22174b.slice/crio-c0a1fcdfd2b0be11d0d0511202fbd56710c28bf356a2f767e66f928a1c03ddc5 WatchSource:0}: Error finding container c0a1fcdfd2b0be11d0d0511202fbd56710c28bf356a2f767e66f928a1c03ddc5: Status 404 returned error can't find the container with id c0a1fcdfd2b0be11d0d0511202fbd56710c28bf356a2f767e66f928a1c03ddc5 Jul 11 03:14:23.489790 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:23.489682 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-qcnbm" event={"ID":"3f18c66b-a8f9-4fe6-a7d6-75cfb9c57d5b","Type":"ContainerStarted","Data":"68c6877a3042368e766a23bd2019b69957092cd121c24fb225738f5d4a0e3605"} Jul 11 03:14:23.489790 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:23.489695 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-qcnbm" podUID="3f18c66b-a8f9-4fe6-a7d6-75cfb9c57d5b" containerName="authorino" containerID="cri-o://68c6877a3042368e766a23bd2019b69957092cd121c24fb225738f5d4a0e3605" gracePeriod=30 Jul 11 03:14:23.491409 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:23.491378 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-85d64b9d8d-5s4mz" event={"ID":"e60b1480-cbed-4acf-bf1a-e71a0c22174b","Type":"ContainerStarted","Data":"a53d66610f85296709e1ee7a754edc2ebe2d8d0a0d43a363357d8a37c977e2bb"} Jul 11 03:14:23.491536 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:23.491420 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-85d64b9d8d-5s4mz" event={"ID":"e60b1480-cbed-4acf-bf1a-e71a0c22174b","Type":"ContainerStarted","Data":"c0a1fcdfd2b0be11d0d0511202fbd56710c28bf356a2f767e66f928a1c03ddc5"} Jul 11 03:14:23.491536 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:23.491503 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bd76749cb-zcx4f" Jul 11 03:14:23.506763 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:23.506685 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-qcnbm" podStartSLOduration=2.170977739 podStartE2EDuration="2.506668519s" totalImagesPullingTime="335.69078ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:14:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:14:23.505607281 +0000 UTC m=+687.474219733" watchObservedRunningTime="2026-07-11 03:14:23.506668519 +0000 UTC m=+687.475280998" Jul 11 03:14:23.527647 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:23.527612 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bd76749cb-zcx4f"] Jul 11 03:14:23.530200 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:23.530174 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7bd76749cb-zcx4f"] Jul 11 03:14:23.540901 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:23.540847 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-85d64b9d8d-5s4mz" podStartSLOduration=1.218154381 podStartE2EDuration="1.540821732s" totalImagesPullingTime="322.667351ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:14:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:14:23.540192528 +0000 UTC m=+687.508804981" watchObservedRunningTime="2026-07-11 03:14:23.540821732 +0000 UTC m=+687.509434179" Jul 11 03:14:23.771386 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:23.771352 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-qcnbm" Jul 11 03:14:23.842875 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:23.842838 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ngtcg\" (UniqueName: \"kubernetes.io/projected/3f18c66b-a8f9-4fe6-a7d6-75cfb9c57d5b-kube-api-access-ngtcg\") pod \"3f18c66b-a8f9-4fe6-a7d6-75cfb9c57d5b\" (UID: \"3f18c66b-a8f9-4fe6-a7d6-75cfb9c57d5b\") " Jul 11 03:14:23.845075 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:23.845045 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f18c66b-a8f9-4fe6-a7d6-75cfb9c57d5b-kube-api-access-ngtcg" (OuterVolumeSpecName: "kube-api-access-ngtcg") pod "3f18c66b-a8f9-4fe6-a7d6-75cfb9c57d5b" (UID: "3f18c66b-a8f9-4fe6-a7d6-75cfb9c57d5b"). InnerVolumeSpecName "kube-api-access-ngtcg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 11 03:14:23.944174 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:23.944131 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ngtcg\" (UniqueName: \"kubernetes.io/projected/3f18c66b-a8f9-4fe6-a7d6-75cfb9c57d5b-kube-api-access-ngtcg\") on node \"ip-10-0-141-141.ec2.internal\" DevicePath \"\"" Jul 11 03:14:24.497529 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:24.497450 2559 generic.go:356] "Generic (PLEG): container finished" podID="3f18c66b-a8f9-4fe6-a7d6-75cfb9c57d5b" containerID="68c6877a3042368e766a23bd2019b69957092cd121c24fb225738f5d4a0e3605" exitCode=0 Jul 11 03:14:24.497529 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:24.497496 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-qcnbm" Jul 11 03:14:24.497986 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:24.497540 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-qcnbm" event={"ID":"3f18c66b-a8f9-4fe6-a7d6-75cfb9c57d5b","Type":"ContainerDied","Data":"68c6877a3042368e766a23bd2019b69957092cd121c24fb225738f5d4a0e3605"} Jul 11 03:14:24.497986 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:24.497579 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-qcnbm" event={"ID":"3f18c66b-a8f9-4fe6-a7d6-75cfb9c57d5b","Type":"ContainerDied","Data":"c4a9a1279ac99c434bbc49572a0a2461a122368821735a398b4ccc0ed8ad2687"} Jul 11 03:14:24.497986 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:24.497597 2559 scope.go:117] "RemoveContainer" containerID="68c6877a3042368e766a23bd2019b69957092cd121c24fb225738f5d4a0e3605" Jul 11 03:14:24.506710 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:24.506686 2559 scope.go:117] "RemoveContainer" containerID="68c6877a3042368e766a23bd2019b69957092cd121c24fb225738f5d4a0e3605" Jul 11 03:14:24.507068 ip-10-0-141-141 kubenswrapper[2559]: E0711 03:14:24.507050 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"68c6877a3042368e766a23bd2019b69957092cd121c24fb225738f5d4a0e3605\": container with ID starting with 68c6877a3042368e766a23bd2019b69957092cd121c24fb225738f5d4a0e3605 not found: ID does not exist" containerID="68c6877a3042368e766a23bd2019b69957092cd121c24fb225738f5d4a0e3605" Jul 11 03:14:24.507131 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:24.507077 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"68c6877a3042368e766a23bd2019b69957092cd121c24fb225738f5d4a0e3605"} err="failed to get container status \"68c6877a3042368e766a23bd2019b69957092cd121c24fb225738f5d4a0e3605\": rpc error: code = NotFound desc = could not find container \"68c6877a3042368e766a23bd2019b69957092cd121c24fb225738f5d4a0e3605\": container with ID starting with 68c6877a3042368e766a23bd2019b69957092cd121c24fb225738f5d4a0e3605 not found: ID does not exist" Jul 11 03:14:24.518174 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:24.518144 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-qcnbm"] Jul 11 03:14:24.523261 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:24.523235 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-qcnbm"] Jul 11 03:14:24.615498 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:24.615464 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="172df12d-dfc9-45b8-9dfd-237d838c8702" path="/var/lib/kubelet/pods/172df12d-dfc9-45b8-9dfd-237d838c8702/volumes" Jul 11 03:14:24.615735 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:24.615723 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3f18c66b-a8f9-4fe6-a7d6-75cfb9c57d5b" path="/var/lib/kubelet/pods/3f18c66b-a8f9-4fe6-a7d6-75cfb9c57d5b/volumes" Jul 11 03:14:27.792089 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:27.792043 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-85d64b9d8d-5s4mz_e60b1480-cbed-4acf-bf1a-e71a0c22174b/authorino/0.log" Jul 11 03:14:31.135586 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:31.135555 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-86x9k_3ce00c6e-26bd-436e-8bcf-7d9641f767cc/manager/0.log" Jul 11 03:14:31.246510 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:31.246479 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-hs557_c94207ff-0897-4648-8265-7ba6892a2cf6/manager/0.log" Jul 11 03:14:31.358162 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:31.358133 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-88p9z_0a9cd581-d709-4a53-a68a-5e1f42e2df53/server/0.log" Jul 11 03:14:31.474749 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:31.474666 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-bz22q_335bea99-4f0c-472a-9c94-82b4a1f0338d/manager/0.log" Jul 11 03:14:31.714824 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:31.714797 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7dc498c8d4-94dv5_a278b7ab-fb28-4fcf-afd0-f942b720fb20/copy-manifests/0.log" Jul 11 03:14:31.721366 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:31.721337 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7dc498c8d4-94dv5_a278b7ab-fb28-4fcf-afd0-f942b720fb20/manager/0.log" Jul 11 03:14:32.169893 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:32.169864 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-bmlk2_cf62463e-c1bc-426f-a05d-10262082d66a/postgres/0.log" Jul 11 03:14:32.821415 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:32.821388 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cjsr5_0419b137-a8a6-4b40-842b-946847959ed0/extract/0.log" Jul 11 03:14:32.826913 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:32.826889 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cjsr5_0419b137-a8a6-4b40-842b-946847959ed0/util/0.log" Jul 11 03:14:32.832635 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:32.832617 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cjsr5_0419b137-a8a6-4b40-842b-946847959ed0/pull/0.log" Jul 11 03:14:32.943830 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:32.943805 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fvkg4_7583a6a9-23c6-4e26-9c3f-180abd47fe6f/util/0.log" Jul 11 03:14:32.950282 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:32.950257 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fvkg4_7583a6a9-23c6-4e26-9c3f-180abd47fe6f/pull/0.log" Jul 11 03:14:32.956484 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:32.956465 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fvkg4_7583a6a9-23c6-4e26-9c3f-180abd47fe6f/extract/0.log" Jul 11 03:14:33.070044 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:33.070010 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7342kbc_0d799ed7-e4cb-4d50-b6a6-77ae1dba8fba/util/0.log" Jul 11 03:14:33.077156 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:33.077097 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7342kbc_0d799ed7-e4cb-4d50-b6a6-77ae1dba8fba/pull/0.log" Jul 11 03:14:33.083933 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:33.083908 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7342kbc_0d799ed7-e4cb-4d50-b6a6-77ae1dba8fba/extract/0.log" Jul 11 03:14:33.194521 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:33.194492 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t66nr_4606cc70-243f-4873-908e-0ab132049f4e/util/0.log" Jul 11 03:14:33.201405 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:33.201384 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t66nr_4606cc70-243f-4873-908e-0ab132049f4e/pull/0.log" Jul 11 03:14:33.208114 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:33.208093 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t66nr_4606cc70-243f-4873-908e-0ab132049f4e/extract/0.log" Jul 11 03:14:33.320476 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:33.320452 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-85d64b9d8d-5s4mz_e60b1480-cbed-4acf-bf1a-e71a0c22174b/authorino/0.log" Jul 11 03:14:33.437063 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:33.436989 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-5b7pq_91ed20fb-eb56-47eb-bb79-68ff9ce421b8/manager/0.log" Jul 11 03:14:33.547423 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:33.547399 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-fm2pp_17c60af8-bbf8-450f-8214-97db2a3cb84f/manager/0.log" Jul 11 03:14:33.763893 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:33.763812 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-m8zn7_fa092c01-89d8-4a0c-a4a6-20c31ca5eff9/registry-server/0.log" Jul 11 03:14:33.878014 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:33.877988 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-rsnm4_69c26b3f-fe3a-4d18-9869-5c81876f88e3/manager/0.log" Jul 11 03:14:34.433382 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:34.433328 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb6788k5rl_fee6d489-76a7-47d1-b44e-549cbad94d98/istio-proxy/0.log" Jul 11 03:14:34.657520 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:34.657491 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7566565894-c2brf_1972c53a-6d99-4094-9453-b6007073590f/kube-auth-proxy/0.log" Jul 11 03:14:34.885757 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:34.885728 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-jqwkk_b0c70ae8-fc23-4775-81a4-00b56a95b821/istio-proxy/0.log" Jul 11 03:14:41.559232 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:41.559204 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-z7wb6_3f82cf26-f769-4fc3-ad0f-b1042b1f63c0/global-pull-secret-syncer/0.log" Jul 11 03:14:41.622775 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:41.622747 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-fvldx_e01a98e9-1445-401c-b9c5-8cd0ef77d1e6/konnectivity-agent/0.log" Jul 11 03:14:41.719058 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:41.719033 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-141.ec2.internal_f78a7cbe224856398af387ef37689630/haproxy/0.log" Jul 11 03:14:45.720633 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:45.720605 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cjsr5_0419b137-a8a6-4b40-842b-946847959ed0/extract/0.log" Jul 11 03:14:45.742382 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:45.742352 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cjsr5_0419b137-a8a6-4b40-842b-946847959ed0/util/0.log" Jul 11 03:14:45.766162 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:45.766128 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cjsr5_0419b137-a8a6-4b40-842b-946847959ed0/pull/0.log" Jul 11 03:14:45.798252 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:45.798223 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fvkg4_7583a6a9-23c6-4e26-9c3f-180abd47fe6f/extract/0.log" Jul 11 03:14:45.816621 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:45.816595 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fvkg4_7583a6a9-23c6-4e26-9c3f-180abd47fe6f/util/0.log" Jul 11 03:14:45.835628 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:45.835602 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fvkg4_7583a6a9-23c6-4e26-9c3f-180abd47fe6f/pull/0.log" Jul 11 03:14:45.895252 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:45.895228 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7342kbc_0d799ed7-e4cb-4d50-b6a6-77ae1dba8fba/extract/0.log" Jul 11 03:14:45.914360 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:45.914335 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7342kbc_0d799ed7-e4cb-4d50-b6a6-77ae1dba8fba/util/0.log" Jul 11 03:14:45.948131 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:45.948085 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7342kbc_0d799ed7-e4cb-4d50-b6a6-77ae1dba8fba/pull/0.log" Jul 11 03:14:45.975129 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:45.975053 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t66nr_4606cc70-243f-4873-908e-0ab132049f4e/extract/0.log" Jul 11 03:14:46.001684 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:46.001655 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t66nr_4606cc70-243f-4873-908e-0ab132049f4e/util/0.log" Jul 11 03:14:46.024921 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:46.024893 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t66nr_4606cc70-243f-4873-908e-0ab132049f4e/pull/0.log" Jul 11 03:14:46.052311 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:46.052283 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-85d64b9d8d-5s4mz_e60b1480-cbed-4acf-bf1a-e71a0c22174b/authorino/0.log" Jul 11 03:14:46.079778 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:46.079750 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-5b7pq_91ed20fb-eb56-47eb-bb79-68ff9ce421b8/manager/0.log" Jul 11 03:14:46.105400 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:46.105372 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-fm2pp_17c60af8-bbf8-450f-8214-97db2a3cb84f/manager/0.log" Jul 11 03:14:46.168020 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:46.167987 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-m8zn7_fa092c01-89d8-4a0c-a4a6-20c31ca5eff9/registry-server/0.log" Jul 11 03:14:46.210686 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:46.210655 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-rsnm4_69c26b3f-fe3a-4d18-9869-5c81876f88e3/manager/0.log" Jul 11 03:14:48.303702 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:48.303619 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-66f475786-wj46m_4fc67bd8-4094-4629-b494-da78210fa48b/metrics-server/0.log" Jul 11 03:14:48.504246 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:48.504216 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zsnxt_2f36027a-012a-4ff0-9879-d7ba45a44d24/node-exporter/0.log" Jul 11 03:14:48.522751 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:48.522723 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zsnxt_2f36027a-012a-4ff0-9879-d7ba45a44d24/kube-rbac-proxy/0.log" Jul 11 03:14:48.540790 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:48.540758 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zsnxt_2f36027a-012a-4ff0-9879-d7ba45a44d24/init-textfile/0.log" Jul 11 03:14:51.711258 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:51.711228 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-69b94ddfdb-244hl_96c09329-e5bf-42c9-b6e5-fd188bf949eb/console/0.log" Jul 11 03:14:51.933104 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:51.933073 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-sfd22/perf-node-gather-daemonset-2p2pn"] Jul 11 03:14:51.933432 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:51.933421 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f18c66b-a8f9-4fe6-a7d6-75cfb9c57d5b" containerName="authorino" Jul 11 03:14:51.933481 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:51.933435 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f18c66b-a8f9-4fe6-a7d6-75cfb9c57d5b" containerName="authorino" Jul 11 03:14:51.933513 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:51.933489 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f18c66b-a8f9-4fe6-a7d6-75cfb9c57d5b" containerName="authorino" Jul 11 03:14:51.936407 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:51.936389 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-sfd22/perf-node-gather-daemonset-2p2pn" Jul 11 03:14:51.938827 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:51.938803 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-sfd22\"/\"default-dockercfg-kgqz4\"" Jul 11 03:14:51.939008 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:51.938990 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-sfd22\"/\"openshift-service-ca.crt\"" Jul 11 03:14:51.939819 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:51.939807 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-sfd22\"/\"kube-root-ca.crt\"" Jul 11 03:14:51.947485 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:51.947456 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-sfd22/perf-node-gather-daemonset-2p2pn"] Jul 11 03:14:52.094917 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:52.094885 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/38656de6-4fb4-4247-835d-eda722a3be7c-lib-modules\") pod \"perf-node-gather-daemonset-2p2pn\" (UID: \"38656de6-4fb4-4247-835d-eda722a3be7c\") " pod="openshift-must-gather-sfd22/perf-node-gather-daemonset-2p2pn" Jul 11 03:14:52.094917 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:52.094924 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/38656de6-4fb4-4247-835d-eda722a3be7c-sys\") pod \"perf-node-gather-daemonset-2p2pn\" (UID: \"38656de6-4fb4-4247-835d-eda722a3be7c\") " pod="openshift-must-gather-sfd22/perf-node-gather-daemonset-2p2pn" Jul 11 03:14:52.095172 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:52.095095 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/38656de6-4fb4-4247-835d-eda722a3be7c-proc\") pod \"perf-node-gather-daemonset-2p2pn\" (UID: \"38656de6-4fb4-4247-835d-eda722a3be7c\") " pod="openshift-must-gather-sfd22/perf-node-gather-daemonset-2p2pn" Jul 11 03:14:52.095172 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:52.095131 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cx4qp\" (UniqueName: \"kubernetes.io/projected/38656de6-4fb4-4247-835d-eda722a3be7c-kube-api-access-cx4qp\") pod \"perf-node-gather-daemonset-2p2pn\" (UID: \"38656de6-4fb4-4247-835d-eda722a3be7c\") " pod="openshift-must-gather-sfd22/perf-node-gather-daemonset-2p2pn" Jul 11 03:14:52.095172 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:52.095156 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/38656de6-4fb4-4247-835d-eda722a3be7c-podres\") pod \"perf-node-gather-daemonset-2p2pn\" (UID: \"38656de6-4fb4-4247-835d-eda722a3be7c\") " pod="openshift-must-gather-sfd22/perf-node-gather-daemonset-2p2pn" Jul 11 03:14:52.196204 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:52.196166 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/38656de6-4fb4-4247-835d-eda722a3be7c-podres\") pod \"perf-node-gather-daemonset-2p2pn\" (UID: \"38656de6-4fb4-4247-835d-eda722a3be7c\") " pod="openshift-must-gather-sfd22/perf-node-gather-daemonset-2p2pn" Jul 11 03:14:52.196384 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:52.196215 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/38656de6-4fb4-4247-835d-eda722a3be7c-lib-modules\") pod \"perf-node-gather-daemonset-2p2pn\" (UID: \"38656de6-4fb4-4247-835d-eda722a3be7c\") " pod="openshift-must-gather-sfd22/perf-node-gather-daemonset-2p2pn" Jul 11 03:14:52.196384 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:52.196254 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/38656de6-4fb4-4247-835d-eda722a3be7c-sys\") pod \"perf-node-gather-daemonset-2p2pn\" (UID: \"38656de6-4fb4-4247-835d-eda722a3be7c\") " pod="openshift-must-gather-sfd22/perf-node-gather-daemonset-2p2pn" Jul 11 03:14:52.196384 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:52.196325 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/38656de6-4fb4-4247-835d-eda722a3be7c-proc\") pod \"perf-node-gather-daemonset-2p2pn\" (UID: \"38656de6-4fb4-4247-835d-eda722a3be7c\") " pod="openshift-must-gather-sfd22/perf-node-gather-daemonset-2p2pn" Jul 11 03:14:52.196384 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:52.196344 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cx4qp\" (UniqueName: \"kubernetes.io/projected/38656de6-4fb4-4247-835d-eda722a3be7c-kube-api-access-cx4qp\") pod \"perf-node-gather-daemonset-2p2pn\" (UID: \"38656de6-4fb4-4247-835d-eda722a3be7c\") " pod="openshift-must-gather-sfd22/perf-node-gather-daemonset-2p2pn" Jul 11 03:14:52.196384 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:52.196347 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/38656de6-4fb4-4247-835d-eda722a3be7c-podres\") pod \"perf-node-gather-daemonset-2p2pn\" (UID: \"38656de6-4fb4-4247-835d-eda722a3be7c\") " pod="openshift-must-gather-sfd22/perf-node-gather-daemonset-2p2pn" Jul 11 03:14:52.196579 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:52.196399 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/38656de6-4fb4-4247-835d-eda722a3be7c-lib-modules\") pod \"perf-node-gather-daemonset-2p2pn\" (UID: \"38656de6-4fb4-4247-835d-eda722a3be7c\") " pod="openshift-must-gather-sfd22/perf-node-gather-daemonset-2p2pn" Jul 11 03:14:52.196579 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:52.196420 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/38656de6-4fb4-4247-835d-eda722a3be7c-sys\") pod \"perf-node-gather-daemonset-2p2pn\" (UID: \"38656de6-4fb4-4247-835d-eda722a3be7c\") " pod="openshift-must-gather-sfd22/perf-node-gather-daemonset-2p2pn" Jul 11 03:14:52.196579 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:52.196439 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/38656de6-4fb4-4247-835d-eda722a3be7c-proc\") pod \"perf-node-gather-daemonset-2p2pn\" (UID: \"38656de6-4fb4-4247-835d-eda722a3be7c\") " pod="openshift-must-gather-sfd22/perf-node-gather-daemonset-2p2pn" Jul 11 03:14:52.204296 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:52.204262 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cx4qp\" (UniqueName: \"kubernetes.io/projected/38656de6-4fb4-4247-835d-eda722a3be7c-kube-api-access-cx4qp\") pod \"perf-node-gather-daemonset-2p2pn\" (UID: \"38656de6-4fb4-4247-835d-eda722a3be7c\") " pod="openshift-must-gather-sfd22/perf-node-gather-daemonset-2p2pn" Jul 11 03:14:52.247338 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:52.247301 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-sfd22/perf-node-gather-daemonset-2p2pn" Jul 11 03:14:52.407894 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:52.407863 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-sfd22/perf-node-gather-daemonset-2p2pn"] Jul 11 03:14:52.410014 ip-10-0-141-141 kubenswrapper[2559]: W0711 03:14:52.409985 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod38656de6_4fb4_4247_835d_eda722a3be7c.slice/crio-4838fe3c611d9e3167c1e44edab2e828aa1c6150294a42ceba3c4e98c9e0a29a WatchSource:0}: Error finding container 4838fe3c611d9e3167c1e44edab2e828aa1c6150294a42ceba3c4e98c9e0a29a: Status 404 returned error can't find the container with id 4838fe3c611d9e3167c1e44edab2e828aa1c6150294a42ceba3c4e98c9e0a29a Jul 11 03:14:52.638343 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:52.638256 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sfd22/perf-node-gather-daemonset-2p2pn" event={"ID":"38656de6-4fb4-4247-835d-eda722a3be7c","Type":"ContainerStarted","Data":"3332065da333a900b0dad95a6757626082e8c1cccc1f0a0f90343f7b4d22bb8e"} Jul 11 03:14:52.638343 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:52.638307 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sfd22/perf-node-gather-daemonset-2p2pn" event={"ID":"38656de6-4fb4-4247-835d-eda722a3be7c","Type":"ContainerStarted","Data":"4838fe3c611d9e3167c1e44edab2e828aa1c6150294a42ceba3c4e98c9e0a29a"} Jul 11 03:14:52.638343 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:52.638333 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-sfd22/perf-node-gather-daemonset-2p2pn" Jul 11 03:14:52.654742 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:52.654673 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-sfd22/perf-node-gather-daemonset-2p2pn" podStartSLOduration=1.654657314 podStartE2EDuration="1.654657314s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 03:14:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:14:52.65237175 +0000 UTC m=+716.620984203" watchObservedRunningTime="2026-07-11 03:14:52.654657314 +0000 UTC m=+716.623269765" Jul 11 03:14:53.403778 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:53.403746 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-n2kth_cc8bfa4f-eaf4-4b7e-bc00-bff618dfeacd/dns/0.log" Jul 11 03:14:53.422640 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:53.422618 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-n2kth_cc8bfa4f-eaf4-4b7e-bc00-bff618dfeacd/kube-rbac-proxy/0.log" Jul 11 03:14:53.513849 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:53.513815 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-t56cx_bc91021e-ef93-462d-a80d-130775629ff9/dns-node-resolver/0.log" Jul 11 03:14:54.019061 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:54.019027 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-68db5c7c66-v5d5w_31daaeaf-20c6-4b42-9aa7-5abba272b150/registry/0.log" Jul 11 03:14:54.080420 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:54.080393 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-w6296_29122b3c-c77b-45e1-97db-b2332bfd92cc/node-ca/0.log" Jul 11 03:14:54.943266 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:54.943234 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb6788k5rl_fee6d489-76a7-47d1-b44e-549cbad94d98/istio-proxy/0.log" Jul 11 03:14:54.996303 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:54.996277 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7566565894-c2brf_1972c53a-6d99-4094-9453-b6007073590f/kube-auth-proxy/0.log" Jul 11 03:14:55.049703 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:55.049675 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-jqwkk_b0c70ae8-fc23-4775-81a4-00b56a95b821/istio-proxy/0.log" Jul 11 03:14:55.634992 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:55.634950 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-lctnz_252b2aed-79e7-440f-bcc4-1f147e071cbf/serve-healthcheck-canary/0.log" Jul 11 03:14:56.276749 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:56.276720 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-sl7bx_1c439238-aae6-48ae-ba56-d6fe883732c2/kube-rbac-proxy/0.log" Jul 11 03:14:56.296393 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:56.296368 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-sl7bx_1c439238-aae6-48ae-ba56-d6fe883732c2/exporter/0.log" Jul 11 03:14:56.316383 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:56.316357 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-sl7bx_1c439238-aae6-48ae-ba56-d6fe883732c2/extractor/0.log" Jul 11 03:14:58.344014 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:58.343985 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-86x9k_3ce00c6e-26bd-436e-8bcf-7d9641f767cc/manager/0.log" Jul 11 03:14:58.366934 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:58.366908 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-hs557_c94207ff-0897-4648-8265-7ba6892a2cf6/manager/0.log" Jul 11 03:14:58.389155 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:58.389132 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-88p9z_0a9cd581-d709-4a53-a68a-5e1f42e2df53/server/0.log" Jul 11 03:14:58.429887 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:58.429858 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-bz22q_335bea99-4f0c-472a-9c94-82b4a1f0338d/manager/0.log" Jul 11 03:14:58.511398 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:58.511367 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7dc498c8d4-94dv5_a278b7ab-fb28-4fcf-afd0-f942b720fb20/manager/0.log" Jul 11 03:14:58.529391 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:58.529363 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7dc498c8d4-94dv5_a278b7ab-fb28-4fcf-afd0-f942b720fb20/copy-manifests/0.log" Jul 11 03:14:58.654178 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:14:58.654100 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-sfd22/perf-node-gather-daemonset-2p2pn" Jul 11 03:15:01.959220 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:15:01.959130 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb6788k5rl_fee6d489-76a7-47d1-b44e-549cbad94d98/istio-proxy/0.log" Jul 11 03:15:02.003333 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:15:02.003306 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7566565894-c2brf_1972c53a-6d99-4094-9453-b6007073590f/kube-auth-proxy/0.log" Jul 11 03:15:02.035353 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:15:02.035318 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-jqwkk_b0c70ae8-fc23-4775-81a4-00b56a95b821/istio-proxy/0.log" Jul 11 03:15:03.286663 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:15:03.286638 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb6788k5rl_fee6d489-76a7-47d1-b44e-549cbad94d98/istio-proxy/0.log" Jul 11 03:15:03.328144 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:15:03.328116 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7566565894-c2brf_1972c53a-6d99-4094-9453-b6007073590f/kube-auth-proxy/0.log" Jul 11 03:15:03.366924 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:15:03.366896 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-jqwkk_b0c70ae8-fc23-4775-81a4-00b56a95b821/istio-proxy/0.log" Jul 11 03:15:06.216042 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:15:06.216015 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-f7sb8_b9e9a007-7d90-418e-b327-13b3f2ed817f/kube-multus-additional-cni-plugins/0.log" Jul 11 03:15:06.236215 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:15:06.236158 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-f7sb8_b9e9a007-7d90-418e-b327-13b3f2ed817f/egress-router-binary-copy/0.log" Jul 11 03:15:06.255530 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:15:06.255507 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-f7sb8_b9e9a007-7d90-418e-b327-13b3f2ed817f/cni-plugins/0.log" Jul 11 03:15:06.274260 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:15:06.274233 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-f7sb8_b9e9a007-7d90-418e-b327-13b3f2ed817f/bond-cni-plugin/0.log" Jul 11 03:15:06.293328 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:15:06.293297 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-f7sb8_b9e9a007-7d90-418e-b327-13b3f2ed817f/routeoverride-cni/0.log" Jul 11 03:15:06.312150 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:15:06.312126 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-f7sb8_b9e9a007-7d90-418e-b327-13b3f2ed817f/whereabouts-cni-bincopy/0.log" Jul 11 03:15:06.330911 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:15:06.330876 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-f7sb8_b9e9a007-7d90-418e-b327-13b3f2ed817f/whereabouts-cni/0.log" Jul 11 03:15:06.661868 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:15:06.661832 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-wg5xr_994a29f5-0a6e-4e78-a413-99d5eb63cad7/kube-multus/0.log" Jul 11 03:15:06.718832 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:15:06.718796 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-v9zw2_e1553e4e-4895-4ef5-9027-14635923ec65/network-metrics-daemon/0.log" Jul 11 03:15:06.737132 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:15:06.737097 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-v9zw2_e1553e4e-4895-4ef5-9027-14635923ec65/kube-rbac-proxy/0.log" Jul 11 03:15:07.738940 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:15:07.738907 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hb24z_4287b506-42a9-4b1d-85e8-91008605fd2c/ovn-controller/0.log" Jul 11 03:15:07.759517 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:15:07.759203 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hb24z_4287b506-42a9-4b1d-85e8-91008605fd2c/ovn-acl-logging/1.log" Jul 11 03:15:07.759517 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:15:07.759221 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hb24z_4287b506-42a9-4b1d-85e8-91008605fd2c/ovn-acl-logging/0.log" Jul 11 03:15:07.778733 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:15:07.778699 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hb24z_4287b506-42a9-4b1d-85e8-91008605fd2c/kube-rbac-proxy-node/0.log" Jul 11 03:15:07.799491 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:15:07.799460 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hb24z_4287b506-42a9-4b1d-85e8-91008605fd2c/kube-rbac-proxy-ovn-metrics/0.log" Jul 11 03:15:07.815996 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:15:07.815953 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hb24z_4287b506-42a9-4b1d-85e8-91008605fd2c/northd/0.log" Jul 11 03:15:07.835598 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:15:07.835570 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hb24z_4287b506-42a9-4b1d-85e8-91008605fd2c/nbdb/0.log" Jul 11 03:15:07.856516 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:15:07.856488 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hb24z_4287b506-42a9-4b1d-85e8-91008605fd2c/sbdb/0.log" Jul 11 03:15:07.920158 ip-10-0-141-141 kubenswrapper[2559]: I0711 03:15:07.920124 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hb24z_4287b506-42a9-4b1d-85e8-91008605fd2c/ovnkube-controller/0.log"