Jul 30 19:37:31.415038 ip-10-0-136-46 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 30 19:37:31.415051 ip-10-0-136-46 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 30 19:37:31.415061 ip-10-0-136-46 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 30 19:37:31.415543 ip-10-0-136-46 systemd[1]: Failed to start Kubernetes Kubelet. Jul 30 19:37:41.260907 ip-10-0-136-46 systemd[1]: kubelet.service: Failed to schedule restart job: Unit openvswitch.service not found. Jul 30 19:37:41.260922 ip-10-0-136-46 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot fe00ff682a51471e9cbb826d197a26ee -- Jul 30 19:39:24.159577 ip-10-0-136-46 systemd[1]: Starting Kubernetes Kubelet... Jul 30 19:39:24.545558 ip-10-0-136-46 kubenswrapper[2555]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 30 19:39:24.545558 ip-10-0-136-46 kubenswrapper[2555]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 30 19:39:24.545558 ip-10-0-136-46 kubenswrapper[2555]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 30 19:39:24.545558 ip-10-0-136-46 kubenswrapper[2555]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 30 19:39:24.545558 ip-10-0-136-46 kubenswrapper[2555]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 30 19:39:24.546470 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.546368 2555 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 30 19:39:24.553853 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.553836 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 30 19:39:24.553853 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.553851 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 30 19:39:24.553853 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.553855 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 30 19:39:24.553958 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.553858 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 30 19:39:24.553958 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.553861 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 30 19:39:24.553958 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.553865 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 30 19:39:24.553958 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.553867 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 30 19:39:24.553958 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.553872 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 30 19:39:24.553958 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.553876 2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 30 19:39:24.553958 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.553879 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 30 19:39:24.553958 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.553881 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 30 19:39:24.553958 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.553884 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 30 19:39:24.553958 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.553891 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 30 19:39:24.553958 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.553894 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 30 19:39:24.553958 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.553897 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 30 19:39:24.553958 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.553901 2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 30 19:39:24.553958 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.553904 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 30 19:39:24.553958 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.553907 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 30 19:39:24.553958 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.553910 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 30 19:39:24.553958 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.553913 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 30 19:39:24.553958 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.553915 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 30 19:39:24.553958 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.553918 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 30 19:39:24.554434 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.553920 2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 30 19:39:24.554434 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.553923 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 30 19:39:24.554434 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.553925 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 30 19:39:24.554434 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.553928 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 30 19:39:24.554434 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.553930 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 30 19:39:24.554434 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.553933 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 30 19:39:24.554434 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.553935 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 30 19:39:24.554434 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.553938 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 30 19:39:24.554434 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.553942 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 30 19:39:24.554434 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.553945 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 30 19:39:24.554434 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.553948 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 30 19:39:24.554434 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.553951 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 30 19:39:24.554434 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.553954 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 30 19:39:24.554434 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.553956 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 30 19:39:24.554434 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.553960 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 30 19:39:24.554434 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.553963 2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 30 19:39:24.554434 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.553966 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 30 19:39:24.554434 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.553970 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 30 19:39:24.554434 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.553973 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 30 19:39:24.554434 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.553976 2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 30 19:39:24.554913 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.553979 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 30 19:39:24.554913 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.553981 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 30 19:39:24.554913 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.553985 2555 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 30 19:39:24.554913 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.553987 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 30 19:39:24.554913 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.553990 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 30 19:39:24.554913 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.553993 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 30 19:39:24.554913 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.553996 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 30 19:39:24.554913 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.553998 2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 30 19:39:24.554913 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.554001 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 30 19:39:24.554913 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.554003 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 30 19:39:24.554913 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.554005 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 30 19:39:24.554913 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.554008 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 30 19:39:24.554913 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.554010 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 30 19:39:24.554913 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.554013 2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 30 19:39:24.554913 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.554015 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 30 19:39:24.554913 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.554018 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 30 19:39:24.554913 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.554020 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 30 19:39:24.554913 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.554023 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 30 19:39:24.554913 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.554025 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 30 19:39:24.554913 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.554027 2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 30 19:39:24.555410 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.554030 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 30 19:39:24.555410 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.554032 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 30 19:39:24.555410 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.554035 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 30 19:39:24.555410 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.554037 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 30 19:39:24.555410 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.554040 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 30 19:39:24.555410 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.554044 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 30 19:39:24.555410 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.554048 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 30 19:39:24.555410 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.554052 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 30 19:39:24.555410 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.554055 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 30 19:39:24.555410 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.554057 2555 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 30 19:39:24.555410 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.554060 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 30 19:39:24.555410 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.554063 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 30 19:39:24.555410 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.554065 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 30 19:39:24.555410 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.554068 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 30 19:39:24.555410 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.554071 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 30 19:39:24.555410 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.554074 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 30 19:39:24.555410 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.554076 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 30 19:39:24.555410 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.554079 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 30 19:39:24.555410 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.554082 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 30 19:39:24.555410 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.554084 2555 feature_gate.go:328] unrecognized feature gate: Example Jul 30 19:39:24.555874 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.554087 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 30 19:39:24.555874 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.554089 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 30 19:39:24.555874 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.554092 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 30 19:39:24.555874 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.554094 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 30 19:39:24.555874 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.554096 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 30 19:39:24.555874 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.554099 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 30 19:39:24.555874 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.554101 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 30 19:39:24.555874 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.554104 2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 30 19:39:24.555874 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.554107 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 30 19:39:24.555874 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.554109 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 30 19:39:24.555874 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.554112 2555 feature_gate.go:328] unrecognized feature gate: Example2 Jul 30 19:39:24.555874 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.554114 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 30 19:39:24.555874 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.554117 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 30 19:39:24.555874 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.554119 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 30 19:39:24.555874 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.554122 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 30 19:39:24.555874 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.554124 2555 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 30 19:39:24.555874 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.554127 2555 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 30 19:39:24.556518 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.556372 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 30 19:39:24.556518 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.556390 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 30 19:39:24.556518 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.556396 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 30 19:39:24.556518 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.556402 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 30 19:39:24.556518 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.556406 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 30 19:39:24.556518 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.556411 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 30 19:39:24.556518 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.556416 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 30 19:39:24.556518 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.556420 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 30 19:39:24.556518 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.556425 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 30 19:39:24.556518 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.556429 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 30 19:39:24.556518 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.556439 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 30 19:39:24.556518 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.556443 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 30 19:39:24.556518 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.556448 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 30 19:39:24.556518 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.556453 2555 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 30 19:39:24.556518 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.556457 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 30 19:39:24.556518 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.556461 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 30 19:39:24.556518 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.556466 2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 30 19:39:24.556518 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.556472 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 30 19:39:24.556518 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.556479 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 30 19:39:24.556518 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.556484 2555 feature_gate.go:328] unrecognized feature gate: Example Jul 30 19:39:24.557243 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.556489 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 30 19:39:24.557243 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.556494 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 30 19:39:24.557243 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.556503 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 30 19:39:24.557243 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.556507 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 30 19:39:24.557243 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.556512 2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 30 19:39:24.557243 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.556516 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 30 19:39:24.557243 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.556520 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 30 19:39:24.557243 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.556525 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 30 19:39:24.557243 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.556530 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 30 19:39:24.557243 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.556535 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 30 19:39:24.557243 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.556539 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 30 19:39:24.557243 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.556544 2555 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 30 19:39:24.557243 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.556548 2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 30 19:39:24.557243 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.556552 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 30 19:39:24.557243 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.556557 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 30 19:39:24.557243 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.556566 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 30 19:39:24.557243 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.556570 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 30 19:39:24.557243 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.556574 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 30 19:39:24.557243 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.556578 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 30 19:39:24.557243 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.556583 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 30 19:39:24.557756 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.556587 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 30 19:39:24.557756 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.556590 2555 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 30 19:39:24.557756 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.556594 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 30 19:39:24.557756 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.556598 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 30 19:39:24.557756 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.556602 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 30 19:39:24.557756 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.556606 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 30 19:39:24.557756 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.556612 2555 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 30 19:39:24.557756 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.556620 2555 feature_gate.go:328] unrecognized feature gate: Example2 Jul 30 19:39:24.557756 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.556624 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 30 19:39:24.557756 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.556628 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 30 19:39:24.557756 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.556635 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 30 19:39:24.557756 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.556642 2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 30 19:39:24.557756 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.556647 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 30 19:39:24.557756 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.556652 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 30 19:39:24.557756 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.556657 2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 30 19:39:24.557756 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.556663 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 30 19:39:24.557756 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.556668 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 30 19:39:24.557756 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.556672 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 30 19:39:24.557756 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.556677 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 30 19:39:24.557756 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.556686 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 30 19:39:24.558254 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.556690 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 30 19:39:24.558254 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.556694 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 30 19:39:24.558254 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.556698 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 30 19:39:24.558254 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.556702 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 30 19:39:24.558254 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.556708 2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 30 19:39:24.558254 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.556714 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 30 19:39:24.558254 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.556722 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 30 19:39:24.558254 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.556727 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 30 19:39:24.558254 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.556732 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 30 19:39:24.558254 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.556736 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 30 19:39:24.558254 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.556745 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 30 19:39:24.558254 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.556749 2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 30 19:39:24.558254 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.556754 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 30 19:39:24.558254 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.556758 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 30 19:39:24.558254 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.556762 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 30 19:39:24.558254 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.556766 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 30 19:39:24.558254 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.556770 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 30 19:39:24.558254 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.556774 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 30 19:39:24.558254 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.556778 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 30 19:39:24.558736 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.556781 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 30 19:39:24.558736 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.556786 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 30 19:39:24.558736 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.556790 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 30 19:39:24.558736 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.556794 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 30 19:39:24.558736 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.556803 2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 30 19:39:24.558736 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.556808 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 30 19:39:24.558736 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.556814 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 30 19:39:24.558736 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.556818 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 30 19:39:24.558736 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.556822 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 30 19:39:24.558736 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.556827 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 30 19:39:24.558736 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.556831 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 30 19:39:24.558736 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.556836 2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 30 19:39:24.558736 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.556840 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 30 19:39:24.558736 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.557326 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 30 19:39:24.558736 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.557457 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 30 19:39:24.558736 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.557462 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 30 19:39:24.558736 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.557466 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 30 19:39:24.558736 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.557470 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 30 19:39:24.558736 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.557474 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 30 19:39:24.558736 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.557479 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 30 19:39:24.559213 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.558002 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 30 19:39:24.559213 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.558012 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 30 19:39:24.559213 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.558018 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 30 19:39:24.559213 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.558023 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 30 19:39:24.559213 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.558027 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 30 19:39:24.559213 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.558031 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 30 19:39:24.559213 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.558035 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 30 19:39:24.559213 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.558039 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 30 19:39:24.559213 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.558043 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 30 19:39:24.559213 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.558047 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 30 19:39:24.559213 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.558052 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 30 19:39:24.559213 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.558055 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 30 19:39:24.559213 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.558059 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 30 19:39:24.559213 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.558063 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 30 19:39:24.559213 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.558067 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 30 19:39:24.559213 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.558071 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 30 19:39:24.559213 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.558075 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 30 19:39:24.559213 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.558079 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 30 19:39:24.559213 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.558082 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 30 19:39:24.559713 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.558086 2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 30 19:39:24.559713 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.558089 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 30 19:39:24.559713 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.558093 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 30 19:39:24.559713 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.558097 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 30 19:39:24.559713 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.558101 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 30 19:39:24.559713 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.558105 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 30 19:39:24.559713 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.558109 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 30 19:39:24.559713 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.558113 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 30 19:39:24.559713 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.558117 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 30 19:39:24.559713 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.558121 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 30 19:39:24.559713 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.558124 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 30 19:39:24.559713 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.558129 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 30 19:39:24.559713 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.558132 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 30 19:39:24.559713 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.558136 2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 30 19:39:24.559713 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.558139 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 30 19:39:24.559713 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.558143 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 30 19:39:24.559713 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.558147 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 30 19:39:24.559713 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.558150 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 30 19:39:24.559713 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.558154 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 30 19:39:24.559713 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.558157 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 30 19:39:24.560175 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.558161 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 30 19:39:24.560175 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.558165 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 30 19:39:24.560175 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.558169 2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 30 19:39:24.560175 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.558172 2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 30 19:39:24.560175 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.558176 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 30 19:39:24.560175 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.558179 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 30 19:39:24.560175 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.558182 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 30 19:39:24.560175 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.558187 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 30 19:39:24.560175 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.558191 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 30 19:39:24.560175 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.558195 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 30 19:39:24.560175 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.558198 2555 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 30 19:39:24.560175 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.558201 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 30 19:39:24.560175 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.558205 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 30 19:39:24.560175 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.558209 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 30 19:39:24.560175 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.558212 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 30 19:39:24.560175 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.558217 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 30 19:39:24.560175 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.558240 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 30 19:39:24.560175 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.558245 2555 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 30 19:39:24.560175 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.558249 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 30 19:39:24.560175 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.558255 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 30 19:39:24.560658 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.558259 2555 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 30 19:39:24.560658 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.558263 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 30 19:39:24.560658 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.558267 2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 30 19:39:24.560658 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.558271 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 30 19:39:24.560658 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.558274 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 30 19:39:24.560658 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.558279 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 30 19:39:24.560658 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.558284 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 30 19:39:24.560658 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.558288 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 30 19:39:24.560658 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.558305 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 30 19:39:24.560658 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.558309 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 30 19:39:24.560658 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.558313 2555 feature_gate.go:328] unrecognized feature gate: Example Jul 30 19:39:24.560658 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.558318 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 30 19:39:24.560658 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.558322 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 30 19:39:24.560658 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.558326 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 30 19:39:24.560658 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.558331 2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 30 19:39:24.560658 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.558336 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 30 19:39:24.560658 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.558340 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 30 19:39:24.560658 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.558344 2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 30 19:39:24.560658 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.558348 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 30 19:39:24.561137 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.558352 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 30 19:39:24.561137 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.558356 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 30 19:39:24.561137 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.558360 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 30 19:39:24.561137 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.558363 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 30 19:39:24.561137 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.558368 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 30 19:39:24.561137 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.558372 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 30 19:39:24.561137 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.558376 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 30 19:39:24.561137 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.558379 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 30 19:39:24.561137 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.558382 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 30 19:39:24.561137 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.558386 2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 30 19:39:24.561137 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.558393 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 30 19:39:24.561137 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.558397 2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 30 19:39:24.561137 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.558400 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 30 19:39:24.561137 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.558404 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 30 19:39:24.561137 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.558407 2555 feature_gate.go:328] unrecognized feature gate: Example2 Jul 30 19:39:24.561137 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.558411 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 30 19:39:24.561137 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.558415 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 30 19:39:24.561137 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.558418 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 30 19:39:24.561137 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.558421 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 30 19:39:24.561137 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.558425 2555 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 30 19:39:24.561625 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.558429 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 30 19:39:24.561625 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.558515 2555 flags.go:64] FLAG: --address="0.0.0.0" Jul 30 19:39:24.561625 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.558524 2555 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 30 19:39:24.561625 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.558532 2555 flags.go:64] FLAG: --anonymous-auth="true" Jul 30 19:39:24.561625 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.558538 2555 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 30 19:39:24.561625 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.558544 2555 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 30 19:39:24.561625 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.558548 2555 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 30 19:39:24.561625 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.558554 2555 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 30 19:39:24.561625 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.558560 2555 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 30 19:39:24.561625 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.558564 2555 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 30 19:39:24.561625 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.558568 2555 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 30 19:39:24.561625 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.558574 2555 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 30 19:39:24.561625 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.558579 2555 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 30 19:39:24.561625 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.558583 2555 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 30 19:39:24.561625 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.558587 2555 flags.go:64] FLAG: --cgroup-root="" Jul 30 19:39:24.561625 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.558592 2555 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 30 19:39:24.561625 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.558596 2555 flags.go:64] FLAG: --client-ca-file="" Jul 30 19:39:24.561625 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.558602 2555 flags.go:64] FLAG: --cloud-provider="external" Jul 30 19:39:24.561625 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.558606 2555 flags.go:64] FLAG: --cluster-dns="[]" Jul 30 19:39:24.561625 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.558612 2555 flags.go:64] FLAG: --cluster-domain="" Jul 30 19:39:24.561625 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.558616 2555 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 30 19:39:24.561625 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.558621 2555 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 30 19:39:24.561625 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.558628 2555 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 30 19:39:24.561625 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.558633 2555 flags.go:64] FLAG: --container-log-max-files="5" Jul 30 19:39:24.562196 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.558638 2555 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 30 19:39:24.562196 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.558642 2555 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 30 19:39:24.562196 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.558646 2555 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 30 19:39:24.562196 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.558651 2555 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 30 19:39:24.562196 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.558655 2555 flags.go:64] FLAG: --contention-profiling="false" Jul 30 19:39:24.562196 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.558659 2555 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 30 19:39:24.562196 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.558663 2555 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 30 19:39:24.562196 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.558668 2555 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 30 19:39:24.562196 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.558672 2555 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 30 19:39:24.562196 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.558677 2555 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 30 19:39:24.562196 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.558681 2555 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 30 19:39:24.562196 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.558685 2555 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 30 19:39:24.562196 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.558690 2555 flags.go:64] FLAG: --enable-load-reader="false" Jul 30 19:39:24.562196 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.558694 2555 flags.go:64] FLAG: --enable-server="true" Jul 30 19:39:24.562196 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.558698 2555 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 30 19:39:24.562196 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.558704 2555 flags.go:64] FLAG: --event-burst="100" Jul 30 19:39:24.562196 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.558708 2555 flags.go:64] FLAG: --event-qps="50" Jul 30 19:39:24.562196 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.558712 2555 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 30 19:39:24.562196 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.558717 2555 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 30 19:39:24.562196 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.558720 2555 flags.go:64] FLAG: --eviction-hard="" Jul 30 19:39:24.562196 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.558726 2555 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 30 19:39:24.562196 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.558730 2555 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 30 19:39:24.562196 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.558735 2555 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 30 19:39:24.562196 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.558739 2555 flags.go:64] FLAG: --eviction-soft="" Jul 30 19:39:24.562196 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.558743 2555 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 30 19:39:24.562789 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.558748 2555 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 30 19:39:24.562789 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.558753 2555 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 30 19:39:24.562789 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.558757 2555 flags.go:64] FLAG: --experimental-mounter-path="" Jul 30 19:39:24.562789 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.558761 2555 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 30 19:39:24.562789 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.558766 2555 flags.go:64] FLAG: --fail-swap-on="true" Jul 30 19:39:24.562789 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.558770 2555 flags.go:64] FLAG: --feature-gates="" Jul 30 19:39:24.562789 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.558776 2555 flags.go:64] FLAG: --file-check-frequency="20s" Jul 30 19:39:24.562789 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.558780 2555 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 30 19:39:24.562789 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.558784 2555 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 30 19:39:24.562789 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.558789 2555 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 30 19:39:24.562789 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.558793 2555 flags.go:64] FLAG: --healthz-port="10248" Jul 30 19:39:24.562789 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.558797 2555 flags.go:64] FLAG: --help="false" Jul 30 19:39:24.562789 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.558801 2555 flags.go:64] FLAG: --hostname-override="ip-10-0-136-46.ec2.internal" Jul 30 19:39:24.562789 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.558806 2555 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 30 19:39:24.562789 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.558810 2555 flags.go:64] FLAG: --http-check-frequency="20s" Jul 30 19:39:24.562789 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.558814 2555 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 30 19:39:24.562789 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.558819 2555 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 30 19:39:24.562789 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.558824 2555 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 30 19:39:24.562789 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.558828 2555 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 30 19:39:24.562789 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.558832 2555 flags.go:64] FLAG: --image-service-endpoint="" Jul 30 19:39:24.562789 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.558836 2555 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 30 19:39:24.562789 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.558840 2555 flags.go:64] FLAG: --kube-api-burst="100" Jul 30 19:39:24.562789 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.558844 2555 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 30 19:39:24.563389 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.558848 2555 flags.go:64] FLAG: --kube-api-qps="50" Jul 30 19:39:24.563389 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.558852 2555 flags.go:64] FLAG: --kube-reserved="" Jul 30 19:39:24.563389 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.558856 2555 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 30 19:39:24.563389 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.558860 2555 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 30 19:39:24.563389 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.558864 2555 flags.go:64] FLAG: --kubelet-cgroups="" Jul 30 19:39:24.563389 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.558868 2555 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 30 19:39:24.563389 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.558872 2555 flags.go:64] FLAG: --lock-file="" Jul 30 19:39:24.563389 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.558876 2555 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 30 19:39:24.563389 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.558881 2555 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 30 19:39:24.563389 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.558885 2555 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 30 19:39:24.563389 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.558893 2555 flags.go:64] FLAG: --log-json-split-stream="false" Jul 30 19:39:24.563389 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.558898 2555 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 30 19:39:24.563389 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.558904 2555 flags.go:64] FLAG: --log-text-split-stream="false" Jul 30 19:39:24.563389 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.558908 2555 flags.go:64] FLAG: --logging-format="text" Jul 30 19:39:24.563389 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.558912 2555 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 30 19:39:24.563389 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.558917 2555 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 30 19:39:24.563389 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.558921 2555 flags.go:64] FLAG: --manifest-url="" Jul 30 19:39:24.563389 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.558926 2555 flags.go:64] FLAG: --manifest-url-header="" Jul 30 19:39:24.563389 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.558931 2555 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 30 19:39:24.563389 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.558935 2555 flags.go:64] FLAG: --max-open-files="1000000" Jul 30 19:39:24.563389 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.558941 2555 flags.go:64] FLAG: --max-pods="110" Jul 30 19:39:24.563389 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.558946 2555 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 30 19:39:24.563389 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.558950 2555 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 30 19:39:24.563389 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.558955 2555 flags.go:64] FLAG: --memory-manager-policy="None" Jul 30 19:39:24.563389 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.558959 2555 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 30 19:39:24.563975 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.558964 2555 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 30 19:39:24.563975 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.558968 2555 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 30 19:39:24.563975 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.558972 2555 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 30 19:39:24.563975 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.558981 2555 flags.go:64] FLAG: --node-status-max-images="50" Jul 30 19:39:24.563975 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.558985 2555 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 30 19:39:24.563975 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.558989 2555 flags.go:64] FLAG: --oom-score-adj="-999" Jul 30 19:39:24.563975 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.558993 2555 flags.go:64] FLAG: --pod-cidr="" Jul 30 19:39:24.563975 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.558997 2555 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:267c8c33005f5dc3d4121af550b1c396e30e2928a13624d7362adfbfb7f440f8" Jul 30 19:39:24.563975 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.559005 2555 flags.go:64] FLAG: --pod-manifest-path="" Jul 30 19:39:24.563975 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.559009 2555 flags.go:64] FLAG: --pod-max-pids="-1" Jul 30 19:39:24.563975 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.559013 2555 flags.go:64] FLAG: --pods-per-core="0" Jul 30 19:39:24.563975 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.559017 2555 flags.go:64] FLAG: --port="10250" Jul 30 19:39:24.563975 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.559022 2555 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 30 19:39:24.563975 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.559025 2555 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-058e7a9c978c5c25e" Jul 30 19:39:24.563975 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.559030 2555 flags.go:64] FLAG: --qos-reserved="" Jul 30 19:39:24.563975 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.559033 2555 flags.go:64] FLAG: --read-only-port="10255" Jul 30 19:39:24.563975 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.559037 2555 flags.go:64] FLAG: --register-node="true" Jul 30 19:39:24.563975 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.559041 2555 flags.go:64] FLAG: --register-with-taints="" Jul 30 19:39:24.563975 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.559046 2555 flags.go:64] FLAG: --registry-burst="10" Jul 30 19:39:24.563975 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.559053 2555 flags.go:64] FLAG: --registry-qps="5" Jul 30 19:39:24.563975 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.559057 2555 flags.go:64] FLAG: --reserved-cpus="" Jul 30 19:39:24.563975 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.559061 2555 flags.go:64] FLAG: --reserved-memory="" Jul 30 19:39:24.563975 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.559067 2555 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 30 19:39:24.563975 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.559071 2555 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 30 19:39:24.563975 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.559076 2555 flags.go:64] FLAG: --rotate-certificates="false" Jul 30 19:39:24.564615 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.559080 2555 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 30 19:39:24.564615 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.559084 2555 flags.go:64] FLAG: --runonce="false" Jul 30 19:39:24.564615 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.559088 2555 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 30 19:39:24.564615 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.559093 2555 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 30 19:39:24.564615 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.559097 2555 flags.go:64] FLAG: --seccomp-default="false" Jul 30 19:39:24.564615 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.559101 2555 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 30 19:39:24.564615 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.559105 2555 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 30 19:39:24.564615 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.559109 2555 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 30 19:39:24.564615 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.559114 2555 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 30 19:39:24.564615 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.559118 2555 flags.go:64] FLAG: --storage-driver-password="root" Jul 30 19:39:24.564615 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.559122 2555 flags.go:64] FLAG: --storage-driver-secure="false" Jul 30 19:39:24.564615 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.559132 2555 flags.go:64] FLAG: --storage-driver-table="stats" Jul 30 19:39:24.564615 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.559137 2555 flags.go:64] FLAG: --storage-driver-user="root" Jul 30 19:39:24.564615 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.559142 2555 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 30 19:39:24.564615 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.559146 2555 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 30 19:39:24.564615 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.559150 2555 flags.go:64] FLAG: --system-cgroups="" Jul 30 19:39:24.564615 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.559154 2555 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 30 19:39:24.564615 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.559161 2555 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 30 19:39:24.564615 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.559166 2555 flags.go:64] FLAG: --tls-cert-file="" Jul 30 19:39:24.564615 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.559169 2555 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 30 19:39:24.564615 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.559174 2555 flags.go:64] FLAG: --tls-min-version="" Jul 30 19:39:24.564615 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.559178 2555 flags.go:64] FLAG: --tls-private-key-file="" Jul 30 19:39:24.564615 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.559181 2555 flags.go:64] FLAG: --topology-manager-policy="none" Jul 30 19:39:24.564615 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.559186 2555 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 30 19:39:24.564615 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.559190 2555 flags.go:64] FLAG: --topology-manager-scope="container" Jul 30 19:39:24.565202 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.559194 2555 flags.go:64] FLAG: --v="2" Jul 30 19:39:24.565202 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.559201 2555 flags.go:64] FLAG: --version="false" Jul 30 19:39:24.565202 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.559208 2555 flags.go:64] FLAG: --vmodule="" Jul 30 19:39:24.565202 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.559213 2555 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 30 19:39:24.565202 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.559219 2555 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 30 19:39:24.565202 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.559407 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 30 19:39:24.565202 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.559413 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 30 19:39:24.565202 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.559418 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 30 19:39:24.565202 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.559422 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 30 19:39:24.565202 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.559426 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 30 19:39:24.565202 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.559430 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 30 19:39:24.565202 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.559434 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 30 19:39:24.565202 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.559437 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 30 19:39:24.565202 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.559441 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 30 19:39:24.565202 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.559444 2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 30 19:39:24.565202 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.559448 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 30 19:39:24.565202 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.559452 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 30 19:39:24.565202 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.559455 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 30 19:39:24.565202 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.559459 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 30 19:39:24.565202 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.559463 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 30 19:39:24.565202 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.559467 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 30 19:39:24.565750 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.559470 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 30 19:39:24.565750 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.559474 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 30 19:39:24.565750 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.559477 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 30 19:39:24.565750 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.559481 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 30 19:39:24.565750 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.559484 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 30 19:39:24.565750 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.559490 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 30 19:39:24.565750 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.559494 2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 30 19:39:24.565750 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.559498 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 30 19:39:24.565750 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.559501 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 30 19:39:24.565750 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.559505 2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 30 19:39:24.565750 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.559508 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 30 19:39:24.565750 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.559512 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 30 19:39:24.565750 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.559518 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 30 19:39:24.565750 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.559521 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 30 19:39:24.565750 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.559526 2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 30 19:39:24.565750 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.559532 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 30 19:39:24.565750 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.559536 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 30 19:39:24.565750 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.559540 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 30 19:39:24.565750 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.559543 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 30 19:39:24.566202 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.559547 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 30 19:39:24.566202 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.559551 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 30 19:39:24.566202 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.559555 2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 30 19:39:24.566202 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.559558 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 30 19:39:24.566202 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.559562 2555 feature_gate.go:328] unrecognized feature gate: Example Jul 30 19:39:24.566202 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.559566 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 30 19:39:24.566202 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.559570 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 30 19:39:24.566202 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.559574 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 30 19:39:24.566202 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.559578 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 30 19:39:24.566202 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.559582 2555 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 30 19:39:24.566202 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.559586 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 30 19:39:24.566202 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.559589 2555 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 30 19:39:24.566202 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.559594 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 30 19:39:24.566202 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.559597 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 30 19:39:24.566202 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.559603 2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 30 19:39:24.566202 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.559608 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 30 19:39:24.566202 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.559612 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 30 19:39:24.566202 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.559616 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 30 19:39:24.566202 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.559620 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 30 19:39:24.566202 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.559624 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 30 19:39:24.566682 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.559628 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 30 19:39:24.566682 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.559631 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 30 19:39:24.566682 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.559634 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 30 19:39:24.566682 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.559638 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 30 19:39:24.566682 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.559641 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 30 19:39:24.566682 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.559647 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 30 19:39:24.566682 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.559650 2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 30 19:39:24.566682 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.559656 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 30 19:39:24.566682 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.559662 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 30 19:39:24.566682 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.559666 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 30 19:39:24.566682 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.559671 2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 30 19:39:24.566682 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.559675 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 30 19:39:24.566682 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.559679 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 30 19:39:24.566682 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.559683 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 30 19:39:24.566682 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.559687 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 30 19:39:24.566682 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.559690 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 30 19:39:24.566682 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.559694 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 30 19:39:24.566682 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.559698 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 30 19:39:24.566682 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.559702 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 30 19:39:24.567147 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.559706 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 30 19:39:24.567147 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.559709 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 30 19:39:24.567147 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.559713 2555 feature_gate.go:328] unrecognized feature gate: Example2 Jul 30 19:39:24.567147 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.559717 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 30 19:39:24.567147 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.559721 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 30 19:39:24.567147 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.559724 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 30 19:39:24.567147 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.559728 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 30 19:39:24.567147 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.559732 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 30 19:39:24.567147 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.559735 2555 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 30 19:39:24.567147 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.559739 2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 30 19:39:24.567147 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.559742 2555 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 30 19:39:24.567147 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.559746 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 30 19:39:24.567147 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.559750 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 30 19:39:24.567147 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.559753 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 30 19:39:24.567147 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.559757 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 30 19:39:24.567147 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.559760 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 30 19:39:24.567147 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.559763 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 30 19:39:24.567147 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.559767 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 30 19:39:24.567147 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.559773 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 30 19:39:24.567147 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.559776 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 30 19:39:24.567643 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.559780 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 30 19:39:24.567643 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.559784 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 30 19:39:24.567643 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.559789 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 30 19:39:24.567643 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.559793 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 30 19:39:24.567643 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.559797 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 30 19:39:24.567643 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.560280 2555 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 30 19:39:24.567643 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.566682 2555 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 30 19:39:24.567643 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.566695 2555 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 30 19:39:24.567643 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.567528 2555 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 30 19:39:24.567643 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.567536 2555 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 30 19:39:24.567643 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.567590 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 30 19:39:24.567643 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.567595 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 30 19:39:24.567643 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.567599 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 30 19:39:24.567643 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.567602 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 30 19:39:24.567643 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.567605 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 30 19:39:24.568011 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.567608 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 30 19:39:24.568011 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.567612 2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 30 19:39:24.568011 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.567616 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 30 19:39:24.568011 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.567620 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 30 19:39:24.568011 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.567624 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 30 19:39:24.568011 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.567627 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 30 19:39:24.568011 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.567630 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 30 19:39:24.568011 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.567633 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 30 19:39:24.568011 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.567635 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 30 19:39:24.568011 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.567638 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 30 19:39:24.568011 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.567641 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 30 19:39:24.568011 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.567643 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 30 19:39:24.568011 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.567646 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 30 19:39:24.568011 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.567649 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 30 19:39:24.568011 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.567651 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 30 19:39:24.568011 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.567654 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 30 19:39:24.568011 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.567657 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 30 19:39:24.568011 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.567659 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 30 19:39:24.568011 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.567662 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 30 19:39:24.568461 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.567664 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 30 19:39:24.568461 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.567667 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 30 19:39:24.568461 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.567669 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 30 19:39:24.568461 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.567672 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 30 19:39:24.568461 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.567675 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 30 19:39:24.568461 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.567680 2555 feature_gate.go:328] unrecognized feature gate: Example Jul 30 19:39:24.568461 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.567683 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 30 19:39:24.568461 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.567686 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 30 19:39:24.568461 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.567688 2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 30 19:39:24.568461 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.567691 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 30 19:39:24.568461 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.567693 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 30 19:39:24.568461 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.567696 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 30 19:39:24.568461 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.567698 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 30 19:39:24.568461 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.567700 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 30 19:39:24.568461 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.567704 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 30 19:39:24.568461 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.567706 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 30 19:39:24.568461 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.567709 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 30 19:39:24.568461 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.567711 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 30 19:39:24.568461 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.567714 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 30 19:39:24.568908 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.567717 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 30 19:39:24.568908 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.567719 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 30 19:39:24.568908 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.567722 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 30 19:39:24.568908 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.567724 2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 30 19:39:24.568908 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.567727 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 30 19:39:24.568908 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.567730 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 30 19:39:24.568908 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.567733 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 30 19:39:24.568908 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.567735 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 30 19:39:24.568908 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.567738 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 30 19:39:24.568908 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.567741 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 30 19:39:24.568908 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.567743 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 30 19:39:24.568908 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.567746 2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 30 19:39:24.568908 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.567748 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 30 19:39:24.568908 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.567751 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 30 19:39:24.568908 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.567753 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 30 19:39:24.568908 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.567756 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 30 19:39:24.568908 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.567758 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 30 19:39:24.568908 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.567761 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 30 19:39:24.568908 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.567764 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 30 19:39:24.569370 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.567767 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 30 19:39:24.569370 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.567769 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 30 19:39:24.569370 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.567772 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 30 19:39:24.569370 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.567774 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 30 19:39:24.569370 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.567777 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 30 19:39:24.569370 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.567779 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 30 19:39:24.569370 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.567781 2555 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 30 19:39:24.569370 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.567784 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 30 19:39:24.569370 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.567787 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 30 19:39:24.569370 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.567790 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 30 19:39:24.569370 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.567792 2555 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 30 19:39:24.569370 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.567795 2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 30 19:39:24.569370 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.567797 2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 30 19:39:24.569370 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.567800 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 30 19:39:24.569370 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.567802 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 30 19:39:24.569370 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.567805 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 30 19:39:24.569370 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.567807 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 30 19:39:24.569370 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.567810 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 30 19:39:24.569370 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.567812 2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 30 19:39:24.569370 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.567815 2555 feature_gate.go:328] unrecognized feature gate: Example2 Jul 30 19:39:24.569829 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.567817 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 30 19:39:24.569829 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.567819 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 30 19:39:24.569829 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.567822 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 30 19:39:24.569829 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.567824 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 30 19:39:24.569829 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.567827 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 30 19:39:24.569829 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.567829 2555 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 30 19:39:24.569829 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.567832 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 30 19:39:24.569829 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.567834 2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 30 19:39:24.569829 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.567837 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 30 19:39:24.569829 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.567839 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 30 19:39:24.569829 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.567842 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 30 19:39:24.569829 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.567845 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 30 19:39:24.569829 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.567847 2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 30 19:39:24.569829 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.567850 2555 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 30 19:39:24.569829 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.567853 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 30 19:39:24.569829 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.567855 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 30 19:39:24.569829 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.567858 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 30 19:39:24.570232 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.567862 2555 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 30 19:39:24.570232 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.567965 2555 feature_gate.go:328] unrecognized feature gate: Example Jul 30 19:39:24.570232 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.567970 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 30 19:39:24.570232 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.567973 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 30 19:39:24.570232 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.567976 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 30 19:39:24.570232 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.567979 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 30 19:39:24.570232 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.567982 2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 30 19:39:24.570232 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.567985 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 30 19:39:24.570232 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.567987 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 30 19:39:24.570232 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.567990 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 30 19:39:24.570232 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.567992 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 30 19:39:24.570232 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.567995 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 30 19:39:24.570232 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.567997 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 30 19:39:24.570232 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.568000 2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 30 19:39:24.570232 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.568002 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 30 19:39:24.570602 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.568005 2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 30 19:39:24.570602 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.568007 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 30 19:39:24.570602 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.568010 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 30 19:39:24.570602 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.568012 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 30 19:39:24.570602 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.568015 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 30 19:39:24.570602 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.568018 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 30 19:39:24.570602 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.568020 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 30 19:39:24.570602 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.568023 2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 30 19:39:24.570602 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.568026 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 30 19:39:24.570602 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.568028 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 30 19:39:24.570602 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.568032 2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 30 19:39:24.570602 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.568035 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 30 19:39:24.570602 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.568038 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 30 19:39:24.570602 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.568041 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 30 19:39:24.570602 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.568044 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 30 19:39:24.570602 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.568047 2555 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 30 19:39:24.570602 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.568050 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 30 19:39:24.570602 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.568052 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 30 19:39:24.570602 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.568056 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 30 19:39:24.571069 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.568058 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 30 19:39:24.571069 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.568061 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 30 19:39:24.571069 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.568064 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 30 19:39:24.571069 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.568067 2555 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 30 19:39:24.571069 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.568069 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 30 19:39:24.571069 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.568071 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 30 19:39:24.571069 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.568074 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 30 19:39:24.571069 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.568076 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 30 19:39:24.571069 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.568079 2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 30 19:39:24.571069 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.568081 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 30 19:39:24.571069 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.568084 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 30 19:39:24.571069 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.568086 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 30 19:39:24.571069 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.568089 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 30 19:39:24.571069 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.568091 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 30 19:39:24.571069 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.568094 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 30 19:39:24.571069 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.568096 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 30 19:39:24.571069 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.568099 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 30 19:39:24.571069 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.568101 2555 feature_gate.go:328] unrecognized feature gate: Example2 Jul 30 19:39:24.571069 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.568104 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 30 19:39:24.571069 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.568106 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 30 19:39:24.571562 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.568110 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 30 19:39:24.571562 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.568113 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 30 19:39:24.571562 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.568116 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 30 19:39:24.571562 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.568118 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 30 19:39:24.571562 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.568121 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 30 19:39:24.571562 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.568123 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 30 19:39:24.571562 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.568125 2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 30 19:39:24.571562 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.568128 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 30 19:39:24.571562 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.568131 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 30 19:39:24.571562 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.568133 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 30 19:39:24.571562 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.568136 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 30 19:39:24.571562 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.568138 2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 30 19:39:24.571562 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.568141 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 30 19:39:24.571562 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.568144 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 30 19:39:24.571562 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.568146 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 30 19:39:24.571562 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.568149 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 30 19:39:24.571562 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.568151 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 30 19:39:24.571562 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.568154 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 30 19:39:24.571562 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.568156 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 30 19:39:24.572007 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.568159 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 30 19:39:24.572007 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.568161 2555 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 30 19:39:24.572007 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.568165 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 30 19:39:24.572007 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.568169 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 30 19:39:24.572007 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.568172 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 30 19:39:24.572007 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.568175 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 30 19:39:24.572007 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.568178 2555 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 30 19:39:24.572007 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.568180 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 30 19:39:24.572007 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.568183 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 30 19:39:24.572007 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.568185 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 30 19:39:24.572007 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.568188 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 30 19:39:24.572007 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.568190 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 30 19:39:24.572007 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.568193 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 30 19:39:24.572007 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.568195 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 30 19:39:24.572007 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.568198 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 30 19:39:24.572007 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.568200 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 30 19:39:24.572007 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.568202 2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 30 19:39:24.572007 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.568205 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 30 19:39:24.572007 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.568207 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 30 19:39:24.572479 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.568210 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 30 19:39:24.572479 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.568212 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 30 19:39:24.572479 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.568215 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 30 19:39:24.572479 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.568218 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 30 19:39:24.572479 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.568220 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 30 19:39:24.572479 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.568223 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 30 19:39:24.572479 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.568225 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 30 19:39:24.572479 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:24.568228 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 30 19:39:24.572479 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.568233 2555 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 30 19:39:24.572479 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.568361 2555 server.go:962] "Client rotation is on, will bootstrap in background" Jul 30 19:39:24.572479 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.570629 2555 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 30 19:39:24.572479 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.571924 2555 server.go:1019] "Starting client certificate rotation" Jul 30 19:39:24.572479 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.572022 2555 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 30 19:39:24.572479 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.572054 2555 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 30 19:39:24.574471 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.574457 2555 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 30 19:39:24.575534 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.575518 2555 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 30 19:39:24.582587 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.582571 2555 log.go:25] "Validated CRI v1 runtime API" Jul 30 19:39:24.584402 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.584388 2555 log.go:25] "Validated CRI v1 image API" Jul 30 19:39:24.586087 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.586068 2555 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 30 19:39:24.588643 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.588626 2555 fs.go:135] Filesystem UUIDs: map[58621c29-273c-4942-ba6d-b26d31865576:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 c3388c02-2ce6-4224-88ce-a4e90a03ad52:/dev/nvme0n1p3] Jul 30 19:39:24.588705 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.588643 2555 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 30 19:39:24.594750 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.594643 2555 manager.go:216] Machine: {Timestamp:2026-07-30 19:39:24.593274675 +0000 UTC m=+0.322336560 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3218555 MemoryCapacity:33164488704 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2a3c53e34529865fbce0cf97add145 SystemUUID:ec2a3c53-e345-2986-5fbc-e0cf97add145 BootID:fe00ff68-2a51-471e-9cbb-826d197a26ee Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:63:fc:b0:17:01 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:63:fc:b0:17:01 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:de:a3:6c:56:cb:bf Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164488704 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 30 19:39:24.594750 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.594739 2555 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 30 19:39:24.594889 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.594816 2555 manager.go:232] Version: {KernelVersion:5.14.0-570.131.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260727-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 30 19:39:24.597860 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.597830 2555 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 30 19:39:24.597988 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.597863 2555 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-46.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 30 19:39:24.598940 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.598930 2555 topology_manager.go:138] "Creating topology manager with none policy" Jul 30 19:39:24.598940 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.598942 2555 container_manager_linux.go:309] "Creating device plugin manager" Jul 30 19:39:24.599018 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.598949 2555 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 30 19:39:24.599510 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.599498 2555 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 30 19:39:24.600257 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.600248 2555 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 30 19:39:24.601271 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.601252 2555 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 30 19:39:24.604111 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.604099 2555 state_mem.go:36] "Initialized new in-memory state store" Jul 30 19:39:24.604225 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.604215 2555 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 30 19:39:24.604258 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.604248 2555 kubelet.go:486] "Attempting to sync node with API server" Jul 30 19:39:24.604299 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.604258 2555 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 30 19:39:24.604299 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.604271 2555 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 30 19:39:24.604299 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.604280 2555 kubelet.go:398] "Adding apiserver pod source" Jul 30 19:39:24.604414 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.604301 2555 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 30 19:39:24.604650 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.604636 2555 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 30 19:39:24.604686 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.604661 2555 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 30 19:39:24.606756 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.606739 2555 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 30 19:39:24.607961 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.607946 2555 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 30 19:39:24.608034 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.607984 2555 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 30 19:39:24.608834 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.608820 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 30 19:39:24.608910 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.608839 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 30 19:39:24.608910 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.608848 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 30 19:39:24.608910 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.608857 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 30 19:39:24.608910 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.608869 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 30 19:39:24.608910 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.608878 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 30 19:39:24.608910 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.608889 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 30 19:39:24.608910 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.608897 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 30 19:39:24.608910 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.608906 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 30 19:39:24.609136 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.608915 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 30 19:39:24.609136 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.608926 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 30 19:39:24.609136 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.608934 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 30 19:39:24.609790 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.609779 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 30 19:39:24.609849 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.609793 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 30 19:39:24.613023 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.613009 2555 server.go:1268] "Started kubelet" Jul 30 19:39:24.613227 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.613114 2555 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 30 19:39:24.613363 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.613306 2555 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 30 19:39:24.613891 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.613866 2555 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 30 19:39:24.613936 ip-10-0-136-46 systemd[1]: Started Kubernetes Kubelet. Jul 30 19:39:24.614501 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.614399 2555 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 30 19:39:24.614604 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:39:24.614569 2555 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 30 19:39:24.614729 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:39:24.614649 2555 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-46.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 30 19:39:24.614779 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.614736 2555 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-46.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 30 19:39:24.615893 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.615877 2555 server.go:310] "Adding debug handlers to kubelet server" Jul 30 19:39:24.619599 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.619578 2555 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 30 19:39:24.619694 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.619611 2555 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 30 19:39:24.619987 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:39:24.619966 2555 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 30 19:39:24.619987 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:39:24.619970 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-46.ec2.internal\" not found" Jul 30 19:39:24.620145 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.620074 2555 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 30 19:39:24.620145 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.620085 2555 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 30 19:39:24.620145 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.620086 2555 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 30 19:39:24.620260 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.620202 2555 reconstruct.go:97] "Volume reconstruction finished" Jul 30 19:39:24.620260 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.620211 2555 reconciler.go:29] "Reconciler: start to sync state" Jul 30 19:39:24.620941 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:39:24.619707 2555 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-46.ec2.internal.18c7288d4c669aea default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-46.ec2.internal,UID:ip-10-0-136-46.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-136-46.ec2.internal,},FirstTimestamp:2026-07-30 19:39:24.61298353 +0000 UTC m=+0.342045415,LastTimestamp:2026-07-30 19:39:24.61298353 +0000 UTC m=+0.342045415,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-46.ec2.internal,}" Jul 30 19:39:24.621045 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.621006 2555 factory.go:55] Registering systemd factory Jul 30 19:39:24.621045 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.621018 2555 factory.go:223] Registration of the systemd container factory successfully Jul 30 19:39:24.621223 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.621212 2555 factory.go:153] Registering CRI-O factory Jul 30 19:39:24.621223 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.621222 2555 factory.go:223] Registration of the crio container factory successfully Jul 30 19:39:24.621320 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.621261 2555 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 30 19:39:24.621320 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.621281 2555 factory.go:103] Registering Raw factory Jul 30 19:39:24.621320 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.621305 2555 manager.go:1196] Started watching for new ooms in manager Jul 30 19:39:24.621731 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.621718 2555 manager.go:349] Starting recovery of all containers Jul 30 19:39:24.622434 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.622410 2555 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7rrzr" Jul 30 19:39:24.626416 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:39:24.626383 2555 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 30 19:39:24.626495 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:39:24.626414 2555 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-136-46.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 30 19:39:24.629767 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.629746 2555 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7rrzr" Jul 30 19:39:24.632770 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.632753 2555 manager.go:354] Recovery completed Jul 30 19:39:24.638037 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.638023 2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 30 19:39:24.639936 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.639908 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-46.ec2.internal" event="NodeHasSufficientMemory" Jul 30 19:39:24.640029 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.639944 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-46.ec2.internal" event="NodeHasNoDiskPressure" Jul 30 19:39:24.640029 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.639960 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-46.ec2.internal" event="NodeHasSufficientPID" Jul 30 19:39:24.640500 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.640484 2555 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 30 19:39:24.640500 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.640498 2555 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 30 19:39:24.640634 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.640499 2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 30 19:39:24.640634 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.640518 2555 state_mem.go:36] "Initialized new in-memory state store" Jul 30 19:39:24.641204 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.641191 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-46.ec2.internal" event="NodeHasSufficientMemory" Jul 30 19:39:24.641243 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.641217 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-46.ec2.internal" event="NodeHasNoDiskPressure" Jul 30 19:39:24.641243 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.641228 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-46.ec2.internal" event="NodeHasSufficientPID" Jul 30 19:39:24.641619 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.641606 2555 policy_none.go:49] "None policy: Start" Jul 30 19:39:24.641664 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.641626 2555 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 30 19:39:24.641664 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.641641 2555 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 30 19:39:24.642348 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:39:24.642261 2555 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-46.ec2.internal.18c7288d4e01b902 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-46.ec2.internal,UID:ip-10-0-136-46.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-136-46.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-136-46.ec2.internal,},FirstTimestamp:2026-07-30 19:39:24.63992653 +0000 UTC m=+0.368988422,LastTimestamp:2026-07-30 19:39:24.63992653 +0000 UTC m=+0.368988422,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-46.ec2.internal,}" Jul 30 19:39:24.642518 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.642503 2555 policy_none.go:47] "Start" Jul 30 19:39:24.682963 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.682801 2555 manager.go:337] "Starting Device Plugin manager" Jul 30 19:39:24.683047 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:39:24.682988 2555 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 30 19:39:24.683047 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.683000 2555 server.go:87] "Starting device plugin registration server" Jul 30 19:39:24.683214 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.683202 2555 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 30 19:39:24.683265 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.683215 2555 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 30 19:39:24.683355 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.683337 2555 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 30 19:39:24.683689 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.683430 2555 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 30 19:39:24.683689 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.683444 2555 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 30 19:39:24.683878 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:39:24.683856 2555 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 30 19:39:24.683945 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:39:24.683913 2555 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-46.ec2.internal\" not found" Jul 30 19:39:24.729220 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.729195 2555 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 30 19:39:24.730376 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.730318 2555 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 30 19:39:24.730376 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.730352 2555 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 30 19:39:24.730376 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.730372 2555 kubelet.go:2448] "Starting kubelet main sync loop" Jul 30 19:39:24.730493 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:39:24.730406 2555 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 30 19:39:24.732710 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.732694 2555 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 30 19:39:24.784365 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.784326 2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 30 19:39:24.785970 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.785953 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-46.ec2.internal" event="NodeHasSufficientMemory" Jul 30 19:39:24.786081 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.785985 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-46.ec2.internal" event="NodeHasNoDiskPressure" Jul 30 19:39:24.786081 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.786001 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-46.ec2.internal" event="NodeHasSufficientPID" Jul 30 19:39:24.786081 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.786031 2555 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-46.ec2.internal" Jul 30 19:39:24.793722 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.793706 2555 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-46.ec2.internal" Jul 30 19:39:24.793808 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:39:24.793729 2555 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-46.ec2.internal\": node \"ip-10-0-136-46.ec2.internal\" not found" Jul 30 19:39:24.802083 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:39:24.802038 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-46.ec2.internal\" not found" Jul 30 19:39:24.830629 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.830609 2555 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-46.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-136-46.ec2.internal"] Jul 30 19:39:24.830718 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.830661 2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 30 19:39:24.832020 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.832004 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-46.ec2.internal" event="NodeHasSufficientMemory" Jul 30 19:39:24.832089 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.832033 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-46.ec2.internal" event="NodeHasNoDiskPressure" Jul 30 19:39:24.832089 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.832042 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-46.ec2.internal" event="NodeHasSufficientPID" Jul 30 19:39:24.833131 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.833119 2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 30 19:39:24.833252 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.833238 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-46.ec2.internal" Jul 30 19:39:24.833286 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.833265 2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 30 19:39:24.833795 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.833778 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-46.ec2.internal" event="NodeHasSufficientMemory" Jul 30 19:39:24.833795 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.833802 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-46.ec2.internal" event="NodeHasNoDiskPressure" Jul 30 19:39:24.833946 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.833811 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-46.ec2.internal" event="NodeHasSufficientPID" Jul 30 19:39:24.833946 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.833822 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-46.ec2.internal" event="NodeHasSufficientMemory" Jul 30 19:39:24.833946 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.833845 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-46.ec2.internal" event="NodeHasNoDiskPressure" Jul 30 19:39:24.833946 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.833859 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-46.ec2.internal" event="NodeHasSufficientPID" Jul 30 19:39:24.834912 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.834897 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-46.ec2.internal" Jul 30 19:39:24.834988 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.834923 2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 30 19:39:24.835601 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.835588 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-46.ec2.internal" event="NodeHasSufficientMemory" Jul 30 19:39:24.835692 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.835620 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-46.ec2.internal" event="NodeHasNoDiskPressure" Jul 30 19:39:24.835692 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.835633 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-46.ec2.internal" event="NodeHasSufficientPID" Jul 30 19:39:24.859950 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:39:24.859928 2555 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-46.ec2.internal\" not found" node="ip-10-0-136-46.ec2.internal" Jul 30 19:39:24.863102 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:39:24.863087 2555 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-46.ec2.internal\" not found" node="ip-10-0-136-46.ec2.internal" Jul 30 19:39:24.902105 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:39:24.902083 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-46.ec2.internal\" not found" Jul 30 19:39:24.921974 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.921950 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1a2944b9797870016f92974beffaabc3-config\") pod \"kube-apiserver-proxy-ip-10-0-136-46.ec2.internal\" (UID: \"1a2944b9797870016f92974beffaabc3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-46.ec2.internal" Jul 30 19:39:24.922075 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.921986 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/55b5d07ef5da4396d8fc84d8570a1cf0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-46.ec2.internal\" (UID: \"55b5d07ef5da4396d8fc84d8570a1cf0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-46.ec2.internal" Jul 30 19:39:24.922075 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:24.922010 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/55b5d07ef5da4396d8fc84d8570a1cf0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-46.ec2.internal\" (UID: \"55b5d07ef5da4396d8fc84d8570a1cf0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-46.ec2.internal" Jul 30 19:39:25.002239 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:39:25.002205 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-46.ec2.internal\" not found" Jul 30 19:39:25.022544 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:25.022518 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/55b5d07ef5da4396d8fc84d8570a1cf0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-46.ec2.internal\" (UID: \"55b5d07ef5da4396d8fc84d8570a1cf0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-46.ec2.internal" Jul 30 19:39:25.022605 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:25.022551 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/55b5d07ef5da4396d8fc84d8570a1cf0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-46.ec2.internal\" (UID: \"55b5d07ef5da4396d8fc84d8570a1cf0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-46.ec2.internal" Jul 30 19:39:25.022605 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:25.022567 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1a2944b9797870016f92974beffaabc3-config\") pod \"kube-apiserver-proxy-ip-10-0-136-46.ec2.internal\" (UID: \"1a2944b9797870016f92974beffaabc3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-46.ec2.internal" Jul 30 19:39:25.022670 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:25.022608 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1a2944b9797870016f92974beffaabc3-config\") pod \"kube-apiserver-proxy-ip-10-0-136-46.ec2.internal\" (UID: \"1a2944b9797870016f92974beffaabc3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-46.ec2.internal" Jul 30 19:39:25.022670 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:25.022625 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/55b5d07ef5da4396d8fc84d8570a1cf0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-46.ec2.internal\" (UID: \"55b5d07ef5da4396d8fc84d8570a1cf0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-46.ec2.internal" Jul 30 19:39:25.022670 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:25.022628 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/55b5d07ef5da4396d8fc84d8570a1cf0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-46.ec2.internal\" (UID: \"55b5d07ef5da4396d8fc84d8570a1cf0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-46.ec2.internal" Jul 30 19:39:26.680786 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:39:26.680762 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-46.ec2.internal\" not found" Jul 30 19:39:26.741396 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:26.741367 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-46.ec2.internal" Jul 30 19:39:26.743518 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:26.743504 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-46.ec2.internal" Jul 30 19:39:26.781067 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:39:26.781039 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-46.ec2.internal\" not found" Jul 30 19:39:26.881503 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:39:26.881468 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-46.ec2.internal\" not found" Jul 30 19:39:26.981959 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:39:26.981894 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-46.ec2.internal\" not found" Jul 30 19:39:27.082551 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:39:27.082518 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-46.ec2.internal\" not found" Jul 30 19:39:27.148907 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:27.148879 2555 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 30 19:39:27.149363 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:27.149049 2555 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 30 19:39:27.183190 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:39:27.183163 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-46.ec2.internal\" not found" Jul 30 19:39:27.211674 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:27.211640 2555 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-29 19:34:26 +0000 UTC" deadline="2027-12-28 06:11:34.182118897 +0000 UTC" Jul 30 19:39:27.211674 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:27.211667 2555 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12370h32m6.970454692s" Jul 30 19:39:27.232141 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:27.232090 2555 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 30 19:39:27.284041 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:39:27.283998 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-46.ec2.internal\" not found" Jul 30 19:39:27.295920 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:27.295891 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55b5d07ef5da4396d8fc84d8570a1cf0.slice/crio-8a6debe441ac25e2210cc6f9cb9a171bd491a6e385264ece4a060e60f91c2dc5 WatchSource:0}: Error finding container 8a6debe441ac25e2210cc6f9cb9a171bd491a6e385264ece4a060e60f91c2dc5: Status 404 returned error can't find the container with id 8a6debe441ac25e2210cc6f9cb9a171bd491a6e385264ece4a060e60f91c2dc5 Jul 30 19:39:27.296401 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:27.296386 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a2944b9797870016f92974beffaabc3.slice/crio-4e5bf371bb435755133032d847cf3a457b2af46c30f03100f0ea8a9f330b1ef5 WatchSource:0}: Error finding container 4e5bf371bb435755133032d847cf3a457b2af46c30f03100f0ea8a9f330b1ef5: Status 404 returned error can't find the container with id 4e5bf371bb435755133032d847cf3a457b2af46c30f03100f0ea8a9f330b1ef5 Jul 30 19:39:27.300400 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:27.300382 2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 30 19:39:27.311432 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:27.311391 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-46.ec2.internal" event={"ID":"1a2944b9797870016f92974beffaabc3","Type":"ContainerStarted","Data":"4e5bf371bb435755133032d847cf3a457b2af46c30f03100f0ea8a9f330b1ef5"} Jul 30 19:39:27.312314 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:27.312293 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-46.ec2.internal" event={"ID":"55b5d07ef5da4396d8fc84d8570a1cf0","Type":"ContainerStarted","Data":"8a6debe441ac25e2210cc6f9cb9a171bd491a6e385264ece4a060e60f91c2dc5"} Jul 30 19:39:27.384488 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:39:27.384449 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-46.ec2.internal\" not found" Jul 30 19:39:27.427066 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:27.427036 2555 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 30 19:39:27.485055 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:39:27.484994 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-46.ec2.internal\" not found" Jul 30 19:39:27.585513 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:39:27.585476 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-46.ec2.internal\" not found" Jul 30 19:39:27.686236 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:39:27.686206 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-46.ec2.internal\" not found" Jul 30 19:39:27.781029 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:27.780952 2555 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 30 19:39:27.799082 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:27.799055 2555 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-46.ec2.internal" Jul 30 19:39:27.809435 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:27.809413 2555 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 30 19:39:27.810431 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:27.810414 2555 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-46.ec2.internal" Jul 30 19:39:27.818059 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:27.818030 2555 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 30 19:39:28.183613 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.183549 2555 apiserver.go:52] "Watching apiserver" Jul 30 19:39:28.190944 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.190907 2555 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 30 19:39:28.191390 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.191359 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-fn7fj","kube-system/konnectivity-agent-swtbz","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vmwjm","openshift-cluster-node-tuning-operator/tuned-cbkpr","openshift-dns/node-resolver-krnh8","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-46.ec2.internal","openshift-multus/network-metrics-daemon-sx4k5","openshift-network-diagnostics/network-check-target-k2nrq","kube-system/kube-apiserver-proxy-ip-10-0-136-46.ec2.internal","openshift-image-registry/node-ca-crnbd","openshift-multus/multus-8flqh","openshift-multus/multus-additional-cni-plugins-g5s9d","openshift-network-operator/iptables-alerter-6l9wb","openshift-ovn-kubernetes/ovnkube-node-sjhkz"] Jul 30 19:39:28.193178 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.193080 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sx4k5" Jul 30 19:39:28.193366 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:39:28.193172 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sx4k5" podUID="a1ca9892-7f18-4426-80c4-3e9c14681dab" Jul 30 19:39:28.194217 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.194123 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-6l9wb" Jul 30 19:39:28.195346 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.195324 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vmwjm" Jul 30 19:39:28.196509 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.196473 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-fm6lb\"" Jul 30 19:39:28.196709 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.196688 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-cbkpr" Jul 30 19:39:28.197302 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.197263 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 30 19:39:28.197402 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.197309 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 30 19:39:28.197402 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.197264 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 30 19:39:28.198622 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.198089 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 30 19:39:28.198622 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.198103 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 30 19:39:28.198622 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.198178 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 30 19:39:28.198622 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.198313 2555 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 30 19:39:28.198622 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.198367 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-krnh8" Jul 30 19:39:28.198622 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.198425 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-5hbz8\"" Jul 30 19:39:28.203009 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.200311 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-ghwwg\"" Jul 30 19:39:28.203009 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.200613 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 30 19:39:28.203009 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.200766 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-rxj9s\"" Jul 30 19:39:28.203009 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.200894 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 30 19:39:28.203009 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.201001 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 30 19:39:28.203009 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.201955 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 30 19:39:28.203009 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.202695 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-sjhkz" Jul 30 19:39:28.204688 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.204664 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k2nrq" Jul 30 19:39:28.204797 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:39:28.204748 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k2nrq" podUID="58525c90-52a2-441e-8ebc-6d165487e982" Jul 30 19:39:28.205294 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.205244 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 30 19:39:28.205909 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.205451 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 30 19:39:28.205909 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.205587 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 30 19:39:28.206232 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.206214 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 30 19:39:28.207162 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.206915 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-s7w95\"" Jul 30 19:39:28.207162 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.207028 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 30 19:39:28.208224 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.208156 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 30 19:39:28.208605 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.208369 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e87200c1-3059-4317-84b2-b2caf70a1a21-etc-kubernetes\") pod \"tuned-cbkpr\" (UID: \"e87200c1-3059-4317-84b2-b2caf70a1a21\") " pod="openshift-cluster-node-tuning-operator/tuned-cbkpr" Jul 30 19:39:28.208605 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.208402 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a11908b9-aecd-47de-b9a8-c49537dff46b-var-lib-openvswitch\") pod \"ovnkube-node-sjhkz\" (UID: \"a11908b9-aecd-47de-b9a8-c49537dff46b\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjhkz" Jul 30 19:39:28.208605 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.208427 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a11908b9-aecd-47de-b9a8-c49537dff46b-etc-openvswitch\") pod \"ovnkube-node-sjhkz\" (UID: \"a11908b9-aecd-47de-b9a8-c49537dff46b\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjhkz" Jul 30 19:39:28.208605 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.208451 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a11908b9-aecd-47de-b9a8-c49537dff46b-node-log\") pod \"ovnkube-node-sjhkz\" (UID: \"a11908b9-aecd-47de-b9a8-c49537dff46b\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjhkz" Jul 30 19:39:28.208605 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.208501 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a11908b9-aecd-47de-b9a8-c49537dff46b-host-cni-netd\") pod \"ovnkube-node-sjhkz\" (UID: \"a11908b9-aecd-47de-b9a8-c49537dff46b\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjhkz" Jul 30 19:39:28.208605 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.208535 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a11908b9-aecd-47de-b9a8-c49537dff46b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-sjhkz\" (UID: \"a11908b9-aecd-47de-b9a8-c49537dff46b\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjhkz" Jul 30 19:39:28.208605 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.208561 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a11908b9-aecd-47de-b9a8-c49537dff46b-ovnkube-config\") pod \"ovnkube-node-sjhkz\" (UID: \"a11908b9-aecd-47de-b9a8-c49537dff46b\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjhkz" Jul 30 19:39:28.208605 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.208583 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a1ca9892-7f18-4426-80c4-3e9c14681dab-metrics-certs\") pod \"network-metrics-daemon-sx4k5\" (UID: \"a1ca9892-7f18-4426-80c4-3e9c14681dab\") " pod="openshift-multus/network-metrics-daemon-sx4k5" Jul 30 19:39:28.208605 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.208605 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6hk8\" (UniqueName: \"kubernetes.io/projected/3061134d-d0a7-491b-8d15-88a12ce9d02d-kube-api-access-w6hk8\") pod \"node-resolver-krnh8\" (UID: \"3061134d-d0a7-491b-8d15-88a12ce9d02d\") " pod="openshift-dns/node-resolver-krnh8" Jul 30 19:39:28.209053 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.208627 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a11908b9-aecd-47de-b9a8-c49537dff46b-host-kubelet\") pod \"ovnkube-node-sjhkz\" (UID: \"a11908b9-aecd-47de-b9a8-c49537dff46b\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjhkz" Jul 30 19:39:28.209053 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.208648 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a44f2ec2-ca30-4d88-9523-e95b805c047c-socket-dir\") pod \"aws-ebs-csi-driver-node-vmwjm\" (UID: \"a44f2ec2-ca30-4d88-9523-e95b805c047c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vmwjm" Jul 30 19:39:28.209053 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.208669 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e87200c1-3059-4317-84b2-b2caf70a1a21-etc-modprobe-d\") pod \"tuned-cbkpr\" (UID: \"e87200c1-3059-4317-84b2-b2caf70a1a21\") " pod="openshift-cluster-node-tuning-operator/tuned-cbkpr" Jul 30 19:39:28.209053 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.208695 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e87200c1-3059-4317-84b2-b2caf70a1a21-etc-systemd\") pod \"tuned-cbkpr\" (UID: \"e87200c1-3059-4317-84b2-b2caf70a1a21\") " pod="openshift-cluster-node-tuning-operator/tuned-cbkpr" Jul 30 19:39:28.209053 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.208718 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e87200c1-3059-4317-84b2-b2caf70a1a21-var-lib-kubelet\") pod \"tuned-cbkpr\" (UID: \"e87200c1-3059-4317-84b2-b2caf70a1a21\") " pod="openshift-cluster-node-tuning-operator/tuned-cbkpr" Jul 30 19:39:28.209053 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.208745 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e87200c1-3059-4317-84b2-b2caf70a1a21-etc-tuned\") pod \"tuned-cbkpr\" (UID: \"e87200c1-3059-4317-84b2-b2caf70a1a21\") " pod="openshift-cluster-node-tuning-operator/tuned-cbkpr" Jul 30 19:39:28.209053 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.208771 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3061134d-d0a7-491b-8d15-88a12ce9d02d-hosts-file\") pod \"node-resolver-krnh8\" (UID: \"3061134d-d0a7-491b-8d15-88a12ce9d02d\") " pod="openshift-dns/node-resolver-krnh8" Jul 30 19:39:28.209053 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.208794 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e87200c1-3059-4317-84b2-b2caf70a1a21-sys\") pod \"tuned-cbkpr\" (UID: \"e87200c1-3059-4317-84b2-b2caf70a1a21\") " pod="openshift-cluster-node-tuning-operator/tuned-cbkpr" Jul 30 19:39:28.209053 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.208839 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6xrz\" (UniqueName: \"kubernetes.io/projected/e87200c1-3059-4317-84b2-b2caf70a1a21-kube-api-access-k6xrz\") pod \"tuned-cbkpr\" (UID: \"e87200c1-3059-4317-84b2-b2caf70a1a21\") " pod="openshift-cluster-node-tuning-operator/tuned-cbkpr" Jul 30 19:39:28.209053 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.208863 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a11908b9-aecd-47de-b9a8-c49537dff46b-run-systemd\") pod \"ovnkube-node-sjhkz\" (UID: \"a11908b9-aecd-47de-b9a8-c49537dff46b\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjhkz" Jul 30 19:39:28.209053 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.208887 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a11908b9-aecd-47de-b9a8-c49537dff46b-run-ovn\") pod \"ovnkube-node-sjhkz\" (UID: \"a11908b9-aecd-47de-b9a8-c49537dff46b\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjhkz" Jul 30 19:39:28.209053 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.208920 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fn7fj" Jul 30 19:39:28.209053 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.208925 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a11908b9-aecd-47de-b9a8-c49537dff46b-log-socket\") pod \"ovnkube-node-sjhkz\" (UID: \"a11908b9-aecd-47de-b9a8-c49537dff46b\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjhkz" Jul 30 19:39:28.209053 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:39:28.208985 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fn7fj" podUID="ef0f467f-7334-4115-9601-875fd55fb025" Jul 30 19:39:28.209053 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.209040 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a11908b9-aecd-47de-b9a8-c49537dff46b-host-cni-bin\") pod \"ovnkube-node-sjhkz\" (UID: \"a11908b9-aecd-47de-b9a8-c49537dff46b\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjhkz" Jul 30 19:39:28.209735 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.209067 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a11908b9-aecd-47de-b9a8-c49537dff46b-env-overrides\") pod \"ovnkube-node-sjhkz\" (UID: \"a11908b9-aecd-47de-b9a8-c49537dff46b\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjhkz" Jul 30 19:39:28.209735 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.209091 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a11908b9-aecd-47de-b9a8-c49537dff46b-ovnkube-script-lib\") pod \"ovnkube-node-sjhkz\" (UID: \"a11908b9-aecd-47de-b9a8-c49537dff46b\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjhkz" Jul 30 19:39:28.209735 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.209163 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a44f2ec2-ca30-4d88-9523-e95b805c047c-registration-dir\") pod \"aws-ebs-csi-driver-node-vmwjm\" (UID: \"a44f2ec2-ca30-4d88-9523-e95b805c047c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vmwjm" Jul 30 19:39:28.209735 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.209220 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a44f2ec2-ca30-4d88-9523-e95b805c047c-device-dir\") pod \"aws-ebs-csi-driver-node-vmwjm\" (UID: \"a44f2ec2-ca30-4d88-9523-e95b805c047c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vmwjm" Jul 30 19:39:28.209735 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.209285 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a11908b9-aecd-47de-b9a8-c49537dff46b-systemd-units\") pod \"ovnkube-node-sjhkz\" (UID: \"a11908b9-aecd-47de-b9a8-c49537dff46b\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjhkz" Jul 30 19:39:28.209735 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.209327 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a11908b9-aecd-47de-b9a8-c49537dff46b-ovn-node-metrics-cert\") pod \"ovnkube-node-sjhkz\" (UID: \"a11908b9-aecd-47de-b9a8-c49537dff46b\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjhkz" Jul 30 19:39:28.209735 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.209380 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fthh6\" (UniqueName: \"kubernetes.io/projected/a1ca9892-7f18-4426-80c4-3e9c14681dab-kube-api-access-fthh6\") pod \"network-metrics-daemon-sx4k5\" (UID: \"a1ca9892-7f18-4426-80c4-3e9c14681dab\") " pod="openshift-multus/network-metrics-daemon-sx4k5" Jul 30 19:39:28.209735 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.209429 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5f2f2204-5fa6-4fdc-8749-f60ec4a95303-iptables-alerter-script\") pod \"iptables-alerter-6l9wb\" (UID: \"5f2f2204-5fa6-4fdc-8749-f60ec4a95303\") " pod="openshift-network-operator/iptables-alerter-6l9wb" Jul 30 19:39:28.209735 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.209457 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a44f2ec2-ca30-4d88-9523-e95b805c047c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vmwjm\" (UID: \"a44f2ec2-ca30-4d88-9523-e95b805c047c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vmwjm" Jul 30 19:39:28.209735 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.209483 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a44f2ec2-ca30-4d88-9523-e95b805c047c-etc-selinux\") pod \"aws-ebs-csi-driver-node-vmwjm\" (UID: \"a44f2ec2-ca30-4d88-9523-e95b805c047c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vmwjm" Jul 30 19:39:28.209735 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.209507 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e87200c1-3059-4317-84b2-b2caf70a1a21-etc-sysctl-conf\") pod \"tuned-cbkpr\" (UID: \"e87200c1-3059-4317-84b2-b2caf70a1a21\") " pod="openshift-cluster-node-tuning-operator/tuned-cbkpr" Jul 30 19:39:28.209735 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.209529 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a11908b9-aecd-47de-b9a8-c49537dff46b-host-run-netns\") pod \"ovnkube-node-sjhkz\" (UID: \"a11908b9-aecd-47de-b9a8-c49537dff46b\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjhkz" Jul 30 19:39:28.209735 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.209552 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m8k4c\" (UniqueName: \"kubernetes.io/projected/a11908b9-aecd-47de-b9a8-c49537dff46b-kube-api-access-m8k4c\") pod \"ovnkube-node-sjhkz\" (UID: \"a11908b9-aecd-47de-b9a8-c49537dff46b\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjhkz" Jul 30 19:39:28.209735 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.209586 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8v8wr\" (UniqueName: \"kubernetes.io/projected/5f2f2204-5fa6-4fdc-8749-f60ec4a95303-kube-api-access-8v8wr\") pod \"iptables-alerter-6l9wb\" (UID: \"5f2f2204-5fa6-4fdc-8749-f60ec4a95303\") " pod="openshift-network-operator/iptables-alerter-6l9wb" Jul 30 19:39:28.209735 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.209618 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e87200c1-3059-4317-84b2-b2caf70a1a21-etc-sysctl-d\") pod \"tuned-cbkpr\" (UID: \"e87200c1-3059-4317-84b2-b2caf70a1a21\") " pod="openshift-cluster-node-tuning-operator/tuned-cbkpr" Jul 30 19:39:28.209735 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.209641 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e87200c1-3059-4317-84b2-b2caf70a1a21-run\") pod \"tuned-cbkpr\" (UID: \"e87200c1-3059-4317-84b2-b2caf70a1a21\") " pod="openshift-cluster-node-tuning-operator/tuned-cbkpr" Jul 30 19:39:28.210477 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.209663 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e87200c1-3059-4317-84b2-b2caf70a1a21-lib-modules\") pod \"tuned-cbkpr\" (UID: \"e87200c1-3059-4317-84b2-b2caf70a1a21\") " pod="openshift-cluster-node-tuning-operator/tuned-cbkpr" Jul 30 19:39:28.210477 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.209684 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e87200c1-3059-4317-84b2-b2caf70a1a21-tmp\") pod \"tuned-cbkpr\" (UID: \"e87200c1-3059-4317-84b2-b2caf70a1a21\") " pod="openshift-cluster-node-tuning-operator/tuned-cbkpr" Jul 30 19:39:28.210477 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.209784 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a11908b9-aecd-47de-b9a8-c49537dff46b-host-slash\") pod \"ovnkube-node-sjhkz\" (UID: \"a11908b9-aecd-47de-b9a8-c49537dff46b\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjhkz" Jul 30 19:39:28.210477 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.209816 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4h5pn\" (UniqueName: \"kubernetes.io/projected/a44f2ec2-ca30-4d88-9523-e95b805c047c-kube-api-access-4h5pn\") pod \"aws-ebs-csi-driver-node-vmwjm\" (UID: \"a44f2ec2-ca30-4d88-9523-e95b805c047c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vmwjm" Jul 30 19:39:28.210477 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.209853 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e87200c1-3059-4317-84b2-b2caf70a1a21-host\") pod \"tuned-cbkpr\" (UID: \"e87200c1-3059-4317-84b2-b2caf70a1a21\") " pod="openshift-cluster-node-tuning-operator/tuned-cbkpr" Jul 30 19:39:28.210477 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.209891 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3061134d-d0a7-491b-8d15-88a12ce9d02d-tmp-dir\") pod \"node-resolver-krnh8\" (UID: \"3061134d-d0a7-491b-8d15-88a12ce9d02d\") " pod="openshift-dns/node-resolver-krnh8" Jul 30 19:39:28.210477 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.209913 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5f2f2204-5fa6-4fdc-8749-f60ec4a95303-host-slash\") pod \"iptables-alerter-6l9wb\" (UID: \"5f2f2204-5fa6-4fdc-8749-f60ec4a95303\") " pod="openshift-network-operator/iptables-alerter-6l9wb" Jul 30 19:39:28.210477 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.209934 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a44f2ec2-ca30-4d88-9523-e95b805c047c-sys-fs\") pod \"aws-ebs-csi-driver-node-vmwjm\" (UID: \"a44f2ec2-ca30-4d88-9523-e95b805c047c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vmwjm" Jul 30 19:39:28.210477 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.209955 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e87200c1-3059-4317-84b2-b2caf70a1a21-etc-sysconfig\") pod \"tuned-cbkpr\" (UID: \"e87200c1-3059-4317-84b2-b2caf70a1a21\") " pod="openshift-cluster-node-tuning-operator/tuned-cbkpr" Jul 30 19:39:28.210477 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.209978 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a11908b9-aecd-47de-b9a8-c49537dff46b-run-openvswitch\") pod \"ovnkube-node-sjhkz\" (UID: \"a11908b9-aecd-47de-b9a8-c49537dff46b\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjhkz" Jul 30 19:39:28.210477 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.209999 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a11908b9-aecd-47de-b9a8-c49537dff46b-host-run-ovn-kubernetes\") pod \"ovnkube-node-sjhkz\" (UID: \"a11908b9-aecd-47de-b9a8-c49537dff46b\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjhkz" Jul 30 19:39:28.210477 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.210082 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-swtbz" Jul 30 19:39:28.212690 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.212240 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-crnbd" Jul 30 19:39:28.213727 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.213705 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-n7479\"" Jul 30 19:39:28.214568 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.213976 2555 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 30 19:39:28.214568 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.214181 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-8flqh" Jul 30 19:39:28.214568 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.214381 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 30 19:39:28.215307 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.215104 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 30 19:39:28.215307 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.215169 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 30 19:39:28.215307 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.215291 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-g5s9d" Jul 30 19:39:28.216161 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.215317 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 30 19:39:28.216161 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.215565 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 30 19:39:28.216161 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.215662 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-zh2bj\"" Jul 30 19:39:28.216491 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.216470 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 30 19:39:28.216846 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.216829 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 30 19:39:28.217226 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.217210 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 30 19:39:28.217478 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.217465 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 30 19:39:28.217707 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.217693 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-qhqtt\"" Jul 30 19:39:28.218263 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.218243 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 30 19:39:28.218477 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.218461 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 30 19:39:28.219211 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.218643 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-rtctb\"" Jul 30 19:39:28.234592 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.234570 2555 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-bpkbv" Jul 30 19:39:28.241674 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.241651 2555 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-bpkbv" Jul 30 19:39:28.300639 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.300601 2555 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 30 19:39:28.310875 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.310844 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5f2f2204-5fa6-4fdc-8749-f60ec4a95303-iptables-alerter-script\") pod \"iptables-alerter-6l9wb\" (UID: \"5f2f2204-5fa6-4fdc-8749-f60ec4a95303\") " pod="openshift-network-operator/iptables-alerter-6l9wb" Jul 30 19:39:28.311018 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.310890 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nq54q\" (UniqueName: \"kubernetes.io/projected/07586ae2-3389-4063-b494-eb1affb8ad5b-kube-api-access-nq54q\") pod \"node-ca-crnbd\" (UID: \"07586ae2-3389-4063-b494-eb1affb8ad5b\") " pod="openshift-image-registry/node-ca-crnbd" Jul 30 19:39:28.311018 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.310917 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2b80bb73-3e52-45c7-80c1-2beec4c736ac-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-g5s9d\" (UID: \"2b80bb73-3e52-45c7-80c1-2beec4c736ac\") " pod="openshift-multus/multus-additional-cni-plugins-g5s9d" Jul 30 19:39:28.311018 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.310942 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m8k4c\" (UniqueName: \"kubernetes.io/projected/a11908b9-aecd-47de-b9a8-c49537dff46b-kube-api-access-m8k4c\") pod \"ovnkube-node-sjhkz\" (UID: \"a11908b9-aecd-47de-b9a8-c49537dff46b\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjhkz" Jul 30 19:39:28.311018 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.310972 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8v8wr\" (UniqueName: \"kubernetes.io/projected/5f2f2204-5fa6-4fdc-8749-f60ec4a95303-kube-api-access-8v8wr\") pod \"iptables-alerter-6l9wb\" (UID: \"5f2f2204-5fa6-4fdc-8749-f60ec4a95303\") " pod="openshift-network-operator/iptables-alerter-6l9wb" Jul 30 19:39:28.311018 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.310994 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/07586ae2-3389-4063-b494-eb1affb8ad5b-host\") pod \"node-ca-crnbd\" (UID: \"07586ae2-3389-4063-b494-eb1affb8ad5b\") " pod="openshift-image-registry/node-ca-crnbd" Jul 30 19:39:28.311351 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.311019 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6hk8\" (UniqueName: \"kubernetes.io/projected/3061134d-d0a7-491b-8d15-88a12ce9d02d-kube-api-access-w6hk8\") pod \"node-resolver-krnh8\" (UID: \"3061134d-d0a7-491b-8d15-88a12ce9d02d\") " pod="openshift-dns/node-resolver-krnh8" Jul 30 19:39:28.311351 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.311044 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a11908b9-aecd-47de-b9a8-c49537dff46b-host-kubelet\") pod \"ovnkube-node-sjhkz\" (UID: \"a11908b9-aecd-47de-b9a8-c49537dff46b\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjhkz" Jul 30 19:39:28.311351 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.311068 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e87200c1-3059-4317-84b2-b2caf70a1a21-etc-modprobe-d\") pod \"tuned-cbkpr\" (UID: \"e87200c1-3059-4317-84b2-b2caf70a1a21\") " pod="openshift-cluster-node-tuning-operator/tuned-cbkpr" Jul 30 19:39:28.311351 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.311091 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e87200c1-3059-4317-84b2-b2caf70a1a21-var-lib-kubelet\") pod \"tuned-cbkpr\" (UID: \"e87200c1-3059-4317-84b2-b2caf70a1a21\") " pod="openshift-cluster-node-tuning-operator/tuned-cbkpr" Jul 30 19:39:28.311351 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.311129 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a11908b9-aecd-47de-b9a8-c49537dff46b-env-overrides\") pod \"ovnkube-node-sjhkz\" (UID: \"a11908b9-aecd-47de-b9a8-c49537dff46b\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjhkz" Jul 30 19:39:28.311351 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.311152 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e87200c1-3059-4317-84b2-b2caf70a1a21-sys\") pod \"tuned-cbkpr\" (UID: \"e87200c1-3059-4317-84b2-b2caf70a1a21\") " pod="openshift-cluster-node-tuning-operator/tuned-cbkpr" Jul 30 19:39:28.311351 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.311184 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a11908b9-aecd-47de-b9a8-c49537dff46b-log-socket\") pod \"ovnkube-node-sjhkz\" (UID: \"a11908b9-aecd-47de-b9a8-c49537dff46b\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjhkz" Jul 30 19:39:28.311351 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.311222 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ef0f467f-7334-4115-9601-875fd55fb025-original-pull-secret\") pod \"global-pull-secret-syncer-fn7fj\" (UID: \"ef0f467f-7334-4115-9601-875fd55fb025\") " pod="kube-system/global-pull-secret-syncer-fn7fj" Jul 30 19:39:28.311351 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.311244 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/291f3d88-2c11-4b10-8e36-e4cb333a7c16-system-cni-dir\") pod \"multus-8flqh\" (UID: \"291f3d88-2c11-4b10-8e36-e4cb333a7c16\") " pod="openshift-multus/multus-8flqh" Jul 30 19:39:28.311351 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.311268 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/291f3d88-2c11-4b10-8e36-e4cb333a7c16-host-var-lib-cni-multus\") pod \"multus-8flqh\" (UID: \"291f3d88-2c11-4b10-8e36-e4cb333a7c16\") " pod="openshift-multus/multus-8flqh" Jul 30 19:39:28.311351 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.311309 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/291f3d88-2c11-4b10-8e36-e4cb333a7c16-multus-conf-dir\") pod \"multus-8flqh\" (UID: \"291f3d88-2c11-4b10-8e36-e4cb333a7c16\") " pod="openshift-multus/multus-8flqh" Jul 30 19:39:28.311914 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.311546 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2b80bb73-3e52-45c7-80c1-2beec4c736ac-cnibin\") pod \"multus-additional-cni-plugins-g5s9d\" (UID: \"2b80bb73-3e52-45c7-80c1-2beec4c736ac\") " pod="openshift-multus/multus-additional-cni-plugins-g5s9d" Jul 30 19:39:28.311914 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.311591 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1be342d5-ea6e-4ec7-af4a-61e79e9bfe90-agent-certs\") pod \"konnectivity-agent-swtbz\" (UID: \"1be342d5-ea6e-4ec7-af4a-61e79e9bfe90\") " pod="kube-system/konnectivity-agent-swtbz" Jul 30 19:39:28.311914 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.311618 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a44f2ec2-ca30-4d88-9523-e95b805c047c-registration-dir\") pod \"aws-ebs-csi-driver-node-vmwjm\" (UID: \"a44f2ec2-ca30-4d88-9523-e95b805c047c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vmwjm" Jul 30 19:39:28.311914 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.311661 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a11908b9-aecd-47de-b9a8-c49537dff46b-systemd-units\") pod \"ovnkube-node-sjhkz\" (UID: \"a11908b9-aecd-47de-b9a8-c49537dff46b\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjhkz" Jul 30 19:39:28.311914 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.311691 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/291f3d88-2c11-4b10-8e36-e4cb333a7c16-etc-kubernetes\") pod \"multus-8flqh\" (UID: \"291f3d88-2c11-4b10-8e36-e4cb333a7c16\") " pod="openshift-multus/multus-8flqh" Jul 30 19:39:28.311914 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.311721 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a44f2ec2-ca30-4d88-9523-e95b805c047c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vmwjm\" (UID: \"a44f2ec2-ca30-4d88-9523-e95b805c047c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vmwjm" Jul 30 19:39:28.311914 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.311748 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/291f3d88-2c11-4b10-8e36-e4cb333a7c16-multus-cni-dir\") pod \"multus-8flqh\" (UID: \"291f3d88-2c11-4b10-8e36-e4cb333a7c16\") " pod="openshift-multus/multus-8flqh" Jul 30 19:39:28.311914 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.311772 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2b80bb73-3e52-45c7-80c1-2beec4c736ac-os-release\") pod \"multus-additional-cni-plugins-g5s9d\" (UID: \"2b80bb73-3e52-45c7-80c1-2beec4c736ac\") " pod="openshift-multus/multus-additional-cni-plugins-g5s9d" Jul 30 19:39:28.311914 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.311803 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2b80bb73-3e52-45c7-80c1-2beec4c736ac-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-g5s9d\" (UID: \"2b80bb73-3e52-45c7-80c1-2beec4c736ac\") " pod="openshift-multus/multus-additional-cni-plugins-g5s9d" Jul 30 19:39:28.311914 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.311823 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a11908b9-aecd-47de-b9a8-c49537dff46b-log-socket\") pod \"ovnkube-node-sjhkz\" (UID: \"a11908b9-aecd-47de-b9a8-c49537dff46b\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjhkz" Jul 30 19:39:28.311914 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.311837 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e87200c1-3059-4317-84b2-b2caf70a1a21-tmp\") pod \"tuned-cbkpr\" (UID: \"e87200c1-3059-4317-84b2-b2caf70a1a21\") " pod="openshift-cluster-node-tuning-operator/tuned-cbkpr" Jul 30 19:39:28.311914 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.311864 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a11908b9-aecd-47de-b9a8-c49537dff46b-host-slash\") pod \"ovnkube-node-sjhkz\" (UID: \"a11908b9-aecd-47de-b9a8-c49537dff46b\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjhkz" Jul 30 19:39:28.311914 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.311890 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e87200c1-3059-4317-84b2-b2caf70a1a21-host\") pod \"tuned-cbkpr\" (UID: \"e87200c1-3059-4317-84b2-b2caf70a1a21\") " pod="openshift-cluster-node-tuning-operator/tuned-cbkpr" Jul 30 19:39:28.311914 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.311919 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/291f3d88-2c11-4b10-8e36-e4cb333a7c16-host-var-lib-cni-bin\") pod \"multus-8flqh\" (UID: \"291f3d88-2c11-4b10-8e36-e4cb333a7c16\") " pod="openshift-multus/multus-8flqh" Jul 30 19:39:28.312599 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.311949 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9tg8k\" (UniqueName: \"kubernetes.io/projected/291f3d88-2c11-4b10-8e36-e4cb333a7c16-kube-api-access-9tg8k\") pod \"multus-8flqh\" (UID: \"291f3d88-2c11-4b10-8e36-e4cb333a7c16\") " pod="openshift-multus/multus-8flqh" Jul 30 19:39:28.312599 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.311980 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e87200c1-3059-4317-84b2-b2caf70a1a21-etc-sysconfig\") pod \"tuned-cbkpr\" (UID: \"e87200c1-3059-4317-84b2-b2caf70a1a21\") " pod="openshift-cluster-node-tuning-operator/tuned-cbkpr" Jul 30 19:39:28.312599 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.312009 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a11908b9-aecd-47de-b9a8-c49537dff46b-run-openvswitch\") pod \"ovnkube-node-sjhkz\" (UID: \"a11908b9-aecd-47de-b9a8-c49537dff46b\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjhkz" Jul 30 19:39:28.312599 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.312037 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a11908b9-aecd-47de-b9a8-c49537dff46b-host-run-ovn-kubernetes\") pod \"ovnkube-node-sjhkz\" (UID: \"a11908b9-aecd-47de-b9a8-c49537dff46b\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjhkz" Jul 30 19:39:28.312599 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.312101 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a11908b9-aecd-47de-b9a8-c49537dff46b-host-run-ovn-kubernetes\") pod \"ovnkube-node-sjhkz\" (UID: \"a11908b9-aecd-47de-b9a8-c49537dff46b\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjhkz" Jul 30 19:39:28.312599 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.312464 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a44f2ec2-ca30-4d88-9523-e95b805c047c-registration-dir\") pod \"aws-ebs-csi-driver-node-vmwjm\" (UID: \"a44f2ec2-ca30-4d88-9523-e95b805c047c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vmwjm" Jul 30 19:39:28.312599 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.312524 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a11908b9-aecd-47de-b9a8-c49537dff46b-systemd-units\") pod \"ovnkube-node-sjhkz\" (UID: \"a11908b9-aecd-47de-b9a8-c49537dff46b\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjhkz" Jul 30 19:39:28.312599 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.312597 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a11908b9-aecd-47de-b9a8-c49537dff46b-host-kubelet\") pod \"ovnkube-node-sjhkz\" (UID: \"a11908b9-aecd-47de-b9a8-c49537dff46b\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjhkz" Jul 30 19:39:28.312942 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.312650 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a44f2ec2-ca30-4d88-9523-e95b805c047c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vmwjm\" (UID: \"a44f2ec2-ca30-4d88-9523-e95b805c047c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vmwjm" Jul 30 19:39:28.312942 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.312652 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e87200c1-3059-4317-84b2-b2caf70a1a21-etc-modprobe-d\") pod \"tuned-cbkpr\" (UID: \"e87200c1-3059-4317-84b2-b2caf70a1a21\") " pod="openshift-cluster-node-tuning-operator/tuned-cbkpr" Jul 30 19:39:28.312942 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.312731 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e87200c1-3059-4317-84b2-b2caf70a1a21-var-lib-kubelet\") pod \"tuned-cbkpr\" (UID: \"e87200c1-3059-4317-84b2-b2caf70a1a21\") " pod="openshift-cluster-node-tuning-operator/tuned-cbkpr" Jul 30 19:39:28.312942 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.312748 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e87200c1-3059-4317-84b2-b2caf70a1a21-sys\") pod \"tuned-cbkpr\" (UID: \"e87200c1-3059-4317-84b2-b2caf70a1a21\") " pod="openshift-cluster-node-tuning-operator/tuned-cbkpr" Jul 30 19:39:28.313188 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.313139 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e87200c1-3059-4317-84b2-b2caf70a1a21-host\") pod \"tuned-cbkpr\" (UID: \"e87200c1-3059-4317-84b2-b2caf70a1a21\") " pod="openshift-cluster-node-tuning-operator/tuned-cbkpr" Jul 30 19:39:28.313246 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.313190 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a11908b9-aecd-47de-b9a8-c49537dff46b-env-overrides\") pod \"ovnkube-node-sjhkz\" (UID: \"a11908b9-aecd-47de-b9a8-c49537dff46b\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjhkz" Jul 30 19:39:28.313246 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.313211 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a11908b9-aecd-47de-b9a8-c49537dff46b-host-slash\") pod \"ovnkube-node-sjhkz\" (UID: \"a11908b9-aecd-47de-b9a8-c49537dff46b\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjhkz" Jul 30 19:39:28.313246 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.313231 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e87200c1-3059-4317-84b2-b2caf70a1a21-etc-sysconfig\") pod \"tuned-cbkpr\" (UID: \"e87200c1-3059-4317-84b2-b2caf70a1a21\") " pod="openshift-cluster-node-tuning-operator/tuned-cbkpr" Jul 30 19:39:28.313429 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.313269 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a11908b9-aecd-47de-b9a8-c49537dff46b-run-openvswitch\") pod \"ovnkube-node-sjhkz\" (UID: \"a11908b9-aecd-47de-b9a8-c49537dff46b\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjhkz" Jul 30 19:39:28.313429 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.313326 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5f2f2204-5fa6-4fdc-8749-f60ec4a95303-iptables-alerter-script\") pod \"iptables-alerter-6l9wb\" (UID: \"5f2f2204-5fa6-4fdc-8749-f60ec4a95303\") " pod="openshift-network-operator/iptables-alerter-6l9wb" Jul 30 19:39:28.313429 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.313412 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/291f3d88-2c11-4b10-8e36-e4cb333a7c16-cnibin\") pod \"multus-8flqh\" (UID: \"291f3d88-2c11-4b10-8e36-e4cb333a7c16\") " pod="openshift-multus/multus-8flqh" Jul 30 19:39:28.313586 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.313447 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/291f3d88-2c11-4b10-8e36-e4cb333a7c16-os-release\") pod \"multus-8flqh\" (UID: \"291f3d88-2c11-4b10-8e36-e4cb333a7c16\") " pod="openshift-multus/multus-8flqh" Jul 30 19:39:28.313586 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.313470 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/291f3d88-2c11-4b10-8e36-e4cb333a7c16-hostroot\") pod \"multus-8flqh\" (UID: \"291f3d88-2c11-4b10-8e36-e4cb333a7c16\") " pod="openshift-multus/multus-8flqh" Jul 30 19:39:28.313586 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.313498 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1be342d5-ea6e-4ec7-af4a-61e79e9bfe90-konnectivity-ca\") pod \"konnectivity-agent-swtbz\" (UID: \"1be342d5-ea6e-4ec7-af4a-61e79e9bfe90\") " pod="kube-system/konnectivity-agent-swtbz" Jul 30 19:39:28.313586 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.313530 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e87200c1-3059-4317-84b2-b2caf70a1a21-etc-kubernetes\") pod \"tuned-cbkpr\" (UID: \"e87200c1-3059-4317-84b2-b2caf70a1a21\") " pod="openshift-cluster-node-tuning-operator/tuned-cbkpr" Jul 30 19:39:28.313586 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.313558 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a11908b9-aecd-47de-b9a8-c49537dff46b-var-lib-openvswitch\") pod \"ovnkube-node-sjhkz\" (UID: \"a11908b9-aecd-47de-b9a8-c49537dff46b\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjhkz" Jul 30 19:39:28.313586 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.313538 2555 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 30 19:39:28.313841 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.313590 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a11908b9-aecd-47de-b9a8-c49537dff46b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-sjhkz\" (UID: \"a11908b9-aecd-47de-b9a8-c49537dff46b\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjhkz" Jul 30 19:39:28.313841 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.313632 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a1ca9892-7f18-4426-80c4-3e9c14681dab-metrics-certs\") pod \"network-metrics-daemon-sx4k5\" (UID: \"a1ca9892-7f18-4426-80c4-3e9c14681dab\") " pod="openshift-multus/network-metrics-daemon-sx4k5" Jul 30 19:39:28.313841 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.313662 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ef0f467f-7334-4115-9601-875fd55fb025-kubelet-config\") pod \"global-pull-secret-syncer-fn7fj\" (UID: \"ef0f467f-7334-4115-9601-875fd55fb025\") " pod="kube-system/global-pull-secret-syncer-fn7fj" Jul 30 19:39:28.313841 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.313689 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ef0f467f-7334-4115-9601-875fd55fb025-dbus\") pod \"global-pull-secret-syncer-fn7fj\" (UID: \"ef0f467f-7334-4115-9601-875fd55fb025\") " pod="kube-system/global-pull-secret-syncer-fn7fj" Jul 30 19:39:28.313841 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.313715 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/07586ae2-3389-4063-b494-eb1affb8ad5b-serviceca\") pod \"node-ca-crnbd\" (UID: \"07586ae2-3389-4063-b494-eb1affb8ad5b\") " pod="openshift-image-registry/node-ca-crnbd" Jul 30 19:39:28.313841 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.313740 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a44f2ec2-ca30-4d88-9523-e95b805c047c-socket-dir\") pod \"aws-ebs-csi-driver-node-vmwjm\" (UID: \"a44f2ec2-ca30-4d88-9523-e95b805c047c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vmwjm" Jul 30 19:39:28.313841 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.313768 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e87200c1-3059-4317-84b2-b2caf70a1a21-etc-systemd\") pod \"tuned-cbkpr\" (UID: \"e87200c1-3059-4317-84b2-b2caf70a1a21\") " pod="openshift-cluster-node-tuning-operator/tuned-cbkpr" Jul 30 19:39:28.313841 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.313796 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e87200c1-3059-4317-84b2-b2caf70a1a21-etc-tuned\") pod \"tuned-cbkpr\" (UID: \"e87200c1-3059-4317-84b2-b2caf70a1a21\") " pod="openshift-cluster-node-tuning-operator/tuned-cbkpr" Jul 30 19:39:28.313841 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.313824 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3061134d-d0a7-491b-8d15-88a12ce9d02d-hosts-file\") pod \"node-resolver-krnh8\" (UID: \"3061134d-d0a7-491b-8d15-88a12ce9d02d\") " pod="openshift-dns/node-resolver-krnh8" Jul 30 19:39:28.314249 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.313852 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a11908b9-aecd-47de-b9a8-c49537dff46b-run-ovn\") pod \"ovnkube-node-sjhkz\" (UID: \"a11908b9-aecd-47de-b9a8-c49537dff46b\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjhkz" Jul 30 19:39:28.314249 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.313880 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a11908b9-aecd-47de-b9a8-c49537dff46b-ovnkube-script-lib\") pod \"ovnkube-node-sjhkz\" (UID: \"a11908b9-aecd-47de-b9a8-c49537dff46b\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjhkz" Jul 30 19:39:28.314249 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.313874 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a11908b9-aecd-47de-b9a8-c49537dff46b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-sjhkz\" (UID: \"a11908b9-aecd-47de-b9a8-c49537dff46b\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjhkz" Jul 30 19:39:28.314249 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.313921 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/291f3d88-2c11-4b10-8e36-e4cb333a7c16-host-run-multus-certs\") pod \"multus-8flqh\" (UID: \"291f3d88-2c11-4b10-8e36-e4cb333a7c16\") " pod="openshift-multus/multus-8flqh" Jul 30 19:39:28.314249 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.313965 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6xrz\" (UniqueName: \"kubernetes.io/projected/e87200c1-3059-4317-84b2-b2caf70a1a21-kube-api-access-k6xrz\") pod \"tuned-cbkpr\" (UID: \"e87200c1-3059-4317-84b2-b2caf70a1a21\") " pod="openshift-cluster-node-tuning-operator/tuned-cbkpr" Jul 30 19:39:28.314249 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.314072 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a11908b9-aecd-47de-b9a8-c49537dff46b-var-lib-openvswitch\") pod \"ovnkube-node-sjhkz\" (UID: \"a11908b9-aecd-47de-b9a8-c49537dff46b\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjhkz" Jul 30 19:39:28.314249 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.314151 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a11908b9-aecd-47de-b9a8-c49537dff46b-run-ovn\") pod \"ovnkube-node-sjhkz\" (UID: \"a11908b9-aecd-47de-b9a8-c49537dff46b\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjhkz" Jul 30 19:39:28.314249 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:39:28.314165 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 30 19:39:28.314249 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.314240 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a11908b9-aecd-47de-b9a8-c49537dff46b-run-systemd\") pod \"ovnkube-node-sjhkz\" (UID: \"a11908b9-aecd-47de-b9a8-c49537dff46b\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjhkz" Jul 30 19:39:28.314675 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:39:28.314292 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1ca9892-7f18-4426-80c4-3e9c14681dab-metrics-certs podName:a1ca9892-7f18-4426-80c4-3e9c14681dab nodeName:}" failed. No retries permitted until 2026-07-30 19:39:28.81425536 +0000 UTC m=+2.965334917 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a1ca9892-7f18-4426-80c4-3e9c14681dab-metrics-certs") pod "network-metrics-daemon-sx4k5" (UID: "a1ca9892-7f18-4426-80c4-3e9c14681dab") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 30 19:39:28.314675 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.314316 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a11908b9-aecd-47de-b9a8-c49537dff46b-run-systemd\") pod \"ovnkube-node-sjhkz\" (UID: \"a11908b9-aecd-47de-b9a8-c49537dff46b\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjhkz" Jul 30 19:39:28.314675 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.314322 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a11908b9-aecd-47de-b9a8-c49537dff46b-host-cni-bin\") pod \"ovnkube-node-sjhkz\" (UID: \"a11908b9-aecd-47de-b9a8-c49537dff46b\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjhkz" Jul 30 19:39:28.314675 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.314355 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fthh6\" (UniqueName: \"kubernetes.io/projected/a1ca9892-7f18-4426-80c4-3e9c14681dab-kube-api-access-fthh6\") pod \"network-metrics-daemon-sx4k5\" (UID: \"a1ca9892-7f18-4426-80c4-3e9c14681dab\") " pod="openshift-multus/network-metrics-daemon-sx4k5" Jul 30 19:39:28.314675 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.314391 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/291f3d88-2c11-4b10-8e36-e4cb333a7c16-cni-binary-copy\") pod \"multus-8flqh\" (UID: \"291f3d88-2c11-4b10-8e36-e4cb333a7c16\") " pod="openshift-multus/multus-8flqh" Jul 30 19:39:28.314675 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.314422 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a44f2ec2-ca30-4d88-9523-e95b805c047c-socket-dir\") pod \"aws-ebs-csi-driver-node-vmwjm\" (UID: \"a44f2ec2-ca30-4d88-9523-e95b805c047c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vmwjm" Jul 30 19:39:28.314675 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.314504 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2b80bb73-3e52-45c7-80c1-2beec4c736ac-tuning-conf-dir\") pod \"multus-additional-cni-plugins-g5s9d\" (UID: \"2b80bb73-3e52-45c7-80c1-2beec4c736ac\") " pod="openshift-multus/multus-additional-cni-plugins-g5s9d" Jul 30 19:39:28.314675 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.314557 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a44f2ec2-ca30-4d88-9523-e95b805c047c-device-dir\") pod \"aws-ebs-csi-driver-node-vmwjm\" (UID: \"a44f2ec2-ca30-4d88-9523-e95b805c047c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vmwjm" Jul 30 19:39:28.314675 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.314589 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a11908b9-aecd-47de-b9a8-c49537dff46b-ovn-node-metrics-cert\") pod \"ovnkube-node-sjhkz\" (UID: \"a11908b9-aecd-47de-b9a8-c49537dff46b\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjhkz" Jul 30 19:39:28.314675 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.314605 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3061134d-d0a7-491b-8d15-88a12ce9d02d-hosts-file\") pod \"node-resolver-krnh8\" (UID: \"3061134d-d0a7-491b-8d15-88a12ce9d02d\") " pod="openshift-dns/node-resolver-krnh8" Jul 30 19:39:28.314675 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.314677 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e87200c1-3059-4317-84b2-b2caf70a1a21-etc-kubernetes\") pod \"tuned-cbkpr\" (UID: \"e87200c1-3059-4317-84b2-b2caf70a1a21\") " pod="openshift-cluster-node-tuning-operator/tuned-cbkpr" Jul 30 19:39:28.315196 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.314682 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a11908b9-aecd-47de-b9a8-c49537dff46b-ovnkube-script-lib\") pod \"ovnkube-node-sjhkz\" (UID: \"a11908b9-aecd-47de-b9a8-c49537dff46b\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjhkz" Jul 30 19:39:28.315196 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.314723 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e87200c1-3059-4317-84b2-b2caf70a1a21-etc-systemd\") pod \"tuned-cbkpr\" (UID: \"e87200c1-3059-4317-84b2-b2caf70a1a21\") " pod="openshift-cluster-node-tuning-operator/tuned-cbkpr" Jul 30 19:39:28.315196 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.314758 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/291f3d88-2c11-4b10-8e36-e4cb333a7c16-multus-socket-dir-parent\") pod \"multus-8flqh\" (UID: \"291f3d88-2c11-4b10-8e36-e4cb333a7c16\") " pod="openshift-multus/multus-8flqh" Jul 30 19:39:28.315196 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.314790 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2b80bb73-3e52-45c7-80c1-2beec4c736ac-cni-binary-copy\") pod \"multus-additional-cni-plugins-g5s9d\" (UID: \"2b80bb73-3e52-45c7-80c1-2beec4c736ac\") " pod="openshift-multus/multus-additional-cni-plugins-g5s9d" Jul 30 19:39:28.315196 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.314844 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a11908b9-aecd-47de-b9a8-c49537dff46b-host-cni-bin\") pod \"ovnkube-node-sjhkz\" (UID: \"a11908b9-aecd-47de-b9a8-c49537dff46b\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjhkz" Jul 30 19:39:28.315196 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.314885 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a44f2ec2-ca30-4d88-9523-e95b805c047c-etc-selinux\") pod \"aws-ebs-csi-driver-node-vmwjm\" (UID: \"a44f2ec2-ca30-4d88-9523-e95b805c047c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vmwjm" Jul 30 19:39:28.315196 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.314925 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e87200c1-3059-4317-84b2-b2caf70a1a21-etc-sysctl-conf\") pod \"tuned-cbkpr\" (UID: \"e87200c1-3059-4317-84b2-b2caf70a1a21\") " pod="openshift-cluster-node-tuning-operator/tuned-cbkpr" Jul 30 19:39:28.315196 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.314960 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a44f2ec2-ca30-4d88-9523-e95b805c047c-device-dir\") pod \"aws-ebs-csi-driver-node-vmwjm\" (UID: \"a44f2ec2-ca30-4d88-9523-e95b805c047c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vmwjm" Jul 30 19:39:28.315196 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.315013 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a11908b9-aecd-47de-b9a8-c49537dff46b-host-run-netns\") pod \"ovnkube-node-sjhkz\" (UID: \"a11908b9-aecd-47de-b9a8-c49537dff46b\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjhkz" Jul 30 19:39:28.315196 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.315049 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-45lmh\" (UniqueName: \"kubernetes.io/projected/58525c90-52a2-441e-8ebc-6d165487e982-kube-api-access-45lmh\") pod \"network-check-target-k2nrq\" (UID: \"58525c90-52a2-441e-8ebc-6d165487e982\") " pod="openshift-network-diagnostics/network-check-target-k2nrq" Jul 30 19:39:28.315196 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.315055 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a11908b9-aecd-47de-b9a8-c49537dff46b-host-run-netns\") pod \"ovnkube-node-sjhkz\" (UID: \"a11908b9-aecd-47de-b9a8-c49537dff46b\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjhkz" Jul 30 19:39:28.315196 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.315102 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/291f3d88-2c11-4b10-8e36-e4cb333a7c16-host-var-lib-kubelet\") pod \"multus-8flqh\" (UID: \"291f3d88-2c11-4b10-8e36-e4cb333a7c16\") " pod="openshift-multus/multus-8flqh" Jul 30 19:39:28.315196 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.315125 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a44f2ec2-ca30-4d88-9523-e95b805c047c-etc-selinux\") pod \"aws-ebs-csi-driver-node-vmwjm\" (UID: \"a44f2ec2-ca30-4d88-9523-e95b805c047c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vmwjm" Jul 30 19:39:28.315196 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.315136 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e87200c1-3059-4317-84b2-b2caf70a1a21-etc-sysctl-d\") pod \"tuned-cbkpr\" (UID: \"e87200c1-3059-4317-84b2-b2caf70a1a21\") " pod="openshift-cluster-node-tuning-operator/tuned-cbkpr" Jul 30 19:39:28.315196 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.315169 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e87200c1-3059-4317-84b2-b2caf70a1a21-run\") pod \"tuned-cbkpr\" (UID: \"e87200c1-3059-4317-84b2-b2caf70a1a21\") " pod="openshift-cluster-node-tuning-operator/tuned-cbkpr" Jul 30 19:39:28.315196 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.315202 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e87200c1-3059-4317-84b2-b2caf70a1a21-lib-modules\") pod \"tuned-cbkpr\" (UID: \"e87200c1-3059-4317-84b2-b2caf70a1a21\") " pod="openshift-cluster-node-tuning-operator/tuned-cbkpr" Jul 30 19:39:28.315935 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.315235 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/291f3d88-2c11-4b10-8e36-e4cb333a7c16-host-run-k8s-cni-cncf-io\") pod \"multus-8flqh\" (UID: \"291f3d88-2c11-4b10-8e36-e4cb333a7c16\") " pod="openshift-multus/multus-8flqh" Jul 30 19:39:28.315935 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.315264 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/291f3d88-2c11-4b10-8e36-e4cb333a7c16-host-run-netns\") pod \"multus-8flqh\" (UID: \"291f3d88-2c11-4b10-8e36-e4cb333a7c16\") " pod="openshift-multus/multus-8flqh" Jul 30 19:39:28.315935 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.315303 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e87200c1-3059-4317-84b2-b2caf70a1a21-etc-sysctl-conf\") pod \"tuned-cbkpr\" (UID: \"e87200c1-3059-4317-84b2-b2caf70a1a21\") " pod="openshift-cluster-node-tuning-operator/tuned-cbkpr" Jul 30 19:39:28.315935 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.315344 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e87200c1-3059-4317-84b2-b2caf70a1a21-run\") pod \"tuned-cbkpr\" (UID: \"e87200c1-3059-4317-84b2-b2caf70a1a21\") " pod="openshift-cluster-node-tuning-operator/tuned-cbkpr" Jul 30 19:39:28.315935 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.315419 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e87200c1-3059-4317-84b2-b2caf70a1a21-etc-sysctl-d\") pod \"tuned-cbkpr\" (UID: \"e87200c1-3059-4317-84b2-b2caf70a1a21\") " pod="openshift-cluster-node-tuning-operator/tuned-cbkpr" Jul 30 19:39:28.315935 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.315477 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4h5pn\" (UniqueName: \"kubernetes.io/projected/a44f2ec2-ca30-4d88-9523-e95b805c047c-kube-api-access-4h5pn\") pod \"aws-ebs-csi-driver-node-vmwjm\" (UID: \"a44f2ec2-ca30-4d88-9523-e95b805c047c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vmwjm" Jul 30 19:39:28.315935 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.315485 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e87200c1-3059-4317-84b2-b2caf70a1a21-lib-modules\") pod \"tuned-cbkpr\" (UID: \"e87200c1-3059-4317-84b2-b2caf70a1a21\") " pod="openshift-cluster-node-tuning-operator/tuned-cbkpr" Jul 30 19:39:28.315935 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.315530 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3061134d-d0a7-491b-8d15-88a12ce9d02d-tmp-dir\") pod \"node-resolver-krnh8\" (UID: \"3061134d-d0a7-491b-8d15-88a12ce9d02d\") " pod="openshift-dns/node-resolver-krnh8" Jul 30 19:39:28.315935 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.315580 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2b80bb73-3e52-45c7-80c1-2beec4c736ac-system-cni-dir\") pod \"multus-additional-cni-plugins-g5s9d\" (UID: \"2b80bb73-3e52-45c7-80c1-2beec4c736ac\") " pod="openshift-multus/multus-additional-cni-plugins-g5s9d" Jul 30 19:39:28.315935 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.315610 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5t7mg\" (UniqueName: \"kubernetes.io/projected/2b80bb73-3e52-45c7-80c1-2beec4c736ac-kube-api-access-5t7mg\") pod \"multus-additional-cni-plugins-g5s9d\" (UID: \"2b80bb73-3e52-45c7-80c1-2beec4c736ac\") " pod="openshift-multus/multus-additional-cni-plugins-g5s9d" Jul 30 19:39:28.315935 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.315741 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a44f2ec2-ca30-4d88-9523-e95b805c047c-sys-fs\") pod \"aws-ebs-csi-driver-node-vmwjm\" (UID: \"a44f2ec2-ca30-4d88-9523-e95b805c047c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vmwjm" Jul 30 19:39:28.315935 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.315782 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/291f3d88-2c11-4b10-8e36-e4cb333a7c16-multus-daemon-config\") pod \"multus-8flqh\" (UID: \"291f3d88-2c11-4b10-8e36-e4cb333a7c16\") " pod="openshift-multus/multus-8flqh" Jul 30 19:39:28.315935 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.315820 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a44f2ec2-ca30-4d88-9523-e95b805c047c-sys-fs\") pod \"aws-ebs-csi-driver-node-vmwjm\" (UID: \"a44f2ec2-ca30-4d88-9523-e95b805c047c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vmwjm" Jul 30 19:39:28.315935 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.315866 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5f2f2204-5fa6-4fdc-8749-f60ec4a95303-host-slash\") pod \"iptables-alerter-6l9wb\" (UID: \"5f2f2204-5fa6-4fdc-8749-f60ec4a95303\") " pod="openshift-network-operator/iptables-alerter-6l9wb" Jul 30 19:39:28.315935 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.315906 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5f2f2204-5fa6-4fdc-8749-f60ec4a95303-host-slash\") pod \"iptables-alerter-6l9wb\" (UID: \"5f2f2204-5fa6-4fdc-8749-f60ec4a95303\") " pod="openshift-network-operator/iptables-alerter-6l9wb" Jul 30 19:39:28.315935 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.315920 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3061134d-d0a7-491b-8d15-88a12ce9d02d-tmp-dir\") pod \"node-resolver-krnh8\" (UID: \"3061134d-d0a7-491b-8d15-88a12ce9d02d\") " pod="openshift-dns/node-resolver-krnh8" Jul 30 19:39:28.316676 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.315956 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a11908b9-aecd-47de-b9a8-c49537dff46b-etc-openvswitch\") pod \"ovnkube-node-sjhkz\" (UID: \"a11908b9-aecd-47de-b9a8-c49537dff46b\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjhkz" Jul 30 19:39:28.316676 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.316007 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a11908b9-aecd-47de-b9a8-c49537dff46b-node-log\") pod \"ovnkube-node-sjhkz\" (UID: \"a11908b9-aecd-47de-b9a8-c49537dff46b\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjhkz" Jul 30 19:39:28.316676 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.316040 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a11908b9-aecd-47de-b9a8-c49537dff46b-host-cni-netd\") pod \"ovnkube-node-sjhkz\" (UID: \"a11908b9-aecd-47de-b9a8-c49537dff46b\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjhkz" Jul 30 19:39:28.316676 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.316047 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a11908b9-aecd-47de-b9a8-c49537dff46b-etc-openvswitch\") pod \"ovnkube-node-sjhkz\" (UID: \"a11908b9-aecd-47de-b9a8-c49537dff46b\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjhkz" Jul 30 19:39:28.316676 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.316066 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a11908b9-aecd-47de-b9a8-c49537dff46b-ovnkube-config\") pod \"ovnkube-node-sjhkz\" (UID: \"a11908b9-aecd-47de-b9a8-c49537dff46b\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjhkz" Jul 30 19:39:28.316676 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.316094 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a11908b9-aecd-47de-b9a8-c49537dff46b-node-log\") pod \"ovnkube-node-sjhkz\" (UID: \"a11908b9-aecd-47de-b9a8-c49537dff46b\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjhkz" Jul 30 19:39:28.316676 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.316121 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a11908b9-aecd-47de-b9a8-c49537dff46b-host-cni-netd\") pod \"ovnkube-node-sjhkz\" (UID: \"a11908b9-aecd-47de-b9a8-c49537dff46b\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjhkz" Jul 30 19:39:28.316676 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.316645 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a11908b9-aecd-47de-b9a8-c49537dff46b-ovnkube-config\") pod \"ovnkube-node-sjhkz\" (UID: \"a11908b9-aecd-47de-b9a8-c49537dff46b\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjhkz" Jul 30 19:39:28.321747 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.321714 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e87200c1-3059-4317-84b2-b2caf70a1a21-etc-tuned\") pod \"tuned-cbkpr\" (UID: \"e87200c1-3059-4317-84b2-b2caf70a1a21\") " pod="openshift-cluster-node-tuning-operator/tuned-cbkpr" Jul 30 19:39:28.321925 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.321905 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e87200c1-3059-4317-84b2-b2caf70a1a21-tmp\") pod \"tuned-cbkpr\" (UID: \"e87200c1-3059-4317-84b2-b2caf70a1a21\") " pod="openshift-cluster-node-tuning-operator/tuned-cbkpr" Jul 30 19:39:28.322291 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.322255 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a11908b9-aecd-47de-b9a8-c49537dff46b-ovn-node-metrics-cert\") pod \"ovnkube-node-sjhkz\" (UID: \"a11908b9-aecd-47de-b9a8-c49537dff46b\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjhkz" Jul 30 19:39:28.324250 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.324157 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m8k4c\" (UniqueName: \"kubernetes.io/projected/a11908b9-aecd-47de-b9a8-c49537dff46b-kube-api-access-m8k4c\") pod \"ovnkube-node-sjhkz\" (UID: \"a11908b9-aecd-47de-b9a8-c49537dff46b\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjhkz" Jul 30 19:39:28.325810 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.325789 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8v8wr\" (UniqueName: \"kubernetes.io/projected/5f2f2204-5fa6-4fdc-8749-f60ec4a95303-kube-api-access-8v8wr\") pod \"iptables-alerter-6l9wb\" (UID: \"5f2f2204-5fa6-4fdc-8749-f60ec4a95303\") " pod="openshift-network-operator/iptables-alerter-6l9wb" Jul 30 19:39:28.325898 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.325816 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6xrz\" (UniqueName: \"kubernetes.io/projected/e87200c1-3059-4317-84b2-b2caf70a1a21-kube-api-access-k6xrz\") pod \"tuned-cbkpr\" (UID: \"e87200c1-3059-4317-84b2-b2caf70a1a21\") " pod="openshift-cluster-node-tuning-operator/tuned-cbkpr" Jul 30 19:39:28.326199 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.326179 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6hk8\" (UniqueName: \"kubernetes.io/projected/3061134d-d0a7-491b-8d15-88a12ce9d02d-kube-api-access-w6hk8\") pod \"node-resolver-krnh8\" (UID: \"3061134d-d0a7-491b-8d15-88a12ce9d02d\") " pod="openshift-dns/node-resolver-krnh8" Jul 30 19:39:28.327307 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.327285 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fthh6\" (UniqueName: \"kubernetes.io/projected/a1ca9892-7f18-4426-80c4-3e9c14681dab-kube-api-access-fthh6\") pod \"network-metrics-daemon-sx4k5\" (UID: \"a1ca9892-7f18-4426-80c4-3e9c14681dab\") " pod="openshift-multus/network-metrics-daemon-sx4k5" Jul 30 19:39:28.329622 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.329600 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4h5pn\" (UniqueName: \"kubernetes.io/projected/a44f2ec2-ca30-4d88-9523-e95b805c047c-kube-api-access-4h5pn\") pod \"aws-ebs-csi-driver-node-vmwjm\" (UID: \"a44f2ec2-ca30-4d88-9523-e95b805c047c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vmwjm" Jul 30 19:39:28.418176 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.417049 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/291f3d88-2c11-4b10-8e36-e4cb333a7c16-host-var-lib-cni-bin\") pod \"multus-8flqh\" (UID: \"291f3d88-2c11-4b10-8e36-e4cb333a7c16\") " pod="openshift-multus/multus-8flqh" Jul 30 19:39:28.418176 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.417090 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9tg8k\" (UniqueName: \"kubernetes.io/projected/291f3d88-2c11-4b10-8e36-e4cb333a7c16-kube-api-access-9tg8k\") pod \"multus-8flqh\" (UID: \"291f3d88-2c11-4b10-8e36-e4cb333a7c16\") " pod="openshift-multus/multus-8flqh" Jul 30 19:39:28.418176 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.417121 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/291f3d88-2c11-4b10-8e36-e4cb333a7c16-cnibin\") pod \"multus-8flqh\" (UID: \"291f3d88-2c11-4b10-8e36-e4cb333a7c16\") " pod="openshift-multus/multus-8flqh" Jul 30 19:39:28.418176 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.417144 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/291f3d88-2c11-4b10-8e36-e4cb333a7c16-os-release\") pod \"multus-8flqh\" (UID: \"291f3d88-2c11-4b10-8e36-e4cb333a7c16\") " pod="openshift-multus/multus-8flqh" Jul 30 19:39:28.418176 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.417165 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/291f3d88-2c11-4b10-8e36-e4cb333a7c16-hostroot\") pod \"multus-8flqh\" (UID: \"291f3d88-2c11-4b10-8e36-e4cb333a7c16\") " pod="openshift-multus/multus-8flqh" Jul 30 19:39:28.418176 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.417187 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1be342d5-ea6e-4ec7-af4a-61e79e9bfe90-konnectivity-ca\") pod \"konnectivity-agent-swtbz\" (UID: \"1be342d5-ea6e-4ec7-af4a-61e79e9bfe90\") " pod="kube-system/konnectivity-agent-swtbz" Jul 30 19:39:28.418176 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.417234 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/291f3d88-2c11-4b10-8e36-e4cb333a7c16-host-var-lib-cni-bin\") pod \"multus-8flqh\" (UID: \"291f3d88-2c11-4b10-8e36-e4cb333a7c16\") " pod="openshift-multus/multus-8flqh" Jul 30 19:39:28.418176 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.417247 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/291f3d88-2c11-4b10-8e36-e4cb333a7c16-cnibin\") pod \"multus-8flqh\" (UID: \"291f3d88-2c11-4b10-8e36-e4cb333a7c16\") " pod="openshift-multus/multus-8flqh" Jul 30 19:39:28.418176 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.417290 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/291f3d88-2c11-4b10-8e36-e4cb333a7c16-os-release\") pod \"multus-8flqh\" (UID: \"291f3d88-2c11-4b10-8e36-e4cb333a7c16\") " pod="openshift-multus/multus-8flqh" Jul 30 19:39:28.418176 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.417296 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/291f3d88-2c11-4b10-8e36-e4cb333a7c16-hostroot\") pod \"multus-8flqh\" (UID: \"291f3d88-2c11-4b10-8e36-e4cb333a7c16\") " pod="openshift-multus/multus-8flqh" Jul 30 19:39:28.418176 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.417319 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ef0f467f-7334-4115-9601-875fd55fb025-kubelet-config\") pod \"global-pull-secret-syncer-fn7fj\" (UID: \"ef0f467f-7334-4115-9601-875fd55fb025\") " pod="kube-system/global-pull-secret-syncer-fn7fj" Jul 30 19:39:28.418176 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.417340 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ef0f467f-7334-4115-9601-875fd55fb025-dbus\") pod \"global-pull-secret-syncer-fn7fj\" (UID: \"ef0f467f-7334-4115-9601-875fd55fb025\") " pod="kube-system/global-pull-secret-syncer-fn7fj" Jul 30 19:39:28.418176 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.417359 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/07586ae2-3389-4063-b494-eb1affb8ad5b-serviceca\") pod \"node-ca-crnbd\" (UID: \"07586ae2-3389-4063-b494-eb1affb8ad5b\") " pod="openshift-image-registry/node-ca-crnbd" Jul 30 19:39:28.418176 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.417387 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/291f3d88-2c11-4b10-8e36-e4cb333a7c16-host-run-multus-certs\") pod \"multus-8flqh\" (UID: \"291f3d88-2c11-4b10-8e36-e4cb333a7c16\") " pod="openshift-multus/multus-8flqh" Jul 30 19:39:28.418176 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.417397 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ef0f467f-7334-4115-9601-875fd55fb025-kubelet-config\") pod \"global-pull-secret-syncer-fn7fj\" (UID: \"ef0f467f-7334-4115-9601-875fd55fb025\") " pod="kube-system/global-pull-secret-syncer-fn7fj" Jul 30 19:39:28.418176 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.417414 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/291f3d88-2c11-4b10-8e36-e4cb333a7c16-cni-binary-copy\") pod \"multus-8flqh\" (UID: \"291f3d88-2c11-4b10-8e36-e4cb333a7c16\") " pod="openshift-multus/multus-8flqh" Jul 30 19:39:28.418176 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.417439 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2b80bb73-3e52-45c7-80c1-2beec4c736ac-tuning-conf-dir\") pod \"multus-additional-cni-plugins-g5s9d\" (UID: \"2b80bb73-3e52-45c7-80c1-2beec4c736ac\") " pod="openshift-multus/multus-additional-cni-plugins-g5s9d" Jul 30 19:39:28.418176 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.417446 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/291f3d88-2c11-4b10-8e36-e4cb333a7c16-host-run-multus-certs\") pod \"multus-8flqh\" (UID: \"291f3d88-2c11-4b10-8e36-e4cb333a7c16\") " pod="openshift-multus/multus-8flqh" Jul 30 19:39:28.419202 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.417475 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/291f3d88-2c11-4b10-8e36-e4cb333a7c16-multus-socket-dir-parent\") pod \"multus-8flqh\" (UID: \"291f3d88-2c11-4b10-8e36-e4cb333a7c16\") " pod="openshift-multus/multus-8flqh" Jul 30 19:39:28.419202 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.417495 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ef0f467f-7334-4115-9601-875fd55fb025-dbus\") pod \"global-pull-secret-syncer-fn7fj\" (UID: \"ef0f467f-7334-4115-9601-875fd55fb025\") " pod="kube-system/global-pull-secret-syncer-fn7fj" Jul 30 19:39:28.419202 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.417503 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2b80bb73-3e52-45c7-80c1-2beec4c736ac-cni-binary-copy\") pod \"multus-additional-cni-plugins-g5s9d\" (UID: \"2b80bb73-3e52-45c7-80c1-2beec4c736ac\") " pod="openshift-multus/multus-additional-cni-plugins-g5s9d" Jul 30 19:39:28.419202 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.417537 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-45lmh\" (UniqueName: \"kubernetes.io/projected/58525c90-52a2-441e-8ebc-6d165487e982-kube-api-access-45lmh\") pod \"network-check-target-k2nrq\" (UID: \"58525c90-52a2-441e-8ebc-6d165487e982\") " pod="openshift-network-diagnostics/network-check-target-k2nrq" Jul 30 19:39:28.419202 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.417562 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/291f3d88-2c11-4b10-8e36-e4cb333a7c16-host-var-lib-kubelet\") pod \"multus-8flqh\" (UID: \"291f3d88-2c11-4b10-8e36-e4cb333a7c16\") " pod="openshift-multus/multus-8flqh" Jul 30 19:39:28.419202 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.417571 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2b80bb73-3e52-45c7-80c1-2beec4c736ac-tuning-conf-dir\") pod \"multus-additional-cni-plugins-g5s9d\" (UID: \"2b80bb73-3e52-45c7-80c1-2beec4c736ac\") " pod="openshift-multus/multus-additional-cni-plugins-g5s9d" Jul 30 19:39:28.419202 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.417588 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/291f3d88-2c11-4b10-8e36-e4cb333a7c16-host-run-k8s-cni-cncf-io\") pod \"multus-8flqh\" (UID: \"291f3d88-2c11-4b10-8e36-e4cb333a7c16\") " pod="openshift-multus/multus-8flqh" Jul 30 19:39:28.419202 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.417612 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/291f3d88-2c11-4b10-8e36-e4cb333a7c16-host-run-netns\") pod \"multus-8flqh\" (UID: \"291f3d88-2c11-4b10-8e36-e4cb333a7c16\") " pod="openshift-multus/multus-8flqh" Jul 30 19:39:28.419202 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.417655 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2b80bb73-3e52-45c7-80c1-2beec4c736ac-system-cni-dir\") pod \"multus-additional-cni-plugins-g5s9d\" (UID: \"2b80bb73-3e52-45c7-80c1-2beec4c736ac\") " pod="openshift-multus/multus-additional-cni-plugins-g5s9d" Jul 30 19:39:28.419202 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.417694 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5t7mg\" (UniqueName: \"kubernetes.io/projected/2b80bb73-3e52-45c7-80c1-2beec4c736ac-kube-api-access-5t7mg\") pod \"multus-additional-cni-plugins-g5s9d\" (UID: \"2b80bb73-3e52-45c7-80c1-2beec4c736ac\") " pod="openshift-multus/multus-additional-cni-plugins-g5s9d" Jul 30 19:39:28.419202 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.417725 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/291f3d88-2c11-4b10-8e36-e4cb333a7c16-multus-daemon-config\") pod \"multus-8flqh\" (UID: \"291f3d88-2c11-4b10-8e36-e4cb333a7c16\") " pod="openshift-multus/multus-8flqh" Jul 30 19:39:28.419202 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.417753 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nq54q\" (UniqueName: \"kubernetes.io/projected/07586ae2-3389-4063-b494-eb1affb8ad5b-kube-api-access-nq54q\") pod \"node-ca-crnbd\" (UID: \"07586ae2-3389-4063-b494-eb1affb8ad5b\") " pod="openshift-image-registry/node-ca-crnbd" Jul 30 19:39:28.419202 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.417776 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2b80bb73-3e52-45c7-80c1-2beec4c736ac-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-g5s9d\" (UID: \"2b80bb73-3e52-45c7-80c1-2beec4c736ac\") " pod="openshift-multus/multus-additional-cni-plugins-g5s9d" Jul 30 19:39:28.419202 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.417794 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1be342d5-ea6e-4ec7-af4a-61e79e9bfe90-konnectivity-ca\") pod \"konnectivity-agent-swtbz\" (UID: \"1be342d5-ea6e-4ec7-af4a-61e79e9bfe90\") " pod="kube-system/konnectivity-agent-swtbz" Jul 30 19:39:28.419202 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.417800 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/07586ae2-3389-4063-b494-eb1affb8ad5b-host\") pod \"node-ca-crnbd\" (UID: \"07586ae2-3389-4063-b494-eb1affb8ad5b\") " pod="openshift-image-registry/node-ca-crnbd" Jul 30 19:39:28.419202 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.417809 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/07586ae2-3389-4063-b494-eb1affb8ad5b-serviceca\") pod \"node-ca-crnbd\" (UID: \"07586ae2-3389-4063-b494-eb1affb8ad5b\") " pod="openshift-image-registry/node-ca-crnbd" Jul 30 19:39:28.419202 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.417839 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ef0f467f-7334-4115-9601-875fd55fb025-original-pull-secret\") pod \"global-pull-secret-syncer-fn7fj\" (UID: \"ef0f467f-7334-4115-9601-875fd55fb025\") " pod="kube-system/global-pull-secret-syncer-fn7fj" Jul 30 19:39:28.419994 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.417853 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/291f3d88-2c11-4b10-8e36-e4cb333a7c16-multus-socket-dir-parent\") pod \"multus-8flqh\" (UID: \"291f3d88-2c11-4b10-8e36-e4cb333a7c16\") " pod="openshift-multus/multus-8flqh" Jul 30 19:39:28.419994 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.417861 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/291f3d88-2c11-4b10-8e36-e4cb333a7c16-system-cni-dir\") pod \"multus-8flqh\" (UID: \"291f3d88-2c11-4b10-8e36-e4cb333a7c16\") " pod="openshift-multus/multus-8flqh" Jul 30 19:39:28.419994 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.417866 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2b80bb73-3e52-45c7-80c1-2beec4c736ac-system-cni-dir\") pod \"multus-additional-cni-plugins-g5s9d\" (UID: \"2b80bb73-3e52-45c7-80c1-2beec4c736ac\") " pod="openshift-multus/multus-additional-cni-plugins-g5s9d" Jul 30 19:39:28.419994 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.417884 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/291f3d88-2c11-4b10-8e36-e4cb333a7c16-host-var-lib-cni-multus\") pod \"multus-8flqh\" (UID: \"291f3d88-2c11-4b10-8e36-e4cb333a7c16\") " pod="openshift-multus/multus-8flqh" Jul 30 19:39:28.419994 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.417894 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/291f3d88-2c11-4b10-8e36-e4cb333a7c16-host-var-lib-kubelet\") pod \"multus-8flqh\" (UID: \"291f3d88-2c11-4b10-8e36-e4cb333a7c16\") " pod="openshift-multus/multus-8flqh" Jul 30 19:39:28.419994 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.417907 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/291f3d88-2c11-4b10-8e36-e4cb333a7c16-multus-conf-dir\") pod \"multus-8flqh\" (UID: \"291f3d88-2c11-4b10-8e36-e4cb333a7c16\") " pod="openshift-multus/multus-8flqh" Jul 30 19:39:28.419994 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.417932 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2b80bb73-3e52-45c7-80c1-2beec4c736ac-cnibin\") pod \"multus-additional-cni-plugins-g5s9d\" (UID: \"2b80bb73-3e52-45c7-80c1-2beec4c736ac\") " pod="openshift-multus/multus-additional-cni-plugins-g5s9d" Jul 30 19:39:28.419994 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.417937 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/291f3d88-2c11-4b10-8e36-e4cb333a7c16-host-run-netns\") pod \"multus-8flqh\" (UID: \"291f3d88-2c11-4b10-8e36-e4cb333a7c16\") " pod="openshift-multus/multus-8flqh" Jul 30 19:39:28.419994 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.417956 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1be342d5-ea6e-4ec7-af4a-61e79e9bfe90-agent-certs\") pod \"konnectivity-agent-swtbz\" (UID: \"1be342d5-ea6e-4ec7-af4a-61e79e9bfe90\") " pod="kube-system/konnectivity-agent-swtbz" Jul 30 19:39:28.419994 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.417983 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/291f3d88-2c11-4b10-8e36-e4cb333a7c16-etc-kubernetes\") pod \"multus-8flqh\" (UID: \"291f3d88-2c11-4b10-8e36-e4cb333a7c16\") " pod="openshift-multus/multus-8flqh" Jul 30 19:39:28.419994 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.418010 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/291f3d88-2c11-4b10-8e36-e4cb333a7c16-multus-cni-dir\") pod \"multus-8flqh\" (UID: \"291f3d88-2c11-4b10-8e36-e4cb333a7c16\") " pod="openshift-multus/multus-8flqh" Jul 30 19:39:28.419994 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.418027 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2b80bb73-3e52-45c7-80c1-2beec4c736ac-cni-binary-copy\") pod \"multus-additional-cni-plugins-g5s9d\" (UID: \"2b80bb73-3e52-45c7-80c1-2beec4c736ac\") " pod="openshift-multus/multus-additional-cni-plugins-g5s9d" Jul 30 19:39:28.419994 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.418068 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2b80bb73-3e52-45c7-80c1-2beec4c736ac-os-release\") pod \"multus-additional-cni-plugins-g5s9d\" (UID: \"2b80bb73-3e52-45c7-80c1-2beec4c736ac\") " pod="openshift-multus/multus-additional-cni-plugins-g5s9d" Jul 30 19:39:28.419994 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.418094 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/291f3d88-2c11-4b10-8e36-e4cb333a7c16-system-cni-dir\") pod \"multus-8flqh\" (UID: \"291f3d88-2c11-4b10-8e36-e4cb333a7c16\") " pod="openshift-multus/multus-8flqh" Jul 30 19:39:28.419994 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.418095 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2b80bb73-3e52-45c7-80c1-2beec4c736ac-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-g5s9d\" (UID: \"2b80bb73-3e52-45c7-80c1-2beec4c736ac\") " pod="openshift-multus/multus-additional-cni-plugins-g5s9d" Jul 30 19:39:28.419994 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.418142 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/291f3d88-2c11-4b10-8e36-e4cb333a7c16-multus-conf-dir\") pod \"multus-8flqh\" (UID: \"291f3d88-2c11-4b10-8e36-e4cb333a7c16\") " pod="openshift-multus/multus-8flqh" Jul 30 19:39:28.419994 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.417908 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/291f3d88-2c11-4b10-8e36-e4cb333a7c16-host-run-k8s-cni-cncf-io\") pod \"multus-8flqh\" (UID: \"291f3d88-2c11-4b10-8e36-e4cb333a7c16\") " pod="openshift-multus/multus-8flqh" Jul 30 19:39:28.419994 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.418188 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2b80bb73-3e52-45c7-80c1-2beec4c736ac-cnibin\") pod \"multus-additional-cni-plugins-g5s9d\" (UID: \"2b80bb73-3e52-45c7-80c1-2beec4c736ac\") " pod="openshift-multus/multus-additional-cni-plugins-g5s9d" Jul 30 19:39:28.420835 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.418233 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/07586ae2-3389-4063-b494-eb1affb8ad5b-host\") pod \"node-ca-crnbd\" (UID: \"07586ae2-3389-4063-b494-eb1affb8ad5b\") " pod="openshift-image-registry/node-ca-crnbd" Jul 30 19:39:28.420835 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:39:28.418318 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 30 19:39:28.420835 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:39:28.418385 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef0f467f-7334-4115-9601-875fd55fb025-original-pull-secret podName:ef0f467f-7334-4115-9601-875fd55fb025 nodeName:}" failed. No retries permitted until 2026-07-30 19:39:28.918367404 +0000 UTC m=+3.069446931 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ef0f467f-7334-4115-9601-875fd55fb025-original-pull-secret") pod "global-pull-secret-syncer-fn7fj" (UID: "ef0f467f-7334-4115-9601-875fd55fb025") : object "kube-system"/"original-pull-secret" not registered Jul 30 19:39:28.420835 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.418511 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/291f3d88-2c11-4b10-8e36-e4cb333a7c16-cni-binary-copy\") pod \"multus-8flqh\" (UID: \"291f3d88-2c11-4b10-8e36-e4cb333a7c16\") " pod="openshift-multus/multus-8flqh" Jul 30 19:39:28.420835 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.418540 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/291f3d88-2c11-4b10-8e36-e4cb333a7c16-host-var-lib-cni-multus\") pod \"multus-8flqh\" (UID: \"291f3d88-2c11-4b10-8e36-e4cb333a7c16\") " pod="openshift-multus/multus-8flqh" Jul 30 19:39:28.420835 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.418582 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/291f3d88-2c11-4b10-8e36-e4cb333a7c16-multus-cni-dir\") pod \"multus-8flqh\" (UID: \"291f3d88-2c11-4b10-8e36-e4cb333a7c16\") " pod="openshift-multus/multus-8flqh" Jul 30 19:39:28.420835 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.418584 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/291f3d88-2c11-4b10-8e36-e4cb333a7c16-etc-kubernetes\") pod \"multus-8flqh\" (UID: \"291f3d88-2c11-4b10-8e36-e4cb333a7c16\") " pod="openshift-multus/multus-8flqh" Jul 30 19:39:28.420835 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.418597 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2b80bb73-3e52-45c7-80c1-2beec4c736ac-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-g5s9d\" (UID: \"2b80bb73-3e52-45c7-80c1-2beec4c736ac\") " pod="openshift-multus/multus-additional-cni-plugins-g5s9d" Jul 30 19:39:28.420835 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.418631 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2b80bb73-3e52-45c7-80c1-2beec4c736ac-os-release\") pod \"multus-additional-cni-plugins-g5s9d\" (UID: \"2b80bb73-3e52-45c7-80c1-2beec4c736ac\") " pod="openshift-multus/multus-additional-cni-plugins-g5s9d" Jul 30 19:39:28.420835 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.419051 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2b80bb73-3e52-45c7-80c1-2beec4c736ac-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-g5s9d\" (UID: \"2b80bb73-3e52-45c7-80c1-2beec4c736ac\") " pod="openshift-multus/multus-additional-cni-plugins-g5s9d" Jul 30 19:39:28.420835 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.420119 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/291f3d88-2c11-4b10-8e36-e4cb333a7c16-multus-daemon-config\") pod \"multus-8flqh\" (UID: \"291f3d88-2c11-4b10-8e36-e4cb333a7c16\") " pod="openshift-multus/multus-8flqh" Jul 30 19:39:28.421499 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.421477 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1be342d5-ea6e-4ec7-af4a-61e79e9bfe90-agent-certs\") pod \"konnectivity-agent-swtbz\" (UID: \"1be342d5-ea6e-4ec7-af4a-61e79e9bfe90\") " pod="kube-system/konnectivity-agent-swtbz" Jul 30 19:39:28.423795 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:39:28.423757 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 30 19:39:28.423795 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:39:28.423779 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 30 19:39:28.423795 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:39:28.423792 2555 projected.go:196] Error preparing data for projected volume kube-api-access-45lmh for pod openshift-network-diagnostics/network-check-target-k2nrq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 30 19:39:28.424003 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:39:28.423845 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/58525c90-52a2-441e-8ebc-6d165487e982-kube-api-access-45lmh podName:58525c90-52a2-441e-8ebc-6d165487e982 nodeName:}" failed. No retries permitted until 2026-07-30 19:39:28.923829046 +0000 UTC m=+3.074908585 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-45lmh" (UniqueName: "kubernetes.io/projected/58525c90-52a2-441e-8ebc-6d165487e982-kube-api-access-45lmh") pod "network-check-target-k2nrq" (UID: "58525c90-52a2-441e-8ebc-6d165487e982") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 30 19:39:28.426522 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.426503 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nq54q\" (UniqueName: \"kubernetes.io/projected/07586ae2-3389-4063-b494-eb1affb8ad5b-kube-api-access-nq54q\") pod \"node-ca-crnbd\" (UID: \"07586ae2-3389-4063-b494-eb1affb8ad5b\") " pod="openshift-image-registry/node-ca-crnbd" Jul 30 19:39:28.426716 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.426698 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9tg8k\" (UniqueName: \"kubernetes.io/projected/291f3d88-2c11-4b10-8e36-e4cb333a7c16-kube-api-access-9tg8k\") pod \"multus-8flqh\" (UID: \"291f3d88-2c11-4b10-8e36-e4cb333a7c16\") " pod="openshift-multus/multus-8flqh" Jul 30 19:39:28.427463 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.427428 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5t7mg\" (UniqueName: \"kubernetes.io/projected/2b80bb73-3e52-45c7-80c1-2beec4c736ac-kube-api-access-5t7mg\") pod \"multus-additional-cni-plugins-g5s9d\" (UID: \"2b80bb73-3e52-45c7-80c1-2beec4c736ac\") " pod="openshift-multus/multus-additional-cni-plugins-g5s9d" Jul 30 19:39:28.516826 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.516745 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-6l9wb" Jul 30 19:39:28.523018 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.522993 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vmwjm" Jul 30 19:39:28.531609 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.531583 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-cbkpr" Jul 30 19:39:28.542208 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.542185 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-krnh8" Jul 30 19:39:28.550119 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.550099 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-sjhkz" Jul 30 19:39:28.551012 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:28.550984 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode87200c1_3059_4317_84b2_b2caf70a1a21.slice/crio-094e91573c1ad055d564be2233376cf28fbacaf48036732d5837b9b1d5329a7e WatchSource:0}: Error finding container 094e91573c1ad055d564be2233376cf28fbacaf48036732d5837b9b1d5329a7e: Status 404 returned error can't find the container with id 094e91573c1ad055d564be2233376cf28fbacaf48036732d5837b9b1d5329a7e Jul 30 19:39:28.551888 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:28.551726 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f2f2204_5fa6_4fdc_8749_f60ec4a95303.slice/crio-8e80f27cfff0c7b5bf0b86db771d5eb7eb40d25d195ec9d09d72196d7994342a WatchSource:0}: Error finding container 8e80f27cfff0c7b5bf0b86db771d5eb7eb40d25d195ec9d09d72196d7994342a: Status 404 returned error can't find the container with id 8e80f27cfff0c7b5bf0b86db771d5eb7eb40d25d195ec9d09d72196d7994342a Jul 30 19:39:28.552676 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:28.552657 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda44f2ec2_ca30_4d88_9523_e95b805c047c.slice/crio-6cfef1538cbf2de737d59c59f6413d8f52bf37d89ea10930eefa0062cba330c2 WatchSource:0}: Error finding container 6cfef1538cbf2de737d59c59f6413d8f52bf37d89ea10930eefa0062cba330c2: Status 404 returned error can't find the container with id 6cfef1538cbf2de737d59c59f6413d8f52bf37d89ea10930eefa0062cba330c2 Jul 30 19:39:28.557122 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.557097 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-swtbz" Jul 30 19:39:28.567174 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.567151 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-crnbd" Jul 30 19:39:28.571174 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:28.571143 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3061134d_d0a7_491b_8d15_88a12ce9d02d.slice/crio-3fcb175b4c8425be7fce0dbe476cb7c2f38a5572714ab82bc017893708ca3098 WatchSource:0}: Error finding container 3fcb175b4c8425be7fce0dbe476cb7c2f38a5572714ab82bc017893708ca3098: Status 404 returned error can't find the container with id 3fcb175b4c8425be7fce0dbe476cb7c2f38a5572714ab82bc017893708ca3098 Jul 30 19:39:28.572345 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.572328 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-8flqh" Jul 30 19:39:28.574329 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:28.574287 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda11908b9_aecd_47de_b9a8_c49537dff46b.slice/crio-6fa221705150ae253ce3ad139adad6f03621def783638e6adabaeac00cb80e83 WatchSource:0}: Error finding container 6fa221705150ae253ce3ad139adad6f03621def783638e6adabaeac00cb80e83: Status 404 returned error can't find the container with id 6fa221705150ae253ce3ad139adad6f03621def783638e6adabaeac00cb80e83 Jul 30 19:39:28.579474 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.579458 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-g5s9d" Jul 30 19:39:28.581045 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:28.580996 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1be342d5_ea6e_4ec7_af4a_61e79e9bfe90.slice/crio-16db630fc6be412788bb71727a81c6fb07dcdb9fa3058d67e893a4440918bcbf WatchSource:0}: Error finding container 16db630fc6be412788bb71727a81c6fb07dcdb9fa3058d67e893a4440918bcbf: Status 404 returned error can't find the container with id 16db630fc6be412788bb71727a81c6fb07dcdb9fa3058d67e893a4440918bcbf Jul 30 19:39:28.589347 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:28.588465 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod291f3d88_2c11_4b10_8e36_e4cb333a7c16.slice/crio-33ac0d4a635898db37cf961727aacb3b93620d7eec19e18b4847911c3382ae31 WatchSource:0}: Error finding container 33ac0d4a635898db37cf961727aacb3b93620d7eec19e18b4847911c3382ae31: Status 404 returned error can't find the container with id 33ac0d4a635898db37cf961727aacb3b93620d7eec19e18b4847911c3382ae31 Jul 30 19:39:28.592552 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:39:28.592530 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b80bb73_3e52_45c7_80c1_2beec4c736ac.slice/crio-f1a84e37dcc5823b82ea0e14f4fd8c6b12a073e46447896469104532bc821a88 WatchSource:0}: Error finding container f1a84e37dcc5823b82ea0e14f4fd8c6b12a073e46447896469104532bc821a88: Status 404 returned error can't find the container with id f1a84e37dcc5823b82ea0e14f4fd8c6b12a073e46447896469104532bc821a88 Jul 30 19:39:28.699898 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.699866 2555 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 30 19:39:28.821073 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.821036 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a1ca9892-7f18-4426-80c4-3e9c14681dab-metrics-certs\") pod \"network-metrics-daemon-sx4k5\" (UID: \"a1ca9892-7f18-4426-80c4-3e9c14681dab\") " pod="openshift-multus/network-metrics-daemon-sx4k5" Jul 30 19:39:28.821215 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:39:28.821172 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 30 19:39:28.821298 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:39:28.821242 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1ca9892-7f18-4426-80c4-3e9c14681dab-metrics-certs podName:a1ca9892-7f18-4426-80c4-3e9c14681dab nodeName:}" failed. No retries permitted until 2026-07-30 19:39:29.821223195 +0000 UTC m=+3.972302737 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a1ca9892-7f18-4426-80c4-3e9c14681dab-metrics-certs") pod "network-metrics-daemon-sx4k5" (UID: "a1ca9892-7f18-4426-80c4-3e9c14681dab") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 30 19:39:28.921679 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:28.921642 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ef0f467f-7334-4115-9601-875fd55fb025-original-pull-secret\") pod \"global-pull-secret-syncer-fn7fj\" (UID: \"ef0f467f-7334-4115-9601-875fd55fb025\") " pod="kube-system/global-pull-secret-syncer-fn7fj" Jul 30 19:39:28.921835 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:39:28.921768 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 30 19:39:28.921835 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:39:28.921830 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef0f467f-7334-4115-9601-875fd55fb025-original-pull-secret podName:ef0f467f-7334-4115-9601-875fd55fb025 nodeName:}" failed. No retries permitted until 2026-07-30 19:39:29.921813676 +0000 UTC m=+4.072893207 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ef0f467f-7334-4115-9601-875fd55fb025-original-pull-secret") pod "global-pull-secret-syncer-fn7fj" (UID: "ef0f467f-7334-4115-9601-875fd55fb025") : object "kube-system"/"original-pull-secret" not registered Jul 30 19:39:29.022442 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:29.022407 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-45lmh\" (UniqueName: \"kubernetes.io/projected/58525c90-52a2-441e-8ebc-6d165487e982-kube-api-access-45lmh\") pod \"network-check-target-k2nrq\" (UID: \"58525c90-52a2-441e-8ebc-6d165487e982\") " pod="openshift-network-diagnostics/network-check-target-k2nrq" Jul 30 19:39:29.022609 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:39:29.022554 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 30 19:39:29.022609 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:39:29.022576 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 30 19:39:29.022609 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:39:29.022587 2555 projected.go:196] Error preparing data for projected volume kube-api-access-45lmh for pod openshift-network-diagnostics/network-check-target-k2nrq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 30 19:39:29.022756 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:39:29.022639 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/58525c90-52a2-441e-8ebc-6d165487e982-kube-api-access-45lmh podName:58525c90-52a2-441e-8ebc-6d165487e982 nodeName:}" failed. No retries permitted until 2026-07-30 19:39:30.022624726 +0000 UTC m=+4.173704257 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-45lmh" (UniqueName: "kubernetes.io/projected/58525c90-52a2-441e-8ebc-6d165487e982-kube-api-access-45lmh") pod "network-check-target-k2nrq" (UID: "58525c90-52a2-441e-8ebc-6d165487e982") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 30 19:39:29.244308 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:29.244174 2555 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-29 19:34:28 +0000 UTC" deadline="2028-01-08 14:56:35.617563677 +0000 UTC" Jul 30 19:39:29.244308 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:29.244223 2555 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12643h17m6.373345689s" Jul 30 19:39:29.309032 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:29.308997 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k2nrq" Jul 30 19:39:29.309214 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:39:29.309137 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k2nrq" podUID="58525c90-52a2-441e-8ebc-6d165487e982" Jul 30 19:39:29.320422 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:29.320331 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g5s9d" event={"ID":"2b80bb73-3e52-45c7-80c1-2beec4c736ac","Type":"ContainerStarted","Data":"f1a84e37dcc5823b82ea0e14f4fd8c6b12a073e46447896469104532bc821a88"} Jul 30 19:39:29.322009 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:29.321966 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-8flqh" event={"ID":"291f3d88-2c11-4b10-8e36-e4cb333a7c16","Type":"ContainerStarted","Data":"33ac0d4a635898db37cf961727aacb3b93620d7eec19e18b4847911c3382ae31"} Jul 30 19:39:29.326336 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:29.326307 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-crnbd" event={"ID":"07586ae2-3389-4063-b494-eb1affb8ad5b","Type":"ContainerStarted","Data":"45494dd493b74f9a904a391fd713ed0cda3b665dc90d7a739742ffb362e0ab48"} Jul 30 19:39:29.342136 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:29.342018 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-swtbz" event={"ID":"1be342d5-ea6e-4ec7-af4a-61e79e9bfe90","Type":"ContainerStarted","Data":"16db630fc6be412788bb71727a81c6fb07dcdb9fa3058d67e893a4440918bcbf"} Jul 30 19:39:29.347406 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:29.346578 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sjhkz" event={"ID":"a11908b9-aecd-47de-b9a8-c49537dff46b","Type":"ContainerStarted","Data":"6fa221705150ae253ce3ad139adad6f03621def783638e6adabaeac00cb80e83"} Jul 30 19:39:29.348091 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:29.348064 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-6l9wb" event={"ID":"5f2f2204-5fa6-4fdc-8749-f60ec4a95303","Type":"ContainerStarted","Data":"8e80f27cfff0c7b5bf0b86db771d5eb7eb40d25d195ec9d09d72196d7994342a"} Jul 30 19:39:29.351111 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:29.351085 2555 generic.go:356] "Generic (PLEG): container finished" podID="55b5d07ef5da4396d8fc84d8570a1cf0" containerID="be639a7e0f46bbf16e8900dda7e1fe217dab16618852ffdd021249a323b9ea23" exitCode=0 Jul 30 19:39:29.351193 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:29.351164 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-46.ec2.internal" event={"ID":"55b5d07ef5da4396d8fc84d8570a1cf0","Type":"ContainerDied","Data":"be639a7e0f46bbf16e8900dda7e1fe217dab16618852ffdd021249a323b9ea23"} Jul 30 19:39:29.353032 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:29.353009 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-krnh8" event={"ID":"3061134d-d0a7-491b-8d15-88a12ce9d02d","Type":"ContainerStarted","Data":"3fcb175b4c8425be7fce0dbe476cb7c2f38a5572714ab82bc017893708ca3098"} Jul 30 19:39:29.354578 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:29.354555 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vmwjm" event={"ID":"a44f2ec2-ca30-4d88-9523-e95b805c047c","Type":"ContainerStarted","Data":"6cfef1538cbf2de737d59c59f6413d8f52bf37d89ea10930eefa0062cba330c2"} Jul 30 19:39:29.358796 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:29.358772 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-cbkpr" event={"ID":"e87200c1-3059-4317-84b2-b2caf70a1a21","Type":"ContainerStarted","Data":"094e91573c1ad055d564be2233376cf28fbacaf48036732d5837b9b1d5329a7e"} Jul 30 19:39:29.830078 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:29.829794 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a1ca9892-7f18-4426-80c4-3e9c14681dab-metrics-certs\") pod \"network-metrics-daemon-sx4k5\" (UID: \"a1ca9892-7f18-4426-80c4-3e9c14681dab\") " pod="openshift-multus/network-metrics-daemon-sx4k5" Jul 30 19:39:29.830078 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:39:29.829973 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 30 19:39:29.830078 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:39:29.830029 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1ca9892-7f18-4426-80c4-3e9c14681dab-metrics-certs podName:a1ca9892-7f18-4426-80c4-3e9c14681dab nodeName:}" failed. No retries permitted until 2026-07-30 19:39:31.830009861 +0000 UTC m=+5.981089388 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a1ca9892-7f18-4426-80c4-3e9c14681dab-metrics-certs") pod "network-metrics-daemon-sx4k5" (UID: "a1ca9892-7f18-4426-80c4-3e9c14681dab") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 30 19:39:29.934992 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:29.934953 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ef0f467f-7334-4115-9601-875fd55fb025-original-pull-secret\") pod \"global-pull-secret-syncer-fn7fj\" (UID: \"ef0f467f-7334-4115-9601-875fd55fb025\") " pod="kube-system/global-pull-secret-syncer-fn7fj" Jul 30 19:39:29.935176 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:39:29.935093 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 30 19:39:29.935176 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:39:29.935152 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef0f467f-7334-4115-9601-875fd55fb025-original-pull-secret podName:ef0f467f-7334-4115-9601-875fd55fb025 nodeName:}" failed. No retries permitted until 2026-07-30 19:39:31.935134915 +0000 UTC m=+6.086214446 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ef0f467f-7334-4115-9601-875fd55fb025-original-pull-secret") pod "global-pull-secret-syncer-fn7fj" (UID: "ef0f467f-7334-4115-9601-875fd55fb025") : object "kube-system"/"original-pull-secret" not registered Jul 30 19:39:30.036408 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:30.036314 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-45lmh\" (UniqueName: \"kubernetes.io/projected/58525c90-52a2-441e-8ebc-6d165487e982-kube-api-access-45lmh\") pod \"network-check-target-k2nrq\" (UID: \"58525c90-52a2-441e-8ebc-6d165487e982\") " pod="openshift-network-diagnostics/network-check-target-k2nrq" Jul 30 19:39:30.036592 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:39:30.036503 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 30 19:39:30.036592 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:39:30.036524 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 30 19:39:30.036592 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:39:30.036537 2555 projected.go:196] Error preparing data for projected volume kube-api-access-45lmh for pod openshift-network-diagnostics/network-check-target-k2nrq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 30 19:39:30.036592 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:39:30.036594 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/58525c90-52a2-441e-8ebc-6d165487e982-kube-api-access-45lmh podName:58525c90-52a2-441e-8ebc-6d165487e982 nodeName:}" failed. No retries permitted until 2026-07-30 19:39:32.036575814 +0000 UTC m=+6.187655345 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-45lmh" (UniqueName: "kubernetes.io/projected/58525c90-52a2-441e-8ebc-6d165487e982-kube-api-access-45lmh") pod "network-check-target-k2nrq" (UID: "58525c90-52a2-441e-8ebc-6d165487e982") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 30 19:39:30.245220 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:30.245127 2555 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-29 19:34:28 +0000 UTC" deadline="2028-01-29 19:06:38.971349063 +0000 UTC" Jul 30 19:39:30.245220 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:30.245186 2555 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13151h27m8.726167244s" Jul 30 19:39:30.310836 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:30.310758 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fn7fj" Jul 30 19:39:30.310983 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:39:30.310898 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fn7fj" podUID="ef0f467f-7334-4115-9601-875fd55fb025" Jul 30 19:39:30.311057 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:30.311016 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sx4k5" Jul 30 19:39:30.311147 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:39:30.311123 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sx4k5" podUID="a1ca9892-7f18-4426-80c4-3e9c14681dab" Jul 30 19:39:30.367327 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:30.366772 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-46.ec2.internal" event={"ID":"1a2944b9797870016f92974beffaabc3","Type":"ContainerStarted","Data":"d86c6c0611e8a8ecc48d0a4afda9ea7fcd60b410692ae2020fee494830f3bcb4"} Jul 30 19:39:30.376298 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:30.376245 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-46.ec2.internal" event={"ID":"55b5d07ef5da4396d8fc84d8570a1cf0","Type":"ContainerStarted","Data":"eb00f827c71099e57bfedde0ed882eb22eda7687e613f076c22117a031fc5268"} Jul 30 19:39:30.398730 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:30.398652 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-46.ec2.internal" podStartSLOduration=3.398634219 podStartE2EDuration="3.398634219s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 19:39:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 19:39:30.398299708 +0000 UTC m=+4.549379257" watchObservedRunningTime="2026-07-30 19:39:30.398634219 +0000 UTC m=+4.549713770" Jul 30 19:39:30.398888 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:30.398836 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-46.ec2.internal" podStartSLOduration=3.398827465 podStartE2EDuration="3.398827465s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 19:39:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 19:39:30.381858659 +0000 UTC m=+4.532938208" watchObservedRunningTime="2026-07-30 19:39:30.398827465 +0000 UTC m=+4.549907017" Jul 30 19:39:31.309049 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:31.308565 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k2nrq" Jul 30 19:39:31.309049 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:39:31.308691 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k2nrq" podUID="58525c90-52a2-441e-8ebc-6d165487e982" Jul 30 19:39:31.853028 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:31.852993 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a1ca9892-7f18-4426-80c4-3e9c14681dab-metrics-certs\") pod \"network-metrics-daemon-sx4k5\" (UID: \"a1ca9892-7f18-4426-80c4-3e9c14681dab\") " pod="openshift-multus/network-metrics-daemon-sx4k5" Jul 30 19:39:31.853203 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:39:31.853181 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 30 19:39:31.853296 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:39:31.853240 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1ca9892-7f18-4426-80c4-3e9c14681dab-metrics-certs podName:a1ca9892-7f18-4426-80c4-3e9c14681dab nodeName:}" failed. No retries permitted until 2026-07-30 19:39:35.853223469 +0000 UTC m=+10.004303010 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a1ca9892-7f18-4426-80c4-3e9c14681dab-metrics-certs") pod "network-metrics-daemon-sx4k5" (UID: "a1ca9892-7f18-4426-80c4-3e9c14681dab") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 30 19:39:31.953791 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:31.953751 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ef0f467f-7334-4115-9601-875fd55fb025-original-pull-secret\") pod \"global-pull-secret-syncer-fn7fj\" (UID: \"ef0f467f-7334-4115-9601-875fd55fb025\") " pod="kube-system/global-pull-secret-syncer-fn7fj" Jul 30 19:39:31.953968 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:39:31.953898 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 30 19:39:31.953968 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:39:31.953964 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef0f467f-7334-4115-9601-875fd55fb025-original-pull-secret podName:ef0f467f-7334-4115-9601-875fd55fb025 nodeName:}" failed. No retries permitted until 2026-07-30 19:39:35.953944933 +0000 UTC m=+10.105024482 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ef0f467f-7334-4115-9601-875fd55fb025-original-pull-secret") pod "global-pull-secret-syncer-fn7fj" (UID: "ef0f467f-7334-4115-9601-875fd55fb025") : object "kube-system"/"original-pull-secret" not registered Jul 30 19:39:32.054801 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:32.054766 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-45lmh\" (UniqueName: \"kubernetes.io/projected/58525c90-52a2-441e-8ebc-6d165487e982-kube-api-access-45lmh\") pod \"network-check-target-k2nrq\" (UID: \"58525c90-52a2-441e-8ebc-6d165487e982\") " pod="openshift-network-diagnostics/network-check-target-k2nrq" Jul 30 19:39:32.054966 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:39:32.054939 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 30 19:39:32.054966 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:39:32.054962 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 30 19:39:32.055067 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:39:32.054976 2555 projected.go:196] Error preparing data for projected volume kube-api-access-45lmh for pod openshift-network-diagnostics/network-check-target-k2nrq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 30 19:39:32.055067 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:39:32.055025 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/58525c90-52a2-441e-8ebc-6d165487e982-kube-api-access-45lmh podName:58525c90-52a2-441e-8ebc-6d165487e982 nodeName:}" failed. No retries permitted until 2026-07-30 19:39:36.05501296 +0000 UTC m=+10.206092487 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-45lmh" (UniqueName: "kubernetes.io/projected/58525c90-52a2-441e-8ebc-6d165487e982-kube-api-access-45lmh") pod "network-check-target-k2nrq" (UID: "58525c90-52a2-441e-8ebc-6d165487e982") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 30 19:39:32.309336 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:32.309243 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sx4k5" Jul 30 19:39:32.309765 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:39:32.309400 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sx4k5" podUID="a1ca9892-7f18-4426-80c4-3e9c14681dab" Jul 30 19:39:32.310040 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:32.309862 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fn7fj" Jul 30 19:39:32.310040 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:39:32.309966 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fn7fj" podUID="ef0f467f-7334-4115-9601-875fd55fb025" Jul 30 19:39:33.308589 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:33.308549 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k2nrq" Jul 30 19:39:33.308781 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:39:33.308682 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k2nrq" podUID="58525c90-52a2-441e-8ebc-6d165487e982" Jul 30 19:39:34.309215 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:34.309180 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fn7fj" Jul 30 19:39:34.309620 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:39:34.309322 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fn7fj" podUID="ef0f467f-7334-4115-9601-875fd55fb025" Jul 30 19:39:34.309784 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:34.309762 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sx4k5" Jul 30 19:39:34.309891 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:39:34.309867 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sx4k5" podUID="a1ca9892-7f18-4426-80c4-3e9c14681dab" Jul 30 19:39:35.308815 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:35.308785 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k2nrq" Jul 30 19:39:35.308977 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:39:35.308904 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k2nrq" podUID="58525c90-52a2-441e-8ebc-6d165487e982" Jul 30 19:39:35.887222 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:35.887182 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a1ca9892-7f18-4426-80c4-3e9c14681dab-metrics-certs\") pod \"network-metrics-daemon-sx4k5\" (UID: \"a1ca9892-7f18-4426-80c4-3e9c14681dab\") " pod="openshift-multus/network-metrics-daemon-sx4k5" Jul 30 19:39:35.887694 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:39:35.887359 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 30 19:39:35.887694 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:39:35.887444 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1ca9892-7f18-4426-80c4-3e9c14681dab-metrics-certs podName:a1ca9892-7f18-4426-80c4-3e9c14681dab nodeName:}" failed. No retries permitted until 2026-07-30 19:39:43.887425263 +0000 UTC m=+18.038504794 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a1ca9892-7f18-4426-80c4-3e9c14681dab-metrics-certs") pod "network-metrics-daemon-sx4k5" (UID: "a1ca9892-7f18-4426-80c4-3e9c14681dab") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 30 19:39:35.988317 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:35.988258 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ef0f467f-7334-4115-9601-875fd55fb025-original-pull-secret\") pod \"global-pull-secret-syncer-fn7fj\" (UID: \"ef0f467f-7334-4115-9601-875fd55fb025\") " pod="kube-system/global-pull-secret-syncer-fn7fj" Jul 30 19:39:35.988502 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:39:35.988477 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 30 19:39:35.988647 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:39:35.988548 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef0f467f-7334-4115-9601-875fd55fb025-original-pull-secret podName:ef0f467f-7334-4115-9601-875fd55fb025 nodeName:}" failed. No retries permitted until 2026-07-30 19:39:43.988529161 +0000 UTC m=+18.139608729 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ef0f467f-7334-4115-9601-875fd55fb025-original-pull-secret") pod "global-pull-secret-syncer-fn7fj" (UID: "ef0f467f-7334-4115-9601-875fd55fb025") : object "kube-system"/"original-pull-secret" not registered Jul 30 19:39:36.089284 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:36.089183 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-45lmh\" (UniqueName: \"kubernetes.io/projected/58525c90-52a2-441e-8ebc-6d165487e982-kube-api-access-45lmh\") pod \"network-check-target-k2nrq\" (UID: \"58525c90-52a2-441e-8ebc-6d165487e982\") " pod="openshift-network-diagnostics/network-check-target-k2nrq" Jul 30 19:39:36.089457 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:39:36.089434 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 30 19:39:36.089457 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:39:36.089462 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 30 19:39:36.089680 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:39:36.089474 2555 projected.go:196] Error preparing data for projected volume kube-api-access-45lmh for pod openshift-network-diagnostics/network-check-target-k2nrq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 30 19:39:36.089680 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:39:36.089536 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/58525c90-52a2-441e-8ebc-6d165487e982-kube-api-access-45lmh podName:58525c90-52a2-441e-8ebc-6d165487e982 nodeName:}" failed. No retries permitted until 2026-07-30 19:39:44.089517804 +0000 UTC m=+18.240597344 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-45lmh" (UniqueName: "kubernetes.io/projected/58525c90-52a2-441e-8ebc-6d165487e982-kube-api-access-45lmh") pod "network-check-target-k2nrq" (UID: "58525c90-52a2-441e-8ebc-6d165487e982") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 30 19:39:36.310828 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:36.310518 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sx4k5" Jul 30 19:39:36.310828 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:36.310571 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fn7fj" Jul 30 19:39:36.310828 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:39:36.310654 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fn7fj" podUID="ef0f467f-7334-4115-9601-875fd55fb025" Jul 30 19:39:36.310828 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:39:36.310698 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sx4k5" podUID="a1ca9892-7f18-4426-80c4-3e9c14681dab" Jul 30 19:39:37.309032 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:37.308997 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k2nrq" Jul 30 19:39:37.309476 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:39:37.309139 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k2nrq" podUID="58525c90-52a2-441e-8ebc-6d165487e982" Jul 30 19:39:38.309550 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:38.309509 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sx4k5" Jul 30 19:39:38.309972 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:38.309557 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fn7fj" Jul 30 19:39:38.309972 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:39:38.309713 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sx4k5" podUID="a1ca9892-7f18-4426-80c4-3e9c14681dab" Jul 30 19:39:38.309972 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:39:38.309847 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fn7fj" podUID="ef0f467f-7334-4115-9601-875fd55fb025" Jul 30 19:39:39.308713 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:39.308680 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k2nrq" Jul 30 19:39:39.308893 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:39:39.308784 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k2nrq" podUID="58525c90-52a2-441e-8ebc-6d165487e982" Jul 30 19:39:40.309373 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:40.309315 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sx4k5" Jul 30 19:39:40.309373 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:40.309339 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fn7fj" Jul 30 19:39:40.309878 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:39:40.309522 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sx4k5" podUID="a1ca9892-7f18-4426-80c4-3e9c14681dab" Jul 30 19:39:40.309878 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:39:40.309630 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fn7fj" podUID="ef0f467f-7334-4115-9601-875fd55fb025" Jul 30 19:39:41.308970 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:41.308938 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k2nrq" Jul 30 19:39:41.309138 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:39:41.309051 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k2nrq" podUID="58525c90-52a2-441e-8ebc-6d165487e982" Jul 30 19:39:42.308633 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:42.308549 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sx4k5" Jul 30 19:39:42.309013 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:42.308549 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fn7fj" Jul 30 19:39:42.309013 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:39:42.308684 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sx4k5" podUID="a1ca9892-7f18-4426-80c4-3e9c14681dab" Jul 30 19:39:42.309013 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:39:42.308757 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fn7fj" podUID="ef0f467f-7334-4115-9601-875fd55fb025" Jul 30 19:39:43.308536 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:43.308504 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k2nrq" Jul 30 19:39:43.308737 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:39:43.308633 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k2nrq" podUID="58525c90-52a2-441e-8ebc-6d165487e982" Jul 30 19:39:43.946312 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:43.946257 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a1ca9892-7f18-4426-80c4-3e9c14681dab-metrics-certs\") pod \"network-metrics-daemon-sx4k5\" (UID: \"a1ca9892-7f18-4426-80c4-3e9c14681dab\") " pod="openshift-multus/network-metrics-daemon-sx4k5" Jul 30 19:39:43.946573 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:39:43.946423 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 30 19:39:43.946573 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:39:43.946493 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1ca9892-7f18-4426-80c4-3e9c14681dab-metrics-certs podName:a1ca9892-7f18-4426-80c4-3e9c14681dab nodeName:}" failed. No retries permitted until 2026-07-30 19:39:59.946472987 +0000 UTC m=+34.097552526 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a1ca9892-7f18-4426-80c4-3e9c14681dab-metrics-certs") pod "network-metrics-daemon-sx4k5" (UID: "a1ca9892-7f18-4426-80c4-3e9c14681dab") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 30 19:39:44.047188 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:44.047151 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ef0f467f-7334-4115-9601-875fd55fb025-original-pull-secret\") pod \"global-pull-secret-syncer-fn7fj\" (UID: \"ef0f467f-7334-4115-9601-875fd55fb025\") " pod="kube-system/global-pull-secret-syncer-fn7fj" Jul 30 19:39:44.047375 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:39:44.047292 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 30 19:39:44.047375 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:39:44.047358 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef0f467f-7334-4115-9601-875fd55fb025-original-pull-secret podName:ef0f467f-7334-4115-9601-875fd55fb025 nodeName:}" failed. No retries permitted until 2026-07-30 19:40:00.047338902 +0000 UTC m=+34.198418430 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ef0f467f-7334-4115-9601-875fd55fb025-original-pull-secret") pod "global-pull-secret-syncer-fn7fj" (UID: "ef0f467f-7334-4115-9601-875fd55fb025") : object "kube-system"/"original-pull-secret" not registered Jul 30 19:39:44.147662 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:44.147622 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-45lmh\" (UniqueName: \"kubernetes.io/projected/58525c90-52a2-441e-8ebc-6d165487e982-kube-api-access-45lmh\") pod \"network-check-target-k2nrq\" (UID: \"58525c90-52a2-441e-8ebc-6d165487e982\") " pod="openshift-network-diagnostics/network-check-target-k2nrq" Jul 30 19:39:44.147842 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:39:44.147793 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 30 19:39:44.147842 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:39:44.147816 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 30 19:39:44.147842 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:39:44.147829 2555 projected.go:196] Error preparing data for projected volume kube-api-access-45lmh for pod openshift-network-diagnostics/network-check-target-k2nrq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 30 19:39:44.147997 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:39:44.147893 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/58525c90-52a2-441e-8ebc-6d165487e982-kube-api-access-45lmh podName:58525c90-52a2-441e-8ebc-6d165487e982 nodeName:}" failed. No retries permitted until 2026-07-30 19:40:00.147873114 +0000 UTC m=+34.298952664 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-45lmh" (UniqueName: "kubernetes.io/projected/58525c90-52a2-441e-8ebc-6d165487e982-kube-api-access-45lmh") pod "network-check-target-k2nrq" (UID: "58525c90-52a2-441e-8ebc-6d165487e982") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 30 19:39:44.309205 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:44.309118 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sx4k5" Jul 30 19:39:44.309645 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:39:44.309266 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sx4k5" podUID="a1ca9892-7f18-4426-80c4-3e9c14681dab" Jul 30 19:39:44.309645 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:44.309301 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fn7fj" Jul 30 19:39:44.309645 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:39:44.309413 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fn7fj" podUID="ef0f467f-7334-4115-9601-875fd55fb025" Jul 30 19:39:45.309286 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:45.309234 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k2nrq" Jul 30 19:39:45.309729 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:39:45.309367 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k2nrq" podUID="58525c90-52a2-441e-8ebc-6d165487e982" Jul 30 19:39:46.310113 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:46.309990 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fn7fj" Jul 30 19:39:46.312626 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:39:46.312066 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fn7fj" podUID="ef0f467f-7334-4115-9601-875fd55fb025" Jul 30 19:39:46.312626 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:46.312144 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sx4k5" Jul 30 19:39:46.312626 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:39:46.312241 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sx4k5" podUID="a1ca9892-7f18-4426-80c4-3e9c14681dab" Jul 30 19:39:46.413367 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:46.413085 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g5s9d" event={"ID":"2b80bb73-3e52-45c7-80c1-2beec4c736ac","Type":"ContainerStarted","Data":"55ee214f49fb654f9f164c367d48b9553df3835089de2ad251213e5bf3a053e0"} Jul 30 19:39:46.418833 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:46.417884 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-crnbd" event={"ID":"07586ae2-3389-4063-b494-eb1affb8ad5b","Type":"ContainerStarted","Data":"89b0195119f88e333f14a3cf1e71ce68637272ec86464913f36b36c6d586e20d"} Jul 30 19:39:46.422105 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:46.421994 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-swtbz" event={"ID":"1be342d5-ea6e-4ec7-af4a-61e79e9bfe90","Type":"ContainerStarted","Data":"cc52bf23d2bdc343631818a3ac1c2c4fbf161e211d8a80a5311675f0e4db8da1"} Jul 30 19:39:46.428490 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:46.428448 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-krnh8" event={"ID":"3061134d-d0a7-491b-8d15-88a12ce9d02d","Type":"ContainerStarted","Data":"e27ad61bbdddc0d1149cd5a8e029bcec61602ade8cdf2fca3f45171da535d27a"} Jul 30 19:39:46.430788 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:46.430766 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vmwjm" event={"ID":"a44f2ec2-ca30-4d88-9523-e95b805c047c","Type":"ContainerStarted","Data":"aec43fa5d2b0a2d19444ff70a8b23fc21d325427ee70124f4e5032d9534566e5"} Jul 30 19:39:46.432211 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:46.432160 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-cbkpr" event={"ID":"e87200c1-3059-4317-84b2-b2caf70a1a21","Type":"ContainerStarted","Data":"2e83d100d1024946cb79f8e89ada7690011c303df3e71d9b62f1b09310737117"} Jul 30 19:39:46.461264 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:46.460982 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-cbkpr" podStartSLOduration=2.889692133 podStartE2EDuration="20.460964036s" totalImagesPullingTime="17.571271903s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 19:39:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 19:39:46.447901842 +0000 UTC m=+20.598981390" watchObservedRunningTime="2026-07-30 19:39:46.460964036 +0000 UTC m=+20.612043585" Jul 30 19:39:46.461397 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:46.461299 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-crnbd" podStartSLOduration=2.912008604 podStartE2EDuration="20.461291752s" totalImagesPullingTime="17.549283148s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 19:39:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 19:39:46.460766664 +0000 UTC m=+20.611846212" watchObservedRunningTime="2026-07-30 19:39:46.461291752 +0000 UTC m=+20.612371296" Jul 30 19:39:46.481725 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:46.478181 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-krnh8" podStartSLOduration=2.944975734 podStartE2EDuration="20.478162423s" totalImagesPullingTime="17.533186689s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 19:39:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 19:39:46.47785383 +0000 UTC m=+20.628933379" watchObservedRunningTime="2026-07-30 19:39:46.478162423 +0000 UTC m=+20.629241974" Jul 30 19:39:46.491020 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:46.490978 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-swtbz" podStartSLOduration=7.116707751 podStartE2EDuration="20.490962641s" totalImagesPullingTime="13.37425489s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 19:39:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 19:39:46.490387293 +0000 UTC m=+20.641466840" watchObservedRunningTime="2026-07-30 19:39:46.490962641 +0000 UTC m=+20.642042189" Jul 30 19:39:47.309103 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:47.308898 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k2nrq" Jul 30 19:39:47.309228 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:39:47.309131 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k2nrq" podUID="58525c90-52a2-441e-8ebc-6d165487e982" Jul 30 19:39:47.434707 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:47.434681 2555 generic.go:356] "Generic (PLEG): container finished" podID="2b80bb73-3e52-45c7-80c1-2beec4c736ac" containerID="55ee214f49fb654f9f164c367d48b9553df3835089de2ad251213e5bf3a053e0" exitCode=0 Jul 30 19:39:47.435479 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:47.434750 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g5s9d" event={"ID":"2b80bb73-3e52-45c7-80c1-2beec4c736ac","Type":"ContainerDied","Data":"55ee214f49fb654f9f164c367d48b9553df3835089de2ad251213e5bf3a053e0"} Jul 30 19:39:47.436158 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:47.436139 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-8flqh" event={"ID":"291f3d88-2c11-4b10-8e36-e4cb333a7c16","Type":"ContainerStarted","Data":"3de71aefa562e332497db73ce4b4e5e0b0f1a5718d953c4b1e825f96fd4c9fb2"} Jul 30 19:39:47.438889 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:47.438862 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sjhkz" event={"ID":"a11908b9-aecd-47de-b9a8-c49537dff46b","Type":"ContainerStarted","Data":"ff6ce73d02d63812fdd128636b858fcabd72a9313a1cd0c78877b19ff47c74f3"} Jul 30 19:39:47.438978 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:47.438928 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sjhkz" event={"ID":"a11908b9-aecd-47de-b9a8-c49537dff46b","Type":"ContainerStarted","Data":"047c1b18fabb78406a80d3b24e68feb4726f4dbce0a01fb96511c22d1275cba4"} Jul 30 19:39:47.438978 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:47.438974 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sjhkz" event={"ID":"a11908b9-aecd-47de-b9a8-c49537dff46b","Type":"ContainerStarted","Data":"0457da05912a978ddefd1002e8f68f36dfc145db46f997e0ef66152ce095a415"} Jul 30 19:39:47.439064 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:47.439003 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sjhkz" event={"ID":"a11908b9-aecd-47de-b9a8-c49537dff46b","Type":"ContainerStarted","Data":"59d0c786cf594d167c061202ac2e81b99de37ec1cc1b4db82f34379b8416ea1b"} Jul 30 19:39:47.439064 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:47.439045 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sjhkz" event={"ID":"a11908b9-aecd-47de-b9a8-c49537dff46b","Type":"ContainerStarted","Data":"f1786d91cf4e6a2a74e20b63532042485a8fdab8c47a26ef2741a5d222fe61f6"} Jul 30 19:39:47.439132 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:47.439072 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sjhkz" event={"ID":"a11908b9-aecd-47de-b9a8-c49537dff46b","Type":"ContainerStarted","Data":"43963abaa53bd1e08c1842c7aec40aa16e982005da851c455c7f75ffaf537b11"} Jul 30 19:39:47.472551 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:47.472514 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-8flqh" podStartSLOduration=3.631614092 podStartE2EDuration="21.472503091s" totalImagesPullingTime="17.840888999s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 19:39:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 19:39:47.472336111 +0000 UTC m=+21.623415659" watchObservedRunningTime="2026-07-30 19:39:47.472503091 +0000 UTC m=+21.623582639" Jul 30 19:39:47.538131 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:47.538108 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-swtbz" Jul 30 19:39:47.538792 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:47.538774 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-swtbz" Jul 30 19:39:47.669019 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:47.668999 2555 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 30 19:39:48.273340 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:48.273218 2555 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-30T19:39:47.669013974Z","UUID":"1f1f47aa-c66b-40a0-aaff-caae9c92d6ab","Handler":null,"Name":"","Endpoint":""} Jul 30 19:39:48.274831 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:48.274807 2555 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 30 19:39:48.274951 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:48.274850 2555 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 30 19:39:48.309227 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:48.309201 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sx4k5" Jul 30 19:39:48.309395 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:48.309238 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fn7fj" Jul 30 19:39:48.309395 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:39:48.309349 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sx4k5" podUID="a1ca9892-7f18-4426-80c4-3e9c14681dab" Jul 30 19:39:48.309513 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:39:48.309491 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fn7fj" podUID="ef0f467f-7334-4115-9601-875fd55fb025" Jul 30 19:39:48.443168 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:48.443137 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vmwjm" event={"ID":"a44f2ec2-ca30-4d88-9523-e95b805c047c","Type":"ContainerStarted","Data":"2b3432c2925a22c09200b68572390775a51d911cfd3134b7197b318c1782f6a5"} Jul 30 19:39:48.445329 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:48.445219 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-6l9wb" event={"ID":"5f2f2204-5fa6-4fdc-8749-f60ec4a95303","Type":"ContainerStarted","Data":"d43ed9158fc02edce03c3b6b5889ac1229b503a511744030d1e3d2c2a4eefbde"} Jul 30 19:39:48.445842 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:48.445809 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-swtbz" Jul 30 19:39:48.446340 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:48.446317 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-swtbz" Jul 30 19:39:48.463101 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:48.463061 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-6l9wb" podStartSLOduration=4.892075282 podStartE2EDuration="22.463046139s" totalImagesPullingTime="17.570970857s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 19:39:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 19:39:48.462607446 +0000 UTC m=+22.613686995" watchObservedRunningTime="2026-07-30 19:39:48.463046139 +0000 UTC m=+22.614125690" Jul 30 19:39:49.309211 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:49.309134 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k2nrq" Jul 30 19:39:49.309366 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:39:49.309261 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k2nrq" podUID="58525c90-52a2-441e-8ebc-6d165487e982" Jul 30 19:39:49.450597 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:49.450562 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sjhkz" event={"ID":"a11908b9-aecd-47de-b9a8-c49537dff46b","Type":"ContainerStarted","Data":"2fee043ca1e09d12fdc2c904d8f239db6eac2d7b8f643b094691fb2b36895dd4"} Jul 30 19:39:49.452863 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:49.452819 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vmwjm" event={"ID":"a44f2ec2-ca30-4d88-9523-e95b805c047c","Type":"ContainerStarted","Data":"a5ea2ec08c005ce584b56d0307858b6567970e1ffbb5b35b6fd90c7f6da7d7b5"} Jul 30 19:39:49.471581 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:49.471531 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vmwjm" podStartSLOduration=3.875518804 podStartE2EDuration="23.471513019s" totalImagesPullingTime="19.595994215s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 19:39:26 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 19:39:49.470121849 +0000 UTC m=+23.621201399" watchObservedRunningTime="2026-07-30 19:39:49.471513019 +0000 UTC m=+23.622592568" Jul 30 19:39:50.308991 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:50.308777 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sx4k5" Jul 30 19:39:50.309256 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:50.308838 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fn7fj" Jul 30 19:39:50.309256 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:39:50.309115 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sx4k5" podUID="a1ca9892-7f18-4426-80c4-3e9c14681dab" Jul 30 19:39:50.309256 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:39:50.309173 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fn7fj" podUID="ef0f467f-7334-4115-9601-875fd55fb025" Jul 30 19:39:51.309086 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:51.309017 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k2nrq" Jul 30 19:39:51.309544 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:39:51.309151 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k2nrq" podUID="58525c90-52a2-441e-8ebc-6d165487e982" Jul 30 19:39:52.309151 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:52.309012 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fn7fj" Jul 30 19:39:52.309794 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:52.309101 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sx4k5" Jul 30 19:39:52.309794 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:39:52.309235 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fn7fj" podUID="ef0f467f-7334-4115-9601-875fd55fb025" Jul 30 19:39:52.309794 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:39:52.309349 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sx4k5" podUID="a1ca9892-7f18-4426-80c4-3e9c14681dab" Jul 30 19:39:52.460203 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:52.460175 2555 generic.go:356] "Generic (PLEG): container finished" podID="2b80bb73-3e52-45c7-80c1-2beec4c736ac" containerID="89689d511c01473a4bc916b49e1f84814066da76cf63aa1f299ab6b09ffbb693" exitCode=0 Jul 30 19:39:52.460355 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:52.460262 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g5s9d" event={"ID":"2b80bb73-3e52-45c7-80c1-2beec4c736ac","Type":"ContainerDied","Data":"89689d511c01473a4bc916b49e1f84814066da76cf63aa1f299ab6b09ffbb693"} Jul 30 19:39:52.464104 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:52.464081 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sjhkz" event={"ID":"a11908b9-aecd-47de-b9a8-c49537dff46b","Type":"ContainerStarted","Data":"20b9fc5b5ad953dbba07fdb1c3e12ec8a9eddf396e112315b93b7cf09627a490"} Jul 30 19:39:52.464409 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:52.464387 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-sjhkz" Jul 30 19:39:52.464507 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:52.464458 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-sjhkz" Jul 30 19:39:52.478395 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:52.478377 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-sjhkz" Jul 30 19:39:52.503404 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:52.503358 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-sjhkz" podStartSLOduration=8.860264313 podStartE2EDuration="26.503346505s" totalImagesPullingTime="17.643082192s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 19:39:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 19:39:52.502915696 +0000 UTC m=+26.653995241" watchObservedRunningTime="2026-07-30 19:39:52.503346505 +0000 UTC m=+26.654426054" Jul 30 19:39:53.308769 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:53.308719 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k2nrq" Jul 30 19:39:53.309104 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:39:53.308841 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k2nrq" podUID="58525c90-52a2-441e-8ebc-6d165487e982" Jul 30 19:39:53.466747 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:53.466706 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-sjhkz" Jul 30 19:39:53.481264 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:53.481243 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-sjhkz" Jul 30 19:39:54.064948 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:54.064919 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fn7fj"] Jul 30 19:39:54.065141 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:54.065060 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fn7fj" Jul 30 19:39:54.065194 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:39:54.065162 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fn7fj" podUID="ef0f467f-7334-4115-9601-875fd55fb025" Jul 30 19:39:54.068235 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:54.068206 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-k2nrq"] Jul 30 19:39:54.068386 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:54.068322 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k2nrq" Jul 30 19:39:54.068450 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:39:54.068422 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k2nrq" podUID="58525c90-52a2-441e-8ebc-6d165487e982" Jul 30 19:39:54.068891 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:54.068869 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-sx4k5"] Jul 30 19:39:54.069007 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:54.068974 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sx4k5" Jul 30 19:39:54.069089 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:39:54.069071 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sx4k5" podUID="a1ca9892-7f18-4426-80c4-3e9c14681dab" Jul 30 19:39:54.470178 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:54.470146 2555 generic.go:356] "Generic (PLEG): container finished" podID="2b80bb73-3e52-45c7-80c1-2beec4c736ac" containerID="c13ba8cafc049d2a32380e1891392db8a02bda8aaf4bd2095d09690f1d1804a1" exitCode=0 Jul 30 19:39:54.470597 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:54.470230 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g5s9d" event={"ID":"2b80bb73-3e52-45c7-80c1-2beec4c736ac","Type":"ContainerDied","Data":"c13ba8cafc049d2a32380e1891392db8a02bda8aaf4bd2095d09690f1d1804a1"} Jul 30 19:39:55.309125 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:55.308952 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fn7fj" Jul 30 19:39:55.309288 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:39:55.309194 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fn7fj" podUID="ef0f467f-7334-4115-9601-875fd55fb025" Jul 30 19:39:56.310022 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:56.309989 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k2nrq" Jul 30 19:39:56.310579 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:56.310051 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sx4k5" Jul 30 19:39:56.310579 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:39:56.310067 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k2nrq" podUID="58525c90-52a2-441e-8ebc-6d165487e982" Jul 30 19:39:56.310579 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:39:56.310137 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sx4k5" podUID="a1ca9892-7f18-4426-80c4-3e9c14681dab" Jul 30 19:39:56.476588 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:56.476554 2555 generic.go:356] "Generic (PLEG): container finished" podID="2b80bb73-3e52-45c7-80c1-2beec4c736ac" containerID="7412520d6c750c2dd42c9b2f3e01f9d3cec8d3eed7ebeb365966b69b1e2f46bc" exitCode=0 Jul 30 19:39:56.476748 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:56.476610 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g5s9d" event={"ID":"2b80bb73-3e52-45c7-80c1-2beec4c736ac","Type":"ContainerDied","Data":"7412520d6c750c2dd42c9b2f3e01f9d3cec8d3eed7ebeb365966b69b1e2f46bc"} Jul 30 19:39:57.309178 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:57.309145 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fn7fj" Jul 30 19:39:57.309371 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:39:57.309267 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fn7fj" podUID="ef0f467f-7334-4115-9601-875fd55fb025" Jul 30 19:39:58.308919 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:58.308881 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sx4k5" Jul 30 19:39:58.309543 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:39:58.309017 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sx4k5" podUID="a1ca9892-7f18-4426-80c4-3e9c14681dab" Jul 30 19:39:58.309543 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:58.309074 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k2nrq" Jul 30 19:39:58.309543 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:39:58.309185 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k2nrq" podUID="58525c90-52a2-441e-8ebc-6d165487e982" Jul 30 19:39:59.136845 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:59.136763 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-46.ec2.internal" event="NodeReady" Jul 30 19:39:59.137039 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:59.136913 2555 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 30 19:39:59.181200 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:59.181163 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-8hgzs"] Jul 30 19:39:59.183040 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:59.183017 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-m5znh"] Jul 30 19:39:59.183171 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:59.183125 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8hgzs" Jul 30 19:39:59.184690 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:59.184668 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5c7469cffd-x8fmw"] Jul 30 19:39:59.184827 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:59.184808 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-m5znh" Jul 30 19:39:59.185825 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:59.185801 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 30 19:39:59.185966 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:59.185915 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-rlq6w\"" Jul 30 19:39:59.186178 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:59.186147 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 30 19:39:59.186317 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:59.186179 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 30 19:39:59.186485 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:59.186470 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5c7469cffd-x8fmw" Jul 30 19:39:59.187012 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:59.186996 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 30 19:39:59.187091 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:59.187066 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 30 19:39:59.187140 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:59.187107 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-xj98q\"" Jul 30 19:39:59.188709 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:59.188692 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 30 19:39:59.188828 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:59.188812 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-2dgvw\"" Jul 30 19:39:59.188897 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:59.188810 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 30 19:39:59.189191 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:59.189173 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 30 19:39:59.200554 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:59.198511 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-m5znh"] Jul 30 19:39:59.200554 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:59.200112 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 30 19:39:59.200554 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:59.200323 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8hgzs"] Jul 30 19:39:59.201461 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:59.201397 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5c7469cffd-x8fmw"] Jul 30 19:39:59.308807 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:59.308774 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fn7fj" Jul 30 19:39:59.311662 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:59.311637 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 30 19:39:59.370959 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:59.370921 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/699cb731-6732-4466-b2a6-c94c3c75209c-metrics-tls\") pod \"dns-default-m5znh\" (UID: \"699cb731-6732-4466-b2a6-c94c3c75209c\") " pod="openshift-dns/dns-default-m5znh" Jul 30 19:39:59.371147 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:59.370974 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wh49m\" (UniqueName: \"kubernetes.io/projected/b68104df-4001-4583-80f1-700368eb4583-kube-api-access-wh49m\") pod \"image-registry-5c7469cffd-x8fmw\" (UID: \"b68104df-4001-4583-80f1-700368eb4583\") " pod="openshift-image-registry/image-registry-5c7469cffd-x8fmw" Jul 30 19:39:59.371147 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:59.370996 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sn82x\" (UniqueName: \"kubernetes.io/projected/b12d3e8b-733d-482d-a5e4-5037e134e354-kube-api-access-sn82x\") pod \"ingress-canary-8hgzs\" (UID: \"b12d3e8b-733d-482d-a5e4-5037e134e354\") " pod="openshift-ingress-canary/ingress-canary-8hgzs" Jul 30 19:39:59.371147 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:59.371016 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b68104df-4001-4583-80f1-700368eb4583-bound-sa-token\") pod \"image-registry-5c7469cffd-x8fmw\" (UID: \"b68104df-4001-4583-80f1-700368eb4583\") " pod="openshift-image-registry/image-registry-5c7469cffd-x8fmw" Jul 30 19:39:59.371147 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:59.371120 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b68104df-4001-4583-80f1-700368eb4583-ca-trust-extracted\") pod \"image-registry-5c7469cffd-x8fmw\" (UID: \"b68104df-4001-4583-80f1-700368eb4583\") " pod="openshift-image-registry/image-registry-5c7469cffd-x8fmw" Jul 30 19:39:59.371359 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:59.371160 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b68104df-4001-4583-80f1-700368eb4583-image-registry-private-configuration\") pod \"image-registry-5c7469cffd-x8fmw\" (UID: \"b68104df-4001-4583-80f1-700368eb4583\") " pod="openshift-image-registry/image-registry-5c7469cffd-x8fmw" Jul 30 19:39:59.371359 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:59.371187 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b68104df-4001-4583-80f1-700368eb4583-registry-certificates\") pod \"image-registry-5c7469cffd-x8fmw\" (UID: \"b68104df-4001-4583-80f1-700368eb4583\") " pod="openshift-image-registry/image-registry-5c7469cffd-x8fmw" Jul 30 19:39:59.371359 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:59.371215 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b68104df-4001-4583-80f1-700368eb4583-installation-pull-secrets\") pod \"image-registry-5c7469cffd-x8fmw\" (UID: \"b68104df-4001-4583-80f1-700368eb4583\") " pod="openshift-image-registry/image-registry-5c7469cffd-x8fmw" Jul 30 19:39:59.371359 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:59.371250 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zj59s\" (UniqueName: \"kubernetes.io/projected/699cb731-6732-4466-b2a6-c94c3c75209c-kube-api-access-zj59s\") pod \"dns-default-m5znh\" (UID: \"699cb731-6732-4466-b2a6-c94c3c75209c\") " pod="openshift-dns/dns-default-m5znh" Jul 30 19:39:59.371359 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:59.371315 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b12d3e8b-733d-482d-a5e4-5037e134e354-cert\") pod \"ingress-canary-8hgzs\" (UID: \"b12d3e8b-733d-482d-a5e4-5037e134e354\") " pod="openshift-ingress-canary/ingress-canary-8hgzs" Jul 30 19:39:59.371359 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:59.371349 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b68104df-4001-4583-80f1-700368eb4583-registry-tls\") pod \"image-registry-5c7469cffd-x8fmw\" (UID: \"b68104df-4001-4583-80f1-700368eb4583\") " pod="openshift-image-registry/image-registry-5c7469cffd-x8fmw" Jul 30 19:39:59.371597 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:59.371373 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b68104df-4001-4583-80f1-700368eb4583-trusted-ca\") pod \"image-registry-5c7469cffd-x8fmw\" (UID: \"b68104df-4001-4583-80f1-700368eb4583\") " pod="openshift-image-registry/image-registry-5c7469cffd-x8fmw" Jul 30 19:39:59.371597 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:59.371442 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/699cb731-6732-4466-b2a6-c94c3c75209c-tmp-dir\") pod \"dns-default-m5znh\" (UID: \"699cb731-6732-4466-b2a6-c94c3c75209c\") " pod="openshift-dns/dns-default-m5znh" Jul 30 19:39:59.371597 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:59.371474 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/699cb731-6732-4466-b2a6-c94c3c75209c-config-volume\") pod \"dns-default-m5znh\" (UID: \"699cb731-6732-4466-b2a6-c94c3c75209c\") " pod="openshift-dns/dns-default-m5znh" Jul 30 19:39:59.472240 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:59.472207 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b68104df-4001-4583-80f1-700368eb4583-ca-trust-extracted\") pod \"image-registry-5c7469cffd-x8fmw\" (UID: \"b68104df-4001-4583-80f1-700368eb4583\") " pod="openshift-image-registry/image-registry-5c7469cffd-x8fmw" Jul 30 19:39:59.472240 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:59.472242 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b68104df-4001-4583-80f1-700368eb4583-image-registry-private-configuration\") pod \"image-registry-5c7469cffd-x8fmw\" (UID: \"b68104df-4001-4583-80f1-700368eb4583\") " pod="openshift-image-registry/image-registry-5c7469cffd-x8fmw" Jul 30 19:39:59.472492 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:59.472263 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b68104df-4001-4583-80f1-700368eb4583-registry-certificates\") pod \"image-registry-5c7469cffd-x8fmw\" (UID: \"b68104df-4001-4583-80f1-700368eb4583\") " pod="openshift-image-registry/image-registry-5c7469cffd-x8fmw" Jul 30 19:39:59.472492 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:59.472298 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b68104df-4001-4583-80f1-700368eb4583-installation-pull-secrets\") pod \"image-registry-5c7469cffd-x8fmw\" (UID: \"b68104df-4001-4583-80f1-700368eb4583\") " pod="openshift-image-registry/image-registry-5c7469cffd-x8fmw" Jul 30 19:39:59.472492 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:59.472326 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zj59s\" (UniqueName: \"kubernetes.io/projected/699cb731-6732-4466-b2a6-c94c3c75209c-kube-api-access-zj59s\") pod \"dns-default-m5znh\" (UID: \"699cb731-6732-4466-b2a6-c94c3c75209c\") " pod="openshift-dns/dns-default-m5znh" Jul 30 19:39:59.472492 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:59.472348 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b12d3e8b-733d-482d-a5e4-5037e134e354-cert\") pod \"ingress-canary-8hgzs\" (UID: \"b12d3e8b-733d-482d-a5e4-5037e134e354\") " pod="openshift-ingress-canary/ingress-canary-8hgzs" Jul 30 19:39:59.473014 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:59.472667 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b68104df-4001-4583-80f1-700368eb4583-ca-trust-extracted\") pod \"image-registry-5c7469cffd-x8fmw\" (UID: \"b68104df-4001-4583-80f1-700368eb4583\") " pod="openshift-image-registry/image-registry-5c7469cffd-x8fmw" Jul 30 19:39:59.473014 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:59.472724 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b68104df-4001-4583-80f1-700368eb4583-registry-tls\") pod \"image-registry-5c7469cffd-x8fmw\" (UID: \"b68104df-4001-4583-80f1-700368eb4583\") " pod="openshift-image-registry/image-registry-5c7469cffd-x8fmw" Jul 30 19:39:59.473014 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:59.472752 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b68104df-4001-4583-80f1-700368eb4583-trusted-ca\") pod \"image-registry-5c7469cffd-x8fmw\" (UID: \"b68104df-4001-4583-80f1-700368eb4583\") " pod="openshift-image-registry/image-registry-5c7469cffd-x8fmw" Jul 30 19:39:59.473014 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:59.472807 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/699cb731-6732-4466-b2a6-c94c3c75209c-tmp-dir\") pod \"dns-default-m5znh\" (UID: \"699cb731-6732-4466-b2a6-c94c3c75209c\") " pod="openshift-dns/dns-default-m5znh" Jul 30 19:39:59.473014 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:59.472841 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/699cb731-6732-4466-b2a6-c94c3c75209c-config-volume\") pod \"dns-default-m5znh\" (UID: \"699cb731-6732-4466-b2a6-c94c3c75209c\") " pod="openshift-dns/dns-default-m5znh" Jul 30 19:39:59.473014 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:59.472879 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/699cb731-6732-4466-b2a6-c94c3c75209c-metrics-tls\") pod \"dns-default-m5znh\" (UID: \"699cb731-6732-4466-b2a6-c94c3c75209c\") " pod="openshift-dns/dns-default-m5znh" Jul 30 19:39:59.473014 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:59.472913 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wh49m\" (UniqueName: \"kubernetes.io/projected/b68104df-4001-4583-80f1-700368eb4583-kube-api-access-wh49m\") pod \"image-registry-5c7469cffd-x8fmw\" (UID: \"b68104df-4001-4583-80f1-700368eb4583\") " pod="openshift-image-registry/image-registry-5c7469cffd-x8fmw" Jul 30 19:39:59.473014 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:59.472938 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sn82x\" (UniqueName: \"kubernetes.io/projected/b12d3e8b-733d-482d-a5e4-5037e134e354-kube-api-access-sn82x\") pod \"ingress-canary-8hgzs\" (UID: \"b12d3e8b-733d-482d-a5e4-5037e134e354\") " pod="openshift-ingress-canary/ingress-canary-8hgzs" Jul 30 19:39:59.473014 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:59.472966 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b68104df-4001-4583-80f1-700368eb4583-bound-sa-token\") pod \"image-registry-5c7469cffd-x8fmw\" (UID: \"b68104df-4001-4583-80f1-700368eb4583\") " pod="openshift-image-registry/image-registry-5c7469cffd-x8fmw" Jul 30 19:39:59.473014 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:59.473007 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b68104df-4001-4583-80f1-700368eb4583-registry-certificates\") pod \"image-registry-5c7469cffd-x8fmw\" (UID: \"b68104df-4001-4583-80f1-700368eb4583\") " pod="openshift-image-registry/image-registry-5c7469cffd-x8fmw" Jul 30 19:39:59.473686 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:39:59.473074 2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 30 19:39:59.473686 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:39:59.473103 2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5c7469cffd-x8fmw: secret "image-registry-tls" not found Jul 30 19:39:59.473686 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:39:59.473130 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 30 19:39:59.473686 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:39:59.473180 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b68104df-4001-4583-80f1-700368eb4583-registry-tls podName:b68104df-4001-4583-80f1-700368eb4583 nodeName:}" failed. No retries permitted until 2026-07-30 19:39:59.973154234 +0000 UTC m=+34.124233767 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b68104df-4001-4583-80f1-700368eb4583-registry-tls") pod "image-registry-5c7469cffd-x8fmw" (UID: "b68104df-4001-4583-80f1-700368eb4583") : secret "image-registry-tls" not found Jul 30 19:39:59.473686 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:39:59.473214 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/699cb731-6732-4466-b2a6-c94c3c75209c-metrics-tls podName:699cb731-6732-4466-b2a6-c94c3c75209c nodeName:}" failed. No retries permitted until 2026-07-30 19:39:59.97318745 +0000 UTC m=+34.124266979 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/699cb731-6732-4466-b2a6-c94c3c75209c-metrics-tls") pod "dns-default-m5znh" (UID: "699cb731-6732-4466-b2a6-c94c3c75209c") : secret "dns-default-metrics-tls" not found Jul 30 19:39:59.473686 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:59.473230 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/699cb731-6732-4466-b2a6-c94c3c75209c-tmp-dir\") pod \"dns-default-m5znh\" (UID: \"699cb731-6732-4466-b2a6-c94c3c75209c\") " pod="openshift-dns/dns-default-m5znh" Jul 30 19:39:59.474003 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:59.473711 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/699cb731-6732-4466-b2a6-c94c3c75209c-config-volume\") pod \"dns-default-m5znh\" (UID: \"699cb731-6732-4466-b2a6-c94c3c75209c\") " pod="openshift-dns/dns-default-m5znh" Jul 30 19:39:59.474003 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:59.473936 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b68104df-4001-4583-80f1-700368eb4583-trusted-ca\") pod \"image-registry-5c7469cffd-x8fmw\" (UID: \"b68104df-4001-4583-80f1-700368eb4583\") " pod="openshift-image-registry/image-registry-5c7469cffd-x8fmw" Jul 30 19:39:59.477334 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:59.477307 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b68104df-4001-4583-80f1-700368eb4583-installation-pull-secrets\") pod \"image-registry-5c7469cffd-x8fmw\" (UID: \"b68104df-4001-4583-80f1-700368eb4583\") " pod="openshift-image-registry/image-registry-5c7469cffd-x8fmw" Jul 30 19:39:59.477334 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:59.477326 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b12d3e8b-733d-482d-a5e4-5037e134e354-cert\") pod \"ingress-canary-8hgzs\" (UID: \"b12d3e8b-733d-482d-a5e4-5037e134e354\") " pod="openshift-ingress-canary/ingress-canary-8hgzs" Jul 30 19:39:59.477697 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:59.477675 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b68104df-4001-4583-80f1-700368eb4583-image-registry-private-configuration\") pod \"image-registry-5c7469cffd-x8fmw\" (UID: \"b68104df-4001-4583-80f1-700368eb4583\") " pod="openshift-image-registry/image-registry-5c7469cffd-x8fmw" Jul 30 19:39:59.480177 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:59.480152 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zj59s\" (UniqueName: \"kubernetes.io/projected/699cb731-6732-4466-b2a6-c94c3c75209c-kube-api-access-zj59s\") pod \"dns-default-m5znh\" (UID: \"699cb731-6732-4466-b2a6-c94c3c75209c\") " pod="openshift-dns/dns-default-m5znh" Jul 30 19:39:59.484105 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:59.484064 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b68104df-4001-4583-80f1-700368eb4583-bound-sa-token\") pod \"image-registry-5c7469cffd-x8fmw\" (UID: \"b68104df-4001-4583-80f1-700368eb4583\") " pod="openshift-image-registry/image-registry-5c7469cffd-x8fmw" Jul 30 19:39:59.485627 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:59.485605 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sn82x\" (UniqueName: \"kubernetes.io/projected/b12d3e8b-733d-482d-a5e4-5037e134e354-kube-api-access-sn82x\") pod \"ingress-canary-8hgzs\" (UID: \"b12d3e8b-733d-482d-a5e4-5037e134e354\") " pod="openshift-ingress-canary/ingress-canary-8hgzs" Jul 30 19:39:59.485928 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:59.485909 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wh49m\" (UniqueName: \"kubernetes.io/projected/b68104df-4001-4583-80f1-700368eb4583-kube-api-access-wh49m\") pod \"image-registry-5c7469cffd-x8fmw\" (UID: \"b68104df-4001-4583-80f1-700368eb4583\") " pod="openshift-image-registry/image-registry-5c7469cffd-x8fmw" Jul 30 19:39:59.496669 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:59.496646 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8hgzs" Jul 30 19:39:59.976979 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:59.976940 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b68104df-4001-4583-80f1-700368eb4583-registry-tls\") pod \"image-registry-5c7469cffd-x8fmw\" (UID: \"b68104df-4001-4583-80f1-700368eb4583\") " pod="openshift-image-registry/image-registry-5c7469cffd-x8fmw" Jul 30 19:39:59.977174 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:59.976994 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a1ca9892-7f18-4426-80c4-3e9c14681dab-metrics-certs\") pod \"network-metrics-daemon-sx4k5\" (UID: \"a1ca9892-7f18-4426-80c4-3e9c14681dab\") " pod="openshift-multus/network-metrics-daemon-sx4k5" Jul 30 19:39:59.977174 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:39:59.977094 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/699cb731-6732-4466-b2a6-c94c3c75209c-metrics-tls\") pod \"dns-default-m5znh\" (UID: \"699cb731-6732-4466-b2a6-c94c3c75209c\") " pod="openshift-dns/dns-default-m5znh" Jul 30 19:39:59.977174 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:39:59.977115 2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 30 19:39:59.977174 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:39:59.977130 2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5c7469cffd-x8fmw: secret "image-registry-tls" not found Jul 30 19:39:59.977407 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:39:59.977189 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b68104df-4001-4583-80f1-700368eb4583-registry-tls podName:b68104df-4001-4583-80f1-700368eb4583 nodeName:}" failed. No retries permitted until 2026-07-30 19:40:00.977169636 +0000 UTC m=+35.128249167 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b68104df-4001-4583-80f1-700368eb4583-registry-tls") pod "image-registry-5c7469cffd-x8fmw" (UID: "b68104df-4001-4583-80f1-700368eb4583") : secret "image-registry-tls" not found Jul 30 19:39:59.977407 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:39:59.977195 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 30 19:39:59.977407 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:39:59.977208 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 30 19:39:59.977407 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:39:59.977295 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1ca9892-7f18-4426-80c4-3e9c14681dab-metrics-certs podName:a1ca9892-7f18-4426-80c4-3e9c14681dab nodeName:}" failed. No retries permitted until 2026-07-30 19:40:31.977261614 +0000 UTC m=+66.128341146 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a1ca9892-7f18-4426-80c4-3e9c14681dab-metrics-certs") pod "network-metrics-daemon-sx4k5" (UID: "a1ca9892-7f18-4426-80c4-3e9c14681dab") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 30 19:39:59.977407 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:39:59.977339 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/699cb731-6732-4466-b2a6-c94c3c75209c-metrics-tls podName:699cb731-6732-4466-b2a6-c94c3c75209c nodeName:}" failed. No retries permitted until 2026-07-30 19:40:00.977325267 +0000 UTC m=+35.128404800 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/699cb731-6732-4466-b2a6-c94c3c75209c-metrics-tls") pod "dns-default-m5znh" (UID: "699cb731-6732-4466-b2a6-c94c3c75209c") : secret "dns-default-metrics-tls" not found Jul 30 19:40:00.078225 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:00.078182 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ef0f467f-7334-4115-9601-875fd55fb025-original-pull-secret\") pod \"global-pull-secret-syncer-fn7fj\" (UID: \"ef0f467f-7334-4115-9601-875fd55fb025\") " pod="kube-system/global-pull-secret-syncer-fn7fj" Jul 30 19:40:00.080773 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:00.080746 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ef0f467f-7334-4115-9601-875fd55fb025-original-pull-secret\") pod \"global-pull-secret-syncer-fn7fj\" (UID: \"ef0f467f-7334-4115-9601-875fd55fb025\") " pod="kube-system/global-pull-secret-syncer-fn7fj" Jul 30 19:40:00.179437 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:00.179396 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-45lmh\" (UniqueName: \"kubernetes.io/projected/58525c90-52a2-441e-8ebc-6d165487e982-kube-api-access-45lmh\") pod \"network-check-target-k2nrq\" (UID: \"58525c90-52a2-441e-8ebc-6d165487e982\") " pod="openshift-network-diagnostics/network-check-target-k2nrq" Jul 30 19:40:00.179614 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:40:00.179591 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 30 19:40:00.179663 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:40:00.179625 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 30 19:40:00.179663 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:40:00.179640 2555 projected.go:196] Error preparing data for projected volume kube-api-access-45lmh for pod openshift-network-diagnostics/network-check-target-k2nrq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 30 19:40:00.179736 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:40:00.179706 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/58525c90-52a2-441e-8ebc-6d165487e982-kube-api-access-45lmh podName:58525c90-52a2-441e-8ebc-6d165487e982 nodeName:}" failed. No retries permitted until 2026-07-30 19:40:32.179684917 +0000 UTC m=+66.330764459 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-45lmh" (UniqueName: "kubernetes.io/projected/58525c90-52a2-441e-8ebc-6d165487e982-kube-api-access-45lmh") pod "network-check-target-k2nrq" (UID: "58525c90-52a2-441e-8ebc-6d165487e982") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 30 19:40:00.217916 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:00.217880 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fn7fj" Jul 30 19:40:00.309729 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:00.309605 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sx4k5" Jul 30 19:40:00.309729 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:00.309648 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k2nrq" Jul 30 19:40:00.312646 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:00.312621 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 30 19:40:00.313145 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:00.312655 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 30 19:40:00.313658 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:00.313638 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-p96kd\"" Jul 30 19:40:00.313903 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:00.313887 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-chvmd\"" Jul 30 19:40:00.313956 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:00.313906 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 30 19:40:00.802029 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:00.801879 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fn7fj"] Jul 30 19:40:00.805343 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:00.805320 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8hgzs"] Jul 30 19:40:00.806242 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:40:00.806218 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef0f467f_7334_4115_9601_875fd55fb025.slice/crio-9564d8c999331bd89c6c60b3fa64f56ee6d27902b2781f6a595462a5178558f9 WatchSource:0}: Error finding container 9564d8c999331bd89c6c60b3fa64f56ee6d27902b2781f6a595462a5178558f9: Status 404 returned error can't find the container with id 9564d8c999331bd89c6c60b3fa64f56ee6d27902b2781f6a595462a5178558f9 Jul 30 19:40:00.810391 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:40:00.810357 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb12d3e8b_733d_482d_a5e4_5037e134e354.slice/crio-dc9115709c34b1d9b78d0264c879a2f8c9bfcd6ea0cc63a854c97102eaf8736f WatchSource:0}: Error finding container dc9115709c34b1d9b78d0264c879a2f8c9bfcd6ea0cc63a854c97102eaf8736f: Status 404 returned error can't find the container with id dc9115709c34b1d9b78d0264c879a2f8c9bfcd6ea0cc63a854c97102eaf8736f Jul 30 19:40:00.984401 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:00.984367 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/699cb731-6732-4466-b2a6-c94c3c75209c-metrics-tls\") pod \"dns-default-m5znh\" (UID: \"699cb731-6732-4466-b2a6-c94c3c75209c\") " pod="openshift-dns/dns-default-m5znh" Jul 30 19:40:00.984545 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:00.984439 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b68104df-4001-4583-80f1-700368eb4583-registry-tls\") pod \"image-registry-5c7469cffd-x8fmw\" (UID: \"b68104df-4001-4583-80f1-700368eb4583\") " pod="openshift-image-registry/image-registry-5c7469cffd-x8fmw" Jul 30 19:40:00.984545 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:40:00.984520 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 30 19:40:00.984665 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:40:00.984546 2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 30 19:40:00.984665 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:40:00.984560 2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5c7469cffd-x8fmw: secret "image-registry-tls" not found Jul 30 19:40:00.984665 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:40:00.984583 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/699cb731-6732-4466-b2a6-c94c3c75209c-metrics-tls podName:699cb731-6732-4466-b2a6-c94c3c75209c nodeName:}" failed. No retries permitted until 2026-07-30 19:40:02.984567042 +0000 UTC m=+37.135646577 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/699cb731-6732-4466-b2a6-c94c3c75209c-metrics-tls") pod "dns-default-m5znh" (UID: "699cb731-6732-4466-b2a6-c94c3c75209c") : secret "dns-default-metrics-tls" not found Jul 30 19:40:00.984665 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:40:00.984609 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b68104df-4001-4583-80f1-700368eb4583-registry-tls podName:b68104df-4001-4583-80f1-700368eb4583 nodeName:}" failed. No retries permitted until 2026-07-30 19:40:02.984592074 +0000 UTC m=+37.135671616 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b68104df-4001-4583-80f1-700368eb4583-registry-tls") pod "image-registry-5c7469cffd-x8fmw" (UID: "b68104df-4001-4583-80f1-700368eb4583") : secret "image-registry-tls" not found Jul 30 19:40:01.488696 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:01.488663 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fn7fj" event={"ID":"ef0f467f-7334-4115-9601-875fd55fb025","Type":"ContainerStarted","Data":"9564d8c999331bd89c6c60b3fa64f56ee6d27902b2781f6a595462a5178558f9"} Jul 30 19:40:01.491173 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:01.491146 2555 generic.go:356] "Generic (PLEG): container finished" podID="2b80bb73-3e52-45c7-80c1-2beec4c736ac" containerID="7122b7febfed5ac27bd16c4a1cfe2dcdfd9e952777a3a0fe8e4e44098be1b9a7" exitCode=0 Jul 30 19:40:01.491288 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:01.491230 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g5s9d" event={"ID":"2b80bb73-3e52-45c7-80c1-2beec4c736ac","Type":"ContainerDied","Data":"7122b7febfed5ac27bd16c4a1cfe2dcdfd9e952777a3a0fe8e4e44098be1b9a7"} Jul 30 19:40:01.492434 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:01.492318 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8hgzs" event={"ID":"b12d3e8b-733d-482d-a5e4-5037e134e354","Type":"ContainerStarted","Data":"dc9115709c34b1d9b78d0264c879a2f8c9bfcd6ea0cc63a854c97102eaf8736f"} Jul 30 19:40:02.498787 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:02.498743 2555 generic.go:356] "Generic (PLEG): container finished" podID="2b80bb73-3e52-45c7-80c1-2beec4c736ac" containerID="e8091c183c06401e99915c17c4f1c603e4b55cd56ea9326fdb1969db615fdd9d" exitCode=0 Jul 30 19:40:02.499213 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:02.498816 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g5s9d" event={"ID":"2b80bb73-3e52-45c7-80c1-2beec4c736ac","Type":"ContainerDied","Data":"e8091c183c06401e99915c17c4f1c603e4b55cd56ea9326fdb1969db615fdd9d"} Jul 30 19:40:02.996776 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:02.996591 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b68104df-4001-4583-80f1-700368eb4583-registry-tls\") pod \"image-registry-5c7469cffd-x8fmw\" (UID: \"b68104df-4001-4583-80f1-700368eb4583\") " pod="openshift-image-registry/image-registry-5c7469cffd-x8fmw" Jul 30 19:40:02.996976 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:40:02.996730 2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 30 19:40:02.996976 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:40:02.996829 2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5c7469cffd-x8fmw: secret "image-registry-tls" not found Jul 30 19:40:02.996976 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:40:02.996879 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 30 19:40:02.996976 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:02.996812 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/699cb731-6732-4466-b2a6-c94c3c75209c-metrics-tls\") pod \"dns-default-m5znh\" (UID: \"699cb731-6732-4466-b2a6-c94c3c75209c\") " pod="openshift-dns/dns-default-m5znh" Jul 30 19:40:02.996976 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:40:02.996881 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b68104df-4001-4583-80f1-700368eb4583-registry-tls podName:b68104df-4001-4583-80f1-700368eb4583 nodeName:}" failed. No retries permitted until 2026-07-30 19:40:06.996867259 +0000 UTC m=+41.147946790 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b68104df-4001-4583-80f1-700368eb4583-registry-tls") pod "image-registry-5c7469cffd-x8fmw" (UID: "b68104df-4001-4583-80f1-700368eb4583") : secret "image-registry-tls" not found Jul 30 19:40:02.996976 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:40:02.996927 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/699cb731-6732-4466-b2a6-c94c3c75209c-metrics-tls podName:699cb731-6732-4466-b2a6-c94c3c75209c nodeName:}" failed. No retries permitted until 2026-07-30 19:40:06.996916071 +0000 UTC m=+41.147995599 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/699cb731-6732-4466-b2a6-c94c3c75209c-metrics-tls") pod "dns-default-m5znh" (UID: "699cb731-6732-4466-b2a6-c94c3c75209c") : secret "dns-default-metrics-tls" not found Jul 30 19:40:03.491993 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:03.491948 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-68bc745d87-bmskb"] Jul 30 19:40:03.526109 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:03.526007 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-68bc745d87-bmskb"] Jul 30 19:40:03.526109 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:03.526055 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g5s9d" event={"ID":"2b80bb73-3e52-45c7-80c1-2beec4c736ac","Type":"ContainerStarted","Data":"ebeb1bbd5e9ccb2725229e08012615c1587ff6cd6f5d697adb041ba0143f8163"} Jul 30 19:40:03.526579 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:03.526134 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-bmskb" Jul 30 19:40:03.528843 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:03.528819 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 30 19:40:03.528843 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:03.528839 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-d76zp\"" Jul 30 19:40:03.529141 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:03.529123 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 30 19:40:03.532604 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:03.532367 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-g5s9d" podStartSLOduration=8.266557698 podStartE2EDuration="37.532348773s" totalImagesPullingTime="29.265791075s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 19:39:26 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 19:40:03.530408687 +0000 UTC m=+37.681488239" watchObservedRunningTime="2026-07-30 19:40:03.532348773 +0000 UTC m=+37.683428325" Jul 30 19:40:03.601956 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:03.601912 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9fdf\" (UniqueName: \"kubernetes.io/projected/69b80037-a1d0-4687-b77b-2f181b1eac11-kube-api-access-c9fdf\") pod \"migrator-68bc745d87-bmskb\" (UID: \"69b80037-a1d0-4687-b77b-2f181b1eac11\") " pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-bmskb" Jul 30 19:40:03.702865 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:03.702819 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9fdf\" (UniqueName: \"kubernetes.io/projected/69b80037-a1d0-4687-b77b-2f181b1eac11-kube-api-access-c9fdf\") pod \"migrator-68bc745d87-bmskb\" (UID: \"69b80037-a1d0-4687-b77b-2f181b1eac11\") " pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-bmskb" Jul 30 19:40:03.713753 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:03.713718 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9fdf\" (UniqueName: \"kubernetes.io/projected/69b80037-a1d0-4687-b77b-2f181b1eac11-kube-api-access-c9fdf\") pod \"migrator-68bc745d87-bmskb\" (UID: \"69b80037-a1d0-4687-b77b-2f181b1eac11\") " pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-bmskb" Jul 30 19:40:03.838518 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:03.838444 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-bmskb" Jul 30 19:40:03.940063 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:03.939759 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-jh4gj"] Jul 30 19:40:03.946217 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:03.946014 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jh4gj" Jul 30 19:40:03.951629 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:03.949869 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-gccm8\"" Jul 30 19:40:03.951629 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:03.950140 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 30 19:40:03.951629 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:03.950158 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 30 19:40:03.956848 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:03.956822 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 30 19:40:03.957142 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:03.957122 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 30 19:40:03.959878 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:03.959841 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jh4gj"] Jul 30 19:40:04.005583 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:04.005463 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/48b97056-59a9-47e6-a611-7fae01b30ef3-data-volume\") pod \"insights-runtime-extractor-jh4gj\" (UID: \"48b97056-59a9-47e6-a611-7fae01b30ef3\") " pod="openshift-insights/insights-runtime-extractor-jh4gj" Jul 30 19:40:04.005583 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:04.005512 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/48b97056-59a9-47e6-a611-7fae01b30ef3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jh4gj\" (UID: \"48b97056-59a9-47e6-a611-7fae01b30ef3\") " pod="openshift-insights/insights-runtime-extractor-jh4gj" Jul 30 19:40:04.005799 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:04.005648 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/48b97056-59a9-47e6-a611-7fae01b30ef3-crio-socket\") pod \"insights-runtime-extractor-jh4gj\" (UID: \"48b97056-59a9-47e6-a611-7fae01b30ef3\") " pod="openshift-insights/insights-runtime-extractor-jh4gj" Jul 30 19:40:04.005799 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:04.005686 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/48b97056-59a9-47e6-a611-7fae01b30ef3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jh4gj\" (UID: \"48b97056-59a9-47e6-a611-7fae01b30ef3\") " pod="openshift-insights/insights-runtime-extractor-jh4gj" Jul 30 19:40:04.005799 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:04.005755 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqg94\" (UniqueName: \"kubernetes.io/projected/48b97056-59a9-47e6-a611-7fae01b30ef3-kube-api-access-hqg94\") pod \"insights-runtime-extractor-jh4gj\" (UID: \"48b97056-59a9-47e6-a611-7fae01b30ef3\") " pod="openshift-insights/insights-runtime-extractor-jh4gj" Jul 30 19:40:04.023839 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:04.023807 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-68bc745d87-bmskb"] Jul 30 19:40:04.028087 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:40:04.028054 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69b80037_a1d0_4687_b77b_2f181b1eac11.slice/crio-6c7be83c8bc58d3bb9eb941bfef5cce2d9cbf9f495f1e607fd8899cae74f599d WatchSource:0}: Error finding container 6c7be83c8bc58d3bb9eb941bfef5cce2d9cbf9f495f1e607fd8899cae74f599d: Status 404 returned error can't find the container with id 6c7be83c8bc58d3bb9eb941bfef5cce2d9cbf9f495f1e607fd8899cae74f599d Jul 30 19:40:04.106554 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:04.106523 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/48b97056-59a9-47e6-a611-7fae01b30ef3-crio-socket\") pod \"insights-runtime-extractor-jh4gj\" (UID: \"48b97056-59a9-47e6-a611-7fae01b30ef3\") " pod="openshift-insights/insights-runtime-extractor-jh4gj" Jul 30 19:40:04.106683 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:04.106558 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/48b97056-59a9-47e6-a611-7fae01b30ef3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jh4gj\" (UID: \"48b97056-59a9-47e6-a611-7fae01b30ef3\") " pod="openshift-insights/insights-runtime-extractor-jh4gj" Jul 30 19:40:04.106683 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:04.106602 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqg94\" (UniqueName: \"kubernetes.io/projected/48b97056-59a9-47e6-a611-7fae01b30ef3-kube-api-access-hqg94\") pod \"insights-runtime-extractor-jh4gj\" (UID: \"48b97056-59a9-47e6-a611-7fae01b30ef3\") " pod="openshift-insights/insights-runtime-extractor-jh4gj" Jul 30 19:40:04.106683 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:04.106664 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/48b97056-59a9-47e6-a611-7fae01b30ef3-data-volume\") pod \"insights-runtime-extractor-jh4gj\" (UID: \"48b97056-59a9-47e6-a611-7fae01b30ef3\") " pod="openshift-insights/insights-runtime-extractor-jh4gj" Jul 30 19:40:04.106683 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:04.106680 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/48b97056-59a9-47e6-a611-7fae01b30ef3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jh4gj\" (UID: \"48b97056-59a9-47e6-a611-7fae01b30ef3\") " pod="openshift-insights/insights-runtime-extractor-jh4gj" Jul 30 19:40:04.106875 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:40:04.106746 2555 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 30 19:40:04.106875 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:04.106791 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/48b97056-59a9-47e6-a611-7fae01b30ef3-crio-socket\") pod \"insights-runtime-extractor-jh4gj\" (UID: \"48b97056-59a9-47e6-a611-7fae01b30ef3\") " pod="openshift-insights/insights-runtime-extractor-jh4gj" Jul 30 19:40:04.106875 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:40:04.106746 2555 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 30 19:40:04.106875 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:40:04.106857 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/48b97056-59a9-47e6-a611-7fae01b30ef3-kube-rbac-proxy-cm podName:48b97056-59a9-47e6-a611-7fae01b30ef3 nodeName:}" failed. No retries permitted until 2026-07-30 19:40:04.606835321 +0000 UTC m=+38.757914867 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/48b97056-59a9-47e6-a611-7fae01b30ef3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jh4gj" (UID: "48b97056-59a9-47e6-a611-7fae01b30ef3") : configmap "kube-rbac-proxy" not found Jul 30 19:40:04.106875 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:40:04.106877 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/48b97056-59a9-47e6-a611-7fae01b30ef3-insights-runtime-extractor-tls podName:48b97056-59a9-47e6-a611-7fae01b30ef3 nodeName:}" failed. No retries permitted until 2026-07-30 19:40:04.606868032 +0000 UTC m=+38.757947560 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/48b97056-59a9-47e6-a611-7fae01b30ef3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jh4gj" (UID: "48b97056-59a9-47e6-a611-7fae01b30ef3") : secret "insights-runtime-extractor-tls" not found Jul 30 19:40:04.107117 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:04.106944 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/48b97056-59a9-47e6-a611-7fae01b30ef3-data-volume\") pod \"insights-runtime-extractor-jh4gj\" (UID: \"48b97056-59a9-47e6-a611-7fae01b30ef3\") " pod="openshift-insights/insights-runtime-extractor-jh4gj" Jul 30 19:40:04.115550 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:04.115526 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqg94\" (UniqueName: \"kubernetes.io/projected/48b97056-59a9-47e6-a611-7fae01b30ef3-kube-api-access-hqg94\") pod \"insights-runtime-extractor-jh4gj\" (UID: \"48b97056-59a9-47e6-a611-7fae01b30ef3\") " pod="openshift-insights/insights-runtime-extractor-jh4gj" Jul 30 19:40:04.511064 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:04.511028 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-bmskb" event={"ID":"69b80037-a1d0-4687-b77b-2f181b1eac11","Type":"ContainerStarted","Data":"6c7be83c8bc58d3bb9eb941bfef5cce2d9cbf9f495f1e607fd8899cae74f599d"} Jul 30 19:40:04.512601 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:04.512551 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8hgzs" event={"ID":"b12d3e8b-733d-482d-a5e4-5037e134e354","Type":"ContainerStarted","Data":"c896eef9d07f96722b6a559716aba24ea9b27d5b3ad465183020e306c917ce29"} Jul 30 19:40:04.528643 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:04.528603 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-8hgzs" podStartSLOduration=2.310949905 podStartE2EDuration="5.528586932s" totalImagesPullingTime="3.217637027s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 19:39:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 19:40:04.527178571 +0000 UTC m=+38.678258122" watchObservedRunningTime="2026-07-30 19:40:04.528586932 +0000 UTC m=+38.679666483" Jul 30 19:40:04.610681 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:04.610643 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/48b97056-59a9-47e6-a611-7fae01b30ef3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jh4gj\" (UID: \"48b97056-59a9-47e6-a611-7fae01b30ef3\") " pod="openshift-insights/insights-runtime-extractor-jh4gj" Jul 30 19:40:04.610847 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:04.610706 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/48b97056-59a9-47e6-a611-7fae01b30ef3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jh4gj\" (UID: \"48b97056-59a9-47e6-a611-7fae01b30ef3\") " pod="openshift-insights/insights-runtime-extractor-jh4gj" Jul 30 19:40:04.610847 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:40:04.610813 2555 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 30 19:40:04.610971 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:40:04.610885 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/48b97056-59a9-47e6-a611-7fae01b30ef3-kube-rbac-proxy-cm podName:48b97056-59a9-47e6-a611-7fae01b30ef3 nodeName:}" failed. No retries permitted until 2026-07-30 19:40:05.610865724 +0000 UTC m=+39.761945257 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/48b97056-59a9-47e6-a611-7fae01b30ef3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jh4gj" (UID: "48b97056-59a9-47e6-a611-7fae01b30ef3") : configmap "kube-rbac-proxy" not found Jul 30 19:40:04.611057 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:40:04.611039 2555 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 30 19:40:04.611118 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:40:04.611097 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/48b97056-59a9-47e6-a611-7fae01b30ef3-insights-runtime-extractor-tls podName:48b97056-59a9-47e6-a611-7fae01b30ef3 nodeName:}" failed. No retries permitted until 2026-07-30 19:40:05.611080948 +0000 UTC m=+39.762160492 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/48b97056-59a9-47e6-a611-7fae01b30ef3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jh4gj" (UID: "48b97056-59a9-47e6-a611-7fae01b30ef3") : secret "insights-runtime-extractor-tls" not found Jul 30 19:40:05.620090 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:05.620055 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/48b97056-59a9-47e6-a611-7fae01b30ef3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jh4gj\" (UID: \"48b97056-59a9-47e6-a611-7fae01b30ef3\") " pod="openshift-insights/insights-runtime-extractor-jh4gj" Jul 30 19:40:05.620558 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:05.620103 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/48b97056-59a9-47e6-a611-7fae01b30ef3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jh4gj\" (UID: \"48b97056-59a9-47e6-a611-7fae01b30ef3\") " pod="openshift-insights/insights-runtime-extractor-jh4gj" Jul 30 19:40:05.620558 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:40:05.620178 2555 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 30 19:40:05.620558 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:40:05.620203 2555 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 30 19:40:05.620558 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:40:05.620234 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/48b97056-59a9-47e6-a611-7fae01b30ef3-kube-rbac-proxy-cm podName:48b97056-59a9-47e6-a611-7fae01b30ef3 nodeName:}" failed. No retries permitted until 2026-07-30 19:40:07.62021985 +0000 UTC m=+41.771299379 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/48b97056-59a9-47e6-a611-7fae01b30ef3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jh4gj" (UID: "48b97056-59a9-47e6-a611-7fae01b30ef3") : configmap "kube-rbac-proxy" not found Jul 30 19:40:05.620558 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:40:05.620248 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/48b97056-59a9-47e6-a611-7fae01b30ef3-insights-runtime-extractor-tls podName:48b97056-59a9-47e6-a611-7fae01b30ef3 nodeName:}" failed. No retries permitted until 2026-07-30 19:40:07.620242459 +0000 UTC m=+41.771321986 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/48b97056-59a9-47e6-a611-7fae01b30ef3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jh4gj" (UID: "48b97056-59a9-47e6-a611-7fae01b30ef3") : secret "insights-runtime-extractor-tls" not found Jul 30 19:40:05.987647 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:05.987610 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-98c88fbb5-g4h5w"] Jul 30 19:40:06.006797 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:06.006769 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-98c88fbb5-g4h5w"] Jul 30 19:40:06.006967 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:06.006882 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-98c88fbb5-g4h5w" Jul 30 19:40:06.009758 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:06.009608 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-pg89k\"" Jul 30 19:40:06.009758 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:06.009636 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 30 19:40:06.010541 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:06.010514 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 30 19:40:06.010541 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:06.010536 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 30 19:40:06.010828 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:06.010711 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 30 19:40:06.022393 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:06.022302 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9htc\" (UniqueName: \"kubernetes.io/projected/1ca31357-b99a-47a2-afb0-fae7fe94dad0-kube-api-access-m9htc\") pod \"service-ca-98c88fbb5-g4h5w\" (UID: \"1ca31357-b99a-47a2-afb0-fae7fe94dad0\") " pod="openshift-service-ca/service-ca-98c88fbb5-g4h5w" Jul 30 19:40:06.022393 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:06.022392 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/1ca31357-b99a-47a2-afb0-fae7fe94dad0-signing-key\") pod \"service-ca-98c88fbb5-g4h5w\" (UID: \"1ca31357-b99a-47a2-afb0-fae7fe94dad0\") " pod="openshift-service-ca/service-ca-98c88fbb5-g4h5w" Jul 30 19:40:06.022609 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:06.022414 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/1ca31357-b99a-47a2-afb0-fae7fe94dad0-signing-cabundle\") pod \"service-ca-98c88fbb5-g4h5w\" (UID: \"1ca31357-b99a-47a2-afb0-fae7fe94dad0\") " pod="openshift-service-ca/service-ca-98c88fbb5-g4h5w" Jul 30 19:40:06.123327 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:06.123262 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9htc\" (UniqueName: \"kubernetes.io/projected/1ca31357-b99a-47a2-afb0-fae7fe94dad0-kube-api-access-m9htc\") pod \"service-ca-98c88fbb5-g4h5w\" (UID: \"1ca31357-b99a-47a2-afb0-fae7fe94dad0\") " pod="openshift-service-ca/service-ca-98c88fbb5-g4h5w" Jul 30 19:40:06.123505 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:06.123368 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/1ca31357-b99a-47a2-afb0-fae7fe94dad0-signing-key\") pod \"service-ca-98c88fbb5-g4h5w\" (UID: \"1ca31357-b99a-47a2-afb0-fae7fe94dad0\") " pod="openshift-service-ca/service-ca-98c88fbb5-g4h5w" Jul 30 19:40:06.123505 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:06.123402 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/1ca31357-b99a-47a2-afb0-fae7fe94dad0-signing-cabundle\") pod \"service-ca-98c88fbb5-g4h5w\" (UID: \"1ca31357-b99a-47a2-afb0-fae7fe94dad0\") " pod="openshift-service-ca/service-ca-98c88fbb5-g4h5w" Jul 30 19:40:06.124094 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:06.124068 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/1ca31357-b99a-47a2-afb0-fae7fe94dad0-signing-cabundle\") pod \"service-ca-98c88fbb5-g4h5w\" (UID: \"1ca31357-b99a-47a2-afb0-fae7fe94dad0\") " pod="openshift-service-ca/service-ca-98c88fbb5-g4h5w" Jul 30 19:40:06.126267 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:06.126244 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/1ca31357-b99a-47a2-afb0-fae7fe94dad0-signing-key\") pod \"service-ca-98c88fbb5-g4h5w\" (UID: \"1ca31357-b99a-47a2-afb0-fae7fe94dad0\") " pod="openshift-service-ca/service-ca-98c88fbb5-g4h5w" Jul 30 19:40:06.131151 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:06.131126 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9htc\" (UniqueName: \"kubernetes.io/projected/1ca31357-b99a-47a2-afb0-fae7fe94dad0-kube-api-access-m9htc\") pod \"service-ca-98c88fbb5-g4h5w\" (UID: \"1ca31357-b99a-47a2-afb0-fae7fe94dad0\") " pod="openshift-service-ca/service-ca-98c88fbb5-g4h5w" Jul 30 19:40:06.308007 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:06.307981 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-krnh8_3061134d-d0a7-491b-8d15-88a12ce9d02d/dns-node-resolver/0.log" Jul 30 19:40:06.317878 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:06.317841 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-98c88fbb5-g4h5w" Jul 30 19:40:06.520169 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:06.520122 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fn7fj" event={"ID":"ef0f467f-7334-4115-9601-875fd55fb025","Type":"ContainerStarted","Data":"f947767b205beb171518db31b20b2e3429b1bc91beb8f4331950c418cff276cb"} Jul 30 19:40:06.537782 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:06.537737 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-fn7fj" podStartSLOduration=35.563064963 podStartE2EDuration="40.537720204s" totalImagesPullingTime="4.974655241s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 19:39:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 19:40:06.537030943 +0000 UTC m=+40.688110492" watchObservedRunningTime="2026-07-30 19:40:06.537720204 +0000 UTC m=+40.688799758" Jul 30 19:40:06.740842 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:06.740814 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-98c88fbb5-g4h5w"] Jul 30 19:40:06.743776 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:40:06.743750 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ca31357_b99a_47a2_afb0_fae7fe94dad0.slice/crio-b6c3e1902da4d439ee0cf86eccca304712a1d73234418b9151f3eb607664c747 WatchSource:0}: Error finding container b6c3e1902da4d439ee0cf86eccca304712a1d73234418b9151f3eb607664c747: Status 404 returned error can't find the container with id b6c3e1902da4d439ee0cf86eccca304712a1d73234418b9151f3eb607664c747 Jul 30 19:40:07.029840 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:07.029814 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b68104df-4001-4583-80f1-700368eb4583-registry-tls\") pod \"image-registry-5c7469cffd-x8fmw\" (UID: \"b68104df-4001-4583-80f1-700368eb4583\") " pod="openshift-image-registry/image-registry-5c7469cffd-x8fmw" Jul 30 19:40:07.029952 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:07.029878 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/699cb731-6732-4466-b2a6-c94c3c75209c-metrics-tls\") pod \"dns-default-m5znh\" (UID: \"699cb731-6732-4466-b2a6-c94c3c75209c\") " pod="openshift-dns/dns-default-m5znh" Jul 30 19:40:07.029997 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:40:07.029952 2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 30 19:40:07.029997 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:40:07.029966 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 30 19:40:07.030060 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:40:07.030005 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/699cb731-6732-4466-b2a6-c94c3c75209c-metrics-tls podName:699cb731-6732-4466-b2a6-c94c3c75209c nodeName:}" failed. No retries permitted until 2026-07-30 19:40:15.029992888 +0000 UTC m=+49.181072417 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/699cb731-6732-4466-b2a6-c94c3c75209c-metrics-tls") pod "dns-default-m5znh" (UID: "699cb731-6732-4466-b2a6-c94c3c75209c") : secret "dns-default-metrics-tls" not found Jul 30 19:40:07.030060 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:40:07.029968 2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5c7469cffd-x8fmw: secret "image-registry-tls" not found Jul 30 19:40:07.030143 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:40:07.030088 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b68104df-4001-4583-80f1-700368eb4583-registry-tls podName:b68104df-4001-4583-80f1-700368eb4583 nodeName:}" failed. No retries permitted until 2026-07-30 19:40:15.030074705 +0000 UTC m=+49.181154233 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b68104df-4001-4583-80f1-700368eb4583-registry-tls") pod "image-registry-5c7469cffd-x8fmw" (UID: "b68104df-4001-4583-80f1-700368eb4583") : secret "image-registry-tls" not found Jul 30 19:40:07.309752 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:07.309683 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-crnbd_07586ae2-3389-4063-b494-eb1affb8ad5b/node-ca/0.log" Jul 30 19:40:07.524623 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:07.524582 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-bmskb" event={"ID":"69b80037-a1d0-4687-b77b-2f181b1eac11","Type":"ContainerStarted","Data":"1b5fa5abc24cb59429c58c2532006f8669dd0edab8b448cf80d5dc62c0e05482"} Jul 30 19:40:07.524785 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:07.524646 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-bmskb" event={"ID":"69b80037-a1d0-4687-b77b-2f181b1eac11","Type":"ContainerStarted","Data":"30461365aec468e99f7c4a2f6a9a77e1f7614a4e385d08ac17f645f5d17b3e1e"} Jul 30 19:40:07.525973 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:07.525922 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-98c88fbb5-g4h5w" event={"ID":"1ca31357-b99a-47a2-afb0-fae7fe94dad0","Type":"ContainerStarted","Data":"b6c3e1902da4d439ee0cf86eccca304712a1d73234418b9151f3eb607664c747"} Jul 30 19:40:07.541979 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:07.541931 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-bmskb" podStartSLOduration=1.557390531 podStartE2EDuration="4.541915114s" totalImagesPullingTime="2.984524583s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 19:40:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 19:40:07.54071785 +0000 UTC m=+41.691797400" watchObservedRunningTime="2026-07-30 19:40:07.541915114 +0000 UTC m=+41.692994641" Jul 30 19:40:07.635619 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:07.635528 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/48b97056-59a9-47e6-a611-7fae01b30ef3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jh4gj\" (UID: \"48b97056-59a9-47e6-a611-7fae01b30ef3\") " pod="openshift-insights/insights-runtime-extractor-jh4gj" Jul 30 19:40:07.635619 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:07.635589 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/48b97056-59a9-47e6-a611-7fae01b30ef3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jh4gj\" (UID: \"48b97056-59a9-47e6-a611-7fae01b30ef3\") " pod="openshift-insights/insights-runtime-extractor-jh4gj" Jul 30 19:40:07.635841 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:40:07.635736 2555 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 30 19:40:07.635841 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:40:07.635802 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/48b97056-59a9-47e6-a611-7fae01b30ef3-insights-runtime-extractor-tls podName:48b97056-59a9-47e6-a611-7fae01b30ef3 nodeName:}" failed. No retries permitted until 2026-07-30 19:40:11.635782116 +0000 UTC m=+45.786861646 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/48b97056-59a9-47e6-a611-7fae01b30ef3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jh4gj" (UID: "48b97056-59a9-47e6-a611-7fae01b30ef3") : secret "insights-runtime-extractor-tls" not found Jul 30 19:40:07.636124 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:07.636096 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/48b97056-59a9-47e6-a611-7fae01b30ef3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jh4gj\" (UID: \"48b97056-59a9-47e6-a611-7fae01b30ef3\") " pod="openshift-insights/insights-runtime-extractor-jh4gj" Jul 30 19:40:07.910189 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:07.910110 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-8hgzs_b12d3e8b-733d-482d-a5e4-5037e134e354/serve-healthcheck-canary/0.log" Jul 30 19:40:08.309287 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:08.309240 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-68bc745d87-bmskb_69b80037-a1d0-4687-b77b-2f181b1eac11/migrator/0.log" Jul 30 19:40:08.508808 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:08.508780 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-68bc745d87-bmskb_69b80037-a1d0-4687-b77b-2f181b1eac11/graceful-termination/0.log" Jul 30 19:40:09.531878 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:09.531845 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-98c88fbb5-g4h5w" event={"ID":"1ca31357-b99a-47a2-afb0-fae7fe94dad0","Type":"ContainerStarted","Data":"6b4aa6db0250798f49d3206ba3469bb70df8a2d6bd9771a4660ddf7bada9e5ab"} Jul 30 19:40:09.548400 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:09.548352 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-98c88fbb5-g4h5w" podStartSLOduration=1.861622869 podStartE2EDuration="4.548332753s" totalImagesPullingTime="2.686709884s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 19:40:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 19:40:09.547138922 +0000 UTC m=+43.698218472" watchObservedRunningTime="2026-07-30 19:40:09.548332753 +0000 UTC m=+43.699412302" Jul 30 19:40:11.664403 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:11.664352 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/48b97056-59a9-47e6-a611-7fae01b30ef3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jh4gj\" (UID: \"48b97056-59a9-47e6-a611-7fae01b30ef3\") " pod="openshift-insights/insights-runtime-extractor-jh4gj" Jul 30 19:40:11.664955 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:40:11.664525 2555 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 30 19:40:11.664955 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:40:11.664620 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/48b97056-59a9-47e6-a611-7fae01b30ef3-insights-runtime-extractor-tls podName:48b97056-59a9-47e6-a611-7fae01b30ef3 nodeName:}" failed. No retries permitted until 2026-07-30 19:40:19.66459539 +0000 UTC m=+53.815674922 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/48b97056-59a9-47e6-a611-7fae01b30ef3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jh4gj" (UID: "48b97056-59a9-47e6-a611-7fae01b30ef3") : secret "insights-runtime-extractor-tls" not found Jul 30 19:40:15.091878 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:15.091841 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b68104df-4001-4583-80f1-700368eb4583-registry-tls\") pod \"image-registry-5c7469cffd-x8fmw\" (UID: \"b68104df-4001-4583-80f1-700368eb4583\") " pod="openshift-image-registry/image-registry-5c7469cffd-x8fmw" Jul 30 19:40:15.092237 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:15.091915 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/699cb731-6732-4466-b2a6-c94c3c75209c-metrics-tls\") pod \"dns-default-m5znh\" (UID: \"699cb731-6732-4466-b2a6-c94c3c75209c\") " pod="openshift-dns/dns-default-m5znh" Jul 30 19:40:15.094263 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:15.094229 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/699cb731-6732-4466-b2a6-c94c3c75209c-metrics-tls\") pod \"dns-default-m5znh\" (UID: \"699cb731-6732-4466-b2a6-c94c3c75209c\") " pod="openshift-dns/dns-default-m5znh" Jul 30 19:40:15.094392 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:15.094310 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b68104df-4001-4583-80f1-700368eb4583-registry-tls\") pod \"image-registry-5c7469cffd-x8fmw\" (UID: \"b68104df-4001-4583-80f1-700368eb4583\") " pod="openshift-image-registry/image-registry-5c7469cffd-x8fmw" Jul 30 19:40:15.107627 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:15.107600 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-m5znh" Jul 30 19:40:15.112715 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:15.112692 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5c7469cffd-x8fmw" Jul 30 19:40:15.275760 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:15.275738 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-m5znh"] Jul 30 19:40:15.279076 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:40:15.279049 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod699cb731_6732_4466_b2a6_c94c3c75209c.slice/crio-c8e2c585e6612c0bc28586e65f6469423fa7657ed0504fb0d802ce53419e69c4 WatchSource:0}: Error finding container c8e2c585e6612c0bc28586e65f6469423fa7657ed0504fb0d802ce53419e69c4: Status 404 returned error can't find the container with id c8e2c585e6612c0bc28586e65f6469423fa7657ed0504fb0d802ce53419e69c4 Jul 30 19:40:15.305723 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:15.305688 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5c7469cffd-x8fmw"] Jul 30 19:40:15.308426 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:40:15.308404 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb68104df_4001_4583_80f1_700368eb4583.slice/crio-8fe7f59c042a108b1b17d0b7ef4f1f27dc07ab1bccd14bc80a01d01bc03237c5 WatchSource:0}: Error finding container 8fe7f59c042a108b1b17d0b7ef4f1f27dc07ab1bccd14bc80a01d01bc03237c5: Status 404 returned error can't find the container with id 8fe7f59c042a108b1b17d0b7ef4f1f27dc07ab1bccd14bc80a01d01bc03237c5 Jul 30 19:40:15.549442 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:15.549405 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-m5znh" event={"ID":"699cb731-6732-4466-b2a6-c94c3c75209c","Type":"ContainerStarted","Data":"c8e2c585e6612c0bc28586e65f6469423fa7657ed0504fb0d802ce53419e69c4"} Jul 30 19:40:15.550868 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:15.550840 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5c7469cffd-x8fmw" event={"ID":"b68104df-4001-4583-80f1-700368eb4583","Type":"ContainerStarted","Data":"e9866f700659fd0b3b723b5e73d37dc2450e1242a41892cfb6d849c076aa5fc7"} Jul 30 19:40:15.551027 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:15.550879 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5c7469cffd-x8fmw" event={"ID":"b68104df-4001-4583-80f1-700368eb4583","Type":"ContainerStarted","Data":"8fe7f59c042a108b1b17d0b7ef4f1f27dc07ab1bccd14bc80a01d01bc03237c5"} Jul 30 19:40:15.551027 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:15.550977 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5c7469cffd-x8fmw" Jul 30 19:40:15.569599 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:15.569533 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5c7469cffd-x8fmw" podStartSLOduration=27.569512118 podStartE2EDuration="27.569512118s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 19:39:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 19:40:15.568883372 +0000 UTC m=+49.719962923" watchObservedRunningTime="2026-07-30 19:40:15.569512118 +0000 UTC m=+49.720591669" Jul 30 19:40:17.558867 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:17.558775 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-m5znh" event={"ID":"699cb731-6732-4466-b2a6-c94c3c75209c","Type":"ContainerStarted","Data":"d8c88340bc8006a2f99d8ed4a62e32896c82a309f7004c27062364febc772902"} Jul 30 19:40:17.558867 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:17.558843 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-m5znh" event={"ID":"699cb731-6732-4466-b2a6-c94c3c75209c","Type":"ContainerStarted","Data":"9e1fcee0267b31040ba00ec672535aa30cb7144a4a26ed294ab08ee65a1f51c3"} Jul 30 19:40:17.559392 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:17.558882 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-m5znh" Jul 30 19:40:17.576724 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:17.576667 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-m5znh" podStartSLOduration=16.617403616 podStartE2EDuration="18.576645777s" totalImagesPullingTime="1.959242161s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 19:39:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 19:40:17.574986221 +0000 UTC m=+51.726065770" watchObservedRunningTime="2026-07-30 19:40:17.576645777 +0000 UTC m=+51.727725329" Jul 30 19:40:19.732700 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:19.732661 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/48b97056-59a9-47e6-a611-7fae01b30ef3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jh4gj\" (UID: \"48b97056-59a9-47e6-a611-7fae01b30ef3\") " pod="openshift-insights/insights-runtime-extractor-jh4gj" Jul 30 19:40:19.734866 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:19.734845 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/48b97056-59a9-47e6-a611-7fae01b30ef3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jh4gj\" (UID: \"48b97056-59a9-47e6-a611-7fae01b30ef3\") " pod="openshift-insights/insights-runtime-extractor-jh4gj" Jul 30 19:40:19.865867 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:19.865835 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jh4gj" Jul 30 19:40:19.986096 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:19.986008 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jh4gj"] Jul 30 19:40:19.988591 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:40:19.988565 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48b97056_59a9_47e6_a611_7fae01b30ef3.slice/crio-defe81b05a5876c7c15df27ab77e13d7f39a1d6a92266f198ecee286cb20210d WatchSource:0}: Error finding container defe81b05a5876c7c15df27ab77e13d7f39a1d6a92266f198ecee286cb20210d: Status 404 returned error can't find the container with id defe81b05a5876c7c15df27ab77e13d7f39a1d6a92266f198ecee286cb20210d Jul 30 19:40:20.572711 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:20.572677 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jh4gj" event={"ID":"48b97056-59a9-47e6-a611-7fae01b30ef3","Type":"ContainerStarted","Data":"320477aade6dd45eab5fdfa4bce0074317dfd1f71289268e4823f893f9af61b1"} Jul 30 19:40:20.573078 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:20.572743 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jh4gj" event={"ID":"48b97056-59a9-47e6-a611-7fae01b30ef3","Type":"ContainerStarted","Data":"defe81b05a5876c7c15df27ab77e13d7f39a1d6a92266f198ecee286cb20210d"} Jul 30 19:40:21.577733 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:21.577699 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jh4gj" event={"ID":"48b97056-59a9-47e6-a611-7fae01b30ef3","Type":"ContainerStarted","Data":"c2117ee8f922228638f8b494be325a2f38bccd0fbbcfa479df11de4f32a7eb67"} Jul 30 19:40:22.583056 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:22.583016 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jh4gj" event={"ID":"48b97056-59a9-47e6-a611-7fae01b30ef3","Type":"ContainerStarted","Data":"b25cfc3db7dba190b6275ca669e0d8881781eb750ee8330444a95f0b9b116bec"} Jul 30 19:40:22.603061 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:22.603013 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-jh4gj" podStartSLOduration=17.32624387 podStartE2EDuration="19.602996736s" totalImagesPullingTime="2.276752866s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 19:40:03 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 19:40:22.602542409 +0000 UTC m=+56.753621958" watchObservedRunningTime="2026-07-30 19:40:22.602996736 +0000 UTC m=+56.754076285" Jul 30 19:40:25.484581 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:25.484547 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-sjhkz" Jul 30 19:40:27.344610 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:27.344575 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77ccb4f94b-2c7z2"] Jul 30 19:40:27.347542 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:27.347517 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77ccb4f94b-2c7z2" Jul 30 19:40:27.347750 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:27.347723 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b94698dd4-894mq"] Jul 30 19:40:27.349520 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:27.349501 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d5c54d84-fq7q8"] Jul 30 19:40:27.349656 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:27.349636 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b94698dd4-894mq" Jul 30 19:40:27.350046 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:27.350026 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 30 19:40:27.350046 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:27.350026 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-5mhhl\"" Jul 30 19:40:27.350323 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:27.350308 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 30 19:40:27.350971 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:27.350950 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 30 19:40:27.351072 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:27.350995 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 30 19:40:27.351463 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:27.351442 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d5c54d84-fq7q8" Jul 30 19:40:27.351937 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:27.351922 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 30 19:40:27.353855 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:27.353834 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 30 19:40:27.353949 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:27.353890 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 30 19:40:27.354591 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:27.354572 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 30 19:40:27.355106 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:27.355088 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 30 19:40:27.355446 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:27.355428 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5c7469cffd-x8fmw"] Jul 30 19:40:27.357993 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:27.357977 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77ccb4f94b-2c7z2"] Jul 30 19:40:27.361679 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:27.361661 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b94698dd4-894mq"] Jul 30 19:40:27.378088 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:27.378065 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d5c54d84-fq7q8"] Jul 30 19:40:27.452639 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:27.452607 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6d96b57fcb-m4jlr"] Jul 30 19:40:27.454324 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:27.454310 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6d96b57fcb-m4jlr" Jul 30 19:40:27.468330 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:27.468302 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6d96b57fcb-m4jlr"] Jul 30 19:40:27.487051 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:27.487024 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h8t6w\" (UniqueName: \"kubernetes.io/projected/aaba8039-78c5-46b2-963b-3b2758321e35-kube-api-access-h8t6w\") pod \"cluster-proxy-proxy-agent-6d5c54d84-fq7q8\" (UID: \"aaba8039-78c5-46b2-963b-3b2758321e35\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d5c54d84-fq7q8" Jul 30 19:40:27.487202 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:27.487057 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/58567ceb-d5db-4799-86d9-b3574bf10933-klusterlet-config\") pod \"klusterlet-addon-workmgr-6b94698dd4-894mq\" (UID: \"58567ceb-d5db-4799-86d9-b3574bf10933\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b94698dd4-894mq" Jul 30 19:40:27.487202 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:27.487077 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdf2h\" (UniqueName: \"kubernetes.io/projected/58567ceb-d5db-4799-86d9-b3574bf10933-kube-api-access-xdf2h\") pod \"klusterlet-addon-workmgr-6b94698dd4-894mq\" (UID: \"58567ceb-d5db-4799-86d9-b3574bf10933\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b94698dd4-894mq" Jul 30 19:40:27.487202 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:27.487098 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/aaba8039-78c5-46b2-963b-3b2758321e35-hub\") pod \"cluster-proxy-proxy-agent-6d5c54d84-fq7q8\" (UID: \"aaba8039-78c5-46b2-963b-3b2758321e35\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d5c54d84-fq7q8" Jul 30 19:40:27.487202 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:27.487180 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/aaba8039-78c5-46b2-963b-3b2758321e35-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6d5c54d84-fq7q8\" (UID: \"aaba8039-78c5-46b2-963b-3b2758321e35\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d5c54d84-fq7q8" Jul 30 19:40:27.487447 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:27.487218 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/aaba8039-78c5-46b2-963b-3b2758321e35-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6d5c54d84-fq7q8\" (UID: \"aaba8039-78c5-46b2-963b-3b2758321e35\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d5c54d84-fq7q8" Jul 30 19:40:27.487447 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:27.487248 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9fmh\" (UniqueName: \"kubernetes.io/projected/0f916132-44f7-4d55-ac1f-26c7950de3b9-kube-api-access-p9fmh\") pod \"managed-serviceaccount-addon-agent-77ccb4f94b-2c7z2\" (UID: \"0f916132-44f7-4d55-ac1f-26c7950de3b9\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77ccb4f94b-2c7z2" Jul 30 19:40:27.487447 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:27.487318 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/58567ceb-d5db-4799-86d9-b3574bf10933-tmp\") pod \"klusterlet-addon-workmgr-6b94698dd4-894mq\" (UID: \"58567ceb-d5db-4799-86d9-b3574bf10933\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b94698dd4-894mq" Jul 30 19:40:27.487447 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:27.487354 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/aaba8039-78c5-46b2-963b-3b2758321e35-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6d5c54d84-fq7q8\" (UID: \"aaba8039-78c5-46b2-963b-3b2758321e35\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d5c54d84-fq7q8" Jul 30 19:40:27.487447 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:27.487389 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0f916132-44f7-4d55-ac1f-26c7950de3b9-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-77ccb4f94b-2c7z2\" (UID: \"0f916132-44f7-4d55-ac1f-26c7950de3b9\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77ccb4f94b-2c7z2" Jul 30 19:40:27.487447 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:27.487435 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/aaba8039-78c5-46b2-963b-3b2758321e35-ca\") pod \"cluster-proxy-proxy-agent-6d5c54d84-fq7q8\" (UID: \"aaba8039-78c5-46b2-963b-3b2758321e35\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d5c54d84-fq7q8" Jul 30 19:40:27.564959 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:27.564924 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-m5znh" Jul 30 19:40:27.588318 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:27.588269 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5a8ed3c7-72b5-41e0-98d3-de4484d1479c-installation-pull-secrets\") pod \"image-registry-6d96b57fcb-m4jlr\" (UID: \"5a8ed3c7-72b5-41e0-98d3-de4484d1479c\") " pod="openshift-image-registry/image-registry-6d96b57fcb-m4jlr" Jul 30 19:40:27.588499 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:27.588341 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/aaba8039-78c5-46b2-963b-3b2758321e35-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6d5c54d84-fq7q8\" (UID: \"aaba8039-78c5-46b2-963b-3b2758321e35\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d5c54d84-fq7q8" Jul 30 19:40:27.588499 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:27.588369 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5a8ed3c7-72b5-41e0-98d3-de4484d1479c-image-registry-private-configuration\") pod \"image-registry-6d96b57fcb-m4jlr\" (UID: \"5a8ed3c7-72b5-41e0-98d3-de4484d1479c\") " pod="openshift-image-registry/image-registry-6d96b57fcb-m4jlr" Jul 30 19:40:27.588499 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:27.588396 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5a8ed3c7-72b5-41e0-98d3-de4484d1479c-trusted-ca\") pod \"image-registry-6d96b57fcb-m4jlr\" (UID: \"5a8ed3c7-72b5-41e0-98d3-de4484d1479c\") " pod="openshift-image-registry/image-registry-6d96b57fcb-m4jlr" Jul 30 19:40:27.588499 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:27.588454 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0f916132-44f7-4d55-ac1f-26c7950de3b9-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-77ccb4f94b-2c7z2\" (UID: \"0f916132-44f7-4d55-ac1f-26c7950de3b9\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77ccb4f94b-2c7z2" Jul 30 19:40:27.588723 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:27.588500 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5a8ed3c7-72b5-41e0-98d3-de4484d1479c-ca-trust-extracted\") pod \"image-registry-6d96b57fcb-m4jlr\" (UID: \"5a8ed3c7-72b5-41e0-98d3-de4484d1479c\") " pod="openshift-image-registry/image-registry-6d96b57fcb-m4jlr" Jul 30 19:40:27.588723 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:27.588536 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5a8ed3c7-72b5-41e0-98d3-de4484d1479c-registry-certificates\") pod \"image-registry-6d96b57fcb-m4jlr\" (UID: \"5a8ed3c7-72b5-41e0-98d3-de4484d1479c\") " pod="openshift-image-registry/image-registry-6d96b57fcb-m4jlr" Jul 30 19:40:27.588723 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:27.588571 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/aaba8039-78c5-46b2-963b-3b2758321e35-ca\") pod \"cluster-proxy-proxy-agent-6d5c54d84-fq7q8\" (UID: \"aaba8039-78c5-46b2-963b-3b2758321e35\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d5c54d84-fq7q8" Jul 30 19:40:27.588723 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:27.588600 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h8t6w\" (UniqueName: \"kubernetes.io/projected/aaba8039-78c5-46b2-963b-3b2758321e35-kube-api-access-h8t6w\") pod \"cluster-proxy-proxy-agent-6d5c54d84-fq7q8\" (UID: \"aaba8039-78c5-46b2-963b-3b2758321e35\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d5c54d84-fq7q8" Jul 30 19:40:27.588723 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:27.588642 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/58567ceb-d5db-4799-86d9-b3574bf10933-klusterlet-config\") pod \"klusterlet-addon-workmgr-6b94698dd4-894mq\" (UID: \"58567ceb-d5db-4799-86d9-b3574bf10933\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b94698dd4-894mq" Jul 30 19:40:27.588723 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:27.588688 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdf2h\" (UniqueName: \"kubernetes.io/projected/58567ceb-d5db-4799-86d9-b3574bf10933-kube-api-access-xdf2h\") pod \"klusterlet-addon-workmgr-6b94698dd4-894mq\" (UID: \"58567ceb-d5db-4799-86d9-b3574bf10933\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b94698dd4-894mq" Jul 30 19:40:27.589032 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:27.588725 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/aaba8039-78c5-46b2-963b-3b2758321e35-hub\") pod \"cluster-proxy-proxy-agent-6d5c54d84-fq7q8\" (UID: \"aaba8039-78c5-46b2-963b-3b2758321e35\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d5c54d84-fq7q8" Jul 30 19:40:27.589032 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:27.588755 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rrw28\" (UniqueName: \"kubernetes.io/projected/5a8ed3c7-72b5-41e0-98d3-de4484d1479c-kube-api-access-rrw28\") pod \"image-registry-6d96b57fcb-m4jlr\" (UID: \"5a8ed3c7-72b5-41e0-98d3-de4484d1479c\") " pod="openshift-image-registry/image-registry-6d96b57fcb-m4jlr" Jul 30 19:40:27.589032 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:27.588801 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5a8ed3c7-72b5-41e0-98d3-de4484d1479c-registry-tls\") pod \"image-registry-6d96b57fcb-m4jlr\" (UID: \"5a8ed3c7-72b5-41e0-98d3-de4484d1479c\") " pod="openshift-image-registry/image-registry-6d96b57fcb-m4jlr" Jul 30 19:40:27.589032 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:27.588830 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/aaba8039-78c5-46b2-963b-3b2758321e35-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6d5c54d84-fq7q8\" (UID: \"aaba8039-78c5-46b2-963b-3b2758321e35\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d5c54d84-fq7q8" Jul 30 19:40:27.589032 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:27.588857 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/aaba8039-78c5-46b2-963b-3b2758321e35-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6d5c54d84-fq7q8\" (UID: \"aaba8039-78c5-46b2-963b-3b2758321e35\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d5c54d84-fq7q8" Jul 30 19:40:27.589032 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:27.588884 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9fmh\" (UniqueName: \"kubernetes.io/projected/0f916132-44f7-4d55-ac1f-26c7950de3b9-kube-api-access-p9fmh\") pod \"managed-serviceaccount-addon-agent-77ccb4f94b-2c7z2\" (UID: \"0f916132-44f7-4d55-ac1f-26c7950de3b9\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77ccb4f94b-2c7z2" Jul 30 19:40:27.589032 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:27.588912 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5a8ed3c7-72b5-41e0-98d3-de4484d1479c-bound-sa-token\") pod \"image-registry-6d96b57fcb-m4jlr\" (UID: \"5a8ed3c7-72b5-41e0-98d3-de4484d1479c\") " pod="openshift-image-registry/image-registry-6d96b57fcb-m4jlr" Jul 30 19:40:27.589032 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:27.588964 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/58567ceb-d5db-4799-86d9-b3574bf10933-tmp\") pod \"klusterlet-addon-workmgr-6b94698dd4-894mq\" (UID: \"58567ceb-d5db-4799-86d9-b3574bf10933\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b94698dd4-894mq" Jul 30 19:40:27.589477 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:27.589050 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/aaba8039-78c5-46b2-963b-3b2758321e35-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6d5c54d84-fq7q8\" (UID: \"aaba8039-78c5-46b2-963b-3b2758321e35\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d5c54d84-fq7q8" Jul 30 19:40:27.589477 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:27.589387 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/58567ceb-d5db-4799-86d9-b3574bf10933-tmp\") pod \"klusterlet-addon-workmgr-6b94698dd4-894mq\" (UID: \"58567ceb-d5db-4799-86d9-b3574bf10933\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b94698dd4-894mq" Jul 30 19:40:27.592037 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:27.592012 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/aaba8039-78c5-46b2-963b-3b2758321e35-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6d5c54d84-fq7q8\" (UID: \"aaba8039-78c5-46b2-963b-3b2758321e35\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d5c54d84-fq7q8" Jul 30 19:40:27.592179 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:27.592012 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/aaba8039-78c5-46b2-963b-3b2758321e35-ca\") pod \"cluster-proxy-proxy-agent-6d5c54d84-fq7q8\" (UID: \"aaba8039-78c5-46b2-963b-3b2758321e35\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d5c54d84-fq7q8" Jul 30 19:40:27.592179 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:27.592139 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/58567ceb-d5db-4799-86d9-b3574bf10933-klusterlet-config\") pod \"klusterlet-addon-workmgr-6b94698dd4-894mq\" (UID: \"58567ceb-d5db-4799-86d9-b3574bf10933\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b94698dd4-894mq" Jul 30 19:40:27.592311 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:27.592266 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/aaba8039-78c5-46b2-963b-3b2758321e35-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6d5c54d84-fq7q8\" (UID: \"aaba8039-78c5-46b2-963b-3b2758321e35\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d5c54d84-fq7q8" Jul 30 19:40:27.593373 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:27.593339 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/aaba8039-78c5-46b2-963b-3b2758321e35-hub\") pod \"cluster-proxy-proxy-agent-6d5c54d84-fq7q8\" (UID: \"aaba8039-78c5-46b2-963b-3b2758321e35\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d5c54d84-fq7q8" Jul 30 19:40:27.593489 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:27.593469 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0f916132-44f7-4d55-ac1f-26c7950de3b9-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-77ccb4f94b-2c7z2\" (UID: \"0f916132-44f7-4d55-ac1f-26c7950de3b9\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77ccb4f94b-2c7z2" Jul 30 19:40:27.598145 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:27.598059 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h8t6w\" (UniqueName: \"kubernetes.io/projected/aaba8039-78c5-46b2-963b-3b2758321e35-kube-api-access-h8t6w\") pod \"cluster-proxy-proxy-agent-6d5c54d84-fq7q8\" (UID: \"aaba8039-78c5-46b2-963b-3b2758321e35\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d5c54d84-fq7q8" Jul 30 19:40:27.598352 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:27.598325 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9fmh\" (UniqueName: \"kubernetes.io/projected/0f916132-44f7-4d55-ac1f-26c7950de3b9-kube-api-access-p9fmh\") pod \"managed-serviceaccount-addon-agent-77ccb4f94b-2c7z2\" (UID: \"0f916132-44f7-4d55-ac1f-26c7950de3b9\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77ccb4f94b-2c7z2" Jul 30 19:40:27.598732 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:27.598674 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdf2h\" (UniqueName: \"kubernetes.io/projected/58567ceb-d5db-4799-86d9-b3574bf10933-kube-api-access-xdf2h\") pod \"klusterlet-addon-workmgr-6b94698dd4-894mq\" (UID: \"58567ceb-d5db-4799-86d9-b3574bf10933\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b94698dd4-894mq" Jul 30 19:40:27.666264 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:27.666229 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77ccb4f94b-2c7z2" Jul 30 19:40:27.672783 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:27.672753 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b94698dd4-894mq" Jul 30 19:40:27.678251 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:27.678222 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d5c54d84-fq7q8" Jul 30 19:40:27.690090 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:27.690045 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5a8ed3c7-72b5-41e0-98d3-de4484d1479c-bound-sa-token\") pod \"image-registry-6d96b57fcb-m4jlr\" (UID: \"5a8ed3c7-72b5-41e0-98d3-de4484d1479c\") " pod="openshift-image-registry/image-registry-6d96b57fcb-m4jlr" Jul 30 19:40:27.691089 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:27.690353 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5a8ed3c7-72b5-41e0-98d3-de4484d1479c-installation-pull-secrets\") pod \"image-registry-6d96b57fcb-m4jlr\" (UID: \"5a8ed3c7-72b5-41e0-98d3-de4484d1479c\") " pod="openshift-image-registry/image-registry-6d96b57fcb-m4jlr" Jul 30 19:40:27.691089 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:27.690407 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5a8ed3c7-72b5-41e0-98d3-de4484d1479c-image-registry-private-configuration\") pod \"image-registry-6d96b57fcb-m4jlr\" (UID: \"5a8ed3c7-72b5-41e0-98d3-de4484d1479c\") " pod="openshift-image-registry/image-registry-6d96b57fcb-m4jlr" Jul 30 19:40:27.691089 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:27.690433 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5a8ed3c7-72b5-41e0-98d3-de4484d1479c-trusted-ca\") pod \"image-registry-6d96b57fcb-m4jlr\" (UID: \"5a8ed3c7-72b5-41e0-98d3-de4484d1479c\") " pod="openshift-image-registry/image-registry-6d96b57fcb-m4jlr" Jul 30 19:40:27.691089 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:27.690470 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5a8ed3c7-72b5-41e0-98d3-de4484d1479c-ca-trust-extracted\") pod \"image-registry-6d96b57fcb-m4jlr\" (UID: \"5a8ed3c7-72b5-41e0-98d3-de4484d1479c\") " pod="openshift-image-registry/image-registry-6d96b57fcb-m4jlr" Jul 30 19:40:27.691089 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:27.690506 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5a8ed3c7-72b5-41e0-98d3-de4484d1479c-registry-certificates\") pod \"image-registry-6d96b57fcb-m4jlr\" (UID: \"5a8ed3c7-72b5-41e0-98d3-de4484d1479c\") " pod="openshift-image-registry/image-registry-6d96b57fcb-m4jlr" Jul 30 19:40:27.691089 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:27.690586 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rrw28\" (UniqueName: \"kubernetes.io/projected/5a8ed3c7-72b5-41e0-98d3-de4484d1479c-kube-api-access-rrw28\") pod \"image-registry-6d96b57fcb-m4jlr\" (UID: \"5a8ed3c7-72b5-41e0-98d3-de4484d1479c\") " pod="openshift-image-registry/image-registry-6d96b57fcb-m4jlr" Jul 30 19:40:27.691089 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:27.690641 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5a8ed3c7-72b5-41e0-98d3-de4484d1479c-registry-tls\") pod \"image-registry-6d96b57fcb-m4jlr\" (UID: \"5a8ed3c7-72b5-41e0-98d3-de4484d1479c\") " pod="openshift-image-registry/image-registry-6d96b57fcb-m4jlr" Jul 30 19:40:27.691804 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:27.691735 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5a8ed3c7-72b5-41e0-98d3-de4484d1479c-ca-trust-extracted\") pod \"image-registry-6d96b57fcb-m4jlr\" (UID: \"5a8ed3c7-72b5-41e0-98d3-de4484d1479c\") " pod="openshift-image-registry/image-registry-6d96b57fcb-m4jlr" Jul 30 19:40:27.691905 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:27.691814 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5a8ed3c7-72b5-41e0-98d3-de4484d1479c-trusted-ca\") pod \"image-registry-6d96b57fcb-m4jlr\" (UID: \"5a8ed3c7-72b5-41e0-98d3-de4484d1479c\") " pod="openshift-image-registry/image-registry-6d96b57fcb-m4jlr" Jul 30 19:40:27.692308 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:27.692228 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5a8ed3c7-72b5-41e0-98d3-de4484d1479c-registry-certificates\") pod \"image-registry-6d96b57fcb-m4jlr\" (UID: \"5a8ed3c7-72b5-41e0-98d3-de4484d1479c\") " pod="openshift-image-registry/image-registry-6d96b57fcb-m4jlr" Jul 30 19:40:27.694345 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:27.694321 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5a8ed3c7-72b5-41e0-98d3-de4484d1479c-image-registry-private-configuration\") pod \"image-registry-6d96b57fcb-m4jlr\" (UID: \"5a8ed3c7-72b5-41e0-98d3-de4484d1479c\") " pod="openshift-image-registry/image-registry-6d96b57fcb-m4jlr" Jul 30 19:40:27.694466 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:27.694407 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5a8ed3c7-72b5-41e0-98d3-de4484d1479c-installation-pull-secrets\") pod \"image-registry-6d96b57fcb-m4jlr\" (UID: \"5a8ed3c7-72b5-41e0-98d3-de4484d1479c\") " pod="openshift-image-registry/image-registry-6d96b57fcb-m4jlr" Jul 30 19:40:27.694898 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:27.694873 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5a8ed3c7-72b5-41e0-98d3-de4484d1479c-registry-tls\") pod \"image-registry-6d96b57fcb-m4jlr\" (UID: \"5a8ed3c7-72b5-41e0-98d3-de4484d1479c\") " pod="openshift-image-registry/image-registry-6d96b57fcb-m4jlr" Jul 30 19:40:27.701362 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:27.701318 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rrw28\" (UniqueName: \"kubernetes.io/projected/5a8ed3c7-72b5-41e0-98d3-de4484d1479c-kube-api-access-rrw28\") pod \"image-registry-6d96b57fcb-m4jlr\" (UID: \"5a8ed3c7-72b5-41e0-98d3-de4484d1479c\") " pod="openshift-image-registry/image-registry-6d96b57fcb-m4jlr" Jul 30 19:40:27.701577 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:27.701556 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5a8ed3c7-72b5-41e0-98d3-de4484d1479c-bound-sa-token\") pod \"image-registry-6d96b57fcb-m4jlr\" (UID: \"5a8ed3c7-72b5-41e0-98d3-de4484d1479c\") " pod="openshift-image-registry/image-registry-6d96b57fcb-m4jlr" Jul 30 19:40:27.772704 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:27.772668 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6d96b57fcb-m4jlr" Jul 30 19:40:27.818254 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:27.818181 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77ccb4f94b-2c7z2"] Jul 30 19:40:27.822430 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:40:27.822393 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0f916132_44f7_4d55_ac1f_26c7950de3b9.slice/crio-38d34f3018c11f1fe56c5ff7d129af6900d14aeb8bc1f39f40f37ad1871c9138 WatchSource:0}: Error finding container 38d34f3018c11f1fe56c5ff7d129af6900d14aeb8bc1f39f40f37ad1871c9138: Status 404 returned error can't find the container with id 38d34f3018c11f1fe56c5ff7d129af6900d14aeb8bc1f39f40f37ad1871c9138 Jul 30 19:40:27.910385 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:27.910303 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6d96b57fcb-m4jlr"] Jul 30 19:40:27.912834 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:40:27.912808 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a8ed3c7_72b5_41e0_98d3_de4484d1479c.slice/crio-07f4ee3c8426fe0a18b2df96c254a76a9ac28d21a378d7f0c9a995603bfd3f8c WatchSource:0}: Error finding container 07f4ee3c8426fe0a18b2df96c254a76a9ac28d21a378d7f0c9a995603bfd3f8c: Status 404 returned error can't find the container with id 07f4ee3c8426fe0a18b2df96c254a76a9ac28d21a378d7f0c9a995603bfd3f8c Jul 30 19:40:28.043590 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:28.043567 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b94698dd4-894mq"] Jul 30 19:40:28.046488 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:28.046458 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d5c54d84-fq7q8"] Jul 30 19:40:28.046756 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:40:28.046731 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58567ceb_d5db_4799_86d9_b3574bf10933.slice/crio-b7a0b907146971219e431209c7cc7b492a88cd219b93379dfdc4ff0af2071865 WatchSource:0}: Error finding container b7a0b907146971219e431209c7cc7b492a88cd219b93379dfdc4ff0af2071865: Status 404 returned error can't find the container with id b7a0b907146971219e431209c7cc7b492a88cd219b93379dfdc4ff0af2071865 Jul 30 19:40:28.050098 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:40:28.050047 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaaba8039_78c5_46b2_963b_3b2758321e35.slice/crio-1e2323d76b97bc363a038da97bfa4cc63cd38596299440ebf4a518188044b4fc WatchSource:0}: Error finding container 1e2323d76b97bc363a038da97bfa4cc63cd38596299440ebf4a518188044b4fc: Status 404 returned error can't find the container with id 1e2323d76b97bc363a038da97bfa4cc63cd38596299440ebf4a518188044b4fc Jul 30 19:40:28.606692 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:28.606654 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77ccb4f94b-2c7z2" event={"ID":"0f916132-44f7-4d55-ac1f-26c7950de3b9","Type":"ContainerStarted","Data":"38d34f3018c11f1fe56c5ff7d129af6900d14aeb8bc1f39f40f37ad1871c9138"} Jul 30 19:40:28.607812 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:28.607785 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d5c54d84-fq7q8" event={"ID":"aaba8039-78c5-46b2-963b-3b2758321e35","Type":"ContainerStarted","Data":"1e2323d76b97bc363a038da97bfa4cc63cd38596299440ebf4a518188044b4fc"} Jul 30 19:40:28.609178 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:28.609145 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6d96b57fcb-m4jlr" event={"ID":"5a8ed3c7-72b5-41e0-98d3-de4484d1479c","Type":"ContainerStarted","Data":"0a607a3cf56c11a7a6a90fc5bcd89a7b6b4a85c3faca7f667e81f74bf4b23950"} Jul 30 19:40:28.609257 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:28.609194 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6d96b57fcb-m4jlr" event={"ID":"5a8ed3c7-72b5-41e0-98d3-de4484d1479c","Type":"ContainerStarted","Data":"07f4ee3c8426fe0a18b2df96c254a76a9ac28d21a378d7f0c9a995603bfd3f8c"} Jul 30 19:40:28.609257 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:28.609228 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6d96b57fcb-m4jlr" Jul 30 19:40:28.610253 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:28.610229 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b94698dd4-894mq" event={"ID":"58567ceb-d5db-4799-86d9-b3574bf10933","Type":"ContainerStarted","Data":"b7a0b907146971219e431209c7cc7b492a88cd219b93379dfdc4ff0af2071865"} Jul 30 19:40:28.629145 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:28.629096 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6d96b57fcb-m4jlr" podStartSLOduration=1.629080826 podStartE2EDuration="1.629080826s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 19:40:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 19:40:28.627746004 +0000 UTC m=+62.778825554" watchObservedRunningTime="2026-07-30 19:40:28.629080826 +0000 UTC m=+62.780160353" Jul 30 19:40:32.029508 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:32.029462 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a1ca9892-7f18-4426-80c4-3e9c14681dab-metrics-certs\") pod \"network-metrics-daemon-sx4k5\" (UID: \"a1ca9892-7f18-4426-80c4-3e9c14681dab\") " pod="openshift-multus/network-metrics-daemon-sx4k5" Jul 30 19:40:32.032137 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:32.032110 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 30 19:40:32.042331 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:32.042303 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a1ca9892-7f18-4426-80c4-3e9c14681dab-metrics-certs\") pod \"network-metrics-daemon-sx4k5\" (UID: \"a1ca9892-7f18-4426-80c4-3e9c14681dab\") " pod="openshift-multus/network-metrics-daemon-sx4k5" Jul 30 19:40:32.124897 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:32.124865 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-p96kd\"" Jul 30 19:40:32.133124 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:32.133099 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sx4k5" Jul 30 19:40:32.231037 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:32.230998 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-45lmh\" (UniqueName: \"kubernetes.io/projected/58525c90-52a2-441e-8ebc-6d165487e982-kube-api-access-45lmh\") pod \"network-check-target-k2nrq\" (UID: \"58525c90-52a2-441e-8ebc-6d165487e982\") " pod="openshift-network-diagnostics/network-check-target-k2nrq" Jul 30 19:40:32.233520 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:32.233500 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 30 19:40:32.243689 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:32.243670 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 30 19:40:32.254371 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:32.254338 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-45lmh\" (UniqueName: \"kubernetes.io/projected/58525c90-52a2-441e-8ebc-6d165487e982-kube-api-access-45lmh\") pod \"network-check-target-k2nrq\" (UID: \"58525c90-52a2-441e-8ebc-6d165487e982\") " pod="openshift-network-diagnostics/network-check-target-k2nrq" Jul 30 19:40:32.429323 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:32.429232 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-chvmd\"" Jul 30 19:40:32.437288 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:32.437256 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k2nrq" Jul 30 19:40:34.644543 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:34.644418 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b94698dd4-894mq" event={"ID":"58567ceb-d5db-4799-86d9-b3574bf10933","Type":"ContainerStarted","Data":"6211c914febf6726e9651f83f744bcac866555dbe0a7a4cbeaa79b164b06d168"} Jul 30 19:40:34.646305 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:34.646239 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b94698dd4-894mq" Jul 30 19:40:34.649102 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:34.649056 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77ccb4f94b-2c7z2" event={"ID":"0f916132-44f7-4d55-ac1f-26c7950de3b9","Type":"ContainerStarted","Data":"8ad293b59d00e126e8c7bbdcc3430f3f5d27ec161b7eb5619d4a1c082e102974"} Jul 30 19:40:34.649768 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:34.649708 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b94698dd4-894mq" Jul 30 19:40:34.651464 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:34.651325 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d5c54d84-fq7q8" event={"ID":"aaba8039-78c5-46b2-963b-3b2758321e35","Type":"ContainerStarted","Data":"de78b63292fc9f8ffa9ab960ff470b5c237f6b5ac35426524a55c10496428569"} Jul 30 19:40:34.661179 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:34.661121 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b94698dd4-894mq" podStartSLOduration=1.181245878 podStartE2EDuration="7.661101751s" totalImagesPullingTime="6.479855873s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 19:40:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 19:40:34.660124455 +0000 UTC m=+68.811204007" watchObservedRunningTime="2026-07-30 19:40:34.661101751 +0000 UTC m=+68.812181300" Jul 30 19:40:34.672316 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:34.672285 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-sx4k5"] Jul 30 19:40:34.674634 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:34.674591 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77ccb4f94b-2c7z2" podStartSLOduration=0.976367508 podStartE2EDuration="7.67457697s" totalImagesPullingTime="6.698209462s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 19:40:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 19:40:34.673778844 +0000 UTC m=+68.824858396" watchObservedRunningTime="2026-07-30 19:40:34.67457697 +0000 UTC m=+68.825656520" Jul 30 19:40:34.679490 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:40:34.679451 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1ca9892_7f18_4426_80c4_3e9c14681dab.slice/crio-0bb7ef13dfaffaab27074993269b61ba280fa05acced631a8ba5a7d9734efff4 WatchSource:0}: Error finding container 0bb7ef13dfaffaab27074993269b61ba280fa05acced631a8ba5a7d9734efff4: Status 404 returned error can't find the container with id 0bb7ef13dfaffaab27074993269b61ba280fa05acced631a8ba5a7d9734efff4 Jul 30 19:40:34.686190 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:34.686140 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-k2nrq"] Jul 30 19:40:34.691361 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:40:34.691333 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58525c90_52a2_441e_8ebc_6d165487e982.slice/crio-3ab9d55055beefc92552e01d570ca5e42ee61092dc97afa45eb6ff9d2a1c3fc3 WatchSource:0}: Error finding container 3ab9d55055beefc92552e01d570ca5e42ee61092dc97afa45eb6ff9d2a1c3fc3: Status 404 returned error can't find the container with id 3ab9d55055beefc92552e01d570ca5e42ee61092dc97afa45eb6ff9d2a1c3fc3 Jul 30 19:40:35.657775 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:35.657688 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d5c54d84-fq7q8" event={"ID":"aaba8039-78c5-46b2-963b-3b2758321e35","Type":"ContainerStarted","Data":"0d7b9fd797624f09d435c2e084e4e1a6397e32eefb04d37317cc2274db398720"} Jul 30 19:40:35.657775 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:35.657743 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d5c54d84-fq7q8" event={"ID":"aaba8039-78c5-46b2-963b-3b2758321e35","Type":"ContainerStarted","Data":"91a86a5dfbb00456b5ef419da5fa58e81dcffa921560f02928eae299c5a43458"} Jul 30 19:40:35.659292 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:35.659244 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-k2nrq" event={"ID":"58525c90-52a2-441e-8ebc-6d165487e982","Type":"ContainerStarted","Data":"3ab9d55055beefc92552e01d570ca5e42ee61092dc97afa45eb6ff9d2a1c3fc3"} Jul 30 19:40:35.660770 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:35.660703 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-sx4k5" event={"ID":"a1ca9892-7f18-4426-80c4-3e9c14681dab","Type":"ContainerStarted","Data":"0bb7ef13dfaffaab27074993269b61ba280fa05acced631a8ba5a7d9734efff4"} Jul 30 19:40:35.676689 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:35.676639 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d5c54d84-fq7q8" podStartSLOduration=2.214444896 podStartE2EDuration="8.676620623s" totalImagesPullingTime="6.462175727s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 19:40:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 19:40:35.674203287 +0000 UTC m=+69.825282838" watchObservedRunningTime="2026-07-30 19:40:35.676620623 +0000 UTC m=+69.827700179" Jul 30 19:40:36.666371 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:36.666330 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-sx4k5" event={"ID":"a1ca9892-7f18-4426-80c4-3e9c14681dab","Type":"ContainerStarted","Data":"e89eb6ae7e84224d70fdcdd8d2dfd113cdc9ef45504ba8f1b5d5dc0700dad172"} Jul 30 19:40:36.666749 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:36.666396 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-sx4k5" event={"ID":"a1ca9892-7f18-4426-80c4-3e9c14681dab","Type":"ContainerStarted","Data":"cb3924fe0d987cf2ec7abf64a41fd64622f19c228cca344540bfd28eac8e355d"} Jul 30 19:40:36.684774 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:36.684727 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-sx4k5" podStartSLOduration=69.531556314 podStartE2EDuration="1m10.684710096s" totalImagesPullingTime="1.153153782s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 19:39:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 19:40:36.682850215 +0000 UTC m=+70.833929766" watchObservedRunningTime="2026-07-30 19:40:36.684710096 +0000 UTC m=+70.835789645" Jul 30 19:40:37.362240 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:37.362208 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5c7469cffd-x8fmw" Jul 30 19:40:38.676439 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:38.676395 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-k2nrq" event={"ID":"58525c90-52a2-441e-8ebc-6d165487e982","Type":"ContainerStarted","Data":"71fd13cea3466921f60b32d3eb71a316d8aa77bab162be351883327fcd6795f1"} Jul 30 19:40:38.676834 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:38.676501 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-k2nrq" Jul 30 19:40:38.691495 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:38.691445 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-k2nrq" podStartSLOduration=69.387141431 podStartE2EDuration="1m12.691429469s" totalImagesPullingTime="3.304288038s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 19:39:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 19:40:38.690200043 +0000 UTC m=+72.841279594" watchObservedRunningTime="2026-07-30 19:40:38.691429469 +0000 UTC m=+72.842509018" Jul 30 19:40:39.863630 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:39.863596 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-wxr9x"] Jul 30 19:40:39.892053 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:39.892019 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-wxr9x" Jul 30 19:40:39.894848 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:39.894822 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 30 19:40:39.894999 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:39.894924 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-hgzkn\"" Jul 30 19:40:39.895099 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:39.895084 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 30 19:40:39.896102 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:39.896081 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 30 19:40:39.896476 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:39.896450 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 30 19:40:39.896890 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:39.896675 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 30 19:40:39.896890 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:39.896786 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 30 19:40:39.998181 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:39.998139 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5066da59-90f5-42b5-b27f-2deba547ad72-metrics-client-ca\") pod \"node-exporter-wxr9x\" (UID: \"5066da59-90f5-42b5-b27f-2deba547ad72\") " pod="openshift-monitoring/node-exporter-wxr9x" Jul 30 19:40:39.998367 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:39.998203 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5066da59-90f5-42b5-b27f-2deba547ad72-root\") pod \"node-exporter-wxr9x\" (UID: \"5066da59-90f5-42b5-b27f-2deba547ad72\") " pod="openshift-monitoring/node-exporter-wxr9x" Jul 30 19:40:39.998367 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:39.998231 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dd6w5\" (UniqueName: \"kubernetes.io/projected/5066da59-90f5-42b5-b27f-2deba547ad72-kube-api-access-dd6w5\") pod \"node-exporter-wxr9x\" (UID: \"5066da59-90f5-42b5-b27f-2deba547ad72\") " pod="openshift-monitoring/node-exporter-wxr9x" Jul 30 19:40:39.998367 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:39.998260 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5066da59-90f5-42b5-b27f-2deba547ad72-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wxr9x\" (UID: \"5066da59-90f5-42b5-b27f-2deba547ad72\") " pod="openshift-monitoring/node-exporter-wxr9x" Jul 30 19:40:39.998367 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:39.998309 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5066da59-90f5-42b5-b27f-2deba547ad72-node-exporter-accelerators-collector-config\") pod \"node-exporter-wxr9x\" (UID: \"5066da59-90f5-42b5-b27f-2deba547ad72\") " pod="openshift-monitoring/node-exporter-wxr9x" Jul 30 19:40:39.998570 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:39.998388 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5066da59-90f5-42b5-b27f-2deba547ad72-node-exporter-wtmp\") pod \"node-exporter-wxr9x\" (UID: \"5066da59-90f5-42b5-b27f-2deba547ad72\") " pod="openshift-monitoring/node-exporter-wxr9x" Jul 30 19:40:39.998570 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:39.998437 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5066da59-90f5-42b5-b27f-2deba547ad72-node-exporter-textfile\") pod \"node-exporter-wxr9x\" (UID: \"5066da59-90f5-42b5-b27f-2deba547ad72\") " pod="openshift-monitoring/node-exporter-wxr9x" Jul 30 19:40:39.998570 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:39.998473 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5066da59-90f5-42b5-b27f-2deba547ad72-sys\") pod \"node-exporter-wxr9x\" (UID: \"5066da59-90f5-42b5-b27f-2deba547ad72\") " pod="openshift-monitoring/node-exporter-wxr9x" Jul 30 19:40:39.998570 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:39.998507 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5066da59-90f5-42b5-b27f-2deba547ad72-node-exporter-tls\") pod \"node-exporter-wxr9x\" (UID: \"5066da59-90f5-42b5-b27f-2deba547ad72\") " pod="openshift-monitoring/node-exporter-wxr9x" Jul 30 19:40:40.099137 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:40.099103 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5066da59-90f5-42b5-b27f-2deba547ad72-sys\") pod \"node-exporter-wxr9x\" (UID: \"5066da59-90f5-42b5-b27f-2deba547ad72\") " pod="openshift-monitoring/node-exporter-wxr9x" Jul 30 19:40:40.099403 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:40.099154 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5066da59-90f5-42b5-b27f-2deba547ad72-node-exporter-tls\") pod \"node-exporter-wxr9x\" (UID: \"5066da59-90f5-42b5-b27f-2deba547ad72\") " pod="openshift-monitoring/node-exporter-wxr9x" Jul 30 19:40:40.099403 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:40.099193 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5066da59-90f5-42b5-b27f-2deba547ad72-metrics-client-ca\") pod \"node-exporter-wxr9x\" (UID: \"5066da59-90f5-42b5-b27f-2deba547ad72\") " pod="openshift-monitoring/node-exporter-wxr9x" Jul 30 19:40:40.099403 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:40.099217 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5066da59-90f5-42b5-b27f-2deba547ad72-sys\") pod \"node-exporter-wxr9x\" (UID: \"5066da59-90f5-42b5-b27f-2deba547ad72\") " pod="openshift-monitoring/node-exporter-wxr9x" Jul 30 19:40:40.099403 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:40.099233 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5066da59-90f5-42b5-b27f-2deba547ad72-root\") pod \"node-exporter-wxr9x\" (UID: \"5066da59-90f5-42b5-b27f-2deba547ad72\") " pod="openshift-monitoring/node-exporter-wxr9x" Jul 30 19:40:40.099403 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:40.099258 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dd6w5\" (UniqueName: \"kubernetes.io/projected/5066da59-90f5-42b5-b27f-2deba547ad72-kube-api-access-dd6w5\") pod \"node-exporter-wxr9x\" (UID: \"5066da59-90f5-42b5-b27f-2deba547ad72\") " pod="openshift-monitoring/node-exporter-wxr9x" Jul 30 19:40:40.099403 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:40.099297 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5066da59-90f5-42b5-b27f-2deba547ad72-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wxr9x\" (UID: \"5066da59-90f5-42b5-b27f-2deba547ad72\") " pod="openshift-monitoring/node-exporter-wxr9x" Jul 30 19:40:40.099403 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:40.099316 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5066da59-90f5-42b5-b27f-2deba547ad72-root\") pod \"node-exporter-wxr9x\" (UID: \"5066da59-90f5-42b5-b27f-2deba547ad72\") " pod="openshift-monitoring/node-exporter-wxr9x" Jul 30 19:40:40.099403 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:40.099322 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5066da59-90f5-42b5-b27f-2deba547ad72-node-exporter-accelerators-collector-config\") pod \"node-exporter-wxr9x\" (UID: \"5066da59-90f5-42b5-b27f-2deba547ad72\") " pod="openshift-monitoring/node-exporter-wxr9x" Jul 30 19:40:40.099403 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:40.099385 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5066da59-90f5-42b5-b27f-2deba547ad72-node-exporter-wtmp\") pod \"node-exporter-wxr9x\" (UID: \"5066da59-90f5-42b5-b27f-2deba547ad72\") " pod="openshift-monitoring/node-exporter-wxr9x" Jul 30 19:40:40.099834 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:40.099416 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5066da59-90f5-42b5-b27f-2deba547ad72-node-exporter-textfile\") pod \"node-exporter-wxr9x\" (UID: \"5066da59-90f5-42b5-b27f-2deba547ad72\") " pod="openshift-monitoring/node-exporter-wxr9x" Jul 30 19:40:40.099834 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:40:40.099440 2555 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 30 19:40:40.099834 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:40:40.099509 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5066da59-90f5-42b5-b27f-2deba547ad72-node-exporter-tls podName:5066da59-90f5-42b5-b27f-2deba547ad72 nodeName:}" failed. No retries permitted until 2026-07-30 19:40:40.599488023 +0000 UTC m=+74.750567559 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/5066da59-90f5-42b5-b27f-2deba547ad72-node-exporter-tls") pod "node-exporter-wxr9x" (UID: "5066da59-90f5-42b5-b27f-2deba547ad72") : secret "node-exporter-tls" not found Jul 30 19:40:40.099834 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:40.099732 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5066da59-90f5-42b5-b27f-2deba547ad72-node-exporter-wtmp\") pod \"node-exporter-wxr9x\" (UID: \"5066da59-90f5-42b5-b27f-2deba547ad72\") " pod="openshift-monitoring/node-exporter-wxr9x" Jul 30 19:40:40.099834 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:40.099775 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5066da59-90f5-42b5-b27f-2deba547ad72-node-exporter-textfile\") pod \"node-exporter-wxr9x\" (UID: \"5066da59-90f5-42b5-b27f-2deba547ad72\") " pod="openshift-monitoring/node-exporter-wxr9x" Jul 30 19:40:40.100018 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:40.099907 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5066da59-90f5-42b5-b27f-2deba547ad72-metrics-client-ca\") pod \"node-exporter-wxr9x\" (UID: \"5066da59-90f5-42b5-b27f-2deba547ad72\") " pod="openshift-monitoring/node-exporter-wxr9x" Jul 30 19:40:40.100054 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:40.100020 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5066da59-90f5-42b5-b27f-2deba547ad72-node-exporter-accelerators-collector-config\") pod \"node-exporter-wxr9x\" (UID: \"5066da59-90f5-42b5-b27f-2deba547ad72\") " pod="openshift-monitoring/node-exporter-wxr9x" Jul 30 19:40:40.102030 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:40.102003 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5066da59-90f5-42b5-b27f-2deba547ad72-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wxr9x\" (UID: \"5066da59-90f5-42b5-b27f-2deba547ad72\") " pod="openshift-monitoring/node-exporter-wxr9x" Jul 30 19:40:40.108866 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:40.108845 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dd6w5\" (UniqueName: \"kubernetes.io/projected/5066da59-90f5-42b5-b27f-2deba547ad72-kube-api-access-dd6w5\") pod \"node-exporter-wxr9x\" (UID: \"5066da59-90f5-42b5-b27f-2deba547ad72\") " pod="openshift-monitoring/node-exporter-wxr9x" Jul 30 19:40:40.605337 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:40.605295 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5066da59-90f5-42b5-b27f-2deba547ad72-node-exporter-tls\") pod \"node-exporter-wxr9x\" (UID: \"5066da59-90f5-42b5-b27f-2deba547ad72\") " pod="openshift-monitoring/node-exporter-wxr9x" Jul 30 19:40:40.607668 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:40.607640 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5066da59-90f5-42b5-b27f-2deba547ad72-node-exporter-tls\") pod \"node-exporter-wxr9x\" (UID: \"5066da59-90f5-42b5-b27f-2deba547ad72\") " pod="openshift-monitoring/node-exporter-wxr9x" Jul 30 19:40:40.804517 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:40.804479 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-wxr9x" Jul 30 19:40:40.830541 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:40:40.830508 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5066da59_90f5_42b5_b27f_2deba547ad72.slice/crio-5f3559aca4a6faa43133bc6a56e2d5b2cb86bf18bb28b793d9c0eddbe52e5b56 WatchSource:0}: Error finding container 5f3559aca4a6faa43133bc6a56e2d5b2cb86bf18bb28b793d9c0eddbe52e5b56: Status 404 returned error can't find the container with id 5f3559aca4a6faa43133bc6a56e2d5b2cb86bf18bb28b793d9c0eddbe52e5b56 Jul 30 19:40:41.689227 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:41.689186 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wxr9x" event={"ID":"5066da59-90f5-42b5-b27f-2deba547ad72","Type":"ContainerStarted","Data":"5f3559aca4a6faa43133bc6a56e2d5b2cb86bf18bb28b793d9c0eddbe52e5b56"} Jul 30 19:40:42.694361 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:42.694262 2555 generic.go:356] "Generic (PLEG): container finished" podID="5066da59-90f5-42b5-b27f-2deba547ad72" containerID="e9e7971119dde801c1caf765aa314628e60dd6e216b7bdae8fdfc0ed79b12a1a" exitCode=0 Jul 30 19:40:42.694361 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:42.694323 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wxr9x" event={"ID":"5066da59-90f5-42b5-b27f-2deba547ad72","Type":"ContainerDied","Data":"e9e7971119dde801c1caf765aa314628e60dd6e216b7bdae8fdfc0ed79b12a1a"} Jul 30 19:40:43.699879 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:43.699839 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wxr9x" event={"ID":"5066da59-90f5-42b5-b27f-2deba547ad72","Type":"ContainerStarted","Data":"5432d21530a8294378285f67f283e0eebb2a782ca4e4a9eae0687614a1c204f3"} Jul 30 19:40:43.699879 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:43.699890 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wxr9x" event={"ID":"5066da59-90f5-42b5-b27f-2deba547ad72","Type":"ContainerStarted","Data":"6d3c2209e57d529e9d795e3eb48ec995624ae3de1cefefdf4352eda9cc0d1ef5"} Jul 30 19:40:43.722189 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:43.722137 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-wxr9x" podStartSLOduration=3.244290007 podStartE2EDuration="4.722121401s" totalImagesPullingTime="1.415468508s" totalInitContainerRuntime="62.362886ms" isStatefulPod=true podCreationTimestamp="2026-07-30 19:40:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 19:40:43.720289734 +0000 UTC m=+77.871369275" watchObservedRunningTime="2026-07-30 19:40:43.722121401 +0000 UTC m=+77.873200997" Jul 30 19:40:49.621088 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:49.620974 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6d96b57fcb-m4jlr" Jul 30 19:40:52.375764 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:52.375697 2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5c7469cffd-x8fmw" podUID="b68104df-4001-4583-80f1-700368eb4583" containerName="registry" containerID="cri-o://e9866f700659fd0b3b723b5e73d37dc2450e1242a41892cfb6d849c076aa5fc7" gracePeriod=30 Jul 30 19:40:52.606537 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:52.606514 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5c7469cffd-x8fmw" Jul 30 19:40:52.700032 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:52.699950 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wh49m\" (UniqueName: \"kubernetes.io/projected/b68104df-4001-4583-80f1-700368eb4583-kube-api-access-wh49m\") pod \"b68104df-4001-4583-80f1-700368eb4583\" (UID: \"b68104df-4001-4583-80f1-700368eb4583\") " Jul 30 19:40:52.700032 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:52.699982 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b68104df-4001-4583-80f1-700368eb4583-image-registry-private-configuration\") pod \"b68104df-4001-4583-80f1-700368eb4583\" (UID: \"b68104df-4001-4583-80f1-700368eb4583\") " Jul 30 19:40:52.700032 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:52.700009 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b68104df-4001-4583-80f1-700368eb4583-installation-pull-secrets\") pod \"b68104df-4001-4583-80f1-700368eb4583\" (UID: \"b68104df-4001-4583-80f1-700368eb4583\") " Jul 30 19:40:52.700032 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:52.700026 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b68104df-4001-4583-80f1-700368eb4583-registry-tls\") pod \"b68104df-4001-4583-80f1-700368eb4583\" (UID: \"b68104df-4001-4583-80f1-700368eb4583\") " Jul 30 19:40:52.700376 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:52.700048 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b68104df-4001-4583-80f1-700368eb4583-registry-certificates\") pod \"b68104df-4001-4583-80f1-700368eb4583\" (UID: \"b68104df-4001-4583-80f1-700368eb4583\") " Jul 30 19:40:52.700376 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:52.700115 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b68104df-4001-4583-80f1-700368eb4583-trusted-ca\") pod \"b68104df-4001-4583-80f1-700368eb4583\" (UID: \"b68104df-4001-4583-80f1-700368eb4583\") " Jul 30 19:40:52.700376 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:52.700176 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b68104df-4001-4583-80f1-700368eb4583-bound-sa-token\") pod \"b68104df-4001-4583-80f1-700368eb4583\" (UID: \"b68104df-4001-4583-80f1-700368eb4583\") " Jul 30 19:40:52.700376 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:52.700201 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b68104df-4001-4583-80f1-700368eb4583-ca-trust-extracted\") pod \"b68104df-4001-4583-80f1-700368eb4583\" (UID: \"b68104df-4001-4583-80f1-700368eb4583\") " Jul 30 19:40:52.700582 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:52.700539 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b68104df-4001-4583-80f1-700368eb4583-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "b68104df-4001-4583-80f1-700368eb4583" (UID: "b68104df-4001-4583-80f1-700368eb4583"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 19:40:52.700711 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:52.700677 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b68104df-4001-4583-80f1-700368eb4583-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "b68104df-4001-4583-80f1-700368eb4583" (UID: "b68104df-4001-4583-80f1-700368eb4583"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 19:40:52.702693 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:52.702643 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b68104df-4001-4583-80f1-700368eb4583-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "b68104df-4001-4583-80f1-700368eb4583" (UID: "b68104df-4001-4583-80f1-700368eb4583"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 30 19:40:52.702824 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:52.702715 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b68104df-4001-4583-80f1-700368eb4583-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "b68104df-4001-4583-80f1-700368eb4583" (UID: "b68104df-4001-4583-80f1-700368eb4583"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 19:40:52.703036 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:52.703012 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b68104df-4001-4583-80f1-700368eb4583-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "b68104df-4001-4583-80f1-700368eb4583" (UID: "b68104df-4001-4583-80f1-700368eb4583"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 30 19:40:52.703154 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:52.703069 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b68104df-4001-4583-80f1-700368eb4583-kube-api-access-wh49m" (OuterVolumeSpecName: "kube-api-access-wh49m") pod "b68104df-4001-4583-80f1-700368eb4583" (UID: "b68104df-4001-4583-80f1-700368eb4583"). InnerVolumeSpecName "kube-api-access-wh49m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 19:40:52.703217 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:52.703145 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b68104df-4001-4583-80f1-700368eb4583-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "b68104df-4001-4583-80f1-700368eb4583" (UID: "b68104df-4001-4583-80f1-700368eb4583"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 19:40:52.709556 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:52.709530 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b68104df-4001-4583-80f1-700368eb4583-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "b68104df-4001-4583-80f1-700368eb4583" (UID: "b68104df-4001-4583-80f1-700368eb4583"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 19:40:52.732751 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:52.732721 2555 generic.go:356] "Generic (PLEG): container finished" podID="b68104df-4001-4583-80f1-700368eb4583" containerID="e9866f700659fd0b3b723b5e73d37dc2450e1242a41892cfb6d849c076aa5fc7" exitCode=0 Jul 30 19:40:52.732852 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:52.732758 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5c7469cffd-x8fmw" Jul 30 19:40:52.732852 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:52.732787 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5c7469cffd-x8fmw" event={"ID":"b68104df-4001-4583-80f1-700368eb4583","Type":"ContainerDied","Data":"e9866f700659fd0b3b723b5e73d37dc2450e1242a41892cfb6d849c076aa5fc7"} Jul 30 19:40:52.732852 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:52.732830 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5c7469cffd-x8fmw" event={"ID":"b68104df-4001-4583-80f1-700368eb4583","Type":"ContainerDied","Data":"8fe7f59c042a108b1b17d0b7ef4f1f27dc07ab1bccd14bc80a01d01bc03237c5"} Jul 30 19:40:52.732952 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:52.732852 2555 scope.go:117] "RemoveContainer" containerID="e9866f700659fd0b3b723b5e73d37dc2450e1242a41892cfb6d849c076aa5fc7" Jul 30 19:40:52.740648 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:52.740629 2555 scope.go:117] "RemoveContainer" containerID="e9866f700659fd0b3b723b5e73d37dc2450e1242a41892cfb6d849c076aa5fc7" Jul 30 19:40:52.740904 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:40:52.740887 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e9866f700659fd0b3b723b5e73d37dc2450e1242a41892cfb6d849c076aa5fc7\": container with ID starting with e9866f700659fd0b3b723b5e73d37dc2450e1242a41892cfb6d849c076aa5fc7 not found: ID does not exist" containerID="e9866f700659fd0b3b723b5e73d37dc2450e1242a41892cfb6d849c076aa5fc7" Jul 30 19:40:52.740950 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:52.740910 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e9866f700659fd0b3b723b5e73d37dc2450e1242a41892cfb6d849c076aa5fc7"} err="failed to get container status \"e9866f700659fd0b3b723b5e73d37dc2450e1242a41892cfb6d849c076aa5fc7\": rpc error: code = NotFound desc = could not find container \"e9866f700659fd0b3b723b5e73d37dc2450e1242a41892cfb6d849c076aa5fc7\": container with ID starting with e9866f700659fd0b3b723b5e73d37dc2450e1242a41892cfb6d849c076aa5fc7 not found: ID does not exist" Jul 30 19:40:52.752589 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:52.752566 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5c7469cffd-x8fmw"] Jul 30 19:40:52.756219 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:52.756200 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5c7469cffd-x8fmw"] Jul 30 19:40:52.801401 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:52.801372 2555 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b68104df-4001-4583-80f1-700368eb4583-bound-sa-token\") on node \"ip-10-0-136-46.ec2.internal\" DevicePath \"\"" Jul 30 19:40:52.801401 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:52.801395 2555 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b68104df-4001-4583-80f1-700368eb4583-ca-trust-extracted\") on node \"ip-10-0-136-46.ec2.internal\" DevicePath \"\"" Jul 30 19:40:52.801401 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:52.801404 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wh49m\" (UniqueName: \"kubernetes.io/projected/b68104df-4001-4583-80f1-700368eb4583-kube-api-access-wh49m\") on node \"ip-10-0-136-46.ec2.internal\" DevicePath \"\"" Jul 30 19:40:52.801617 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:52.801415 2555 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b68104df-4001-4583-80f1-700368eb4583-image-registry-private-configuration\") on node \"ip-10-0-136-46.ec2.internal\" DevicePath \"\"" Jul 30 19:40:52.801617 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:52.801424 2555 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b68104df-4001-4583-80f1-700368eb4583-installation-pull-secrets\") on node \"ip-10-0-136-46.ec2.internal\" DevicePath \"\"" Jul 30 19:40:52.801617 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:52.801434 2555 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b68104df-4001-4583-80f1-700368eb4583-registry-tls\") on node \"ip-10-0-136-46.ec2.internal\" DevicePath \"\"" Jul 30 19:40:52.801617 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:52.801442 2555 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b68104df-4001-4583-80f1-700368eb4583-registry-certificates\") on node \"ip-10-0-136-46.ec2.internal\" DevicePath \"\"" Jul 30 19:40:52.801617 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:52.801449 2555 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b68104df-4001-4583-80f1-700368eb4583-trusted-ca\") on node \"ip-10-0-136-46.ec2.internal\" DevicePath \"\"" Jul 30 19:40:54.313825 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:40:54.313791 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b68104df-4001-4583-80f1-700368eb4583" path="/var/lib/kubelet/pods/b68104df-4001-4583-80f1-700368eb4583/volumes" Jul 30 19:41:09.682407 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:41:09.682373 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-k2nrq" Jul 30 19:43:56.965570 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:43:56.965533 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-d686446bf-k6srf"] Jul 30 19:43:56.966068 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:43:56.965763 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b68104df-4001-4583-80f1-700368eb4583" containerName="registry" Jul 30 19:43:56.966068 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:43:56.965773 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="b68104df-4001-4583-80f1-700368eb4583" containerName="registry" Jul 30 19:43:56.966068 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:43:56.965827 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="b68104df-4001-4583-80f1-700368eb4583" containerName="registry" Jul 30 19:43:56.967548 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:43:56.967531 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-d686446bf-k6srf" Jul 30 19:43:56.969925 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:43:56.969904 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 30 19:43:56.970061 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:43:56.969953 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 30 19:43:56.970197 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:43:56.970179 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 30 19:43:56.970267 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:43:56.970194 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-t962t\"" Jul 30 19:43:56.970348 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:43:56.970296 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 30 19:43:56.982778 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:43:56.982755 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-d686446bf-k6srf"] Jul 30 19:43:57.110613 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:43:57.110582 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/22201517-6965-4b54-84be-dcc34513bcc5-manifests\") pod \"opendatahub-operator-controller-manager-d686446bf-k6srf\" (UID: \"22201517-6965-4b54-84be-dcc34513bcc5\") " pod="opendatahub/opendatahub-operator-controller-manager-d686446bf-k6srf" Jul 30 19:43:57.110613 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:43:57.110615 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/22201517-6965-4b54-84be-dcc34513bcc5-tmp\") pod \"opendatahub-operator-controller-manager-d686446bf-k6srf\" (UID: \"22201517-6965-4b54-84be-dcc34513bcc5\") " pod="opendatahub/opendatahub-operator-controller-manager-d686446bf-k6srf" Jul 30 19:43:57.110875 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:43:57.110649 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/22201517-6965-4b54-84be-dcc34513bcc5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-d686446bf-k6srf\" (UID: \"22201517-6965-4b54-84be-dcc34513bcc5\") " pod="opendatahub/opendatahub-operator-controller-manager-d686446bf-k6srf" Jul 30 19:43:57.110875 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:43:57.110704 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/22201517-6965-4b54-84be-dcc34513bcc5-webhook-cert\") pod \"opendatahub-operator-controller-manager-d686446bf-k6srf\" (UID: \"22201517-6965-4b54-84be-dcc34513bcc5\") " pod="opendatahub/opendatahub-operator-controller-manager-d686446bf-k6srf" Jul 30 19:43:57.110875 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:43:57.110810 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8h5p\" (UniqueName: \"kubernetes.io/projected/22201517-6965-4b54-84be-dcc34513bcc5-kube-api-access-n8h5p\") pod \"opendatahub-operator-controller-manager-d686446bf-k6srf\" (UID: \"22201517-6965-4b54-84be-dcc34513bcc5\") " pod="opendatahub/opendatahub-operator-controller-manager-d686446bf-k6srf" Jul 30 19:43:57.211151 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:43:57.211107 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/22201517-6965-4b54-84be-dcc34513bcc5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-d686446bf-k6srf\" (UID: \"22201517-6965-4b54-84be-dcc34513bcc5\") " pod="opendatahub/opendatahub-operator-controller-manager-d686446bf-k6srf" Jul 30 19:43:57.211151 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:43:57.211149 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/22201517-6965-4b54-84be-dcc34513bcc5-webhook-cert\") pod \"opendatahub-operator-controller-manager-d686446bf-k6srf\" (UID: \"22201517-6965-4b54-84be-dcc34513bcc5\") " pod="opendatahub/opendatahub-operator-controller-manager-d686446bf-k6srf" Jul 30 19:43:57.211418 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:43:57.211182 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8h5p\" (UniqueName: \"kubernetes.io/projected/22201517-6965-4b54-84be-dcc34513bcc5-kube-api-access-n8h5p\") pod \"opendatahub-operator-controller-manager-d686446bf-k6srf\" (UID: \"22201517-6965-4b54-84be-dcc34513bcc5\") " pod="opendatahub/opendatahub-operator-controller-manager-d686446bf-k6srf" Jul 30 19:43:57.211418 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:43:57.211224 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/22201517-6965-4b54-84be-dcc34513bcc5-manifests\") pod \"opendatahub-operator-controller-manager-d686446bf-k6srf\" (UID: \"22201517-6965-4b54-84be-dcc34513bcc5\") " pod="opendatahub/opendatahub-operator-controller-manager-d686446bf-k6srf" Jul 30 19:43:57.211418 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:43:57.211247 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/22201517-6965-4b54-84be-dcc34513bcc5-tmp\") pod \"opendatahub-operator-controller-manager-d686446bf-k6srf\" (UID: \"22201517-6965-4b54-84be-dcc34513bcc5\") " pod="opendatahub/opendatahub-operator-controller-manager-d686446bf-k6srf" Jul 30 19:43:57.211732 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:43:57.211707 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/22201517-6965-4b54-84be-dcc34513bcc5-manifests\") pod \"opendatahub-operator-controller-manager-d686446bf-k6srf\" (UID: \"22201517-6965-4b54-84be-dcc34513bcc5\") " pod="opendatahub/opendatahub-operator-controller-manager-d686446bf-k6srf" Jul 30 19:43:57.213480 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:43:57.213458 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/22201517-6965-4b54-84be-dcc34513bcc5-tmp\") pod \"opendatahub-operator-controller-manager-d686446bf-k6srf\" (UID: \"22201517-6965-4b54-84be-dcc34513bcc5\") " pod="opendatahub/opendatahub-operator-controller-manager-d686446bf-k6srf" Jul 30 19:43:57.213691 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:43:57.213672 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/22201517-6965-4b54-84be-dcc34513bcc5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-d686446bf-k6srf\" (UID: \"22201517-6965-4b54-84be-dcc34513bcc5\") " pod="opendatahub/opendatahub-operator-controller-manager-d686446bf-k6srf" Jul 30 19:43:57.213777 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:43:57.213755 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/22201517-6965-4b54-84be-dcc34513bcc5-webhook-cert\") pod \"opendatahub-operator-controller-manager-d686446bf-k6srf\" (UID: \"22201517-6965-4b54-84be-dcc34513bcc5\") " pod="opendatahub/opendatahub-operator-controller-manager-d686446bf-k6srf" Jul 30 19:43:57.220598 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:43:57.220532 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8h5p\" (UniqueName: \"kubernetes.io/projected/22201517-6965-4b54-84be-dcc34513bcc5-kube-api-access-n8h5p\") pod \"opendatahub-operator-controller-manager-d686446bf-k6srf\" (UID: \"22201517-6965-4b54-84be-dcc34513bcc5\") " pod="opendatahub/opendatahub-operator-controller-manager-d686446bf-k6srf" Jul 30 19:43:57.277521 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:43:57.277486 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-d686446bf-k6srf" Jul 30 19:43:57.424079 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:43:57.424054 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-d686446bf-k6srf"] Jul 30 19:43:57.426184 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:43:57.426158 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22201517_6965_4b54_84be_dcc34513bcc5.slice/crio-b45940933286a89e318e98aa2233cb44d51df9b58a8f49e7e00a0360c341ebb4 WatchSource:0}: Error finding container b45940933286a89e318e98aa2233cb44d51df9b58a8f49e7e00a0360c341ebb4: Status 404 returned error can't find the container with id b45940933286a89e318e98aa2233cb44d51df9b58a8f49e7e00a0360c341ebb4 Jul 30 19:43:58.349356 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:43:58.349300 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d686446bf-k6srf" event={"ID":"22201517-6965-4b54-84be-dcc34513bcc5","Type":"ContainerStarted","Data":"b45940933286a89e318e98aa2233cb44d51df9b58a8f49e7e00a0360c341ebb4"} Jul 30 19:44:01.362558 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:44:01.362521 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d686446bf-k6srf" event={"ID":"22201517-6965-4b54-84be-dcc34513bcc5","Type":"ContainerStarted","Data":"c4a502a4f2fb03ed6e5fb77614b410f8892b075c3408f4d196bc27c44a1dae18"} Jul 30 19:44:02.367472 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:44:02.367435 2555 generic.go:356] "Generic (PLEG): container finished" podID="22201517-6965-4b54-84be-dcc34513bcc5" containerID="c4a502a4f2fb03ed6e5fb77614b410f8892b075c3408f4d196bc27c44a1dae18" exitCode=0 Jul 30 19:44:02.367891 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:44:02.367499 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d686446bf-k6srf" event={"ID":"22201517-6965-4b54-84be-dcc34513bcc5","Type":"ContainerDied","Data":"c4a502a4f2fb03ed6e5fb77614b410f8892b075c3408f4d196bc27c44a1dae18"} Jul 30 19:44:03.373219 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:44:03.373177 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d686446bf-k6srf" event={"ID":"22201517-6965-4b54-84be-dcc34513bcc5","Type":"ContainerStarted","Data":"2c636d5120f5859b13b7683c4791586e5a905d77b34e1638576911fafc673f46"} Jul 30 19:44:03.373687 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:44:03.373304 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-d686446bf-k6srf" Jul 30 19:44:03.394767 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:44:03.394721 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-d686446bf-k6srf" podStartSLOduration=2.945031324 podStartE2EDuration="7.394703644s" totalImagesPullingTime="3.372520303s" totalInitContainerRuntime="1.077152017s" isStatefulPod=false podCreationTimestamp="2026-07-30 19:43:56 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 19:44:03.392722769 +0000 UTC m=+277.543802365" watchObservedRunningTime="2026-07-30 19:44:03.394703644 +0000 UTC m=+277.545783194" Jul 30 19:44:14.379388 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:44:14.379360 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-d686446bf-k6srf" Jul 30 19:44:16.504932 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:44:16.504899 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-75997846f9-vrd5l"] Jul 30 19:44:16.513849 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:44:16.513829 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-75997846f9-vrd5l" Jul 30 19:44:16.517825 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:44:16.517803 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 30 19:44:16.518907 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:44:16.518885 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-tqwgr\"" Jul 30 19:44:16.519091 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:44:16.518914 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 30 19:44:16.519091 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:44:16.518932 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 30 19:44:16.519091 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:44:16.518890 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 30 19:44:16.524460 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:44:16.524439 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-75997846f9-vrd5l"] Jul 30 19:44:16.559884 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:44:16.559856 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9d3a9222-0971-4d51-b653-dc9027e6f16d-tls-certs\") pod \"kube-auth-proxy-75997846f9-vrd5l\" (UID: \"9d3a9222-0971-4d51-b653-dc9027e6f16d\") " pod="openshift-ingress/kube-auth-proxy-75997846f9-vrd5l" Jul 30 19:44:16.560014 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:44:16.559889 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fh5t7\" (UniqueName: \"kubernetes.io/projected/9d3a9222-0971-4d51-b653-dc9027e6f16d-kube-api-access-fh5t7\") pod \"kube-auth-proxy-75997846f9-vrd5l\" (UID: \"9d3a9222-0971-4d51-b653-dc9027e6f16d\") " pod="openshift-ingress/kube-auth-proxy-75997846f9-vrd5l" Jul 30 19:44:16.560014 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:44:16.559909 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9d3a9222-0971-4d51-b653-dc9027e6f16d-tmp\") pod \"kube-auth-proxy-75997846f9-vrd5l\" (UID: \"9d3a9222-0971-4d51-b653-dc9027e6f16d\") " pod="openshift-ingress/kube-auth-proxy-75997846f9-vrd5l" Jul 30 19:44:16.660409 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:44:16.660373 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9d3a9222-0971-4d51-b653-dc9027e6f16d-tmp\") pod \"kube-auth-proxy-75997846f9-vrd5l\" (UID: \"9d3a9222-0971-4d51-b653-dc9027e6f16d\") " pod="openshift-ingress/kube-auth-proxy-75997846f9-vrd5l" Jul 30 19:44:16.660577 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:44:16.660477 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9d3a9222-0971-4d51-b653-dc9027e6f16d-tls-certs\") pod \"kube-auth-proxy-75997846f9-vrd5l\" (UID: \"9d3a9222-0971-4d51-b653-dc9027e6f16d\") " pod="openshift-ingress/kube-auth-proxy-75997846f9-vrd5l" Jul 30 19:44:16.660577 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:44:16.660506 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fh5t7\" (UniqueName: \"kubernetes.io/projected/9d3a9222-0971-4d51-b653-dc9027e6f16d-kube-api-access-fh5t7\") pod \"kube-auth-proxy-75997846f9-vrd5l\" (UID: \"9d3a9222-0971-4d51-b653-dc9027e6f16d\") " pod="openshift-ingress/kube-auth-proxy-75997846f9-vrd5l" Jul 30 19:44:16.662701 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:44:16.662671 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9d3a9222-0971-4d51-b653-dc9027e6f16d-tmp\") pod \"kube-auth-proxy-75997846f9-vrd5l\" (UID: \"9d3a9222-0971-4d51-b653-dc9027e6f16d\") " pod="openshift-ingress/kube-auth-proxy-75997846f9-vrd5l" Jul 30 19:44:16.662887 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:44:16.662868 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9d3a9222-0971-4d51-b653-dc9027e6f16d-tls-certs\") pod \"kube-auth-proxy-75997846f9-vrd5l\" (UID: \"9d3a9222-0971-4d51-b653-dc9027e6f16d\") " pod="openshift-ingress/kube-auth-proxy-75997846f9-vrd5l" Jul 30 19:44:16.679465 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:44:16.679437 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fh5t7\" (UniqueName: \"kubernetes.io/projected/9d3a9222-0971-4d51-b653-dc9027e6f16d-kube-api-access-fh5t7\") pod \"kube-auth-proxy-75997846f9-vrd5l\" (UID: \"9d3a9222-0971-4d51-b653-dc9027e6f16d\") " pod="openshift-ingress/kube-auth-proxy-75997846f9-vrd5l" Jul 30 19:44:16.823270 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:44:16.823198 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-75997846f9-vrd5l" Jul 30 19:44:16.945469 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:44:16.945443 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-75997846f9-vrd5l"] Jul 30 19:44:16.947744 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:44:16.947719 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d3a9222_0971_4d51_b653_dc9027e6f16d.slice/crio-9807b95dbb63bca61064f015819e9a8135aed60d608ffd3e409e4e725c7b0e54 WatchSource:0}: Error finding container 9807b95dbb63bca61064f015819e9a8135aed60d608ffd3e409e4e725c7b0e54: Status 404 returned error can't find the container with id 9807b95dbb63bca61064f015819e9a8135aed60d608ffd3e409e4e725c7b0e54 Jul 30 19:44:17.422395 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:44:17.422360 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-75997846f9-vrd5l" event={"ID":"9d3a9222-0971-4d51-b653-dc9027e6f16d","Type":"ContainerStarted","Data":"9807b95dbb63bca61064f015819e9a8135aed60d608ffd3e409e4e725c7b0e54"} Jul 30 19:44:20.435202 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:44:20.435168 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-75997846f9-vrd5l" event={"ID":"9d3a9222-0971-4d51-b653-dc9027e6f16d","Type":"ContainerStarted","Data":"2a871900df25dbc77a76df9129d7043da3ecd4bbc3d44a5be925c1dd355acbe6"} Jul 30 19:44:20.451898 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:44:20.451842 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-75997846f9-vrd5l" podStartSLOduration=1.7696045969999998 podStartE2EDuration="4.451826715s" totalImagesPullingTime="2.682222118s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 19:44:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 19:44:20.449971044 +0000 UTC m=+294.601050595" watchObservedRunningTime="2026-07-30 19:44:20.451826715 +0000 UTC m=+294.602906325" Jul 30 19:44:23.630813 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:44:23.630776 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-4vqv6"] Jul 30 19:44:23.634033 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:44:23.634017 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-4vqv6" Jul 30 19:44:23.636455 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:44:23.636432 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 30 19:44:23.636581 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:44:23.636483 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 30 19:44:23.636581 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:44:23.636440 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-nxlbx\"" Jul 30 19:44:23.636702 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:44:23.636676 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 30 19:44:23.636863 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:44:23.636849 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 30 19:44:23.646847 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:44:23.646824 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-4vqv6"] Jul 30 19:44:23.708292 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:44:23.708254 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/7a7dfd9d-8e3f-4333-9e0c-4c3248ab1f7b-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-4vqv6\" (UID: \"7a7dfd9d-8e3f-4333-9e0c-4c3248ab1f7b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-4vqv6" Jul 30 19:44:23.708459 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:44:23.708308 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7a7dfd9d-8e3f-4333-9e0c-4c3248ab1f7b-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-4vqv6\" (UID: \"7a7dfd9d-8e3f-4333-9e0c-4c3248ab1f7b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-4vqv6" Jul 30 19:44:23.708459 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:44:23.708386 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9prr\" (UniqueName: \"kubernetes.io/projected/7a7dfd9d-8e3f-4333-9e0c-4c3248ab1f7b-kube-api-access-j9prr\") pod \"istiod-openshift-gateway-5677ccb49b-4vqv6\" (UID: \"7a7dfd9d-8e3f-4333-9e0c-4c3248ab1f7b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-4vqv6" Jul 30 19:44:23.708459 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:44:23.708427 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/7a7dfd9d-8e3f-4333-9e0c-4c3248ab1f7b-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-4vqv6\" (UID: \"7a7dfd9d-8e3f-4333-9e0c-4c3248ab1f7b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-4vqv6" Jul 30 19:44:23.708459 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:44:23.708455 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7a7dfd9d-8e3f-4333-9e0c-4c3248ab1f7b-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-4vqv6\" (UID: \"7a7dfd9d-8e3f-4333-9e0c-4c3248ab1f7b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-4vqv6" Jul 30 19:44:23.708594 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:44:23.708502 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/7a7dfd9d-8e3f-4333-9e0c-4c3248ab1f7b-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-4vqv6\" (UID: \"7a7dfd9d-8e3f-4333-9e0c-4c3248ab1f7b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-4vqv6" Jul 30 19:44:23.708594 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:44:23.708523 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/7a7dfd9d-8e3f-4333-9e0c-4c3248ab1f7b-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-4vqv6\" (UID: \"7a7dfd9d-8e3f-4333-9e0c-4c3248ab1f7b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-4vqv6" Jul 30 19:44:23.809331 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:44:23.809296 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/7a7dfd9d-8e3f-4333-9e0c-4c3248ab1f7b-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-4vqv6\" (UID: \"7a7dfd9d-8e3f-4333-9e0c-4c3248ab1f7b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-4vqv6" Jul 30 19:44:23.809331 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:44:23.809330 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7a7dfd9d-8e3f-4333-9e0c-4c3248ab1f7b-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-4vqv6\" (UID: \"7a7dfd9d-8e3f-4333-9e0c-4c3248ab1f7b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-4vqv6" Jul 30 19:44:23.809525 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:44:23.809360 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9prr\" (UniqueName: \"kubernetes.io/projected/7a7dfd9d-8e3f-4333-9e0c-4c3248ab1f7b-kube-api-access-j9prr\") pod \"istiod-openshift-gateway-5677ccb49b-4vqv6\" (UID: \"7a7dfd9d-8e3f-4333-9e0c-4c3248ab1f7b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-4vqv6" Jul 30 19:44:23.809525 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:44:23.809392 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/7a7dfd9d-8e3f-4333-9e0c-4c3248ab1f7b-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-4vqv6\" (UID: \"7a7dfd9d-8e3f-4333-9e0c-4c3248ab1f7b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-4vqv6" Jul 30 19:44:23.809525 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:44:23.809414 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7a7dfd9d-8e3f-4333-9e0c-4c3248ab1f7b-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-4vqv6\" (UID: \"7a7dfd9d-8e3f-4333-9e0c-4c3248ab1f7b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-4vqv6" Jul 30 19:44:23.809525 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:44:23.809473 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/7a7dfd9d-8e3f-4333-9e0c-4c3248ab1f7b-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-4vqv6\" (UID: \"7a7dfd9d-8e3f-4333-9e0c-4c3248ab1f7b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-4vqv6" Jul 30 19:44:23.809525 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:44:23.809505 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/7a7dfd9d-8e3f-4333-9e0c-4c3248ab1f7b-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-4vqv6\" (UID: \"7a7dfd9d-8e3f-4333-9e0c-4c3248ab1f7b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-4vqv6" Jul 30 19:44:23.810078 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:44:23.810055 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/7a7dfd9d-8e3f-4333-9e0c-4c3248ab1f7b-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-4vqv6\" (UID: \"7a7dfd9d-8e3f-4333-9e0c-4c3248ab1f7b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-4vqv6" Jul 30 19:44:23.811781 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:44:23.811758 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/7a7dfd9d-8e3f-4333-9e0c-4c3248ab1f7b-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-4vqv6\" (UID: \"7a7dfd9d-8e3f-4333-9e0c-4c3248ab1f7b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-4vqv6" Jul 30 19:44:23.811884 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:44:23.811861 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/7a7dfd9d-8e3f-4333-9e0c-4c3248ab1f7b-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-4vqv6\" (UID: \"7a7dfd9d-8e3f-4333-9e0c-4c3248ab1f7b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-4vqv6" Jul 30 19:44:23.811990 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:44:23.811976 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/7a7dfd9d-8e3f-4333-9e0c-4c3248ab1f7b-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-4vqv6\" (UID: \"7a7dfd9d-8e3f-4333-9e0c-4c3248ab1f7b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-4vqv6" Jul 30 19:44:23.812104 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:44:23.812087 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7a7dfd9d-8e3f-4333-9e0c-4c3248ab1f7b-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-4vqv6\" (UID: \"7a7dfd9d-8e3f-4333-9e0c-4c3248ab1f7b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-4vqv6" Jul 30 19:44:23.818206 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:44:23.818183 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7a7dfd9d-8e3f-4333-9e0c-4c3248ab1f7b-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-4vqv6\" (UID: \"7a7dfd9d-8e3f-4333-9e0c-4c3248ab1f7b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-4vqv6" Jul 30 19:44:23.818449 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:44:23.818430 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9prr\" (UniqueName: \"kubernetes.io/projected/7a7dfd9d-8e3f-4333-9e0c-4c3248ab1f7b-kube-api-access-j9prr\") pod \"istiod-openshift-gateway-5677ccb49b-4vqv6\" (UID: \"7a7dfd9d-8e3f-4333-9e0c-4c3248ab1f7b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-4vqv6" Jul 30 19:44:23.943770 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:44:23.943688 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-4vqv6" Jul 30 19:44:24.082083 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:44:24.082058 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-4vqv6"] Jul 30 19:44:24.084120 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:44:24.084094 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a7dfd9d_8e3f_4333_9e0c_4c3248ab1f7b.slice/crio-417c631fc87c4641dbf61bb934d7effc1616b71608f13f2ac5105a976d7aaac0 WatchSource:0}: Error finding container 417c631fc87c4641dbf61bb934d7effc1616b71608f13f2ac5105a976d7aaac0: Status 404 returned error can't find the container with id 417c631fc87c4641dbf61bb934d7effc1616b71608f13f2ac5105a976d7aaac0 Jul 30 19:44:24.450664 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:44:24.450626 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-4vqv6" event={"ID":"7a7dfd9d-8e3f-4333-9e0c-4c3248ab1f7b","Type":"ContainerStarted","Data":"417c631fc87c4641dbf61bb934d7effc1616b71608f13f2ac5105a976d7aaac0"} Jul 30 19:44:26.599965 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:44:26.599932 2555 kubelet.go:1648] "Image garbage collection succeeded" Jul 30 19:44:26.638988 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:44:26.638930 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 30 19:44:26.639107 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:44:26.639017 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 30 19:44:27.465983 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:44:27.465945 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-4vqv6" event={"ID":"7a7dfd9d-8e3f-4333-9e0c-4c3248ab1f7b","Type":"ContainerStarted","Data":"7495bfc30fc5fa157e686bb7d69985c8630d92e0aa326588cb9d2886e8415ac9"} Jul 30 19:44:27.466205 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:44:27.466153 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-4vqv6" Jul 30 19:44:27.467775 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:44:27.467747 2555 patch_prober.go:28] interesting pod/istiod-openshift-gateway-5677ccb49b-4vqv6 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 30 19:44:27.467899 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:44:27.467805 2555 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-4vqv6" podUID="7a7dfd9d-8e3f-4333-9e0c-4c3248ab1f7b" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 30 19:44:27.487165 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:44:27.487122 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-4vqv6" podStartSLOduration=1.934835279 podStartE2EDuration="4.487108142s" totalImagesPullingTime="2.552272863s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 19:44:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 19:44:27.48663742 +0000 UTC m=+301.637716970" watchObservedRunningTime="2026-07-30 19:44:27.487108142 +0000 UTC m=+301.638187693" Jul 30 19:44:28.471095 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:44:28.471069 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-4vqv6" Jul 30 19:45:17.587392 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:45:17.587354 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-rc8s8"] Jul 30 19:45:17.595771 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:45:17.595738 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-rc8s8" Jul 30 19:45:17.598415 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:45:17.598387 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 30 19:45:17.598582 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:45:17.598552 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-rc8s8"] Jul 30 19:45:17.599585 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:45:17.599496 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-hsfjv\"" Jul 30 19:45:17.599844 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:45:17.599829 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 30 19:45:17.715613 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:45:17.715579 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ww4bs\" (UniqueName: \"kubernetes.io/projected/0d54a67f-d336-47b2-8ee3-e9cfbc6a9922-kube-api-access-ww4bs\") pod \"kuadrant-operator-catalog-rc8s8\" (UID: \"0d54a67f-d336-47b2-8ee3-e9cfbc6a9922\") " pod="kuadrant-system/kuadrant-operator-catalog-rc8s8" Jul 30 19:45:17.816498 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:45:17.816462 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ww4bs\" (UniqueName: \"kubernetes.io/projected/0d54a67f-d336-47b2-8ee3-e9cfbc6a9922-kube-api-access-ww4bs\") pod \"kuadrant-operator-catalog-rc8s8\" (UID: \"0d54a67f-d336-47b2-8ee3-e9cfbc6a9922\") " pod="kuadrant-system/kuadrant-operator-catalog-rc8s8" Jul 30 19:45:17.823879 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:45:17.823853 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ww4bs\" (UniqueName: \"kubernetes.io/projected/0d54a67f-d336-47b2-8ee3-e9cfbc6a9922-kube-api-access-ww4bs\") pod \"kuadrant-operator-catalog-rc8s8\" (UID: \"0d54a67f-d336-47b2-8ee3-e9cfbc6a9922\") " pod="kuadrant-system/kuadrant-operator-catalog-rc8s8" Jul 30 19:45:17.906957 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:45:17.906845 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-rc8s8" Jul 30 19:45:17.958335 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:45:17.958304 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-rc8s8"] Jul 30 19:45:18.029335 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:45:18.029310 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-rc8s8"] Jul 30 19:45:18.033586 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:45:18.033559 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d54a67f_d336_47b2_8ee3_e9cfbc6a9922.slice/crio-5fa54cedd36d18ac8ec1b51b146f0d39750ac2a24cb36f2452d2079832924ca5 WatchSource:0}: Error finding container 5fa54cedd36d18ac8ec1b51b146f0d39750ac2a24cb36f2452d2079832924ca5: Status 404 returned error can't find the container with id 5fa54cedd36d18ac8ec1b51b146f0d39750ac2a24cb36f2452d2079832924ca5 Jul 30 19:45:18.035338 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:45:18.035319 2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 30 19:45:18.641553 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:45:18.641479 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-rc8s8" event={"ID":"0d54a67f-d336-47b2-8ee3-e9cfbc6a9922","Type":"ContainerStarted","Data":"5fa54cedd36d18ac8ec1b51b146f0d39750ac2a24cb36f2452d2079832924ca5"} Jul 30 19:45:20.650394 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:45:20.650366 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-rc8s8" event={"ID":"0d54a67f-d336-47b2-8ee3-e9cfbc6a9922","Type":"ContainerStarted","Data":"e8d14376f2e994faf8388330aba6c74824d76dd31748ab4b257aa83e77e61f82"} Jul 30 19:45:20.650854 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:45:20.650455 2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-rc8s8" podUID="0d54a67f-d336-47b2-8ee3-e9cfbc6a9922" containerName="registry-server" containerID="cri-o://e8d14376f2e994faf8388330aba6c74824d76dd31748ab4b257aa83e77e61f82" gracePeriod=2 Jul 30 19:45:20.666330 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:45:20.666288 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-rc8s8" podStartSLOduration=1.662323818 podStartE2EDuration="3.666256377s" totalImagesPullingTime="2.003932559s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 19:45:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 19:45:20.664827169 +0000 UTC m=+354.815906716" watchObservedRunningTime="2026-07-30 19:45:20.666256377 +0000 UTC m=+354.817335926" Jul 30 19:45:20.887362 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:45:20.887339 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-rc8s8" Jul 30 19:45:21.040826 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:45:21.040794 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ww4bs\" (UniqueName: \"kubernetes.io/projected/0d54a67f-d336-47b2-8ee3-e9cfbc6a9922-kube-api-access-ww4bs\") pod \"0d54a67f-d336-47b2-8ee3-e9cfbc6a9922\" (UID: \"0d54a67f-d336-47b2-8ee3-e9cfbc6a9922\") " Jul 30 19:45:21.042878 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:45:21.042856 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d54a67f-d336-47b2-8ee3-e9cfbc6a9922-kube-api-access-ww4bs" (OuterVolumeSpecName: "kube-api-access-ww4bs") pod "0d54a67f-d336-47b2-8ee3-e9cfbc6a9922" (UID: "0d54a67f-d336-47b2-8ee3-e9cfbc6a9922"). InnerVolumeSpecName "kube-api-access-ww4bs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 19:45:21.141573 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:45:21.141544 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ww4bs\" (UniqueName: \"kubernetes.io/projected/0d54a67f-d336-47b2-8ee3-e9cfbc6a9922-kube-api-access-ww4bs\") on node \"ip-10-0-136-46.ec2.internal\" DevicePath \"\"" Jul 30 19:45:21.655380 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:45:21.655342 2555 generic.go:356] "Generic (PLEG): container finished" podID="0d54a67f-d336-47b2-8ee3-e9cfbc6a9922" containerID="e8d14376f2e994faf8388330aba6c74824d76dd31748ab4b257aa83e77e61f82" exitCode=0 Jul 30 19:45:21.655773 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:45:21.655384 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-rc8s8" Jul 30 19:45:21.655773 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:45:21.655427 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-rc8s8" event={"ID":"0d54a67f-d336-47b2-8ee3-e9cfbc6a9922","Type":"ContainerDied","Data":"e8d14376f2e994faf8388330aba6c74824d76dd31748ab4b257aa83e77e61f82"} Jul 30 19:45:21.655773 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:45:21.655477 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-rc8s8" event={"ID":"0d54a67f-d336-47b2-8ee3-e9cfbc6a9922","Type":"ContainerDied","Data":"5fa54cedd36d18ac8ec1b51b146f0d39750ac2a24cb36f2452d2079832924ca5"} Jul 30 19:45:21.655773 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:45:21.655501 2555 scope.go:117] "RemoveContainer" containerID="e8d14376f2e994faf8388330aba6c74824d76dd31748ab4b257aa83e77e61f82" Jul 30 19:45:21.668729 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:45:21.664597 2555 scope.go:117] "RemoveContainer" containerID="e8d14376f2e994faf8388330aba6c74824d76dd31748ab4b257aa83e77e61f82" Jul 30 19:45:21.669215 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:45:21.669189 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e8d14376f2e994faf8388330aba6c74824d76dd31748ab4b257aa83e77e61f82\": container with ID starting with e8d14376f2e994faf8388330aba6c74824d76dd31748ab4b257aa83e77e61f82 not found: ID does not exist" containerID="e8d14376f2e994faf8388330aba6c74824d76dd31748ab4b257aa83e77e61f82" Jul 30 19:45:21.669338 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:45:21.669220 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e8d14376f2e994faf8388330aba6c74824d76dd31748ab4b257aa83e77e61f82"} err="failed to get container status \"e8d14376f2e994faf8388330aba6c74824d76dd31748ab4b257aa83e77e61f82\": rpc error: code = NotFound desc = could not find container \"e8d14376f2e994faf8388330aba6c74824d76dd31748ab4b257aa83e77e61f82\": container with ID starting with e8d14376f2e994faf8388330aba6c74824d76dd31748ab4b257aa83e77e61f82 not found: ID does not exist" Jul 30 19:45:21.676553 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:45:21.676533 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-rc8s8"] Jul 30 19:45:21.679836 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:45:21.679818 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-rc8s8"] Jul 30 19:45:22.313904 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:45:22.313872 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0d54a67f-d336-47b2-8ee3-e9cfbc6a9922" path="/var/lib/kubelet/pods/0d54a67f-d336-47b2-8ee3-e9cfbc6a9922/volumes" Jul 30 19:45:43.282071 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:45:43.282038 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7n9n9"] Jul 30 19:45:43.282499 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:45:43.282306 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d54a67f-d336-47b2-8ee3-e9cfbc6a9922" containerName="registry-server" Jul 30 19:45:43.282499 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:45:43.282318 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d54a67f-d336-47b2-8ee3-e9cfbc6a9922" containerName="registry-server" Jul 30 19:45:43.282499 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:45:43.282375 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="0d54a67f-d336-47b2-8ee3-e9cfbc6a9922" containerName="registry-server" Jul 30 19:45:43.286415 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:45:43.286396 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7n9n9" Jul 30 19:45:43.288868 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:45:43.288850 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 30 19:45:43.289845 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:45:43.289830 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-vz2w6\"" Jul 30 19:45:43.289904 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:45:43.289832 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 30 19:45:43.294032 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:45:43.294012 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7n9n9"] Jul 30 19:45:43.309259 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:45:43.309238 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rrcdv\" (UniqueName: \"kubernetes.io/projected/14564972-5a9a-44c0-9997-9491e781ac2f-kube-api-access-rrcdv\") pod \"limitador-operator-controller-manager-859d7b78bd-7n9n9\" (UID: \"14564972-5a9a-44c0-9997-9491e781ac2f\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7n9n9" Jul 30 19:45:43.409601 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:45:43.409564 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rrcdv\" (UniqueName: \"kubernetes.io/projected/14564972-5a9a-44c0-9997-9491e781ac2f-kube-api-access-rrcdv\") pod \"limitador-operator-controller-manager-859d7b78bd-7n9n9\" (UID: \"14564972-5a9a-44c0-9997-9491e781ac2f\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7n9n9" Jul 30 19:45:43.433747 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:45:43.433717 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rrcdv\" (UniqueName: \"kubernetes.io/projected/14564972-5a9a-44c0-9997-9491e781ac2f-kube-api-access-rrcdv\") pod \"limitador-operator-controller-manager-859d7b78bd-7n9n9\" (UID: \"14564972-5a9a-44c0-9997-9491e781ac2f\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7n9n9" Jul 30 19:45:43.596678 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:45:43.596598 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7n9n9" Jul 30 19:45:43.724972 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:45:43.724946 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7n9n9"] Jul 30 19:45:43.727245 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:45:43.727222 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14564972_5a9a_44c0_9997_9491e781ac2f.slice/crio-854558c68e03fac02e7c66a3029df22734105e1f7913d397e3d85c5b09b585bc WatchSource:0}: Error finding container 854558c68e03fac02e7c66a3029df22734105e1f7913d397e3d85c5b09b585bc: Status 404 returned error can't find the container with id 854558c68e03fac02e7c66a3029df22734105e1f7913d397e3d85c5b09b585bc Jul 30 19:45:43.733463 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:45:43.733436 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7n9n9" event={"ID":"14564972-5a9a-44c0-9997-9491e781ac2f","Type":"ContainerStarted","Data":"854558c68e03fac02e7c66a3029df22734105e1f7913d397e3d85c5b09b585bc"} Jul 30 19:45:45.742924 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:45:45.742890 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7n9n9" event={"ID":"14564972-5a9a-44c0-9997-9491e781ac2f","Type":"ContainerStarted","Data":"ed59a8afbd7d73f360bef861671a76faa31ec9199f522ac7871829160208a5f4"} Jul 30 19:45:45.743355 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:45:45.742990 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7n9n9" Jul 30 19:45:45.758490 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:45:45.758446 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7n9n9" podStartSLOduration=1.2808293179999999 podStartE2EDuration="2.758431s" totalImagesPullingTime="1.477601682s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 19:45:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 19:45:45.757457104 +0000 UTC m=+379.908536653" watchObservedRunningTime="2026-07-30 19:45:45.758431 +0000 UTC m=+379.909510550" Jul 30 19:45:52.468380 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:45:52.468347 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-rjbml"] Jul 30 19:45:52.471530 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:45:52.471509 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-rjbml" Jul 30 19:45:52.474012 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:45:52.473992 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-926dq\"" Jul 30 19:45:52.481969 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:45:52.481942 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-rjbml"] Jul 30 19:45:52.568543 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:45:52.568513 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mz48x\" (UniqueName: \"kubernetes.io/projected/93132180-eeae-48ef-b67a-a69d9f41eb87-kube-api-access-mz48x\") pod \"authorino-operator-75cc8d5cb7-rjbml\" (UID: \"93132180-eeae-48ef-b67a-a69d9f41eb87\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-rjbml" Jul 30 19:45:52.668882 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:45:52.668836 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mz48x\" (UniqueName: \"kubernetes.io/projected/93132180-eeae-48ef-b67a-a69d9f41eb87-kube-api-access-mz48x\") pod \"authorino-operator-75cc8d5cb7-rjbml\" (UID: \"93132180-eeae-48ef-b67a-a69d9f41eb87\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-rjbml" Jul 30 19:45:52.680381 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:45:52.680356 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mz48x\" (UniqueName: \"kubernetes.io/projected/93132180-eeae-48ef-b67a-a69d9f41eb87-kube-api-access-mz48x\") pod \"authorino-operator-75cc8d5cb7-rjbml\" (UID: \"93132180-eeae-48ef-b67a-a69d9f41eb87\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-rjbml" Jul 30 19:45:52.782856 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:45:52.782782 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-rjbml" Jul 30 19:45:52.905370 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:45:52.905336 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-rjbml"] Jul 30 19:45:52.908314 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:45:52.908291 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93132180_eeae_48ef_b67a_a69d9f41eb87.slice/crio-1d08c3ceeacdf7d59802b46a0692aea3c2e162fa8c94608119411db27dae65ac WatchSource:0}: Error finding container 1d08c3ceeacdf7d59802b46a0692aea3c2e162fa8c94608119411db27dae65ac: Status 404 returned error can't find the container with id 1d08c3ceeacdf7d59802b46a0692aea3c2e162fa8c94608119411db27dae65ac Jul 30 19:45:53.774362 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:45:53.774311 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-rjbml" event={"ID":"93132180-eeae-48ef-b67a-a69d9f41eb87","Type":"ContainerStarted","Data":"1d08c3ceeacdf7d59802b46a0692aea3c2e162fa8c94608119411db27dae65ac"} Jul 30 19:45:55.783416 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:45:55.783382 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-rjbml" event={"ID":"93132180-eeae-48ef-b67a-a69d9f41eb87","Type":"ContainerStarted","Data":"8aade4eaea4f53d95fc7fffb5c6266a3e96ec7b1df59a8b90a4a307cd7b0e90a"} Jul 30 19:45:55.783821 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:45:55.783503 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-rjbml" Jul 30 19:45:55.799503 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:45:55.799465 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-rjbml" podStartSLOduration=1.617832926 podStartE2EDuration="3.799450523s" totalImagesPullingTime="2.181617597s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 19:45:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 19:45:55.798244851 +0000 UTC m=+389.949324401" watchObservedRunningTime="2026-07-30 19:45:55.799450523 +0000 UTC m=+389.950530073" Jul 30 19:45:56.749780 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:45:56.749751 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7n9n9" Jul 30 19:46:06.789856 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:46:06.789812 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-rjbml" Jul 30 19:46:07.052532 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:46:07.052436 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7n9n9"] Jul 30 19:46:07.053132 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:46:07.053092 2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7n9n9" podUID="14564972-5a9a-44c0-9997-9491e781ac2f" containerName="manager" containerID="cri-o://ed59a8afbd7d73f360bef861671a76faa31ec9199f522ac7871829160208a5f4" gracePeriod=2 Jul 30 19:46:07.070976 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:46:07.070948 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7n9n9"] Jul 30 19:46:07.076213 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:46:07.076173 2555 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"14564972-5a9a-44c0-9997-9491e781ac2f\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-859d7b78bd-7n9n9\": pods \"limitador-operator-controller-manager-859d7b78bd-7n9n9\" not found" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7n9n9" Jul 30 19:46:07.095029 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:46:07.094989 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zzsj2"] Jul 30 19:46:07.095448 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:46:07.095431 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14564972-5a9a-44c0-9997-9491e781ac2f" containerName="manager" Jul 30 19:46:07.095522 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:46:07.095452 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="14564972-5a9a-44c0-9997-9491e781ac2f" containerName="manager" Jul 30 19:46:07.095583 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:46:07.095524 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="14564972-5a9a-44c0-9997-9491e781ac2f" containerName="manager" Jul 30 19:46:07.098745 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:46:07.098725 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zzsj2" Jul 30 19:46:07.101019 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:46:07.100985 2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-7n9n9\" is forbidden: User \"system:node:ip-10-0-136-46.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-46.ec2.internal' and this object" podUID="14564972-5a9a-44c0-9997-9491e781ac2f" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7n9n9" Jul 30 19:46:07.110905 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:46:07.110883 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zzsj2"] Jul 30 19:46:07.173659 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:46:07.173635 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7gzqh\" (UniqueName: \"kubernetes.io/projected/925facfe-5902-45e9-8ee8-eae6397972a4-kube-api-access-7gzqh\") pod \"limitador-operator-controller-manager-859d7b78bd-zzsj2\" (UID: \"925facfe-5902-45e9-8ee8-eae6397972a4\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zzsj2" Jul 30 19:46:07.274420 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:46:07.274390 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7gzqh\" (UniqueName: \"kubernetes.io/projected/925facfe-5902-45e9-8ee8-eae6397972a4-kube-api-access-7gzqh\") pod \"limitador-operator-controller-manager-859d7b78bd-zzsj2\" (UID: \"925facfe-5902-45e9-8ee8-eae6397972a4\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zzsj2" Jul 30 19:46:07.289970 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:46:07.289927 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7gzqh\" (UniqueName: \"kubernetes.io/projected/925facfe-5902-45e9-8ee8-eae6397972a4-kube-api-access-7gzqh\") pod \"limitador-operator-controller-manager-859d7b78bd-zzsj2\" (UID: \"925facfe-5902-45e9-8ee8-eae6397972a4\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zzsj2" Jul 30 19:46:07.293118 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:46:07.293097 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7n9n9" Jul 30 19:46:07.295369 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:46:07.295335 2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-7n9n9\" is forbidden: User \"system:node:ip-10-0-136-46.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-46.ec2.internal' and this object" podUID="14564972-5a9a-44c0-9997-9491e781ac2f" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7n9n9" Jul 30 19:46:07.374895 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:46:07.374806 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rrcdv\" (UniqueName: \"kubernetes.io/projected/14564972-5a9a-44c0-9997-9491e781ac2f-kube-api-access-rrcdv\") pod \"14564972-5a9a-44c0-9997-9491e781ac2f\" (UID: \"14564972-5a9a-44c0-9997-9491e781ac2f\") " Jul 30 19:46:07.376862 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:46:07.376835 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/14564972-5a9a-44c0-9997-9491e781ac2f-kube-api-access-rrcdv" (OuterVolumeSpecName: "kube-api-access-rrcdv") pod "14564972-5a9a-44c0-9997-9491e781ac2f" (UID: "14564972-5a9a-44c0-9997-9491e781ac2f"). InnerVolumeSpecName "kube-api-access-rrcdv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 19:46:07.429120 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:46:07.429076 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zzsj2" Jul 30 19:46:07.475784 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:46:07.475745 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rrcdv\" (UniqueName: \"kubernetes.io/projected/14564972-5a9a-44c0-9997-9491e781ac2f-kube-api-access-rrcdv\") on node \"ip-10-0-136-46.ec2.internal\" DevicePath \"\"" Jul 30 19:46:07.556645 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:46:07.556549 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zzsj2"] Jul 30 19:46:07.559227 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:46:07.559203 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod925facfe_5902_45e9_8ee8_eae6397972a4.slice/crio-3b3a64636ec32f9019f3fffad47c9450d36c672bdeea818f70ce6798bca5037b WatchSource:0}: Error finding container 3b3a64636ec32f9019f3fffad47c9450d36c672bdeea818f70ce6798bca5037b: Status 404 returned error can't find the container with id 3b3a64636ec32f9019f3fffad47c9450d36c672bdeea818f70ce6798bca5037b Jul 30 19:46:07.831703 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:46:07.831665 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zzsj2" event={"ID":"925facfe-5902-45e9-8ee8-eae6397972a4","Type":"ContainerStarted","Data":"956eb7a59c39965b63a3a7b025ab3b1b7be302d0558a463f7b502b42026615cd"} Jul 30 19:46:07.832145 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:46:07.831727 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zzsj2" event={"ID":"925facfe-5902-45e9-8ee8-eae6397972a4","Type":"ContainerStarted","Data":"3b3a64636ec32f9019f3fffad47c9450d36c672bdeea818f70ce6798bca5037b"} Jul 30 19:46:07.832145 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:46:07.831756 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zzsj2" Jul 30 19:46:07.832961 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:46:07.832936 2555 generic.go:356] "Generic (PLEG): container finished" podID="14564972-5a9a-44c0-9997-9491e781ac2f" containerID="ed59a8afbd7d73f360bef861671a76faa31ec9199f522ac7871829160208a5f4" exitCode=0 Jul 30 19:46:07.833045 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:46:07.832979 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7n9n9" Jul 30 19:46:07.833045 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:46:07.833000 2555 scope.go:117] "RemoveContainer" containerID="ed59a8afbd7d73f360bef861671a76faa31ec9199f522ac7871829160208a5f4" Jul 30 19:46:07.841161 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:46:07.841138 2555 scope.go:117] "RemoveContainer" containerID="ed59a8afbd7d73f360bef861671a76faa31ec9199f522ac7871829160208a5f4" Jul 30 19:46:07.841446 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:46:07.841429 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ed59a8afbd7d73f360bef861671a76faa31ec9199f522ac7871829160208a5f4\": container with ID starting with ed59a8afbd7d73f360bef861671a76faa31ec9199f522ac7871829160208a5f4 not found: ID does not exist" containerID="ed59a8afbd7d73f360bef861671a76faa31ec9199f522ac7871829160208a5f4" Jul 30 19:46:07.841513 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:46:07.841453 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ed59a8afbd7d73f360bef861671a76faa31ec9199f522ac7871829160208a5f4"} err="failed to get container status \"ed59a8afbd7d73f360bef861671a76faa31ec9199f522ac7871829160208a5f4\": rpc error: code = NotFound desc = could not find container \"ed59a8afbd7d73f360bef861671a76faa31ec9199f522ac7871829160208a5f4\": container with ID starting with ed59a8afbd7d73f360bef861671a76faa31ec9199f522ac7871829160208a5f4 not found: ID does not exist" Jul 30 19:46:07.847972 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:46:07.847932 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zzsj2" podStartSLOduration=0.847919365 podStartE2EDuration="847.919365ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 19:46:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 19:46:07.846376373 +0000 UTC m=+401.997455916" watchObservedRunningTime="2026-07-30 19:46:07.847919365 +0000 UTC m=+401.998998960" Jul 30 19:46:07.848161 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:46:07.848139 2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-7n9n9\" is forbidden: User \"system:node:ip-10-0-136-46.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-46.ec2.internal' and this object" podUID="14564972-5a9a-44c0-9997-9491e781ac2f" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7n9n9" Jul 30 19:46:07.850522 ip-10-0-136-46 kubenswrapper[2555]: E0730 19:46:07.850500 2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-7n9n9\" is forbidden: User \"system:node:ip-10-0-136-46.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-46.ec2.internal' and this object" podUID="14564972-5a9a-44c0-9997-9491e781ac2f" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7n9n9" Jul 30 19:46:08.314932 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:46:08.314899 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="14564972-5a9a-44c0-9997-9491e781ac2f" path="/var/lib/kubelet/pods/14564972-5a9a-44c0-9997-9491e781ac2f/volumes" Jul 30 19:46:18.840532 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:46:18.840503 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zzsj2" Jul 30 19:46:48.658782 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:46:48.658701 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 19:46:48.665256 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:46:48.665233 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-khpb5" Jul 30 19:46:48.668341 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:46:48.668318 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-v42rg\"" Jul 30 19:46:48.668480 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:46:48.668318 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 30 19:46:48.669189 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:46:48.669168 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 19:46:48.696151 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:46:48.696121 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 19:46:48.798966 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:46:48.798931 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krdq2\" (UniqueName: \"kubernetes.io/projected/021fcd4a-5e16-4968-8e43-948ccc84d6ad-kube-api-access-krdq2\") pod \"limitador-limitador-54d6d988d5-khpb5\" (UID: \"021fcd4a-5e16-4968-8e43-948ccc84d6ad\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-khpb5" Jul 30 19:46:48.799157 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:46:48.799007 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/021fcd4a-5e16-4968-8e43-948ccc84d6ad-config-file\") pod \"limitador-limitador-54d6d988d5-khpb5\" (UID: \"021fcd4a-5e16-4968-8e43-948ccc84d6ad\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-khpb5" Jul 30 19:46:48.900115 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:46:48.900076 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-krdq2\" (UniqueName: \"kubernetes.io/projected/021fcd4a-5e16-4968-8e43-948ccc84d6ad-kube-api-access-krdq2\") pod \"limitador-limitador-54d6d988d5-khpb5\" (UID: \"021fcd4a-5e16-4968-8e43-948ccc84d6ad\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-khpb5" Jul 30 19:46:48.900363 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:46:48.900148 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/021fcd4a-5e16-4968-8e43-948ccc84d6ad-config-file\") pod \"limitador-limitador-54d6d988d5-khpb5\" (UID: \"021fcd4a-5e16-4968-8e43-948ccc84d6ad\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-khpb5" Jul 30 19:46:48.900806 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:46:48.900782 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/021fcd4a-5e16-4968-8e43-948ccc84d6ad-config-file\") pod \"limitador-limitador-54d6d988d5-khpb5\" (UID: \"021fcd4a-5e16-4968-8e43-948ccc84d6ad\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-khpb5" Jul 30 19:46:48.907118 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:46:48.907093 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-krdq2\" (UniqueName: \"kubernetes.io/projected/021fcd4a-5e16-4968-8e43-948ccc84d6ad-kube-api-access-krdq2\") pod \"limitador-limitador-54d6d988d5-khpb5\" (UID: \"021fcd4a-5e16-4968-8e43-948ccc84d6ad\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-khpb5" Jul 30 19:46:48.975853 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:46:48.975824 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-khpb5" Jul 30 19:46:49.110216 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:46:49.110157 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 19:46:49.112848 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:46:49.112823 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod021fcd4a_5e16_4968_8e43_948ccc84d6ad.slice/crio-dfd981ede4e08c351665bb6a265e364592bde567c8bccc742de68b54b79b934c WatchSource:0}: Error finding container dfd981ede4e08c351665bb6a265e364592bde567c8bccc742de68b54b79b934c: Status 404 returned error can't find the container with id dfd981ede4e08c351665bb6a265e364592bde567c8bccc742de68b54b79b934c Jul 30 19:46:50.000972 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:46:50.000935 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-khpb5" event={"ID":"021fcd4a-5e16-4968-8e43-948ccc84d6ad","Type":"ContainerStarted","Data":"dfd981ede4e08c351665bb6a265e364592bde567c8bccc742de68b54b79b934c"} Jul 30 19:46:52.013942 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:46:52.013904 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-khpb5" event={"ID":"021fcd4a-5e16-4968-8e43-948ccc84d6ad","Type":"ContainerStarted","Data":"03bc5e9d2fb2988496e45eb06128e55b22732c6452709e796db0aad70d876926"} Jul 30 19:46:52.014336 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:46:52.014004 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-khpb5" Jul 30 19:46:52.029485 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:46:52.029442 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-khpb5" podStartSLOduration=1.60673383 podStartE2EDuration="4.029427068s" totalImagesPullingTime="2.422693238s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 19:46:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 19:46:52.028045722 +0000 UTC m=+446.179125271" watchObservedRunningTime="2026-07-30 19:46:52.029427068 +0000 UTC m=+446.180506618" Jul 30 19:47:03.019038 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:47:03.019006 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-khpb5" Jul 30 19:48:05.001942 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:48:05.001909 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 19:48:25.498326 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:48:25.498237 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hmpch"] Jul 30 19:48:25.502015 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:48:25.501989 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hmpch" Jul 30 19:48:25.505557 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:48:25.505530 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jul 30 19:48:25.505557 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:48:25.505552 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 30 19:48:25.505745 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:48:25.505573 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-866sb\"" Jul 30 19:48:25.505745 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:48:25.505552 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 30 19:48:25.509895 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:48:25.509491 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hmpch"] Jul 30 19:48:25.531849 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:48:25.531819 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aab9c609-04e0-4966-b749-b880bedfb785-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hmpch\" (UID: \"aab9c609-04e0-4966-b749-b880bedfb785\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hmpch" Jul 30 19:48:25.532017 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:48:25.531857 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aab9c609-04e0-4966-b749-b880bedfb785-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hmpch\" (UID: \"aab9c609-04e0-4966-b749-b880bedfb785\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hmpch" Jul 30 19:48:25.532017 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:48:25.531902 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-clctz\" (UniqueName: \"kubernetes.io/projected/aab9c609-04e0-4966-b749-b880bedfb785-kube-api-access-clctz\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hmpch\" (UID: \"aab9c609-04e0-4966-b749-b880bedfb785\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hmpch" Jul 30 19:48:25.532017 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:48:25.531927 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aab9c609-04e0-4966-b749-b880bedfb785-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hmpch\" (UID: \"aab9c609-04e0-4966-b749-b880bedfb785\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hmpch" Jul 30 19:48:25.532017 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:48:25.532004 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aab9c609-04e0-4966-b749-b880bedfb785-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hmpch\" (UID: \"aab9c609-04e0-4966-b749-b880bedfb785\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hmpch" Jul 30 19:48:25.532149 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:48:25.532045 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aab9c609-04e0-4966-b749-b880bedfb785-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hmpch\" (UID: \"aab9c609-04e0-4966-b749-b880bedfb785\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hmpch" Jul 30 19:48:25.632763 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:48:25.632730 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aab9c609-04e0-4966-b749-b880bedfb785-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hmpch\" (UID: \"aab9c609-04e0-4966-b749-b880bedfb785\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hmpch" Jul 30 19:48:25.632952 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:48:25.632788 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aab9c609-04e0-4966-b749-b880bedfb785-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hmpch\" (UID: \"aab9c609-04e0-4966-b749-b880bedfb785\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hmpch" Jul 30 19:48:25.632952 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:48:25.632811 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aab9c609-04e0-4966-b749-b880bedfb785-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hmpch\" (UID: \"aab9c609-04e0-4966-b749-b880bedfb785\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hmpch" Jul 30 19:48:25.632952 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:48:25.632829 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aab9c609-04e0-4966-b749-b880bedfb785-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hmpch\" (UID: \"aab9c609-04e0-4966-b749-b880bedfb785\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hmpch" Jul 30 19:48:25.632952 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:48:25.632851 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aab9c609-04e0-4966-b749-b880bedfb785-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hmpch\" (UID: \"aab9c609-04e0-4966-b749-b880bedfb785\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hmpch" Jul 30 19:48:25.632952 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:48:25.632876 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-clctz\" (UniqueName: \"kubernetes.io/projected/aab9c609-04e0-4966-b749-b880bedfb785-kube-api-access-clctz\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hmpch\" (UID: \"aab9c609-04e0-4966-b749-b880bedfb785\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hmpch" Jul 30 19:48:25.633289 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:48:25.633255 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aab9c609-04e0-4966-b749-b880bedfb785-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hmpch\" (UID: \"aab9c609-04e0-4966-b749-b880bedfb785\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hmpch" Jul 30 19:48:25.633357 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:48:25.633258 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aab9c609-04e0-4966-b749-b880bedfb785-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hmpch\" (UID: \"aab9c609-04e0-4966-b749-b880bedfb785\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hmpch" Jul 30 19:48:25.633357 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:48:25.633332 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aab9c609-04e0-4966-b749-b880bedfb785-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hmpch\" (UID: \"aab9c609-04e0-4966-b749-b880bedfb785\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hmpch" Jul 30 19:48:25.635000 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:48:25.634981 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aab9c609-04e0-4966-b749-b880bedfb785-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hmpch\" (UID: \"aab9c609-04e0-4966-b749-b880bedfb785\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hmpch" Jul 30 19:48:25.635270 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:48:25.635252 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aab9c609-04e0-4966-b749-b880bedfb785-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hmpch\" (UID: \"aab9c609-04e0-4966-b749-b880bedfb785\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hmpch" Jul 30 19:48:25.639767 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:48:25.639745 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-clctz\" (UniqueName: \"kubernetes.io/projected/aab9c609-04e0-4966-b749-b880bedfb785-kube-api-access-clctz\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hmpch\" (UID: \"aab9c609-04e0-4966-b749-b880bedfb785\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hmpch" Jul 30 19:48:25.813463 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:48:25.813372 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hmpch" Jul 30 19:48:25.940978 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:48:25.940953 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hmpch"] Jul 30 19:48:25.943079 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:48:25.943053 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaab9c609_04e0_4966_b749_b880bedfb785.slice/crio-c4e118a77cb292fe1d08053a8fed621fc11a04029cc9506f3a2712782f7dc8c4 WatchSource:0}: Error finding container c4e118a77cb292fe1d08053a8fed621fc11a04029cc9506f3a2712782f7dc8c4: Status 404 returned error can't find the container with id c4e118a77cb292fe1d08053a8fed621fc11a04029cc9506f3a2712782f7dc8c4 Jul 30 19:48:26.090407 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:48:26.090334 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 19:48:26.375337 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:48:26.375234 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hmpch" event={"ID":"aab9c609-04e0-4966-b749-b880bedfb785","Type":"ContainerStarted","Data":"c4e118a77cb292fe1d08053a8fed621fc11a04029cc9506f3a2712782f7dc8c4"} Jul 30 19:48:27.381410 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:48:27.381379 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hmpch" event={"ID":"aab9c609-04e0-4966-b749-b880bedfb785","Type":"ContainerStarted","Data":"73b1277cec93934717168f4e521876df1349c3128433bb95ba354e3196bdf348"} Jul 30 19:48:27.397936 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:48:27.397893 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hmpch" podStartSLOduration=1.40612667 podStartE2EDuration="2.3978741s" totalImagesPullingTime="991.74743ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 19:48:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 19:48:27.396909819 +0000 UTC m=+541.547989368" watchObservedRunningTime="2026-07-30 19:48:27.3978741 +0000 UTC m=+541.548953649" Jul 30 19:48:35.095640 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:48:35.095610 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 19:48:35.813767 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:48:35.813721 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hmpch" Jul 30 19:48:35.813959 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:48:35.813925 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hmpch" Jul 30 19:48:35.826400 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:48:35.826372 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hmpch" Jul 30 19:48:36.427545 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:48:36.427509 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hmpch" Jul 30 19:48:55.296313 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:48:55.296266 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 19:49:07.503784 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:49:07.503747 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 19:49:20.598285 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:49:20.598237 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-qnpxp"] Jul 30 19:49:20.604747 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:49:20.602428 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qnpxp" Jul 30 19:49:20.605540 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:49:20.605512 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 30 19:49:20.610269 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:49:20.610240 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-qnpxp"] Jul 30 19:49:20.672958 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:49:20.672917 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f63bacd2-abd6-4ce4-941b-4c7a126f345f-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qnpxp\" (UID: \"f63bacd2-abd6-4ce4-941b-4c7a126f345f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qnpxp" Jul 30 19:49:20.673139 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:49:20.673002 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f63bacd2-abd6-4ce4-941b-4c7a126f345f-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qnpxp\" (UID: \"f63bacd2-abd6-4ce4-941b-4c7a126f345f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qnpxp" Jul 30 19:49:20.673139 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:49:20.673032 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f63bacd2-abd6-4ce4-941b-4c7a126f345f-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qnpxp\" (UID: \"f63bacd2-abd6-4ce4-941b-4c7a126f345f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qnpxp" Jul 30 19:49:20.673139 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:49:20.673091 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f63bacd2-abd6-4ce4-941b-4c7a126f345f-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qnpxp\" (UID: \"f63bacd2-abd6-4ce4-941b-4c7a126f345f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qnpxp" Jul 30 19:49:20.673248 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:49:20.673234 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f63bacd2-abd6-4ce4-941b-4c7a126f345f-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qnpxp\" (UID: \"f63bacd2-abd6-4ce4-941b-4c7a126f345f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qnpxp" Jul 30 19:49:20.673301 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:49:20.673290 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-frhsv\" (UniqueName: \"kubernetes.io/projected/f63bacd2-abd6-4ce4-941b-4c7a126f345f-kube-api-access-frhsv\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qnpxp\" (UID: \"f63bacd2-abd6-4ce4-941b-4c7a126f345f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qnpxp" Jul 30 19:49:20.774178 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:49:20.774138 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f63bacd2-abd6-4ce4-941b-4c7a126f345f-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qnpxp\" (UID: \"f63bacd2-abd6-4ce4-941b-4c7a126f345f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qnpxp" Jul 30 19:49:20.774381 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:49:20.774189 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-frhsv\" (UniqueName: \"kubernetes.io/projected/f63bacd2-abd6-4ce4-941b-4c7a126f345f-kube-api-access-frhsv\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qnpxp\" (UID: \"f63bacd2-abd6-4ce4-941b-4c7a126f345f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qnpxp" Jul 30 19:49:20.774381 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:49:20.774220 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f63bacd2-abd6-4ce4-941b-4c7a126f345f-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qnpxp\" (UID: \"f63bacd2-abd6-4ce4-941b-4c7a126f345f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qnpxp" Jul 30 19:49:20.774381 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:49:20.774253 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f63bacd2-abd6-4ce4-941b-4c7a126f345f-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qnpxp\" (UID: \"f63bacd2-abd6-4ce4-941b-4c7a126f345f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qnpxp" Jul 30 19:49:20.774381 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:49:20.774293 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f63bacd2-abd6-4ce4-941b-4c7a126f345f-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qnpxp\" (UID: \"f63bacd2-abd6-4ce4-941b-4c7a126f345f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qnpxp" Jul 30 19:49:20.774381 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:49:20.774311 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f63bacd2-abd6-4ce4-941b-4c7a126f345f-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qnpxp\" (UID: \"f63bacd2-abd6-4ce4-941b-4c7a126f345f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qnpxp" Jul 30 19:49:20.774670 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:49:20.774644 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f63bacd2-abd6-4ce4-941b-4c7a126f345f-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qnpxp\" (UID: \"f63bacd2-abd6-4ce4-941b-4c7a126f345f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qnpxp" Jul 30 19:49:20.774722 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:49:20.774677 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f63bacd2-abd6-4ce4-941b-4c7a126f345f-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qnpxp\" (UID: \"f63bacd2-abd6-4ce4-941b-4c7a126f345f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qnpxp" Jul 30 19:49:20.774783 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:49:20.774726 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f63bacd2-abd6-4ce4-941b-4c7a126f345f-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qnpxp\" (UID: \"f63bacd2-abd6-4ce4-941b-4c7a126f345f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qnpxp" Jul 30 19:49:20.776557 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:49:20.776527 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f63bacd2-abd6-4ce4-941b-4c7a126f345f-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qnpxp\" (UID: \"f63bacd2-abd6-4ce4-941b-4c7a126f345f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qnpxp" Jul 30 19:49:20.776857 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:49:20.776841 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f63bacd2-abd6-4ce4-941b-4c7a126f345f-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qnpxp\" (UID: \"f63bacd2-abd6-4ce4-941b-4c7a126f345f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qnpxp" Jul 30 19:49:20.781814 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:49:20.781788 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-frhsv\" (UniqueName: \"kubernetes.io/projected/f63bacd2-abd6-4ce4-941b-4c7a126f345f-kube-api-access-frhsv\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qnpxp\" (UID: \"f63bacd2-abd6-4ce4-941b-4c7a126f345f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qnpxp" Jul 30 19:49:20.914817 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:49:20.914724 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qnpxp" Jul 30 19:49:21.040457 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:49:21.040401 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-qnpxp"] Jul 30 19:49:21.043940 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:49:21.043909 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf63bacd2_abd6_4ce4_941b_4c7a126f345f.slice/crio-a9968e93c80d638a68ab9af0bf2dcbca78184c865afcef533bed3041d9abec84 WatchSource:0}: Error finding container a9968e93c80d638a68ab9af0bf2dcbca78184c865afcef533bed3041d9abec84: Status 404 returned error can't find the container with id a9968e93c80d638a68ab9af0bf2dcbca78184c865afcef533bed3041d9abec84 Jul 30 19:49:21.595617 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:49:21.595531 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qnpxp" event={"ID":"f63bacd2-abd6-4ce4-941b-4c7a126f345f","Type":"ContainerStarted","Data":"e769bbb174e1a6f5c067442a88e920f4db0eefb8ecce0e0046f16cab1ffc399b"} Jul 30 19:49:21.595617 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:49:21.595578 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qnpxp" event={"ID":"f63bacd2-abd6-4ce4-941b-4c7a126f345f","Type":"ContainerStarted","Data":"a9968e93c80d638a68ab9af0bf2dcbca78184c865afcef533bed3041d9abec84"} Jul 30 19:49:21.614131 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:49:21.614080 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qnpxp" podStartSLOduration=1.439079955 podStartE2EDuration="1.614065139s" totalImagesPullingTime="174.985184ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 19:49:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 19:49:21.611858327 +0000 UTC m=+595.762937876" watchObservedRunningTime="2026-07-30 19:49:21.614065139 +0000 UTC m=+595.765144688" Jul 30 19:49:23.398742 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:49:23.398709 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 19:49:26.890308 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:49:26.890256 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-thh5h"] Jul 30 19:49:26.893524 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:49:26.893504 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-thh5h" Jul 30 19:49:26.896254 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:49:26.896232 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jul 30 19:49:26.903160 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:49:26.903134 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-thh5h"] Jul 30 19:49:26.922170 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:49:26.922140 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dee95f8b-20ea-4987-bf52-90ebf0a23e14-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-thh5h\" (UID: \"dee95f8b-20ea-4987-bf52-90ebf0a23e14\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-thh5h" Jul 30 19:49:26.922322 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:49:26.922180 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dee95f8b-20ea-4987-bf52-90ebf0a23e14-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-thh5h\" (UID: \"dee95f8b-20ea-4987-bf52-90ebf0a23e14\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-thh5h" Jul 30 19:49:26.922322 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:49:26.922199 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dee95f8b-20ea-4987-bf52-90ebf0a23e14-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-thh5h\" (UID: \"dee95f8b-20ea-4987-bf52-90ebf0a23e14\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-thh5h" Jul 30 19:49:26.922322 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:49:26.922225 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fv9rh\" (UniqueName: \"kubernetes.io/projected/dee95f8b-20ea-4987-bf52-90ebf0a23e14-kube-api-access-fv9rh\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-thh5h\" (UID: \"dee95f8b-20ea-4987-bf52-90ebf0a23e14\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-thh5h" Jul 30 19:49:26.922322 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:49:26.922268 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dee95f8b-20ea-4987-bf52-90ebf0a23e14-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-thh5h\" (UID: \"dee95f8b-20ea-4987-bf52-90ebf0a23e14\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-thh5h" Jul 30 19:49:26.922460 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:49:26.922351 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dee95f8b-20ea-4987-bf52-90ebf0a23e14-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-thh5h\" (UID: \"dee95f8b-20ea-4987-bf52-90ebf0a23e14\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-thh5h" Jul 30 19:49:27.023745 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:49:27.023708 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dee95f8b-20ea-4987-bf52-90ebf0a23e14-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-thh5h\" (UID: \"dee95f8b-20ea-4987-bf52-90ebf0a23e14\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-thh5h" Jul 30 19:49:27.023745 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:49:27.023749 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fv9rh\" (UniqueName: \"kubernetes.io/projected/dee95f8b-20ea-4987-bf52-90ebf0a23e14-kube-api-access-fv9rh\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-thh5h\" (UID: \"dee95f8b-20ea-4987-bf52-90ebf0a23e14\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-thh5h" Jul 30 19:49:27.023946 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:49:27.023845 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dee95f8b-20ea-4987-bf52-90ebf0a23e14-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-thh5h\" (UID: \"dee95f8b-20ea-4987-bf52-90ebf0a23e14\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-thh5h" Jul 30 19:49:27.023946 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:49:27.023876 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dee95f8b-20ea-4987-bf52-90ebf0a23e14-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-thh5h\" (UID: \"dee95f8b-20ea-4987-bf52-90ebf0a23e14\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-thh5h" Jul 30 19:49:27.023946 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:49:27.023913 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dee95f8b-20ea-4987-bf52-90ebf0a23e14-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-thh5h\" (UID: \"dee95f8b-20ea-4987-bf52-90ebf0a23e14\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-thh5h" Jul 30 19:49:27.024062 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:49:27.024035 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dee95f8b-20ea-4987-bf52-90ebf0a23e14-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-thh5h\" (UID: \"dee95f8b-20ea-4987-bf52-90ebf0a23e14\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-thh5h" Jul 30 19:49:27.024267 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:49:27.024246 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dee95f8b-20ea-4987-bf52-90ebf0a23e14-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-thh5h\" (UID: \"dee95f8b-20ea-4987-bf52-90ebf0a23e14\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-thh5h" Jul 30 19:49:27.024353 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:49:27.024311 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dee95f8b-20ea-4987-bf52-90ebf0a23e14-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-thh5h\" (UID: \"dee95f8b-20ea-4987-bf52-90ebf0a23e14\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-thh5h" Jul 30 19:49:27.024407 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:49:27.024356 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dee95f8b-20ea-4987-bf52-90ebf0a23e14-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-thh5h\" (UID: \"dee95f8b-20ea-4987-bf52-90ebf0a23e14\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-thh5h" Jul 30 19:49:27.026067 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:49:27.026042 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dee95f8b-20ea-4987-bf52-90ebf0a23e14-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-thh5h\" (UID: \"dee95f8b-20ea-4987-bf52-90ebf0a23e14\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-thh5h" Jul 30 19:49:27.026474 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:49:27.026457 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dee95f8b-20ea-4987-bf52-90ebf0a23e14-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-thh5h\" (UID: \"dee95f8b-20ea-4987-bf52-90ebf0a23e14\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-thh5h" Jul 30 19:49:27.031260 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:49:27.031234 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fv9rh\" (UniqueName: \"kubernetes.io/projected/dee95f8b-20ea-4987-bf52-90ebf0a23e14-kube-api-access-fv9rh\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-thh5h\" (UID: \"dee95f8b-20ea-4987-bf52-90ebf0a23e14\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-thh5h" Jul 30 19:49:27.204127 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:49:27.204042 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-thh5h" Jul 30 19:49:27.329092 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:49:27.329067 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-thh5h"] Jul 30 19:49:27.331047 ip-10-0-136-46 kubenswrapper[2555]: W0730 19:49:27.331013 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddee95f8b_20ea_4987_bf52_90ebf0a23e14.slice/crio-2ecd14b00db60df737f3b7960e2e825bf320ff808272e36ad586aba2c0e33cdc WatchSource:0}: Error finding container 2ecd14b00db60df737f3b7960e2e825bf320ff808272e36ad586aba2c0e33cdc: Status 404 returned error can't find the container with id 2ecd14b00db60df737f3b7960e2e825bf320ff808272e36ad586aba2c0e33cdc Jul 30 19:49:27.626711 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:49:27.626670 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-thh5h" event={"ID":"dee95f8b-20ea-4987-bf52-90ebf0a23e14","Type":"ContainerStarted","Data":"7ed97482618ca3146328705165dc5fdf2a5d73dae96b9c81011271d361e635c1"} Jul 30 19:49:27.626888 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:49:27.626719 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-thh5h" event={"ID":"dee95f8b-20ea-4987-bf52-90ebf0a23e14","Type":"ContainerStarted","Data":"2ecd14b00db60df737f3b7960e2e825bf320ff808272e36ad586aba2c0e33cdc"} Jul 30 19:49:27.642454 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:49:27.642410 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-thh5h" podStartSLOduration=1.454070719 podStartE2EDuration="1.64239291s" totalImagesPullingTime="188.322191ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 19:49:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 19:49:27.641225638 +0000 UTC m=+601.792305191" watchObservedRunningTime="2026-07-30 19:49:27.64239291 +0000 UTC m=+601.793472438" Jul 30 19:49:30.915573 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:49:30.915533 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qnpxp" Jul 30 19:49:30.915945 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:49:30.915607 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qnpxp" Jul 30 19:49:30.928244 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:49:30.928221 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qnpxp" Jul 30 19:49:31.657912 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:49:31.657887 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qnpxp" Jul 30 19:49:37.204929 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:49:37.204895 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-thh5h" Jul 30 19:49:37.205388 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:49:37.205049 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-thh5h" Jul 30 19:49:37.217085 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:49:37.217061 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-thh5h" Jul 30 19:49:37.496338 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:49:37.496305 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 19:49:37.682066 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:49:37.682039 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-thh5h" Jul 30 19:50:49.898814 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:50:49.898786 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 19:51:00.495822 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:51:00.495783 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 19:51:11.404664 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:51:11.404635 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 19:52:50.404521 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:52:50.404446 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 19:53:58.890969 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:53:58.890935 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 19:54:08.589463 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:54:08.589425 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 19:54:23.690210 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:54:23.690174 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 19:54:32.401446 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:54:32.401418 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 19:54:41.893522 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:54:41.893482 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 19:54:52.598719 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:54:52.598681 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 19:55:04.089883 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:55:04.089851 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 19:55:13.394061 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:55:13.394025 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 19:55:34.712660 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:55:34.712625 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 19:55:45.699113 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:55:45.699078 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 19:56:08.297781 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:56:08.297746 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 19:56:18.700334 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:56:18.700292 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 19:56:34.799134 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:56:34.799098 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 19:56:44.594710 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:56:44.594673 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 19:57:00.298695 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:57:00.298660 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 19:57:09.500005 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:57:09.499973 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 19:57:17.700847 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:57:17.700816 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 19:57:27.300194 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:57:27.300118 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 19:57:35.808480 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:57:35.808444 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 19:57:48.199219 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:57:48.199188 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 19:57:58.992332 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:57:58.992293 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 19:58:07.892171 ip-10-0-136-46 kubenswrapper[2555]: I0730 19:58:07.892136 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 20:00:18.099982 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:00:18.099951 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 20:00:25.992042 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:00:25.991966 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 20:00:48.597201 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:00:48.597166 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 20:00:58.796641 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:00:58.796606 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 20:01:07.896066 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:01:07.896030 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 20:01:17.390026 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:01:17.389991 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 20:01:26.294818 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:01:26.294782 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 20:01:35.496396 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:01:35.496359 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 20:01:46.307435 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:01:46.307400 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 20:01:58.199070 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:01:58.199033 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 20:02:07.703304 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:02:07.703261 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 20:02:19.292704 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:02:19.292666 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 20:02:41.201395 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:02:41.201360 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 20:02:50.299564 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:02:50.299520 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 20:03:02.596504 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:03:02.596468 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 20:03:18.594328 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:03:18.594226 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 20:03:28.191550 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:03:28.191518 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 20:03:42.093846 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:03:42.093808 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 20:03:51.999849 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:03:51.999812 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 20:04:05.397474 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:04:05.397439 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 20:04:20.598783 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:04:20.598748 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 20:04:30.892904 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:04:30.892863 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 20:04:42.299149 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:04:42.299106 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 20:04:52.095909 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:04:52.095869 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 20:05:01.494428 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:05:01.494392 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 20:05:14.893605 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:05:14.893564 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 20:05:23.495603 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:05:23.495569 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 20:05:32.797799 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:05:32.797764 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 20:05:42.700007 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:05:42.699975 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 20:05:54.291997 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:05:54.291965 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 20:06:04.501620 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:06:04.501583 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 20:06:16.803560 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:06:16.803517 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 20:06:27.496362 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:06:27.496264 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 20:06:34.003628 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:06:34.003592 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 20:06:48.203632 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:06:48.203597 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 20:06:57.187404 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:06:57.187366 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 20:07:10.796779 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:07:10.796725 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 20:07:25.496166 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:07:25.496129 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 20:07:34.797951 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:07:34.797915 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 20:07:45.205489 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:07:45.205448 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 20:07:55.994651 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:07:55.994574 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 20:08:13.400030 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:08:13.399994 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 20:08:25.497027 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:08:25.496987 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 20:08:47.587345 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:08:47.587307 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 20:09:00.795051 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:09:00.795016 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 20:09:34.795415 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:09:34.795376 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 20:09:46.701795 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:09:46.701764 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 20:10:10.991783 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:10:10.991744 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 20:10:33.499818 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:10:33.499783 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 20:12:01.706598 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:12:01.706558 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 20:12:13.105751 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:12:13.105711 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 20:12:23.894415 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:12:23.894333 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 20:13:07.697386 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:13:07.697357 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 20:13:43.598111 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:13:43.598076 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 20:15:30.103596 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:15:30.103562 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 20:15:40.587967 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:15:40.587929 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 20:16:07.494036 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:16:07.494002 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 20:16:27.194162 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:16:27.194122 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 20:16:53.915213 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:16:53.915178 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 20:17:03.799680 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:17:03.799647 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 20:17:49.495432 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:17:49.495393 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 20:18:00.910640 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:18:00.910599 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 20:18:12.425982 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:18:12.425953 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 20:19:02.998465 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:19:02.998428 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 20:19:32.703422 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:19:32.703390 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 20:19:55.791846 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:19:55.791810 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 20:20:06.698729 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:20:06.698697 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 20:20:29.492910 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:20:29.492876 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 20:20:42.896823 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:20:42.896786 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 20:21:05.859311 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:21:05.859264 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-478a06-n9xpt"] Jul 30 20:21:05.862399 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:21:05.862384 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-478a06-n9xpt" Jul 30 20:21:05.865038 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:21:05.865015 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 30 20:21:05.865195 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:21:05.865076 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mgdxn\"" Jul 30 20:21:05.868843 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:21:05.868820 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-478a06-n9xpt"] Jul 30 20:21:05.923736 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:21:05.923706 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/001c5f67-fabd-4cce-8c08-9f4d4d60410f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-478a06-n9xpt\" (UID: \"001c5f67-fabd-4cce-8c08-9f4d4d60410f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-478a06-n9xpt" Jul 30 20:21:06.024693 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:21:06.024664 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/001c5f67-fabd-4cce-8c08-9f4d4d60410f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-478a06-n9xpt\" (UID: \"001c5f67-fabd-4cce-8c08-9f4d4d60410f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-478a06-n9xpt" Jul 30 20:21:06.025335 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:21:06.025318 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/001c5f67-fabd-4cce-8c08-9f4d4d60410f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-478a06-n9xpt\" (UID: \"001c5f67-fabd-4cce-8c08-9f4d4d60410f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-478a06-n9xpt" Jul 30 20:21:06.173424 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:21:06.173343 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-478a06-n9xpt" Jul 30 20:21:06.298655 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:21:06.298629 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-478a06-n9xpt"] Jul 30 20:21:06.304158 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:21:06.304138 2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 30 20:21:06.320054 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:21:06.320025 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-478a06-n9xpt" event={"ID":"001c5f67-fabd-4cce-8c08-9f4d4d60410f","Type":"ContainerStarted","Data":"eead1763ab917cd6ba717f08b527cd04718971cce2e5a9d5953c4eb0fd635c92"} Jul 30 20:21:09.701913 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:21:09.701843 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 20:21:10.337676 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:21:10.337597 2555 generic.go:356] "Generic (PLEG): container finished" podID="001c5f67-fabd-4cce-8c08-9f4d4d60410f" containerID="bee9b75e169240a67602e26956043fbe8add1ceceac1fc524d478fd1cd165ca4" exitCode=0 Jul 30 20:21:10.337827 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:21:10.337678 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-478a06-n9xpt" event={"ID":"001c5f67-fabd-4cce-8c08-9f4d4d60410f","Type":"ContainerDied","Data":"bee9b75e169240a67602e26956043fbe8add1ceceac1fc524d478fd1cd165ca4"} Jul 30 20:21:11.466895 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:21:11.466873 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-478a06-n9xpt" Jul 30 20:21:11.576331 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:21:11.576300 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/001c5f67-fabd-4cce-8c08-9f4d4d60410f-maas-api-service-ca\") pod \"001c5f67-fabd-4cce-8c08-9f4d4d60410f\" (UID: \"001c5f67-fabd-4cce-8c08-9f4d4d60410f\") " Jul 30 20:21:11.576665 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:21:11.576638 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/001c5f67-fabd-4cce-8c08-9f4d4d60410f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "001c5f67-fabd-4cce-8c08-9f4d4d60410f" (UID: "001c5f67-fabd-4cce-8c08-9f4d4d60410f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 20:21:11.676951 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:21:11.676877 2555 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/001c5f67-fabd-4cce-8c08-9f4d4d60410f-maas-api-service-ca\") on node \"ip-10-0-136-46.ec2.internal\" DevicePath \"\"" Jul 30 20:21:12.346654 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:21:12.346617 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-478a06-n9xpt" event={"ID":"001c5f67-fabd-4cce-8c08-9f4d4d60410f","Type":"ContainerDied","Data":"eead1763ab917cd6ba717f08b527cd04718971cce2e5a9d5953c4eb0fd635c92"} Jul 30 20:21:12.346654 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:21:12.346653 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-478a06-n9xpt" Jul 30 20:21:12.346823 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:21:12.346663 2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="eead1763ab917cd6ba717f08b527cd04718971cce2e5a9d5953c4eb0fd635c92" Jul 30 20:21:16.488678 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:21:16.488639 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-478a06-n9xpt"] Jul 30 20:21:16.492070 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:21:16.492045 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-478a06-n9xpt"] Jul 30 20:21:18.314591 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:21:18.314559 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="001c5f67-fabd-4cce-8c08-9f4d4d60410f" path="/var/lib/kubelet/pods/001c5f67-fabd-4cce-8c08-9f4d4d60410f/volumes" Jul 30 20:21:25.300696 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:21:25.300660 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 20:21:36.701858 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:21:36.701820 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 20:21:49.496483 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:21:49.496451 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 20:22:21.190920 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:22:21.190879 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 20:22:40.230250 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:22:40.230207 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-d0b78d-6ksdz"] Jul 30 20:22:40.230776 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:22:40.230657 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="001c5f67-fabd-4cce-8c08-9f4d4d60410f" containerName="revoke-keys" Jul 30 20:22:40.230776 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:22:40.230675 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="001c5f67-fabd-4cce-8c08-9f4d4d60410f" containerName="revoke-keys" Jul 30 20:22:40.230776 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:22:40.230762 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="001c5f67-fabd-4cce-8c08-9f4d4d60410f" containerName="revoke-keys" Jul 30 20:22:40.232636 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:22:40.232617 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-d0b78d-6ksdz" Jul 30 20:22:40.235403 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:22:40.235383 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 30 20:22:40.235497 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:22:40.235456 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mgdxn\"" Jul 30 20:22:40.241405 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:22:40.241377 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-d0b78d-6ksdz"] Jul 30 20:22:40.294129 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:22:40.294090 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6aa82548-4fd5-454d-8dfb-baa656e8ef55-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-d0b78d-6ksdz\" (UID: \"6aa82548-4fd5-454d-8dfb-baa656e8ef55\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-d0b78d-6ksdz" Jul 30 20:22:40.395519 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:22:40.395474 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6aa82548-4fd5-454d-8dfb-baa656e8ef55-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-d0b78d-6ksdz\" (UID: \"6aa82548-4fd5-454d-8dfb-baa656e8ef55\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-d0b78d-6ksdz" Jul 30 20:22:40.396120 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:22:40.396099 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6aa82548-4fd5-454d-8dfb-baa656e8ef55-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-d0b78d-6ksdz\" (UID: \"6aa82548-4fd5-454d-8dfb-baa656e8ef55\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-d0b78d-6ksdz" Jul 30 20:22:40.543491 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:22:40.543398 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-d0b78d-6ksdz" Jul 30 20:22:40.670137 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:22:40.670098 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-d0b78d-6ksdz"] Jul 30 20:22:40.673297 ip-10-0-136-46 kubenswrapper[2555]: W0730 20:22:40.673243 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6aa82548_4fd5_454d_8dfb_baa656e8ef55.slice/crio-b2aff6465a5ff5c02306e1de3e8728ff098e7eb3a8257fb078538713ae73d5bf WatchSource:0}: Error finding container b2aff6465a5ff5c02306e1de3e8728ff098e7eb3a8257fb078538713ae73d5bf: Status 404 returned error can't find the container with id b2aff6465a5ff5c02306e1de3e8728ff098e7eb3a8257fb078538713ae73d5bf Jul 30 20:22:40.704552 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:22:40.704527 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-d0b78d-6ksdz" event={"ID":"6aa82548-4fd5-454d-8dfb-baa656e8ef55","Type":"ContainerStarted","Data":"b2aff6465a5ff5c02306e1de3e8728ff098e7eb3a8257fb078538713ae73d5bf"} Jul 30 20:22:41.710383 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:22:41.710292 2555 generic.go:356] "Generic (PLEG): container finished" podID="6aa82548-4fd5-454d-8dfb-baa656e8ef55" containerID="3f5e16e91d4d8e52cb0db0e026d997dd82447b1c24aa4dc7ffc50e245e6c157b" exitCode=0 Jul 30 20:22:41.710383 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:22:41.710369 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-d0b78d-6ksdz" event={"ID":"6aa82548-4fd5-454d-8dfb-baa656e8ef55","Type":"ContainerDied","Data":"3f5e16e91d4d8e52cb0db0e026d997dd82447b1c24aa4dc7ffc50e245e6c157b"} Jul 30 20:22:42.844865 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:22:42.844838 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-d0b78d-6ksdz" Jul 30 20:22:42.919937 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:22:42.919902 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6aa82548-4fd5-454d-8dfb-baa656e8ef55-maas-api-service-ca\") pod \"6aa82548-4fd5-454d-8dfb-baa656e8ef55\" (UID: \"6aa82548-4fd5-454d-8dfb-baa656e8ef55\") " Jul 30 20:22:42.920343 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:22:42.920325 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6aa82548-4fd5-454d-8dfb-baa656e8ef55-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "6aa82548-4fd5-454d-8dfb-baa656e8ef55" (UID: "6aa82548-4fd5-454d-8dfb-baa656e8ef55"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 20:22:43.021452 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:22:43.021378 2555 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6aa82548-4fd5-454d-8dfb-baa656e8ef55-maas-api-service-ca\") on node \"ip-10-0-136-46.ec2.internal\" DevicePath \"\"" Jul 30 20:22:43.719722 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:22:43.719683 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-d0b78d-6ksdz" event={"ID":"6aa82548-4fd5-454d-8dfb-baa656e8ef55","Type":"ContainerDied","Data":"b2aff6465a5ff5c02306e1de3e8728ff098e7eb3a8257fb078538713ae73d5bf"} Jul 30 20:22:43.719722 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:22:43.719718 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-d0b78d-6ksdz" Jul 30 20:22:43.719936 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:22:43.719738 2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b2aff6465a5ff5c02306e1de3e8728ff098e7eb3a8257fb078538713ae73d5bf" Jul 30 20:22:56.545885 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:22:56.545847 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-d0b78d-6ksdz"] Jul 30 20:22:56.551888 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:22:56.551860 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-d0b78d-6ksdz"] Jul 30 20:22:58.313691 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:22:58.313659 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6aa82548-4fd5-454d-8dfb-baa656e8ef55" path="/var/lib/kubelet/pods/6aa82548-4fd5-454d-8dfb-baa656e8ef55/volumes" Jul 30 20:23:02.499418 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:23:02.499379 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 20:23:03.477070 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:23:03.477041 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-671642-ccnvj"] Jul 30 20:23:03.477355 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:23:03.477342 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6aa82548-4fd5-454d-8dfb-baa656e8ef55" containerName="revoke-keys" Jul 30 20:23:03.477405 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:23:03.477357 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="6aa82548-4fd5-454d-8dfb-baa656e8ef55" containerName="revoke-keys" Jul 30 20:23:03.477439 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:23:03.477420 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="6aa82548-4fd5-454d-8dfb-baa656e8ef55" containerName="revoke-keys" Jul 30 20:23:03.479447 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:23:03.479421 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-671642-ccnvj" Jul 30 20:23:03.482308 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:23:03.482269 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 30 20:23:03.483358 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:23:03.483334 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mgdxn\"" Jul 30 20:23:03.491183 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:23:03.491164 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-671642-ccnvj"] Jul 30 20:23:03.596144 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:23:03.596104 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0bb49e8e-d76f-4981-a336-ac801919b781-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-671642-ccnvj\" (UID: \"0bb49e8e-d76f-4981-a336-ac801919b781\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-671642-ccnvj" Jul 30 20:23:03.696607 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:23:03.696572 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0bb49e8e-d76f-4981-a336-ac801919b781-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-671642-ccnvj\" (UID: \"0bb49e8e-d76f-4981-a336-ac801919b781\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-671642-ccnvj" Jul 30 20:23:03.697249 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:23:03.697223 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0bb49e8e-d76f-4981-a336-ac801919b781-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-671642-ccnvj\" (UID: \"0bb49e8e-d76f-4981-a336-ac801919b781\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-671642-ccnvj" Jul 30 20:23:03.789669 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:23:03.789587 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-671642-ccnvj" Jul 30 20:23:03.914734 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:23:03.914710 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-671642-ccnvj"] Jul 30 20:23:03.916771 ip-10-0-136-46 kubenswrapper[2555]: W0730 20:23:03.916740 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0bb49e8e_d76f_4981_a336_ac801919b781.slice/crio-2fe2b953215c8b93d2082ebb7c36ccfd58b831ab8c07aea4de65a823235dfba9 WatchSource:0}: Error finding container 2fe2b953215c8b93d2082ebb7c36ccfd58b831ab8c07aea4de65a823235dfba9: Status 404 returned error can't find the container with id 2fe2b953215c8b93d2082ebb7c36ccfd58b831ab8c07aea4de65a823235dfba9 Jul 30 20:23:04.805824 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:23:04.805738 2555 generic.go:356] "Generic (PLEG): container finished" podID="0bb49e8e-d76f-4981-a336-ac801919b781" containerID="c5c8613459a926e0d193e52160d56443d067f1fc8507bf0c247d31ae18d48ded" exitCode=0 Jul 30 20:23:04.806167 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:23:04.805820 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-671642-ccnvj" event={"ID":"0bb49e8e-d76f-4981-a336-ac801919b781","Type":"ContainerDied","Data":"c5c8613459a926e0d193e52160d56443d067f1fc8507bf0c247d31ae18d48ded"} Jul 30 20:23:04.806167 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:23:04.805877 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-671642-ccnvj" event={"ID":"0bb49e8e-d76f-4981-a336-ac801919b781","Type":"ContainerStarted","Data":"2fe2b953215c8b93d2082ebb7c36ccfd58b831ab8c07aea4de65a823235dfba9"} Jul 30 20:23:05.930794 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:23:05.930771 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-671642-ccnvj" Jul 30 20:23:06.013453 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:23:06.013421 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0bb49e8e-d76f-4981-a336-ac801919b781-maas-api-service-ca\") pod \"0bb49e8e-d76f-4981-a336-ac801919b781\" (UID: \"0bb49e8e-d76f-4981-a336-ac801919b781\") " Jul 30 20:23:06.013778 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:23:06.013747 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0bb49e8e-d76f-4981-a336-ac801919b781-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "0bb49e8e-d76f-4981-a336-ac801919b781" (UID: "0bb49e8e-d76f-4981-a336-ac801919b781"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 20:23:06.114332 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:23:06.114243 2555 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0bb49e8e-d76f-4981-a336-ac801919b781-maas-api-service-ca\") on node \"ip-10-0-136-46.ec2.internal\" DevicePath \"\"" Jul 30 20:23:06.817898 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:23:06.817870 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-671642-ccnvj" Jul 30 20:23:06.817898 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:23:06.817878 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-671642-ccnvj" event={"ID":"0bb49e8e-d76f-4981-a336-ac801919b781","Type":"ContainerDied","Data":"2fe2b953215c8b93d2082ebb7c36ccfd58b831ab8c07aea4de65a823235dfba9"} Jul 30 20:23:06.818149 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:23:06.817921 2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2fe2b953215c8b93d2082ebb7c36ccfd58b831ab8c07aea4de65a823235dfba9" Jul 30 20:23:19.201479 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:23:19.201437 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-671642-ccnvj"] Jul 30 20:23:19.205370 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:23:19.205328 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-671642-ccnvj"] Jul 30 20:23:20.314517 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:23:20.314487 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0bb49e8e-d76f-4981-a336-ac801919b781" path="/var/lib/kubelet/pods/0bb49e8e-d76f-4981-a336-ac801919b781/volumes" Jul 30 20:23:23.895162 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:23:23.895084 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 20:23:35.594742 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:23:35.594708 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 20:24:05.001650 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:24:05.001612 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 20:24:36.196786 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:24:36.196752 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 20:25:00.195130 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:25:00.195097 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 20:25:23.806694 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:25:23.806660 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 20:25:49.494549 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:25:49.494469 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 20:26:07.698823 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:26:07.698785 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 20:26:33.996131 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:26:33.996082 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 20:26:52.302964 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:26:52.299796 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 20:27:17.599782 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:27:17.599744 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 20:27:26.494183 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:27:26.494109 2555 scope.go:117] "RemoveContainer" containerID="bee9b75e169240a67602e26956043fbe8add1ceceac1fc524d478fd1cd165ca4" Jul 30 20:27:34.905485 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:27:34.905446 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 20:28:02.001085 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:28:02.001045 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 20:28:15.602721 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:28:15.602686 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 20:28:27.196567 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:28:27.196526 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 20:28:47.604518 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:28:47.604478 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 20:29:05.299331 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:29:05.299296 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 20:29:26.517872 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:29:26.517835 2555 scope.go:117] "RemoveContainer" containerID="c5c8613459a926e0d193e52160d56443d067f1fc8507bf0c247d31ae18d48ded" Jul 30 20:29:26.525538 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:29:26.525517 2555 scope.go:117] "RemoveContainer" containerID="3f5e16e91d4d8e52cb0db0e026d997dd82447b1c24aa4dc7ffc50e245e6c157b" Jul 30 20:29:32.100707 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:29:32.100672 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 20:29:48.891438 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:29:48.891396 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 20:30:00.132798 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:30:00.132761 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-474e8f-29757390-2t4kv"] Jul 30 20:30:00.133394 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:30:00.133227 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0bb49e8e-d76f-4981-a336-ac801919b781" containerName="revoke-keys" Jul 30 20:30:00.133394 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:30:00.133244 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="0bb49e8e-d76f-4981-a336-ac801919b781" containerName="revoke-keys" Jul 30 20:30:00.133394 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:30:00.133375 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="0bb49e8e-d76f-4981-a336-ac801919b781" containerName="revoke-keys" Jul 30 20:30:00.136305 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:30:00.136265 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-474e8f-29757390-2t4kv" Jul 30 20:30:00.139845 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:30:00.139824 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mgdxn\"" Jul 30 20:30:00.140539 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:30:00.140517 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-808798-29757390-x4rb4"] Jul 30 20:30:00.143856 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:30:00.143835 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29757390-gzqlz"] Jul 30 20:30:00.143968 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:30:00.143943 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-808798-29757390-x4rb4" Jul 30 20:30:00.147226 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:30:00.147200 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-474e8f-29757390-2t4kv" Jul 30 20:30:00.147382 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:30:00.147361 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-474e8f-29757390-2t4kv"] Jul 30 20:30:00.147496 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:30:00.147451 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757390-gzqlz" Jul 30 20:30:00.154750 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:30:00.153461 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-808798-29757390-x4rb4"] Jul 30 20:30:00.161038 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:30:00.160914 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29757390-gzqlz"] Jul 30 20:30:00.180742 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:30:00.180703 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-808798-29757390-x4rb4" Jul 30 20:30:00.188027 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:30:00.188001 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757390-gzqlz" Jul 30 20:30:00.315988 ip-10-0-136-46 kubenswrapper[2555]: W0730 20:30:00.315955 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43029fa8_995a_47f0_bd0c_1f55a2d37a9e.slice/crio-f6e68033c7f7446f18143d8e573f62a94540196d2d11dbe85c45f2762e411ad4 WatchSource:0}: Error finding container f6e68033c7f7446f18143d8e573f62a94540196d2d11dbe85c45f2762e411ad4: Status 404 returned error can't find the container with id f6e68033c7f7446f18143d8e573f62a94540196d2d11dbe85c45f2762e411ad4 Jul 30 20:30:00.317324 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:30:00.317299 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-474e8f-29757390-2t4kv"] Jul 30 20:30:00.346168 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:30:00.346144 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-808798-29757390-x4rb4"] Jul 30 20:30:00.349407 ip-10-0-136-46 kubenswrapper[2555]: W0730 20:30:00.349369 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5de0a0f7_28dc_4466_8a6e_0074748df30b.slice/crio-be9556626b7bbb02de154cc50e44ea5eee437816ff1721923bcc0df60b664e3c WatchSource:0}: Error finding container be9556626b7bbb02de154cc50e44ea5eee437816ff1721923bcc0df60b664e3c: Status 404 returned error can't find the container with id be9556626b7bbb02de154cc50e44ea5eee437816ff1721923bcc0df60b664e3c Jul 30 20:30:00.360690 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:30:00.360666 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29757390-gzqlz"] Jul 30 20:30:00.363495 ip-10-0-136-46 kubenswrapper[2555]: W0730 20:30:00.363399 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22e48f7c_d0f9_42f4_a08c_7f0699739c69.slice/crio-bdd1912db261340f6a40e564cb10a6db7bd5ee1c453bf7f6570e5e4b94fbdd38 WatchSource:0}: Error finding container bdd1912db261340f6a40e564cb10a6db7bd5ee1c453bf7f6570e5e4b94fbdd38: Status 404 returned error can't find the container with id bdd1912db261340f6a40e564cb10a6db7bd5ee1c453bf7f6570e5e4b94fbdd38 Jul 30 20:30:00.514431 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:30:00.514399 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-808798-29757390-x4rb4" event={"ID":"5de0a0f7-28dc-4466-8a6e-0074748df30b","Type":"ContainerStarted","Data":"be9556626b7bbb02de154cc50e44ea5eee437816ff1721923bcc0df60b664e3c"} Jul 30 20:30:00.515365 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:30:00.515336 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757390-gzqlz" event={"ID":"22e48f7c-d0f9-42f4-a08c-7f0699739c69","Type":"ContainerStarted","Data":"bdd1912db261340f6a40e564cb10a6db7bd5ee1c453bf7f6570e5e4b94fbdd38"} Jul 30 20:30:00.516351 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:30:00.516328 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-474e8f-29757390-2t4kv" event={"ID":"43029fa8-995a-47f0-bd0c-1f55a2d37a9e","Type":"ContainerStarted","Data":"f6e68033c7f7446f18143d8e573f62a94540196d2d11dbe85c45f2762e411ad4"} Jul 30 20:30:01.524665 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:30:01.524572 2555 generic.go:356] "Generic (PLEG): container finished" podID="5de0a0f7-28dc-4466-8a6e-0074748df30b" containerID="11faaf1bfc085105bac5500982bf8df8576bbb6c56baa2796b97fea61176f61e" exitCode=0 Jul 30 20:30:01.525093 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:30:01.524665 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-808798-29757390-x4rb4" event={"ID":"5de0a0f7-28dc-4466-8a6e-0074748df30b","Type":"ContainerDied","Data":"11faaf1bfc085105bac5500982bf8df8576bbb6c56baa2796b97fea61176f61e"} Jul 30 20:30:01.526058 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:30:01.526034 2555 generic.go:356] "Generic (PLEG): container finished" podID="22e48f7c-d0f9-42f4-a08c-7f0699739c69" containerID="466002d4d9908a8a852d9f24c9c326c09f21510ee48966f41aa857cdbbfe12f3" exitCode=0 Jul 30 20:30:01.526156 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:30:01.526117 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757390-gzqlz" event={"ID":"22e48f7c-d0f9-42f4-a08c-7f0699739c69","Type":"ContainerDied","Data":"466002d4d9908a8a852d9f24c9c326c09f21510ee48966f41aa857cdbbfe12f3"} Jul 30 20:30:01.527439 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:30:01.527418 2555 generic.go:356] "Generic (PLEG): container finished" podID="43029fa8-995a-47f0-bd0c-1f55a2d37a9e" containerID="aa1854e15a69d66b7190e27a9e930e7ecf88f28da3557ee2cbd283a5acb2616c" exitCode=0 Jul 30 20:30:01.527523 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:30:01.527468 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-474e8f-29757390-2t4kv" event={"ID":"43029fa8-995a-47f0-bd0c-1f55a2d37a9e","Type":"ContainerDied","Data":"aa1854e15a69d66b7190e27a9e930e7ecf88f28da3557ee2cbd283a5acb2616c"} Jul 30 20:30:02.691062 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:30:02.691035 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-808798-29757390-x4rb4" Jul 30 20:30:02.729742 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:30:02.729717 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-474e8f-29757390-2t4kv" Jul 30 20:30:02.732563 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:30:02.732546 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757390-gzqlz" Jul 30 20:30:03.537216 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:30:03.537187 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757390-gzqlz" Jul 30 20:30:03.537426 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:30:03.537193 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757390-gzqlz" event={"ID":"22e48f7c-d0f9-42f4-a08c-7f0699739c69","Type":"ContainerDied","Data":"bdd1912db261340f6a40e564cb10a6db7bd5ee1c453bf7f6570e5e4b94fbdd38"} Jul 30 20:30:03.537426 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:30:03.537326 2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bdd1912db261340f6a40e564cb10a6db7bd5ee1c453bf7f6570e5e4b94fbdd38" Jul 30 20:30:03.538430 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:30:03.538412 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-474e8f-29757390-2t4kv" Jul 30 20:30:03.538534 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:30:03.538449 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-474e8f-29757390-2t4kv" event={"ID":"43029fa8-995a-47f0-bd0c-1f55a2d37a9e","Type":"ContainerDied","Data":"f6e68033c7f7446f18143d8e573f62a94540196d2d11dbe85c45f2762e411ad4"} Jul 30 20:30:03.538534 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:30:03.538486 2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f6e68033c7f7446f18143d8e573f62a94540196d2d11dbe85c45f2762e411ad4" Jul 30 20:30:03.539777 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:30:03.539756 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-808798-29757390-x4rb4" event={"ID":"5de0a0f7-28dc-4466-8a6e-0074748df30b","Type":"ContainerDied","Data":"be9556626b7bbb02de154cc50e44ea5eee437816ff1721923bcc0df60b664e3c"} Jul 30 20:30:03.539777 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:30:03.539766 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-808798-29757390-x4rb4" Jul 30 20:30:03.539937 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:30:03.539787 2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="be9556626b7bbb02de154cc50e44ea5eee437816ff1721923bcc0df60b664e3c" Jul 30 20:30:03.599581 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:30:03.599529 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 20:30:18.012521 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:30:18.012486 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4hr7g"] Jul 30 20:30:18.012894 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:30:18.012793 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="43029fa8-995a-47f0-bd0c-1f55a2d37a9e" containerName="cleanup" Jul 30 20:30:18.012894 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:30:18.012804 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="43029fa8-995a-47f0-bd0c-1f55a2d37a9e" containerName="cleanup" Jul 30 20:30:18.012894 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:30:18.012816 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="22e48f7c-d0f9-42f4-a08c-7f0699739c69" containerName="cleanup" Jul 30 20:30:18.012894 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:30:18.012822 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="22e48f7c-d0f9-42f4-a08c-7f0699739c69" containerName="cleanup" Jul 30 20:30:18.012894 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:30:18.012830 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5de0a0f7-28dc-4466-8a6e-0074748df30b" containerName="cleanup" Jul 30 20:30:18.012894 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:30:18.012836 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="5de0a0f7-28dc-4466-8a6e-0074748df30b" containerName="cleanup" Jul 30 20:30:18.012894 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:30:18.012890 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="5de0a0f7-28dc-4466-8a6e-0074748df30b" containerName="cleanup" Jul 30 20:30:18.012894 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:30:18.012896 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="43029fa8-995a-47f0-bd0c-1f55a2d37a9e" containerName="cleanup" Jul 30 20:30:18.013138 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:30:18.012903 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="22e48f7c-d0f9-42f4-a08c-7f0699739c69" containerName="cleanup" Jul 30 20:30:18.015493 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:30:18.015477 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-4hr7g" Jul 30 20:30:18.017987 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:30:18.017968 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-hsfjv\"" Jul 30 20:30:18.024675 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:30:18.024652 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4hr7g"] Jul 30 20:30:18.111426 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:30:18.111395 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bpbqp\" (UniqueName: \"kubernetes.io/projected/0fdb29c9-99e1-4ce0-951c-09e15b525afb-kube-api-access-bpbqp\") pod \"kuadrant-operator-catalog-4hr7g\" (UID: \"0fdb29c9-99e1-4ce0-951c-09e15b525afb\") " pod="kuadrant-system/kuadrant-operator-catalog-4hr7g" Jul 30 20:30:18.212084 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:30:18.212051 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bpbqp\" (UniqueName: \"kubernetes.io/projected/0fdb29c9-99e1-4ce0-951c-09e15b525afb-kube-api-access-bpbqp\") pod \"kuadrant-operator-catalog-4hr7g\" (UID: \"0fdb29c9-99e1-4ce0-951c-09e15b525afb\") " pod="kuadrant-system/kuadrant-operator-catalog-4hr7g" Jul 30 20:30:18.220650 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:30:18.220628 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bpbqp\" (UniqueName: \"kubernetes.io/projected/0fdb29c9-99e1-4ce0-951c-09e15b525afb-kube-api-access-bpbqp\") pod \"kuadrant-operator-catalog-4hr7g\" (UID: \"0fdb29c9-99e1-4ce0-951c-09e15b525afb\") " pod="kuadrant-system/kuadrant-operator-catalog-4hr7g" Jul 30 20:30:18.325282 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:30:18.325179 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-4hr7g" Jul 30 20:30:18.458955 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:30:18.458934 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4hr7g"] Jul 30 20:30:18.461213 ip-10-0-136-46 kubenswrapper[2555]: W0730 20:30:18.461184 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fdb29c9_99e1_4ce0_951c_09e15b525afb.slice/crio-3850c3e1f3c5115a3502e6c32f0d393f3a4617450c8ef58b85d6f9409b9dbab8 WatchSource:0}: Error finding container 3850c3e1f3c5115a3502e6c32f0d393f3a4617450c8ef58b85d6f9409b9dbab8: Status 404 returned error can't find the container with id 3850c3e1f3c5115a3502e6c32f0d393f3a4617450c8ef58b85d6f9409b9dbab8 Jul 30 20:30:18.463130 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:30:18.463108 2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 30 20:30:18.600371 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:30:18.600248 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-4hr7g" event={"ID":"0fdb29c9-99e1-4ce0-951c-09e15b525afb","Type":"ContainerStarted","Data":"3850c3e1f3c5115a3502e6c32f0d393f3a4617450c8ef58b85d6f9409b9dbab8"} Jul 30 20:30:19.606331 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:30:19.606289 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-4hr7g" event={"ID":"0fdb29c9-99e1-4ce0-951c-09e15b525afb","Type":"ContainerStarted","Data":"242bf456bf7d94caa83cc3d1893fe6d89eefed2ed27e0f2134936f6bc746cfda"} Jul 30 20:30:19.622152 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:30:19.622107 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-4hr7g" podStartSLOduration=2.218795923 podStartE2EDuration="2.622090686s" totalImagesPullingTime="403.294763ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:30:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:30:19.620320007 +0000 UTC m=+3053.771399558" watchObservedRunningTime="2026-07-30 20:30:19.622090686 +0000 UTC m=+3053.773170235" Jul 30 20:30:28.325806 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:30:28.325774 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-4hr7g" Jul 30 20:30:28.326304 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:30:28.325822 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-4hr7g" Jul 30 20:30:28.347334 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:30:28.347308 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-4hr7g" Jul 30 20:30:28.664914 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:30:28.664846 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-4hr7g" Jul 30 20:30:28.697044 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:30:28.697008 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4hr7g"] Jul 30 20:30:30.652792 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:30:30.652728 2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-4hr7g" podUID="0fdb29c9-99e1-4ce0-951c-09e15b525afb" containerName="registry-server" containerID="cri-o://242bf456bf7d94caa83cc3d1893fe6d89eefed2ed27e0f2134936f6bc746cfda" gracePeriod=2 Jul 30 20:30:30.900082 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:30:30.900057 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-4hr7g" Jul 30 20:30:31.021555 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:30:31.021519 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bpbqp\" (UniqueName: \"kubernetes.io/projected/0fdb29c9-99e1-4ce0-951c-09e15b525afb-kube-api-access-bpbqp\") pod \"0fdb29c9-99e1-4ce0-951c-09e15b525afb\" (UID: \"0fdb29c9-99e1-4ce0-951c-09e15b525afb\") " Jul 30 20:30:31.023561 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:30:31.023542 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0fdb29c9-99e1-4ce0-951c-09e15b525afb-kube-api-access-bpbqp" (OuterVolumeSpecName: "kube-api-access-bpbqp") pod "0fdb29c9-99e1-4ce0-951c-09e15b525afb" (UID: "0fdb29c9-99e1-4ce0-951c-09e15b525afb"). InnerVolumeSpecName "kube-api-access-bpbqp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 20:30:31.122164 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:30:31.122128 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bpbqp\" (UniqueName: \"kubernetes.io/projected/0fdb29c9-99e1-4ce0-951c-09e15b525afb-kube-api-access-bpbqp\") on node \"ip-10-0-136-46.ec2.internal\" DevicePath \"\"" Jul 30 20:30:31.659764 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:30:31.659733 2555 generic.go:356] "Generic (PLEG): container finished" podID="0fdb29c9-99e1-4ce0-951c-09e15b525afb" containerID="242bf456bf7d94caa83cc3d1893fe6d89eefed2ed27e0f2134936f6bc746cfda" exitCode=0 Jul 30 20:30:31.660177 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:30:31.659775 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-4hr7g" Jul 30 20:30:31.660177 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:30:31.659784 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-4hr7g" event={"ID":"0fdb29c9-99e1-4ce0-951c-09e15b525afb","Type":"ContainerDied","Data":"242bf456bf7d94caa83cc3d1893fe6d89eefed2ed27e0f2134936f6bc746cfda"} Jul 30 20:30:31.660177 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:30:31.659824 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-4hr7g" event={"ID":"0fdb29c9-99e1-4ce0-951c-09e15b525afb","Type":"ContainerDied","Data":"3850c3e1f3c5115a3502e6c32f0d393f3a4617450c8ef58b85d6f9409b9dbab8"} Jul 30 20:30:31.660177 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:30:31.659843 2555 scope.go:117] "RemoveContainer" containerID="242bf456bf7d94caa83cc3d1893fe6d89eefed2ed27e0f2134936f6bc746cfda" Jul 30 20:30:31.668468 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:30:31.668444 2555 scope.go:117] "RemoveContainer" containerID="242bf456bf7d94caa83cc3d1893fe6d89eefed2ed27e0f2134936f6bc746cfda" Jul 30 20:30:31.668700 ip-10-0-136-46 kubenswrapper[2555]: E0730 20:30:31.668681 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"242bf456bf7d94caa83cc3d1893fe6d89eefed2ed27e0f2134936f6bc746cfda\": container with ID starting with 242bf456bf7d94caa83cc3d1893fe6d89eefed2ed27e0f2134936f6bc746cfda not found: ID does not exist" containerID="242bf456bf7d94caa83cc3d1893fe6d89eefed2ed27e0f2134936f6bc746cfda" Jul 30 20:30:31.668750 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:30:31.668709 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"242bf456bf7d94caa83cc3d1893fe6d89eefed2ed27e0f2134936f6bc746cfda"} err="failed to get container status \"242bf456bf7d94caa83cc3d1893fe6d89eefed2ed27e0f2134936f6bc746cfda\": rpc error: code = NotFound desc = could not find container \"242bf456bf7d94caa83cc3d1893fe6d89eefed2ed27e0f2134936f6bc746cfda\": container with ID starting with 242bf456bf7d94caa83cc3d1893fe6d89eefed2ed27e0f2134936f6bc746cfda not found: ID does not exist" Jul 30 20:30:31.682355 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:30:31.682327 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4hr7g"] Jul 30 20:30:31.685604 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:30:31.685582 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4hr7g"] Jul 30 20:30:32.313907 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:30:32.313872 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0fdb29c9-99e1-4ce0-951c-09e15b525afb" path="/var/lib/kubelet/pods/0fdb29c9-99e1-4ce0-951c-09e15b525afb/volumes" Jul 30 20:30:49.400319 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:30:49.400266 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 20:31:06.195483 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:31:06.195447 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 20:31:30.589341 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:31:30.589306 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 20:31:50.099298 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:31:50.099202 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 20:32:05.296661 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:32:05.296627 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 20:32:38.894827 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:32:38.894792 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 20:33:31.505681 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:33:31.505600 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 20:33:51.940964 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:33:51.940931 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 20:34:14.898568 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:34:14.898529 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 20:34:28.299008 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:34:28.298975 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 20:34:41.035330 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:34:41.035291 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-7f2993-openshift-default-76f4bcc794-rklhg"] Jul 30 20:34:41.035690 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:34:41.035590 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0fdb29c9-99e1-4ce0-951c-09e15b525afb" containerName="registry-server" Jul 30 20:34:41.035690 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:34:41.035601 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="0fdb29c9-99e1-4ce0-951c-09e15b525afb" containerName="registry-server" Jul 30 20:34:41.035690 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:34:41.035657 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="0fdb29c9-99e1-4ce0-951c-09e15b525afb" containerName="registry-server" Jul 30 20:34:41.038492 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:34:41.038469 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-7f2993-openshift-default-76f4bcc794-rklhg" Jul 30 20:34:41.041020 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:34:41.040999 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-7f2993-openshift-default-dockercfg-dpv8b\"" Jul 30 20:34:41.051976 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:34:41.051952 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-7f2993-openshift-default-76f4bcc794-rklhg"] Jul 30 20:34:41.145803 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:34:41.145773 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/60e268d2-20e5-4636-aaa8-13f6030cccd4-istio-data\") pod \"e2e-ipp-a-7f2993-openshift-default-76f4bcc794-rklhg\" (UID: \"60e268d2-20e5-4636-aaa8-13f6030cccd4\") " pod="openshift-ingress/e2e-ipp-a-7f2993-openshift-default-76f4bcc794-rklhg" Jul 30 20:34:41.145959 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:34:41.145810 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/60e268d2-20e5-4636-aaa8-13f6030cccd4-istio-envoy\") pod \"e2e-ipp-a-7f2993-openshift-default-76f4bcc794-rklhg\" (UID: \"60e268d2-20e5-4636-aaa8-13f6030cccd4\") " pod="openshift-ingress/e2e-ipp-a-7f2993-openshift-default-76f4bcc794-rklhg" Jul 30 20:34:41.145959 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:34:41.145833 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/60e268d2-20e5-4636-aaa8-13f6030cccd4-istio-podinfo\") pod \"e2e-ipp-a-7f2993-openshift-default-76f4bcc794-rklhg\" (UID: \"60e268d2-20e5-4636-aaa8-13f6030cccd4\") " pod="openshift-ingress/e2e-ipp-a-7f2993-openshift-default-76f4bcc794-rklhg" Jul 30 20:34:41.145959 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:34:41.145851 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/60e268d2-20e5-4636-aaa8-13f6030cccd4-workload-socket\") pod \"e2e-ipp-a-7f2993-openshift-default-76f4bcc794-rklhg\" (UID: \"60e268d2-20e5-4636-aaa8-13f6030cccd4\") " pod="openshift-ingress/e2e-ipp-a-7f2993-openshift-default-76f4bcc794-rklhg" Jul 30 20:34:41.145959 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:34:41.145885 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/60e268d2-20e5-4636-aaa8-13f6030cccd4-istiod-ca-cert\") pod \"e2e-ipp-a-7f2993-openshift-default-76f4bcc794-rklhg\" (UID: \"60e268d2-20e5-4636-aaa8-13f6030cccd4\") " pod="openshift-ingress/e2e-ipp-a-7f2993-openshift-default-76f4bcc794-rklhg" Jul 30 20:34:41.145959 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:34:41.145907 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qhlv\" (UniqueName: \"kubernetes.io/projected/60e268d2-20e5-4636-aaa8-13f6030cccd4-kube-api-access-6qhlv\") pod \"e2e-ipp-a-7f2993-openshift-default-76f4bcc794-rklhg\" (UID: \"60e268d2-20e5-4636-aaa8-13f6030cccd4\") " pod="openshift-ingress/e2e-ipp-a-7f2993-openshift-default-76f4bcc794-rklhg" Jul 30 20:34:41.146124 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:34:41.145985 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/60e268d2-20e5-4636-aaa8-13f6030cccd4-credential-socket\") pod \"e2e-ipp-a-7f2993-openshift-default-76f4bcc794-rklhg\" (UID: \"60e268d2-20e5-4636-aaa8-13f6030cccd4\") " pod="openshift-ingress/e2e-ipp-a-7f2993-openshift-default-76f4bcc794-rklhg" Jul 30 20:34:41.146124 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:34:41.146042 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/60e268d2-20e5-4636-aaa8-13f6030cccd4-workload-certs\") pod \"e2e-ipp-a-7f2993-openshift-default-76f4bcc794-rklhg\" (UID: \"60e268d2-20e5-4636-aaa8-13f6030cccd4\") " pod="openshift-ingress/e2e-ipp-a-7f2993-openshift-default-76f4bcc794-rklhg" Jul 30 20:34:41.146124 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:34:41.146069 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/60e268d2-20e5-4636-aaa8-13f6030cccd4-istio-token\") pod \"e2e-ipp-a-7f2993-openshift-default-76f4bcc794-rklhg\" (UID: \"60e268d2-20e5-4636-aaa8-13f6030cccd4\") " pod="openshift-ingress/e2e-ipp-a-7f2993-openshift-default-76f4bcc794-rklhg" Jul 30 20:34:41.247031 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:34:41.246985 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/60e268d2-20e5-4636-aaa8-13f6030cccd4-istio-podinfo\") pod \"e2e-ipp-a-7f2993-openshift-default-76f4bcc794-rklhg\" (UID: \"60e268d2-20e5-4636-aaa8-13f6030cccd4\") " pod="openshift-ingress/e2e-ipp-a-7f2993-openshift-default-76f4bcc794-rklhg" Jul 30 20:34:41.247031 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:34:41.247032 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/60e268d2-20e5-4636-aaa8-13f6030cccd4-workload-socket\") pod \"e2e-ipp-a-7f2993-openshift-default-76f4bcc794-rklhg\" (UID: \"60e268d2-20e5-4636-aaa8-13f6030cccd4\") " pod="openshift-ingress/e2e-ipp-a-7f2993-openshift-default-76f4bcc794-rklhg" Jul 30 20:34:41.247031 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:34:41.247047 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/60e268d2-20e5-4636-aaa8-13f6030cccd4-istiod-ca-cert\") pod \"e2e-ipp-a-7f2993-openshift-default-76f4bcc794-rklhg\" (UID: \"60e268d2-20e5-4636-aaa8-13f6030cccd4\") " pod="openshift-ingress/e2e-ipp-a-7f2993-openshift-default-76f4bcc794-rklhg" Jul 30 20:34:41.247357 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:34:41.247065 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qhlv\" (UniqueName: \"kubernetes.io/projected/60e268d2-20e5-4636-aaa8-13f6030cccd4-kube-api-access-6qhlv\") pod \"e2e-ipp-a-7f2993-openshift-default-76f4bcc794-rklhg\" (UID: \"60e268d2-20e5-4636-aaa8-13f6030cccd4\") " pod="openshift-ingress/e2e-ipp-a-7f2993-openshift-default-76f4bcc794-rklhg" Jul 30 20:34:41.247357 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:34:41.247090 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/60e268d2-20e5-4636-aaa8-13f6030cccd4-credential-socket\") pod \"e2e-ipp-a-7f2993-openshift-default-76f4bcc794-rklhg\" (UID: \"60e268d2-20e5-4636-aaa8-13f6030cccd4\") " pod="openshift-ingress/e2e-ipp-a-7f2993-openshift-default-76f4bcc794-rklhg" Jul 30 20:34:41.247357 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:34:41.247124 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/60e268d2-20e5-4636-aaa8-13f6030cccd4-workload-certs\") pod \"e2e-ipp-a-7f2993-openshift-default-76f4bcc794-rklhg\" (UID: \"60e268d2-20e5-4636-aaa8-13f6030cccd4\") " pod="openshift-ingress/e2e-ipp-a-7f2993-openshift-default-76f4bcc794-rklhg" Jul 30 20:34:41.247357 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:34:41.247155 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/60e268d2-20e5-4636-aaa8-13f6030cccd4-istio-token\") pod \"e2e-ipp-a-7f2993-openshift-default-76f4bcc794-rklhg\" (UID: \"60e268d2-20e5-4636-aaa8-13f6030cccd4\") " pod="openshift-ingress/e2e-ipp-a-7f2993-openshift-default-76f4bcc794-rklhg" Jul 30 20:34:41.247969 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:34:41.247890 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/60e268d2-20e5-4636-aaa8-13f6030cccd4-workload-certs\") pod \"e2e-ipp-a-7f2993-openshift-default-76f4bcc794-rklhg\" (UID: \"60e268d2-20e5-4636-aaa8-13f6030cccd4\") " pod="openshift-ingress/e2e-ipp-a-7f2993-openshift-default-76f4bcc794-rklhg" Jul 30 20:34:41.247969 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:34:41.247899 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/60e268d2-20e5-4636-aaa8-13f6030cccd4-istio-data\") pod \"e2e-ipp-a-7f2993-openshift-default-76f4bcc794-rklhg\" (UID: \"60e268d2-20e5-4636-aaa8-13f6030cccd4\") " pod="openshift-ingress/e2e-ipp-a-7f2993-openshift-default-76f4bcc794-rklhg" Jul 30 20:34:41.247969 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:34:41.247946 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/60e268d2-20e5-4636-aaa8-13f6030cccd4-credential-socket\") pod \"e2e-ipp-a-7f2993-openshift-default-76f4bcc794-rklhg\" (UID: \"60e268d2-20e5-4636-aaa8-13f6030cccd4\") " pod="openshift-ingress/e2e-ipp-a-7f2993-openshift-default-76f4bcc794-rklhg" Jul 30 20:34:41.248226 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:34:41.247228 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/60e268d2-20e5-4636-aaa8-13f6030cccd4-istio-data\") pod \"e2e-ipp-a-7f2993-openshift-default-76f4bcc794-rklhg\" (UID: \"60e268d2-20e5-4636-aaa8-13f6030cccd4\") " pod="openshift-ingress/e2e-ipp-a-7f2993-openshift-default-76f4bcc794-rklhg" Jul 30 20:34:41.248311 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:34:41.248268 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/60e268d2-20e5-4636-aaa8-13f6030cccd4-istio-envoy\") pod \"e2e-ipp-a-7f2993-openshift-default-76f4bcc794-rklhg\" (UID: \"60e268d2-20e5-4636-aaa8-13f6030cccd4\") " pod="openshift-ingress/e2e-ipp-a-7f2993-openshift-default-76f4bcc794-rklhg" Jul 30 20:34:41.249425 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:34:41.248478 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/60e268d2-20e5-4636-aaa8-13f6030cccd4-istiod-ca-cert\") pod \"e2e-ipp-a-7f2993-openshift-default-76f4bcc794-rklhg\" (UID: \"60e268d2-20e5-4636-aaa8-13f6030cccd4\") " pod="openshift-ingress/e2e-ipp-a-7f2993-openshift-default-76f4bcc794-rklhg" Jul 30 20:34:41.254771 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:34:41.250902 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/60e268d2-20e5-4636-aaa8-13f6030cccd4-istio-envoy\") pod \"e2e-ipp-a-7f2993-openshift-default-76f4bcc794-rklhg\" (UID: \"60e268d2-20e5-4636-aaa8-13f6030cccd4\") " pod="openshift-ingress/e2e-ipp-a-7f2993-openshift-default-76f4bcc794-rklhg" Jul 30 20:34:41.254771 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:34:41.250936 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/60e268d2-20e5-4636-aaa8-13f6030cccd4-istio-podinfo\") pod \"e2e-ipp-a-7f2993-openshift-default-76f4bcc794-rklhg\" (UID: \"60e268d2-20e5-4636-aaa8-13f6030cccd4\") " pod="openshift-ingress/e2e-ipp-a-7f2993-openshift-default-76f4bcc794-rklhg" Jul 30 20:34:41.255059 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:34:41.255034 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/60e268d2-20e5-4636-aaa8-13f6030cccd4-workload-socket\") pod \"e2e-ipp-a-7f2993-openshift-default-76f4bcc794-rklhg\" (UID: \"60e268d2-20e5-4636-aaa8-13f6030cccd4\") " pod="openshift-ingress/e2e-ipp-a-7f2993-openshift-default-76f4bcc794-rklhg" Jul 30 20:34:41.257636 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:34:41.257612 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/60e268d2-20e5-4636-aaa8-13f6030cccd4-istio-token\") pod \"e2e-ipp-a-7f2993-openshift-default-76f4bcc794-rklhg\" (UID: \"60e268d2-20e5-4636-aaa8-13f6030cccd4\") " pod="openshift-ingress/e2e-ipp-a-7f2993-openshift-default-76f4bcc794-rklhg" Jul 30 20:34:41.257741 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:34:41.257705 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qhlv\" (UniqueName: \"kubernetes.io/projected/60e268d2-20e5-4636-aaa8-13f6030cccd4-kube-api-access-6qhlv\") pod \"e2e-ipp-a-7f2993-openshift-default-76f4bcc794-rklhg\" (UID: \"60e268d2-20e5-4636-aaa8-13f6030cccd4\") " pod="openshift-ingress/e2e-ipp-a-7f2993-openshift-default-76f4bcc794-rklhg" Jul 30 20:34:41.348587 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:34:41.348520 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-7f2993-openshift-default-76f4bcc794-rklhg" Jul 30 20:34:41.481994 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:34:41.481966 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-7f2993-openshift-default-76f4bcc794-rklhg"] Jul 30 20:34:41.483807 ip-10-0-136-46 kubenswrapper[2555]: W0730 20:34:41.483783 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60e268d2_20e5_4636_aaa8_13f6030cccd4.slice/crio-511ef98257d6df5bef7869f7ec75634a023219d67fa63c3c50707e85e3f9e969 WatchSource:0}: Error finding container 511ef98257d6df5bef7869f7ec75634a023219d67fa63c3c50707e85e3f9e969: Status 404 returned error can't find the container with id 511ef98257d6df5bef7869f7ec75634a023219d67fa63c3c50707e85e3f9e969 Jul 30 20:34:41.707729 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:34:41.707649 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-7f2993-openshift-default-76f4bcc794-rklhg" event={"ID":"60e268d2-20e5-4636-aaa8-13f6030cccd4","Type":"ContainerStarted","Data":"511ef98257d6df5bef7869f7ec75634a023219d67fa63c3c50707e85e3f9e969"} Jul 30 20:34:44.485830 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:34:44.485794 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 30 20:34:44.486182 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:34:44.485902 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 30 20:34:44.486182 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:34:44.485948 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 30 20:34:44.724253 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:34:44.724213 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-7f2993-openshift-default-76f4bcc794-rklhg" event={"ID":"60e268d2-20e5-4636-aaa8-13f6030cccd4","Type":"ContainerStarted","Data":"bdc156cc3175b28e99a2f53a100d6ac4f71ec041fe02d1e2d3b48f06c4e62039"} Jul 30 20:34:44.745902 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:34:44.745810 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-7f2993-openshift-default-76f4bcc794-rklhg" podStartSLOduration=0.746478636 podStartE2EDuration="3.745792377s" totalImagesPullingTime="2.999313741s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:34:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:34:44.743487158 +0000 UTC m=+3318.894566708" watchObservedRunningTime="2026-07-30 20:34:44.745792377 +0000 UTC m=+3318.896871927" Jul 30 20:34:45.349680 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:34:45.349644 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-7f2993-openshift-default-76f4bcc794-rklhg" Jul 30 20:34:45.354568 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:34:45.354537 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-7f2993-openshift-default-76f4bcc794-rklhg" Jul 30 20:34:45.728965 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:34:45.728939 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-7f2993-openshift-default-76f4bcc794-rklhg" Jul 30 20:34:45.729915 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:34:45.729897 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-7f2993-openshift-default-76f4bcc794-rklhg" Jul 30 20:34:52.891052 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:34:52.891017 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 20:35:00.730175 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:35:00.730095 2555 patch_prober.go:28] interesting pod/e2e-ipp-a-7f2993-openshift-default-76f4bcc794-rklhg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body= Jul 30 20:35:00.730621 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:35:00.730182 2555 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-7f2993-openshift-default-76f4bcc794-rklhg" podUID="60e268d2-20e5-4636-aaa8-13f6030cccd4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" Jul 30 20:35:00.796436 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:35:00.796405 2555 generic.go:356] "Generic (PLEG): container finished" podID="60e268d2-20e5-4636-aaa8-13f6030cccd4" containerID="bdc156cc3175b28e99a2f53a100d6ac4f71ec041fe02d1e2d3b48f06c4e62039" exitCode=0 Jul 30 20:35:00.796584 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:35:00.796442 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-7f2993-openshift-default-76f4bcc794-rklhg" event={"ID":"60e268d2-20e5-4636-aaa8-13f6030cccd4","Type":"ContainerDied","Data":"bdc156cc3175b28e99a2f53a100d6ac4f71ec041fe02d1e2d3b48f06c4e62039"} Jul 30 20:35:00.796847 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:35:00.796824 2555 scope.go:117] "RemoveContainer" containerID="bdc156cc3175b28e99a2f53a100d6ac4f71ec041fe02d1e2d3b48f06c4e62039" Jul 30 20:35:00.797857 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:35:00.797828 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 30 20:35:00.797911 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:35:00.797895 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 30 20:35:00.797949 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:35:00.797923 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 30 20:35:01.803217 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:35:01.803180 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-7f2993-openshift-default-76f4bcc794-rklhg" event={"ID":"60e268d2-20e5-4636-aaa8-13f6030cccd4","Type":"ContainerStarted","Data":"fa7303c82cc1187816da8ccec236ca0f33b659b8dfa92887d4c9434cd7c196c0"} Jul 30 20:35:02.349012 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:35:02.348974 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-7f2993-openshift-default-76f4bcc794-rklhg" Jul 30 20:35:02.349234 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:35:02.349210 2555 patch_prober.go:28] interesting pod/e2e-ipp-a-7f2993-openshift-default-76f4bcc794-rklhg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body= Jul 30 20:35:02.349314 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:35:02.349260 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-7f2993-openshift-default-76f4bcc794-rklhg" podUID="60e268d2-20e5-4636-aaa8-13f6030cccd4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" Jul 30 20:35:03.349193 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:35:03.349156 2555 patch_prober.go:28] interesting pod/e2e-ipp-a-7f2993-openshift-default-76f4bcc794-rklhg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body= Jul 30 20:35:03.349608 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:35:03.349212 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-7f2993-openshift-default-76f4bcc794-rklhg" podUID="60e268d2-20e5-4636-aaa8-13f6030cccd4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" Jul 30 20:35:04.349665 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:35:04.349634 2555 patch_prober.go:28] interesting pod/e2e-ipp-a-7f2993-openshift-default-76f4bcc794-rklhg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body= Jul 30 20:35:04.350041 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:35:04.349691 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-7f2993-openshift-default-76f4bcc794-rklhg" podUID="60e268d2-20e5-4636-aaa8-13f6030cccd4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" Jul 30 20:35:05.349721 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:35:05.349679 2555 patch_prober.go:28] interesting pod/e2e-ipp-a-7f2993-openshift-default-76f4bcc794-rklhg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body= Jul 30 20:35:05.350136 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:35:05.349741 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-7f2993-openshift-default-76f4bcc794-rklhg" podUID="60e268d2-20e5-4636-aaa8-13f6030cccd4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" Jul 30 20:35:06.352539 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:35:06.352507 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-7f2993-openshift-default-76f4bcc794-rklhg" Jul 30 20:35:06.352886 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:35:06.352776 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-7f2993-openshift-default-76f4bcc794-rklhg" Jul 30 20:35:06.353476 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:35:06.353460 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-7f2993-openshift-default-76f4bcc794-rklhg" Jul 30 20:35:12.720153 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:35:12.720123 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-9d3c06-openshift-default-88bbfb67d-qftvn"] Jul 30 20:35:12.723269 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:35:12.723251 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-9d3c06-openshift-default-88bbfb67d-qftvn" Jul 30 20:35:12.727408 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:35:12.727388 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-9d3c06-openshift-default-dockercfg-cwls4\"" Jul 30 20:35:12.748168 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:35:12.743937 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-9d3c06-openshift-default-88bbfb67d-qftvn"] Jul 30 20:35:12.820370 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:35:12.820327 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cdec9a41-b9d4-43da-acea-4c1bba8320c9-credential-socket\") pod \"e2e-ipp-b-9d3c06-openshift-default-88bbfb67d-qftvn\" (UID: \"cdec9a41-b9d4-43da-acea-4c1bba8320c9\") " pod="openshift-ingress/e2e-ipp-b-9d3c06-openshift-default-88bbfb67d-qftvn" Jul 30 20:35:12.820370 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:35:12.820364 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cdec9a41-b9d4-43da-acea-4c1bba8320c9-workload-certs\") pod \"e2e-ipp-b-9d3c06-openshift-default-88bbfb67d-qftvn\" (UID: \"cdec9a41-b9d4-43da-acea-4c1bba8320c9\") " pod="openshift-ingress/e2e-ipp-b-9d3c06-openshift-default-88bbfb67d-qftvn" Jul 30 20:35:12.820613 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:35:12.820391 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cdec9a41-b9d4-43da-acea-4c1bba8320c9-istiod-ca-cert\") pod \"e2e-ipp-b-9d3c06-openshift-default-88bbfb67d-qftvn\" (UID: \"cdec9a41-b9d4-43da-acea-4c1bba8320c9\") " pod="openshift-ingress/e2e-ipp-b-9d3c06-openshift-default-88bbfb67d-qftvn" Jul 30 20:35:12.820613 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:35:12.820531 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cdec9a41-b9d4-43da-acea-4c1bba8320c9-workload-socket\") pod \"e2e-ipp-b-9d3c06-openshift-default-88bbfb67d-qftvn\" (UID: \"cdec9a41-b9d4-43da-acea-4c1bba8320c9\") " pod="openshift-ingress/e2e-ipp-b-9d3c06-openshift-default-88bbfb67d-qftvn" Jul 30 20:35:12.820613 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:35:12.820574 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cdec9a41-b9d4-43da-acea-4c1bba8320c9-istio-token\") pod \"e2e-ipp-b-9d3c06-openshift-default-88bbfb67d-qftvn\" (UID: \"cdec9a41-b9d4-43da-acea-4c1bba8320c9\") " pod="openshift-ingress/e2e-ipp-b-9d3c06-openshift-default-88bbfb67d-qftvn" Jul 30 20:35:12.820764 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:35:12.820617 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8sd8p\" (UniqueName: \"kubernetes.io/projected/cdec9a41-b9d4-43da-acea-4c1bba8320c9-kube-api-access-8sd8p\") pod \"e2e-ipp-b-9d3c06-openshift-default-88bbfb67d-qftvn\" (UID: \"cdec9a41-b9d4-43da-acea-4c1bba8320c9\") " pod="openshift-ingress/e2e-ipp-b-9d3c06-openshift-default-88bbfb67d-qftvn" Jul 30 20:35:12.820764 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:35:12.820645 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cdec9a41-b9d4-43da-acea-4c1bba8320c9-istio-podinfo\") pod \"e2e-ipp-b-9d3c06-openshift-default-88bbfb67d-qftvn\" (UID: \"cdec9a41-b9d4-43da-acea-4c1bba8320c9\") " pod="openshift-ingress/e2e-ipp-b-9d3c06-openshift-default-88bbfb67d-qftvn" Jul 30 20:35:12.820764 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:35:12.820699 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cdec9a41-b9d4-43da-acea-4c1bba8320c9-istio-data\") pod \"e2e-ipp-b-9d3c06-openshift-default-88bbfb67d-qftvn\" (UID: \"cdec9a41-b9d4-43da-acea-4c1bba8320c9\") " pod="openshift-ingress/e2e-ipp-b-9d3c06-openshift-default-88bbfb67d-qftvn" Jul 30 20:35:12.820764 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:35:12.820720 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cdec9a41-b9d4-43da-acea-4c1bba8320c9-istio-envoy\") pod \"e2e-ipp-b-9d3c06-openshift-default-88bbfb67d-qftvn\" (UID: \"cdec9a41-b9d4-43da-acea-4c1bba8320c9\") " pod="openshift-ingress/e2e-ipp-b-9d3c06-openshift-default-88bbfb67d-qftvn" Jul 30 20:35:12.921260 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:35:12.921227 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cdec9a41-b9d4-43da-acea-4c1bba8320c9-workload-socket\") pod \"e2e-ipp-b-9d3c06-openshift-default-88bbfb67d-qftvn\" (UID: \"cdec9a41-b9d4-43da-acea-4c1bba8320c9\") " pod="openshift-ingress/e2e-ipp-b-9d3c06-openshift-default-88bbfb67d-qftvn" Jul 30 20:35:12.921260 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:35:12.921263 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cdec9a41-b9d4-43da-acea-4c1bba8320c9-istio-token\") pod \"e2e-ipp-b-9d3c06-openshift-default-88bbfb67d-qftvn\" (UID: \"cdec9a41-b9d4-43da-acea-4c1bba8320c9\") " pod="openshift-ingress/e2e-ipp-b-9d3c06-openshift-default-88bbfb67d-qftvn" Jul 30 20:35:12.921516 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:35:12.921293 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8sd8p\" (UniqueName: \"kubernetes.io/projected/cdec9a41-b9d4-43da-acea-4c1bba8320c9-kube-api-access-8sd8p\") pod \"e2e-ipp-b-9d3c06-openshift-default-88bbfb67d-qftvn\" (UID: \"cdec9a41-b9d4-43da-acea-4c1bba8320c9\") " pod="openshift-ingress/e2e-ipp-b-9d3c06-openshift-default-88bbfb67d-qftvn" Jul 30 20:35:12.921516 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:35:12.921407 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cdec9a41-b9d4-43da-acea-4c1bba8320c9-istio-podinfo\") pod \"e2e-ipp-b-9d3c06-openshift-default-88bbfb67d-qftvn\" (UID: \"cdec9a41-b9d4-43da-acea-4c1bba8320c9\") " pod="openshift-ingress/e2e-ipp-b-9d3c06-openshift-default-88bbfb67d-qftvn" Jul 30 20:35:12.921516 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:35:12.921479 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cdec9a41-b9d4-43da-acea-4c1bba8320c9-istio-data\") pod \"e2e-ipp-b-9d3c06-openshift-default-88bbfb67d-qftvn\" (UID: \"cdec9a41-b9d4-43da-acea-4c1bba8320c9\") " pod="openshift-ingress/e2e-ipp-b-9d3c06-openshift-default-88bbfb67d-qftvn" Jul 30 20:35:12.921516 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:35:12.921508 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cdec9a41-b9d4-43da-acea-4c1bba8320c9-istio-envoy\") pod \"e2e-ipp-b-9d3c06-openshift-default-88bbfb67d-qftvn\" (UID: \"cdec9a41-b9d4-43da-acea-4c1bba8320c9\") " pod="openshift-ingress/e2e-ipp-b-9d3c06-openshift-default-88bbfb67d-qftvn" Jul 30 20:35:12.921713 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:35:12.921557 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cdec9a41-b9d4-43da-acea-4c1bba8320c9-credential-socket\") pod \"e2e-ipp-b-9d3c06-openshift-default-88bbfb67d-qftvn\" (UID: \"cdec9a41-b9d4-43da-acea-4c1bba8320c9\") " pod="openshift-ingress/e2e-ipp-b-9d3c06-openshift-default-88bbfb67d-qftvn" Jul 30 20:35:12.921713 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:35:12.921584 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cdec9a41-b9d4-43da-acea-4c1bba8320c9-workload-certs\") pod \"e2e-ipp-b-9d3c06-openshift-default-88bbfb67d-qftvn\" (UID: \"cdec9a41-b9d4-43da-acea-4c1bba8320c9\") " pod="openshift-ingress/e2e-ipp-b-9d3c06-openshift-default-88bbfb67d-qftvn" Jul 30 20:35:12.921713 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:35:12.921627 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cdec9a41-b9d4-43da-acea-4c1bba8320c9-workload-socket\") pod \"e2e-ipp-b-9d3c06-openshift-default-88bbfb67d-qftvn\" (UID: \"cdec9a41-b9d4-43da-acea-4c1bba8320c9\") " pod="openshift-ingress/e2e-ipp-b-9d3c06-openshift-default-88bbfb67d-qftvn" Jul 30 20:35:12.921713 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:35:12.921633 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cdec9a41-b9d4-43da-acea-4c1bba8320c9-istiod-ca-cert\") pod \"e2e-ipp-b-9d3c06-openshift-default-88bbfb67d-qftvn\" (UID: \"cdec9a41-b9d4-43da-acea-4c1bba8320c9\") " pod="openshift-ingress/e2e-ipp-b-9d3c06-openshift-default-88bbfb67d-qftvn" Jul 30 20:35:12.921935 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:35:12.921844 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cdec9a41-b9d4-43da-acea-4c1bba8320c9-istio-data\") pod \"e2e-ipp-b-9d3c06-openshift-default-88bbfb67d-qftvn\" (UID: \"cdec9a41-b9d4-43da-acea-4c1bba8320c9\") " pod="openshift-ingress/e2e-ipp-b-9d3c06-openshift-default-88bbfb67d-qftvn" Jul 30 20:35:12.922207 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:35:12.922181 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cdec9a41-b9d4-43da-acea-4c1bba8320c9-workload-certs\") pod \"e2e-ipp-b-9d3c06-openshift-default-88bbfb67d-qftvn\" (UID: \"cdec9a41-b9d4-43da-acea-4c1bba8320c9\") " pod="openshift-ingress/e2e-ipp-b-9d3c06-openshift-default-88bbfb67d-qftvn" Jul 30 20:35:12.922207 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:35:12.922197 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cdec9a41-b9d4-43da-acea-4c1bba8320c9-credential-socket\") pod \"e2e-ipp-b-9d3c06-openshift-default-88bbfb67d-qftvn\" (UID: \"cdec9a41-b9d4-43da-acea-4c1bba8320c9\") " pod="openshift-ingress/e2e-ipp-b-9d3c06-openshift-default-88bbfb67d-qftvn" Jul 30 20:35:12.922358 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:35:12.922230 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cdec9a41-b9d4-43da-acea-4c1bba8320c9-istiod-ca-cert\") pod \"e2e-ipp-b-9d3c06-openshift-default-88bbfb67d-qftvn\" (UID: \"cdec9a41-b9d4-43da-acea-4c1bba8320c9\") " pod="openshift-ingress/e2e-ipp-b-9d3c06-openshift-default-88bbfb67d-qftvn" Jul 30 20:35:12.923829 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:35:12.923811 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cdec9a41-b9d4-43da-acea-4c1bba8320c9-istio-envoy\") pod \"e2e-ipp-b-9d3c06-openshift-default-88bbfb67d-qftvn\" (UID: \"cdec9a41-b9d4-43da-acea-4c1bba8320c9\") " pod="openshift-ingress/e2e-ipp-b-9d3c06-openshift-default-88bbfb67d-qftvn" Jul 30 20:35:12.924039 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:35:12.924019 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cdec9a41-b9d4-43da-acea-4c1bba8320c9-istio-podinfo\") pod \"e2e-ipp-b-9d3c06-openshift-default-88bbfb67d-qftvn\" (UID: \"cdec9a41-b9d4-43da-acea-4c1bba8320c9\") " pod="openshift-ingress/e2e-ipp-b-9d3c06-openshift-default-88bbfb67d-qftvn" Jul 30 20:35:12.938580 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:35:12.938551 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cdec9a41-b9d4-43da-acea-4c1bba8320c9-istio-token\") pod \"e2e-ipp-b-9d3c06-openshift-default-88bbfb67d-qftvn\" (UID: \"cdec9a41-b9d4-43da-acea-4c1bba8320c9\") " pod="openshift-ingress/e2e-ipp-b-9d3c06-openshift-default-88bbfb67d-qftvn" Jul 30 20:35:12.940772 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:35:12.940740 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8sd8p\" (UniqueName: \"kubernetes.io/projected/cdec9a41-b9d4-43da-acea-4c1bba8320c9-kube-api-access-8sd8p\") pod \"e2e-ipp-b-9d3c06-openshift-default-88bbfb67d-qftvn\" (UID: \"cdec9a41-b9d4-43da-acea-4c1bba8320c9\") " pod="openshift-ingress/e2e-ipp-b-9d3c06-openshift-default-88bbfb67d-qftvn" Jul 30 20:35:13.034055 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:35:13.033973 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-9d3c06-openshift-default-88bbfb67d-qftvn" Jul 30 20:35:13.169243 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:35:13.169218 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-9d3c06-openshift-default-88bbfb67d-qftvn"] Jul 30 20:35:13.170846 ip-10-0-136-46 kubenswrapper[2555]: W0730 20:35:13.170826 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcdec9a41_b9d4_43da_acea_4c1bba8320c9.slice/crio-c1d7bec502eab5a3865c28fc7bd02d2a1ef6cbf907c13b6ba5b80ef6f425a1e5 WatchSource:0}: Error finding container c1d7bec502eab5a3865c28fc7bd02d2a1ef6cbf907c13b6ba5b80ef6f425a1e5: Status 404 returned error can't find the container with id c1d7bec502eab5a3865c28fc7bd02d2a1ef6cbf907c13b6ba5b80ef6f425a1e5 Jul 30 20:35:13.173067 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:35:13.173038 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 30 20:35:13.173140 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:35:13.173101 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 30 20:35:13.173140 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:35:13.173129 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 30 20:35:13.856954 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:35:13.856924 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-9d3c06-openshift-default-88bbfb67d-qftvn" event={"ID":"cdec9a41-b9d4-43da-acea-4c1bba8320c9","Type":"ContainerStarted","Data":"ae568d60ea8d404381444fb8587db0c18e78e58878a1b97f431c16609a584cb5"} Jul 30 20:35:13.857381 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:35:13.856975 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-9d3c06-openshift-default-88bbfb67d-qftvn" event={"ID":"cdec9a41-b9d4-43da-acea-4c1bba8320c9","Type":"ContainerStarted","Data":"c1d7bec502eab5a3865c28fc7bd02d2a1ef6cbf907c13b6ba5b80ef6f425a1e5"} Jul 30 20:35:13.877822 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:35:13.877772 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-9d3c06-openshift-default-88bbfb67d-qftvn" podStartSLOduration=1.877755711 podStartE2EDuration="1.877755711s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:35:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:35:13.876722617 +0000 UTC m=+3348.027802166" watchObservedRunningTime="2026-07-30 20:35:13.877755711 +0000 UTC m=+3348.028835260" Jul 30 20:35:14.034262 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:35:14.034230 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-9d3c06-openshift-default-88bbfb67d-qftvn" Jul 30 20:35:14.039077 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:35:14.039053 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-9d3c06-openshift-default-88bbfb67d-qftvn" Jul 30 20:35:14.861534 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:35:14.861499 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-9d3c06-openshift-default-88bbfb67d-qftvn" Jul 30 20:35:14.862478 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:35:14.862458 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-9d3c06-openshift-default-88bbfb67d-qftvn" Jul 30 20:35:25.401925 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:35:25.401889 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 20:35:33.950956 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:35:33.950922 2555 generic.go:356] "Generic (PLEG): container finished" podID="cdec9a41-b9d4-43da-acea-4c1bba8320c9" containerID="ae568d60ea8d404381444fb8587db0c18e78e58878a1b97f431c16609a584cb5" exitCode=0 Jul 30 20:35:33.951590 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:35:33.950996 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-9d3c06-openshift-default-88bbfb67d-qftvn" event={"ID":"cdec9a41-b9d4-43da-acea-4c1bba8320c9","Type":"ContainerDied","Data":"ae568d60ea8d404381444fb8587db0c18e78e58878a1b97f431c16609a584cb5"} Jul 30 20:35:33.951590 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:35:33.951521 2555 scope.go:117] "RemoveContainer" containerID="ae568d60ea8d404381444fb8587db0c18e78e58878a1b97f431c16609a584cb5" Jul 30 20:35:33.952654 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:35:33.952627 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 30 20:35:33.952728 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:35:33.952703 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 30 20:35:33.952765 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:35:33.952735 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 30 20:35:34.957296 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:35:34.957243 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-9d3c06-openshift-default-88bbfb67d-qftvn" event={"ID":"cdec9a41-b9d4-43da-acea-4c1bba8320c9","Type":"ContainerStarted","Data":"88fd80460201209a527ba9077604a969b85f4a2f40938bfeece7e08c648da959"} Jul 30 20:35:35.035011 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:35:35.034965 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-9d3c06-openshift-default-88bbfb67d-qftvn" Jul 30 20:35:35.035344 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:35:35.035316 2555 patch_prober.go:28] interesting pod/e2e-ipp-b-9d3c06-openshift-default-88bbfb67d-qftvn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body= Jul 30 20:35:35.035446 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:35:35.035372 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-9d3c06-openshift-default-88bbfb67d-qftvn" podUID="cdec9a41-b9d4-43da-acea-4c1bba8320c9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" Jul 30 20:35:36.035793 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:35:36.035745 2555 patch_prober.go:28] interesting pod/e2e-ipp-b-9d3c06-openshift-default-88bbfb67d-qftvn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body= Jul 30 20:35:36.036335 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:35:36.035834 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-9d3c06-openshift-default-88bbfb67d-qftvn" podUID="cdec9a41-b9d4-43da-acea-4c1bba8320c9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" Jul 30 20:35:37.035225 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:35:37.035180 2555 patch_prober.go:28] interesting pod/e2e-ipp-b-9d3c06-openshift-default-88bbfb67d-qftvn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body= Jul 30 20:35:37.035449 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:35:37.035267 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-9d3c06-openshift-default-88bbfb67d-qftvn" podUID="cdec9a41-b9d4-43da-acea-4c1bba8320c9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" Jul 30 20:35:38.035053 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:35:38.035017 2555 patch_prober.go:28] interesting pod/e2e-ipp-b-9d3c06-openshift-default-88bbfb67d-qftvn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body= Jul 30 20:35:38.035656 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:35:38.035626 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-9d3c06-openshift-default-88bbfb67d-qftvn" podUID="cdec9a41-b9d4-43da-acea-4c1bba8320c9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" Jul 30 20:35:39.037695 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:35:39.037663 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-9d3c06-openshift-default-88bbfb67d-qftvn" Jul 30 20:35:39.038063 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:35:39.037942 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-9d3c06-openshift-default-88bbfb67d-qftvn" Jul 30 20:35:39.038606 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:35:39.038589 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-9d3c06-openshift-default-88bbfb67d-qftvn" Jul 30 20:35:55.345519 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:35:55.345488 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 20:36:27.898593 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:36:27.898518 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 20:36:38.968709 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:36:38.968677 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-556562-openshift-default-8485f84df4-85dmv"] Jul 30 20:36:38.972093 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:36:38.972073 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-556562-openshift-default-8485f84df4-85dmv" Jul 30 20:36:38.974561 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:36:38.974541 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-556562-openshift-default-dockercfg-ll8rl\"" Jul 30 20:36:38.983702 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:36:38.983678 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-556562-openshift-default-8485f84df4-85dmv"] Jul 30 20:36:39.067852 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:36:39.067817 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lg5mq\" (UniqueName: \"kubernetes.io/projected/87992233-e173-4d52-a093-fa4683304b2a-kube-api-access-lg5mq\") pod \"e2e-ipp-cleanup-556562-openshift-default-8485f84df4-85dmv\" (UID: \"87992233-e173-4d52-a093-fa4683304b2a\") " pod="openshift-ingress/e2e-ipp-cleanup-556562-openshift-default-8485f84df4-85dmv" Jul 30 20:36:39.068034 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:36:39.067894 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/87992233-e173-4d52-a093-fa4683304b2a-istio-envoy\") pod \"e2e-ipp-cleanup-556562-openshift-default-8485f84df4-85dmv\" (UID: \"87992233-e173-4d52-a093-fa4683304b2a\") " pod="openshift-ingress/e2e-ipp-cleanup-556562-openshift-default-8485f84df4-85dmv" Jul 30 20:36:39.068034 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:36:39.067926 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/87992233-e173-4d52-a093-fa4683304b2a-istiod-ca-cert\") pod \"e2e-ipp-cleanup-556562-openshift-default-8485f84df4-85dmv\" (UID: \"87992233-e173-4d52-a093-fa4683304b2a\") " pod="openshift-ingress/e2e-ipp-cleanup-556562-openshift-default-8485f84df4-85dmv" Jul 30 20:36:39.068034 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:36:39.067995 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/87992233-e173-4d52-a093-fa4683304b2a-credential-socket\") pod \"e2e-ipp-cleanup-556562-openshift-default-8485f84df4-85dmv\" (UID: \"87992233-e173-4d52-a093-fa4683304b2a\") " pod="openshift-ingress/e2e-ipp-cleanup-556562-openshift-default-8485f84df4-85dmv" Jul 30 20:36:39.068034 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:36:39.068020 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/87992233-e173-4d52-a093-fa4683304b2a-istio-data\") pod \"e2e-ipp-cleanup-556562-openshift-default-8485f84df4-85dmv\" (UID: \"87992233-e173-4d52-a093-fa4683304b2a\") " pod="openshift-ingress/e2e-ipp-cleanup-556562-openshift-default-8485f84df4-85dmv" Jul 30 20:36:39.068342 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:36:39.068047 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/87992233-e173-4d52-a093-fa4683304b2a-workload-certs\") pod \"e2e-ipp-cleanup-556562-openshift-default-8485f84df4-85dmv\" (UID: \"87992233-e173-4d52-a093-fa4683304b2a\") " pod="openshift-ingress/e2e-ipp-cleanup-556562-openshift-default-8485f84df4-85dmv" Jul 30 20:36:39.068342 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:36:39.068072 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/87992233-e173-4d52-a093-fa4683304b2a-istio-podinfo\") pod \"e2e-ipp-cleanup-556562-openshift-default-8485f84df4-85dmv\" (UID: \"87992233-e173-4d52-a093-fa4683304b2a\") " pod="openshift-ingress/e2e-ipp-cleanup-556562-openshift-default-8485f84df4-85dmv" Jul 30 20:36:39.068342 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:36:39.068094 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/87992233-e173-4d52-a093-fa4683304b2a-istio-token\") pod \"e2e-ipp-cleanup-556562-openshift-default-8485f84df4-85dmv\" (UID: \"87992233-e173-4d52-a093-fa4683304b2a\") " pod="openshift-ingress/e2e-ipp-cleanup-556562-openshift-default-8485f84df4-85dmv" Jul 30 20:36:39.068342 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:36:39.068135 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/87992233-e173-4d52-a093-fa4683304b2a-workload-socket\") pod \"e2e-ipp-cleanup-556562-openshift-default-8485f84df4-85dmv\" (UID: \"87992233-e173-4d52-a093-fa4683304b2a\") " pod="openshift-ingress/e2e-ipp-cleanup-556562-openshift-default-8485f84df4-85dmv" Jul 30 20:36:39.168892 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:36:39.168850 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/87992233-e173-4d52-a093-fa4683304b2a-credential-socket\") pod \"e2e-ipp-cleanup-556562-openshift-default-8485f84df4-85dmv\" (UID: \"87992233-e173-4d52-a093-fa4683304b2a\") " pod="openshift-ingress/e2e-ipp-cleanup-556562-openshift-default-8485f84df4-85dmv" Jul 30 20:36:39.168892 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:36:39.168886 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/87992233-e173-4d52-a093-fa4683304b2a-istio-data\") pod \"e2e-ipp-cleanup-556562-openshift-default-8485f84df4-85dmv\" (UID: \"87992233-e173-4d52-a093-fa4683304b2a\") " pod="openshift-ingress/e2e-ipp-cleanup-556562-openshift-default-8485f84df4-85dmv" Jul 30 20:36:39.169164 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:36:39.168907 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/87992233-e173-4d52-a093-fa4683304b2a-workload-certs\") pod \"e2e-ipp-cleanup-556562-openshift-default-8485f84df4-85dmv\" (UID: \"87992233-e173-4d52-a093-fa4683304b2a\") " pod="openshift-ingress/e2e-ipp-cleanup-556562-openshift-default-8485f84df4-85dmv" Jul 30 20:36:39.169164 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:36:39.168924 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/87992233-e173-4d52-a093-fa4683304b2a-istio-podinfo\") pod \"e2e-ipp-cleanup-556562-openshift-default-8485f84df4-85dmv\" (UID: \"87992233-e173-4d52-a093-fa4683304b2a\") " pod="openshift-ingress/e2e-ipp-cleanup-556562-openshift-default-8485f84df4-85dmv" Jul 30 20:36:39.169164 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:36:39.168946 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/87992233-e173-4d52-a093-fa4683304b2a-istio-token\") pod \"e2e-ipp-cleanup-556562-openshift-default-8485f84df4-85dmv\" (UID: \"87992233-e173-4d52-a093-fa4683304b2a\") " pod="openshift-ingress/e2e-ipp-cleanup-556562-openshift-default-8485f84df4-85dmv" Jul 30 20:36:39.169164 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:36:39.168980 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/87992233-e173-4d52-a093-fa4683304b2a-workload-socket\") pod \"e2e-ipp-cleanup-556562-openshift-default-8485f84df4-85dmv\" (UID: \"87992233-e173-4d52-a093-fa4683304b2a\") " pod="openshift-ingress/e2e-ipp-cleanup-556562-openshift-default-8485f84df4-85dmv" Jul 30 20:36:39.169164 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:36:39.169039 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lg5mq\" (UniqueName: \"kubernetes.io/projected/87992233-e173-4d52-a093-fa4683304b2a-kube-api-access-lg5mq\") pod \"e2e-ipp-cleanup-556562-openshift-default-8485f84df4-85dmv\" (UID: \"87992233-e173-4d52-a093-fa4683304b2a\") " pod="openshift-ingress/e2e-ipp-cleanup-556562-openshift-default-8485f84df4-85dmv" Jul 30 20:36:39.169164 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:36:39.169107 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/87992233-e173-4d52-a093-fa4683304b2a-istio-envoy\") pod \"e2e-ipp-cleanup-556562-openshift-default-8485f84df4-85dmv\" (UID: \"87992233-e173-4d52-a093-fa4683304b2a\") " pod="openshift-ingress/e2e-ipp-cleanup-556562-openshift-default-8485f84df4-85dmv" Jul 30 20:36:39.169164 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:36:39.169133 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/87992233-e173-4d52-a093-fa4683304b2a-istiod-ca-cert\") pod \"e2e-ipp-cleanup-556562-openshift-default-8485f84df4-85dmv\" (UID: \"87992233-e173-4d52-a093-fa4683304b2a\") " pod="openshift-ingress/e2e-ipp-cleanup-556562-openshift-default-8485f84df4-85dmv" Jul 30 20:36:39.169550 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:36:39.169337 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/87992233-e173-4d52-a093-fa4683304b2a-credential-socket\") pod \"e2e-ipp-cleanup-556562-openshift-default-8485f84df4-85dmv\" (UID: \"87992233-e173-4d52-a093-fa4683304b2a\") " pod="openshift-ingress/e2e-ipp-cleanup-556562-openshift-default-8485f84df4-85dmv" Jul 30 20:36:39.169550 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:36:39.169377 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/87992233-e173-4d52-a093-fa4683304b2a-istio-data\") pod \"e2e-ipp-cleanup-556562-openshift-default-8485f84df4-85dmv\" (UID: \"87992233-e173-4d52-a093-fa4683304b2a\") " pod="openshift-ingress/e2e-ipp-cleanup-556562-openshift-default-8485f84df4-85dmv" Jul 30 20:36:39.169550 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:36:39.169412 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/87992233-e173-4d52-a093-fa4683304b2a-workload-certs\") pod \"e2e-ipp-cleanup-556562-openshift-default-8485f84df4-85dmv\" (UID: \"87992233-e173-4d52-a093-fa4683304b2a\") " pod="openshift-ingress/e2e-ipp-cleanup-556562-openshift-default-8485f84df4-85dmv" Jul 30 20:36:39.169734 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:36:39.169709 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/87992233-e173-4d52-a093-fa4683304b2a-workload-socket\") pod \"e2e-ipp-cleanup-556562-openshift-default-8485f84df4-85dmv\" (UID: \"87992233-e173-4d52-a093-fa4683304b2a\") " pod="openshift-ingress/e2e-ipp-cleanup-556562-openshift-default-8485f84df4-85dmv" Jul 30 20:36:39.169851 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:36:39.169831 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/87992233-e173-4d52-a093-fa4683304b2a-istiod-ca-cert\") pod \"e2e-ipp-cleanup-556562-openshift-default-8485f84df4-85dmv\" (UID: \"87992233-e173-4d52-a093-fa4683304b2a\") " pod="openshift-ingress/e2e-ipp-cleanup-556562-openshift-default-8485f84df4-85dmv" Jul 30 20:36:39.171472 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:36:39.171446 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/87992233-e173-4d52-a093-fa4683304b2a-istio-envoy\") pod \"e2e-ipp-cleanup-556562-openshift-default-8485f84df4-85dmv\" (UID: \"87992233-e173-4d52-a093-fa4683304b2a\") " pod="openshift-ingress/e2e-ipp-cleanup-556562-openshift-default-8485f84df4-85dmv" Jul 30 20:36:39.171596 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:36:39.171519 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/87992233-e173-4d52-a093-fa4683304b2a-istio-podinfo\") pod \"e2e-ipp-cleanup-556562-openshift-default-8485f84df4-85dmv\" (UID: \"87992233-e173-4d52-a093-fa4683304b2a\") " pod="openshift-ingress/e2e-ipp-cleanup-556562-openshift-default-8485f84df4-85dmv" Jul 30 20:36:39.177101 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:36:39.177074 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/87992233-e173-4d52-a093-fa4683304b2a-istio-token\") pod \"e2e-ipp-cleanup-556562-openshift-default-8485f84df4-85dmv\" (UID: \"87992233-e173-4d52-a093-fa4683304b2a\") " pod="openshift-ingress/e2e-ipp-cleanup-556562-openshift-default-8485f84df4-85dmv" Jul 30 20:36:39.177583 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:36:39.177562 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lg5mq\" (UniqueName: \"kubernetes.io/projected/87992233-e173-4d52-a093-fa4683304b2a-kube-api-access-lg5mq\") pod \"e2e-ipp-cleanup-556562-openshift-default-8485f84df4-85dmv\" (UID: \"87992233-e173-4d52-a093-fa4683304b2a\") " pod="openshift-ingress/e2e-ipp-cleanup-556562-openshift-default-8485f84df4-85dmv" Jul 30 20:36:39.285554 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:36:39.285473 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-556562-openshift-default-8485f84df4-85dmv" Jul 30 20:36:39.419018 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:36:39.418994 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-556562-openshift-default-8485f84df4-85dmv"] Jul 30 20:36:39.421119 ip-10-0-136-46 kubenswrapper[2555]: W0730 20:36:39.421084 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87992233_e173_4d52_a093_fa4683304b2a.slice/crio-aabb8e7987355cac3ed72990ccf0265e39b1630d0f1fc73e3d29c509d6a4c7fb WatchSource:0}: Error finding container aabb8e7987355cac3ed72990ccf0265e39b1630d0f1fc73e3d29c509d6a4c7fb: Status 404 returned error can't find the container with id aabb8e7987355cac3ed72990ccf0265e39b1630d0f1fc73e3d29c509d6a4c7fb Jul 30 20:36:39.423312 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:36:39.423268 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 30 20:36:39.423381 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:36:39.423368 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 30 20:36:39.423423 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:36:39.423398 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 30 20:36:40.255203 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:36:40.255168 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-556562-openshift-default-8485f84df4-85dmv" event={"ID":"87992233-e173-4d52-a093-fa4683304b2a","Type":"ContainerStarted","Data":"576baa6b9eb301ae8d4354e4d924e1056b1d5dab597b39bd8da006e36beba3be"} Jul 30 20:36:40.255601 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:36:40.255219 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-556562-openshift-default-8485f84df4-85dmv" event={"ID":"87992233-e173-4d52-a093-fa4683304b2a","Type":"ContainerStarted","Data":"aabb8e7987355cac3ed72990ccf0265e39b1630d0f1fc73e3d29c509d6a4c7fb"} Jul 30 20:36:40.274995 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:36:40.274950 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-556562-openshift-default-8485f84df4-85dmv" podStartSLOduration=2.274931848 podStartE2EDuration="2.274931848s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:36:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:36:40.273057325 +0000 UTC m=+3434.424136892" watchObservedRunningTime="2026-07-30 20:36:40.274931848 +0000 UTC m=+3434.426011397" Jul 30 20:36:40.285750 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:36:40.285724 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-556562-openshift-default-8485f84df4-85dmv" Jul 30 20:36:40.290749 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:36:40.290726 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-556562-openshift-default-8485f84df4-85dmv" Jul 30 20:36:41.265545 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:36:41.265513 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-556562-openshift-default-8485f84df4-85dmv" Jul 30 20:36:41.266593 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:36:41.266575 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-556562-openshift-default-8485f84df4-85dmv" Jul 30 20:36:47.893381 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:36:47.893347 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 20:36:56.267311 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:36:56.267262 2555 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-556562-openshift-default-8485f84df4-85dmv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body= Jul 30 20:36:56.267718 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:36:56.267350 2555 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-cleanup-556562-openshift-default-8485f84df4-85dmv" podUID="87992233-e173-4d52-a093-fa4683304b2a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" Jul 30 20:36:56.331735 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:36:56.331702 2555 generic.go:356] "Generic (PLEG): container finished" podID="87992233-e173-4d52-a093-fa4683304b2a" containerID="576baa6b9eb301ae8d4354e4d924e1056b1d5dab597b39bd8da006e36beba3be" exitCode=0 Jul 30 20:36:56.331893 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:36:56.331774 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-556562-openshift-default-8485f84df4-85dmv" event={"ID":"87992233-e173-4d52-a093-fa4683304b2a","Type":"ContainerDied","Data":"576baa6b9eb301ae8d4354e4d924e1056b1d5dab597b39bd8da006e36beba3be"} Jul 30 20:36:56.332157 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:36:56.332145 2555 scope.go:117] "RemoveContainer" containerID="576baa6b9eb301ae8d4354e4d924e1056b1d5dab597b39bd8da006e36beba3be" Jul 30 20:36:56.333171 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:36:56.333139 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 30 20:36:56.333219 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:36:56.333211 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 30 20:36:56.333252 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:36:56.333242 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 30 20:36:57.341203 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:36:57.341158 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-556562-openshift-default-8485f84df4-85dmv" event={"ID":"87992233-e173-4d52-a093-fa4683304b2a","Type":"ContainerStarted","Data":"296536ec13d4b1fcf66708ad62cdbf015c7819cd10a80dac4e8369afc4e5ff7c"} Jul 30 20:36:58.286570 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:36:58.286534 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-556562-openshift-default-8485f84df4-85dmv" Jul 30 20:36:58.286781 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:36:58.286760 2555 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-556562-openshift-default-8485f84df4-85dmv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body= Jul 30 20:36:58.286824 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:36:58.286805 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-556562-openshift-default-8485f84df4-85dmv" podUID="87992233-e173-4d52-a093-fa4683304b2a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" Jul 30 20:36:59.286776 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:36:59.286739 2555 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-556562-openshift-default-8485f84df4-85dmv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body= Jul 30 20:36:59.287185 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:36:59.286813 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-556562-openshift-default-8485f84df4-85dmv" podUID="87992233-e173-4d52-a093-fa4683304b2a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" Jul 30 20:37:00.286834 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:37:00.286798 2555 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-556562-openshift-default-8485f84df4-85dmv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body= Jul 30 20:37:00.287337 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:37:00.286859 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-556562-openshift-default-8485f84df4-85dmv" podUID="87992233-e173-4d52-a093-fa4683304b2a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" Jul 30 20:37:01.290351 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:37:01.290321 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-556562-openshift-default-8485f84df4-85dmv" Jul 30 20:37:01.290763 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:37:01.290575 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-556562-openshift-default-8485f84df4-85dmv" Jul 30 20:37:01.291265 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:37:01.291250 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-556562-openshift-default-8485f84df4-85dmv" Jul 30 20:37:07.884715 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:37:07.884681 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-556562-jffp4"] Jul 30 20:37:07.887011 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:37:07.886995 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-556562-jffp4" Jul 30 20:37:07.889539 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:37:07.889519 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mgdxn\"" Jul 30 20:37:07.889656 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:37:07.889536 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 30 20:37:07.895428 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:37:07.895399 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-556562-jffp4"] Jul 30 20:37:08.022341 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:37:08.022305 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c1e62645-c00f-4a2c-868c-c5eec989e1cd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-556562-jffp4\" (UID: \"c1e62645-c00f-4a2c-868c-c5eec989e1cd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-556562-jffp4" Jul 30 20:37:08.123228 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:37:08.123192 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c1e62645-c00f-4a2c-868c-c5eec989e1cd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-556562-jffp4\" (UID: \"c1e62645-c00f-4a2c-868c-c5eec989e1cd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-556562-jffp4" Jul 30 20:37:08.123813 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:37:08.123794 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c1e62645-c00f-4a2c-868c-c5eec989e1cd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-556562-jffp4\" (UID: \"c1e62645-c00f-4a2c-868c-c5eec989e1cd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-556562-jffp4" Jul 30 20:37:08.198648 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:37:08.198567 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-556562-jffp4" Jul 30 20:37:08.322570 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:37:08.322427 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-556562-jffp4"] Jul 30 20:37:08.325257 ip-10-0-136-46 kubenswrapper[2555]: W0730 20:37:08.325220 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1e62645_c00f_4a2c_868c_c5eec989e1cd.slice/crio-4c00ce297ab7fd98ba1be9a06f1caddba05a89ffe82556d68b1994d74bca6fcb WatchSource:0}: Error finding container 4c00ce297ab7fd98ba1be9a06f1caddba05a89ffe82556d68b1994d74bca6fcb: Status 404 returned error can't find the container with id 4c00ce297ab7fd98ba1be9a06f1caddba05a89ffe82556d68b1994d74bca6fcb Jul 30 20:37:08.399105 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:37:08.399071 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-556562-jffp4" event={"ID":"c1e62645-c00f-4a2c-868c-c5eec989e1cd","Type":"ContainerStarted","Data":"4c00ce297ab7fd98ba1be9a06f1caddba05a89ffe82556d68b1994d74bca6fcb"} Jul 30 20:37:09.405582 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:37:09.405548 2555 generic.go:356] "Generic (PLEG): container finished" podID="c1e62645-c00f-4a2c-868c-c5eec989e1cd" containerID="4f94192571f52f0541a164928eb51deab2f7fe47be2c3be4ed30f4cbfb814685" exitCode=0 Jul 30 20:37:09.405971 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:37:09.405593 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-556562-jffp4" event={"ID":"c1e62645-c00f-4a2c-868c-c5eec989e1cd","Type":"ContainerDied","Data":"4f94192571f52f0541a164928eb51deab2f7fe47be2c3be4ed30f4cbfb814685"} Jul 30 20:37:10.534238 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:37:10.534215 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-556562-jffp4" Jul 30 20:37:10.645582 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:37:10.645546 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c1e62645-c00f-4a2c-868c-c5eec989e1cd-maas-api-service-ca\") pod \"c1e62645-c00f-4a2c-868c-c5eec989e1cd\" (UID: \"c1e62645-c00f-4a2c-868c-c5eec989e1cd\") " Jul 30 20:37:10.645948 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:37:10.645922 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c1e62645-c00f-4a2c-868c-c5eec989e1cd-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c1e62645-c00f-4a2c-868c-c5eec989e1cd" (UID: "c1e62645-c00f-4a2c-868c-c5eec989e1cd"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 20:37:10.746622 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:37:10.746590 2555 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c1e62645-c00f-4a2c-868c-c5eec989e1cd-maas-api-service-ca\") on node \"ip-10-0-136-46.ec2.internal\" DevicePath \"\"" Jul 30 20:37:11.416225 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:37:11.416194 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-556562-jffp4" Jul 30 20:37:11.416225 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:37:11.416214 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-556562-jffp4" event={"ID":"c1e62645-c00f-4a2c-868c-c5eec989e1cd","Type":"ContainerDied","Data":"4c00ce297ab7fd98ba1be9a06f1caddba05a89ffe82556d68b1994d74bca6fcb"} Jul 30 20:37:11.416477 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:37:11.416260 2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4c00ce297ab7fd98ba1be9a06f1caddba05a89ffe82556d68b1994d74bca6fcb" Jul 30 20:37:14.217350 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:37:14.217315 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-556562-jffp4"] Jul 30 20:37:14.218886 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:37:14.218864 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-556562-jffp4"] Jul 30 20:37:14.314728 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:37:14.314683 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c1e62645-c00f-4a2c-868c-c5eec989e1cd" path="/var/lib/kubelet/pods/c1e62645-c00f-4a2c-868c-c5eec989e1cd/volumes" Jul 30 20:37:18.934719 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:37:18.934679 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 20:37:20.584697 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:37:20.584663 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-556562-openshift-default-8485f84df4-85dmv"] Jul 30 20:37:20.585095 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:37:20.584928 2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-556562-openshift-default-8485f84df4-85dmv" podUID="87992233-e173-4d52-a093-fa4683304b2a" containerName="istio-proxy" containerID="cri-o://296536ec13d4b1fcf66708ad62cdbf015c7819cd10a80dac4e8369afc4e5ff7c" gracePeriod=30 Jul 30 20:37:24.525135 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:37:24.525096 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-7f2993-mcbt7"] Jul 30 20:37:24.525720 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:37:24.525587 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c1e62645-c00f-4a2c-868c-c5eec989e1cd" containerName="revoke-keys" Jul 30 20:37:24.525720 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:37:24.525606 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="c1e62645-c00f-4a2c-868c-c5eec989e1cd" containerName="revoke-keys" Jul 30 20:37:24.525720 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:37:24.525716 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="c1e62645-c00f-4a2c-868c-c5eec989e1cd" containerName="revoke-keys" Jul 30 20:37:24.528789 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:37:24.528769 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-7f2993-mcbt7" Jul 30 20:37:24.531698 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:37:24.531674 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 30 20:37:24.531799 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:37:24.531735 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mgdxn\"" Jul 30 20:37:24.546924 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:37:24.546897 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-7f2993-mcbt7"] Jul 30 20:37:24.671381 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:37:24.671339 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6752919f-34db-4c63-9ad3-0a2454ac5fbf-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-7f2993-mcbt7\" (UID: \"6752919f-34db-4c63-9ad3-0a2454ac5fbf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-7f2993-mcbt7" Jul 30 20:37:24.771865 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:37:24.771830 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6752919f-34db-4c63-9ad3-0a2454ac5fbf-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-7f2993-mcbt7\" (UID: \"6752919f-34db-4c63-9ad3-0a2454ac5fbf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-7f2993-mcbt7" Jul 30 20:37:24.772501 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:37:24.772481 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6752919f-34db-4c63-9ad3-0a2454ac5fbf-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-7f2993-mcbt7\" (UID: \"6752919f-34db-4c63-9ad3-0a2454ac5fbf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-7f2993-mcbt7" Jul 30 20:37:24.838942 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:37:24.838858 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-7f2993-mcbt7" Jul 30 20:37:24.964879 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:37:24.964852 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-7f2993-mcbt7"] Jul 30 20:37:24.966336 ip-10-0-136-46 kubenswrapper[2555]: W0730 20:37:24.966310 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6752919f_34db_4c63_9ad3_0a2454ac5fbf.slice/crio-83115200457f2700f49296c87f24e6b57db20e0bae29bfb3766faa24ac27541b WatchSource:0}: Error finding container 83115200457f2700f49296c87f24e6b57db20e0bae29bfb3766faa24ac27541b: Status 404 returned error can't find the container with id 83115200457f2700f49296c87f24e6b57db20e0bae29bfb3766faa24ac27541b Jul 30 20:37:25.478894 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:37:25.478861 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-7f2993-mcbt7" event={"ID":"6752919f-34db-4c63-9ad3-0a2454ac5fbf","Type":"ContainerStarted","Data":"61ea5870a0f9acbf75c5b68732ce4d9634cc341634f363f807320f79add025b2"} Jul 30 20:37:25.479055 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:37:25.478923 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-7f2993-mcbt7" event={"ID":"6752919f-34db-4c63-9ad3-0a2454ac5fbf","Type":"ContainerStarted","Data":"83115200457f2700f49296c87f24e6b57db20e0bae29bfb3766faa24ac27541b"} Jul 30 20:37:25.493498 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:37:25.493455 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-7f2993-mcbt7" podStartSLOduration=1.493440154 podStartE2EDuration="1.493440154s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:37:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:37:25.49216821 +0000 UTC m=+3479.643247762" watchObservedRunningTime="2026-07-30 20:37:25.493440154 +0000 UTC m=+3479.644519703" Jul 30 20:37:25.817703 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:37:25.817678 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-556562-openshift-default-8485f84df4-85dmv" Jul 30 20:37:25.982705 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:37:25.982670 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/87992233-e173-4d52-a093-fa4683304b2a-istio-podinfo\") pod \"87992233-e173-4d52-a093-fa4683304b2a\" (UID: \"87992233-e173-4d52-a093-fa4683304b2a\") " Jul 30 20:37:25.982895 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:37:25.982712 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/87992233-e173-4d52-a093-fa4683304b2a-workload-socket\") pod \"87992233-e173-4d52-a093-fa4683304b2a\" (UID: \"87992233-e173-4d52-a093-fa4683304b2a\") " Jul 30 20:37:25.982895 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:37:25.982746 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/87992233-e173-4d52-a093-fa4683304b2a-istio-token\") pod \"87992233-e173-4d52-a093-fa4683304b2a\" (UID: \"87992233-e173-4d52-a093-fa4683304b2a\") " Jul 30 20:37:25.982895 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:37:25.982771 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/87992233-e173-4d52-a093-fa4683304b2a-workload-certs\") pod \"87992233-e173-4d52-a093-fa4683304b2a\" (UID: \"87992233-e173-4d52-a093-fa4683304b2a\") " Jul 30 20:37:25.982895 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:37:25.982800 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/87992233-e173-4d52-a093-fa4683304b2a-istio-envoy\") pod \"87992233-e173-4d52-a093-fa4683304b2a\" (UID: \"87992233-e173-4d52-a093-fa4683304b2a\") " Jul 30 20:37:25.982895 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:37:25.982883 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/87992233-e173-4d52-a093-fa4683304b2a-istiod-ca-cert\") pod \"87992233-e173-4d52-a093-fa4683304b2a\" (UID: \"87992233-e173-4d52-a093-fa4683304b2a\") " Jul 30 20:37:25.983147 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:37:25.982934 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lg5mq\" (UniqueName: \"kubernetes.io/projected/87992233-e173-4d52-a093-fa4683304b2a-kube-api-access-lg5mq\") pod \"87992233-e173-4d52-a093-fa4683304b2a\" (UID: \"87992233-e173-4d52-a093-fa4683304b2a\") " Jul 30 20:37:25.983147 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:37:25.982970 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/87992233-e173-4d52-a093-fa4683304b2a-credential-socket\") pod \"87992233-e173-4d52-a093-fa4683304b2a\" (UID: \"87992233-e173-4d52-a093-fa4683304b2a\") " Jul 30 20:37:25.983147 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:37:25.983012 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/87992233-e173-4d52-a093-fa4683304b2a-istio-data\") pod \"87992233-e173-4d52-a093-fa4683304b2a\" (UID: \"87992233-e173-4d52-a093-fa4683304b2a\") " Jul 30 20:37:25.983147 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:37:25.983028 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87992233-e173-4d52-a093-fa4683304b2a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "87992233-e173-4d52-a093-fa4683304b2a" (UID: "87992233-e173-4d52-a093-fa4683304b2a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 20:37:25.983147 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:37:25.983076 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87992233-e173-4d52-a093-fa4683304b2a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "87992233-e173-4d52-a093-fa4683304b2a" (UID: "87992233-e173-4d52-a093-fa4683304b2a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 20:37:25.983438 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:37:25.983330 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87992233-e173-4d52-a093-fa4683304b2a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "87992233-e173-4d52-a093-fa4683304b2a" (UID: "87992233-e173-4d52-a093-fa4683304b2a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 20:37:25.983438 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:37:25.983341 2555 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/87992233-e173-4d52-a093-fa4683304b2a-workload-socket\") on node \"ip-10-0-136-46.ec2.internal\" DevicePath \"\"" Jul 30 20:37:25.983438 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:37:25.983364 2555 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/87992233-e173-4d52-a093-fa4683304b2a-workload-certs\") on node \"ip-10-0-136-46.ec2.internal\" DevicePath \"\"" Jul 30 20:37:25.983587 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:37:25.983488 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/87992233-e173-4d52-a093-fa4683304b2a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "87992233-e173-4d52-a093-fa4683304b2a" (UID: "87992233-e173-4d52-a093-fa4683304b2a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 20:37:25.983845 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:37:25.983824 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87992233-e173-4d52-a093-fa4683304b2a-istio-data" (OuterVolumeSpecName: "istio-data") pod "87992233-e173-4d52-a093-fa4683304b2a" (UID: "87992233-e173-4d52-a093-fa4683304b2a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 20:37:25.985167 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:37:25.985132 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/87992233-e173-4d52-a093-fa4683304b2a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "87992233-e173-4d52-a093-fa4683304b2a" (UID: "87992233-e173-4d52-a093-fa4683304b2a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 30 20:37:25.985167 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:37:25.985136 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87992233-e173-4d52-a093-fa4683304b2a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "87992233-e173-4d52-a093-fa4683304b2a" (UID: "87992233-e173-4d52-a093-fa4683304b2a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 20:37:25.985398 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:37:25.985298 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/87992233-e173-4d52-a093-fa4683304b2a-kube-api-access-lg5mq" (OuterVolumeSpecName: "kube-api-access-lg5mq") pod "87992233-e173-4d52-a093-fa4683304b2a" (UID: "87992233-e173-4d52-a093-fa4683304b2a"). InnerVolumeSpecName "kube-api-access-lg5mq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 20:37:25.985398 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:37:25.985318 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/87992233-e173-4d52-a093-fa4683304b2a-istio-token" (OuterVolumeSpecName: "istio-token") pod "87992233-e173-4d52-a093-fa4683304b2a" (UID: "87992233-e173-4d52-a093-fa4683304b2a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 20:37:26.084471 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:37:26.084382 2555 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/87992233-e173-4d52-a093-fa4683304b2a-istiod-ca-cert\") on node \"ip-10-0-136-46.ec2.internal\" DevicePath \"\"" Jul 30 20:37:26.084471 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:37:26.084420 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lg5mq\" (UniqueName: \"kubernetes.io/projected/87992233-e173-4d52-a093-fa4683304b2a-kube-api-access-lg5mq\") on node \"ip-10-0-136-46.ec2.internal\" DevicePath \"\"" Jul 30 20:37:26.084471 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:37:26.084431 2555 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/87992233-e173-4d52-a093-fa4683304b2a-credential-socket\") on node \"ip-10-0-136-46.ec2.internal\" DevicePath \"\"" Jul 30 20:37:26.084471 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:37:26.084440 2555 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/87992233-e173-4d52-a093-fa4683304b2a-istio-data\") on node \"ip-10-0-136-46.ec2.internal\" DevicePath \"\"" Jul 30 20:37:26.084471 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:37:26.084448 2555 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/87992233-e173-4d52-a093-fa4683304b2a-istio-podinfo\") on node \"ip-10-0-136-46.ec2.internal\" DevicePath \"\"" Jul 30 20:37:26.084471 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:37:26.084455 2555 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/87992233-e173-4d52-a093-fa4683304b2a-istio-token\") on node \"ip-10-0-136-46.ec2.internal\" DevicePath \"\"" Jul 30 20:37:26.084471 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:37:26.084462 2555 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/87992233-e173-4d52-a093-fa4683304b2a-istio-envoy\") on node \"ip-10-0-136-46.ec2.internal\" DevicePath \"\"" Jul 30 20:37:26.486502 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:37:26.486468 2555 generic.go:356] "Generic (PLEG): container finished" podID="6752919f-34db-4c63-9ad3-0a2454ac5fbf" containerID="61ea5870a0f9acbf75c5b68732ce4d9634cc341634f363f807320f79add025b2" exitCode=0 Jul 30 20:37:26.486699 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:37:26.486556 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-7f2993-mcbt7" event={"ID":"6752919f-34db-4c63-9ad3-0a2454ac5fbf","Type":"ContainerDied","Data":"61ea5870a0f9acbf75c5b68732ce4d9634cc341634f363f807320f79add025b2"} Jul 30 20:37:26.488192 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:37:26.488165 2555 generic.go:356] "Generic (PLEG): container finished" podID="87992233-e173-4d52-a093-fa4683304b2a" containerID="296536ec13d4b1fcf66708ad62cdbf015c7819cd10a80dac4e8369afc4e5ff7c" exitCode=0 Jul 30 20:37:26.488335 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:37:26.488225 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-556562-openshift-default-8485f84df4-85dmv" Jul 30 20:37:26.488335 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:37:26.488241 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-556562-openshift-default-8485f84df4-85dmv" event={"ID":"87992233-e173-4d52-a093-fa4683304b2a","Type":"ContainerDied","Data":"296536ec13d4b1fcf66708ad62cdbf015c7819cd10a80dac4e8369afc4e5ff7c"} Jul 30 20:37:26.488335 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:37:26.488314 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-556562-openshift-default-8485f84df4-85dmv" event={"ID":"87992233-e173-4d52-a093-fa4683304b2a","Type":"ContainerDied","Data":"aabb8e7987355cac3ed72990ccf0265e39b1630d0f1fc73e3d29c509d6a4c7fb"} Jul 30 20:37:26.488437 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:37:26.488347 2555 scope.go:117] "RemoveContainer" containerID="296536ec13d4b1fcf66708ad62cdbf015c7819cd10a80dac4e8369afc4e5ff7c" Jul 30 20:37:26.496739 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:37:26.496721 2555 scope.go:117] "RemoveContainer" containerID="576baa6b9eb301ae8d4354e4d924e1056b1d5dab597b39bd8da006e36beba3be" Jul 30 20:37:26.504866 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:37:26.504844 2555 scope.go:117] "RemoveContainer" containerID="296536ec13d4b1fcf66708ad62cdbf015c7819cd10a80dac4e8369afc4e5ff7c" Jul 30 20:37:26.505121 ip-10-0-136-46 kubenswrapper[2555]: E0730 20:37:26.505098 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"296536ec13d4b1fcf66708ad62cdbf015c7819cd10a80dac4e8369afc4e5ff7c\": container with ID starting with 296536ec13d4b1fcf66708ad62cdbf015c7819cd10a80dac4e8369afc4e5ff7c not found: ID does not exist" containerID="296536ec13d4b1fcf66708ad62cdbf015c7819cd10a80dac4e8369afc4e5ff7c" Jul 30 20:37:26.505196 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:37:26.505134 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"296536ec13d4b1fcf66708ad62cdbf015c7819cd10a80dac4e8369afc4e5ff7c"} err="failed to get container status \"296536ec13d4b1fcf66708ad62cdbf015c7819cd10a80dac4e8369afc4e5ff7c\": rpc error: code = NotFound desc = could not find container \"296536ec13d4b1fcf66708ad62cdbf015c7819cd10a80dac4e8369afc4e5ff7c\": container with ID starting with 296536ec13d4b1fcf66708ad62cdbf015c7819cd10a80dac4e8369afc4e5ff7c not found: ID does not exist" Jul 30 20:37:26.505196 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:37:26.505162 2555 scope.go:117] "RemoveContainer" containerID="576baa6b9eb301ae8d4354e4d924e1056b1d5dab597b39bd8da006e36beba3be" Jul 30 20:37:26.505450 ip-10-0-136-46 kubenswrapper[2555]: E0730 20:37:26.505429 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"576baa6b9eb301ae8d4354e4d924e1056b1d5dab597b39bd8da006e36beba3be\": container with ID starting with 576baa6b9eb301ae8d4354e4d924e1056b1d5dab597b39bd8da006e36beba3be not found: ID does not exist" containerID="576baa6b9eb301ae8d4354e4d924e1056b1d5dab597b39bd8da006e36beba3be" Jul 30 20:37:26.505526 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:37:26.505454 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"576baa6b9eb301ae8d4354e4d924e1056b1d5dab597b39bd8da006e36beba3be"} err="failed to get container status \"576baa6b9eb301ae8d4354e4d924e1056b1d5dab597b39bd8da006e36beba3be\": rpc error: code = NotFound desc = could not find container \"576baa6b9eb301ae8d4354e4d924e1056b1d5dab597b39bd8da006e36beba3be\": container with ID starting with 576baa6b9eb301ae8d4354e4d924e1056b1d5dab597b39bd8da006e36beba3be not found: ID does not exist" Jul 30 20:37:26.512574 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:37:26.512551 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-556562-openshift-default-8485f84df4-85dmv"] Jul 30 20:37:26.517022 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:37:26.517003 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-556562-openshift-default-8485f84df4-85dmv"] Jul 30 20:37:27.625384 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:37:27.625357 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-7f2993-mcbt7" Jul 30 20:37:27.798609 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:37:27.798532 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6752919f-34db-4c63-9ad3-0a2454ac5fbf-maas-api-service-ca\") pod \"6752919f-34db-4c63-9ad3-0a2454ac5fbf\" (UID: \"6752919f-34db-4c63-9ad3-0a2454ac5fbf\") " Jul 30 20:37:27.798883 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:37:27.798860 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6752919f-34db-4c63-9ad3-0a2454ac5fbf-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "6752919f-34db-4c63-9ad3-0a2454ac5fbf" (UID: "6752919f-34db-4c63-9ad3-0a2454ac5fbf"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 20:37:27.899790 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:37:27.899756 2555 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6752919f-34db-4c63-9ad3-0a2454ac5fbf-maas-api-service-ca\") on node \"ip-10-0-136-46.ec2.internal\" DevicePath \"\"" Jul 30 20:37:28.314026 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:37:28.313994 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="87992233-e173-4d52-a093-fa4683304b2a" path="/var/lib/kubelet/pods/87992233-e173-4d52-a093-fa4683304b2a/volumes" Jul 30 20:37:28.499150 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:37:28.499116 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-7f2993-mcbt7" event={"ID":"6752919f-34db-4c63-9ad3-0a2454ac5fbf","Type":"ContainerDied","Data":"83115200457f2700f49296c87f24e6b57db20e0bae29bfb3766faa24ac27541b"} Jul 30 20:37:28.499150 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:37:28.499145 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-7f2993-mcbt7" Jul 30 20:37:28.499385 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:37:28.499163 2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="83115200457f2700f49296c87f24e6b57db20e0bae29bfb3766faa24ac27541b" Jul 30 20:37:39.195059 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:37:39.195014 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 20:37:40.130609 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:37:40.130567 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-7f2993-mcbt7"] Jul 30 20:37:40.135654 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:37:40.135629 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-7f2993-mcbt7"] Jul 30 20:37:40.314233 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:37:40.314197 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6752919f-34db-4c63-9ad3-0a2454ac5fbf" path="/var/lib/kubelet/pods/6752919f-34db-4c63-9ad3-0a2454ac5fbf/volumes" Jul 30 20:37:50.294337 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:37:50.294246 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 20:38:42.667709 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:38:42.667662 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-7f2993-openshift-default-76f4bcc794-rklhg"] Jul 30 20:38:42.668313 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:38:42.667917 2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-7f2993-openshift-default-76f4bcc794-rklhg" podUID="60e268d2-20e5-4636-aaa8-13f6030cccd4" containerName="istio-proxy" containerID="cri-o://fa7303c82cc1187816da8ccec236ca0f33b659b8dfa92887d4c9434cd7c196c0" gracePeriod=30 Jul 30 20:38:47.857957 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:38:47.857926 2555 generic.go:356] "Generic (PLEG): container finished" podID="60e268d2-20e5-4636-aaa8-13f6030cccd4" containerID="fa7303c82cc1187816da8ccec236ca0f33b659b8dfa92887d4c9434cd7c196c0" exitCode=0 Jul 30 20:38:47.858341 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:38:47.857971 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-7f2993-openshift-default-76f4bcc794-rklhg" event={"ID":"60e268d2-20e5-4636-aaa8-13f6030cccd4","Type":"ContainerDied","Data":"fa7303c82cc1187816da8ccec236ca0f33b659b8dfa92887d4c9434cd7c196c0"} Jul 30 20:38:47.858341 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:38:47.858023 2555 scope.go:117] "RemoveContainer" containerID="bdc156cc3175b28e99a2f53a100d6ac4f71ec041fe02d1e2d3b48f06c4e62039" Jul 30 20:38:47.911988 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:38:47.911962 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-7f2993-openshift-default-76f4bcc794-rklhg" Jul 30 20:38:47.982341 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:38:47.982310 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/60e268d2-20e5-4636-aaa8-13f6030cccd4-istio-data\") pod \"60e268d2-20e5-4636-aaa8-13f6030cccd4\" (UID: \"60e268d2-20e5-4636-aaa8-13f6030cccd4\") " Jul 30 20:38:47.982341 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:38:47.982345 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/60e268d2-20e5-4636-aaa8-13f6030cccd4-istiod-ca-cert\") pod \"60e268d2-20e5-4636-aaa8-13f6030cccd4\" (UID: \"60e268d2-20e5-4636-aaa8-13f6030cccd4\") " Jul 30 20:38:47.982577 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:38:47.982380 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/60e268d2-20e5-4636-aaa8-13f6030cccd4-credential-socket\") pod \"60e268d2-20e5-4636-aaa8-13f6030cccd4\" (UID: \"60e268d2-20e5-4636-aaa8-13f6030cccd4\") " Jul 30 20:38:47.982577 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:38:47.982420 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/60e268d2-20e5-4636-aaa8-13f6030cccd4-istio-token\") pod \"60e268d2-20e5-4636-aaa8-13f6030cccd4\" (UID: \"60e268d2-20e5-4636-aaa8-13f6030cccd4\") " Jul 30 20:38:47.982577 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:38:47.982453 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/60e268d2-20e5-4636-aaa8-13f6030cccd4-istio-envoy\") pod \"60e268d2-20e5-4636-aaa8-13f6030cccd4\" (UID: \"60e268d2-20e5-4636-aaa8-13f6030cccd4\") " Jul 30 20:38:47.982577 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:38:47.982477 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6qhlv\" (UniqueName: \"kubernetes.io/projected/60e268d2-20e5-4636-aaa8-13f6030cccd4-kube-api-access-6qhlv\") pod \"60e268d2-20e5-4636-aaa8-13f6030cccd4\" (UID: \"60e268d2-20e5-4636-aaa8-13f6030cccd4\") " Jul 30 20:38:47.982577 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:38:47.982512 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/60e268d2-20e5-4636-aaa8-13f6030cccd4-istio-podinfo\") pod \"60e268d2-20e5-4636-aaa8-13f6030cccd4\" (UID: \"60e268d2-20e5-4636-aaa8-13f6030cccd4\") " Jul 30 20:38:47.982577 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:38:47.982547 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/60e268d2-20e5-4636-aaa8-13f6030cccd4-workload-socket\") pod \"60e268d2-20e5-4636-aaa8-13f6030cccd4\" (UID: \"60e268d2-20e5-4636-aaa8-13f6030cccd4\") " Jul 30 20:38:47.982577 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:38:47.982576 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/60e268d2-20e5-4636-aaa8-13f6030cccd4-workload-certs\") pod \"60e268d2-20e5-4636-aaa8-13f6030cccd4\" (UID: \"60e268d2-20e5-4636-aaa8-13f6030cccd4\") " Jul 30 20:38:47.982947 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:38:47.982781 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60e268d2-20e5-4636-aaa8-13f6030cccd4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "60e268d2-20e5-4636-aaa8-13f6030cccd4" (UID: "60e268d2-20e5-4636-aaa8-13f6030cccd4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 20:38:47.982947 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:38:47.982797 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/60e268d2-20e5-4636-aaa8-13f6030cccd4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "60e268d2-20e5-4636-aaa8-13f6030cccd4" (UID: "60e268d2-20e5-4636-aaa8-13f6030cccd4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 20:38:47.983070 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:38:47.982970 2555 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/60e268d2-20e5-4636-aaa8-13f6030cccd4-istiod-ca-cert\") on node \"ip-10-0-136-46.ec2.internal\" DevicePath \"\"" Jul 30 20:38:47.983070 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:38:47.982974 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60e268d2-20e5-4636-aaa8-13f6030cccd4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "60e268d2-20e5-4636-aaa8-13f6030cccd4" (UID: "60e268d2-20e5-4636-aaa8-13f6030cccd4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 20:38:47.983070 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:38:47.982989 2555 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/60e268d2-20e5-4636-aaa8-13f6030cccd4-credential-socket\") on node \"ip-10-0-136-46.ec2.internal\" DevicePath \"\"" Jul 30 20:38:47.983070 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:38:47.983036 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60e268d2-20e5-4636-aaa8-13f6030cccd4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "60e268d2-20e5-4636-aaa8-13f6030cccd4" (UID: "60e268d2-20e5-4636-aaa8-13f6030cccd4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 20:38:47.983269 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:38:47.983081 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60e268d2-20e5-4636-aaa8-13f6030cccd4-istio-data" (OuterVolumeSpecName: "istio-data") pod "60e268d2-20e5-4636-aaa8-13f6030cccd4" (UID: "60e268d2-20e5-4636-aaa8-13f6030cccd4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 20:38:47.984663 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:38:47.984629 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/60e268d2-20e5-4636-aaa8-13f6030cccd4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "60e268d2-20e5-4636-aaa8-13f6030cccd4" (UID: "60e268d2-20e5-4636-aaa8-13f6030cccd4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 30 20:38:47.984798 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:38:47.984735 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/60e268d2-20e5-4636-aaa8-13f6030cccd4-istio-token" (OuterVolumeSpecName: "istio-token") pod "60e268d2-20e5-4636-aaa8-13f6030cccd4" (UID: "60e268d2-20e5-4636-aaa8-13f6030cccd4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 20:38:47.984967 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:38:47.984944 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60e268d2-20e5-4636-aaa8-13f6030cccd4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "60e268d2-20e5-4636-aaa8-13f6030cccd4" (UID: "60e268d2-20e5-4636-aaa8-13f6030cccd4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 20:38:47.985032 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:38:47.984986 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/60e268d2-20e5-4636-aaa8-13f6030cccd4-kube-api-access-6qhlv" (OuterVolumeSpecName: "kube-api-access-6qhlv") pod "60e268d2-20e5-4636-aaa8-13f6030cccd4" (UID: "60e268d2-20e5-4636-aaa8-13f6030cccd4"). InnerVolumeSpecName "kube-api-access-6qhlv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 20:38:48.084263 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:38:48.084232 2555 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/60e268d2-20e5-4636-aaa8-13f6030cccd4-istio-token\") on node \"ip-10-0-136-46.ec2.internal\" DevicePath \"\"" Jul 30 20:38:48.084263 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:38:48.084257 2555 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/60e268d2-20e5-4636-aaa8-13f6030cccd4-istio-envoy\") on node \"ip-10-0-136-46.ec2.internal\" DevicePath \"\"" Jul 30 20:38:48.084263 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:38:48.084267 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6qhlv\" (UniqueName: \"kubernetes.io/projected/60e268d2-20e5-4636-aaa8-13f6030cccd4-kube-api-access-6qhlv\") on node \"ip-10-0-136-46.ec2.internal\" DevicePath \"\"" Jul 30 20:38:48.084517 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:38:48.084298 2555 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/60e268d2-20e5-4636-aaa8-13f6030cccd4-istio-podinfo\") on node \"ip-10-0-136-46.ec2.internal\" DevicePath \"\"" Jul 30 20:38:48.084517 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:38:48.084311 2555 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/60e268d2-20e5-4636-aaa8-13f6030cccd4-workload-socket\") on node \"ip-10-0-136-46.ec2.internal\" DevicePath \"\"" Jul 30 20:38:48.084517 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:38:48.084322 2555 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/60e268d2-20e5-4636-aaa8-13f6030cccd4-workload-certs\") on node \"ip-10-0-136-46.ec2.internal\" DevicePath \"\"" Jul 30 20:38:48.084517 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:38:48.084334 2555 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/60e268d2-20e5-4636-aaa8-13f6030cccd4-istio-data\") on node \"ip-10-0-136-46.ec2.internal\" DevicePath \"\"" Jul 30 20:38:48.864894 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:38:48.864860 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-7f2993-openshift-default-76f4bcc794-rklhg" event={"ID":"60e268d2-20e5-4636-aaa8-13f6030cccd4","Type":"ContainerDied","Data":"511ef98257d6df5bef7869f7ec75634a023219d67fa63c3c50707e85e3f9e969"} Jul 30 20:38:48.864894 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:38:48.864894 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-7f2993-openshift-default-76f4bcc794-rklhg" Jul 30 20:38:48.865390 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:38:48.864921 2555 scope.go:117] "RemoveContainer" containerID="fa7303c82cc1187816da8ccec236ca0f33b659b8dfa92887d4c9434cd7c196c0" Jul 30 20:38:48.881748 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:38:48.881724 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-7f2993-openshift-default-76f4bcc794-rklhg"] Jul 30 20:38:48.885564 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:38:48.885541 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-7f2993-openshift-default-76f4bcc794-rklhg"] Jul 30 20:38:50.314691 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:38:50.314658 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="60e268d2-20e5-4636-aaa8-13f6030cccd4" path="/var/lib/kubelet/pods/60e268d2-20e5-4636-aaa8-13f6030cccd4/volumes" Jul 30 20:38:56.496668 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:38:56.496631 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 20:38:59.896980 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:38:59.896948 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-9d3c06-openshift-default-88bbfb67d-qftvn"] Jul 30 20:38:59.898084 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:38:59.897540 2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-9d3c06-openshift-default-88bbfb67d-qftvn" podUID="cdec9a41-b9d4-43da-acea-4c1bba8320c9" containerName="istio-proxy" containerID="cri-o://88fd80460201209a527ba9077604a969b85f4a2f40938bfeece7e08c648da959" gracePeriod=30 Jul 30 20:39:00.272918 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:39:00.272882 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-474e8f-rf2z6"] Jul 30 20:39:00.273301 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:39:00.273256 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60e268d2-20e5-4636-aaa8-13f6030cccd4" containerName="istio-proxy" Jul 30 20:39:00.273301 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:39:00.273291 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="60e268d2-20e5-4636-aaa8-13f6030cccd4" containerName="istio-proxy" Jul 30 20:39:00.273505 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:39:00.273310 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87992233-e173-4d52-a093-fa4683304b2a" containerName="istio-proxy" Jul 30 20:39:00.273505 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:39:00.273319 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="87992233-e173-4d52-a093-fa4683304b2a" containerName="istio-proxy" Jul 30 20:39:00.273505 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:39:00.273342 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6752919f-34db-4c63-9ad3-0a2454ac5fbf" containerName="revoke-keys" Jul 30 20:39:00.273505 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:39:00.273350 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="6752919f-34db-4c63-9ad3-0a2454ac5fbf" containerName="revoke-keys" Jul 30 20:39:00.273505 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:39:00.273361 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87992233-e173-4d52-a093-fa4683304b2a" containerName="istio-proxy" Jul 30 20:39:00.273505 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:39:00.273369 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="87992233-e173-4d52-a093-fa4683304b2a" containerName="istio-proxy" Jul 30 20:39:00.273505 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:39:00.273453 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="60e268d2-20e5-4636-aaa8-13f6030cccd4" containerName="istio-proxy" Jul 30 20:39:00.273505 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:39:00.273467 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="87992233-e173-4d52-a093-fa4683304b2a" containerName="istio-proxy" Jul 30 20:39:00.273505 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:39:00.273478 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="60e268d2-20e5-4636-aaa8-13f6030cccd4" containerName="istio-proxy" Jul 30 20:39:00.273505 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:39:00.273487 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="6752919f-34db-4c63-9ad3-0a2454ac5fbf" containerName="revoke-keys" Jul 30 20:39:00.273505 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:39:00.273498 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="87992233-e173-4d52-a093-fa4683304b2a" containerName="istio-proxy" Jul 30 20:39:00.277773 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:39:00.277753 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-474e8f-rf2z6" Jul 30 20:39:00.280196 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:39:00.280177 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 30 20:39:00.280317 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:39:00.280218 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mgdxn\"" Jul 30 20:39:00.283752 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:39:00.283728 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-474e8f-rf2z6"] Jul 30 20:39:00.386249 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:39:00.386221 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0241ec3e-00db-4c9d-b14d-9cf3e273ae30-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-474e8f-rf2z6\" (UID: \"0241ec3e-00db-4c9d-b14d-9cf3e273ae30\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-474e8f-rf2z6" Jul 30 20:39:00.487118 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:39:00.487082 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0241ec3e-00db-4c9d-b14d-9cf3e273ae30-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-474e8f-rf2z6\" (UID: \"0241ec3e-00db-4c9d-b14d-9cf3e273ae30\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-474e8f-rf2z6" Jul 30 20:39:00.487722 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:39:00.487703 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0241ec3e-00db-4c9d-b14d-9cf3e273ae30-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-474e8f-rf2z6\" (UID: \"0241ec3e-00db-4c9d-b14d-9cf3e273ae30\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-474e8f-rf2z6" Jul 30 20:39:00.589356 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:39:00.589270 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-474e8f-rf2z6" Jul 30 20:39:00.709908 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:39:00.709887 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-474e8f-rf2z6"] Jul 30 20:39:00.711757 ip-10-0-136-46 kubenswrapper[2555]: W0730 20:39:00.711734 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0241ec3e_00db_4c9d_b14d_9cf3e273ae30.slice/crio-df82cb2e394bfbe79bab6f933c88d2c1c9c91ffeb05449593536fd8771d74571 WatchSource:0}: Error finding container df82cb2e394bfbe79bab6f933c88d2c1c9c91ffeb05449593536fd8771d74571: Status 404 returned error can't find the container with id df82cb2e394bfbe79bab6f933c88d2c1c9c91ffeb05449593536fd8771d74571 Jul 30 20:39:00.920686 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:39:00.920593 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-474e8f-rf2z6" event={"ID":"0241ec3e-00db-4c9d-b14d-9cf3e273ae30","Type":"ContainerStarted","Data":"df82cb2e394bfbe79bab6f933c88d2c1c9c91ffeb05449593536fd8771d74571"} Jul 30 20:39:01.926039 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:39:01.926004 2555 generic.go:356] "Generic (PLEG): container finished" podID="0241ec3e-00db-4c9d-b14d-9cf3e273ae30" containerID="f8432b7dce141a28a0097f79c9f92a323852b0b8b844f0d49b840a9398f4da35" exitCode=0 Jul 30 20:39:01.926419 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:39:01.926076 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-474e8f-rf2z6" event={"ID":"0241ec3e-00db-4c9d-b14d-9cf3e273ae30","Type":"ContainerDied","Data":"f8432b7dce141a28a0097f79c9f92a323852b0b8b844f0d49b840a9398f4da35"} Jul 30 20:39:03.055217 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:39:03.055193 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-474e8f-rf2z6" Jul 30 20:39:03.109377 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:39:03.109349 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0241ec3e-00db-4c9d-b14d-9cf3e273ae30-maas-api-service-ca\") pod \"0241ec3e-00db-4c9d-b14d-9cf3e273ae30\" (UID: \"0241ec3e-00db-4c9d-b14d-9cf3e273ae30\") " Jul 30 20:39:03.109692 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:39:03.109671 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0241ec3e-00db-4c9d-b14d-9cf3e273ae30-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "0241ec3e-00db-4c9d-b14d-9cf3e273ae30" (UID: "0241ec3e-00db-4c9d-b14d-9cf3e273ae30"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 20:39:03.210739 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:39:03.210665 2555 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0241ec3e-00db-4c9d-b14d-9cf3e273ae30-maas-api-service-ca\") on node \"ip-10-0-136-46.ec2.internal\" DevicePath \"\"" Jul 30 20:39:03.935472 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:39:03.935436 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-474e8f-rf2z6" event={"ID":"0241ec3e-00db-4c9d-b14d-9cf3e273ae30","Type":"ContainerDied","Data":"df82cb2e394bfbe79bab6f933c88d2c1c9c91ffeb05449593536fd8771d74571"} Jul 30 20:39:03.935472 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:39:03.935468 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-474e8f-rf2z6" Jul 30 20:39:03.935676 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:39:03.935494 2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="df82cb2e394bfbe79bab6f933c88d2c1c9c91ffeb05449593536fd8771d74571" Jul 30 20:39:05.155925 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:39:05.155902 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-9d3c06-openshift-default-88bbfb67d-qftvn" Jul 30 20:39:05.230561 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:39:05.230537 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cdec9a41-b9d4-43da-acea-4c1bba8320c9-istiod-ca-cert\") pod \"cdec9a41-b9d4-43da-acea-4c1bba8320c9\" (UID: \"cdec9a41-b9d4-43da-acea-4c1bba8320c9\") " Jul 30 20:39:05.230715 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:39:05.230569 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cdec9a41-b9d4-43da-acea-4c1bba8320c9-istio-data\") pod \"cdec9a41-b9d4-43da-acea-4c1bba8320c9\" (UID: \"cdec9a41-b9d4-43da-acea-4c1bba8320c9\") " Jul 30 20:39:05.230715 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:39:05.230616 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cdec9a41-b9d4-43da-acea-4c1bba8320c9-workload-socket\") pod \"cdec9a41-b9d4-43da-acea-4c1bba8320c9\" (UID: \"cdec9a41-b9d4-43da-acea-4c1bba8320c9\") " Jul 30 20:39:05.230715 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:39:05.230634 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cdec9a41-b9d4-43da-acea-4c1bba8320c9-istio-envoy\") pod \"cdec9a41-b9d4-43da-acea-4c1bba8320c9\" (UID: \"cdec9a41-b9d4-43da-acea-4c1bba8320c9\") " Jul 30 20:39:05.230715 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:39:05.230664 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cdec9a41-b9d4-43da-acea-4c1bba8320c9-credential-socket\") pod \"cdec9a41-b9d4-43da-acea-4c1bba8320c9\" (UID: \"cdec9a41-b9d4-43da-acea-4c1bba8320c9\") " Jul 30 20:39:05.230715 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:39:05.230682 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cdec9a41-b9d4-43da-acea-4c1bba8320c9-istio-podinfo\") pod \"cdec9a41-b9d4-43da-acea-4c1bba8320c9\" (UID: \"cdec9a41-b9d4-43da-acea-4c1bba8320c9\") " Jul 30 20:39:05.230715 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:39:05.230713 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cdec9a41-b9d4-43da-acea-4c1bba8320c9-workload-certs\") pod \"cdec9a41-b9d4-43da-acea-4c1bba8320c9\" (UID: \"cdec9a41-b9d4-43da-acea-4c1bba8320c9\") " Jul 30 20:39:05.231026 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:39:05.230735 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8sd8p\" (UniqueName: \"kubernetes.io/projected/cdec9a41-b9d4-43da-acea-4c1bba8320c9-kube-api-access-8sd8p\") pod \"cdec9a41-b9d4-43da-acea-4c1bba8320c9\" (UID: \"cdec9a41-b9d4-43da-acea-4c1bba8320c9\") " Jul 30 20:39:05.231026 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:39:05.230788 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cdec9a41-b9d4-43da-acea-4c1bba8320c9-istio-token\") pod \"cdec9a41-b9d4-43da-acea-4c1bba8320c9\" (UID: \"cdec9a41-b9d4-43da-acea-4c1bba8320c9\") " Jul 30 20:39:05.231026 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:39:05.230969 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cdec9a41-b9d4-43da-acea-4c1bba8320c9-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "cdec9a41-b9d4-43da-acea-4c1bba8320c9" (UID: "cdec9a41-b9d4-43da-acea-4c1bba8320c9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 20:39:05.231185 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:39:05.231098 2555 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cdec9a41-b9d4-43da-acea-4c1bba8320c9-workload-certs\") on node \"ip-10-0-136-46.ec2.internal\" DevicePath \"\"" Jul 30 20:39:05.231185 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:39:05.230977 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cdec9a41-b9d4-43da-acea-4c1bba8320c9-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "cdec9a41-b9d4-43da-acea-4c1bba8320c9" (UID: "cdec9a41-b9d4-43da-acea-4c1bba8320c9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 20:39:05.231382 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:39:05.231337 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cdec9a41-b9d4-43da-acea-4c1bba8320c9-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "cdec9a41-b9d4-43da-acea-4c1bba8320c9" (UID: "cdec9a41-b9d4-43da-acea-4c1bba8320c9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 20:39:05.231460 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:39:05.231386 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cdec9a41-b9d4-43da-acea-4c1bba8320c9-istio-data" (OuterVolumeSpecName: "istio-data") pod "cdec9a41-b9d4-43da-acea-4c1bba8320c9" (UID: "cdec9a41-b9d4-43da-acea-4c1bba8320c9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 20:39:05.231460 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:39:05.231416 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cdec9a41-b9d4-43da-acea-4c1bba8320c9-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "cdec9a41-b9d4-43da-acea-4c1bba8320c9" (UID: "cdec9a41-b9d4-43da-acea-4c1bba8320c9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 20:39:05.232807 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:39:05.232777 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cdec9a41-b9d4-43da-acea-4c1bba8320c9-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "cdec9a41-b9d4-43da-acea-4c1bba8320c9" (UID: "cdec9a41-b9d4-43da-acea-4c1bba8320c9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 20:39:05.233004 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:39:05.232981 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cdec9a41-b9d4-43da-acea-4c1bba8320c9-kube-api-access-8sd8p" (OuterVolumeSpecName: "kube-api-access-8sd8p") pod "cdec9a41-b9d4-43da-acea-4c1bba8320c9" (UID: "cdec9a41-b9d4-43da-acea-4c1bba8320c9"). InnerVolumeSpecName "kube-api-access-8sd8p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 20:39:05.233198 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:39:05.233180 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/cdec9a41-b9d4-43da-acea-4c1bba8320c9-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "cdec9a41-b9d4-43da-acea-4c1bba8320c9" (UID: "cdec9a41-b9d4-43da-acea-4c1bba8320c9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 30 20:39:05.233264 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:39:05.233243 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cdec9a41-b9d4-43da-acea-4c1bba8320c9-istio-token" (OuterVolumeSpecName: "istio-token") pod "cdec9a41-b9d4-43da-acea-4c1bba8320c9" (UID: "cdec9a41-b9d4-43da-acea-4c1bba8320c9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 20:39:05.331817 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:39:05.331795 2555 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cdec9a41-b9d4-43da-acea-4c1bba8320c9-workload-socket\") on node \"ip-10-0-136-46.ec2.internal\" DevicePath \"\"" Jul 30 20:39:05.331817 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:39:05.331815 2555 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cdec9a41-b9d4-43da-acea-4c1bba8320c9-istio-envoy\") on node \"ip-10-0-136-46.ec2.internal\" DevicePath \"\"" Jul 30 20:39:05.331949 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:39:05.331825 2555 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cdec9a41-b9d4-43da-acea-4c1bba8320c9-credential-socket\") on node \"ip-10-0-136-46.ec2.internal\" DevicePath \"\"" Jul 30 20:39:05.331949 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:39:05.331833 2555 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cdec9a41-b9d4-43da-acea-4c1bba8320c9-istio-podinfo\") on node \"ip-10-0-136-46.ec2.internal\" DevicePath \"\"" Jul 30 20:39:05.331949 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:39:05.331841 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8sd8p\" (UniqueName: \"kubernetes.io/projected/cdec9a41-b9d4-43da-acea-4c1bba8320c9-kube-api-access-8sd8p\") on node \"ip-10-0-136-46.ec2.internal\" DevicePath \"\"" Jul 30 20:39:05.331949 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:39:05.331849 2555 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cdec9a41-b9d4-43da-acea-4c1bba8320c9-istio-token\") on node \"ip-10-0-136-46.ec2.internal\" DevicePath \"\"" Jul 30 20:39:05.331949 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:39:05.331857 2555 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cdec9a41-b9d4-43da-acea-4c1bba8320c9-istiod-ca-cert\") on node \"ip-10-0-136-46.ec2.internal\" DevicePath \"\"" Jul 30 20:39:05.331949 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:39:05.331866 2555 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cdec9a41-b9d4-43da-acea-4c1bba8320c9-istio-data\") on node \"ip-10-0-136-46.ec2.internal\" DevicePath \"\"" Jul 30 20:39:05.945064 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:39:05.945028 2555 generic.go:356] "Generic (PLEG): container finished" podID="cdec9a41-b9d4-43da-acea-4c1bba8320c9" containerID="88fd80460201209a527ba9077604a969b85f4a2f40938bfeece7e08c648da959" exitCode=0 Jul 30 20:39:05.945232 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:39:05.945076 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-9d3c06-openshift-default-88bbfb67d-qftvn" Jul 30 20:39:05.945232 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:39:05.945106 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-9d3c06-openshift-default-88bbfb67d-qftvn" event={"ID":"cdec9a41-b9d4-43da-acea-4c1bba8320c9","Type":"ContainerDied","Data":"88fd80460201209a527ba9077604a969b85f4a2f40938bfeece7e08c648da959"} Jul 30 20:39:05.945232 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:39:05.945166 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-9d3c06-openshift-default-88bbfb67d-qftvn" event={"ID":"cdec9a41-b9d4-43da-acea-4c1bba8320c9","Type":"ContainerDied","Data":"c1d7bec502eab5a3865c28fc7bd02d2a1ef6cbf907c13b6ba5b80ef6f425a1e5"} Jul 30 20:39:05.945232 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:39:05.945190 2555 scope.go:117] "RemoveContainer" containerID="88fd80460201209a527ba9077604a969b85f4a2f40938bfeece7e08c648da959" Jul 30 20:39:05.954038 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:39:05.954020 2555 scope.go:117] "RemoveContainer" containerID="ae568d60ea8d404381444fb8587db0c18e78e58878a1b97f431c16609a584cb5" Jul 30 20:39:05.962823 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:39:05.962808 2555 scope.go:117] "RemoveContainer" containerID="88fd80460201209a527ba9077604a969b85f4a2f40938bfeece7e08c648da959" Jul 30 20:39:05.963063 ip-10-0-136-46 kubenswrapper[2555]: E0730 20:39:05.963044 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"88fd80460201209a527ba9077604a969b85f4a2f40938bfeece7e08c648da959\": container with ID starting with 88fd80460201209a527ba9077604a969b85f4a2f40938bfeece7e08c648da959 not found: ID does not exist" containerID="88fd80460201209a527ba9077604a969b85f4a2f40938bfeece7e08c648da959" Jul 30 20:39:05.963109 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:39:05.963073 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"88fd80460201209a527ba9077604a969b85f4a2f40938bfeece7e08c648da959"} err="failed to get container status \"88fd80460201209a527ba9077604a969b85f4a2f40938bfeece7e08c648da959\": rpc error: code = NotFound desc = could not find container \"88fd80460201209a527ba9077604a969b85f4a2f40938bfeece7e08c648da959\": container with ID starting with 88fd80460201209a527ba9077604a969b85f4a2f40938bfeece7e08c648da959 not found: ID does not exist" Jul 30 20:39:05.963109 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:39:05.963090 2555 scope.go:117] "RemoveContainer" containerID="ae568d60ea8d404381444fb8587db0c18e78e58878a1b97f431c16609a584cb5" Jul 30 20:39:05.963316 ip-10-0-136-46 kubenswrapper[2555]: E0730 20:39:05.963300 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ae568d60ea8d404381444fb8587db0c18e78e58878a1b97f431c16609a584cb5\": container with ID starting with ae568d60ea8d404381444fb8587db0c18e78e58878a1b97f431c16609a584cb5 not found: ID does not exist" containerID="ae568d60ea8d404381444fb8587db0c18e78e58878a1b97f431c16609a584cb5" Jul 30 20:39:05.963378 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:39:05.963321 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae568d60ea8d404381444fb8587db0c18e78e58878a1b97f431c16609a584cb5"} err="failed to get container status \"ae568d60ea8d404381444fb8587db0c18e78e58878a1b97f431c16609a584cb5\": rpc error: code = NotFound desc = could not find container \"ae568d60ea8d404381444fb8587db0c18e78e58878a1b97f431c16609a584cb5\": container with ID starting with ae568d60ea8d404381444fb8587db0c18e78e58878a1b97f431c16609a584cb5 not found: ID does not exist" Jul 30 20:39:05.967906 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:39:05.967886 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-9d3c06-openshift-default-88bbfb67d-qftvn"] Jul 30 20:39:05.969411 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:39:05.969392 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-9d3c06-openshift-default-88bbfb67d-qftvn"] Jul 30 20:39:06.314572 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:39:06.314542 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cdec9a41-b9d4-43da-acea-4c1bba8320c9" path="/var/lib/kubelet/pods/cdec9a41-b9d4-43da-acea-4c1bba8320c9/volumes" Jul 30 20:39:10.736395 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:39:10.736354 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-474e8f-29757390-2t4kv"] Jul 30 20:39:10.739028 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:39:10.738989 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-474e8f-29757390-2t4kv"] Jul 30 20:39:10.902562 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:39:10.902531 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-474e8f-rf2z6"] Jul 30 20:39:10.905156 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:39:10.905132 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-474e8f-rf2z6"] Jul 30 20:39:12.314432 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:39:12.314399 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0241ec3e-00db-4c9d-b14d-9cf3e273ae30" path="/var/lib/kubelet/pods/0241ec3e-00db-4c9d-b14d-9cf3e273ae30/volumes" Jul 30 20:39:12.314792 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:39:12.314662 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="43029fa8-995a-47f0-bd0c-1f55a2d37a9e" path="/var/lib/kubelet/pods/43029fa8-995a-47f0-bd0c-1f55a2d37a9e/volumes" Jul 30 20:39:12.797044 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:39:12.797015 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 20:39:17.739889 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:39:17.739855 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-808798-rwtzz"] Jul 30 20:39:17.740241 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:39:17.740145 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cdec9a41-b9d4-43da-acea-4c1bba8320c9" containerName="istio-proxy" Jul 30 20:39:17.740241 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:39:17.740155 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="cdec9a41-b9d4-43da-acea-4c1bba8320c9" containerName="istio-proxy" Jul 30 20:39:17.740241 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:39:17.740164 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cdec9a41-b9d4-43da-acea-4c1bba8320c9" containerName="istio-proxy" Jul 30 20:39:17.740241 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:39:17.740169 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="cdec9a41-b9d4-43da-acea-4c1bba8320c9" containerName="istio-proxy" Jul 30 20:39:17.740241 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:39:17.740180 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60e268d2-20e5-4636-aaa8-13f6030cccd4" containerName="istio-proxy" Jul 30 20:39:17.740241 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:39:17.740186 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="60e268d2-20e5-4636-aaa8-13f6030cccd4" containerName="istio-proxy" Jul 30 20:39:17.740241 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:39:17.740204 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0241ec3e-00db-4c9d-b14d-9cf3e273ae30" containerName="revoke-keys" Jul 30 20:39:17.740241 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:39:17.740209 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="0241ec3e-00db-4c9d-b14d-9cf3e273ae30" containerName="revoke-keys" Jul 30 20:39:17.740492 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:39:17.740251 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="cdec9a41-b9d4-43da-acea-4c1bba8320c9" containerName="istio-proxy" Jul 30 20:39:17.740492 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:39:17.740257 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="0241ec3e-00db-4c9d-b14d-9cf3e273ae30" containerName="revoke-keys" Jul 30 20:39:17.740492 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:39:17.740264 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="cdec9a41-b9d4-43da-acea-4c1bba8320c9" containerName="istio-proxy" Jul 30 20:39:17.743133 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:39:17.743117 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-808798-rwtzz" Jul 30 20:39:17.745402 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:39:17.745379 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 30 20:39:17.745524 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:39:17.745382 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mgdxn\"" Jul 30 20:39:17.750562 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:39:17.750538 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-808798-rwtzz"] Jul 30 20:39:17.824214 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:39:17.824182 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7cde1cea-ab3a-4863-8347-bf2a1d5f2781-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-808798-rwtzz\" (UID: \"7cde1cea-ab3a-4863-8347-bf2a1d5f2781\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-808798-rwtzz" Jul 30 20:39:17.924806 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:39:17.924782 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7cde1cea-ab3a-4863-8347-bf2a1d5f2781-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-808798-rwtzz\" (UID: \"7cde1cea-ab3a-4863-8347-bf2a1d5f2781\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-808798-rwtzz" Jul 30 20:39:17.925487 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:39:17.925445 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7cde1cea-ab3a-4863-8347-bf2a1d5f2781-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-808798-rwtzz\" (UID: \"7cde1cea-ab3a-4863-8347-bf2a1d5f2781\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-808798-rwtzz" Jul 30 20:39:18.054109 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:39:18.054040 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-808798-rwtzz" Jul 30 20:39:18.176557 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:39:18.176530 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-808798-rwtzz"] Jul 30 20:39:18.178433 ip-10-0-136-46 kubenswrapper[2555]: W0730 20:39:18.178413 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7cde1cea_ab3a_4863_8347_bf2a1d5f2781.slice/crio-2de6a214aa3fdcef990326671f0fcdeb4a7abbe6bd82c40c0ea95529cb8b4664 WatchSource:0}: Error finding container 2de6a214aa3fdcef990326671f0fcdeb4a7abbe6bd82c40c0ea95529cb8b4664: Status 404 returned error can't find the container with id 2de6a214aa3fdcef990326671f0fcdeb4a7abbe6bd82c40c0ea95529cb8b4664 Jul 30 20:39:19.003311 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:39:19.003196 2555 generic.go:356] "Generic (PLEG): container finished" podID="7cde1cea-ab3a-4863-8347-bf2a1d5f2781" containerID="a1b7895fc62e1d8c679171adc748866ef2844548b3d303afa925f0dd250fd73f" exitCode=0 Jul 30 20:39:19.003311 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:39:19.003233 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-808798-rwtzz" event={"ID":"7cde1cea-ab3a-4863-8347-bf2a1d5f2781","Type":"ContainerDied","Data":"a1b7895fc62e1d8c679171adc748866ef2844548b3d303afa925f0dd250fd73f"} Jul 30 20:39:19.003311 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:39:19.003287 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-808798-rwtzz" event={"ID":"7cde1cea-ab3a-4863-8347-bf2a1d5f2781","Type":"ContainerStarted","Data":"2de6a214aa3fdcef990326671f0fcdeb4a7abbe6bd82c40c0ea95529cb8b4664"} Jul 30 20:39:20.129402 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:39:20.129380 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-808798-rwtzz" Jul 30 20:39:20.245331 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:39:20.245299 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7cde1cea-ab3a-4863-8347-bf2a1d5f2781-maas-api-service-ca\") pod \"7cde1cea-ab3a-4863-8347-bf2a1d5f2781\" (UID: \"7cde1cea-ab3a-4863-8347-bf2a1d5f2781\") " Jul 30 20:39:20.245619 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:39:20.245598 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7cde1cea-ab3a-4863-8347-bf2a1d5f2781-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "7cde1cea-ab3a-4863-8347-bf2a1d5f2781" (UID: "7cde1cea-ab3a-4863-8347-bf2a1d5f2781"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 20:39:20.346382 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:39:20.346357 2555 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7cde1cea-ab3a-4863-8347-bf2a1d5f2781-maas-api-service-ca\") on node \"ip-10-0-136-46.ec2.internal\" DevicePath \"\"" Jul 30 20:39:21.013418 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:39:21.013386 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-808798-rwtzz" Jul 30 20:39:21.013418 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:39:21.013399 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-808798-rwtzz" event={"ID":"7cde1cea-ab3a-4863-8347-bf2a1d5f2781","Type":"ContainerDied","Data":"2de6a214aa3fdcef990326671f0fcdeb4a7abbe6bd82c40c0ea95529cb8b4664"} Jul 30 20:39:21.013633 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:39:21.013445 2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2de6a214aa3fdcef990326671f0fcdeb4a7abbe6bd82c40c0ea95529cb8b4664" Jul 30 20:39:24.578734 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:39:24.578702 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-808798-29757390-x4rb4"] Jul 30 20:39:24.580748 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:39:24.580725 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-808798-29757390-x4rb4"] Jul 30 20:39:24.735618 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:39:24.735586 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-808798-rwtzz"] Jul 30 20:39:24.737955 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:39:24.737928 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-808798-rwtzz"] Jul 30 20:39:26.317438 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:39:26.317400 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5de0a0f7-28dc-4466-8a6e-0074748df30b" path="/var/lib/kubelet/pods/5de0a0f7-28dc-4466-8a6e-0074748df30b/volumes" Jul 30 20:39:26.318604 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:39:26.318575 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7cde1cea-ab3a-4863-8347-bf2a1d5f2781" path="/var/lib/kubelet/pods/7cde1cea-ab3a-4863-8347-bf2a1d5f2781/volumes" Jul 30 20:39:26.614398 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:39:26.614317 2555 scope.go:117] "RemoveContainer" containerID="11faaf1bfc085105bac5500982bf8df8576bbb6c56baa2796b97fea61176f61e" Jul 30 20:39:26.622080 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:39:26.622059 2555 scope.go:117] "RemoveContainer" containerID="aa1854e15a69d66b7190e27a9e930e7ecf88f28da3557ee2cbd283a5acb2616c" Jul 30 20:39:27.792217 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:39:27.792187 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-khpb5"] Jul 30 20:39:38.018833 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:39:38.018806 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d686446bf-k6srf_22201517-6965-4b54-84be-dcc34513bcc5/copy-manifests/0.log" Jul 30 20:39:38.025129 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:39:38.025103 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d686446bf-k6srf_22201517-6965-4b54-84be-dcc34513bcc5/manager/0.log" Jul 30 20:39:38.830976 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:39:38.830936 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29757390-gzqlz_22e48f7c-d0f9-42f4-a08c-7f0699739c69/cleanup/0.log" Jul 30 20:39:40.344828 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:39:40.344798 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-rjbml_93132180-eeae-48ef-b67a-a69d9f41eb87/manager/0.log" Jul 30 20:39:40.922812 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:39:40.922787 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-khpb5_021fcd4a-5e16-4968-8e43-948ccc84d6ad/limitador/0.log" Jul 30 20:39:41.042397 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:39:41.042371 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-zzsj2_925facfe-5902-45e9-8ee8-eae6397972a4/manager/0.log" Jul 30 20:39:41.532910 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:39:41.532880 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-4vqv6_7a7dfd9d-8e3f-4333-9e0c-4c3248ab1f7b/discovery/0.log" Jul 30 20:39:41.764352 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:39:41.764325 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-75997846f9-vrd5l_9d3a9222-0971-4d51-b653-dc9027e6f16d/kube-auth-proxy/0.log" Jul 30 20:39:42.570580 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:39:42.570550 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-hmpch_aab9c609-04e0-4966-b749-b880bedfb785/main/0.log" Jul 30 20:39:43.039980 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:39:43.039951 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-qnpxp_f63bacd2-abd6-4ce4-941b-4c7a126f345f/main/0.log" Jul 30 20:39:43.156547 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:39:43.156517 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-thh5h_dee95f8b-20ea-4987-bf52-90ebf0a23e14/main/0.log" Jul 30 20:39:51.571623 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:39:51.571597 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-fn7fj_ef0f467f-7334-4115-9601-875fd55fb025/global-pull-secret-syncer/0.log" Jul 30 20:39:51.734214 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:39:51.734185 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-swtbz_1be342d5-ea6e-4ec7-af4a-61e79e9bfe90/konnectivity-agent/0.log" Jul 30 20:39:51.798438 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:39:51.798412 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-46.ec2.internal_1a2944b9797870016f92974beffaabc3/haproxy/0.log" Jul 30 20:39:57.388306 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:39:57.388267 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-rjbml_93132180-eeae-48ef-b67a-a69d9f41eb87/manager/0.log" Jul 30 20:39:57.592366 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:39:57.592337 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-khpb5_021fcd4a-5e16-4968-8e43-948ccc84d6ad/limitador/0.log" Jul 30 20:39:57.669370 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:39:57.669268 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-zzsj2_925facfe-5902-45e9-8ee8-eae6397972a4/manager/0.log" Jul 30 20:39:59.855021 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:39:59.854996 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wxr9x_5066da59-90f5-42b5-b27f-2deba547ad72/node-exporter/0.log" Jul 30 20:39:59.875364 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:39:59.875322 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wxr9x_5066da59-90f5-42b5-b27f-2deba547ad72/kube-rbac-proxy/0.log" Jul 30 20:39:59.896523 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:39:59.896500 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wxr9x_5066da59-90f5-42b5-b27f-2deba547ad72/init-textfile/0.log" Jul 30 20:40:01.489957 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:40:01.489924 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-v4f7q/perf-node-gather-daemonset-4rlfm"] Jul 30 20:40:01.490344 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:40:01.490209 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7cde1cea-ab3a-4863-8347-bf2a1d5f2781" containerName="revoke-keys" Jul 30 20:40:01.490344 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:40:01.490220 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="7cde1cea-ab3a-4863-8347-bf2a1d5f2781" containerName="revoke-keys" Jul 30 20:40:01.490344 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:40:01.490295 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="7cde1cea-ab3a-4863-8347-bf2a1d5f2781" containerName="revoke-keys" Jul 30 20:40:01.493179 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:40:01.493155 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-v4f7q/perf-node-gather-daemonset-4rlfm" Jul 30 20:40:01.496077 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:40:01.496054 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-v4f7q\"/\"kube-root-ca.crt\"" Jul 30 20:40:01.497709 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:40:01.497692 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-v4f7q\"/\"default-dockercfg-g22vb\"" Jul 30 20:40:01.497853 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:40:01.497835 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-v4f7q\"/\"openshift-service-ca.crt\"" Jul 30 20:40:01.505244 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:40:01.505225 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-v4f7q/perf-node-gather-daemonset-4rlfm"] Jul 30 20:40:01.579190 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:40:01.579144 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c79b05ac-6794-4d11-a0dc-eb4f9986e44f-podres\") pod \"perf-node-gather-daemonset-4rlfm\" (UID: \"c79b05ac-6794-4d11-a0dc-eb4f9986e44f\") " pod="openshift-must-gather-v4f7q/perf-node-gather-daemonset-4rlfm" Jul 30 20:40:01.579390 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:40:01.579213 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c79b05ac-6794-4d11-a0dc-eb4f9986e44f-proc\") pod \"perf-node-gather-daemonset-4rlfm\" (UID: \"c79b05ac-6794-4d11-a0dc-eb4f9986e44f\") " pod="openshift-must-gather-v4f7q/perf-node-gather-daemonset-4rlfm" Jul 30 20:40:01.579390 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:40:01.579246 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c79b05ac-6794-4d11-a0dc-eb4f9986e44f-lib-modules\") pod \"perf-node-gather-daemonset-4rlfm\" (UID: \"c79b05ac-6794-4d11-a0dc-eb4f9986e44f\") " pod="openshift-must-gather-v4f7q/perf-node-gather-daemonset-4rlfm" Jul 30 20:40:01.579390 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:40:01.579290 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pm2kd\" (UniqueName: \"kubernetes.io/projected/c79b05ac-6794-4d11-a0dc-eb4f9986e44f-kube-api-access-pm2kd\") pod \"perf-node-gather-daemonset-4rlfm\" (UID: \"c79b05ac-6794-4d11-a0dc-eb4f9986e44f\") " pod="openshift-must-gather-v4f7q/perf-node-gather-daemonset-4rlfm" Jul 30 20:40:01.579390 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:40:01.579316 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c79b05ac-6794-4d11-a0dc-eb4f9986e44f-sys\") pod \"perf-node-gather-daemonset-4rlfm\" (UID: \"c79b05ac-6794-4d11-a0dc-eb4f9986e44f\") " pod="openshift-must-gather-v4f7q/perf-node-gather-daemonset-4rlfm" Jul 30 20:40:01.679893 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:40:01.679852 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c79b05ac-6794-4d11-a0dc-eb4f9986e44f-lib-modules\") pod \"perf-node-gather-daemonset-4rlfm\" (UID: \"c79b05ac-6794-4d11-a0dc-eb4f9986e44f\") " pod="openshift-must-gather-v4f7q/perf-node-gather-daemonset-4rlfm" Jul 30 20:40:01.679893 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:40:01.679899 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pm2kd\" (UniqueName: \"kubernetes.io/projected/c79b05ac-6794-4d11-a0dc-eb4f9986e44f-kube-api-access-pm2kd\") pod \"perf-node-gather-daemonset-4rlfm\" (UID: \"c79b05ac-6794-4d11-a0dc-eb4f9986e44f\") " pod="openshift-must-gather-v4f7q/perf-node-gather-daemonset-4rlfm" Jul 30 20:40:01.680122 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:40:01.679920 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c79b05ac-6794-4d11-a0dc-eb4f9986e44f-sys\") pod \"perf-node-gather-daemonset-4rlfm\" (UID: \"c79b05ac-6794-4d11-a0dc-eb4f9986e44f\") " pod="openshift-must-gather-v4f7q/perf-node-gather-daemonset-4rlfm" Jul 30 20:40:01.680122 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:40:01.679967 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c79b05ac-6794-4d11-a0dc-eb4f9986e44f-podres\") pod \"perf-node-gather-daemonset-4rlfm\" (UID: \"c79b05ac-6794-4d11-a0dc-eb4f9986e44f\") " pod="openshift-must-gather-v4f7q/perf-node-gather-daemonset-4rlfm" Jul 30 20:40:01.680122 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:40:01.680023 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c79b05ac-6794-4d11-a0dc-eb4f9986e44f-lib-modules\") pod \"perf-node-gather-daemonset-4rlfm\" (UID: \"c79b05ac-6794-4d11-a0dc-eb4f9986e44f\") " pod="openshift-must-gather-v4f7q/perf-node-gather-daemonset-4rlfm" Jul 30 20:40:01.680122 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:40:01.680033 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c79b05ac-6794-4d11-a0dc-eb4f9986e44f-proc\") pod \"perf-node-gather-daemonset-4rlfm\" (UID: \"c79b05ac-6794-4d11-a0dc-eb4f9986e44f\") " pod="openshift-must-gather-v4f7q/perf-node-gather-daemonset-4rlfm" Jul 30 20:40:01.680122 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:40:01.680069 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c79b05ac-6794-4d11-a0dc-eb4f9986e44f-sys\") pod \"perf-node-gather-daemonset-4rlfm\" (UID: \"c79b05ac-6794-4d11-a0dc-eb4f9986e44f\") " pod="openshift-must-gather-v4f7q/perf-node-gather-daemonset-4rlfm" Jul 30 20:40:01.680122 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:40:01.680083 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c79b05ac-6794-4d11-a0dc-eb4f9986e44f-proc\") pod \"perf-node-gather-daemonset-4rlfm\" (UID: \"c79b05ac-6794-4d11-a0dc-eb4f9986e44f\") " pod="openshift-must-gather-v4f7q/perf-node-gather-daemonset-4rlfm" Jul 30 20:40:01.680353 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:40:01.680132 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c79b05ac-6794-4d11-a0dc-eb4f9986e44f-podres\") pod \"perf-node-gather-daemonset-4rlfm\" (UID: \"c79b05ac-6794-4d11-a0dc-eb4f9986e44f\") " pod="openshift-must-gather-v4f7q/perf-node-gather-daemonset-4rlfm" Jul 30 20:40:01.688958 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:40:01.688935 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pm2kd\" (UniqueName: \"kubernetes.io/projected/c79b05ac-6794-4d11-a0dc-eb4f9986e44f-kube-api-access-pm2kd\") pod \"perf-node-gather-daemonset-4rlfm\" (UID: \"c79b05ac-6794-4d11-a0dc-eb4f9986e44f\") " pod="openshift-must-gather-v4f7q/perf-node-gather-daemonset-4rlfm" Jul 30 20:40:01.803215 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:40:01.803132 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-v4f7q/perf-node-gather-daemonset-4rlfm" Jul 30 20:40:01.932780 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:40:01.932757 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-v4f7q/perf-node-gather-daemonset-4rlfm"] Jul 30 20:40:01.934943 ip-10-0-136-46 kubenswrapper[2555]: W0730 20:40:01.934920 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podc79b05ac_6794_4d11_a0dc_eb4f9986e44f.slice/crio-4d5e947fd9329ac3dcdf4cfacff3cec512b7806a115022abf112e156ada6a902 WatchSource:0}: Error finding container 4d5e947fd9329ac3dcdf4cfacff3cec512b7806a115022abf112e156ada6a902: Status 404 returned error can't find the container with id 4d5e947fd9329ac3dcdf4cfacff3cec512b7806a115022abf112e156ada6a902 Jul 30 20:40:02.191066 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:40:02.190962 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-v4f7q/perf-node-gather-daemonset-4rlfm" event={"ID":"c79b05ac-6794-4d11-a0dc-eb4f9986e44f","Type":"ContainerStarted","Data":"2df2e51c4f2538d2cdda2f0e0e570b2dbab70bbcca663112a1f30f9cde4c2371"} Jul 30 20:40:02.191066 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:40:02.191023 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-v4f7q/perf-node-gather-daemonset-4rlfm" event={"ID":"c79b05ac-6794-4d11-a0dc-eb4f9986e44f","Type":"ContainerStarted","Data":"4d5e947fd9329ac3dcdf4cfacff3cec512b7806a115022abf112e156ada6a902"} Jul 30 20:40:02.191315 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:40:02.191064 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-v4f7q/perf-node-gather-daemonset-4rlfm" Jul 30 20:40:02.214557 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:40:02.214505 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-v4f7q/perf-node-gather-daemonset-4rlfm" podStartSLOduration=1.214486656 podStartE2EDuration="1.214486656s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 20:40:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:40:02.213434027 +0000 UTC m=+3636.364513577" watchObservedRunningTime="2026-07-30 20:40:02.214486656 +0000 UTC m=+3636.365566206" Jul 30 20:40:04.598935 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:40:04.598907 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-m5znh_699cb731-6732-4466-b2a6-c94c3c75209c/dns/0.log" Jul 30 20:40:04.617959 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:40:04.617931 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-m5znh_699cb731-6732-4466-b2a6-c94c3c75209c/kube-rbac-proxy/0.log" Jul 30 20:40:04.662843 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:40:04.662818 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-krnh8_3061134d-d0a7-491b-8d15-88a12ce9d02d/dns-node-resolver/0.log" Jul 30 20:40:05.308590 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:40:05.308560 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6d96b57fcb-m4jlr_5a8ed3c7-72b5-41e0-98d3-de4484d1479c/registry/0.log" Jul 30 20:40:05.385142 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:40:05.385113 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-crnbd_07586ae2-3389-4063-b494-eb1affb8ad5b/node-ca/0.log" Jul 30 20:40:06.482378 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:40:06.482340 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-4vqv6_7a7dfd9d-8e3f-4333-9e0c-4c3248ab1f7b/discovery/0.log" Jul 30 20:40:06.545958 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:40:06.545925 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-75997846f9-vrd5l_9d3a9222-0971-4d51-b653-dc9027e6f16d/kube-auth-proxy/0.log" Jul 30 20:40:07.482707 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:40:07.482680 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-8hgzs_b12d3e8b-733d-482d-a5e4-5037e134e354/serve-healthcheck-canary/0.log" Jul 30 20:40:07.988970 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:40:07.988943 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jh4gj_48b97056-59a9-47e6-a611-7fae01b30ef3/kube-rbac-proxy/0.log" Jul 30 20:40:08.012779 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:40:08.012755 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jh4gj_48b97056-59a9-47e6-a611-7fae01b30ef3/exporter/0.log" Jul 30 20:40:08.037530 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:40:08.037501 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jh4gj_48b97056-59a9-47e6-a611-7fae01b30ef3/extractor/0.log" Jul 30 20:40:08.204977 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:40:08.204951 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-v4f7q/perf-node-gather-daemonset-4rlfm" Jul 30 20:40:11.073939 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:40:11.073849 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d686446bf-k6srf_22201517-6965-4b54-84be-dcc34513bcc5/manager/0.log" Jul 30 20:40:11.093567 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:40:11.093540 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d686446bf-k6srf_22201517-6965-4b54-84be-dcc34513bcc5/copy-manifests/0.log" Jul 30 20:40:11.683164 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:40:11.683134 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-4vqv6_7a7dfd9d-8e3f-4333-9e0c-4c3248ab1f7b/discovery/0.log" Jul 30 20:40:11.712850 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:40:11.712759 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-75997846f9-vrd5l_9d3a9222-0971-4d51-b653-dc9027e6f16d/kube-auth-proxy/0.log" Jul 30 20:40:13.319729 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:40:13.319681 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-4vqv6_7a7dfd9d-8e3f-4333-9e0c-4c3248ab1f7b/discovery/0.log" Jul 30 20:40:13.348073 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:40:13.348048 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-75997846f9-vrd5l_9d3a9222-0971-4d51-b653-dc9027e6f16d/kube-auth-proxy/0.log" Jul 30 20:40:16.983003 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:40:16.982974 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-68bc745d87-bmskb_69b80037-a1d0-4687-b77b-2f181b1eac11/migrator/0.log" Jul 30 20:40:17.013801 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:40:17.013777 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-68bc745d87-bmskb_69b80037-a1d0-4687-b77b-2f181b1eac11/graceful-termination/0.log" Jul 30 20:40:18.282721 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:40:18.282693 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-8flqh_291f3d88-2c11-4b10-8e36-e4cb333a7c16/kube-multus/0.log" Jul 30 20:40:18.446935 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:40:18.446910 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-g5s9d_2b80bb73-3e52-45c7-80c1-2beec4c736ac/kube-multus-additional-cni-plugins/0.log" Jul 30 20:40:18.465778 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:40:18.465757 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-g5s9d_2b80bb73-3e52-45c7-80c1-2beec4c736ac/egress-router-binary-copy/0.log" Jul 30 20:40:18.486731 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:40:18.486698 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-g5s9d_2b80bb73-3e52-45c7-80c1-2beec4c736ac/cni-plugins/0.log" Jul 30 20:40:18.505106 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:40:18.505085 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-g5s9d_2b80bb73-3e52-45c7-80c1-2beec4c736ac/bond-cni-plugin/0.log" Jul 30 20:40:18.522426 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:40:18.522404 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-g5s9d_2b80bb73-3e52-45c7-80c1-2beec4c736ac/routeoverride-cni/0.log" Jul 30 20:40:18.541486 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:40:18.541415 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-g5s9d_2b80bb73-3e52-45c7-80c1-2beec4c736ac/whereabouts-cni-bincopy/0.log" Jul 30 20:40:18.559425 ip-10-0-136-46 kubenswrapper[2555]: I0730 20:40:18.559399 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-g5s9d_2b80bb73-3e52-45c7-80c1-2beec4c736ac/whereabouts-cni/0.log"