Jul 01 19:09:26.541452 ip-10-0-131-184 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 01 19:09:26.541462 ip-10-0-131-184 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 01 19:09:26.541469 ip-10-0-131-184 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 01 19:09:26.541688 ip-10-0-131-184 systemd[1]: Failed to start Kubernetes Kubelet. Jul 01 19:09:36.786732 ip-10-0-131-184 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 01 19:09:36.786751 ip-10-0-131-184 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot e2d595a8767d4da7b7b64d81e94ceed2 -- Jul 01 19:11:33.362285 ip-10-0-131-184 systemd[1]: Starting Kubernetes Kubelet... Jul 01 19:11:33.819741 ip-10-0-131-184 kubenswrapper[2561]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 01 19:11:33.819741 ip-10-0-131-184 kubenswrapper[2561]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 01 19:11:33.819741 ip-10-0-131-184 kubenswrapper[2561]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 01 19:11:33.819741 ip-10-0-131-184 kubenswrapper[2561]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 01 19:11:33.819741 ip-10-0-131-184 kubenswrapper[2561]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 01 19:11:33.821519 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.821431 2561 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 01 19:11:33.825991 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.825976 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 19:11:33.825991 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.825992 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 19:11:33.826060 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.825996 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 19:11:33.826060 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.826000 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 19:11:33.826060 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.826003 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 19:11:33.826060 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.826006 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 19:11:33.826060 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.826009 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 19:11:33.826060 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.826012 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 19:11:33.826060 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.826015 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 19:11:33.826060 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.826018 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 19:11:33.826060 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.826021 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 19:11:33.826060 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.826031 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 19:11:33.826060 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.826036 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 19:11:33.826060 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.826039 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 19:11:33.826060 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.826042 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 19:11:33.826060 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.826045 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 19:11:33.826060 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.826047 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 19:11:33.826060 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.826050 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 19:11:33.826060 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.826053 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 19:11:33.826060 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.826056 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 19:11:33.826060 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.826059 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 19:11:33.826060 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.826061 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 19:11:33.826495 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.826064 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 19:11:33.826495 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.826067 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 19:11:33.826495 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.826069 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 19:11:33.826495 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.826073 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 19:11:33.826495 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.826075 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 19:11:33.826495 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.826078 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 19:11:33.826495 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.826080 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 19:11:33.826495 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.826083 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 19:11:33.826495 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.826086 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 19:11:33.826495 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.826088 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 19:11:33.826495 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.826093 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 19:11:33.826495 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.826097 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 19:11:33.826495 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.826100 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 19:11:33.826495 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.826102 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 19:11:33.826495 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.826105 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 19:11:33.826495 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.826108 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 19:11:33.826495 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.826111 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 19:11:33.826495 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.826114 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 19:11:33.826495 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.826117 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 19:11:33.826987 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.826120 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 19:11:33.826987 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.826123 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 19:11:33.826987 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.826125 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 19:11:33.826987 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.826129 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 19:11:33.826987 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.826132 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 19:11:33.826987 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.826134 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 19:11:33.826987 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.826137 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 19:11:33.826987 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.826140 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 19:11:33.826987 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.826143 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 19:11:33.826987 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.826145 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 19:11:33.826987 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.826148 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 19:11:33.826987 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.826150 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 19:11:33.826987 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.826153 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 19:11:33.826987 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.826155 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 19:11:33.826987 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.826158 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 19:11:33.826987 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.826161 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 19:11:33.826987 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.826163 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 19:11:33.826987 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.826166 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 19:11:33.826987 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.826169 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 19:11:33.827647 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.826171 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 19:11:33.827647 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.826174 2561 feature_gate.go:328] unrecognized feature gate: Example Jul 01 19:11:33.827647 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.826176 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 19:11:33.827647 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.826179 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 19:11:33.827647 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.826181 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 19:11:33.827647 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.826184 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 19:11:33.827647 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.826186 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 19:11:33.827647 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.826189 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 19:11:33.827647 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.826191 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 19:11:33.827647 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.826193 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 19:11:33.827647 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.826196 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 19:11:33.827647 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.826198 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 19:11:33.827647 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.826201 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 19:11:33.827647 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.826203 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 19:11:33.827647 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.826206 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 19:11:33.827647 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.826209 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 19:11:33.827647 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.826211 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 19:11:33.827647 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.826214 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 19:11:33.827647 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.826218 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 19:11:33.827647 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.826221 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 19:11:33.828386 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.826223 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 19:11:33.828386 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.826226 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 19:11:33.828386 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.826229 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 19:11:33.828386 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.826231 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 19:11:33.828386 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.826233 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 19:11:33.828386 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.826236 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 19:11:33.828386 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.826239 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 19:11:33.828386 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.826242 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 19:11:33.828386 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.826244 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 19:11:33.828386 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.826248 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 19:11:33.828386 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.826251 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 19:11:33.828386 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.826255 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 19:11:33.828386 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.826257 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 19:11:33.828386 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.826260 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 19:11:33.828386 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.826263 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 19:11:33.828386 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.826265 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 19:11:33.828386 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.826268 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 19:11:33.828386 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.826270 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 19:11:33.828386 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.826273 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 19:11:33.828386 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.827405 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 19:11:33.828980 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.827425 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 19:11:33.828980 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.827435 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 19:11:33.828980 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.827443 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 19:11:33.828980 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.827450 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 19:11:33.828980 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.827457 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 19:11:33.828980 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.827465 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 19:11:33.828980 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.827479 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 19:11:33.828980 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.827487 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 19:11:33.828980 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.827495 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 19:11:33.828980 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.827502 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 19:11:33.828980 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.827511 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 19:11:33.828980 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.827519 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 19:11:33.828980 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.827527 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 19:11:33.828980 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.827536 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 19:11:33.828980 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.827543 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 19:11:33.828980 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.827551 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 19:11:33.828980 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.827559 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 19:11:33.828980 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.827567 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 19:11:33.828980 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.827575 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 19:11:33.828980 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.827588 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 19:11:33.829554 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.827595 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 19:11:33.829554 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.827602 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 19:11:33.829554 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.827609 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 19:11:33.829554 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.827618 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 19:11:33.829554 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.827636 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 19:11:33.829554 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.827644 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 19:11:33.829554 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.827650 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 19:11:33.829554 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.827655 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 19:11:33.829554 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.827659 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 19:11:33.829554 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.827664 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 19:11:33.829554 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.827668 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 19:11:33.829554 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.827673 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 19:11:33.829554 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.827682 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 19:11:33.829554 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.827686 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 19:11:33.829554 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.827691 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 19:11:33.829554 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.827695 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 19:11:33.829554 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.827699 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 19:11:33.829554 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.827703 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 19:11:33.829554 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.827708 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 19:11:33.829554 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.827713 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 19:11:33.830073 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.827717 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 19:11:33.830073 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.827722 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 19:11:33.830073 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.827726 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 19:11:33.830073 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.827735 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 19:11:33.830073 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.827745 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 19:11:33.830073 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.827750 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 19:11:33.830073 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.827756 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 19:11:33.830073 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.827761 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 19:11:33.830073 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.827766 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 19:11:33.830073 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.827770 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 19:11:33.830073 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.827775 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 19:11:33.830073 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.827779 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 19:11:33.830073 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.827783 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 19:11:33.830073 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.827787 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 19:11:33.830073 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.827792 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 19:11:33.830073 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.827798 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 19:11:33.830073 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.827807 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 19:11:33.830073 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.827811 2561 feature_gate.go:328] unrecognized feature gate: Example Jul 01 19:11:33.830073 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.827815 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 19:11:33.830515 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.827820 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 19:11:33.830515 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.827824 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 19:11:33.830515 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.827828 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 19:11:33.830515 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.827832 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 19:11:33.830515 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.827837 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 19:11:33.830515 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.827841 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 19:11:33.830515 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.827845 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 19:11:33.830515 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.827849 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 19:11:33.830515 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.827854 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 19:11:33.830515 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.827858 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 19:11:33.830515 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.827866 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 19:11:33.830515 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.827871 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 19:11:33.830515 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.827876 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 19:11:33.830515 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.827880 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 19:11:33.830515 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.827884 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 19:11:33.830515 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.827889 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 19:11:33.830515 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.827894 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 19:11:33.830515 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.827899 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 19:11:33.830515 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.827904 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 19:11:33.830515 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.827908 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 19:11:33.831004 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.827915 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 19:11:33.831004 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.827921 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 19:11:33.831004 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.827932 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 19:11:33.831004 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.827936 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 19:11:33.831004 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.827941 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 19:11:33.831004 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.827945 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 19:11:33.831004 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.827964 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 19:11:33.831004 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.827969 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 19:11:33.831004 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.827973 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 19:11:33.831004 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.827977 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 19:11:33.831004 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.827981 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 19:11:33.831004 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.827986 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 19:11:33.831004 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.827990 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 19:11:33.831004 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.827994 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 19:11:33.831004 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.828002 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 19:11:33.831004 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.828007 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 19:11:33.831004 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.828014 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 19:11:33.831004 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.828020 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 19:11:33.831004 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.828025 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 19:11:33.831440 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.829054 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 19:11:33.831440 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.829065 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 19:11:33.831440 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.829070 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 19:11:33.831440 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.829073 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 19:11:33.831440 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.829076 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 19:11:33.831440 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.829080 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 19:11:33.831440 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.829083 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 19:11:33.831440 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.829085 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 19:11:33.831440 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.829090 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 19:11:33.831440 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.829095 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 19:11:33.831440 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.829099 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 19:11:33.831440 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.829102 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 19:11:33.831440 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.829105 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 19:11:33.831440 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.829109 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 19:11:33.831440 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.829112 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 19:11:33.831440 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.829115 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 19:11:33.831440 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.829118 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 19:11:33.831440 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.829121 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 19:11:33.831440 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.829124 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 19:11:33.831884 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.829126 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 19:11:33.831884 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.829129 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 19:11:33.831884 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.829131 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 19:11:33.831884 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.829134 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 19:11:33.831884 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.829136 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 19:11:33.831884 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.829139 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 19:11:33.831884 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.829142 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 19:11:33.831884 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.829144 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 19:11:33.831884 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.829147 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 19:11:33.831884 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.829149 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 19:11:33.831884 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.829152 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 19:11:33.831884 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.829155 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 19:11:33.831884 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.829157 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 19:11:33.831884 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.829161 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 19:11:33.831884 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.829164 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 19:11:33.831884 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.829167 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 19:11:33.831884 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.829169 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 19:11:33.831884 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.829172 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 19:11:33.831884 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.829175 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 19:11:33.831884 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.829178 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 19:11:33.832354 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.829181 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 19:11:33.832354 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.829184 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 19:11:33.832354 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.829187 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 19:11:33.832354 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.829190 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 19:11:33.832354 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.829192 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 19:11:33.832354 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.829195 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 19:11:33.832354 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.829197 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 19:11:33.832354 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.829200 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 19:11:33.832354 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.829202 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 19:11:33.832354 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.829205 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 19:11:33.832354 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.829207 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 19:11:33.832354 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.829210 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 19:11:33.832354 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.829212 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 19:11:33.832354 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.829215 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 19:11:33.832354 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.829218 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 19:11:33.832354 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.829220 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 19:11:33.832354 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.829223 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 19:11:33.832354 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.829225 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 19:11:33.832354 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.829228 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 19:11:33.832354 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.829231 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 19:11:33.832817 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.829234 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 19:11:33.832817 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.829236 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 19:11:33.832817 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.829240 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 19:11:33.832817 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.829244 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 19:11:33.832817 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.829246 2561 feature_gate.go:328] unrecognized feature gate: Example Jul 01 19:11:33.832817 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.829249 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 19:11:33.832817 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.829252 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 19:11:33.832817 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.829255 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 19:11:33.832817 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.829258 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 19:11:33.832817 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.829261 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 19:11:33.832817 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.829263 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 19:11:33.832817 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.829266 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 19:11:33.832817 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.829268 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 19:11:33.832817 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.829271 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 19:11:33.832817 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.829273 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 19:11:33.832817 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.829276 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 19:11:33.832817 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.829278 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 19:11:33.832817 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.829281 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 19:11:33.832817 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.829283 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 19:11:33.832817 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.829286 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 19:11:33.833320 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.829289 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 19:11:33.833320 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.829291 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 19:11:33.833320 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.829294 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 19:11:33.833320 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.829296 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 19:11:33.833320 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.829300 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 19:11:33.833320 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.829304 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 19:11:33.833320 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.829307 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 19:11:33.833320 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.829309 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 19:11:33.833320 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.829312 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 19:11:33.833320 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.829315 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 19:11:33.833320 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.829317 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 19:11:33.833320 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.829320 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 19:11:33.833320 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.829323 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 19:11:33.833320 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.829325 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 19:11:33.833320 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.829328 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 19:11:33.833320 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.829331 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 19:11:33.833320 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.829333 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 19:11:33.833320 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.829336 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 19:11:33.833320 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.829339 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 19:11:33.833768 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.829342 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 19:11:33.833768 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829407 2561 flags.go:64] FLAG: --address="0.0.0.0" Jul 01 19:11:33.833768 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829414 2561 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 01 19:11:33.833768 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829421 2561 flags.go:64] FLAG: --anonymous-auth="true" Jul 01 19:11:33.833768 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829427 2561 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 01 19:11:33.833768 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829434 2561 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 01 19:11:33.833768 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829439 2561 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 01 19:11:33.833768 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829445 2561 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 01 19:11:33.833768 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829450 2561 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 01 19:11:33.833768 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829453 2561 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 01 19:11:33.833768 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829456 2561 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 01 19:11:33.833768 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829460 2561 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 01 19:11:33.833768 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829463 2561 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 01 19:11:33.833768 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829466 2561 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 01 19:11:33.833768 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829469 2561 flags.go:64] FLAG: --cgroup-root="" Jul 01 19:11:33.833768 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829472 2561 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 01 19:11:33.833768 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829475 2561 flags.go:64] FLAG: --client-ca-file="" Jul 01 19:11:33.833768 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829479 2561 flags.go:64] FLAG: --cloud-provider="external" Jul 01 19:11:33.833768 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829482 2561 flags.go:64] FLAG: --cluster-dns="[]" Jul 01 19:11:33.833768 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829519 2561 flags.go:64] FLAG: --cluster-domain="" Jul 01 19:11:33.833768 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829522 2561 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 01 19:11:33.833768 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829526 2561 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 01 19:11:33.833768 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829529 2561 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 01 19:11:33.833768 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829533 2561 flags.go:64] FLAG: --container-log-max-files="5" Jul 01 19:11:33.834367 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829537 2561 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 01 19:11:33.834367 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829540 2561 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 01 19:11:33.834367 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829543 2561 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 01 19:11:33.834367 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829547 2561 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 01 19:11:33.834367 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829550 2561 flags.go:64] FLAG: --contention-profiling="false" Jul 01 19:11:33.834367 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829553 2561 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 01 19:11:33.834367 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829556 2561 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 01 19:11:33.834367 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829560 2561 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 01 19:11:33.834367 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829563 2561 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 01 19:11:33.834367 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829568 2561 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 01 19:11:33.834367 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829571 2561 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 01 19:11:33.834367 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829574 2561 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 01 19:11:33.834367 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829577 2561 flags.go:64] FLAG: --enable-load-reader="false" Jul 01 19:11:33.834367 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829580 2561 flags.go:64] FLAG: --enable-server="true" Jul 01 19:11:33.834367 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829583 2561 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 01 19:11:33.834367 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829588 2561 flags.go:64] FLAG: --event-burst="100" Jul 01 19:11:33.834367 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829591 2561 flags.go:64] FLAG: --event-qps="50" Jul 01 19:11:33.834367 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829594 2561 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 01 19:11:33.834367 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829597 2561 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 01 19:11:33.834367 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829600 2561 flags.go:64] FLAG: --eviction-hard="" Jul 01 19:11:33.834367 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829604 2561 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 01 19:11:33.834367 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829607 2561 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 01 19:11:33.834367 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829610 2561 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 01 19:11:33.834367 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829613 2561 flags.go:64] FLAG: --eviction-soft="" Jul 01 19:11:33.834367 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829616 2561 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 01 19:11:33.834943 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829619 2561 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 01 19:11:33.834943 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829622 2561 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 01 19:11:33.834943 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829625 2561 flags.go:64] FLAG: --experimental-mounter-path="" Jul 01 19:11:33.834943 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829628 2561 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 01 19:11:33.834943 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829631 2561 flags.go:64] FLAG: --fail-swap-on="true" Jul 01 19:11:33.834943 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829637 2561 flags.go:64] FLAG: --feature-gates="" Jul 01 19:11:33.834943 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829640 2561 flags.go:64] FLAG: --file-check-frequency="20s" Jul 01 19:11:33.834943 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829643 2561 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 01 19:11:33.834943 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829646 2561 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 01 19:11:33.834943 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829649 2561 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 01 19:11:33.834943 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829652 2561 flags.go:64] FLAG: --healthz-port="10248" Jul 01 19:11:33.834943 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829656 2561 flags.go:64] FLAG: --help="false" Jul 01 19:11:33.834943 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829659 2561 flags.go:64] FLAG: --hostname-override="ip-10-0-131-184.ec2.internal" Jul 01 19:11:33.834943 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829662 2561 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 01 19:11:33.834943 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829665 2561 flags.go:64] FLAG: --http-check-frequency="20s" Jul 01 19:11:33.834943 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829668 2561 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 01 19:11:33.834943 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829671 2561 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 01 19:11:33.834943 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829674 2561 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 01 19:11:33.834943 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829677 2561 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 01 19:11:33.834943 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829680 2561 flags.go:64] FLAG: --image-service-endpoint="" Jul 01 19:11:33.834943 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829683 2561 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 01 19:11:33.834943 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829686 2561 flags.go:64] FLAG: --kube-api-burst="100" Jul 01 19:11:33.834943 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829689 2561 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 01 19:11:33.835565 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829692 2561 flags.go:64] FLAG: --kube-api-qps="50" Jul 01 19:11:33.835565 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829695 2561 flags.go:64] FLAG: --kube-reserved="" Jul 01 19:11:33.835565 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829698 2561 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 01 19:11:33.835565 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829700 2561 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 01 19:11:33.835565 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829703 2561 flags.go:64] FLAG: --kubelet-cgroups="" Jul 01 19:11:33.835565 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829706 2561 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 01 19:11:33.835565 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829709 2561 flags.go:64] FLAG: --lock-file="" Jul 01 19:11:33.835565 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829712 2561 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 01 19:11:33.835565 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829715 2561 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 01 19:11:33.835565 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829718 2561 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 01 19:11:33.835565 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829724 2561 flags.go:64] FLAG: --log-json-split-stream="false" Jul 01 19:11:33.835565 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829727 2561 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 01 19:11:33.835565 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829730 2561 flags.go:64] FLAG: --log-text-split-stream="false" Jul 01 19:11:33.835565 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829732 2561 flags.go:64] FLAG: --logging-format="text" Jul 01 19:11:33.835565 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829737 2561 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 01 19:11:33.835565 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829741 2561 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 01 19:11:33.835565 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829744 2561 flags.go:64] FLAG: --manifest-url="" Jul 01 19:11:33.835565 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829747 2561 flags.go:64] FLAG: --manifest-url-header="" Jul 01 19:11:33.835565 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829756 2561 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 01 19:11:33.835565 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829759 2561 flags.go:64] FLAG: --max-open-files="1000000" Jul 01 19:11:33.835565 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829763 2561 flags.go:64] FLAG: --max-pods="110" Jul 01 19:11:33.835565 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829766 2561 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 01 19:11:33.835565 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829769 2561 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 01 19:11:33.835565 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829772 2561 flags.go:64] FLAG: --memory-manager-policy="None" Jul 01 19:11:33.835565 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829775 2561 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 01 19:11:33.836170 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829778 2561 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 01 19:11:33.836170 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829781 2561 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 01 19:11:33.836170 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829784 2561 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 01 19:11:33.836170 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829792 2561 flags.go:64] FLAG: --node-status-max-images="50" Jul 01 19:11:33.836170 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829795 2561 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 01 19:11:33.836170 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829798 2561 flags.go:64] FLAG: --oom-score-adj="-999" Jul 01 19:11:33.836170 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829801 2561 flags.go:64] FLAG: --pod-cidr="" Jul 01 19:11:33.836170 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829804 2561 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a2632cd31d78133be7b5fb6999469b2acf9b98d077c7f6ae5d0d94083d76b04" Jul 01 19:11:33.836170 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829809 2561 flags.go:64] FLAG: --pod-manifest-path="" Jul 01 19:11:33.836170 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829812 2561 flags.go:64] FLAG: --pod-max-pids="-1" Jul 01 19:11:33.836170 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829815 2561 flags.go:64] FLAG: --pods-per-core="0" Jul 01 19:11:33.836170 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829818 2561 flags.go:64] FLAG: --port="10250" Jul 01 19:11:33.836170 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829821 2561 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 01 19:11:33.836170 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829824 2561 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0ab5ab30c65fb3221" Jul 01 19:11:33.836170 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829828 2561 flags.go:64] FLAG: --qos-reserved="" Jul 01 19:11:33.836170 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829831 2561 flags.go:64] FLAG: --read-only-port="10255" Jul 01 19:11:33.836170 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829834 2561 flags.go:64] FLAG: --register-node="true" Jul 01 19:11:33.836170 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829837 2561 flags.go:64] FLAG: --register-with-taints="" Jul 01 19:11:33.836170 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829840 2561 flags.go:64] FLAG: --registry-burst="10" Jul 01 19:11:33.836170 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829844 2561 flags.go:64] FLAG: --registry-qps="5" Jul 01 19:11:33.836170 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829847 2561 flags.go:64] FLAG: --reserved-cpus="" Jul 01 19:11:33.836170 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829852 2561 flags.go:64] FLAG: --reserved-memory="" Jul 01 19:11:33.836170 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829855 2561 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 01 19:11:33.836170 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829858 2561 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 01 19:11:33.836170 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829861 2561 flags.go:64] FLAG: --rotate-certificates="false" Jul 01 19:11:33.836769 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829864 2561 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 01 19:11:33.836769 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829867 2561 flags.go:64] FLAG: --runonce="false" Jul 01 19:11:33.836769 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829870 2561 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 01 19:11:33.836769 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829873 2561 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 01 19:11:33.836769 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829876 2561 flags.go:64] FLAG: --seccomp-default="false" Jul 01 19:11:33.836769 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829879 2561 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 01 19:11:33.836769 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829882 2561 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 01 19:11:33.836769 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829885 2561 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 01 19:11:33.836769 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829888 2561 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 01 19:11:33.836769 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829891 2561 flags.go:64] FLAG: --storage-driver-password="root" Jul 01 19:11:33.836769 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829894 2561 flags.go:64] FLAG: --storage-driver-secure="false" Jul 01 19:11:33.836769 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829897 2561 flags.go:64] FLAG: --storage-driver-table="stats" Jul 01 19:11:33.836769 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829899 2561 flags.go:64] FLAG: --storage-driver-user="root" Jul 01 19:11:33.836769 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829902 2561 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 01 19:11:33.836769 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829905 2561 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 01 19:11:33.836769 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829908 2561 flags.go:64] FLAG: --system-cgroups="" Jul 01 19:11:33.836769 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829911 2561 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 01 19:11:33.836769 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829917 2561 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 01 19:11:33.836769 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829920 2561 flags.go:64] FLAG: --tls-cert-file="" Jul 01 19:11:33.836769 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829923 2561 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 01 19:11:33.836769 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829931 2561 flags.go:64] FLAG: --tls-min-version="" Jul 01 19:11:33.836769 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829934 2561 flags.go:64] FLAG: --tls-private-key-file="" Jul 01 19:11:33.836769 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829937 2561 flags.go:64] FLAG: --topology-manager-policy="none" Jul 01 19:11:33.836769 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829940 2561 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 01 19:11:33.836769 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829943 2561 flags.go:64] FLAG: --topology-manager-scope="container" Jul 01 19:11:33.837388 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829946 2561 flags.go:64] FLAG: --v="2" Jul 01 19:11:33.837388 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829966 2561 flags.go:64] FLAG: --version="false" Jul 01 19:11:33.837388 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829971 2561 flags.go:64] FLAG: --vmodule="" Jul 01 19:11:33.837388 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829976 2561 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 01 19:11:33.837388 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.829980 2561 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 01 19:11:33.837388 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.830104 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 19:11:33.837388 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.830109 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 19:11:33.837388 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.830112 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 19:11:33.837388 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.830115 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 19:11:33.837388 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.830118 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 19:11:33.837388 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.830121 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 19:11:33.837388 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.830123 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 19:11:33.837388 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.830126 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 19:11:33.837388 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.830129 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 19:11:33.837388 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.830132 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 19:11:33.837388 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.830134 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 19:11:33.837388 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.830137 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 19:11:33.837388 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.830140 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 19:11:33.837388 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.830142 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 19:11:33.837388 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.830145 2561 feature_gate.go:328] unrecognized feature gate: Example Jul 01 19:11:33.837388 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.830148 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 19:11:33.837887 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.830152 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 19:11:33.837887 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.830155 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 19:11:33.837887 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.830158 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 19:11:33.837887 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.830162 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 19:11:33.837887 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.830165 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 19:11:33.837887 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.830168 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 19:11:33.837887 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.830171 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 19:11:33.837887 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.830174 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 19:11:33.837887 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.830176 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 19:11:33.837887 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.830179 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 19:11:33.837887 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.830182 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 19:11:33.837887 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.830185 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 19:11:33.837887 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.830187 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 19:11:33.837887 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.830190 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 19:11:33.837887 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.830194 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 19:11:33.837887 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.830197 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 19:11:33.837887 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.830200 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 19:11:33.837887 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.830202 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 19:11:33.837887 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.830205 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 19:11:33.838360 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.830208 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 19:11:33.838360 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.830210 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 19:11:33.838360 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.830213 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 19:11:33.838360 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.830215 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 19:11:33.838360 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.830221 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 19:11:33.838360 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.830224 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 19:11:33.838360 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.830226 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 19:11:33.838360 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.830229 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 19:11:33.838360 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.830232 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 19:11:33.838360 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.830234 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 19:11:33.838360 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.830237 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 19:11:33.838360 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.830239 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 19:11:33.838360 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.830242 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 19:11:33.838360 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.830245 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 19:11:33.838360 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.830247 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 19:11:33.838360 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.830250 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 19:11:33.838360 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.830252 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 19:11:33.838360 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.830255 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 19:11:33.838360 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.830258 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 19:11:33.838360 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.830261 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 19:11:33.838862 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.830263 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 19:11:33.838862 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.830266 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 19:11:33.838862 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.830268 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 19:11:33.838862 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.830271 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 19:11:33.838862 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.830274 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 19:11:33.838862 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.830276 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 19:11:33.838862 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.830279 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 19:11:33.838862 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.830283 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 19:11:33.838862 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.830287 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 19:11:33.838862 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.830290 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 19:11:33.838862 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.830293 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 19:11:33.838862 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.830296 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 19:11:33.838862 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.830298 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 19:11:33.838862 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.830301 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 19:11:33.838862 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.830304 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 19:11:33.838862 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.830306 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 19:11:33.838862 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.830310 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 19:11:33.838862 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.830313 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 19:11:33.838862 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.830315 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 19:11:33.838862 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.830318 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 19:11:33.839359 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.830321 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 19:11:33.839359 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.830323 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 19:11:33.839359 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.830325 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 19:11:33.839359 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.830328 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 19:11:33.839359 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.830330 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 19:11:33.839359 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.830333 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 19:11:33.839359 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.830336 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 19:11:33.839359 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.830338 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 19:11:33.839359 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.830341 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 19:11:33.839359 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.830343 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 19:11:33.839359 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.830346 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 19:11:33.839359 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.830348 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 19:11:33.839359 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.830351 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 19:11:33.839359 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.830353 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 19:11:33.839359 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.830356 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 19:11:33.839359 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.830359 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 19:11:33.839359 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.830361 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 19:11:33.839359 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.830364 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 19:11:33.839359 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.830368 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 19:11:33.839359 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.830372 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 19:11:33.839836 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.830376 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 19:11:33.839836 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.830379 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 19:11:33.839836 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.830382 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 19:11:33.839836 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.830385 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 19:11:33.839836 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.831043 2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 01 19:11:33.839836 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.837655 2561 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 01 19:11:33.839836 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.837671 2561 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 01 19:11:33.839836 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.838491 2561 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 01 19:11:33.839836 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.838498 2561 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 01 19:11:33.839836 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.838553 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 19:11:33.839836 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.838558 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 19:11:33.839836 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.838561 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 19:11:33.839836 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.838564 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 19:11:33.839836 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.838567 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 19:11:33.839836 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.838570 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 19:11:33.840214 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.838573 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 19:11:33.840214 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.838576 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 19:11:33.840214 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.838578 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 19:11:33.840214 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.838583 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 19:11:33.840214 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.838587 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 19:11:33.840214 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.838590 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 19:11:33.840214 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.838593 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 19:11:33.840214 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.838596 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 19:11:33.840214 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.838599 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 19:11:33.840214 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.838602 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 19:11:33.840214 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.838605 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 19:11:33.840214 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.838608 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 19:11:33.840214 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.838611 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 19:11:33.840214 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.838614 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 19:11:33.840214 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.838617 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 19:11:33.840214 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.838620 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 19:11:33.840214 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.838623 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 19:11:33.840214 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.838626 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 19:11:33.840214 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.838629 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 19:11:33.840661 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.838632 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 19:11:33.840661 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.838635 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 19:11:33.840661 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.838638 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 19:11:33.840661 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.838640 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 19:11:33.840661 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.838644 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 19:11:33.840661 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.838647 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 19:11:33.840661 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.838650 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 19:11:33.840661 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.838652 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 19:11:33.840661 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.838655 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 19:11:33.840661 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.838658 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 19:11:33.840661 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.838661 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 19:11:33.840661 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.838664 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 19:11:33.840661 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.838666 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 19:11:33.840661 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.838669 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 19:11:33.840661 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.838671 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 19:11:33.840661 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.838674 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 19:11:33.840661 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.838677 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 19:11:33.840661 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.838679 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 19:11:33.840661 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.838682 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 19:11:33.840661 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.838684 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 19:11:33.841152 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.838687 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 19:11:33.841152 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.838690 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 19:11:33.841152 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.838692 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 19:11:33.841152 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.838694 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 19:11:33.841152 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.838697 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 19:11:33.841152 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.838699 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 19:11:33.841152 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.838702 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 19:11:33.841152 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.838705 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 19:11:33.841152 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.838707 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 19:11:33.841152 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.838710 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 19:11:33.841152 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.838712 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 19:11:33.841152 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.838715 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 19:11:33.841152 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.838719 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 19:11:33.841152 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.838721 2561 feature_gate.go:328] unrecognized feature gate: Example Jul 01 19:11:33.841152 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.838724 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 19:11:33.841152 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.838726 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 19:11:33.841152 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.838730 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 19:11:33.841152 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.838733 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 19:11:33.841152 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.838736 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 19:11:33.841152 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.838738 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 19:11:33.841626 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.838741 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 19:11:33.841626 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.838744 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 19:11:33.841626 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.838747 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 19:11:33.841626 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.838749 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 19:11:33.841626 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.838752 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 19:11:33.841626 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.838754 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 19:11:33.841626 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.838757 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 19:11:33.841626 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.838759 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 19:11:33.841626 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.838762 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 19:11:33.841626 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.838765 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 19:11:33.841626 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.838768 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 19:11:33.841626 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.838772 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 19:11:33.841626 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.838775 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 19:11:33.841626 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.838778 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 19:11:33.841626 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.838781 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 19:11:33.841626 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.838784 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 19:11:33.841626 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.838787 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 19:11:33.841626 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.838790 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 19:11:33.841626 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.838792 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 19:11:33.842078 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.838795 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 19:11:33.842078 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.838798 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 19:11:33.842078 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.838800 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 19:11:33.842078 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.838803 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 19:11:33.842078 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.838805 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 19:11:33.842078 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.838808 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 19:11:33.842078 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.838811 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 19:11:33.842078 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.838813 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 19:11:33.842078 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.838817 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 19:11:33.842078 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.838821 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 19:11:33.842078 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.838825 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 19:11:33.842078 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.838828 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 19:11:33.842078 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.838831 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 19:11:33.842078 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.838833 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 19:11:33.842078 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.838836 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 19:11:33.842435 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.838841 2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 01 19:11:33.842435 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.838991 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 19:11:33.842435 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.839003 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 19:11:33.842435 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.839007 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 19:11:33.842435 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.839012 2561 feature_gate.go:328] unrecognized feature gate: Example Jul 01 19:11:33.842435 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.839015 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 19:11:33.842435 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.839018 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 19:11:33.842435 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.839022 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 19:11:33.842435 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.839025 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 19:11:33.842435 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.839027 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 19:11:33.842435 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.839031 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 19:11:33.842435 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.839033 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 19:11:33.842435 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.839036 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 19:11:33.842435 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.839041 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 19:11:33.842435 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.839045 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 19:11:33.842788 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.839049 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 19:11:33.842788 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.839052 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 19:11:33.842788 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.839055 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 19:11:33.842788 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.839059 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 19:11:33.842788 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.839061 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 19:11:33.842788 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.839064 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 19:11:33.842788 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.839068 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 19:11:33.842788 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.839070 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 19:11:33.842788 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.839073 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 19:11:33.842788 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.839079 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 19:11:33.842788 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.839081 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 19:11:33.842788 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.839084 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 19:11:33.842788 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.839087 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 19:11:33.842788 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.839090 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 19:11:33.842788 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.839093 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 19:11:33.842788 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.839095 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 19:11:33.842788 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.839098 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 19:11:33.842788 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.839101 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 19:11:33.842788 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.839104 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 19:11:33.843375 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.839107 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 19:11:33.843375 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.839111 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 19:11:33.843375 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.839113 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 19:11:33.843375 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.839116 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 19:11:33.843375 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.839119 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 19:11:33.843375 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.839121 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 19:11:33.843375 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.839124 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 19:11:33.843375 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.839127 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 19:11:33.843375 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.839130 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 19:11:33.843375 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.839132 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 19:11:33.843375 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.839135 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 19:11:33.843375 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.839137 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 19:11:33.843375 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.839140 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 19:11:33.843375 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.839143 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 19:11:33.843375 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.839146 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 19:11:33.843375 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.839148 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 19:11:33.843375 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.839151 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 19:11:33.843375 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.839153 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 19:11:33.843375 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.839156 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 19:11:33.843375 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.839159 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 19:11:33.843848 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.839161 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 19:11:33.843848 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.839164 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 19:11:33.843848 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.839166 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 19:11:33.843848 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.839169 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 19:11:33.843848 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.839172 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 19:11:33.843848 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.839174 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 19:11:33.843848 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.839177 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 19:11:33.843848 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.839180 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 19:11:33.843848 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.839182 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 19:11:33.843848 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.839186 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 19:11:33.843848 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.839189 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 19:11:33.843848 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.839192 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 19:11:33.843848 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.839196 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 19:11:33.843848 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.839199 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 19:11:33.843848 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.839202 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 19:11:33.843848 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.839205 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 19:11:33.843848 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.839208 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 19:11:33.843848 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.839210 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 19:11:33.843848 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.839213 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 19:11:33.844319 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.839216 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 19:11:33.844319 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.839219 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 19:11:33.844319 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.839221 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 19:11:33.844319 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.839225 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 19:11:33.844319 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.839227 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 19:11:33.844319 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.839230 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 19:11:33.844319 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.839232 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 19:11:33.844319 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.839235 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 19:11:33.844319 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.839238 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 19:11:33.844319 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.839240 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 19:11:33.844319 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.839243 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 19:11:33.844319 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.839245 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 19:11:33.844319 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.839248 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 19:11:33.844319 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.839250 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 19:11:33.844319 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.839253 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 19:11:33.844319 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.839256 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 19:11:33.844319 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.839258 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 19:11:33.844319 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.839261 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 19:11:33.844319 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.839264 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 19:11:33.844319 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.839266 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 19:11:33.844771 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.839269 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 19:11:33.844771 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.839272 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 19:11:33.844771 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.839275 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 19:11:33.844771 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.839277 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 19:11:33.844771 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.839280 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 19:11:33.844771 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.839283 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 19:11:33.844771 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:33.839286 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 19:11:33.844771 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.839291 2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 01 19:11:33.844771 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.839397 2561 server.go:962] "Client rotation is on, will bootstrap in background" Jul 01 19:11:33.844771 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.841649 2561 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 01 19:11:33.844771 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.843009 2561 server.go:1019] "Starting client certificate rotation" Jul 01 19:11:33.844771 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.843113 2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 01 19:11:33.844771 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.843143 2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 01 19:11:33.845464 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.845451 2561 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 01 19:11:33.846596 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.846574 2561 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 01 19:11:33.858135 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.858118 2561 log.go:25] "Validated CRI v1 runtime API" Jul 01 19:11:33.861057 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.861041 2561 log.go:25] "Validated CRI v1 image API" Jul 01 19:11:33.862604 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.862588 2561 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 01 19:11:33.866400 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.866381 2561 fs.go:135] Filesystem UUIDs: map[1482774d-fa06-45d2-8ad1-be061c828d02:/dev/nvme0n1p4 39c29273-48a9-4760-ba04-46dadf85b8a3:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] Jul 01 19:11:33.866472 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.866400 2561 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 01 19:11:33.869810 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.869795 2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 01 19:11:33.871406 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.871303 2561 manager.go:216] Machine: {Timestamp:2026-07-01 19:11:33.869906386 +0000 UTC m=+0.378347224 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3106798 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2908cfb9afae1776b6ea05883ab4db SystemUUID:ec2908cf-b9af-ae17-76b6-ea05883ab4db BootID:e2d595a8-767d-4da7-b7b6-4d81e94ceed2 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:22:a9:29:a8:e3 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:22:a9:29:a8:e3 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:7a:27:40:77:ab:54 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 01 19:11:33.871406 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.871405 2561 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 01 19:11:33.871502 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.871477 2561 manager.go:232] Version: {KernelVersion:5.14.0-570.124.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260623-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 01 19:11:33.875105 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.875083 2561 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 01 19:11:33.875233 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.875108 2561 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-184.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 01 19:11:33.876539 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.876529 2561 topology_manager.go:138] "Creating topology manager with none policy" Jul 01 19:11:33.876570 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.876542 2561 container_manager_linux.go:309] "Creating device plugin manager" Jul 01 19:11:33.876570 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.876549 2561 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 01 19:11:33.877274 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.877264 2561 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 01 19:11:33.878875 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.878866 2561 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 01 19:11:33.882183 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.882171 2561 state_mem.go:36] "Initialized new in-memory state store" Jul 01 19:11:33.882290 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.882281 2561 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 01 19:11:33.882318 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.882308 2561 kubelet.go:486] "Attempting to sync node with API server" Jul 01 19:11:33.882318 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.882318 2561 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 01 19:11:33.882376 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.882333 2561 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 01 19:11:33.882376 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.882344 2561 kubelet.go:398] "Adding apiserver pod source" Jul 01 19:11:33.882376 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.882352 2561 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 01 19:11:33.882672 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.882661 2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 01 19:11:33.882717 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.882679 2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 01 19:11:33.884761 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.884743 2561 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 01 19:11:33.886310 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.886295 2561 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 01 19:11:33.886379 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.886325 2561 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 01 19:11:33.887133 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.887122 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 01 19:11:33.887171 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.887138 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 01 19:11:33.887171 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.887144 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 01 19:11:33.887171 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.887150 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 01 19:11:33.887171 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.887158 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 01 19:11:33.887171 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.887164 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 01 19:11:33.887171 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.887172 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 01 19:11:33.887321 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.887178 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 01 19:11:33.887321 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.887184 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 01 19:11:33.887321 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.887190 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 01 19:11:33.887321 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.887203 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 01 19:11:33.887321 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.887208 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 01 19:11:33.887995 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.887986 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 01 19:11:33.888039 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.887996 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 01 19:11:33.889349 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.889320 2561 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-131-184.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 01 19:11:33.889349 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:11:33.889318 2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 01 19:11:33.889480 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:11:33.889379 2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-131-184.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 01 19:11:33.891428 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.891411 2561 server.go:1268] "Started kubelet" Jul 01 19:11:33.891527 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.891474 2561 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 01 19:11:33.891580 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.891522 2561 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 01 19:11:33.891580 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.891567 2561 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 01 19:11:33.892228 ip-10-0-131-184 systemd[1]: Started Kubernetes Kubelet. Jul 01 19:11:33.893602 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.893587 2561 server.go:310] "Adding debug handlers to kubelet server" Jul 01 19:11:33.898167 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.898138 2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-fmvvr" Jul 01 19:11:33.898263 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.898168 2561 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 01 19:11:33.900753 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:11:33.900732 2561 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 01 19:11:33.901564 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:11:33.899487 2561 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-184.ec2.internal.18be4033d7accf31 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-184.ec2.internal,UID:ip-10-0-131-184.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-131-184.ec2.internal,},FirstTimestamp:2026-07-01 19:11:33.891231537 +0000 UTC m=+0.399672354,LastTimestamp:2026-07-01 19:11:33.891231537 +0000 UTC m=+0.399672354,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-184.ec2.internal,}" Jul 01 19:11:33.902700 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.902685 2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-fmvvr" Jul 01 19:11:33.903779 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.903759 2561 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 01 19:11:33.903779 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.903761 2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 01 19:11:33.903927 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:11:33.903857 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-184.ec2.internal\" not found" Jul 01 19:11:33.904354 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.904339 2561 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 01 19:11:33.904440 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.904350 2561 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 01 19:11:33.904440 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.904369 2561 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 01 19:11:33.904535 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.904473 2561 reconstruct.go:97] "Volume reconstruction finished" Jul 01 19:11:33.904535 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.904485 2561 reconciler.go:29] "Reconciler: start to sync state" Jul 01 19:11:33.904535 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.904511 2561 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 01 19:11:33.904535 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.904524 2561 factory.go:55] Registering systemd factory Jul 01 19:11:33.904535 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.904533 2561 factory.go:223] Registration of the systemd container factory successfully Jul 01 19:11:33.904788 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.904775 2561 factory.go:153] Registering CRI-O factory Jul 01 19:11:33.904836 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.904792 2561 factory.go:223] Registration of the crio container factory successfully Jul 01 19:11:33.904836 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.904816 2561 factory.go:103] Registering Raw factory Jul 01 19:11:33.904836 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.904832 2561 manager.go:1196] Started watching for new ooms in manager Jul 01 19:11:33.905225 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.905213 2561 manager.go:349] Starting recovery of all containers Jul 01 19:11:33.915596 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.915575 2561 manager.go:354] Recovery completed Jul 01 19:11:33.917655 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.917639 2561 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 19:11:33.920006 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.919992 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 19:11:33.921320 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:11:33.921305 2561 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-131-184.ec2.internal\" not found" node="ip-10-0-131-184.ec2.internal" Jul 01 19:11:33.921863 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.921847 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-184.ec2.internal" event="NodeHasSufficientMemory" Jul 01 19:11:33.921915 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.921879 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-184.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 19:11:33.921915 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.921891 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-184.ec2.internal" event="NodeHasSufficientPID" Jul 01 19:11:33.922461 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.922448 2561 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 01 19:11:33.922461 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.922455 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 19:11:33.922579 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.922458 2561 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 01 19:11:33.922579 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.922525 2561 state_mem.go:36] "Initialized new in-memory state store" Jul 01 19:11:33.923111 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.923090 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-184.ec2.internal" event="NodeHasSufficientMemory" Jul 01 19:11:33.923170 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.923119 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-184.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 19:11:33.923170 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.923132 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-184.ec2.internal" event="NodeHasSufficientPID" Jul 01 19:11:33.924042 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.924026 2561 policy_none.go:49] "None policy: Start" Jul 01 19:11:33.924081 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.924050 2561 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 01 19:11:33.924081 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.924065 2561 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 01 19:11:33.925257 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.925243 2561 policy_none.go:47] "Start" Jul 01 19:11:33.961592 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.961560 2561 manager.go:337] "Starting Device Plugin manager" Jul 01 19:11:33.977132 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:11:33.961610 2561 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 01 19:11:33.977132 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.961623 2561 server.go:87] "Starting device plugin registration server" Jul 01 19:11:33.977132 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.961893 2561 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 01 19:11:33.977132 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.961905 2561 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 01 19:11:33.977132 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.962006 2561 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 01 19:11:33.977132 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.962107 2561 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 01 19:11:33.977132 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.962117 2561 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 01 19:11:33.977132 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:11:33.962643 2561 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 01 19:11:33.977132 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:11:33.962695 2561 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-184.ec2.internal\" not found" Jul 01 19:11:33.977132 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.970069 2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 01 19:11:33.977132 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.971250 2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 01 19:11:33.977132 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.971283 2561 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 01 19:11:33.977132 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.971302 2561 kubelet.go:2448] "Starting kubelet main sync loop" Jul 01 19:11:33.977132 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:11:33.971330 2561 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 01 19:11:33.977132 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:33.973782 2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 19:11:34.062049 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:34.062013 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 19:11:34.063020 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:34.062992 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-184.ec2.internal" event="NodeHasSufficientMemory" Jul 01 19:11:34.063141 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:34.063031 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-184.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 19:11:34.063141 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:34.063047 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-184.ec2.internal" event="NodeHasSufficientPID" Jul 01 19:11:34.063141 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:34.063077 2561 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-131-184.ec2.internal" Jul 01 19:11:34.071805 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:34.071746 2561 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-184.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-131-184.ec2.internal"] Jul 01 19:11:34.071872 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:34.071812 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 19:11:34.072174 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:34.072158 2561 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-131-184.ec2.internal" Jul 01 19:11:34.072223 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:11:34.072196 2561 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-131-184.ec2.internal\": node \"ip-10-0-131-184.ec2.internal\" not found" Jul 01 19:11:34.073737 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:34.073718 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-184.ec2.internal" event="NodeHasSufficientMemory" Jul 01 19:11:34.073833 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:34.073749 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-184.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 19:11:34.073833 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:34.073760 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-184.ec2.internal" event="NodeHasSufficientPID" Jul 01 19:11:34.076890 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:34.076877 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 19:11:34.077016 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:34.077002 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-184.ec2.internal" Jul 01 19:11:34.077060 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:34.077035 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 19:11:34.077548 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:34.077525 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-184.ec2.internal" event="NodeHasSufficientMemory" Jul 01 19:11:34.077604 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:34.077525 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-184.ec2.internal" event="NodeHasSufficientMemory" Jul 01 19:11:34.077604 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:34.077576 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-184.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 19:11:34.077604 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:34.077589 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-184.ec2.internal" event="NodeHasSufficientPID" Jul 01 19:11:34.077706 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:34.077553 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-184.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 19:11:34.077706 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:34.077630 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-184.ec2.internal" event="NodeHasSufficientPID" Jul 01 19:11:34.079760 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:34.079744 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-184.ec2.internal" Jul 01 19:11:34.079837 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:34.079777 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 19:11:34.080431 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:34.080417 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-184.ec2.internal" event="NodeHasSufficientMemory" Jul 01 19:11:34.080494 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:34.080443 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-184.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 19:11:34.080494 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:34.080451 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-184.ec2.internal" event="NodeHasSufficientPID" Jul 01 19:11:34.088619 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:11:34.088605 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-184.ec2.internal\" not found" Jul 01 19:11:34.095862 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:11:34.095639 2561 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-184.ec2.internal\" not found" node="ip-10-0-131-184.ec2.internal" Jul 01 19:11:34.100071 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:11:34.100056 2561 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-184.ec2.internal\" not found" node="ip-10-0-131-184.ec2.internal" Jul 01 19:11:34.105160 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:34.105145 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/66ca3bff8df40f7aecc6da1d0afc4ccd-config\") pod \"kube-apiserver-proxy-ip-10-0-131-184.ec2.internal\" (UID: \"66ca3bff8df40f7aecc6da1d0afc4ccd\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-184.ec2.internal" Jul 01 19:11:34.105212 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:34.105166 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2653e56ffabcf512a6490e9fddefd621-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-184.ec2.internal\" (UID: \"2653e56ffabcf512a6490e9fddefd621\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-184.ec2.internal" Jul 01 19:11:34.105212 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:34.105182 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2653e56ffabcf512a6490e9fddefd621-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-184.ec2.internal\" (UID: \"2653e56ffabcf512a6490e9fddefd621\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-184.ec2.internal" Jul 01 19:11:34.189537 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:11:34.189500 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-184.ec2.internal\" not found" Jul 01 19:11:34.205328 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:34.205305 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/66ca3bff8df40f7aecc6da1d0afc4ccd-config\") pod \"kube-apiserver-proxy-ip-10-0-131-184.ec2.internal\" (UID: \"66ca3bff8df40f7aecc6da1d0afc4ccd\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-184.ec2.internal" Jul 01 19:11:34.205443 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:34.205332 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2653e56ffabcf512a6490e9fddefd621-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-184.ec2.internal\" (UID: \"2653e56ffabcf512a6490e9fddefd621\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-184.ec2.internal" Jul 01 19:11:34.205443 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:34.205350 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2653e56ffabcf512a6490e9fddefd621-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-184.ec2.internal\" (UID: \"2653e56ffabcf512a6490e9fddefd621\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-184.ec2.internal" Jul 01 19:11:34.205443 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:34.205395 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2653e56ffabcf512a6490e9fddefd621-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-184.ec2.internal\" (UID: \"2653e56ffabcf512a6490e9fddefd621\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-184.ec2.internal" Jul 01 19:11:34.205443 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:34.205418 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/66ca3bff8df40f7aecc6da1d0afc4ccd-config\") pod \"kube-apiserver-proxy-ip-10-0-131-184.ec2.internal\" (UID: \"66ca3bff8df40f7aecc6da1d0afc4ccd\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-184.ec2.internal" Jul 01 19:11:34.205591 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:34.205417 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2653e56ffabcf512a6490e9fddefd621-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-184.ec2.internal\" (UID: \"2653e56ffabcf512a6490e9fddefd621\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-184.ec2.internal" Jul 01 19:11:34.289757 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:11:34.289713 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-184.ec2.internal\" not found" Jul 01 19:11:34.390526 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:11:34.390436 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-184.ec2.internal\" not found" Jul 01 19:11:34.400623 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:34.400601 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-184.ec2.internal" Jul 01 19:11:34.405258 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:34.405245 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-184.ec2.internal" Jul 01 19:11:34.491004 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:11:34.490963 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-184.ec2.internal\" not found" Jul 01 19:11:34.591532 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:11:34.591485 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-184.ec2.internal\" not found" Jul 01 19:11:34.692074 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:11:34.691980 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-184.ec2.internal\" not found" Jul 01 19:11:34.792561 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:11:34.792523 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-184.ec2.internal\" not found" Jul 01 19:11:34.843011 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:34.842984 2561 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 01 19:11:34.843509 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:34.843143 2561 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 01 19:11:34.843509 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:34.843189 2561 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 01 19:11:34.893128 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:11:34.893099 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-184.ec2.internal\" not found" Jul 01 19:11:34.907309 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:34.907279 2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-30 19:06:33 +0000 UTC" deadline="2028-04-08 10:48:53.30244985 +0000 UTC" Jul 01 19:11:34.907309 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:34.907304 2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15519h37m18.395148898s" Jul 01 19:11:34.927057 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:34.927030 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2653e56ffabcf512a6490e9fddefd621.slice/crio-1709c8f0f1a0f775e29fe6285020acf064b48e0490c441ede5e2305e50ce94e2 WatchSource:0}: Error finding container 1709c8f0f1a0f775e29fe6285020acf064b48e0490c441ede5e2305e50ce94e2: Status 404 returned error can't find the container with id 1709c8f0f1a0f775e29fe6285020acf064b48e0490c441ede5e2305e50ce94e2 Jul 01 19:11:34.927360 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:34.927338 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66ca3bff8df40f7aecc6da1d0afc4ccd.slice/crio-c1ea25e973c941d5bcf742569eb5cb197d64a1ea03ab0a1b6f422dc0986bc2d7 WatchSource:0}: Error finding container c1ea25e973c941d5bcf742569eb5cb197d64a1ea03ab0a1b6f422dc0986bc2d7: Status 404 returned error can't find the container with id c1ea25e973c941d5bcf742569eb5cb197d64a1ea03ab0a1b6f422dc0986bc2d7 Jul 01 19:11:34.931094 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:34.931077 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 01 19:11:34.958867 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:34.958801 2561 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 19:11:34.961686 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:34.961666 2561 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 19:11:34.974483 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:34.974436 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-184.ec2.internal" event={"ID":"2653e56ffabcf512a6490e9fddefd621","Type":"ContainerStarted","Data":"1709c8f0f1a0f775e29fe6285020acf064b48e0490c441ede5e2305e50ce94e2"} Jul 01 19:11:34.975447 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:34.975427 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-184.ec2.internal" event={"ID":"66ca3bff8df40f7aecc6da1d0afc4ccd","Type":"ContainerStarted","Data":"c1ea25e973c941d5bcf742569eb5cb197d64a1ea03ab0a1b6f422dc0986bc2d7"} Jul 01 19:11:35.004468 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:35.004436 2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-184.ec2.internal" Jul 01 19:11:35.015598 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:35.015576 2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 01 19:11:35.016876 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:35.016862 2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-184.ec2.internal" Jul 01 19:11:35.026038 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:35.026020 2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 01 19:11:35.830693 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:35.830642 2561 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 19:11:35.884334 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:35.884303 2561 apiserver.go:52] "Watching apiserver" Jul 01 19:11:35.892197 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:35.892164 2561 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 01 19:11:35.892600 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:35.892570 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-p4nbs","kube-system/konnectivity-agent-wqk2n","kube-system/kube-apiserver-proxy-ip-10-0-131-184.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ntmp4","openshift-dns/node-resolver-rkh5s","openshift-image-registry/node-ca-5bfhm","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-184.ec2.internal","openshift-multus/multus-additional-cni-plugins-vcrsx","openshift-multus/multus-n8h95","kube-system/global-pull-secret-syncer-2x822","openshift-cluster-node-tuning-operator/tuned-6kt9r","openshift-multus/network-metrics-daemon-smtsc","openshift-network-diagnostics/network-check-target-mv2pp","openshift-network-operator/iptables-alerter-gb8ld"] Jul 01 19:11:35.894733 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:35.894715 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2x822" Jul 01 19:11:35.894832 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:11:35.894786 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2x822" podUID="7329e3ea-d499-46e5-8c07-935a27d6ab99" Jul 01 19:11:35.896605 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:35.896584 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mv2pp" Jul 01 19:11:35.896703 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:11:35.896655 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mv2pp" podUID="2ee3163e-709f-4909-a449-583e66fa3ce5" Jul 01 19:11:35.898011 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:35.897992 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-gb8ld" Jul 01 19:11:35.900040 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:35.900020 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ntmp4" Jul 01 19:11:35.900562 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:35.900436 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-f5fhf\"" Jul 01 19:11:35.900562 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:35.900529 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 01 19:11:35.900704 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:35.900565 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 01 19:11:35.900704 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:35.900648 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 01 19:11:35.901567 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:35.901549 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 01 19:11:35.901914 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:35.901893 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 01 19:11:35.902021 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:35.901946 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 01 19:11:35.902088 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:35.902027 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-rkh5s" Jul 01 19:11:35.902331 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:35.902256 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-v56zt\"" Jul 01 19:11:35.903437 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:35.903418 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-5bfhm" Jul 01 19:11:35.903825 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:35.903807 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-5qntm\"" Jul 01 19:11:35.903892 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:35.903884 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 01 19:11:35.903948 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:35.903935 2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 01 19:11:35.904633 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:35.904611 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 01 19:11:35.904926 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:35.904910 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-wnc97\"" Jul 01 19:11:35.905031 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:35.905004 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-n8h95" Jul 01 19:11:35.905405 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:35.905386 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 01 19:11:35.905630 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:35.905598 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 01 19:11:35.905630 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:35.905618 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 01 19:11:35.907249 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:35.907231 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-j5ckl\"" Jul 01 19:11:35.907359 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:35.907344 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 01 19:11:35.907420 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:35.907362 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 01 19:11:35.907470 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:35.907422 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 01 19:11:35.907470 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:35.907428 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 01 19:11:35.907470 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:35.907444 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-vcrsx" Jul 01 19:11:35.908966 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:35.908935 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-wqk2n" Jul 01 19:11:35.909435 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:35.909419 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-728cj\"" Jul 01 19:11:35.911573 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:35.911082 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-p4nbs" Jul 01 19:11:35.911888 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:35.911869 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 01 19:11:35.912105 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:35.912088 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 01 19:11:35.912333 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:35.912315 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 01 19:11:35.912555 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:35.912536 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 01 19:11:35.912841 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:35.912823 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-bkv9c\"" Jul 01 19:11:35.913195 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:35.913176 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 01 19:11:35.913981 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:35.913716 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 01 19:11:35.913981 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:35.913735 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 01 19:11:35.913981 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:35.913804 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmq27\" (UniqueName: \"kubernetes.io/projected/defe52c5-ead5-443a-a79e-6357cf3ce6f2-kube-api-access-mmq27\") pod \"node-resolver-rkh5s\" (UID: \"defe52c5-ead5-443a-a79e-6357cf3ce6f2\") " pod="openshift-dns/node-resolver-rkh5s" Jul 01 19:11:35.913981 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:35.913840 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/985e214f-29e2-4f45-b382-37fd0376ef7b-system-cni-dir\") pod \"multus-n8h95\" (UID: \"985e214f-29e2-4f45-b382-37fd0376ef7b\") " pod="openshift-multus/multus-n8h95" Jul 01 19:11:35.913981 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:35.913866 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/985e214f-29e2-4f45-b382-37fd0376ef7b-multus-socket-dir-parent\") pod \"multus-n8h95\" (UID: \"985e214f-29e2-4f45-b382-37fd0376ef7b\") " pod="openshift-multus/multus-n8h95" Jul 01 19:11:35.913981 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:35.913891 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/985e214f-29e2-4f45-b382-37fd0376ef7b-host-run-k8s-cni-cncf-io\") pod \"multus-n8h95\" (UID: \"985e214f-29e2-4f45-b382-37fd0376ef7b\") " pod="openshift-multus/multus-n8h95" Jul 01 19:11:35.914319 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:35.914010 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wbznf\" (UniqueName: \"kubernetes.io/projected/4c7a0558-eff0-42a2-9769-49f2650c196d-kube-api-access-wbznf\") pod \"iptables-alerter-gb8ld\" (UID: \"4c7a0558-eff0-42a2-9769-49f2650c196d\") " pod="openshift-network-operator/iptables-alerter-gb8ld" Jul 01 19:11:35.914319 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:35.914035 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/962da8ba-cb8b-4738-a1e7-33396d02214d-device-dir\") pod \"aws-ebs-csi-driver-node-ntmp4\" (UID: \"962da8ba-cb8b-4738-a1e7-33396d02214d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ntmp4" Jul 01 19:11:35.914319 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:35.914057 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/962da8ba-cb8b-4738-a1e7-33396d02214d-sys-fs\") pod \"aws-ebs-csi-driver-node-ntmp4\" (UID: \"962da8ba-cb8b-4738-a1e7-33396d02214d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ntmp4" Jul 01 19:11:35.914319 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:35.914079 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mf77l\" (UniqueName: \"kubernetes.io/projected/8747f708-8d08-4b9b-a6f5-5f6a637ed029-kube-api-access-mf77l\") pod \"node-ca-5bfhm\" (UID: \"8747f708-8d08-4b9b-a6f5-5f6a637ed029\") " pod="openshift-image-registry/node-ca-5bfhm" Jul 01 19:11:35.914319 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:35.914116 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/985e214f-29e2-4f45-b382-37fd0376ef7b-multus-cni-dir\") pod \"multus-n8h95\" (UID: \"985e214f-29e2-4f45-b382-37fd0376ef7b\") " pod="openshift-multus/multus-n8h95" Jul 01 19:11:35.914319 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:35.914163 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/985e214f-29e2-4f45-b382-37fd0376ef7b-host-var-lib-cni-multus\") pod \"multus-n8h95\" (UID: \"985e214f-29e2-4f45-b382-37fd0376ef7b\") " pod="openshift-multus/multus-n8h95" Jul 01 19:11:35.914319 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:35.914182 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-6kt9r" Jul 01 19:11:35.914319 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:35.914198 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7pl6\" (UniqueName: \"kubernetes.io/projected/2ee3163e-709f-4909-a449-583e66fa3ce5-kube-api-access-p7pl6\") pod \"network-check-target-mv2pp\" (UID: \"2ee3163e-709f-4909-a449-583e66fa3ce5\") " pod="openshift-network-diagnostics/network-check-target-mv2pp" Jul 01 19:11:35.914319 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:35.914264 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8747f708-8d08-4b9b-a6f5-5f6a637ed029-host\") pod \"node-ca-5bfhm\" (UID: \"8747f708-8d08-4b9b-a6f5-5f6a637ed029\") " pod="openshift-image-registry/node-ca-5bfhm" Jul 01 19:11:35.914319 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:35.914294 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8747f708-8d08-4b9b-a6f5-5f6a637ed029-serviceca\") pod \"node-ca-5bfhm\" (UID: \"8747f708-8d08-4b9b-a6f5-5f6a637ed029\") " pod="openshift-image-registry/node-ca-5bfhm" Jul 01 19:11:35.914319 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:35.914320 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7329e3ea-d499-46e5-8c07-935a27d6ab99-dbus\") pod \"global-pull-secret-syncer-2x822\" (UID: \"7329e3ea-d499-46e5-8c07-935a27d6ab99\") " pod="kube-system/global-pull-secret-syncer-2x822" Jul 01 19:11:35.914803 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:35.914339 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 01 19:11:35.914803 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:35.914400 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 01 19:11:35.914803 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:35.914375 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4c7a0558-eff0-42a2-9769-49f2650c196d-host-slash\") pod \"iptables-alerter-gb8ld\" (UID: \"4c7a0558-eff0-42a2-9769-49f2650c196d\") " pod="openshift-network-operator/iptables-alerter-gb8ld" Jul 01 19:11:35.914803 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:35.914444 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/962da8ba-cb8b-4738-a1e7-33396d02214d-socket-dir\") pod \"aws-ebs-csi-driver-node-ntmp4\" (UID: \"962da8ba-cb8b-4738-a1e7-33396d02214d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ntmp4" Jul 01 19:11:35.914803 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:35.914512 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/962da8ba-cb8b-4738-a1e7-33396d02214d-etc-selinux\") pod \"aws-ebs-csi-driver-node-ntmp4\" (UID: \"962da8ba-cb8b-4738-a1e7-33396d02214d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ntmp4" Jul 01 19:11:35.914803 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:35.914537 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/985e214f-29e2-4f45-b382-37fd0376ef7b-cnibin\") pod \"multus-n8h95\" (UID: \"985e214f-29e2-4f45-b382-37fd0376ef7b\") " pod="openshift-multus/multus-n8h95" Jul 01 19:11:35.914803 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:35.914650 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/985e214f-29e2-4f45-b382-37fd0376ef7b-os-release\") pod \"multus-n8h95\" (UID: \"985e214f-29e2-4f45-b382-37fd0376ef7b\") " pod="openshift-multus/multus-n8h95" Jul 01 19:11:35.914803 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:35.914676 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/985e214f-29e2-4f45-b382-37fd0376ef7b-host-run-netns\") pod \"multus-n8h95\" (UID: \"985e214f-29e2-4f45-b382-37fd0376ef7b\") " pod="openshift-multus/multus-n8h95" Jul 01 19:11:35.914803 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:35.914730 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/985e214f-29e2-4f45-b382-37fd0376ef7b-host-var-lib-kubelet\") pod \"multus-n8h95\" (UID: \"985e214f-29e2-4f45-b382-37fd0376ef7b\") " pod="openshift-multus/multus-n8h95" Jul 01 19:11:35.914803 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:35.914765 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/985e214f-29e2-4f45-b382-37fd0376ef7b-multus-conf-dir\") pod \"multus-n8h95\" (UID: \"985e214f-29e2-4f45-b382-37fd0376ef7b\") " pod="openshift-multus/multus-n8h95" Jul 01 19:11:35.914803 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:35.914791 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/962da8ba-cb8b-4738-a1e7-33396d02214d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ntmp4\" (UID: \"962da8ba-cb8b-4738-a1e7-33396d02214d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ntmp4" Jul 01 19:11:35.915283 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:35.914807 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/962da8ba-cb8b-4738-a1e7-33396d02214d-registration-dir\") pod \"aws-ebs-csi-driver-node-ntmp4\" (UID: \"962da8ba-cb8b-4738-a1e7-33396d02214d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ntmp4" Jul 01 19:11:35.915283 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:35.914830 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/985e214f-29e2-4f45-b382-37fd0376ef7b-host-var-lib-cni-bin\") pod \"multus-n8h95\" (UID: \"985e214f-29e2-4f45-b382-37fd0376ef7b\") " pod="openshift-multus/multus-n8h95" Jul 01 19:11:35.915283 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:35.914873 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 01 19:11:35.915283 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:35.914884 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/985e214f-29e2-4f45-b382-37fd0376ef7b-host-run-multus-certs\") pod \"multus-n8h95\" (UID: \"985e214f-29e2-4f45-b382-37fd0376ef7b\") " pod="openshift-multus/multus-n8h95" Jul 01 19:11:35.915283 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:35.914890 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-nhblg\"" Jul 01 19:11:35.915283 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:35.915277 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/985e214f-29e2-4f45-b382-37fd0376ef7b-etc-kubernetes\") pod \"multus-n8h95\" (UID: \"985e214f-29e2-4f45-b382-37fd0376ef7b\") " pod="openshift-multus/multus-n8h95" Jul 01 19:11:35.915541 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:35.915525 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jk58q\" (UniqueName: \"kubernetes.io/projected/985e214f-29e2-4f45-b382-37fd0376ef7b-kube-api-access-jk58q\") pod \"multus-n8h95\" (UID: \"985e214f-29e2-4f45-b382-37fd0376ef7b\") " pod="openshift-multus/multus-n8h95" Jul 01 19:11:35.915600 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:35.915566 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7329e3ea-d499-46e5-8c07-935a27d6ab99-kubelet-config\") pod \"global-pull-secret-syncer-2x822\" (UID: \"7329e3ea-d499-46e5-8c07-935a27d6ab99\") " pod="kube-system/global-pull-secret-syncer-2x822" Jul 01 19:11:35.915675 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:35.915643 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/985e214f-29e2-4f45-b382-37fd0376ef7b-cni-binary-copy\") pod \"multus-n8h95\" (UID: \"985e214f-29e2-4f45-b382-37fd0376ef7b\") " pod="openshift-multus/multus-n8h95" Jul 01 19:11:35.915737 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:35.915692 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/985e214f-29e2-4f45-b382-37fd0376ef7b-multus-daemon-config\") pod \"multus-n8h95\" (UID: \"985e214f-29e2-4f45-b382-37fd0376ef7b\") " pod="openshift-multus/multus-n8h95" Jul 01 19:11:35.915905 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:35.915887 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 01 19:11:35.916370 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:35.915721 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chnks\" (UniqueName: \"kubernetes.io/projected/962da8ba-cb8b-4738-a1e7-33396d02214d-kube-api-access-chnks\") pod \"aws-ebs-csi-driver-node-ntmp4\" (UID: \"962da8ba-cb8b-4738-a1e7-33396d02214d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ntmp4" Jul 01 19:11:35.916438 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:35.916406 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/defe52c5-ead5-443a-a79e-6357cf3ce6f2-tmp-dir\") pod \"node-resolver-rkh5s\" (UID: \"defe52c5-ead5-443a-a79e-6357cf3ce6f2\") " pod="openshift-dns/node-resolver-rkh5s" Jul 01 19:11:35.916498 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:35.916439 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4c7a0558-eff0-42a2-9769-49f2650c196d-iptables-alerter-script\") pod \"iptables-alerter-gb8ld\" (UID: \"4c7a0558-eff0-42a2-9769-49f2650c196d\") " pod="openshift-network-operator/iptables-alerter-gb8ld" Jul 01 19:11:35.916498 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:35.916469 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/defe52c5-ead5-443a-a79e-6357cf3ce6f2-hosts-file\") pod \"node-resolver-rkh5s\" (UID: \"defe52c5-ead5-443a-a79e-6357cf3ce6f2\") " pod="openshift-dns/node-resolver-rkh5s" Jul 01 19:11:35.916592 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:35.916507 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/985e214f-29e2-4f45-b382-37fd0376ef7b-hostroot\") pod \"multus-n8h95\" (UID: \"985e214f-29e2-4f45-b382-37fd0376ef7b\") " pod="openshift-multus/multus-n8h95" Jul 01 19:11:35.916592 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:35.916545 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7329e3ea-d499-46e5-8c07-935a27d6ab99-original-pull-secret\") pod \"global-pull-secret-syncer-2x822\" (UID: \"7329e3ea-d499-46e5-8c07-935a27d6ab99\") " pod="kube-system/global-pull-secret-syncer-2x822" Jul 01 19:11:35.916781 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:35.916733 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-z9k5p\"" Jul 01 19:11:35.916874 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:35.916849 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 01 19:11:35.917692 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:35.917625 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-smtsc" Jul 01 19:11:35.918823 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:11:35.917878 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-smtsc" podUID="a30b203c-f4ce-4746-a763-ffde940c4276" Jul 01 19:11:35.919332 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:35.919307 2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 01 19:11:36.005759 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.005730 2561 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 01 19:11:36.016755 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.016723 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/193abea0-56eb-4a19-a2a1-6d72265b07e6-agent-certs\") pod \"konnectivity-agent-wqk2n\" (UID: \"193abea0-56eb-4a19-a2a1-6d72265b07e6\") " pod="kube-system/konnectivity-agent-wqk2n" Jul 01 19:11:36.016920 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.016763 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/193abea0-56eb-4a19-a2a1-6d72265b07e6-konnectivity-ca\") pod \"konnectivity-agent-wqk2n\" (UID: \"193abea0-56eb-4a19-a2a1-6d72265b07e6\") " pod="kube-system/konnectivity-agent-wqk2n" Jul 01 19:11:36.016920 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.016789 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9315c387-a14c-4926-969a-64945926951e-host-run-netns\") pod \"ovnkube-node-p4nbs\" (UID: \"9315c387-a14c-4926-969a-64945926951e\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4nbs" Jul 01 19:11:36.016920 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.016820 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4c7a0558-eff0-42a2-9769-49f2650c196d-iptables-alerter-script\") pod \"iptables-alerter-gb8ld\" (UID: \"4c7a0558-eff0-42a2-9769-49f2650c196d\") " pod="openshift-network-operator/iptables-alerter-gb8ld" Jul 01 19:11:36.016920 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.016845 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6ee08291-b071-4a30-bd8a-c0208d7710b5-etc-sysctl-d\") pod \"tuned-6kt9r\" (UID: \"6ee08291-b071-4a30-bd8a-c0208d7710b5\") " pod="openshift-cluster-node-tuning-operator/tuned-6kt9r" Jul 01 19:11:36.016920 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.016872 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9315c387-a14c-4926-969a-64945926951e-host-slash\") pod \"ovnkube-node-p4nbs\" (UID: \"9315c387-a14c-4926-969a-64945926951e\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4nbs" Jul 01 19:11:36.016920 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.016898 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/defe52c5-ead5-443a-a79e-6357cf3ce6f2-hosts-file\") pod \"node-resolver-rkh5s\" (UID: \"defe52c5-ead5-443a-a79e-6357cf3ce6f2\") " pod="openshift-dns/node-resolver-rkh5s" Jul 01 19:11:36.017229 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.016922 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7329e3ea-d499-46e5-8c07-935a27d6ab99-original-pull-secret\") pod \"global-pull-secret-syncer-2x822\" (UID: \"7329e3ea-d499-46e5-8c07-935a27d6ab99\") " pod="kube-system/global-pull-secret-syncer-2x822" Jul 01 19:11:36.017229 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.016947 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5dd67e73-cf2f-4415-88d5-9e42762cb4d3-cnibin\") pod \"multus-additional-cni-plugins-vcrsx\" (UID: \"5dd67e73-cf2f-4415-88d5-9e42762cb4d3\") " pod="openshift-multus/multus-additional-cni-plugins-vcrsx" Jul 01 19:11:36.017229 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.017005 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5dd67e73-cf2f-4415-88d5-9e42762cb4d3-cni-binary-copy\") pod \"multus-additional-cni-plugins-vcrsx\" (UID: \"5dd67e73-cf2f-4415-88d5-9e42762cb4d3\") " pod="openshift-multus/multus-additional-cni-plugins-vcrsx" Jul 01 19:11:36.017229 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.017028 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6ee08291-b071-4a30-bd8a-c0208d7710b5-etc-tuned\") pod \"tuned-6kt9r\" (UID: \"6ee08291-b071-4a30-bd8a-c0208d7710b5\") " pod="openshift-cluster-node-tuning-operator/tuned-6kt9r" Jul 01 19:11:36.017229 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.017051 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9315c387-a14c-4926-969a-64945926951e-host-kubelet\") pod \"ovnkube-node-p4nbs\" (UID: \"9315c387-a14c-4926-969a-64945926951e\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4nbs" Jul 01 19:11:36.017229 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.017076 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9315c387-a14c-4926-969a-64945926951e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-p4nbs\" (UID: \"9315c387-a14c-4926-969a-64945926951e\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4nbs" Jul 01 19:11:36.017229 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.017106 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9t28\" (UniqueName: \"kubernetes.io/projected/9315c387-a14c-4926-969a-64945926951e-kube-api-access-p9t28\") pod \"ovnkube-node-p4nbs\" (UID: \"9315c387-a14c-4926-969a-64945926951e\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4nbs" Jul 01 19:11:36.017229 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.017132 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mmq27\" (UniqueName: \"kubernetes.io/projected/defe52c5-ead5-443a-a79e-6357cf3ce6f2-kube-api-access-mmq27\") pod \"node-resolver-rkh5s\" (UID: \"defe52c5-ead5-443a-a79e-6357cf3ce6f2\") " pod="openshift-dns/node-resolver-rkh5s" Jul 01 19:11:36.017229 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.017180 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/985e214f-29e2-4f45-b382-37fd0376ef7b-system-cni-dir\") pod \"multus-n8h95\" (UID: \"985e214f-29e2-4f45-b382-37fd0376ef7b\") " pod="openshift-multus/multus-n8h95" Jul 01 19:11:36.017229 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.017207 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/985e214f-29e2-4f45-b382-37fd0376ef7b-host-run-k8s-cni-cncf-io\") pod \"multus-n8h95\" (UID: \"985e214f-29e2-4f45-b382-37fd0376ef7b\") " pod="openshift-multus/multus-n8h95" Jul 01 19:11:36.017714 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.017242 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wbznf\" (UniqueName: \"kubernetes.io/projected/4c7a0558-eff0-42a2-9769-49f2650c196d-kube-api-access-wbznf\") pod \"iptables-alerter-gb8ld\" (UID: \"4c7a0558-eff0-42a2-9769-49f2650c196d\") " pod="openshift-network-operator/iptables-alerter-gb8ld" Jul 01 19:11:36.017714 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.017268 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7pl6\" (UniqueName: \"kubernetes.io/projected/2ee3163e-709f-4909-a449-583e66fa3ce5-kube-api-access-p7pl6\") pod \"network-check-target-mv2pp\" (UID: \"2ee3163e-709f-4909-a449-583e66fa3ce5\") " pod="openshift-network-diagnostics/network-check-target-mv2pp" Jul 01 19:11:36.017714 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.017299 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6ee08291-b071-4a30-bd8a-c0208d7710b5-lib-modules\") pod \"tuned-6kt9r\" (UID: \"6ee08291-b071-4a30-bd8a-c0208d7710b5\") " pod="openshift-cluster-node-tuning-operator/tuned-6kt9r" Jul 01 19:11:36.017714 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.017338 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5dd67e73-cf2f-4415-88d5-9e42762cb4d3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vcrsx\" (UID: \"5dd67e73-cf2f-4415-88d5-9e42762cb4d3\") " pod="openshift-multus/multus-additional-cni-plugins-vcrsx" Jul 01 19:11:36.017714 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.017361 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9315c387-a14c-4926-969a-64945926951e-systemd-units\") pod \"ovnkube-node-p4nbs\" (UID: \"9315c387-a14c-4926-969a-64945926951e\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4nbs" Jul 01 19:11:36.017714 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:11:36.017372 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 19:11:36.017714 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.017383 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9315c387-a14c-4926-969a-64945926951e-host-cni-netd\") pod \"ovnkube-node-p4nbs\" (UID: \"9315c387-a14c-4926-969a-64945926951e\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4nbs" Jul 01 19:11:36.017714 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.017411 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/962da8ba-cb8b-4738-a1e7-33396d02214d-socket-dir\") pod \"aws-ebs-csi-driver-node-ntmp4\" (UID: \"962da8ba-cb8b-4738-a1e7-33396d02214d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ntmp4" Jul 01 19:11:36.017714 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:11:36.017457 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7329e3ea-d499-46e5-8c07-935a27d6ab99-original-pull-secret podName:7329e3ea-d499-46e5-8c07-935a27d6ab99 nodeName:}" failed. No retries permitted until 2026-07-01 19:11:36.517422063 +0000 UTC m=+3.025862887 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7329e3ea-d499-46e5-8c07-935a27d6ab99-original-pull-secret") pod "global-pull-secret-syncer-2x822" (UID: "7329e3ea-d499-46e5-8c07-935a27d6ab99") : object "kube-system"/"original-pull-secret" not registered Jul 01 19:11:36.017714 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.017481 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/985e214f-29e2-4f45-b382-37fd0376ef7b-cnibin\") pod \"multus-n8h95\" (UID: \"985e214f-29e2-4f45-b382-37fd0376ef7b\") " pod="openshift-multus/multus-n8h95" Jul 01 19:11:36.017714 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.017522 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/985e214f-29e2-4f45-b382-37fd0376ef7b-host-run-netns\") pod \"multus-n8h95\" (UID: \"985e214f-29e2-4f45-b382-37fd0376ef7b\") " pod="openshift-multus/multus-n8h95" Jul 01 19:11:36.017714 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.017547 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/985e214f-29e2-4f45-b382-37fd0376ef7b-multus-conf-dir\") pod \"multus-n8h95\" (UID: \"985e214f-29e2-4f45-b382-37fd0376ef7b\") " pod="openshift-multus/multus-n8h95" Jul 01 19:11:36.017714 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.017572 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/985e214f-29e2-4f45-b382-37fd0376ef7b-host-run-multus-certs\") pod \"multus-n8h95\" (UID: \"985e214f-29e2-4f45-b382-37fd0376ef7b\") " pod="openshift-multus/multus-n8h95" Jul 01 19:11:36.017714 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.017584 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/962da8ba-cb8b-4738-a1e7-33396d02214d-socket-dir\") pod \"aws-ebs-csi-driver-node-ntmp4\" (UID: \"962da8ba-cb8b-4738-a1e7-33396d02214d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ntmp4" Jul 01 19:11:36.017714 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.017599 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9315c387-a14c-4926-969a-64945926951e-node-log\") pod \"ovnkube-node-p4nbs\" (UID: \"9315c387-a14c-4926-969a-64945926951e\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4nbs" Jul 01 19:11:36.017714 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.017626 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9315c387-a14c-4926-969a-64945926951e-env-overrides\") pod \"ovnkube-node-p4nbs\" (UID: \"9315c387-a14c-4926-969a-64945926951e\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4nbs" Jul 01 19:11:36.017714 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.017692 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/962da8ba-cb8b-4738-a1e7-33396d02214d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ntmp4\" (UID: \"962da8ba-cb8b-4738-a1e7-33396d02214d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ntmp4" Jul 01 19:11:36.018619 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.017718 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jk58q\" (UniqueName: \"kubernetes.io/projected/985e214f-29e2-4f45-b382-37fd0376ef7b-kube-api-access-jk58q\") pod \"multus-n8h95\" (UID: \"985e214f-29e2-4f45-b382-37fd0376ef7b\") " pod="openshift-multus/multus-n8h95" Jul 01 19:11:36.018619 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.017753 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5dd67e73-cf2f-4415-88d5-9e42762cb4d3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vcrsx\" (UID: \"5dd67e73-cf2f-4415-88d5-9e42762cb4d3\") " pod="openshift-multus/multus-additional-cni-plugins-vcrsx" Jul 01 19:11:36.018619 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.017782 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6ee08291-b071-4a30-bd8a-c0208d7710b5-etc-kubernetes\") pod \"tuned-6kt9r\" (UID: \"6ee08291-b071-4a30-bd8a-c0208d7710b5\") " pod="openshift-cluster-node-tuning-operator/tuned-6kt9r" Jul 01 19:11:36.018619 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.017807 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9315c387-a14c-4926-969a-64945926951e-run-ovn\") pod \"ovnkube-node-p4nbs\" (UID: \"9315c387-a14c-4926-969a-64945926951e\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4nbs" Jul 01 19:11:36.018619 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.017834 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/985e214f-29e2-4f45-b382-37fd0376ef7b-cni-binary-copy\") pod \"multus-n8h95\" (UID: \"985e214f-29e2-4f45-b382-37fd0376ef7b\") " pod="openshift-multus/multus-n8h95" Jul 01 19:11:36.018619 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.017859 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/985e214f-29e2-4f45-b382-37fd0376ef7b-multus-daemon-config\") pod \"multus-n8h95\" (UID: \"985e214f-29e2-4f45-b382-37fd0376ef7b\") " pod="openshift-multus/multus-n8h95" Jul 01 19:11:36.018619 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.017884 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzbkg\" (UniqueName: \"kubernetes.io/projected/6ee08291-b071-4a30-bd8a-c0208d7710b5-kube-api-access-nzbkg\") pod \"tuned-6kt9r\" (UID: \"6ee08291-b071-4a30-bd8a-c0208d7710b5\") " pod="openshift-cluster-node-tuning-operator/tuned-6kt9r" Jul 01 19:11:36.018619 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.017979 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9315c387-a14c-4926-969a-64945926951e-etc-openvswitch\") pod \"ovnkube-node-p4nbs\" (UID: \"9315c387-a14c-4926-969a-64945926951e\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4nbs" Jul 01 19:11:36.018619 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.018004 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9315c387-a14c-4926-969a-64945926951e-run-openvswitch\") pod \"ovnkube-node-p4nbs\" (UID: \"9315c387-a14c-4926-969a-64945926951e\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4nbs" Jul 01 19:11:36.018619 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.018024 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/985e214f-29e2-4f45-b382-37fd0376ef7b-system-cni-dir\") pod \"multus-n8h95\" (UID: \"985e214f-29e2-4f45-b382-37fd0376ef7b\") " pod="openshift-multus/multus-n8h95" Jul 01 19:11:36.018619 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.018073 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/985e214f-29e2-4f45-b382-37fd0376ef7b-host-run-k8s-cni-cncf-io\") pod \"multus-n8h95\" (UID: \"985e214f-29e2-4f45-b382-37fd0376ef7b\") " pod="openshift-multus/multus-n8h95" Jul 01 19:11:36.018619 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.018393 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/985e214f-29e2-4f45-b382-37fd0376ef7b-cnibin\") pod \"multus-n8h95\" (UID: \"985e214f-29e2-4f45-b382-37fd0376ef7b\") " pod="openshift-multus/multus-n8h95" Jul 01 19:11:36.018619 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.018027 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9315c387-a14c-4926-969a-64945926951e-log-socket\") pod \"ovnkube-node-p4nbs\" (UID: \"9315c387-a14c-4926-969a-64945926951e\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4nbs" Jul 01 19:11:36.018619 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.018469 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/985e214f-29e2-4f45-b382-37fd0376ef7b-multus-conf-dir\") pod \"multus-n8h95\" (UID: \"985e214f-29e2-4f45-b382-37fd0376ef7b\") " pod="openshift-multus/multus-n8h95" Jul 01 19:11:36.018619 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.018468 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chnks\" (UniqueName: \"kubernetes.io/projected/962da8ba-cb8b-4738-a1e7-33396d02214d-kube-api-access-chnks\") pod \"aws-ebs-csi-driver-node-ntmp4\" (UID: \"962da8ba-cb8b-4738-a1e7-33396d02214d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ntmp4" Jul 01 19:11:36.018619 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.018517 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/defe52c5-ead5-443a-a79e-6357cf3ce6f2-tmp-dir\") pod \"node-resolver-rkh5s\" (UID: \"defe52c5-ead5-443a-a79e-6357cf3ce6f2\") " pod="openshift-dns/node-resolver-rkh5s" Jul 01 19:11:36.018619 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.018568 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6ee08291-b071-4a30-bd8a-c0208d7710b5-etc-modprobe-d\") pod \"tuned-6kt9r\" (UID: \"6ee08291-b071-4a30-bd8a-c0208d7710b5\") " pod="openshift-cluster-node-tuning-operator/tuned-6kt9r" Jul 01 19:11:36.020357 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.018596 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6ee08291-b071-4a30-bd8a-c0208d7710b5-etc-sysctl-conf\") pod \"tuned-6kt9r\" (UID: \"6ee08291-b071-4a30-bd8a-c0208d7710b5\") " pod="openshift-cluster-node-tuning-operator/tuned-6kt9r" Jul 01 19:11:36.020357 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.018619 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6ee08291-b071-4a30-bd8a-c0208d7710b5-sys\") pod \"tuned-6kt9r\" (UID: \"6ee08291-b071-4a30-bd8a-c0208d7710b5\") " pod="openshift-cluster-node-tuning-operator/tuned-6kt9r" Jul 01 19:11:36.020357 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.018648 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a30b203c-f4ce-4746-a763-ffde940c4276-metrics-certs\") pod \"network-metrics-daemon-smtsc\" (UID: \"a30b203c-f4ce-4746-a763-ffde940c4276\") " pod="openshift-multus/network-metrics-daemon-smtsc" Jul 01 19:11:36.020357 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.018699 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/985e214f-29e2-4f45-b382-37fd0376ef7b-host-run-multus-certs\") pod \"multus-n8h95\" (UID: \"985e214f-29e2-4f45-b382-37fd0376ef7b\") " pod="openshift-multus/multus-n8h95" Jul 01 19:11:36.020357 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.018755 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/962da8ba-cb8b-4738-a1e7-33396d02214d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ntmp4\" (UID: \"962da8ba-cb8b-4738-a1e7-33396d02214d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ntmp4" Jul 01 19:11:36.020357 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.018991 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/defe52c5-ead5-443a-a79e-6357cf3ce6f2-hosts-file\") pod \"node-resolver-rkh5s\" (UID: \"defe52c5-ead5-443a-a79e-6357cf3ce6f2\") " pod="openshift-dns/node-resolver-rkh5s" Jul 01 19:11:36.020357 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.019271 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4c7a0558-eff0-42a2-9769-49f2650c196d-iptables-alerter-script\") pod \"iptables-alerter-gb8ld\" (UID: \"4c7a0558-eff0-42a2-9769-49f2650c196d\") " pod="openshift-network-operator/iptables-alerter-gb8ld" Jul 01 19:11:36.020357 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.018434 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/985e214f-29e2-4f45-b382-37fd0376ef7b-host-run-netns\") pod \"multus-n8h95\" (UID: \"985e214f-29e2-4f45-b382-37fd0376ef7b\") " pod="openshift-multus/multus-n8h95" Jul 01 19:11:36.020357 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.019357 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/985e214f-29e2-4f45-b382-37fd0376ef7b-hostroot\") pod \"multus-n8h95\" (UID: \"985e214f-29e2-4f45-b382-37fd0376ef7b\") " pod="openshift-multus/multus-n8h95" Jul 01 19:11:36.020357 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.019389 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9315c387-a14c-4926-969a-64945926951e-host-run-ovn-kubernetes\") pod \"ovnkube-node-p4nbs\" (UID: \"9315c387-a14c-4926-969a-64945926951e\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4nbs" Jul 01 19:11:36.020357 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.019421 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/985e214f-29e2-4f45-b382-37fd0376ef7b-multus-socket-dir-parent\") pod \"multus-n8h95\" (UID: \"985e214f-29e2-4f45-b382-37fd0376ef7b\") " pod="openshift-multus/multus-n8h95" Jul 01 19:11:36.020357 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.019445 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5dd67e73-cf2f-4415-88d5-9e42762cb4d3-os-release\") pod \"multus-additional-cni-plugins-vcrsx\" (UID: \"5dd67e73-cf2f-4415-88d5-9e42762cb4d3\") " pod="openshift-multus/multus-additional-cni-plugins-vcrsx" Jul 01 19:11:36.020357 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.019483 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sn8r9\" (UniqueName: \"kubernetes.io/projected/a30b203c-f4ce-4746-a763-ffde940c4276-kube-api-access-sn8r9\") pod \"network-metrics-daemon-smtsc\" (UID: \"a30b203c-f4ce-4746-a763-ffde940c4276\") " pod="openshift-multus/network-metrics-daemon-smtsc" Jul 01 19:11:36.020357 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.019531 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9315c387-a14c-4926-969a-64945926951e-ovnkube-script-lib\") pod \"ovnkube-node-p4nbs\" (UID: \"9315c387-a14c-4926-969a-64945926951e\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4nbs" Jul 01 19:11:36.020357 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.019569 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/962da8ba-cb8b-4738-a1e7-33396d02214d-device-dir\") pod \"aws-ebs-csi-driver-node-ntmp4\" (UID: \"962da8ba-cb8b-4738-a1e7-33396d02214d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ntmp4" Jul 01 19:11:36.020357 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.019595 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/962da8ba-cb8b-4738-a1e7-33396d02214d-sys-fs\") pod \"aws-ebs-csi-driver-node-ntmp4\" (UID: \"962da8ba-cb8b-4738-a1e7-33396d02214d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ntmp4" Jul 01 19:11:36.020357 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.019625 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mf77l\" (UniqueName: \"kubernetes.io/projected/8747f708-8d08-4b9b-a6f5-5f6a637ed029-kube-api-access-mf77l\") pod \"node-ca-5bfhm\" (UID: \"8747f708-8d08-4b9b-a6f5-5f6a637ed029\") " pod="openshift-image-registry/node-ca-5bfhm" Jul 01 19:11:36.021200 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.019660 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/985e214f-29e2-4f45-b382-37fd0376ef7b-cni-binary-copy\") pod \"multus-n8h95\" (UID: \"985e214f-29e2-4f45-b382-37fd0376ef7b\") " pod="openshift-multus/multus-n8h95" Jul 01 19:11:36.021200 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.019663 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/985e214f-29e2-4f45-b382-37fd0376ef7b-multus-daemon-config\") pod \"multus-n8h95\" (UID: \"985e214f-29e2-4f45-b382-37fd0376ef7b\") " pod="openshift-multus/multus-n8h95" Jul 01 19:11:36.021200 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.019750 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/985e214f-29e2-4f45-b382-37fd0376ef7b-multus-cni-dir\") pod \"multus-n8h95\" (UID: \"985e214f-29e2-4f45-b382-37fd0376ef7b\") " pod="openshift-multus/multus-n8h95" Jul 01 19:11:36.021200 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.019778 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/985e214f-29e2-4f45-b382-37fd0376ef7b-host-var-lib-cni-multus\") pod \"multus-n8h95\" (UID: \"985e214f-29e2-4f45-b382-37fd0376ef7b\") " pod="openshift-multus/multus-n8h95" Jul 01 19:11:36.021200 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.019805 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9315c387-a14c-4926-969a-64945926951e-var-lib-openvswitch\") pod \"ovnkube-node-p4nbs\" (UID: \"9315c387-a14c-4926-969a-64945926951e\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4nbs" Jul 01 19:11:36.021200 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.019830 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6ee08291-b071-4a30-bd8a-c0208d7710b5-etc-systemd\") pod \"tuned-6kt9r\" (UID: \"6ee08291-b071-4a30-bd8a-c0208d7710b5\") " pod="openshift-cluster-node-tuning-operator/tuned-6kt9r" Jul 01 19:11:36.021200 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.019855 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6ee08291-b071-4a30-bd8a-c0208d7710b5-run\") pod \"tuned-6kt9r\" (UID: \"6ee08291-b071-4a30-bd8a-c0208d7710b5\") " pod="openshift-cluster-node-tuning-operator/tuned-6kt9r" Jul 01 19:11:36.021200 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.019879 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8747f708-8d08-4b9b-a6f5-5f6a637ed029-host\") pod \"node-ca-5bfhm\" (UID: \"8747f708-8d08-4b9b-a6f5-5f6a637ed029\") " pod="openshift-image-registry/node-ca-5bfhm" Jul 01 19:11:36.021200 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.019893 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8747f708-8d08-4b9b-a6f5-5f6a637ed029-serviceca\") pod \"node-ca-5bfhm\" (UID: \"8747f708-8d08-4b9b-a6f5-5f6a637ed029\") " pod="openshift-image-registry/node-ca-5bfhm" Jul 01 19:11:36.021200 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.019912 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7329e3ea-d499-46e5-8c07-935a27d6ab99-dbus\") pod \"global-pull-secret-syncer-2x822\" (UID: \"7329e3ea-d499-46e5-8c07-935a27d6ab99\") " pod="kube-system/global-pull-secret-syncer-2x822" Jul 01 19:11:36.021200 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.019944 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4c7a0558-eff0-42a2-9769-49f2650c196d-host-slash\") pod \"iptables-alerter-gb8ld\" (UID: \"4c7a0558-eff0-42a2-9769-49f2650c196d\") " pod="openshift-network-operator/iptables-alerter-gb8ld" Jul 01 19:11:36.021200 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.019985 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5dd67e73-cf2f-4415-88d5-9e42762cb4d3-system-cni-dir\") pod \"multus-additional-cni-plugins-vcrsx\" (UID: \"5dd67e73-cf2f-4415-88d5-9e42762cb4d3\") " pod="openshift-multus/multus-additional-cni-plugins-vcrsx" Jul 01 19:11:36.021200 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.020010 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/962da8ba-cb8b-4738-a1e7-33396d02214d-etc-selinux\") pod \"aws-ebs-csi-driver-node-ntmp4\" (UID: \"962da8ba-cb8b-4738-a1e7-33396d02214d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ntmp4" Jul 01 19:11:36.021200 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.020056 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/985e214f-29e2-4f45-b382-37fd0376ef7b-os-release\") pod \"multus-n8h95\" (UID: \"985e214f-29e2-4f45-b382-37fd0376ef7b\") " pod="openshift-multus/multus-n8h95" Jul 01 19:11:36.021200 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.020082 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/985e214f-29e2-4f45-b382-37fd0376ef7b-host-var-lib-kubelet\") pod \"multus-n8h95\" (UID: \"985e214f-29e2-4f45-b382-37fd0376ef7b\") " pod="openshift-multus/multus-n8h95" Jul 01 19:11:36.021200 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.020117 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxgzh\" (UniqueName: \"kubernetes.io/projected/5dd67e73-cf2f-4415-88d5-9e42762cb4d3-kube-api-access-xxgzh\") pod \"multus-additional-cni-plugins-vcrsx\" (UID: \"5dd67e73-cf2f-4415-88d5-9e42762cb4d3\") " pod="openshift-multus/multus-additional-cni-plugins-vcrsx" Jul 01 19:11:36.021200 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.020329 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6ee08291-b071-4a30-bd8a-c0208d7710b5-etc-sysconfig\") pod \"tuned-6kt9r\" (UID: \"6ee08291-b071-4a30-bd8a-c0208d7710b5\") " pod="openshift-cluster-node-tuning-operator/tuned-6kt9r" Jul 01 19:11:36.021898 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.020362 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6ee08291-b071-4a30-bd8a-c0208d7710b5-tmp\") pod \"tuned-6kt9r\" (UID: \"6ee08291-b071-4a30-bd8a-c0208d7710b5\") " pod="openshift-cluster-node-tuning-operator/tuned-6kt9r" Jul 01 19:11:36.021898 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.020381 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9315c387-a14c-4926-969a-64945926951e-run-systemd\") pod \"ovnkube-node-p4nbs\" (UID: \"9315c387-a14c-4926-969a-64945926951e\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4nbs" Jul 01 19:11:36.021898 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.020408 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9315c387-a14c-4926-969a-64945926951e-host-cni-bin\") pod \"ovnkube-node-p4nbs\" (UID: \"9315c387-a14c-4926-969a-64945926951e\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4nbs" Jul 01 19:11:36.021898 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.020440 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/962da8ba-cb8b-4738-a1e7-33396d02214d-registration-dir\") pod \"aws-ebs-csi-driver-node-ntmp4\" (UID: \"962da8ba-cb8b-4738-a1e7-33396d02214d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ntmp4" Jul 01 19:11:36.021898 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.020472 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/985e214f-29e2-4f45-b382-37fd0376ef7b-host-var-lib-cni-bin\") pod \"multus-n8h95\" (UID: \"985e214f-29e2-4f45-b382-37fd0376ef7b\") " pod="openshift-multus/multus-n8h95" Jul 01 19:11:36.021898 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.020508 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/985e214f-29e2-4f45-b382-37fd0376ef7b-etc-kubernetes\") pod \"multus-n8h95\" (UID: \"985e214f-29e2-4f45-b382-37fd0376ef7b\") " pod="openshift-multus/multus-n8h95" Jul 01 19:11:36.021898 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.020535 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7329e3ea-d499-46e5-8c07-935a27d6ab99-kubelet-config\") pod \"global-pull-secret-syncer-2x822\" (UID: \"7329e3ea-d499-46e5-8c07-935a27d6ab99\") " pod="kube-system/global-pull-secret-syncer-2x822" Jul 01 19:11:36.021898 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.020569 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6ee08291-b071-4a30-bd8a-c0208d7710b5-host\") pod \"tuned-6kt9r\" (UID: \"6ee08291-b071-4a30-bd8a-c0208d7710b5\") " pod="openshift-cluster-node-tuning-operator/tuned-6kt9r" Jul 01 19:11:36.021898 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.020638 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9315c387-a14c-4926-969a-64945926951e-ovnkube-config\") pod \"ovnkube-node-p4nbs\" (UID: \"9315c387-a14c-4926-969a-64945926951e\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4nbs" Jul 01 19:11:36.021898 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.020679 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9315c387-a14c-4926-969a-64945926951e-ovn-node-metrics-cert\") pod \"ovnkube-node-p4nbs\" (UID: \"9315c387-a14c-4926-969a-64945926951e\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4nbs" Jul 01 19:11:36.021898 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.020712 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5dd67e73-cf2f-4415-88d5-9e42762cb4d3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vcrsx\" (UID: \"5dd67e73-cf2f-4415-88d5-9e42762cb4d3\") " pod="openshift-multus/multus-additional-cni-plugins-vcrsx" Jul 01 19:11:36.021898 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.020731 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6ee08291-b071-4a30-bd8a-c0208d7710b5-var-lib-kubelet\") pod \"tuned-6kt9r\" (UID: \"6ee08291-b071-4a30-bd8a-c0208d7710b5\") " pod="openshift-cluster-node-tuning-operator/tuned-6kt9r" Jul 01 19:11:36.021898 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.020930 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/defe52c5-ead5-443a-a79e-6357cf3ce6f2-tmp-dir\") pod \"node-resolver-rkh5s\" (UID: \"defe52c5-ead5-443a-a79e-6357cf3ce6f2\") " pod="openshift-dns/node-resolver-rkh5s" Jul 01 19:11:36.021898 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.021056 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/985e214f-29e2-4f45-b382-37fd0376ef7b-hostroot\") pod \"multus-n8h95\" (UID: \"985e214f-29e2-4f45-b382-37fd0376ef7b\") " pod="openshift-multus/multus-n8h95" Jul 01 19:11:36.021898 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.021168 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/962da8ba-cb8b-4738-a1e7-33396d02214d-etc-selinux\") pod \"aws-ebs-csi-driver-node-ntmp4\" (UID: \"962da8ba-cb8b-4738-a1e7-33396d02214d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ntmp4" Jul 01 19:11:36.021898 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.021183 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/985e214f-29e2-4f45-b382-37fd0376ef7b-multus-socket-dir-parent\") pod \"multus-n8h95\" (UID: \"985e214f-29e2-4f45-b382-37fd0376ef7b\") " pod="openshift-multus/multus-n8h95" Jul 01 19:11:36.021898 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.021225 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/985e214f-29e2-4f45-b382-37fd0376ef7b-os-release\") pod \"multus-n8h95\" (UID: \"985e214f-29e2-4f45-b382-37fd0376ef7b\") " pod="openshift-multus/multus-n8h95" Jul 01 19:11:36.022493 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.021241 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/962da8ba-cb8b-4738-a1e7-33396d02214d-device-dir\") pod \"aws-ebs-csi-driver-node-ntmp4\" (UID: \"962da8ba-cb8b-4738-a1e7-33396d02214d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ntmp4" Jul 01 19:11:36.022493 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.021260 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/985e214f-29e2-4f45-b382-37fd0376ef7b-host-var-lib-kubelet\") pod \"multus-n8h95\" (UID: \"985e214f-29e2-4f45-b382-37fd0376ef7b\") " pod="openshift-multus/multus-n8h95" Jul 01 19:11:36.022493 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.021293 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/962da8ba-cb8b-4738-a1e7-33396d02214d-sys-fs\") pod \"aws-ebs-csi-driver-node-ntmp4\" (UID: \"962da8ba-cb8b-4738-a1e7-33396d02214d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ntmp4" Jul 01 19:11:36.022493 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.021322 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/985e214f-29e2-4f45-b382-37fd0376ef7b-host-var-lib-cni-multus\") pod \"multus-n8h95\" (UID: \"985e214f-29e2-4f45-b382-37fd0376ef7b\") " pod="openshift-multus/multus-n8h95" Jul 01 19:11:36.022493 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.021350 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8747f708-8d08-4b9b-a6f5-5f6a637ed029-host\") pod \"node-ca-5bfhm\" (UID: \"8747f708-8d08-4b9b-a6f5-5f6a637ed029\") " pod="openshift-image-registry/node-ca-5bfhm" Jul 01 19:11:36.022493 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.021402 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/985e214f-29e2-4f45-b382-37fd0376ef7b-multus-cni-dir\") pod \"multus-n8h95\" (UID: \"985e214f-29e2-4f45-b382-37fd0376ef7b\") " pod="openshift-multus/multus-n8h95" Jul 01 19:11:36.022493 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.021444 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/962da8ba-cb8b-4738-a1e7-33396d02214d-registration-dir\") pod \"aws-ebs-csi-driver-node-ntmp4\" (UID: \"962da8ba-cb8b-4738-a1e7-33396d02214d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ntmp4" Jul 01 19:11:36.022493 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.021517 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7329e3ea-d499-46e5-8c07-935a27d6ab99-dbus\") pod \"global-pull-secret-syncer-2x822\" (UID: \"7329e3ea-d499-46e5-8c07-935a27d6ab99\") " pod="kube-system/global-pull-secret-syncer-2x822" Jul 01 19:11:36.022493 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.021545 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4c7a0558-eff0-42a2-9769-49f2650c196d-host-slash\") pod \"iptables-alerter-gb8ld\" (UID: \"4c7a0558-eff0-42a2-9769-49f2650c196d\") " pod="openshift-network-operator/iptables-alerter-gb8ld" Jul 01 19:11:36.022493 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.021630 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7329e3ea-d499-46e5-8c07-935a27d6ab99-kubelet-config\") pod \"global-pull-secret-syncer-2x822\" (UID: \"7329e3ea-d499-46e5-8c07-935a27d6ab99\") " pod="kube-system/global-pull-secret-syncer-2x822" Jul 01 19:11:36.022493 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.021657 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/985e214f-29e2-4f45-b382-37fd0376ef7b-etc-kubernetes\") pod \"multus-n8h95\" (UID: \"985e214f-29e2-4f45-b382-37fd0376ef7b\") " pod="openshift-multus/multus-n8h95" Jul 01 19:11:36.022493 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.021698 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/985e214f-29e2-4f45-b382-37fd0376ef7b-host-var-lib-cni-bin\") pod \"multus-n8h95\" (UID: \"985e214f-29e2-4f45-b382-37fd0376ef7b\") " pod="openshift-multus/multus-n8h95" Jul 01 19:11:36.022493 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.021775 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8747f708-8d08-4b9b-a6f5-5f6a637ed029-serviceca\") pod \"node-ca-5bfhm\" (UID: \"8747f708-8d08-4b9b-a6f5-5f6a637ed029\") " pod="openshift-image-registry/node-ca-5bfhm" Jul 01 19:11:36.026383 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.026358 2561 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 01 19:11:36.027089 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:11:36.027067 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 19:11:36.027198 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:11:36.027094 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 19:11:36.027198 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:11:36.027106 2561 projected.go:196] Error preparing data for projected volume kube-api-access-p7pl6 for pod openshift-network-diagnostics/network-check-target-mv2pp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:11:36.027198 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:11:36.027177 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2ee3163e-709f-4909-a449-583e66fa3ce5-kube-api-access-p7pl6 podName:2ee3163e-709f-4909-a449-583e66fa3ce5 nodeName:}" failed. No retries permitted until 2026-07-01 19:11:36.527160222 +0000 UTC m=+3.035601026 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-p7pl6" (UniqueName: "kubernetes.io/projected/2ee3163e-709f-4909-a449-583e66fa3ce5-kube-api-access-p7pl6") pod "network-check-target-mv2pp" (UID: "2ee3163e-709f-4909-a449-583e66fa3ce5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:11:36.030161 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.030121 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wbznf\" (UniqueName: \"kubernetes.io/projected/4c7a0558-eff0-42a2-9769-49f2650c196d-kube-api-access-wbznf\") pod \"iptables-alerter-gb8ld\" (UID: \"4c7a0558-eff0-42a2-9769-49f2650c196d\") " pod="openshift-network-operator/iptables-alerter-gb8ld" Jul 01 19:11:36.030161 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.030136 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-chnks\" (UniqueName: \"kubernetes.io/projected/962da8ba-cb8b-4738-a1e7-33396d02214d-kube-api-access-chnks\") pod \"aws-ebs-csi-driver-node-ntmp4\" (UID: \"962da8ba-cb8b-4738-a1e7-33396d02214d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ntmp4" Jul 01 19:11:36.030342 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.030320 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmq27\" (UniqueName: \"kubernetes.io/projected/defe52c5-ead5-443a-a79e-6357cf3ce6f2-kube-api-access-mmq27\") pod \"node-resolver-rkh5s\" (UID: \"defe52c5-ead5-443a-a79e-6357cf3ce6f2\") " pod="openshift-dns/node-resolver-rkh5s" Jul 01 19:11:36.032686 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.032668 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mf77l\" (UniqueName: \"kubernetes.io/projected/8747f708-8d08-4b9b-a6f5-5f6a637ed029-kube-api-access-mf77l\") pod \"node-ca-5bfhm\" (UID: \"8747f708-8d08-4b9b-a6f5-5f6a637ed029\") " pod="openshift-image-registry/node-ca-5bfhm" Jul 01 19:11:36.032844 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.032820 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jk58q\" (UniqueName: \"kubernetes.io/projected/985e214f-29e2-4f45-b382-37fd0376ef7b-kube-api-access-jk58q\") pod \"multus-n8h95\" (UID: \"985e214f-29e2-4f45-b382-37fd0376ef7b\") " pod="openshift-multus/multus-n8h95" Jul 01 19:11:36.061348 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.061317 2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-wfmcb" Jul 01 19:11:36.072228 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.072195 2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-wfmcb" Jul 01 19:11:36.121700 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.121622 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6ee08291-b071-4a30-bd8a-c0208d7710b5-etc-modprobe-d\") pod \"tuned-6kt9r\" (UID: \"6ee08291-b071-4a30-bd8a-c0208d7710b5\") " pod="openshift-cluster-node-tuning-operator/tuned-6kt9r" Jul 01 19:11:36.121700 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.121659 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6ee08291-b071-4a30-bd8a-c0208d7710b5-etc-sysctl-conf\") pod \"tuned-6kt9r\" (UID: \"6ee08291-b071-4a30-bd8a-c0208d7710b5\") " pod="openshift-cluster-node-tuning-operator/tuned-6kt9r" Jul 01 19:11:36.121700 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.121684 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6ee08291-b071-4a30-bd8a-c0208d7710b5-sys\") pod \"tuned-6kt9r\" (UID: \"6ee08291-b071-4a30-bd8a-c0208d7710b5\") " pod="openshift-cluster-node-tuning-operator/tuned-6kt9r" Jul 01 19:11:36.121976 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.121707 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a30b203c-f4ce-4746-a763-ffde940c4276-metrics-certs\") pod \"network-metrics-daemon-smtsc\" (UID: \"a30b203c-f4ce-4746-a763-ffde940c4276\") " pod="openshift-multus/network-metrics-daemon-smtsc" Jul 01 19:11:36.121976 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.121731 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9315c387-a14c-4926-969a-64945926951e-host-run-ovn-kubernetes\") pod \"ovnkube-node-p4nbs\" (UID: \"9315c387-a14c-4926-969a-64945926951e\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4nbs" Jul 01 19:11:36.121976 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.121748 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5dd67e73-cf2f-4415-88d5-9e42762cb4d3-os-release\") pod \"multus-additional-cni-plugins-vcrsx\" (UID: \"5dd67e73-cf2f-4415-88d5-9e42762cb4d3\") " pod="openshift-multus/multus-additional-cni-plugins-vcrsx" Jul 01 19:11:36.121976 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.121785 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sn8r9\" (UniqueName: \"kubernetes.io/projected/a30b203c-f4ce-4746-a763-ffde940c4276-kube-api-access-sn8r9\") pod \"network-metrics-daemon-smtsc\" (UID: \"a30b203c-f4ce-4746-a763-ffde940c4276\") " pod="openshift-multus/network-metrics-daemon-smtsc" Jul 01 19:11:36.121976 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.121809 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9315c387-a14c-4926-969a-64945926951e-host-run-ovn-kubernetes\") pod \"ovnkube-node-p4nbs\" (UID: \"9315c387-a14c-4926-969a-64945926951e\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4nbs" Jul 01 19:11:36.121976 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.121823 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9315c387-a14c-4926-969a-64945926951e-ovnkube-script-lib\") pod \"ovnkube-node-p4nbs\" (UID: \"9315c387-a14c-4926-969a-64945926951e\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4nbs" Jul 01 19:11:36.121976 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.121833 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6ee08291-b071-4a30-bd8a-c0208d7710b5-etc-modprobe-d\") pod \"tuned-6kt9r\" (UID: \"6ee08291-b071-4a30-bd8a-c0208d7710b5\") " pod="openshift-cluster-node-tuning-operator/tuned-6kt9r" Jul 01 19:11:36.121976 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:11:36.121818 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:11:36.121976 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.121854 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9315c387-a14c-4926-969a-64945926951e-var-lib-openvswitch\") pod \"ovnkube-node-p4nbs\" (UID: \"9315c387-a14c-4926-969a-64945926951e\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4nbs" Jul 01 19:11:36.121976 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.121856 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5dd67e73-cf2f-4415-88d5-9e42762cb4d3-os-release\") pod \"multus-additional-cni-plugins-vcrsx\" (UID: \"5dd67e73-cf2f-4415-88d5-9e42762cb4d3\") " pod="openshift-multus/multus-additional-cni-plugins-vcrsx" Jul 01 19:11:36.121976 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:11:36.121915 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a30b203c-f4ce-4746-a763-ffde940c4276-metrics-certs podName:a30b203c-f4ce-4746-a763-ffde940c4276 nodeName:}" failed. No retries permitted until 2026-07-01 19:11:36.621893828 +0000 UTC m=+3.130334651 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a30b203c-f4ce-4746-a763-ffde940c4276-metrics-certs") pod "network-metrics-daemon-smtsc" (UID: "a30b203c-f4ce-4746-a763-ffde940c4276") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:11:36.121976 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.121981 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6ee08291-b071-4a30-bd8a-c0208d7710b5-etc-sysctl-conf\") pod \"tuned-6kt9r\" (UID: \"6ee08291-b071-4a30-bd8a-c0208d7710b5\") " pod="openshift-cluster-node-tuning-operator/tuned-6kt9r" Jul 01 19:11:36.122567 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.122026 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6ee08291-b071-4a30-bd8a-c0208d7710b5-sys\") pod \"tuned-6kt9r\" (UID: \"6ee08291-b071-4a30-bd8a-c0208d7710b5\") " pod="openshift-cluster-node-tuning-operator/tuned-6kt9r" Jul 01 19:11:36.122567 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.122056 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6ee08291-b071-4a30-bd8a-c0208d7710b5-etc-systemd\") pod \"tuned-6kt9r\" (UID: \"6ee08291-b071-4a30-bd8a-c0208d7710b5\") " pod="openshift-cluster-node-tuning-operator/tuned-6kt9r" Jul 01 19:11:36.122567 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.122073 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9315c387-a14c-4926-969a-64945926951e-var-lib-openvswitch\") pod \"ovnkube-node-p4nbs\" (UID: \"9315c387-a14c-4926-969a-64945926951e\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4nbs" Jul 01 19:11:36.122567 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.122085 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6ee08291-b071-4a30-bd8a-c0208d7710b5-run\") pod \"tuned-6kt9r\" (UID: \"6ee08291-b071-4a30-bd8a-c0208d7710b5\") " pod="openshift-cluster-node-tuning-operator/tuned-6kt9r" Jul 01 19:11:36.122567 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.122109 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6ee08291-b071-4a30-bd8a-c0208d7710b5-etc-systemd\") pod \"tuned-6kt9r\" (UID: \"6ee08291-b071-4a30-bd8a-c0208d7710b5\") " pod="openshift-cluster-node-tuning-operator/tuned-6kt9r" Jul 01 19:11:36.122567 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.122112 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5dd67e73-cf2f-4415-88d5-9e42762cb4d3-system-cni-dir\") pod \"multus-additional-cni-plugins-vcrsx\" (UID: \"5dd67e73-cf2f-4415-88d5-9e42762cb4d3\") " pod="openshift-multus/multus-additional-cni-plugins-vcrsx" Jul 01 19:11:36.122567 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.122141 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxgzh\" (UniqueName: \"kubernetes.io/projected/5dd67e73-cf2f-4415-88d5-9e42762cb4d3-kube-api-access-xxgzh\") pod \"multus-additional-cni-plugins-vcrsx\" (UID: \"5dd67e73-cf2f-4415-88d5-9e42762cb4d3\") " pod="openshift-multus/multus-additional-cni-plugins-vcrsx" Jul 01 19:11:36.122567 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.122147 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5dd67e73-cf2f-4415-88d5-9e42762cb4d3-system-cni-dir\") pod \"multus-additional-cni-plugins-vcrsx\" (UID: \"5dd67e73-cf2f-4415-88d5-9e42762cb4d3\") " pod="openshift-multus/multus-additional-cni-plugins-vcrsx" Jul 01 19:11:36.122567 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.122158 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6ee08291-b071-4a30-bd8a-c0208d7710b5-etc-sysconfig\") pod \"tuned-6kt9r\" (UID: \"6ee08291-b071-4a30-bd8a-c0208d7710b5\") " pod="openshift-cluster-node-tuning-operator/tuned-6kt9r" Jul 01 19:11:36.122567 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.122162 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6ee08291-b071-4a30-bd8a-c0208d7710b5-run\") pod \"tuned-6kt9r\" (UID: \"6ee08291-b071-4a30-bd8a-c0208d7710b5\") " pod="openshift-cluster-node-tuning-operator/tuned-6kt9r" Jul 01 19:11:36.122567 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.122173 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6ee08291-b071-4a30-bd8a-c0208d7710b5-tmp\") pod \"tuned-6kt9r\" (UID: \"6ee08291-b071-4a30-bd8a-c0208d7710b5\") " pod="openshift-cluster-node-tuning-operator/tuned-6kt9r" Jul 01 19:11:36.122567 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.122187 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9315c387-a14c-4926-969a-64945926951e-run-systemd\") pod \"ovnkube-node-p4nbs\" (UID: \"9315c387-a14c-4926-969a-64945926951e\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4nbs" Jul 01 19:11:36.122567 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.122202 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9315c387-a14c-4926-969a-64945926951e-host-cni-bin\") pod \"ovnkube-node-p4nbs\" (UID: \"9315c387-a14c-4926-969a-64945926951e\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4nbs" Jul 01 19:11:36.122567 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.122218 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6ee08291-b071-4a30-bd8a-c0208d7710b5-host\") pod \"tuned-6kt9r\" (UID: \"6ee08291-b071-4a30-bd8a-c0208d7710b5\") " pod="openshift-cluster-node-tuning-operator/tuned-6kt9r" Jul 01 19:11:36.122567 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.122220 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6ee08291-b071-4a30-bd8a-c0208d7710b5-etc-sysconfig\") pod \"tuned-6kt9r\" (UID: \"6ee08291-b071-4a30-bd8a-c0208d7710b5\") " pod="openshift-cluster-node-tuning-operator/tuned-6kt9r" Jul 01 19:11:36.122567 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.122231 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9315c387-a14c-4926-969a-64945926951e-ovnkube-config\") pod \"ovnkube-node-p4nbs\" (UID: \"9315c387-a14c-4926-969a-64945926951e\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4nbs" Jul 01 19:11:36.122567 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.122246 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9315c387-a14c-4926-969a-64945926951e-ovn-node-metrics-cert\") pod \"ovnkube-node-p4nbs\" (UID: \"9315c387-a14c-4926-969a-64945926951e\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4nbs" Jul 01 19:11:36.122567 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.122261 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9315c387-a14c-4926-969a-64945926951e-host-cni-bin\") pod \"ovnkube-node-p4nbs\" (UID: \"9315c387-a14c-4926-969a-64945926951e\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4nbs" Jul 01 19:11:36.123430 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.122268 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5dd67e73-cf2f-4415-88d5-9e42762cb4d3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vcrsx\" (UID: \"5dd67e73-cf2f-4415-88d5-9e42762cb4d3\") " pod="openshift-multus/multus-additional-cni-plugins-vcrsx" Jul 01 19:11:36.123430 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.122298 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6ee08291-b071-4a30-bd8a-c0208d7710b5-var-lib-kubelet\") pod \"tuned-6kt9r\" (UID: \"6ee08291-b071-4a30-bd8a-c0208d7710b5\") " pod="openshift-cluster-node-tuning-operator/tuned-6kt9r" Jul 01 19:11:36.123430 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.122326 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/193abea0-56eb-4a19-a2a1-6d72265b07e6-agent-certs\") pod \"konnectivity-agent-wqk2n\" (UID: \"193abea0-56eb-4a19-a2a1-6d72265b07e6\") " pod="kube-system/konnectivity-agent-wqk2n" Jul 01 19:11:36.123430 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.122350 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/193abea0-56eb-4a19-a2a1-6d72265b07e6-konnectivity-ca\") pod \"konnectivity-agent-wqk2n\" (UID: \"193abea0-56eb-4a19-a2a1-6d72265b07e6\") " pod="kube-system/konnectivity-agent-wqk2n" Jul 01 19:11:36.123430 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.122373 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5dd67e73-cf2f-4415-88d5-9e42762cb4d3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vcrsx\" (UID: \"5dd67e73-cf2f-4415-88d5-9e42762cb4d3\") " pod="openshift-multus/multus-additional-cni-plugins-vcrsx" Jul 01 19:11:36.123430 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.122375 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9315c387-a14c-4926-969a-64945926951e-host-run-netns\") pod \"ovnkube-node-p4nbs\" (UID: \"9315c387-a14c-4926-969a-64945926951e\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4nbs" Jul 01 19:11:36.123430 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.122394 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6ee08291-b071-4a30-bd8a-c0208d7710b5-var-lib-kubelet\") pod \"tuned-6kt9r\" (UID: \"6ee08291-b071-4a30-bd8a-c0208d7710b5\") " pod="openshift-cluster-node-tuning-operator/tuned-6kt9r" Jul 01 19:11:36.123430 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.122401 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6ee08291-b071-4a30-bd8a-c0208d7710b5-etc-sysctl-d\") pod \"tuned-6kt9r\" (UID: \"6ee08291-b071-4a30-bd8a-c0208d7710b5\") " pod="openshift-cluster-node-tuning-operator/tuned-6kt9r" Jul 01 19:11:36.123430 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.122404 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6ee08291-b071-4a30-bd8a-c0208d7710b5-host\") pod \"tuned-6kt9r\" (UID: \"6ee08291-b071-4a30-bd8a-c0208d7710b5\") " pod="openshift-cluster-node-tuning-operator/tuned-6kt9r" Jul 01 19:11:36.123430 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.122445 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9315c387-a14c-4926-969a-64945926951e-run-systemd\") pod \"ovnkube-node-p4nbs\" (UID: \"9315c387-a14c-4926-969a-64945926951e\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4nbs" Jul 01 19:11:36.123430 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.122474 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9315c387-a14c-4926-969a-64945926951e-host-slash\") pod \"ovnkube-node-p4nbs\" (UID: \"9315c387-a14c-4926-969a-64945926951e\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4nbs" Jul 01 19:11:36.123430 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.122513 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5dd67e73-cf2f-4415-88d5-9e42762cb4d3-cnibin\") pod \"multus-additional-cni-plugins-vcrsx\" (UID: \"5dd67e73-cf2f-4415-88d5-9e42762cb4d3\") " pod="openshift-multus/multus-additional-cni-plugins-vcrsx" Jul 01 19:11:36.123430 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.122512 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9315c387-a14c-4926-969a-64945926951e-ovnkube-script-lib\") pod \"ovnkube-node-p4nbs\" (UID: \"9315c387-a14c-4926-969a-64945926951e\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4nbs" Jul 01 19:11:36.123430 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.122548 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9315c387-a14c-4926-969a-64945926951e-host-slash\") pod \"ovnkube-node-p4nbs\" (UID: \"9315c387-a14c-4926-969a-64945926951e\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4nbs" Jul 01 19:11:36.123430 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.122566 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5dd67e73-cf2f-4415-88d5-9e42762cb4d3-cnibin\") pod \"multus-additional-cni-plugins-vcrsx\" (UID: \"5dd67e73-cf2f-4415-88d5-9e42762cb4d3\") " pod="openshift-multus/multus-additional-cni-plugins-vcrsx" Jul 01 19:11:36.123430 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.122577 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5dd67e73-cf2f-4415-88d5-9e42762cb4d3-cni-binary-copy\") pod \"multus-additional-cni-plugins-vcrsx\" (UID: \"5dd67e73-cf2f-4415-88d5-9e42762cb4d3\") " pod="openshift-multus/multus-additional-cni-plugins-vcrsx" Jul 01 19:11:36.123430 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.122601 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6ee08291-b071-4a30-bd8a-c0208d7710b5-etc-tuned\") pod \"tuned-6kt9r\" (UID: \"6ee08291-b071-4a30-bd8a-c0208d7710b5\") " pod="openshift-cluster-node-tuning-operator/tuned-6kt9r" Jul 01 19:11:36.124236 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.122605 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9315c387-a14c-4926-969a-64945926951e-host-run-netns\") pod \"ovnkube-node-p4nbs\" (UID: \"9315c387-a14c-4926-969a-64945926951e\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4nbs" Jul 01 19:11:36.124236 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.122630 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9315c387-a14c-4926-969a-64945926951e-host-kubelet\") pod \"ovnkube-node-p4nbs\" (UID: \"9315c387-a14c-4926-969a-64945926951e\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4nbs" Jul 01 19:11:36.124236 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.122656 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9315c387-a14c-4926-969a-64945926951e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-p4nbs\" (UID: \"9315c387-a14c-4926-969a-64945926951e\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4nbs" Jul 01 19:11:36.124236 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.122683 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9t28\" (UniqueName: \"kubernetes.io/projected/9315c387-a14c-4926-969a-64945926951e-kube-api-access-p9t28\") pod \"ovnkube-node-p4nbs\" (UID: \"9315c387-a14c-4926-969a-64945926951e\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4nbs" Jul 01 19:11:36.124236 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.122722 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6ee08291-b071-4a30-bd8a-c0208d7710b5-lib-modules\") pod \"tuned-6kt9r\" (UID: \"6ee08291-b071-4a30-bd8a-c0208d7710b5\") " pod="openshift-cluster-node-tuning-operator/tuned-6kt9r" Jul 01 19:11:36.124236 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.122747 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5dd67e73-cf2f-4415-88d5-9e42762cb4d3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vcrsx\" (UID: \"5dd67e73-cf2f-4415-88d5-9e42762cb4d3\") " pod="openshift-multus/multus-additional-cni-plugins-vcrsx" Jul 01 19:11:36.124236 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.122773 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9315c387-a14c-4926-969a-64945926951e-systemd-units\") pod \"ovnkube-node-p4nbs\" (UID: \"9315c387-a14c-4926-969a-64945926951e\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4nbs" Jul 01 19:11:36.124236 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.122788 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9315c387-a14c-4926-969a-64945926951e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-p4nbs\" (UID: \"9315c387-a14c-4926-969a-64945926951e\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4nbs" Jul 01 19:11:36.124236 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.122797 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9315c387-a14c-4926-969a-64945926951e-host-cni-netd\") pod \"ovnkube-node-p4nbs\" (UID: \"9315c387-a14c-4926-969a-64945926951e\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4nbs" Jul 01 19:11:36.124236 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.122843 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9315c387-a14c-4926-969a-64945926951e-host-kubelet\") pod \"ovnkube-node-p4nbs\" (UID: \"9315c387-a14c-4926-969a-64945926951e\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4nbs" Jul 01 19:11:36.124236 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.122827 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9315c387-a14c-4926-969a-64945926951e-node-log\") pod \"ovnkube-node-p4nbs\" (UID: \"9315c387-a14c-4926-969a-64945926951e\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4nbs" Jul 01 19:11:36.124236 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.122877 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9315c387-a14c-4926-969a-64945926951e-env-overrides\") pod \"ovnkube-node-p4nbs\" (UID: \"9315c387-a14c-4926-969a-64945926951e\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4nbs" Jul 01 19:11:36.124236 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.122904 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5dd67e73-cf2f-4415-88d5-9e42762cb4d3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vcrsx\" (UID: \"5dd67e73-cf2f-4415-88d5-9e42762cb4d3\") " pod="openshift-multus/multus-additional-cni-plugins-vcrsx" Jul 01 19:11:36.124236 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.122926 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6ee08291-b071-4a30-bd8a-c0208d7710b5-etc-kubernetes\") pod \"tuned-6kt9r\" (UID: \"6ee08291-b071-4a30-bd8a-c0208d7710b5\") " pod="openshift-cluster-node-tuning-operator/tuned-6kt9r" Jul 01 19:11:36.124236 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.122969 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9315c387-a14c-4926-969a-64945926951e-run-ovn\") pod \"ovnkube-node-p4nbs\" (UID: \"9315c387-a14c-4926-969a-64945926951e\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4nbs" Jul 01 19:11:36.124236 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.122996 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzbkg\" (UniqueName: \"kubernetes.io/projected/6ee08291-b071-4a30-bd8a-c0208d7710b5-kube-api-access-nzbkg\") pod \"tuned-6kt9r\" (UID: \"6ee08291-b071-4a30-bd8a-c0208d7710b5\") " pod="openshift-cluster-node-tuning-operator/tuned-6kt9r" Jul 01 19:11:36.124236 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.123019 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9315c387-a14c-4926-969a-64945926951e-etc-openvswitch\") pod \"ovnkube-node-p4nbs\" (UID: \"9315c387-a14c-4926-969a-64945926951e\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4nbs" Jul 01 19:11:36.125033 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.123043 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9315c387-a14c-4926-969a-64945926951e-run-openvswitch\") pod \"ovnkube-node-p4nbs\" (UID: \"9315c387-a14c-4926-969a-64945926951e\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4nbs" Jul 01 19:11:36.125033 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.123066 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9315c387-a14c-4926-969a-64945926951e-log-socket\") pod \"ovnkube-node-p4nbs\" (UID: \"9315c387-a14c-4926-969a-64945926951e\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4nbs" Jul 01 19:11:36.125033 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.123141 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9315c387-a14c-4926-969a-64945926951e-log-socket\") pod \"ovnkube-node-p4nbs\" (UID: \"9315c387-a14c-4926-969a-64945926951e\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4nbs" Jul 01 19:11:36.125033 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.123182 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9315c387-a14c-4926-969a-64945926951e-systemd-units\") pod \"ovnkube-node-p4nbs\" (UID: \"9315c387-a14c-4926-969a-64945926951e\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4nbs" Jul 01 19:11:36.125033 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.123219 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9315c387-a14c-4926-969a-64945926951e-host-cni-netd\") pod \"ovnkube-node-p4nbs\" (UID: \"9315c387-a14c-4926-969a-64945926951e\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4nbs" Jul 01 19:11:36.125033 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.123263 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9315c387-a14c-4926-969a-64945926951e-node-log\") pod \"ovnkube-node-p4nbs\" (UID: \"9315c387-a14c-4926-969a-64945926951e\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4nbs" Jul 01 19:11:36.125033 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.123324 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/193abea0-56eb-4a19-a2a1-6d72265b07e6-konnectivity-ca\") pod \"konnectivity-agent-wqk2n\" (UID: \"193abea0-56eb-4a19-a2a1-6d72265b07e6\") " pod="kube-system/konnectivity-agent-wqk2n" Jul 01 19:11:36.125033 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.123419 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5dd67e73-cf2f-4415-88d5-9e42762cb4d3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vcrsx\" (UID: \"5dd67e73-cf2f-4415-88d5-9e42762cb4d3\") " pod="openshift-multus/multus-additional-cni-plugins-vcrsx" Jul 01 19:11:36.125033 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.123647 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9315c387-a14c-4926-969a-64945926951e-env-overrides\") pod \"ovnkube-node-p4nbs\" (UID: \"9315c387-a14c-4926-969a-64945926951e\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4nbs" Jul 01 19:11:36.125033 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.123729 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6ee08291-b071-4a30-bd8a-c0208d7710b5-lib-modules\") pod \"tuned-6kt9r\" (UID: \"6ee08291-b071-4a30-bd8a-c0208d7710b5\") " pod="openshift-cluster-node-tuning-operator/tuned-6kt9r" Jul 01 19:11:36.125033 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.123793 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5dd67e73-cf2f-4415-88d5-9e42762cb4d3-cni-binary-copy\") pod \"multus-additional-cni-plugins-vcrsx\" (UID: \"5dd67e73-cf2f-4415-88d5-9e42762cb4d3\") " pod="openshift-multus/multus-additional-cni-plugins-vcrsx" Jul 01 19:11:36.125033 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.123927 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6ee08291-b071-4a30-bd8a-c0208d7710b5-etc-sysctl-d\") pod \"tuned-6kt9r\" (UID: \"6ee08291-b071-4a30-bd8a-c0208d7710b5\") " pod="openshift-cluster-node-tuning-operator/tuned-6kt9r" Jul 01 19:11:36.125033 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.123974 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6ee08291-b071-4a30-bd8a-c0208d7710b5-etc-kubernetes\") pod \"tuned-6kt9r\" (UID: \"6ee08291-b071-4a30-bd8a-c0208d7710b5\") " pod="openshift-cluster-node-tuning-operator/tuned-6kt9r" Jul 01 19:11:36.125033 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.123991 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9315c387-a14c-4926-969a-64945926951e-run-ovn\") pod \"ovnkube-node-p4nbs\" (UID: \"9315c387-a14c-4926-969a-64945926951e\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4nbs" Jul 01 19:11:36.125033 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.124024 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9315c387-a14c-4926-969a-64945926951e-etc-openvswitch\") pod \"ovnkube-node-p4nbs\" (UID: \"9315c387-a14c-4926-969a-64945926951e\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4nbs" Jul 01 19:11:36.125033 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.124038 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9315c387-a14c-4926-969a-64945926951e-run-openvswitch\") pod \"ovnkube-node-p4nbs\" (UID: \"9315c387-a14c-4926-969a-64945926951e\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4nbs" Jul 01 19:11:36.125033 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.124105 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5dd67e73-cf2f-4415-88d5-9e42762cb4d3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vcrsx\" (UID: \"5dd67e73-cf2f-4415-88d5-9e42762cb4d3\") " pod="openshift-multus/multus-additional-cni-plugins-vcrsx" Jul 01 19:11:36.125910 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.124538 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9315c387-a14c-4926-969a-64945926951e-ovnkube-config\") pod \"ovnkube-node-p4nbs\" (UID: \"9315c387-a14c-4926-969a-64945926951e\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4nbs" Jul 01 19:11:36.125910 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.124837 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6ee08291-b071-4a30-bd8a-c0208d7710b5-etc-tuned\") pod \"tuned-6kt9r\" (UID: \"6ee08291-b071-4a30-bd8a-c0208d7710b5\") " pod="openshift-cluster-node-tuning-operator/tuned-6kt9r" Jul 01 19:11:36.125910 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.124985 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6ee08291-b071-4a30-bd8a-c0208d7710b5-tmp\") pod \"tuned-6kt9r\" (UID: \"6ee08291-b071-4a30-bd8a-c0208d7710b5\") " pod="openshift-cluster-node-tuning-operator/tuned-6kt9r" Jul 01 19:11:36.125910 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.125096 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9315c387-a14c-4926-969a-64945926951e-ovn-node-metrics-cert\") pod \"ovnkube-node-p4nbs\" (UID: \"9315c387-a14c-4926-969a-64945926951e\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4nbs" Jul 01 19:11:36.126581 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.126564 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/193abea0-56eb-4a19-a2a1-6d72265b07e6-agent-certs\") pod \"konnectivity-agent-wqk2n\" (UID: \"193abea0-56eb-4a19-a2a1-6d72265b07e6\") " pod="kube-system/konnectivity-agent-wqk2n" Jul 01 19:11:36.133181 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.133157 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sn8r9\" (UniqueName: \"kubernetes.io/projected/a30b203c-f4ce-4746-a763-ffde940c4276-kube-api-access-sn8r9\") pod \"network-metrics-daemon-smtsc\" (UID: \"a30b203c-f4ce-4746-a763-ffde940c4276\") " pod="openshift-multus/network-metrics-daemon-smtsc" Jul 01 19:11:36.133276 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.133185 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxgzh\" (UniqueName: \"kubernetes.io/projected/5dd67e73-cf2f-4415-88d5-9e42762cb4d3-kube-api-access-xxgzh\") pod \"multus-additional-cni-plugins-vcrsx\" (UID: \"5dd67e73-cf2f-4415-88d5-9e42762cb4d3\") " pod="openshift-multus/multus-additional-cni-plugins-vcrsx" Jul 01 19:11:36.134411 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.134395 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9t28\" (UniqueName: \"kubernetes.io/projected/9315c387-a14c-4926-969a-64945926951e-kube-api-access-p9t28\") pod \"ovnkube-node-p4nbs\" (UID: \"9315c387-a14c-4926-969a-64945926951e\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4nbs" Jul 01 19:11:36.136221 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.136204 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzbkg\" (UniqueName: \"kubernetes.io/projected/6ee08291-b071-4a30-bd8a-c0208d7710b5-kube-api-access-nzbkg\") pod \"tuned-6kt9r\" (UID: \"6ee08291-b071-4a30-bd8a-c0208d7710b5\") " pod="openshift-cluster-node-tuning-operator/tuned-6kt9r" Jul 01 19:11:36.212780 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.212748 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-gb8ld" Jul 01 19:11:36.222171 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.222149 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ntmp4" Jul 01 19:11:36.233429 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.233409 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-rkh5s" Jul 01 19:11:36.238370 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.238347 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-5bfhm" Jul 01 19:11:36.245324 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.245309 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-n8h95" Jul 01 19:11:36.253268 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.253252 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-vcrsx" Jul 01 19:11:36.261987 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.261969 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-wqk2n" Jul 01 19:11:36.269687 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.269666 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-p4nbs" Jul 01 19:11:36.274910 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.274892 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-6kt9r" Jul 01 19:11:36.358258 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.358232 2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 19:11:36.525503 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.525413 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7329e3ea-d499-46e5-8c07-935a27d6ab99-original-pull-secret\") pod \"global-pull-secret-syncer-2x822\" (UID: \"7329e3ea-d499-46e5-8c07-935a27d6ab99\") " pod="kube-system/global-pull-secret-syncer-2x822" Jul 01 19:11:36.525666 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:11:36.525585 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 19:11:36.525728 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:11:36.525673 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7329e3ea-d499-46e5-8c07-935a27d6ab99-original-pull-secret podName:7329e3ea-d499-46e5-8c07-935a27d6ab99 nodeName:}" failed. No retries permitted until 2026-07-01 19:11:37.525654118 +0000 UTC m=+4.034094949 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7329e3ea-d499-46e5-8c07-935a27d6ab99-original-pull-secret") pod "global-pull-secret-syncer-2x822" (UID: "7329e3ea-d499-46e5-8c07-935a27d6ab99") : object "kube-system"/"original-pull-secret" not registered Jul 01 19:11:36.626166 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.626119 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7pl6\" (UniqueName: \"kubernetes.io/projected/2ee3163e-709f-4909-a449-583e66fa3ce5-kube-api-access-p7pl6\") pod \"network-check-target-mv2pp\" (UID: \"2ee3163e-709f-4909-a449-583e66fa3ce5\") " pod="openshift-network-diagnostics/network-check-target-mv2pp" Jul 01 19:11:36.626342 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.626189 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a30b203c-f4ce-4746-a763-ffde940c4276-metrics-certs\") pod \"network-metrics-daemon-smtsc\" (UID: \"a30b203c-f4ce-4746-a763-ffde940c4276\") " pod="openshift-multus/network-metrics-daemon-smtsc" Jul 01 19:11:36.626342 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:11:36.626308 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:11:36.626450 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:11:36.626378 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a30b203c-f4ce-4746-a763-ffde940c4276-metrics-certs podName:a30b203c-f4ce-4746-a763-ffde940c4276 nodeName:}" failed. No retries permitted until 2026-07-01 19:11:37.626362596 +0000 UTC m=+4.134803419 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a30b203c-f4ce-4746-a763-ffde940c4276-metrics-certs") pod "network-metrics-daemon-smtsc" (UID: "a30b203c-f4ce-4746-a763-ffde940c4276") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:11:36.626450 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:11:36.626312 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 19:11:36.626450 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:11:36.626417 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 19:11:36.626450 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:11:36.626431 2561 projected.go:196] Error preparing data for projected volume kube-api-access-p7pl6 for pod openshift-network-diagnostics/network-check-target-mv2pp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:11:36.626646 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:11:36.626499 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2ee3163e-709f-4909-a449-583e66fa3ce5-kube-api-access-p7pl6 podName:2ee3163e-709f-4909-a449-583e66fa3ce5 nodeName:}" failed. No retries permitted until 2026-07-01 19:11:37.626462443 +0000 UTC m=+4.134903267 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-p7pl6" (UniqueName: "kubernetes.io/projected/2ee3163e-709f-4909-a449-583e66fa3ce5-kube-api-access-p7pl6") pod "network-check-target-mv2pp" (UID: "2ee3163e-709f-4909-a449-583e66fa3ce5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:11:36.779545 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:36.779502 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8747f708_8d08_4b9b_a6f5_5f6a637ed029.slice/crio-579f19b4e9188b1b8bcd895e9f9e861642060f28df67de1abd63a430132b24cd WatchSource:0}: Error finding container 579f19b4e9188b1b8bcd895e9f9e861642060f28df67de1abd63a430132b24cd: Status 404 returned error can't find the container with id 579f19b4e9188b1b8bcd895e9f9e861642060f28df67de1abd63a430132b24cd Jul 01 19:11:36.780967 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:36.780931 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ee08291_b071_4a30_bd8a_c0208d7710b5.slice/crio-07ebb23e1cdda0947f67d86cb2aa874a0a1642f13271ddee9aa887c43c7ede99 WatchSource:0}: Error finding container 07ebb23e1cdda0947f67d86cb2aa874a0a1642f13271ddee9aa887c43c7ede99: Status 404 returned error can't find the container with id 07ebb23e1cdda0947f67d86cb2aa874a0a1642f13271ddee9aa887c43c7ede99 Jul 01 19:11:36.781581 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:36.781459 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod193abea0_56eb_4a19_a2a1_6d72265b07e6.slice/crio-0452d0b48cb1b1bf6bd2e8a53ce15c9e09a3bed393df8b6f6d044f653dab43a4 WatchSource:0}: Error finding container 0452d0b48cb1b1bf6bd2e8a53ce15c9e09a3bed393df8b6f6d044f653dab43a4: Status 404 returned error can't find the container with id 0452d0b48cb1b1bf6bd2e8a53ce15c9e09a3bed393df8b6f6d044f653dab43a4 Jul 01 19:11:36.784820 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:36.784771 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod962da8ba_cb8b_4738_a1e7_33396d02214d.slice/crio-46c5d9c57010275d8caf1f063ba23a9f578f149719cfcef597bb0bf9c31e77e0 WatchSource:0}: Error finding container 46c5d9c57010275d8caf1f063ba23a9f578f149719cfcef597bb0bf9c31e77e0: Status 404 returned error can't find the container with id 46c5d9c57010275d8caf1f063ba23a9f578f149719cfcef597bb0bf9c31e77e0 Jul 01 19:11:36.788032 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:36.788010 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5dd67e73_cf2f_4415_88d5_9e42762cb4d3.slice/crio-6ae2cc25e234b8cc3d69be03f456577985fa6c690bd4d22bd930d59fb1d1efb0 WatchSource:0}: Error finding container 6ae2cc25e234b8cc3d69be03f456577985fa6c690bd4d22bd930d59fb1d1efb0: Status 404 returned error can't find the container with id 6ae2cc25e234b8cc3d69be03f456577985fa6c690bd4d22bd930d59fb1d1efb0 Jul 01 19:11:36.789307 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:36.789282 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod985e214f_29e2_4f45_b382_37fd0376ef7b.slice/crio-00c2b359586f6dc901472d77845a9036518324e34b267f5dbfe38394c41f3ed7 WatchSource:0}: Error finding container 00c2b359586f6dc901472d77845a9036518324e34b267f5dbfe38394c41f3ed7: Status 404 returned error can't find the container with id 00c2b359586f6dc901472d77845a9036518324e34b267f5dbfe38394c41f3ed7 Jul 01 19:11:36.790543 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:36.790463 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c7a0558_eff0_42a2_9769_49f2650c196d.slice/crio-bc8bdaaace0982cfa4401f5655ccd934650bcf3bff950ebb5a4f16994c329a25 WatchSource:0}: Error finding container bc8bdaaace0982cfa4401f5655ccd934650bcf3bff950ebb5a4f16994c329a25: Status 404 returned error can't find the container with id bc8bdaaace0982cfa4401f5655ccd934650bcf3bff950ebb5a4f16994c329a25 Jul 01 19:11:36.791213 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:11:36.791171 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddefe52c5_ead5_443a_a79e_6357cf3ce6f2.slice/crio-485c3c7c1bb561fb1ab16469dea3064c4e04b8334d1b5c5811c3ae362c03e737 WatchSource:0}: Error finding container 485c3c7c1bb561fb1ab16469dea3064c4e04b8334d1b5c5811c3ae362c03e737: Status 404 returned error can't find the container with id 485c3c7c1bb561fb1ab16469dea3064c4e04b8334d1b5c5811c3ae362c03e737 Jul 01 19:11:36.972482 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.972301 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mv2pp" Jul 01 19:11:36.973201 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.972373 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2x822" Jul 01 19:11:36.973201 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:11:36.972560 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mv2pp" podUID="2ee3163e-709f-4909-a449-583e66fa3ce5" Jul 01 19:11:36.973201 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:11:36.972634 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2x822" podUID="7329e3ea-d499-46e5-8c07-935a27d6ab99" Jul 01 19:11:36.979750 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.979720 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-gb8ld" event={"ID":"4c7a0558-eff0-42a2-9769-49f2650c196d","Type":"ContainerStarted","Data":"bc8bdaaace0982cfa4401f5655ccd934650bcf3bff950ebb5a4f16994c329a25"} Jul 01 19:11:36.980899 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.980867 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-n8h95" event={"ID":"985e214f-29e2-4f45-b382-37fd0376ef7b","Type":"ContainerStarted","Data":"00c2b359586f6dc901472d77845a9036518324e34b267f5dbfe38394c41f3ed7"} Jul 01 19:11:36.981919 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.981900 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ntmp4" event={"ID":"962da8ba-cb8b-4738-a1e7-33396d02214d","Type":"ContainerStarted","Data":"46c5d9c57010275d8caf1f063ba23a9f578f149719cfcef597bb0bf9c31e77e0"} Jul 01 19:11:36.982991 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.982966 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vcrsx" event={"ID":"5dd67e73-cf2f-4415-88d5-9e42762cb4d3","Type":"ContainerStarted","Data":"6ae2cc25e234b8cc3d69be03f456577985fa6c690bd4d22bd930d59fb1d1efb0"} Jul 01 19:11:36.984058 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.984039 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-6kt9r" event={"ID":"6ee08291-b071-4a30-bd8a-c0208d7710b5","Type":"ContainerStarted","Data":"07ebb23e1cdda0947f67d86cb2aa874a0a1642f13271ddee9aa887c43c7ede99"} Jul 01 19:11:36.985113 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.985086 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-5bfhm" event={"ID":"8747f708-8d08-4b9b-a6f5-5f6a637ed029","Type":"ContainerStarted","Data":"579f19b4e9188b1b8bcd895e9f9e861642060f28df67de1abd63a430132b24cd"} Jul 01 19:11:36.987011 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.986986 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-184.ec2.internal" event={"ID":"66ca3bff8df40f7aecc6da1d0afc4ccd","Type":"ContainerStarted","Data":"741f659a4b0387823815888c2d43ae5d6fb5e7a472a8861db17eb8a33db8ac88"} Jul 01 19:11:36.988077 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.988056 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p4nbs" event={"ID":"9315c387-a14c-4926-969a-64945926951e","Type":"ContainerStarted","Data":"c616e384b8af9677e26dd6668d4de31bb56d30d736bd684c2128ef6b3a8269e4"} Jul 01 19:11:36.989125 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.989106 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-rkh5s" event={"ID":"defe52c5-ead5-443a-a79e-6357cf3ce6f2","Type":"ContainerStarted","Data":"485c3c7c1bb561fb1ab16469dea3064c4e04b8334d1b5c5811c3ae362c03e737"} Jul 01 19:11:36.991455 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.991439 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-wqk2n" event={"ID":"193abea0-56eb-4a19-a2a1-6d72265b07e6","Type":"ContainerStarted","Data":"0452d0b48cb1b1bf6bd2e8a53ce15c9e09a3bed393df8b6f6d044f653dab43a4"} Jul 01 19:11:36.999926 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:36.999878 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-184.ec2.internal" podStartSLOduration=1.999866342 podStartE2EDuration="1.999866342s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:11:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:11:36.999849838 +0000 UTC m=+3.508290677" watchObservedRunningTime="2026-07-01 19:11:36.999866342 +0000 UTC m=+3.508307168" Jul 01 19:11:37.074486 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:37.074422 2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-30 19:06:36 +0000 UTC" deadline="2028-01-16 01:37:17.124105365 +0000 UTC" Jul 01 19:11:37.074486 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:37.074475 2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13518h25m40.04963475s" Jul 01 19:11:37.533805 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:37.533770 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7329e3ea-d499-46e5-8c07-935a27d6ab99-original-pull-secret\") pod \"global-pull-secret-syncer-2x822\" (UID: \"7329e3ea-d499-46e5-8c07-935a27d6ab99\") " pod="kube-system/global-pull-secret-syncer-2x822" Jul 01 19:11:37.533986 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:11:37.533966 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 19:11:37.534062 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:11:37.534029 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7329e3ea-d499-46e5-8c07-935a27d6ab99-original-pull-secret podName:7329e3ea-d499-46e5-8c07-935a27d6ab99 nodeName:}" failed. No retries permitted until 2026-07-01 19:11:39.534010704 +0000 UTC m=+6.042451528 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7329e3ea-d499-46e5-8c07-935a27d6ab99-original-pull-secret") pod "global-pull-secret-syncer-2x822" (UID: "7329e3ea-d499-46e5-8c07-935a27d6ab99") : object "kube-system"/"original-pull-secret" not registered Jul 01 19:11:37.634428 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:37.634367 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a30b203c-f4ce-4746-a763-ffde940c4276-metrics-certs\") pod \"network-metrics-daemon-smtsc\" (UID: \"a30b203c-f4ce-4746-a763-ffde940c4276\") " pod="openshift-multus/network-metrics-daemon-smtsc" Jul 01 19:11:37.634428 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:37.634453 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7pl6\" (UniqueName: \"kubernetes.io/projected/2ee3163e-709f-4909-a449-583e66fa3ce5-kube-api-access-p7pl6\") pod \"network-check-target-mv2pp\" (UID: \"2ee3163e-709f-4909-a449-583e66fa3ce5\") " pod="openshift-network-diagnostics/network-check-target-mv2pp" Jul 01 19:11:37.634766 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:11:37.634597 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 19:11:37.634766 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:11:37.634617 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 19:11:37.634766 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:11:37.634629 2561 projected.go:196] Error preparing data for projected volume kube-api-access-p7pl6 for pod openshift-network-diagnostics/network-check-target-mv2pp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:11:37.634766 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:11:37.634683 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2ee3163e-709f-4909-a449-583e66fa3ce5-kube-api-access-p7pl6 podName:2ee3163e-709f-4909-a449-583e66fa3ce5 nodeName:}" failed. No retries permitted until 2026-07-01 19:11:39.634666844 +0000 UTC m=+6.143107667 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-p7pl6" (UniqueName: "kubernetes.io/projected/2ee3163e-709f-4909-a449-583e66fa3ce5-kube-api-access-p7pl6") pod "network-check-target-mv2pp" (UID: "2ee3163e-709f-4909-a449-583e66fa3ce5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:11:37.635116 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:11:37.635083 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:11:37.635193 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:11:37.635138 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a30b203c-f4ce-4746-a763-ffde940c4276-metrics-certs podName:a30b203c-f4ce-4746-a763-ffde940c4276 nodeName:}" failed. No retries permitted until 2026-07-01 19:11:39.635122675 +0000 UTC m=+6.143563501 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a30b203c-f4ce-4746-a763-ffde940c4276-metrics-certs") pod "network-metrics-daemon-smtsc" (UID: "a30b203c-f4ce-4746-a763-ffde940c4276") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:11:37.972015 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:37.971932 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-smtsc" Jul 01 19:11:37.972165 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:11:37.972103 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-smtsc" podUID="a30b203c-f4ce-4746-a763-ffde940c4276" Jul 01 19:11:38.007535 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:38.007494 2561 generic.go:356] "Generic (PLEG): container finished" podID="2653e56ffabcf512a6490e9fddefd621" containerID="6148033933a10eec1a210ae32a91f3f17002a5f87807884a1cca6e02409b56de" exitCode=0 Jul 01 19:11:38.008186 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:38.008121 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-184.ec2.internal" event={"ID":"2653e56ffabcf512a6490e9fddefd621","Type":"ContainerDied","Data":"6148033933a10eec1a210ae32a91f3f17002a5f87807884a1cca6e02409b56de"} Jul 01 19:11:38.074719 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:38.074634 2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-30 19:06:36 +0000 UTC" deadline="2028-01-30 15:43:30.303294003 +0000 UTC" Jul 01 19:11:38.074719 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:38.074676 2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13868h31m52.228622676s" Jul 01 19:11:38.972880 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:38.972300 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2x822" Jul 01 19:11:38.972880 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:11:38.972428 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2x822" podUID="7329e3ea-d499-46e5-8c07-935a27d6ab99" Jul 01 19:11:38.972880 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:38.972300 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mv2pp" Jul 01 19:11:38.972880 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:11:38.972832 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mv2pp" podUID="2ee3163e-709f-4909-a449-583e66fa3ce5" Jul 01 19:11:39.029983 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:39.029876 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-184.ec2.internal" event={"ID":"2653e56ffabcf512a6490e9fddefd621","Type":"ContainerStarted","Data":"21e6c4f1e99ebc427f5f2c73f8998f6bc46948fb11a29dd48d489d4eabebd89d"} Jul 01 19:11:39.046276 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:39.046222 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-184.ec2.internal" podStartSLOduration=4.046201766 podStartE2EDuration="4.046201766s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:11:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:11:39.045539786 +0000 UTC m=+5.553980613" watchObservedRunningTime="2026-07-01 19:11:39.046201766 +0000 UTC m=+5.554642595" Jul 01 19:11:39.553967 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:39.553885 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7329e3ea-d499-46e5-8c07-935a27d6ab99-original-pull-secret\") pod \"global-pull-secret-syncer-2x822\" (UID: \"7329e3ea-d499-46e5-8c07-935a27d6ab99\") " pod="kube-system/global-pull-secret-syncer-2x822" Jul 01 19:11:39.554144 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:11:39.554122 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 19:11:39.554196 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:11:39.554187 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7329e3ea-d499-46e5-8c07-935a27d6ab99-original-pull-secret podName:7329e3ea-d499-46e5-8c07-935a27d6ab99 nodeName:}" failed. No retries permitted until 2026-07-01 19:11:43.554170224 +0000 UTC m=+10.062611053 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7329e3ea-d499-46e5-8c07-935a27d6ab99-original-pull-secret") pod "global-pull-secret-syncer-2x822" (UID: "7329e3ea-d499-46e5-8c07-935a27d6ab99") : object "kube-system"/"original-pull-secret" not registered Jul 01 19:11:39.656083 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:39.655254 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7pl6\" (UniqueName: \"kubernetes.io/projected/2ee3163e-709f-4909-a449-583e66fa3ce5-kube-api-access-p7pl6\") pod \"network-check-target-mv2pp\" (UID: \"2ee3163e-709f-4909-a449-583e66fa3ce5\") " pod="openshift-network-diagnostics/network-check-target-mv2pp" Jul 01 19:11:39.656083 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:39.655321 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a30b203c-f4ce-4746-a763-ffde940c4276-metrics-certs\") pod \"network-metrics-daemon-smtsc\" (UID: \"a30b203c-f4ce-4746-a763-ffde940c4276\") " pod="openshift-multus/network-metrics-daemon-smtsc" Jul 01 19:11:39.656083 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:11:39.655472 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:11:39.656083 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:11:39.655534 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a30b203c-f4ce-4746-a763-ffde940c4276-metrics-certs podName:a30b203c-f4ce-4746-a763-ffde940c4276 nodeName:}" failed. No retries permitted until 2026-07-01 19:11:43.655515751 +0000 UTC m=+10.163956576 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a30b203c-f4ce-4746-a763-ffde940c4276-metrics-certs") pod "network-metrics-daemon-smtsc" (UID: "a30b203c-f4ce-4746-a763-ffde940c4276") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:11:39.656083 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:11:39.655924 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 19:11:39.656083 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:11:39.655947 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 19:11:39.656083 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:11:39.655975 2561 projected.go:196] Error preparing data for projected volume kube-api-access-p7pl6 for pod openshift-network-diagnostics/network-check-target-mv2pp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:11:39.656083 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:11:39.656029 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2ee3163e-709f-4909-a449-583e66fa3ce5-kube-api-access-p7pl6 podName:2ee3163e-709f-4909-a449-583e66fa3ce5 nodeName:}" failed. No retries permitted until 2026-07-01 19:11:43.656003696 +0000 UTC m=+10.164444587 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-p7pl6" (UniqueName: "kubernetes.io/projected/2ee3163e-709f-4909-a449-583e66fa3ce5-kube-api-access-p7pl6") pod "network-check-target-mv2pp" (UID: "2ee3163e-709f-4909-a449-583e66fa3ce5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:11:39.974150 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:39.974084 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-smtsc" Jul 01 19:11:39.974305 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:11:39.974287 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-smtsc" podUID="a30b203c-f4ce-4746-a763-ffde940c4276" Jul 01 19:11:40.972134 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:40.972102 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mv2pp" Jul 01 19:11:40.972526 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:11:40.972237 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mv2pp" podUID="2ee3163e-709f-4909-a449-583e66fa3ce5" Jul 01 19:11:40.972769 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:40.972616 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2x822" Jul 01 19:11:40.972769 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:11:40.972711 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2x822" podUID="7329e3ea-d499-46e5-8c07-935a27d6ab99" Jul 01 19:11:41.972038 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:41.972004 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-smtsc" Jul 01 19:11:41.972198 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:11:41.972154 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-smtsc" podUID="a30b203c-f4ce-4746-a763-ffde940c4276" Jul 01 19:11:42.972195 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:42.972127 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mv2pp" Jul 01 19:11:42.972669 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:11:42.972252 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mv2pp" podUID="2ee3163e-709f-4909-a449-583e66fa3ce5" Jul 01 19:11:42.972669 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:42.972316 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2x822" Jul 01 19:11:42.972669 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:11:42.972411 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2x822" podUID="7329e3ea-d499-46e5-8c07-935a27d6ab99" Jul 01 19:11:43.589979 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:43.589884 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7329e3ea-d499-46e5-8c07-935a27d6ab99-original-pull-secret\") pod \"global-pull-secret-syncer-2x822\" (UID: \"7329e3ea-d499-46e5-8c07-935a27d6ab99\") " pod="kube-system/global-pull-secret-syncer-2x822" Jul 01 19:11:43.590184 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:11:43.590060 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 19:11:43.590184 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:11:43.590139 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7329e3ea-d499-46e5-8c07-935a27d6ab99-original-pull-secret podName:7329e3ea-d499-46e5-8c07-935a27d6ab99 nodeName:}" failed. No retries permitted until 2026-07-01 19:11:51.590117918 +0000 UTC m=+18.098558728 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7329e3ea-d499-46e5-8c07-935a27d6ab99-original-pull-secret") pod "global-pull-secret-syncer-2x822" (UID: "7329e3ea-d499-46e5-8c07-935a27d6ab99") : object "kube-system"/"original-pull-secret" not registered Jul 01 19:11:43.690678 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:43.690625 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7pl6\" (UniqueName: \"kubernetes.io/projected/2ee3163e-709f-4909-a449-583e66fa3ce5-kube-api-access-p7pl6\") pod \"network-check-target-mv2pp\" (UID: \"2ee3163e-709f-4909-a449-583e66fa3ce5\") " pod="openshift-network-diagnostics/network-check-target-mv2pp" Jul 01 19:11:43.690678 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:43.690683 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a30b203c-f4ce-4746-a763-ffde940c4276-metrics-certs\") pod \"network-metrics-daemon-smtsc\" (UID: \"a30b203c-f4ce-4746-a763-ffde940c4276\") " pod="openshift-multus/network-metrics-daemon-smtsc" Jul 01 19:11:43.690898 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:11:43.690813 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:11:43.690898 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:11:43.690816 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 19:11:43.690898 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:11:43.690844 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 19:11:43.690898 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:11:43.690858 2561 projected.go:196] Error preparing data for projected volume kube-api-access-p7pl6 for pod openshift-network-diagnostics/network-check-target-mv2pp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:11:43.690898 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:11:43.690879 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a30b203c-f4ce-4746-a763-ffde940c4276-metrics-certs podName:a30b203c-f4ce-4746-a763-ffde940c4276 nodeName:}" failed. No retries permitted until 2026-07-01 19:11:51.690860165 +0000 UTC m=+18.199300975 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a30b203c-f4ce-4746-a763-ffde940c4276-metrics-certs") pod "network-metrics-daemon-smtsc" (UID: "a30b203c-f4ce-4746-a763-ffde940c4276") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:11:43.691175 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:11:43.690913 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2ee3163e-709f-4909-a449-583e66fa3ce5-kube-api-access-p7pl6 podName:2ee3163e-709f-4909-a449-583e66fa3ce5 nodeName:}" failed. No retries permitted until 2026-07-01 19:11:51.690894195 +0000 UTC m=+18.199335016 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-p7pl6" (UniqueName: "kubernetes.io/projected/2ee3163e-709f-4909-a449-583e66fa3ce5-kube-api-access-p7pl6") pod "network-check-target-mv2pp" (UID: "2ee3163e-709f-4909-a449-583e66fa3ce5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:11:43.974610 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:43.974105 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-smtsc" Jul 01 19:11:43.974610 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:11:43.974220 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-smtsc" podUID="a30b203c-f4ce-4746-a763-ffde940c4276" Jul 01 19:11:44.972308 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:44.972077 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mv2pp" Jul 01 19:11:44.972308 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:11:44.972218 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mv2pp" podUID="2ee3163e-709f-4909-a449-583e66fa3ce5" Jul 01 19:11:44.972308 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:44.972274 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2x822" Jul 01 19:11:44.972531 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:11:44.972372 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2x822" podUID="7329e3ea-d499-46e5-8c07-935a27d6ab99" Jul 01 19:11:45.972635 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:45.972117 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-smtsc" Jul 01 19:11:45.972635 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:11:45.972259 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-smtsc" podUID="a30b203c-f4ce-4746-a763-ffde940c4276" Jul 01 19:11:46.971669 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:46.971629 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mv2pp" Jul 01 19:11:46.971854 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:46.971629 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2x822" Jul 01 19:11:46.971854 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:11:46.971754 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mv2pp" podUID="2ee3163e-709f-4909-a449-583e66fa3ce5" Jul 01 19:11:46.971854 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:11:46.971817 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2x822" podUID="7329e3ea-d499-46e5-8c07-935a27d6ab99" Jul 01 19:11:47.974417 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:47.974388 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-smtsc" Jul 01 19:11:47.974794 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:11:47.974513 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-smtsc" podUID="a30b203c-f4ce-4746-a763-ffde940c4276" Jul 01 19:11:48.971980 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:48.971934 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mv2pp" Jul 01 19:11:48.972157 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:48.971990 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2x822" Jul 01 19:11:48.972157 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:11:48.972057 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mv2pp" podUID="2ee3163e-709f-4909-a449-583e66fa3ce5" Jul 01 19:11:48.972257 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:11:48.972198 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2x822" podUID="7329e3ea-d499-46e5-8c07-935a27d6ab99" Jul 01 19:11:49.971597 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:49.971565 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-smtsc" Jul 01 19:11:49.972076 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:11:49.971698 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-smtsc" podUID="a30b203c-f4ce-4746-a763-ffde940c4276" Jul 01 19:11:50.972316 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:50.972292 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2x822" Jul 01 19:11:50.972738 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:50.972327 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mv2pp" Jul 01 19:11:50.972738 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:11:50.972402 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2x822" podUID="7329e3ea-d499-46e5-8c07-935a27d6ab99" Jul 01 19:11:50.972738 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:11:50.972553 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mv2pp" podUID="2ee3163e-709f-4909-a449-583e66fa3ce5" Jul 01 19:11:51.650504 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:51.650465 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7329e3ea-d499-46e5-8c07-935a27d6ab99-original-pull-secret\") pod \"global-pull-secret-syncer-2x822\" (UID: \"7329e3ea-d499-46e5-8c07-935a27d6ab99\") " pod="kube-system/global-pull-secret-syncer-2x822" Jul 01 19:11:51.650697 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:11:51.650613 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 19:11:51.650697 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:11:51.650695 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7329e3ea-d499-46e5-8c07-935a27d6ab99-original-pull-secret podName:7329e3ea-d499-46e5-8c07-935a27d6ab99 nodeName:}" failed. No retries permitted until 2026-07-01 19:12:07.650674294 +0000 UTC m=+34.159115118 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7329e3ea-d499-46e5-8c07-935a27d6ab99-original-pull-secret") pod "global-pull-secret-syncer-2x822" (UID: "7329e3ea-d499-46e5-8c07-935a27d6ab99") : object "kube-system"/"original-pull-secret" not registered Jul 01 19:11:51.751349 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:51.751310 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7pl6\" (UniqueName: \"kubernetes.io/projected/2ee3163e-709f-4909-a449-583e66fa3ce5-kube-api-access-p7pl6\") pod \"network-check-target-mv2pp\" (UID: \"2ee3163e-709f-4909-a449-583e66fa3ce5\") " pod="openshift-network-diagnostics/network-check-target-mv2pp" Jul 01 19:11:51.751543 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:51.751367 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a30b203c-f4ce-4746-a763-ffde940c4276-metrics-certs\") pod \"network-metrics-daemon-smtsc\" (UID: \"a30b203c-f4ce-4746-a763-ffde940c4276\") " pod="openshift-multus/network-metrics-daemon-smtsc" Jul 01 19:11:51.751543 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:11:51.751495 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:11:51.751543 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:11:51.751497 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 19:11:51.751543 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:11:51.751522 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 19:11:51.751543 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:11:51.751534 2561 projected.go:196] Error preparing data for projected volume kube-api-access-p7pl6 for pod openshift-network-diagnostics/network-check-target-mv2pp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:11:51.751774 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:11:51.751552 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a30b203c-f4ce-4746-a763-ffde940c4276-metrics-certs podName:a30b203c-f4ce-4746-a763-ffde940c4276 nodeName:}" failed. No retries permitted until 2026-07-01 19:12:07.751533878 +0000 UTC m=+34.259974682 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a30b203c-f4ce-4746-a763-ffde940c4276-metrics-certs") pod "network-metrics-daemon-smtsc" (UID: "a30b203c-f4ce-4746-a763-ffde940c4276") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:11:51.751774 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:11:51.751584 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2ee3163e-709f-4909-a449-583e66fa3ce5-kube-api-access-p7pl6 podName:2ee3163e-709f-4909-a449-583e66fa3ce5 nodeName:}" failed. No retries permitted until 2026-07-01 19:12:07.751567563 +0000 UTC m=+34.260008367 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-p7pl6" (UniqueName: "kubernetes.io/projected/2ee3163e-709f-4909-a449-583e66fa3ce5-kube-api-access-p7pl6") pod "network-check-target-mv2pp" (UID: "2ee3163e-709f-4909-a449-583e66fa3ce5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:11:51.972244 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:51.972211 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-smtsc" Jul 01 19:11:51.972414 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:11:51.972354 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-smtsc" podUID="a30b203c-f4ce-4746-a763-ffde940c4276" Jul 01 19:11:52.972067 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:52.972032 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2x822" Jul 01 19:11:52.972251 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:52.972071 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mv2pp" Jul 01 19:11:52.972251 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:11:52.972162 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2x822" podUID="7329e3ea-d499-46e5-8c07-935a27d6ab99" Jul 01 19:11:52.972364 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:11:52.972291 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mv2pp" podUID="2ee3163e-709f-4909-a449-583e66fa3ce5" Jul 01 19:11:53.972872 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:53.972839 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-smtsc" Jul 01 19:11:53.973345 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:11:53.972943 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-smtsc" podUID="a30b203c-f4ce-4746-a763-ffde940c4276" Jul 01 19:11:54.971900 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:54.971857 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mv2pp" Jul 01 19:11:54.972198 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:11:54.972017 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mv2pp" podUID="2ee3163e-709f-4909-a449-583e66fa3ce5" Jul 01 19:11:54.972198 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:54.972077 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2x822" Jul 01 19:11:54.972198 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:11:54.972176 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2x822" podUID="7329e3ea-d499-46e5-8c07-935a27d6ab99" Jul 01 19:11:55.972435 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:55.972172 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-smtsc" Jul 01 19:11:55.972949 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:11:55.972527 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-smtsc" podUID="a30b203c-f4ce-4746-a763-ffde940c4276" Jul 01 19:11:56.065626 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:56.065602 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p4nbs_9315c387-a14c-4926-969a-64945926951e/ovn-acl-logging/0.log" Jul 01 19:11:56.065963 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:56.065903 2561 generic.go:356] "Generic (PLEG): container finished" podID="9315c387-a14c-4926-969a-64945926951e" containerID="427bd5de400d5981b36ca10a3af6ef74c80ebdf3795cbec656a169827b5cc932" exitCode=1 Jul 01 19:11:56.066021 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:56.065975 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p4nbs" event={"ID":"9315c387-a14c-4926-969a-64945926951e","Type":"ContainerStarted","Data":"a8ca4ae06f35ef4867bb188d72179650665c64dc1b08b9419181f4a49ed77789"} Jul 01 19:11:56.066070 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:56.066041 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p4nbs" event={"ID":"9315c387-a14c-4926-969a-64945926951e","Type":"ContainerStarted","Data":"d9886abc2c0aa99fb0760577b3ed364f0bd6b8136ae70fbba743754a472b7519"} Jul 01 19:11:56.066128 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:56.066082 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p4nbs" event={"ID":"9315c387-a14c-4926-969a-64945926951e","Type":"ContainerStarted","Data":"1c881ad4438584577c3d9a0490094440ae1b4b45d2e011bab659d4c118074230"} Jul 01 19:11:56.066128 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:56.066114 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p4nbs" event={"ID":"9315c387-a14c-4926-969a-64945926951e","Type":"ContainerStarted","Data":"cab68af7ef434c398f59898c05f98cf293f76ab6323f67f9e3e3f13ea8748351"} Jul 01 19:11:56.066226 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:56.066155 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p4nbs" event={"ID":"9315c387-a14c-4926-969a-64945926951e","Type":"ContainerDied","Data":"427bd5de400d5981b36ca10a3af6ef74c80ebdf3795cbec656a169827b5cc932"} Jul 01 19:11:56.066226 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:56.066192 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p4nbs" event={"ID":"9315c387-a14c-4926-969a-64945926951e","Type":"ContainerStarted","Data":"66e7bb20dc38fa3d2ab3df0dd59bd252611d1419969bdfe0762126af14fb072c"} Jul 01 19:11:56.067474 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:56.067451 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-rkh5s" event={"ID":"defe52c5-ead5-443a-a79e-6357cf3ce6f2","Type":"ContainerStarted","Data":"bb441dddbaaefe0a23e65520e54599a0fb0c97f2e590e459b74c2c8c9ae45436"} Jul 01 19:11:56.068763 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:56.068742 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-wqk2n" event={"ID":"193abea0-56eb-4a19-a2a1-6d72265b07e6","Type":"ContainerStarted","Data":"288a0f9cce2e72df6053f6cf32eca3d4d4f87356b6ed1fc3fe5ab5ca730c2832"} Jul 01 19:11:56.069994 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:56.069972 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-n8h95" event={"ID":"985e214f-29e2-4f45-b382-37fd0376ef7b","Type":"ContainerStarted","Data":"4ecc08b8a41ac289ce29ae74a5e0c59543c555ea4c612f3923c1c9a0bf086190"} Jul 01 19:11:56.071245 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:56.071228 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ntmp4" event={"ID":"962da8ba-cb8b-4738-a1e7-33396d02214d","Type":"ContainerStarted","Data":"ec6a00524350a7b48d443d7d8e1fcdc952a25bed99f773777e072b9d77fba9ac"} Jul 01 19:11:56.072635 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:56.072611 2561 generic.go:356] "Generic (PLEG): container finished" podID="5dd67e73-cf2f-4415-88d5-9e42762cb4d3" containerID="60a055657a1f842ffef5b3dc16beef1683ed5ab3866f390d97b5f9e449e48afd" exitCode=0 Jul 01 19:11:56.072709 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:56.072686 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vcrsx" event={"ID":"5dd67e73-cf2f-4415-88d5-9e42762cb4d3","Type":"ContainerDied","Data":"60a055657a1f842ffef5b3dc16beef1683ed5ab3866f390d97b5f9e449e48afd"} Jul 01 19:11:56.074298 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:56.074024 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-6kt9r" event={"ID":"6ee08291-b071-4a30-bd8a-c0208d7710b5","Type":"ContainerStarted","Data":"59776e443fd67594710a63b603fb8681723563c7ec2b1e63719ef8b643e4fc8f"} Jul 01 19:11:56.075426 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:56.075402 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-5bfhm" event={"ID":"8747f708-8d08-4b9b-a6f5-5f6a637ed029","Type":"ContainerStarted","Data":"6bb183cda0ec47fe74b9520efb4e7dfeb07691672f8fcc9a7c3d31d67e02d9f1"} Jul 01 19:11:56.083694 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:56.083646 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-rkh5s" podStartSLOduration=3.469170398 podStartE2EDuration="22.08363427s" totalImagesPullingTime="18.614463872s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:11:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:11:56.083106767 +0000 UTC m=+22.591547594" watchObservedRunningTime="2026-07-01 19:11:56.08363427 +0000 UTC m=+22.592075096" Jul 01 19:11:56.096152 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:56.096110 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-5bfhm" podStartSLOduration=3.471683556 podStartE2EDuration="22.096096861s" totalImagesPullingTime="18.624413305s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:11:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:11:56.096075428 +0000 UTC m=+22.604516254" watchObservedRunningTime="2026-07-01 19:11:56.096096861 +0000 UTC m=+22.604537680" Jul 01 19:11:56.142239 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:56.142192 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-n8h95" podStartSLOduration=3.471861433 podStartE2EDuration="22.14217723s" totalImagesPullingTime="18.670315797s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:11:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:11:56.121001937 +0000 UTC m=+22.629442785" watchObservedRunningTime="2026-07-01 19:11:56.14217723 +0000 UTC m=+22.650618072" Jul 01 19:11:56.160140 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:56.160030 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-wqk2n" podStartSLOduration=8.046344513 podStartE2EDuration="22.160013607s" totalImagesPullingTime="14.113669094s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:11:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:11:56.159129098 +0000 UTC m=+22.667569921" watchObservedRunningTime="2026-07-01 19:11:56.160013607 +0000 UTC m=+22.668454434" Jul 01 19:11:56.179399 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:56.179358 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-6kt9r" podStartSLOduration=3.553732727 podStartE2EDuration="22.179343324s" totalImagesPullingTime="18.625610597s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:11:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:11:56.179266814 +0000 UTC m=+22.687707639" watchObservedRunningTime="2026-07-01 19:11:56.179343324 +0000 UTC m=+22.687784149" Jul 01 19:11:56.971524 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:56.971474 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2x822" Jul 01 19:11:56.971649 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:11:56.971591 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2x822" podUID="7329e3ea-d499-46e5-8c07-935a27d6ab99" Jul 01 19:11:56.971649 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:56.971474 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mv2pp" Jul 01 19:11:56.971768 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:11:56.971684 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mv2pp" podUID="2ee3163e-709f-4909-a449-583e66fa3ce5" Jul 01 19:11:57.073841 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:57.073815 2561 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 01 19:11:57.079081 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:57.079052 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-gb8ld" event={"ID":"4c7a0558-eff0-42a2-9769-49f2650c196d","Type":"ContainerStarted","Data":"ffd9c560855a5c9d8f07b40714dcb240f58a6656f9b499747896b9f35a523d59"} Jul 01 19:11:57.081290 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:57.081244 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ntmp4" event={"ID":"962da8ba-cb8b-4738-a1e7-33396d02214d","Type":"ContainerStarted","Data":"cdf45be6f5f0bd7aab0b868d3b14b31b61b4872bfda211e9dd066805c15d5586"} Jul 01 19:11:57.092782 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:57.092659 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-gb8ld" podStartSLOduration=4.476841521 podStartE2EDuration="23.092646736s" totalImagesPullingTime="18.615805215s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:11:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:11:57.092318022 +0000 UTC m=+23.600758860" watchObservedRunningTime="2026-07-01 19:11:57.092646736 +0000 UTC m=+23.601087561" Jul 01 19:11:57.756644 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:57.756603 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-wqk2n" Jul 01 19:11:57.757455 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:57.757436 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-wqk2n" Jul 01 19:11:57.972024 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:57.971986 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-smtsc" Jul 01 19:11:57.972289 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:11:57.972130 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-smtsc" podUID="a30b203c-f4ce-4746-a763-ffde940c4276" Jul 01 19:11:57.972555 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:57.972442 2561 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-01T19:11:57.073835966Z","UUID":"cd7e66d6-baf9-4bc9-94cb-518a7b5f031f","Handler":null,"Name":"","Endpoint":""} Jul 01 19:11:57.974256 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:57.974219 2561 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 01 19:11:57.974256 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:57.974259 2561 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 01 19:11:58.084588 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:58.084496 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-wqk2n" Jul 01 19:11:58.085133 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:58.085029 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-wqk2n" Jul 01 19:11:58.971714 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:58.971684 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2x822" Jul 01 19:11:58.971877 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:58.971684 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mv2pp" Jul 01 19:11:58.971877 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:11:58.971823 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2x822" podUID="7329e3ea-d499-46e5-8c07-935a27d6ab99" Jul 01 19:11:58.972003 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:11:58.971882 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mv2pp" podUID="2ee3163e-709f-4909-a449-583e66fa3ce5" Jul 01 19:11:59.089410 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:59.089374 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ntmp4" event={"ID":"962da8ba-cb8b-4738-a1e7-33396d02214d","Type":"ContainerStarted","Data":"b11c1f5334c24e857eaf00ab49db2f23949171b44292e386938e5a9628a60282"} Jul 01 19:11:59.092655 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:59.092626 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p4nbs_9315c387-a14c-4926-969a-64945926951e/ovn-acl-logging/0.log" Jul 01 19:11:59.093014 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:59.092993 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p4nbs" event={"ID":"9315c387-a14c-4926-969a-64945926951e","Type":"ContainerStarted","Data":"2b527333984b0b9194088cf8cb0f5016824250dde0ae6063c8dbf79e1e059d27"} Jul 01 19:11:59.106489 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:59.106444 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ntmp4" podStartSLOduration=4.204527464 podStartE2EDuration="25.106431658s" totalImagesPullingTime="20.901904194s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:11:34 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:11:59.105846834 +0000 UTC m=+25.614287661" watchObservedRunningTime="2026-07-01 19:11:59.106431658 +0000 UTC m=+25.614872484" Jul 01 19:11:59.972668 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:11:59.972421 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-smtsc" Jul 01 19:11:59.973153 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:11:59.973117 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-smtsc" podUID="a30b203c-f4ce-4746-a763-ffde940c4276" Jul 01 19:12:00.972143 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:00.972109 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2x822" Jul 01 19:12:00.972853 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:00.972108 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mv2pp" Jul 01 19:12:00.972853 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:12:00.972223 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2x822" podUID="7329e3ea-d499-46e5-8c07-935a27d6ab99" Jul 01 19:12:00.972853 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:12:00.972304 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mv2pp" podUID="2ee3163e-709f-4909-a449-583e66fa3ce5" Jul 01 19:12:01.101534 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:01.101499 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p4nbs_9315c387-a14c-4926-969a-64945926951e/ovn-acl-logging/0.log" Jul 01 19:12:01.101877 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:01.101855 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p4nbs" event={"ID":"9315c387-a14c-4926-969a-64945926951e","Type":"ContainerStarted","Data":"94ae3a94328468d912a1dd0127f0f7874803f351d17c78bdb89cdf6cf8cf630c"} Jul 01 19:12:01.102099 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:01.102077 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-p4nbs" Jul 01 19:12:01.102360 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:01.102342 2561 scope.go:117] "RemoveContainer" containerID="427bd5de400d5981b36ca10a3af6ef74c80ebdf3795cbec656a169827b5cc932" Jul 01 19:12:01.103815 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:01.103784 2561 generic.go:356] "Generic (PLEG): container finished" podID="5dd67e73-cf2f-4415-88d5-9e42762cb4d3" containerID="83e86e5eaba198cf397de5a51d700e2b74371f08b466738aac8c3a8b5a737841" exitCode=0 Jul 01 19:12:01.103899 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:01.103821 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vcrsx" event={"ID":"5dd67e73-cf2f-4415-88d5-9e42762cb4d3","Type":"ContainerDied","Data":"83e86e5eaba198cf397de5a51d700e2b74371f08b466738aac8c3a8b5a737841"} Jul 01 19:12:01.119802 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:01.119778 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-p4nbs" Jul 01 19:12:01.974768 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:01.972118 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-smtsc" Jul 01 19:12:01.975334 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:12:01.974878 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-smtsc" podUID="a30b203c-f4ce-4746-a763-ffde940c4276" Jul 01 19:12:02.110233 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:02.110217 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p4nbs_9315c387-a14c-4926-969a-64945926951e/ovn-acl-logging/0.log" Jul 01 19:12:02.110569 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:02.110538 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p4nbs" event={"ID":"9315c387-a14c-4926-969a-64945926951e","Type":"ContainerStarted","Data":"6547271ca3edabb10131f36d5e187b6d6ce74bf9a8777bd518e709c7d4f2d22b"} Jul 01 19:12:02.110852 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:02.110830 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-p4nbs" Jul 01 19:12:02.110986 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:02.110888 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-p4nbs" Jul 01 19:12:02.129926 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:02.129897 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-p4nbs" Jul 01 19:12:02.136809 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:02.136752 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-p4nbs" podStartSLOduration=9.451112678 podStartE2EDuration="28.136731654s" totalImagesPullingTime="18.685618976s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:11:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:12:02.136033662 +0000 UTC m=+28.644474510" watchObservedRunningTime="2026-07-01 19:12:02.136731654 +0000 UTC m=+28.645172481" Jul 01 19:12:02.291577 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:02.291550 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-smtsc"] Jul 01 19:12:02.291707 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:02.291659 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-smtsc" Jul 01 19:12:02.291767 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:12:02.291748 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-smtsc" podUID="a30b203c-f4ce-4746-a763-ffde940c4276" Jul 01 19:12:02.295150 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:02.295128 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-2x822"] Jul 01 19:12:02.295258 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:02.295221 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2x822" Jul 01 19:12:02.295320 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:12:02.295297 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2x822" podUID="7329e3ea-d499-46e5-8c07-935a27d6ab99" Jul 01 19:12:02.295670 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:02.295646 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mv2pp"] Jul 01 19:12:02.295762 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:02.295732 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mv2pp" Jul 01 19:12:02.295837 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:12:02.295818 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mv2pp" podUID="2ee3163e-709f-4909-a449-583e66fa3ce5" Jul 01 19:12:03.114767 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:03.114734 2561 generic.go:356] "Generic (PLEG): container finished" podID="5dd67e73-cf2f-4415-88d5-9e42762cb4d3" containerID="35fa62b9b9da06ff013ce4b941d8a409d56937c4f25d193426588681dffd4bac" exitCode=0 Jul 01 19:12:03.115350 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:03.114818 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vcrsx" event={"ID":"5dd67e73-cf2f-4415-88d5-9e42762cb4d3","Type":"ContainerDied","Data":"35fa62b9b9da06ff013ce4b941d8a409d56937c4f25d193426588681dffd4bac"} Jul 01 19:12:03.972350 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:03.972317 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2x822" Jul 01 19:12:03.972545 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:03.972389 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-smtsc" Jul 01 19:12:03.972545 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:12:03.972409 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2x822" podUID="7329e3ea-d499-46e5-8c07-935a27d6ab99" Jul 01 19:12:03.972545 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:12:03.972502 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-smtsc" podUID="a30b203c-f4ce-4746-a763-ffde940c4276" Jul 01 19:12:03.972545 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:03.972534 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mv2pp" Jul 01 19:12:03.972717 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:12:03.972604 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mv2pp" podUID="2ee3163e-709f-4909-a449-583e66fa3ce5" Jul 01 19:12:05.121756 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:05.121571 2561 generic.go:356] "Generic (PLEG): container finished" podID="5dd67e73-cf2f-4415-88d5-9e42762cb4d3" containerID="87e8fd7306d610e36949a20491ae4fea88ab8c301651034db8f823dbd3bb771d" exitCode=0 Jul 01 19:12:05.122187 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:05.121623 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vcrsx" event={"ID":"5dd67e73-cf2f-4415-88d5-9e42762cb4d3","Type":"ContainerDied","Data":"87e8fd7306d610e36949a20491ae4fea88ab8c301651034db8f823dbd3bb771d"} Jul 01 19:12:05.972535 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:05.972503 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2x822" Jul 01 19:12:05.972535 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:05.972517 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-smtsc" Jul 01 19:12:05.972706 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:12:05.972610 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2x822" podUID="7329e3ea-d499-46e5-8c07-935a27d6ab99" Jul 01 19:12:05.972706 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:12:05.972686 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-smtsc" podUID="a30b203c-f4ce-4746-a763-ffde940c4276" Jul 01 19:12:05.972775 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:05.972729 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mv2pp" Jul 01 19:12:05.972839 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:12:05.972820 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mv2pp" podUID="2ee3163e-709f-4909-a449-583e66fa3ce5" Jul 01 19:12:07.676833 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:07.676792 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7329e3ea-d499-46e5-8c07-935a27d6ab99-original-pull-secret\") pod \"global-pull-secret-syncer-2x822\" (UID: \"7329e3ea-d499-46e5-8c07-935a27d6ab99\") " pod="kube-system/global-pull-secret-syncer-2x822" Jul 01 19:12:07.677428 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:12:07.676980 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 19:12:07.677428 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:12:07.677057 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7329e3ea-d499-46e5-8c07-935a27d6ab99-original-pull-secret podName:7329e3ea-d499-46e5-8c07-935a27d6ab99 nodeName:}" failed. No retries permitted until 2026-07-01 19:12:39.677037506 +0000 UTC m=+66.185478311 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7329e3ea-d499-46e5-8c07-935a27d6ab99-original-pull-secret") pod "global-pull-secret-syncer-2x822" (UID: "7329e3ea-d499-46e5-8c07-935a27d6ab99") : object "kube-system"/"original-pull-secret" not registered Jul 01 19:12:07.777741 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:07.777701 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7pl6\" (UniqueName: \"kubernetes.io/projected/2ee3163e-709f-4909-a449-583e66fa3ce5-kube-api-access-p7pl6\") pod \"network-check-target-mv2pp\" (UID: \"2ee3163e-709f-4909-a449-583e66fa3ce5\") " pod="openshift-network-diagnostics/network-check-target-mv2pp" Jul 01 19:12:07.777913 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:07.777757 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a30b203c-f4ce-4746-a763-ffde940c4276-metrics-certs\") pod \"network-metrics-daemon-smtsc\" (UID: \"a30b203c-f4ce-4746-a763-ffde940c4276\") " pod="openshift-multus/network-metrics-daemon-smtsc" Jul 01 19:12:07.777913 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:12:07.777849 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:12:07.777913 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:12:07.777866 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 19:12:07.777913 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:12:07.777883 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 19:12:07.777913 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:12:07.777896 2561 projected.go:196] Error preparing data for projected volume kube-api-access-p7pl6 for pod openshift-network-diagnostics/network-check-target-mv2pp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:12:07.778119 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:12:07.777917 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a30b203c-f4ce-4746-a763-ffde940c4276-metrics-certs podName:a30b203c-f4ce-4746-a763-ffde940c4276 nodeName:}" failed. No retries permitted until 2026-07-01 19:12:39.777896478 +0000 UTC m=+66.286337282 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a30b203c-f4ce-4746-a763-ffde940c4276-metrics-certs") pod "network-metrics-daemon-smtsc" (UID: "a30b203c-f4ce-4746-a763-ffde940c4276") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:12:07.778119 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:12:07.777934 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2ee3163e-709f-4909-a449-583e66fa3ce5-kube-api-access-p7pl6 podName:2ee3163e-709f-4909-a449-583e66fa3ce5 nodeName:}" failed. No retries permitted until 2026-07-01 19:12:39.777925727 +0000 UTC m=+66.286366533 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-p7pl6" (UniqueName: "kubernetes.io/projected/2ee3163e-709f-4909-a449-583e66fa3ce5-kube-api-access-p7pl6") pod "network-check-target-mv2pp" (UID: "2ee3163e-709f-4909-a449-583e66fa3ce5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:12:07.972570 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:07.972540 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2x822" Jul 01 19:12:07.972710 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:07.972540 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-smtsc" Jul 01 19:12:07.972710 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:07.972559 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mv2pp" Jul 01 19:12:07.972821 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:12:07.972718 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-smtsc" podUID="a30b203c-f4ce-4746-a763-ffde940c4276" Jul 01 19:12:07.972821 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:12:07.972784 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mv2pp" podUID="2ee3163e-709f-4909-a449-583e66fa3ce5" Jul 01 19:12:07.972821 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:12:07.972669 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2x822" podUID="7329e3ea-d499-46e5-8c07-935a27d6ab99" Jul 01 19:12:08.549377 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:08.549349 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-184.ec2.internal" event="NodeReady" Jul 01 19:12:08.549546 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:08.549494 2561 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 01 19:12:08.594021 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:08.593986 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-qndfd"] Jul 01 19:12:08.597531 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:08.597501 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qndfd" Jul 01 19:12:08.601110 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:08.601065 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 01 19:12:08.601110 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:08.601086 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 01 19:12:08.601289 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:08.601122 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6ddhd\"" Jul 01 19:12:08.601967 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:08.601930 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-8lhz2"] Jul 01 19:12:08.604508 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:08.604489 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8lhz2" Jul 01 19:12:08.606708 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:08.606688 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 01 19:12:08.606999 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:08.606973 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 01 19:12:08.607100 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:08.607057 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 01 19:12:08.607100 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:08.607069 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-czspz\"" Jul 01 19:12:08.610620 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:08.610600 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qndfd"] Jul 01 19:12:08.624970 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:08.624925 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8lhz2"] Jul 01 19:12:08.786628 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:08.786587 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4njzt\" (UniqueName: \"kubernetes.io/projected/85b15dc5-328c-41ea-adc4-c0b8fb36d860-kube-api-access-4njzt\") pod \"dns-default-qndfd\" (UID: \"85b15dc5-328c-41ea-adc4-c0b8fb36d860\") " pod="openshift-dns/dns-default-qndfd" Jul 01 19:12:08.787173 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:08.786636 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/85b15dc5-328c-41ea-adc4-c0b8fb36d860-config-volume\") pod \"dns-default-qndfd\" (UID: \"85b15dc5-328c-41ea-adc4-c0b8fb36d860\") " pod="openshift-dns/dns-default-qndfd" Jul 01 19:12:08.787173 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:08.786747 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/85b15dc5-328c-41ea-adc4-c0b8fb36d860-tmp-dir\") pod \"dns-default-qndfd\" (UID: \"85b15dc5-328c-41ea-adc4-c0b8fb36d860\") " pod="openshift-dns/dns-default-qndfd" Jul 01 19:12:08.787173 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:08.786785 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bdrxv\" (UniqueName: \"kubernetes.io/projected/ae718365-8e7b-426d-90ad-74d93647bb51-kube-api-access-bdrxv\") pod \"ingress-canary-8lhz2\" (UID: \"ae718365-8e7b-426d-90ad-74d93647bb51\") " pod="openshift-ingress-canary/ingress-canary-8lhz2" Jul 01 19:12:08.787173 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:08.786845 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ae718365-8e7b-426d-90ad-74d93647bb51-cert\") pod \"ingress-canary-8lhz2\" (UID: \"ae718365-8e7b-426d-90ad-74d93647bb51\") " pod="openshift-ingress-canary/ingress-canary-8lhz2" Jul 01 19:12:08.787173 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:08.786900 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/85b15dc5-328c-41ea-adc4-c0b8fb36d860-metrics-tls\") pod \"dns-default-qndfd\" (UID: \"85b15dc5-328c-41ea-adc4-c0b8fb36d860\") " pod="openshift-dns/dns-default-qndfd" Jul 01 19:12:08.887277 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:08.887196 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/85b15dc5-328c-41ea-adc4-c0b8fb36d860-tmp-dir\") pod \"dns-default-qndfd\" (UID: \"85b15dc5-328c-41ea-adc4-c0b8fb36d860\") " pod="openshift-dns/dns-default-qndfd" Jul 01 19:12:08.887277 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:08.887233 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdrxv\" (UniqueName: \"kubernetes.io/projected/ae718365-8e7b-426d-90ad-74d93647bb51-kube-api-access-bdrxv\") pod \"ingress-canary-8lhz2\" (UID: \"ae718365-8e7b-426d-90ad-74d93647bb51\") " pod="openshift-ingress-canary/ingress-canary-8lhz2" Jul 01 19:12:08.887277 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:08.887274 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ae718365-8e7b-426d-90ad-74d93647bb51-cert\") pod \"ingress-canary-8lhz2\" (UID: \"ae718365-8e7b-426d-90ad-74d93647bb51\") " pod="openshift-ingress-canary/ingress-canary-8lhz2" Jul 01 19:12:08.887563 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:08.887316 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/85b15dc5-328c-41ea-adc4-c0b8fb36d860-metrics-tls\") pod \"dns-default-qndfd\" (UID: \"85b15dc5-328c-41ea-adc4-c0b8fb36d860\") " pod="openshift-dns/dns-default-qndfd" Jul 01 19:12:08.887563 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:08.887359 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4njzt\" (UniqueName: \"kubernetes.io/projected/85b15dc5-328c-41ea-adc4-c0b8fb36d860-kube-api-access-4njzt\") pod \"dns-default-qndfd\" (UID: \"85b15dc5-328c-41ea-adc4-c0b8fb36d860\") " pod="openshift-dns/dns-default-qndfd" Jul 01 19:12:08.887563 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:08.887384 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/85b15dc5-328c-41ea-adc4-c0b8fb36d860-config-volume\") pod \"dns-default-qndfd\" (UID: \"85b15dc5-328c-41ea-adc4-c0b8fb36d860\") " pod="openshift-dns/dns-default-qndfd" Jul 01 19:12:08.887563 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:08.887557 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/85b15dc5-328c-41ea-adc4-c0b8fb36d860-tmp-dir\") pod \"dns-default-qndfd\" (UID: \"85b15dc5-328c-41ea-adc4-c0b8fb36d860\") " pod="openshift-dns/dns-default-qndfd" Jul 01 19:12:08.887740 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:12:08.887648 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 19:12:08.887740 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:12:08.887712 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85b15dc5-328c-41ea-adc4-c0b8fb36d860-metrics-tls podName:85b15dc5-328c-41ea-adc4-c0b8fb36d860 nodeName:}" failed. No retries permitted until 2026-07-01 19:12:09.387692405 +0000 UTC m=+35.896133211 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/85b15dc5-328c-41ea-adc4-c0b8fb36d860-metrics-tls") pod "dns-default-qndfd" (UID: "85b15dc5-328c-41ea-adc4-c0b8fb36d860") : secret "dns-default-metrics-tls" not found Jul 01 19:12:08.887890 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:08.887871 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/85b15dc5-328c-41ea-adc4-c0b8fb36d860-config-volume\") pod \"dns-default-qndfd\" (UID: \"85b15dc5-328c-41ea-adc4-c0b8fb36d860\") " pod="openshift-dns/dns-default-qndfd" Jul 01 19:12:08.893511 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:08.893480 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ae718365-8e7b-426d-90ad-74d93647bb51-cert\") pod \"ingress-canary-8lhz2\" (UID: \"ae718365-8e7b-426d-90ad-74d93647bb51\") " pod="openshift-ingress-canary/ingress-canary-8lhz2" Jul 01 19:12:08.895941 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:08.895919 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4njzt\" (UniqueName: \"kubernetes.io/projected/85b15dc5-328c-41ea-adc4-c0b8fb36d860-kube-api-access-4njzt\") pod \"dns-default-qndfd\" (UID: \"85b15dc5-328c-41ea-adc4-c0b8fb36d860\") " pod="openshift-dns/dns-default-qndfd" Jul 01 19:12:08.896091 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:08.896039 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bdrxv\" (UniqueName: \"kubernetes.io/projected/ae718365-8e7b-426d-90ad-74d93647bb51-kube-api-access-bdrxv\") pod \"ingress-canary-8lhz2\" (UID: \"ae718365-8e7b-426d-90ad-74d93647bb51\") " pod="openshift-ingress-canary/ingress-canary-8lhz2" Jul 01 19:12:08.916857 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:08.916828 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8lhz2" Jul 01 19:12:09.328678 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:09.328521 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8lhz2"] Jul 01 19:12:09.333240 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:12:09.333216 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae718365_8e7b_426d_90ad_74d93647bb51.slice/crio-295b43eae3f41131ae21265ad1bb0762e60023328184e21e0e9e77a3a052d4fd WatchSource:0}: Error finding container 295b43eae3f41131ae21265ad1bb0762e60023328184e21e0e9e77a3a052d4fd: Status 404 returned error can't find the container with id 295b43eae3f41131ae21265ad1bb0762e60023328184e21e0e9e77a3a052d4fd Jul 01 19:12:09.391702 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:09.391663 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/85b15dc5-328c-41ea-adc4-c0b8fb36d860-metrics-tls\") pod \"dns-default-qndfd\" (UID: \"85b15dc5-328c-41ea-adc4-c0b8fb36d860\") " pod="openshift-dns/dns-default-qndfd" Jul 01 19:12:09.391858 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:12:09.391817 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 19:12:09.391901 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:12:09.391876 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85b15dc5-328c-41ea-adc4-c0b8fb36d860-metrics-tls podName:85b15dc5-328c-41ea-adc4-c0b8fb36d860 nodeName:}" failed. No retries permitted until 2026-07-01 19:12:10.391859468 +0000 UTC m=+36.900300272 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/85b15dc5-328c-41ea-adc4-c0b8fb36d860-metrics-tls") pod "dns-default-qndfd" (UID: "85b15dc5-328c-41ea-adc4-c0b8fb36d860") : secret "dns-default-metrics-tls" not found Jul 01 19:12:09.972112 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:09.972078 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2x822" Jul 01 19:12:09.972746 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:09.972079 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-smtsc" Jul 01 19:12:09.972746 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:09.972080 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mv2pp" Jul 01 19:12:09.974968 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:09.974767 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 01 19:12:09.974968 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:09.974802 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 01 19:12:09.974968 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:09.974832 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 01 19:12:09.975190 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:09.975173 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 01 19:12:09.975353 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:09.975332 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-88jrr\"" Jul 01 19:12:09.975484 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:09.975376 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9wqsv\"" Jul 01 19:12:10.139820 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:10.139787 2561 generic.go:356] "Generic (PLEG): container finished" podID="5dd67e73-cf2f-4415-88d5-9e42762cb4d3" containerID="28a9e97326794502c9f9a4a2858dbe18ecc6fc0cd7bc9bce0e1ab2d523f4668f" exitCode=0 Jul 01 19:12:10.140015 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:10.139889 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vcrsx" event={"ID":"5dd67e73-cf2f-4415-88d5-9e42762cb4d3","Type":"ContainerDied","Data":"28a9e97326794502c9f9a4a2858dbe18ecc6fc0cd7bc9bce0e1ab2d523f4668f"} Jul 01 19:12:10.142239 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:10.142100 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8lhz2" event={"ID":"ae718365-8e7b-426d-90ad-74d93647bb51","Type":"ContainerStarted","Data":"295b43eae3f41131ae21265ad1bb0762e60023328184e21e0e9e77a3a052d4fd"} Jul 01 19:12:10.398858 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:10.398810 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/85b15dc5-328c-41ea-adc4-c0b8fb36d860-metrics-tls\") pod \"dns-default-qndfd\" (UID: \"85b15dc5-328c-41ea-adc4-c0b8fb36d860\") " pod="openshift-dns/dns-default-qndfd" Jul 01 19:12:10.399043 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:12:10.398933 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 19:12:10.399043 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:12:10.399002 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85b15dc5-328c-41ea-adc4-c0b8fb36d860-metrics-tls podName:85b15dc5-328c-41ea-adc4-c0b8fb36d860 nodeName:}" failed. No retries permitted until 2026-07-01 19:12:12.398988061 +0000 UTC m=+38.907428864 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/85b15dc5-328c-41ea-adc4-c0b8fb36d860-metrics-tls") pod "dns-default-qndfd" (UID: "85b15dc5-328c-41ea-adc4-c0b8fb36d860") : secret "dns-default-metrics-tls" not found Jul 01 19:12:11.148035 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:11.148005 2561 generic.go:356] "Generic (PLEG): container finished" podID="5dd67e73-cf2f-4415-88d5-9e42762cb4d3" containerID="3c3e0417749fecb3ae179a559bf9f6ca07b6c804fd40f5a9178074750c135e79" exitCode=0 Jul 01 19:12:11.148469 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:11.148066 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vcrsx" event={"ID":"5dd67e73-cf2f-4415-88d5-9e42762cb4d3","Type":"ContainerDied","Data":"3c3e0417749fecb3ae179a559bf9f6ca07b6c804fd40f5a9178074750c135e79"} Jul 01 19:12:12.153286 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:12.153206 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vcrsx" event={"ID":"5dd67e73-cf2f-4415-88d5-9e42762cb4d3","Type":"ContainerStarted","Data":"27ab43b2edcad603290a42e3e81a5dc5dbd7f501b4fc6fc0a5bd1a73c1f81e82"} Jul 01 19:12:12.174895 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:12.174845 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-vcrsx" podStartSLOduration=9.197577004 podStartE2EDuration="38.174832087s" totalImagesPullingTime="28.977255083s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:11:34 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:12:12.174398498 +0000 UTC m=+38.682839336" watchObservedRunningTime="2026-07-01 19:12:12.174832087 +0000 UTC m=+38.683272913" Jul 01 19:12:12.413916 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:12.413854 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/85b15dc5-328c-41ea-adc4-c0b8fb36d860-metrics-tls\") pod \"dns-default-qndfd\" (UID: \"85b15dc5-328c-41ea-adc4-c0b8fb36d860\") " pod="openshift-dns/dns-default-qndfd" Jul 01 19:12:12.414074 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:12:12.414006 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 19:12:12.414074 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:12:12.414073 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85b15dc5-328c-41ea-adc4-c0b8fb36d860-metrics-tls podName:85b15dc5-328c-41ea-adc4-c0b8fb36d860 nodeName:}" failed. No retries permitted until 2026-07-01 19:12:16.414057977 +0000 UTC m=+42.922498781 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/85b15dc5-328c-41ea-adc4-c0b8fb36d860-metrics-tls") pod "dns-default-qndfd" (UID: "85b15dc5-328c-41ea-adc4-c0b8fb36d860") : secret "dns-default-metrics-tls" not found Jul 01 19:12:13.157308 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:13.157275 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8lhz2" event={"ID":"ae718365-8e7b-426d-90ad-74d93647bb51","Type":"ContainerStarted","Data":"4be9795340f1306f8f6615a57e3986b04b8cf5032e858edf948986d505b16fea"} Jul 01 19:12:13.176712 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:13.176656 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-8lhz2" podStartSLOduration=2.236425046 podStartE2EDuration="5.176632185s" totalImagesPullingTime="2.940207139s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:12:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:12:13.176301492 +0000 UTC m=+39.684742320" watchObservedRunningTime="2026-07-01 19:12:13.176632185 +0000 UTC m=+39.685073011" Jul 01 19:12:16.441970 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:16.441925 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/85b15dc5-328c-41ea-adc4-c0b8fb36d860-metrics-tls\") pod \"dns-default-qndfd\" (UID: \"85b15dc5-328c-41ea-adc4-c0b8fb36d860\") " pod="openshift-dns/dns-default-qndfd" Jul 01 19:12:16.442327 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:12:16.442049 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 19:12:16.442327 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:12:16.442112 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85b15dc5-328c-41ea-adc4-c0b8fb36d860-metrics-tls podName:85b15dc5-328c-41ea-adc4-c0b8fb36d860 nodeName:}" failed. No retries permitted until 2026-07-01 19:12:24.442095622 +0000 UTC m=+50.950536427 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/85b15dc5-328c-41ea-adc4-c0b8fb36d860-metrics-tls") pod "dns-default-qndfd" (UID: "85b15dc5-328c-41ea-adc4-c0b8fb36d860") : secret "dns-default-metrics-tls" not found Jul 01 19:12:24.497405 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:24.497366 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/85b15dc5-328c-41ea-adc4-c0b8fb36d860-metrics-tls\") pod \"dns-default-qndfd\" (UID: \"85b15dc5-328c-41ea-adc4-c0b8fb36d860\") " pod="openshift-dns/dns-default-qndfd" Jul 01 19:12:24.497867 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:12:24.497539 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 19:12:24.497867 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:12:24.497607 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85b15dc5-328c-41ea-adc4-c0b8fb36d860-metrics-tls podName:85b15dc5-328c-41ea-adc4-c0b8fb36d860 nodeName:}" failed. No retries permitted until 2026-07-01 19:12:40.497590931 +0000 UTC m=+67.006031735 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/85b15dc5-328c-41ea-adc4-c0b8fb36d860-metrics-tls") pod "dns-default-qndfd" (UID: "85b15dc5-328c-41ea-adc4-c0b8fb36d860") : secret "dns-default-metrics-tls" not found Jul 01 19:12:32.143530 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:32.143500 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5f67b55555-cjsn9"] Jul 01 19:12:32.146818 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:32.146803 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5f67b55555-cjsn9" Jul 01 19:12:32.148981 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:32.148947 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 01 19:12:32.149257 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:32.149244 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 01 19:12:32.149417 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:32.149405 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-s9hxs\"" Jul 01 19:12:32.149465 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:32.149433 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 01 19:12:32.149509 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:32.149435 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 01 19:12:32.155256 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:32.155234 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 01 19:12:32.156144 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:32.156126 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5f67b55555-cjsn9"] Jul 01 19:12:32.249168 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:32.249137 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dee2c113-9b3a-469d-af6a-c85146b4bf98-tmp\") pod \"insights-operator-5f67b55555-cjsn9\" (UID: \"dee2c113-9b3a-469d-af6a-c85146b4bf98\") " pod="openshift-insights/insights-operator-5f67b55555-cjsn9" Jul 01 19:12:32.249327 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:32.249173 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/dee2c113-9b3a-469d-af6a-c85146b4bf98-snapshots\") pod \"insights-operator-5f67b55555-cjsn9\" (UID: \"dee2c113-9b3a-469d-af6a-c85146b4bf98\") " pod="openshift-insights/insights-operator-5f67b55555-cjsn9" Jul 01 19:12:32.249327 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:32.249212 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/dee2c113-9b3a-469d-af6a-c85146b4bf98-serving-cert\") pod \"insights-operator-5f67b55555-cjsn9\" (UID: \"dee2c113-9b3a-469d-af6a-c85146b4bf98\") " pod="openshift-insights/insights-operator-5f67b55555-cjsn9" Jul 01 19:12:32.249327 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:32.249303 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dee2c113-9b3a-469d-af6a-c85146b4bf98-trusted-ca-bundle\") pod \"insights-operator-5f67b55555-cjsn9\" (UID: \"dee2c113-9b3a-469d-af6a-c85146b4bf98\") " pod="openshift-insights/insights-operator-5f67b55555-cjsn9" Jul 01 19:12:32.249451 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:32.249332 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dee2c113-9b3a-469d-af6a-c85146b4bf98-service-ca-bundle\") pod \"insights-operator-5f67b55555-cjsn9\" (UID: \"dee2c113-9b3a-469d-af6a-c85146b4bf98\") " pod="openshift-insights/insights-operator-5f67b55555-cjsn9" Jul 01 19:12:32.249451 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:32.249348 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxj6b\" (UniqueName: \"kubernetes.io/projected/dee2c113-9b3a-469d-af6a-c85146b4bf98-kube-api-access-gxj6b\") pod \"insights-operator-5f67b55555-cjsn9\" (UID: \"dee2c113-9b3a-469d-af6a-c85146b4bf98\") " pod="openshift-insights/insights-operator-5f67b55555-cjsn9" Jul 01 19:12:32.349740 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:32.349702 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dee2c113-9b3a-469d-af6a-c85146b4bf98-tmp\") pod \"insights-operator-5f67b55555-cjsn9\" (UID: \"dee2c113-9b3a-469d-af6a-c85146b4bf98\") " pod="openshift-insights/insights-operator-5f67b55555-cjsn9" Jul 01 19:12:32.349740 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:32.349739 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/dee2c113-9b3a-469d-af6a-c85146b4bf98-snapshots\") pod \"insights-operator-5f67b55555-cjsn9\" (UID: \"dee2c113-9b3a-469d-af6a-c85146b4bf98\") " pod="openshift-insights/insights-operator-5f67b55555-cjsn9" Jul 01 19:12:32.349931 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:32.349870 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/dee2c113-9b3a-469d-af6a-c85146b4bf98-serving-cert\") pod \"insights-operator-5f67b55555-cjsn9\" (UID: \"dee2c113-9b3a-469d-af6a-c85146b4bf98\") " pod="openshift-insights/insights-operator-5f67b55555-cjsn9" Jul 01 19:12:32.350036 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:32.350018 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dee2c113-9b3a-469d-af6a-c85146b4bf98-trusted-ca-bundle\") pod \"insights-operator-5f67b55555-cjsn9\" (UID: \"dee2c113-9b3a-469d-af6a-c85146b4bf98\") " pod="openshift-insights/insights-operator-5f67b55555-cjsn9" Jul 01 19:12:32.350088 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:32.350058 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dee2c113-9b3a-469d-af6a-c85146b4bf98-service-ca-bundle\") pod \"insights-operator-5f67b55555-cjsn9\" (UID: \"dee2c113-9b3a-469d-af6a-c85146b4bf98\") " pod="openshift-insights/insights-operator-5f67b55555-cjsn9" Jul 01 19:12:32.350142 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:32.350083 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gxj6b\" (UniqueName: \"kubernetes.io/projected/dee2c113-9b3a-469d-af6a-c85146b4bf98-kube-api-access-gxj6b\") pod \"insights-operator-5f67b55555-cjsn9\" (UID: \"dee2c113-9b3a-469d-af6a-c85146b4bf98\") " pod="openshift-insights/insights-operator-5f67b55555-cjsn9" Jul 01 19:12:32.350222 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:32.350204 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dee2c113-9b3a-469d-af6a-c85146b4bf98-tmp\") pod \"insights-operator-5f67b55555-cjsn9\" (UID: \"dee2c113-9b3a-469d-af6a-c85146b4bf98\") " pod="openshift-insights/insights-operator-5f67b55555-cjsn9" Jul 01 19:12:32.350531 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:32.350507 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/dee2c113-9b3a-469d-af6a-c85146b4bf98-snapshots\") pod \"insights-operator-5f67b55555-cjsn9\" (UID: \"dee2c113-9b3a-469d-af6a-c85146b4bf98\") " pod="openshift-insights/insights-operator-5f67b55555-cjsn9" Jul 01 19:12:32.350690 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:32.350662 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dee2c113-9b3a-469d-af6a-c85146b4bf98-service-ca-bundle\") pod \"insights-operator-5f67b55555-cjsn9\" (UID: \"dee2c113-9b3a-469d-af6a-c85146b4bf98\") " pod="openshift-insights/insights-operator-5f67b55555-cjsn9" Jul 01 19:12:32.351245 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:32.351227 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dee2c113-9b3a-469d-af6a-c85146b4bf98-trusted-ca-bundle\") pod \"insights-operator-5f67b55555-cjsn9\" (UID: \"dee2c113-9b3a-469d-af6a-c85146b4bf98\") " pod="openshift-insights/insights-operator-5f67b55555-cjsn9" Jul 01 19:12:32.353705 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:32.353685 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/dee2c113-9b3a-469d-af6a-c85146b4bf98-serving-cert\") pod \"insights-operator-5f67b55555-cjsn9\" (UID: \"dee2c113-9b3a-469d-af6a-c85146b4bf98\") " pod="openshift-insights/insights-operator-5f67b55555-cjsn9" Jul 01 19:12:32.364456 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:32.364429 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxj6b\" (UniqueName: \"kubernetes.io/projected/dee2c113-9b3a-469d-af6a-c85146b4bf98-kube-api-access-gxj6b\") pod \"insights-operator-5f67b55555-cjsn9\" (UID: \"dee2c113-9b3a-469d-af6a-c85146b4bf98\") " pod="openshift-insights/insights-operator-5f67b55555-cjsn9" Jul 01 19:12:32.456524 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:32.456486 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5f67b55555-cjsn9" Jul 01 19:12:32.579072 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:32.579043 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5f67b55555-cjsn9"] Jul 01 19:12:32.582175 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:12:32.582144 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddee2c113_9b3a_469d_af6a_c85146b4bf98.slice/crio-173d40fd285cd4223cb06be79cd6cd7af5c41b5219c84e072d27266775700b7b WatchSource:0}: Error finding container 173d40fd285cd4223cb06be79cd6cd7af5c41b5219c84e072d27266775700b7b: Status 404 returned error can't find the container with id 173d40fd285cd4223cb06be79cd6cd7af5c41b5219c84e072d27266775700b7b Jul 01 19:12:33.203945 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:33.203884 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5f67b55555-cjsn9" event={"ID":"dee2c113-9b3a-469d-af6a-c85146b4bf98","Type":"ContainerStarted","Data":"173d40fd285cd4223cb06be79cd6cd7af5c41b5219c84e072d27266775700b7b"} Jul 01 19:12:34.131573 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:34.131544 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-p4nbs" Jul 01 19:12:35.211128 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:35.211096 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5f67b55555-cjsn9" event={"ID":"dee2c113-9b3a-469d-af6a-c85146b4bf98","Type":"ContainerStarted","Data":"c57a9dc2984b37e89eab719de90be6cf4fa6a3c1dbb9425247cc439f7cd7cb73"} Jul 01 19:12:35.225408 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:35.225351 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5f67b55555-cjsn9" podStartSLOduration=0.691669188 podStartE2EDuration="3.225330553s" totalImagesPullingTime="2.533661365s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:12:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:12:35.22506927 +0000 UTC m=+61.733510097" watchObservedRunningTime="2026-07-01 19:12:35.225330553 +0000 UTC m=+61.733771382" Jul 01 19:12:36.207413 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:36.207382 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-zp5ps"] Jul 01 19:12:36.210720 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:36.210697 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-zp5ps" Jul 01 19:12:36.213239 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:36.213217 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-54dhx\"" Jul 01 19:12:36.213690 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:36.213481 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 01 19:12:36.213820 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:36.213805 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 01 19:12:36.219441 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:36.219421 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-lkj58"] Jul 01 19:12:36.221512 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:36.221493 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-lkj58" Jul 01 19:12:36.223776 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:36.223619 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 01 19:12:36.223776 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:36.223645 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 01 19:12:36.223776 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:36.223702 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-zp5ps"] Jul 01 19:12:36.224053 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:36.223803 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 01 19:12:36.224053 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:36.223896 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-nwt58\"" Jul 01 19:12:36.224053 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:36.224031 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 01 19:12:36.231825 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:36.231803 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-lkj58"] Jul 01 19:12:36.279196 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:36.279164 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/43534a28-eb76-425e-8c8f-bbb00ab5df95-crio-socket\") pod \"insights-runtime-extractor-zp5ps\" (UID: \"43534a28-eb76-425e-8c8f-bbb00ab5df95\") " pod="openshift-insights/insights-runtime-extractor-zp5ps" Jul 01 19:12:36.279368 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:36.279216 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/43534a28-eb76-425e-8c8f-bbb00ab5df95-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zp5ps\" (UID: \"43534a28-eb76-425e-8c8f-bbb00ab5df95\") " pod="openshift-insights/insights-runtime-extractor-zp5ps" Jul 01 19:12:36.279368 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:36.279251 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ebf9d613-2590-4a63-8890-fbca3d5fc32c-config\") pod \"kube-storage-version-migrator-operator-79964ff6f9-lkj58\" (UID: \"ebf9d613-2590-4a63-8890-fbca3d5fc32c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-lkj58" Jul 01 19:12:36.279368 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:36.279296 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nlxwh\" (UniqueName: \"kubernetes.io/projected/ebf9d613-2590-4a63-8890-fbca3d5fc32c-kube-api-access-nlxwh\") pod \"kube-storage-version-migrator-operator-79964ff6f9-lkj58\" (UID: \"ebf9d613-2590-4a63-8890-fbca3d5fc32c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-lkj58" Jul 01 19:12:36.279368 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:36.279334 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ebf9d613-2590-4a63-8890-fbca3d5fc32c-serving-cert\") pod \"kube-storage-version-migrator-operator-79964ff6f9-lkj58\" (UID: \"ebf9d613-2590-4a63-8890-fbca3d5fc32c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-lkj58" Jul 01 19:12:36.279506 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:36.279413 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/43534a28-eb76-425e-8c8f-bbb00ab5df95-data-volume\") pod \"insights-runtime-extractor-zp5ps\" (UID: \"43534a28-eb76-425e-8c8f-bbb00ab5df95\") " pod="openshift-insights/insights-runtime-extractor-zp5ps" Jul 01 19:12:36.279506 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:36.279461 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/43534a28-eb76-425e-8c8f-bbb00ab5df95-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zp5ps\" (UID: \"43534a28-eb76-425e-8c8f-bbb00ab5df95\") " pod="openshift-insights/insights-runtime-extractor-zp5ps" Jul 01 19:12:36.279569 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:36.279549 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8l59z\" (UniqueName: \"kubernetes.io/projected/43534a28-eb76-425e-8c8f-bbb00ab5df95-kube-api-access-8l59z\") pod \"insights-runtime-extractor-zp5ps\" (UID: \"43534a28-eb76-425e-8c8f-bbb00ab5df95\") " pod="openshift-insights/insights-runtime-extractor-zp5ps" Jul 01 19:12:36.380844 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:36.380814 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ebf9d613-2590-4a63-8890-fbca3d5fc32c-serving-cert\") pod \"kube-storage-version-migrator-operator-79964ff6f9-lkj58\" (UID: \"ebf9d613-2590-4a63-8890-fbca3d5fc32c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-lkj58" Jul 01 19:12:36.381054 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:36.380864 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/43534a28-eb76-425e-8c8f-bbb00ab5df95-data-volume\") pod \"insights-runtime-extractor-zp5ps\" (UID: \"43534a28-eb76-425e-8c8f-bbb00ab5df95\") " pod="openshift-insights/insights-runtime-extractor-zp5ps" Jul 01 19:12:36.381054 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:36.380894 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/43534a28-eb76-425e-8c8f-bbb00ab5df95-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zp5ps\" (UID: \"43534a28-eb76-425e-8c8f-bbb00ab5df95\") " pod="openshift-insights/insights-runtime-extractor-zp5ps" Jul 01 19:12:36.381054 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:36.380920 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8l59z\" (UniqueName: \"kubernetes.io/projected/43534a28-eb76-425e-8c8f-bbb00ab5df95-kube-api-access-8l59z\") pod \"insights-runtime-extractor-zp5ps\" (UID: \"43534a28-eb76-425e-8c8f-bbb00ab5df95\") " pod="openshift-insights/insights-runtime-extractor-zp5ps" Jul 01 19:12:36.381054 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:36.380985 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/43534a28-eb76-425e-8c8f-bbb00ab5df95-crio-socket\") pod \"insights-runtime-extractor-zp5ps\" (UID: \"43534a28-eb76-425e-8c8f-bbb00ab5df95\") " pod="openshift-insights/insights-runtime-extractor-zp5ps" Jul 01 19:12:36.381054 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:36.381049 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/43534a28-eb76-425e-8c8f-bbb00ab5df95-crio-socket\") pod \"insights-runtime-extractor-zp5ps\" (UID: \"43534a28-eb76-425e-8c8f-bbb00ab5df95\") " pod="openshift-insights/insights-runtime-extractor-zp5ps" Jul 01 19:12:36.381313 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:12:36.381174 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 19:12:36.381313 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:12:36.381228 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43534a28-eb76-425e-8c8f-bbb00ab5df95-insights-runtime-extractor-tls podName:43534a28-eb76-425e-8c8f-bbb00ab5df95 nodeName:}" failed. No retries permitted until 2026-07-01 19:12:36.881211793 +0000 UTC m=+63.389652602 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/43534a28-eb76-425e-8c8f-bbb00ab5df95-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zp5ps" (UID: "43534a28-eb76-425e-8c8f-bbb00ab5df95") : secret "insights-runtime-extractor-tls" not found Jul 01 19:12:36.381313 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:36.381254 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/43534a28-eb76-425e-8c8f-bbb00ab5df95-data-volume\") pod \"insights-runtime-extractor-zp5ps\" (UID: \"43534a28-eb76-425e-8c8f-bbb00ab5df95\") " pod="openshift-insights/insights-runtime-extractor-zp5ps" Jul 01 19:12:36.381313 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:36.381265 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/43534a28-eb76-425e-8c8f-bbb00ab5df95-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zp5ps\" (UID: \"43534a28-eb76-425e-8c8f-bbb00ab5df95\") " pod="openshift-insights/insights-runtime-extractor-zp5ps" Jul 01 19:12:36.381313 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:36.381291 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ebf9d613-2590-4a63-8890-fbca3d5fc32c-config\") pod \"kube-storage-version-migrator-operator-79964ff6f9-lkj58\" (UID: \"ebf9d613-2590-4a63-8890-fbca3d5fc32c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-lkj58" Jul 01 19:12:36.381574 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:36.381331 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nlxwh\" (UniqueName: \"kubernetes.io/projected/ebf9d613-2590-4a63-8890-fbca3d5fc32c-kube-api-access-nlxwh\") pod \"kube-storage-version-migrator-operator-79964ff6f9-lkj58\" (UID: \"ebf9d613-2590-4a63-8890-fbca3d5fc32c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-lkj58" Jul 01 19:12:36.381574 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:12:36.381337 2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 01 19:12:36.381574 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:12:36.381397 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/43534a28-eb76-425e-8c8f-bbb00ab5df95-kube-rbac-proxy-cm podName:43534a28-eb76-425e-8c8f-bbb00ab5df95 nodeName:}" failed. No retries permitted until 2026-07-01 19:12:36.881385528 +0000 UTC m=+63.389826347 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/43534a28-eb76-425e-8c8f-bbb00ab5df95-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zp5ps" (UID: "43534a28-eb76-425e-8c8f-bbb00ab5df95") : configmap "kube-rbac-proxy" not found Jul 01 19:12:36.381860 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:36.381838 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ebf9d613-2590-4a63-8890-fbca3d5fc32c-config\") pod \"kube-storage-version-migrator-operator-79964ff6f9-lkj58\" (UID: \"ebf9d613-2590-4a63-8890-fbca3d5fc32c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-lkj58" Jul 01 19:12:36.383158 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:36.383139 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ebf9d613-2590-4a63-8890-fbca3d5fc32c-serving-cert\") pod \"kube-storage-version-migrator-operator-79964ff6f9-lkj58\" (UID: \"ebf9d613-2590-4a63-8890-fbca3d5fc32c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-lkj58" Jul 01 19:12:36.388968 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:36.388936 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nlxwh\" (UniqueName: \"kubernetes.io/projected/ebf9d613-2590-4a63-8890-fbca3d5fc32c-kube-api-access-nlxwh\") pod \"kube-storage-version-migrator-operator-79964ff6f9-lkj58\" (UID: \"ebf9d613-2590-4a63-8890-fbca3d5fc32c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-lkj58" Jul 01 19:12:36.389233 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:36.389213 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8l59z\" (UniqueName: \"kubernetes.io/projected/43534a28-eb76-425e-8c8f-bbb00ab5df95-kube-api-access-8l59z\") pod \"insights-runtime-extractor-zp5ps\" (UID: \"43534a28-eb76-425e-8c8f-bbb00ab5df95\") " pod="openshift-insights/insights-runtime-extractor-zp5ps" Jul 01 19:12:36.530875 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:36.530781 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-lkj58" Jul 01 19:12:36.659090 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:36.659060 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-lkj58"] Jul 01 19:12:36.662216 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:12:36.662190 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebf9d613_2590_4a63_8890_fbca3d5fc32c.slice/crio-4f27c9b712f236033a9e574e6e344ceb4717d06f67a869d5a93845099b85be05 WatchSource:0}: Error finding container 4f27c9b712f236033a9e574e6e344ceb4717d06f67a869d5a93845099b85be05: Status 404 returned error can't find the container with id 4f27c9b712f236033a9e574e6e344ceb4717d06f67a869d5a93845099b85be05 Jul 01 19:12:36.886275 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:36.886196 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/43534a28-eb76-425e-8c8f-bbb00ab5df95-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zp5ps\" (UID: \"43534a28-eb76-425e-8c8f-bbb00ab5df95\") " pod="openshift-insights/insights-runtime-extractor-zp5ps" Jul 01 19:12:36.886275 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:36.886254 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/43534a28-eb76-425e-8c8f-bbb00ab5df95-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zp5ps\" (UID: \"43534a28-eb76-425e-8c8f-bbb00ab5df95\") " pod="openshift-insights/insights-runtime-extractor-zp5ps" Jul 01 19:12:36.886425 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:12:36.886356 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 19:12:36.886425 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:12:36.886413 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43534a28-eb76-425e-8c8f-bbb00ab5df95-insights-runtime-extractor-tls podName:43534a28-eb76-425e-8c8f-bbb00ab5df95 nodeName:}" failed. No retries permitted until 2026-07-01 19:12:37.886399625 +0000 UTC m=+64.394840434 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/43534a28-eb76-425e-8c8f-bbb00ab5df95-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zp5ps" (UID: "43534a28-eb76-425e-8c8f-bbb00ab5df95") : secret "insights-runtime-extractor-tls" not found Jul 01 19:12:36.886517 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:12:36.886356 2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 01 19:12:36.886517 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:12:36.886488 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/43534a28-eb76-425e-8c8f-bbb00ab5df95-kube-rbac-proxy-cm podName:43534a28-eb76-425e-8c8f-bbb00ab5df95 nodeName:}" failed. No retries permitted until 2026-07-01 19:12:37.886475686 +0000 UTC m=+64.394916495 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/43534a28-eb76-425e-8c8f-bbb00ab5df95-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zp5ps" (UID: "43534a28-eb76-425e-8c8f-bbb00ab5df95") : configmap "kube-rbac-proxy" not found Jul 01 19:12:37.218006 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:37.217966 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-lkj58" event={"ID":"ebf9d613-2590-4a63-8890-fbca3d5fc32c","Type":"ContainerStarted","Data":"4f27c9b712f236033a9e574e6e344ceb4717d06f67a869d5a93845099b85be05"} Jul 01 19:12:37.893554 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:37.893518 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/43534a28-eb76-425e-8c8f-bbb00ab5df95-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zp5ps\" (UID: \"43534a28-eb76-425e-8c8f-bbb00ab5df95\") " pod="openshift-insights/insights-runtime-extractor-zp5ps" Jul 01 19:12:37.893724 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:37.893583 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/43534a28-eb76-425e-8c8f-bbb00ab5df95-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zp5ps\" (UID: \"43534a28-eb76-425e-8c8f-bbb00ab5df95\") " pod="openshift-insights/insights-runtime-extractor-zp5ps" Jul 01 19:12:37.893724 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:12:37.893665 2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 01 19:12:37.893724 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:12:37.893666 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 19:12:37.893724 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:12:37.893718 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/43534a28-eb76-425e-8c8f-bbb00ab5df95-kube-rbac-proxy-cm podName:43534a28-eb76-425e-8c8f-bbb00ab5df95 nodeName:}" failed. No retries permitted until 2026-07-01 19:12:39.893704197 +0000 UTC m=+66.402145000 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/43534a28-eb76-425e-8c8f-bbb00ab5df95-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zp5ps" (UID: "43534a28-eb76-425e-8c8f-bbb00ab5df95") : configmap "kube-rbac-proxy" not found Jul 01 19:12:37.893856 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:12:37.893751 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43534a28-eb76-425e-8c8f-bbb00ab5df95-insights-runtime-extractor-tls podName:43534a28-eb76-425e-8c8f-bbb00ab5df95 nodeName:}" failed. No retries permitted until 2026-07-01 19:12:39.893739871 +0000 UTC m=+66.402180675 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/43534a28-eb76-425e-8c8f-bbb00ab5df95-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zp5ps" (UID: "43534a28-eb76-425e-8c8f-bbb00ab5df95") : secret "insights-runtime-extractor-tls" not found Jul 01 19:12:38.369525 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:38.369495 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-rkh5s_defe52c5-ead5-443a-a79e-6357cf3ce6f2/dns-node-resolver/0.log" Jul 01 19:12:38.769310 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:38.769293 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-5bfhm_8747f708-8d08-4b9b-a6f5-5f6a637ed029/node-ca/0.log" Jul 01 19:12:39.163175 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:39.163099 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-thr5g"] Jul 01 19:12:39.165351 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:39.165326 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-thr5g" Jul 01 19:12:39.167257 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:39.167229 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 01 19:12:39.167257 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:39.167243 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 01 19:12:39.167430 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:39.167312 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-49qz5\"" Jul 01 19:12:39.167430 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:39.167231 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 01 19:12:39.167872 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:39.167856 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 01 19:12:39.174218 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:39.174195 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-thr5g"] Jul 01 19:12:39.206159 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:39.206133 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7d91805f-0e1f-4baa-ba7c-8b0bc1d69b9e-serving-cert\") pod \"service-ca-operator-5d7b7dc95c-thr5g\" (UID: \"7d91805f-0e1f-4baa-ba7c-8b0bc1d69b9e\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-thr5g" Jul 01 19:12:39.206266 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:39.206160 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gfqbj\" (UniqueName: \"kubernetes.io/projected/7d91805f-0e1f-4baa-ba7c-8b0bc1d69b9e-kube-api-access-gfqbj\") pod \"service-ca-operator-5d7b7dc95c-thr5g\" (UID: \"7d91805f-0e1f-4baa-ba7c-8b0bc1d69b9e\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-thr5g" Jul 01 19:12:39.206266 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:39.206202 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7d91805f-0e1f-4baa-ba7c-8b0bc1d69b9e-config\") pod \"service-ca-operator-5d7b7dc95c-thr5g\" (UID: \"7d91805f-0e1f-4baa-ba7c-8b0bc1d69b9e\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-thr5g" Jul 01 19:12:39.224669 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:39.224641 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-lkj58" event={"ID":"ebf9d613-2590-4a63-8890-fbca3d5fc32c","Type":"ContainerStarted","Data":"7237ed3af4a5d0d08cc48bcf5defe44616c2004da8ad47fec7da4390a4f1477b"} Jul 01 19:12:39.239713 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:39.239667 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-lkj58" podStartSLOduration=1.16553998 podStartE2EDuration="3.239649888s" totalImagesPullingTime="2.074109908s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:12:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:12:39.239001235 +0000 UTC m=+65.747442086" watchObservedRunningTime="2026-07-01 19:12:39.239649888 +0000 UTC m=+65.748090713" Jul 01 19:12:39.265226 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:39.265196 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-56499946bc-wsxkq"] Jul 01 19:12:39.267703 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:39.267685 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-56499946bc-wsxkq" Jul 01 19:12:39.269459 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:39.269440 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-knnk9\"" Jul 01 19:12:39.275915 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:39.275894 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-56499946bc-wsxkq"] Jul 01 19:12:39.306750 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:39.306727 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7d91805f-0e1f-4baa-ba7c-8b0bc1d69b9e-serving-cert\") pod \"service-ca-operator-5d7b7dc95c-thr5g\" (UID: \"7d91805f-0e1f-4baa-ba7c-8b0bc1d69b9e\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-thr5g" Jul 01 19:12:39.306903 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:39.306760 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gfqbj\" (UniqueName: \"kubernetes.io/projected/7d91805f-0e1f-4baa-ba7c-8b0bc1d69b9e-kube-api-access-gfqbj\") pod \"service-ca-operator-5d7b7dc95c-thr5g\" (UID: \"7d91805f-0e1f-4baa-ba7c-8b0bc1d69b9e\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-thr5g" Jul 01 19:12:39.306903 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:39.306822 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7d91805f-0e1f-4baa-ba7c-8b0bc1d69b9e-config\") pod \"service-ca-operator-5d7b7dc95c-thr5g\" (UID: \"7d91805f-0e1f-4baa-ba7c-8b0bc1d69b9e\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-thr5g" Jul 01 19:12:39.306903 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:39.306876 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n77tr\" (UniqueName: \"kubernetes.io/projected/bc2b5894-e142-46da-a815-1939b9390a82-kube-api-access-n77tr\") pod \"network-check-source-56499946bc-wsxkq\" (UID: \"bc2b5894-e142-46da-a815-1939b9390a82\") " pod="openshift-network-diagnostics/network-check-source-56499946bc-wsxkq" Jul 01 19:12:39.307481 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:39.307461 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7d91805f-0e1f-4baa-ba7c-8b0bc1d69b9e-config\") pod \"service-ca-operator-5d7b7dc95c-thr5g\" (UID: \"7d91805f-0e1f-4baa-ba7c-8b0bc1d69b9e\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-thr5g" Jul 01 19:12:39.308919 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:39.308898 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7d91805f-0e1f-4baa-ba7c-8b0bc1d69b9e-serving-cert\") pod \"service-ca-operator-5d7b7dc95c-thr5g\" (UID: \"7d91805f-0e1f-4baa-ba7c-8b0bc1d69b9e\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-thr5g" Jul 01 19:12:39.315536 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:39.315509 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gfqbj\" (UniqueName: \"kubernetes.io/projected/7d91805f-0e1f-4baa-ba7c-8b0bc1d69b9e-kube-api-access-gfqbj\") pod \"service-ca-operator-5d7b7dc95c-thr5g\" (UID: \"7d91805f-0e1f-4baa-ba7c-8b0bc1d69b9e\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-thr5g" Jul 01 19:12:39.407776 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:39.407744 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n77tr\" (UniqueName: \"kubernetes.io/projected/bc2b5894-e142-46da-a815-1939b9390a82-kube-api-access-n77tr\") pod \"network-check-source-56499946bc-wsxkq\" (UID: \"bc2b5894-e142-46da-a815-1939b9390a82\") " pod="openshift-network-diagnostics/network-check-source-56499946bc-wsxkq" Jul 01 19:12:39.414815 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:39.414752 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 01 19:12:39.425753 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:39.425737 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 01 19:12:39.437298 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:39.437277 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n77tr\" (UniqueName: \"kubernetes.io/projected/bc2b5894-e142-46da-a815-1939b9390a82-kube-api-access-n77tr\") pod \"network-check-source-56499946bc-wsxkq\" (UID: \"bc2b5894-e142-46da-a815-1939b9390a82\") " pod="openshift-network-diagnostics/network-check-source-56499946bc-wsxkq" Jul 01 19:12:39.474181 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:39.474146 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-thr5g" Jul 01 19:12:39.578261 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:39.578232 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-56499946bc-wsxkq" Jul 01 19:12:39.593886 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:39.593851 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-thr5g"] Jul 01 19:12:39.599315 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:12:39.599286 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d91805f_0e1f_4baa_ba7c_8b0bc1d69b9e.slice/crio-3bb813303c795840b8471b08497d9118f66453652473c9b9fdaef67ddf7a6be1 WatchSource:0}: Error finding container 3bb813303c795840b8471b08497d9118f66453652473c9b9fdaef67ddf7a6be1: Status 404 returned error can't find the container with id 3bb813303c795840b8471b08497d9118f66453652473c9b9fdaef67ddf7a6be1 Jul 01 19:12:39.702386 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:39.702359 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-56499946bc-wsxkq"] Jul 01 19:12:39.705467 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:12:39.705443 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc2b5894_e142_46da_a815_1939b9390a82.slice/crio-50d793d1079a3e55ed1ffc0c246c054e56dd6b2d4577ad7ecddec3fdcd39df0a WatchSource:0}: Error finding container 50d793d1079a3e55ed1ffc0c246c054e56dd6b2d4577ad7ecddec3fdcd39df0a: Status 404 returned error can't find the container with id 50d793d1079a3e55ed1ffc0c246c054e56dd6b2d4577ad7ecddec3fdcd39df0a Jul 01 19:12:39.710118 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:39.710095 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7329e3ea-d499-46e5-8c07-935a27d6ab99-original-pull-secret\") pod \"global-pull-secret-syncer-2x822\" (UID: \"7329e3ea-d499-46e5-8c07-935a27d6ab99\") " pod="kube-system/global-pull-secret-syncer-2x822" Jul 01 19:12:39.711832 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:39.711815 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 01 19:12:39.722591 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:39.722571 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7329e3ea-d499-46e5-8c07-935a27d6ab99-original-pull-secret\") pod \"global-pull-secret-syncer-2x822\" (UID: \"7329e3ea-d499-46e5-8c07-935a27d6ab99\") " pod="kube-system/global-pull-secret-syncer-2x822" Jul 01 19:12:39.771359 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:39.771337 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-8lhz2_ae718365-8e7b-426d-90ad-74d93647bb51/serve-healthcheck-canary/0.log" Jul 01 19:12:39.810916 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:39.810878 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a30b203c-f4ce-4746-a763-ffde940c4276-metrics-certs\") pod \"network-metrics-daemon-smtsc\" (UID: \"a30b203c-f4ce-4746-a763-ffde940c4276\") " pod="openshift-multus/network-metrics-daemon-smtsc" Jul 01 19:12:39.811066 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:39.810946 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7pl6\" (UniqueName: \"kubernetes.io/projected/2ee3163e-709f-4909-a449-583e66fa3ce5-kube-api-access-p7pl6\") pod \"network-check-target-mv2pp\" (UID: \"2ee3163e-709f-4909-a449-583e66fa3ce5\") " pod="openshift-network-diagnostics/network-check-target-mv2pp" Jul 01 19:12:39.813229 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:39.813210 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 01 19:12:39.813317 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:39.813298 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7pl6\" (UniqueName: \"kubernetes.io/projected/2ee3163e-709f-4909-a449-583e66fa3ce5-kube-api-access-p7pl6\") pod \"network-check-target-mv2pp\" (UID: \"2ee3163e-709f-4909-a449-583e66fa3ce5\") " pod="openshift-network-diagnostics/network-check-target-mv2pp" Jul 01 19:12:39.821996 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:12:39.821973 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 01 19:12:39.822087 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:12:39.822035 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a30b203c-f4ce-4746-a763-ffde940c4276-metrics-certs podName:a30b203c-f4ce-4746-a763-ffde940c4276 nodeName:}" failed. No retries permitted until 2026-07-01 19:13:43.822015848 +0000 UTC m=+130.330456670 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a30b203c-f4ce-4746-a763-ffde940c4276-metrics-certs") pod "network-metrics-daemon-smtsc" (UID: "a30b203c-f4ce-4746-a763-ffde940c4276") : secret "metrics-daemon-secret" not found Jul 01 19:12:39.911834 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:39.911801 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/43534a28-eb76-425e-8c8f-bbb00ab5df95-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zp5ps\" (UID: \"43534a28-eb76-425e-8c8f-bbb00ab5df95\") " pod="openshift-insights/insights-runtime-extractor-zp5ps" Jul 01 19:12:39.911996 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:39.911841 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/43534a28-eb76-425e-8c8f-bbb00ab5df95-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zp5ps\" (UID: \"43534a28-eb76-425e-8c8f-bbb00ab5df95\") " pod="openshift-insights/insights-runtime-extractor-zp5ps" Jul 01 19:12:39.911996 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:12:39.911919 2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 01 19:12:39.911996 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:12:39.911948 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 19:12:39.911996 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:12:39.911986 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/43534a28-eb76-425e-8c8f-bbb00ab5df95-kube-rbac-proxy-cm podName:43534a28-eb76-425e-8c8f-bbb00ab5df95 nodeName:}" failed. No retries permitted until 2026-07-01 19:12:43.911972061 +0000 UTC m=+70.420412864 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/43534a28-eb76-425e-8c8f-bbb00ab5df95-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zp5ps" (UID: "43534a28-eb76-425e-8c8f-bbb00ab5df95") : configmap "kube-rbac-proxy" not found Jul 01 19:12:39.912137 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:12:39.912012 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43534a28-eb76-425e-8c8f-bbb00ab5df95-insights-runtime-extractor-tls podName:43534a28-eb76-425e-8c8f-bbb00ab5df95 nodeName:}" failed. No retries permitted until 2026-07-01 19:12:43.911997825 +0000 UTC m=+70.420438629 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/43534a28-eb76-425e-8c8f-bbb00ab5df95-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zp5ps" (UID: "43534a28-eb76-425e-8c8f-bbb00ab5df95") : secret "insights-runtime-extractor-tls" not found Jul 01 19:12:39.926286 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:39.926256 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-786f9fbc5-vf6jb"] Jul 01 19:12:39.930816 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:39.930796 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-vf6jb" Jul 01 19:12:39.933200 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:39.933179 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 01 19:12:39.933330 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:39.933242 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 01 19:12:39.934300 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:39.934282 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-6rr2p\"" Jul 01 19:12:39.943791 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:39.943773 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-786f9fbc5-vf6jb"] Jul 01 19:12:39.984017 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:39.983947 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2x822" Jul 01 19:12:39.998227 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:39.998204 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-88jrr\"" Jul 01 19:12:40.006780 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:40.006752 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mv2pp" Jul 01 19:12:40.013022 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:40.012981 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mf2tn\" (UniqueName: \"kubernetes.io/projected/8fedee21-609d-4861-8716-4a0d30506016-kube-api-access-mf2tn\") pod \"migrator-786f9fbc5-vf6jb\" (UID: \"8fedee21-609d-4861-8716-4a0d30506016\") " pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-vf6jb" Jul 01 19:12:40.113319 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:40.113290 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-2x822"] Jul 01 19:12:40.113631 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:40.113593 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mf2tn\" (UniqueName: \"kubernetes.io/projected/8fedee21-609d-4861-8716-4a0d30506016-kube-api-access-mf2tn\") pod \"migrator-786f9fbc5-vf6jb\" (UID: \"8fedee21-609d-4861-8716-4a0d30506016\") " pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-vf6jb" Jul 01 19:12:40.117054 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:12:40.117030 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7329e3ea_d499_46e5_8c07_935a27d6ab99.slice/crio-ad2b1d465ccc56fe5c64eb6f6a0bca232d1a2881f973a9e2334f9249bd42b8e5 WatchSource:0}: Error finding container ad2b1d465ccc56fe5c64eb6f6a0bca232d1a2881f973a9e2334f9249bd42b8e5: Status 404 returned error can't find the container with id ad2b1d465ccc56fe5c64eb6f6a0bca232d1a2881f973a9e2334f9249bd42b8e5 Jul 01 19:12:40.123817 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:40.123792 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mf2tn\" (UniqueName: \"kubernetes.io/projected/8fedee21-609d-4861-8716-4a0d30506016-kube-api-access-mf2tn\") pod \"migrator-786f9fbc5-vf6jb\" (UID: \"8fedee21-609d-4861-8716-4a0d30506016\") " pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-vf6jb" Jul 01 19:12:40.134656 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:40.134632 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mv2pp"] Jul 01 19:12:40.138146 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:12:40.138119 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ee3163e_709f_4909_a449_583e66fa3ce5.slice/crio-c4b1cbbf4b2c36df54b7eb07fa24db648f2381da3d287a4ee70233c94a81d9a3 WatchSource:0}: Error finding container c4b1cbbf4b2c36df54b7eb07fa24db648f2381da3d287a4ee70233c94a81d9a3: Status 404 returned error can't find the container with id c4b1cbbf4b2c36df54b7eb07fa24db648f2381da3d287a4ee70233c94a81d9a3 Jul 01 19:12:40.229258 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:40.229221 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-56499946bc-wsxkq" event={"ID":"bc2b5894-e142-46da-a815-1939b9390a82","Type":"ContainerStarted","Data":"50d793d1079a3e55ed1ffc0c246c054e56dd6b2d4577ad7ecddec3fdcd39df0a"} Jul 01 19:12:40.230638 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:40.230594 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-2x822" event={"ID":"7329e3ea-d499-46e5-8c07-935a27d6ab99","Type":"ContainerStarted","Data":"ad2b1d465ccc56fe5c64eb6f6a0bca232d1a2881f973a9e2334f9249bd42b8e5"} Jul 01 19:12:40.232075 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:40.231942 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-thr5g" event={"ID":"7d91805f-0e1f-4baa-ba7c-8b0bc1d69b9e","Type":"ContainerStarted","Data":"3bb813303c795840b8471b08497d9118f66453652473c9b9fdaef67ddf7a6be1"} Jul 01 19:12:40.233437 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:40.233416 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mv2pp" event={"ID":"2ee3163e-709f-4909-a449-583e66fa3ce5","Type":"ContainerStarted","Data":"c4b1cbbf4b2c36df54b7eb07fa24db648f2381da3d287a4ee70233c94a81d9a3"} Jul 01 19:12:40.239967 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:40.239756 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-vf6jb" Jul 01 19:12:40.380129 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:40.380100 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-786f9fbc5-vf6jb"] Jul 01 19:12:40.383516 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:12:40.383491 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fedee21_609d_4861_8716_4a0d30506016.slice/crio-2807adc6a5bae3ab63f44f503735bb5c33a96ea53644b11c521de29c7ba26bd1 WatchSource:0}: Error finding container 2807adc6a5bae3ab63f44f503735bb5c33a96ea53644b11c521de29c7ba26bd1: Status 404 returned error can't find the container with id 2807adc6a5bae3ab63f44f503735bb5c33a96ea53644b11c521de29c7ba26bd1 Jul 01 19:12:40.516933 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:40.516329 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/85b15dc5-328c-41ea-adc4-c0b8fb36d860-metrics-tls\") pod \"dns-default-qndfd\" (UID: \"85b15dc5-328c-41ea-adc4-c0b8fb36d860\") " pod="openshift-dns/dns-default-qndfd" Jul 01 19:12:40.516933 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:12:40.516488 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 19:12:40.516933 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:12:40.516549 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85b15dc5-328c-41ea-adc4-c0b8fb36d860-metrics-tls podName:85b15dc5-328c-41ea-adc4-c0b8fb36d860 nodeName:}" failed. No retries permitted until 2026-07-01 19:13:12.516528662 +0000 UTC m=+99.024969469 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/85b15dc5-328c-41ea-adc4-c0b8fb36d860-metrics-tls") pod "dns-default-qndfd" (UID: "85b15dc5-328c-41ea-adc4-c0b8fb36d860") : secret "dns-default-metrics-tls" not found Jul 01 19:12:41.240525 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:41.240393 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-vf6jb" event={"ID":"8fedee21-609d-4861-8716-4a0d30506016","Type":"ContainerStarted","Data":"2807adc6a5bae3ab63f44f503735bb5c33a96ea53644b11c521de29c7ba26bd1"} Jul 01 19:12:43.231642 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:43.231604 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6cdb5968b9-pznw2"] Jul 01 19:12:43.261548 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:43.261513 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cdb5968b9-pznw2"] Jul 01 19:12:43.261720 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:43.261633 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cdb5968b9-pznw2" Jul 01 19:12:43.263653 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:43.263566 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 01 19:12:43.263943 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:43.263826 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-xv8hp\"" Jul 01 19:12:43.263943 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:43.263835 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 01 19:12:43.340935 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:43.340895 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/892a8a50-8bf0-43e5-adc3-613a9dd16e33-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-pznw2\" (UID: \"892a8a50-8bf0-43e5-adc3-613a9dd16e33\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-pznw2" Jul 01 19:12:43.341125 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:43.341050 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/892a8a50-8bf0-43e5-adc3-613a9dd16e33-nginx-conf\") pod \"networking-console-plugin-6cdb5968b9-pznw2\" (UID: \"892a8a50-8bf0-43e5-adc3-613a9dd16e33\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-pznw2" Jul 01 19:12:43.441879 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:43.441841 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/892a8a50-8bf0-43e5-adc3-613a9dd16e33-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-pznw2\" (UID: \"892a8a50-8bf0-43e5-adc3-613a9dd16e33\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-pznw2" Jul 01 19:12:43.442068 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:43.441916 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/892a8a50-8bf0-43e5-adc3-613a9dd16e33-nginx-conf\") pod \"networking-console-plugin-6cdb5968b9-pznw2\" (UID: \"892a8a50-8bf0-43e5-adc3-613a9dd16e33\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-pznw2" Jul 01 19:12:43.442068 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:12:43.442024 2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 01 19:12:43.442160 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:12:43.442116 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/892a8a50-8bf0-43e5-adc3-613a9dd16e33-networking-console-plugin-cert podName:892a8a50-8bf0-43e5-adc3-613a9dd16e33 nodeName:}" failed. No retries permitted until 2026-07-01 19:12:43.942079928 +0000 UTC m=+70.450520736 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/892a8a50-8bf0-43e5-adc3-613a9dd16e33-networking-console-plugin-cert") pod "networking-console-plugin-6cdb5968b9-pznw2" (UID: "892a8a50-8bf0-43e5-adc3-613a9dd16e33") : secret "networking-console-plugin-cert" not found Jul 01 19:12:43.442628 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:43.442602 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/892a8a50-8bf0-43e5-adc3-613a9dd16e33-nginx-conf\") pod \"networking-console-plugin-6cdb5968b9-pznw2\" (UID: \"892a8a50-8bf0-43e5-adc3-613a9dd16e33\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-pznw2" Jul 01 19:12:43.946479 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:43.946447 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/43534a28-eb76-425e-8c8f-bbb00ab5df95-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zp5ps\" (UID: \"43534a28-eb76-425e-8c8f-bbb00ab5df95\") " pod="openshift-insights/insights-runtime-extractor-zp5ps" Jul 01 19:12:43.946620 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:43.946529 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/43534a28-eb76-425e-8c8f-bbb00ab5df95-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zp5ps\" (UID: \"43534a28-eb76-425e-8c8f-bbb00ab5df95\") " pod="openshift-insights/insights-runtime-extractor-zp5ps" Jul 01 19:12:43.946620 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:43.946561 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/892a8a50-8bf0-43e5-adc3-613a9dd16e33-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-pznw2\" (UID: \"892a8a50-8bf0-43e5-adc3-613a9dd16e33\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-pznw2" Jul 01 19:12:43.946682 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:12:43.946624 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 19:12:43.946682 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:12:43.946652 2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 01 19:12:43.946682 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:12:43.946662 2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 01 19:12:43.946770 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:12:43.946693 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43534a28-eb76-425e-8c8f-bbb00ab5df95-insights-runtime-extractor-tls podName:43534a28-eb76-425e-8c8f-bbb00ab5df95 nodeName:}" failed. No retries permitted until 2026-07-01 19:12:51.946675533 +0000 UTC m=+78.455116363 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/43534a28-eb76-425e-8c8f-bbb00ab5df95-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zp5ps" (UID: "43534a28-eb76-425e-8c8f-bbb00ab5df95") : secret "insights-runtime-extractor-tls" not found Jul 01 19:12:43.946770 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:12:43.946710 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/892a8a50-8bf0-43e5-adc3-613a9dd16e33-networking-console-plugin-cert podName:892a8a50-8bf0-43e5-adc3-613a9dd16e33 nodeName:}" failed. No retries permitted until 2026-07-01 19:12:44.946703754 +0000 UTC m=+71.455144564 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/892a8a50-8bf0-43e5-adc3-613a9dd16e33-networking-console-plugin-cert") pod "networking-console-plugin-6cdb5968b9-pznw2" (UID: "892a8a50-8bf0-43e5-adc3-613a9dd16e33") : secret "networking-console-plugin-cert" not found Jul 01 19:12:43.946770 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:12:43.946721 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/43534a28-eb76-425e-8c8f-bbb00ab5df95-kube-rbac-proxy-cm podName:43534a28-eb76-425e-8c8f-bbb00ab5df95 nodeName:}" failed. No retries permitted until 2026-07-01 19:12:51.946714411 +0000 UTC m=+78.455155217 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/43534a28-eb76-425e-8c8f-bbb00ab5df95-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zp5ps" (UID: "43534a28-eb76-425e-8c8f-bbb00ab5df95") : configmap "kube-rbac-proxy" not found Jul 01 19:12:44.953913 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:44.953875 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/892a8a50-8bf0-43e5-adc3-613a9dd16e33-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-pznw2\" (UID: \"892a8a50-8bf0-43e5-adc3-613a9dd16e33\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-pznw2" Jul 01 19:12:44.954316 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:12:44.954061 2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 01 19:12:44.954316 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:12:44.954128 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/892a8a50-8bf0-43e5-adc3-613a9dd16e33-networking-console-plugin-cert podName:892a8a50-8bf0-43e5-adc3-613a9dd16e33 nodeName:}" failed. No retries permitted until 2026-07-01 19:12:46.954108983 +0000 UTC m=+73.462549787 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/892a8a50-8bf0-43e5-adc3-613a9dd16e33-networking-console-plugin-cert") pod "networking-console-plugin-6cdb5968b9-pznw2" (UID: "892a8a50-8bf0-43e5-adc3-613a9dd16e33") : secret "networking-console-plugin-cert" not found Jul 01 19:12:46.257893 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:46.257848 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-2x822" event={"ID":"7329e3ea-d499-46e5-8c07-935a27d6ab99","Type":"ContainerStarted","Data":"a84637e547a7b5e79ad0b06325c186133bb5053eca36c73d0c2c68ee7b88e882"} Jul 01 19:12:46.259350 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:46.259325 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-thr5g" event={"ID":"7d91805f-0e1f-4baa-ba7c-8b0bc1d69b9e","Type":"ContainerStarted","Data":"b1da47d4e5bb7b8e46a09f82aeab62a6db8254c8cd7867adbae5ccef56bd8745"} Jul 01 19:12:46.261211 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:46.261185 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-vf6jb" event={"ID":"8fedee21-609d-4861-8716-4a0d30506016","Type":"ContainerStarted","Data":"765dba6f80882f867196bdb05a0d0775535317b12f7f8ac20756e25a30423cfe"} Jul 01 19:12:46.261308 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:46.261234 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-vf6jb" event={"ID":"8fedee21-609d-4861-8716-4a0d30506016","Type":"ContainerStarted","Data":"6b78de46576e74bc2d3dd318aae69cb2a5038ffbbc03237955e46140cbb4698d"} Jul 01 19:12:46.262760 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:46.262740 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mv2pp" event={"ID":"2ee3163e-709f-4909-a449-583e66fa3ce5","Type":"ContainerStarted","Data":"56eeb26b1df7d1521150e7eff85459dea44d8d90c1f88cd42771b89472dc72bc"} Jul 01 19:12:46.262875 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:46.262851 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-mv2pp" Jul 01 19:12:46.264211 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:46.264189 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-56499946bc-wsxkq" event={"ID":"bc2b5894-e142-46da-a815-1939b9390a82","Type":"ContainerStarted","Data":"dd2a3d8f90f08ef6c0204edc236f09ad3ef426e189769855f909fa2b631acc20"} Jul 01 19:12:46.273437 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:46.273392 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-2x822" podStartSLOduration=66.891967286 podStartE2EDuration="1m12.273375163s" totalImagesPullingTime="5.381407877s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:11:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:12:46.271597952 +0000 UTC m=+72.780038778" watchObservedRunningTime="2026-07-01 19:12:46.273375163 +0000 UTC m=+72.781815993" Jul 01 19:12:46.288401 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:46.288354 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-thr5g" podStartSLOduration=1.406890041 podStartE2EDuration="7.288338627s" totalImagesPullingTime="5.881448586s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:12:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:12:46.288049712 +0000 UTC m=+72.796490539" watchObservedRunningTime="2026-07-01 19:12:46.288338627 +0000 UTC m=+72.796779454" Jul 01 19:12:46.302537 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:46.302489 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-56499946bc-wsxkq" podStartSLOduration=1.519145146 podStartE2EDuration="7.302472283s" totalImagesPullingTime="5.783327137s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:12:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:12:46.301063047 +0000 UTC m=+72.809503874" watchObservedRunningTime="2026-07-01 19:12:46.302472283 +0000 UTC m=+72.810913110" Jul 01 19:12:46.318739 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:46.318699 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-mv2pp" podStartSLOduration=66.95745161400001 podStartE2EDuration="1m12.318688153s" totalImagesPullingTime="5.361236539s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:11:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:12:46.318030974 +0000 UTC m=+72.826471821" watchObservedRunningTime="2026-07-01 19:12:46.318688153 +0000 UTC m=+72.827128979" Jul 01 19:12:46.332653 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:46.332599 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-vf6jb" podStartSLOduration=2.233071571 podStartE2EDuration="7.332581313s" totalImagesPullingTime="5.099509742s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:12:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:12:46.33102533 +0000 UTC m=+72.839466175" watchObservedRunningTime="2026-07-01 19:12:46.332581313 +0000 UTC m=+72.841022140" Jul 01 19:12:46.970407 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:46.970363 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/892a8a50-8bf0-43e5-adc3-613a9dd16e33-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-pznw2\" (UID: \"892a8a50-8bf0-43e5-adc3-613a9dd16e33\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-pznw2" Jul 01 19:12:46.970609 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:12:46.970499 2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 01 19:12:46.970609 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:12:46.970568 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/892a8a50-8bf0-43e5-adc3-613a9dd16e33-networking-console-plugin-cert podName:892a8a50-8bf0-43e5-adc3-613a9dd16e33 nodeName:}" failed. No retries permitted until 2026-07-01 19:12:50.970549092 +0000 UTC m=+77.478989896 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/892a8a50-8bf0-43e5-adc3-613a9dd16e33-networking-console-plugin-cert") pod "networking-console-plugin-6cdb5968b9-pznw2" (UID: "892a8a50-8bf0-43e5-adc3-613a9dd16e33") : secret "networking-console-plugin-cert" not found Jul 01 19:12:51.000741 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:51.000700 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/892a8a50-8bf0-43e5-adc3-613a9dd16e33-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-pznw2\" (UID: \"892a8a50-8bf0-43e5-adc3-613a9dd16e33\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-pznw2" Jul 01 19:12:51.001150 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:12:51.000855 2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 01 19:12:51.001150 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:12:51.000920 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/892a8a50-8bf0-43e5-adc3-613a9dd16e33-networking-console-plugin-cert podName:892a8a50-8bf0-43e5-adc3-613a9dd16e33 nodeName:}" failed. No retries permitted until 2026-07-01 19:12:59.00090391 +0000 UTC m=+85.509344746 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/892a8a50-8bf0-43e5-adc3-613a9dd16e33-networking-console-plugin-cert") pod "networking-console-plugin-6cdb5968b9-pznw2" (UID: "892a8a50-8bf0-43e5-adc3-613a9dd16e33") : secret "networking-console-plugin-cert" not found Jul 01 19:12:52.007708 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:52.007675 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/43534a28-eb76-425e-8c8f-bbb00ab5df95-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zp5ps\" (UID: \"43534a28-eb76-425e-8c8f-bbb00ab5df95\") " pod="openshift-insights/insights-runtime-extractor-zp5ps" Jul 01 19:12:52.008096 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:52.007733 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/43534a28-eb76-425e-8c8f-bbb00ab5df95-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zp5ps\" (UID: \"43534a28-eb76-425e-8c8f-bbb00ab5df95\") " pod="openshift-insights/insights-runtime-extractor-zp5ps" Jul 01 19:12:52.008096 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:12:52.007835 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 19:12:52.008096 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:12:52.007884 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43534a28-eb76-425e-8c8f-bbb00ab5df95-insights-runtime-extractor-tls podName:43534a28-eb76-425e-8c8f-bbb00ab5df95 nodeName:}" failed. No retries permitted until 2026-07-01 19:13:08.007871634 +0000 UTC m=+94.516312437 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/43534a28-eb76-425e-8c8f-bbb00ab5df95-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zp5ps" (UID: "43534a28-eb76-425e-8c8f-bbb00ab5df95") : secret "insights-runtime-extractor-tls" not found Jul 01 19:12:52.008206 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:52.008189 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/43534a28-eb76-425e-8c8f-bbb00ab5df95-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zp5ps\" (UID: \"43534a28-eb76-425e-8c8f-bbb00ab5df95\") " pod="openshift-insights/insights-runtime-extractor-zp5ps" Jul 01 19:12:59.066076 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:12:59.065917 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/892a8a50-8bf0-43e5-adc3-613a9dd16e33-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-pznw2\" (UID: \"892a8a50-8bf0-43e5-adc3-613a9dd16e33\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-pznw2" Jul 01 19:12:59.066076 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:12:59.066068 2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 01 19:12:59.066480 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:12:59.066132 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/892a8a50-8bf0-43e5-adc3-613a9dd16e33-networking-console-plugin-cert podName:892a8a50-8bf0-43e5-adc3-613a9dd16e33 nodeName:}" failed. No retries permitted until 2026-07-01 19:13:15.066115416 +0000 UTC m=+101.574556233 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/892a8a50-8bf0-43e5-adc3-613a9dd16e33-networking-console-plugin-cert") pod "networking-console-plugin-6cdb5968b9-pznw2" (UID: "892a8a50-8bf0-43e5-adc3-613a9dd16e33") : secret "networking-console-plugin-cert" not found Jul 01 19:13:08.036313 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:08.036275 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/43534a28-eb76-425e-8c8f-bbb00ab5df95-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zp5ps\" (UID: \"43534a28-eb76-425e-8c8f-bbb00ab5df95\") " pod="openshift-insights/insights-runtime-extractor-zp5ps" Jul 01 19:13:08.038485 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:08.038463 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/43534a28-eb76-425e-8c8f-bbb00ab5df95-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zp5ps\" (UID: \"43534a28-eb76-425e-8c8f-bbb00ab5df95\") " pod="openshift-insights/insights-runtime-extractor-zp5ps" Jul 01 19:13:08.320588 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:08.320504 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-zp5ps" Jul 01 19:13:08.441459 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:08.441431 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-zp5ps"] Jul 01 19:13:08.444886 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:13:08.444861 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43534a28_eb76_425e_8c8f_bbb00ab5df95.slice/crio-308b46f14c7b0d6bd30f24ac5174620691a9eadead206a10d2cb60cfac2db270 WatchSource:0}: Error finding container 308b46f14c7b0d6bd30f24ac5174620691a9eadead206a10d2cb60cfac2db270: Status 404 returned error can't find the container with id 308b46f14c7b0d6bd30f24ac5174620691a9eadead206a10d2cb60cfac2db270 Jul 01 19:13:09.336691 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:09.336651 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zp5ps" event={"ID":"43534a28-eb76-425e-8c8f-bbb00ab5df95","Type":"ContainerStarted","Data":"308b46f14c7b0d6bd30f24ac5174620691a9eadead206a10d2cb60cfac2db270"} Jul 01 19:13:09.444780 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:09.444657 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-768b647755-nv6rr"] Jul 01 19:13:09.447635 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:09.447251 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-768b647755-nv6rr" Jul 01 19:13:09.449135 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:09.449108 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 01 19:13:09.451761 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:09.451571 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 01 19:13:09.457638 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:09.457403 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 01 19:13:09.457638 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:09.457450 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 01 19:13:09.460589 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:09.460558 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 01 19:13:09.461242 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:09.461220 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 01 19:13:09.461890 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:09.461873 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 01 19:13:09.470813 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:09.470793 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-768b647755-nv6rr"] Jul 01 19:13:09.547291 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:09.547258 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/eea10a40-468c-4742-b7b7-28872c3452e2-ca\") pod \"cluster-proxy-proxy-agent-768b647755-nv6rr\" (UID: \"eea10a40-468c-4742-b7b7-28872c3452e2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-768b647755-nv6rr" Jul 01 19:13:09.547456 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:09.547380 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5psrh\" (UniqueName: \"kubernetes.io/projected/eea10a40-468c-4742-b7b7-28872c3452e2-kube-api-access-5psrh\") pod \"cluster-proxy-proxy-agent-768b647755-nv6rr\" (UID: \"eea10a40-468c-4742-b7b7-28872c3452e2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-768b647755-nv6rr" Jul 01 19:13:09.547521 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:09.547465 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/eea10a40-468c-4742-b7b7-28872c3452e2-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-768b647755-nv6rr\" (UID: \"eea10a40-468c-4742-b7b7-28872c3452e2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-768b647755-nv6rr" Jul 01 19:13:09.547521 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:09.547497 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/eea10a40-468c-4742-b7b7-28872c3452e2-hub\") pod \"cluster-proxy-proxy-agent-768b647755-nv6rr\" (UID: \"eea10a40-468c-4742-b7b7-28872c3452e2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-768b647755-nv6rr" Jul 01 19:13:09.547629 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:09.547578 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/eea10a40-468c-4742-b7b7-28872c3452e2-additional-service-ca\") pod \"cluster-proxy-proxy-agent-768b647755-nv6rr\" (UID: \"eea10a40-468c-4742-b7b7-28872c3452e2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-768b647755-nv6rr" Jul 01 19:13:09.547629 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:09.547608 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/eea10a40-468c-4742-b7b7-28872c3452e2-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-768b647755-nv6rr\" (UID: \"eea10a40-468c-4742-b7b7-28872c3452e2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-768b647755-nv6rr" Jul 01 19:13:09.566445 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:09.566414 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-86b6c6f876-9bvzg"] Jul 01 19:13:09.568731 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:09.568712 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-86b6c6f876-9bvzg" Jul 01 19:13:09.572826 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:09.572798 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 01 19:13:09.573516 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:09.573497 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 01 19:13:09.573966 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:09.573935 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-qj9pz\"" Jul 01 19:13:09.574556 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:09.574521 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 01 19:13:09.579700 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:09.579621 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 01 19:13:09.589294 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:09.589234 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-86b6c6f876-9bvzg"] Jul 01 19:13:09.648836 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:09.648805 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/eea10a40-468c-4742-b7b7-28872c3452e2-hub\") pod \"cluster-proxy-proxy-agent-768b647755-nv6rr\" (UID: \"eea10a40-468c-4742-b7b7-28872c3452e2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-768b647755-nv6rr" Jul 01 19:13:09.649031 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:09.648870 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/eea10a40-468c-4742-b7b7-28872c3452e2-additional-service-ca\") pod \"cluster-proxy-proxy-agent-768b647755-nv6rr\" (UID: \"eea10a40-468c-4742-b7b7-28872c3452e2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-768b647755-nv6rr" Jul 01 19:13:09.649108 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:09.649028 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/eea10a40-468c-4742-b7b7-28872c3452e2-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-768b647755-nv6rr\" (UID: \"eea10a40-468c-4742-b7b7-28872c3452e2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-768b647755-nv6rr" Jul 01 19:13:09.649108 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:09.649100 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/eea10a40-468c-4742-b7b7-28872c3452e2-ca\") pod \"cluster-proxy-proxy-agent-768b647755-nv6rr\" (UID: \"eea10a40-468c-4742-b7b7-28872c3452e2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-768b647755-nv6rr" Jul 01 19:13:09.649229 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:09.649182 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5psrh\" (UniqueName: \"kubernetes.io/projected/eea10a40-468c-4742-b7b7-28872c3452e2-kube-api-access-5psrh\") pod \"cluster-proxy-proxy-agent-768b647755-nv6rr\" (UID: \"eea10a40-468c-4742-b7b7-28872c3452e2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-768b647755-nv6rr" Jul 01 19:13:09.649289 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:09.649259 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/eea10a40-468c-4742-b7b7-28872c3452e2-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-768b647755-nv6rr\" (UID: \"eea10a40-468c-4742-b7b7-28872c3452e2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-768b647755-nv6rr" Jul 01 19:13:09.649677 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:09.649626 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/eea10a40-468c-4742-b7b7-28872c3452e2-additional-service-ca\") pod \"cluster-proxy-proxy-agent-768b647755-nv6rr\" (UID: \"eea10a40-468c-4742-b7b7-28872c3452e2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-768b647755-nv6rr" Jul 01 19:13:09.651825 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:09.651802 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/eea10a40-468c-4742-b7b7-28872c3452e2-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-768b647755-nv6rr\" (UID: \"eea10a40-468c-4742-b7b7-28872c3452e2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-768b647755-nv6rr" Jul 01 19:13:09.652067 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:09.652045 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/eea10a40-468c-4742-b7b7-28872c3452e2-hub\") pod \"cluster-proxy-proxy-agent-768b647755-nv6rr\" (UID: \"eea10a40-468c-4742-b7b7-28872c3452e2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-768b647755-nv6rr" Jul 01 19:13:09.652291 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:09.652268 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/eea10a40-468c-4742-b7b7-28872c3452e2-ca\") pod \"cluster-proxy-proxy-agent-768b647755-nv6rr\" (UID: \"eea10a40-468c-4742-b7b7-28872c3452e2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-768b647755-nv6rr" Jul 01 19:13:09.652522 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:09.652500 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/eea10a40-468c-4742-b7b7-28872c3452e2-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-768b647755-nv6rr\" (UID: \"eea10a40-468c-4742-b7b7-28872c3452e2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-768b647755-nv6rr" Jul 01 19:13:09.657132 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:09.657106 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5psrh\" (UniqueName: \"kubernetes.io/projected/eea10a40-468c-4742-b7b7-28872c3452e2-kube-api-access-5psrh\") pod \"cluster-proxy-proxy-agent-768b647755-nv6rr\" (UID: \"eea10a40-468c-4742-b7b7-28872c3452e2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-768b647755-nv6rr" Jul 01 19:13:09.750901 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:09.750864 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e1817756-11b6-4955-b3b3-db0279608fe2-registry-certificates\") pod \"image-registry-86b6c6f876-9bvzg\" (UID: \"e1817756-11b6-4955-b3b3-db0279608fe2\") " pod="openshift-image-registry/image-registry-86b6c6f876-9bvzg" Jul 01 19:13:09.750901 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:09.750903 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e1817756-11b6-4955-b3b3-db0279608fe2-bound-sa-token\") pod \"image-registry-86b6c6f876-9bvzg\" (UID: \"e1817756-11b6-4955-b3b3-db0279608fe2\") " pod="openshift-image-registry/image-registry-86b6c6f876-9bvzg" Jul 01 19:13:09.751155 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:09.750932 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e1817756-11b6-4955-b3b3-db0279608fe2-registry-tls\") pod \"image-registry-86b6c6f876-9bvzg\" (UID: \"e1817756-11b6-4955-b3b3-db0279608fe2\") " pod="openshift-image-registry/image-registry-86b6c6f876-9bvzg" Jul 01 19:13:09.751155 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:09.751015 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e1817756-11b6-4955-b3b3-db0279608fe2-installation-pull-secrets\") pod \"image-registry-86b6c6f876-9bvzg\" (UID: \"e1817756-11b6-4955-b3b3-db0279608fe2\") " pod="openshift-image-registry/image-registry-86b6c6f876-9bvzg" Jul 01 19:13:09.751263 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:09.751149 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e1817756-11b6-4955-b3b3-db0279608fe2-trusted-ca\") pod \"image-registry-86b6c6f876-9bvzg\" (UID: \"e1817756-11b6-4955-b3b3-db0279608fe2\") " pod="openshift-image-registry/image-registry-86b6c6f876-9bvzg" Jul 01 19:13:09.751263 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:09.751190 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e1817756-11b6-4955-b3b3-db0279608fe2-ca-trust-extracted\") pod \"image-registry-86b6c6f876-9bvzg\" (UID: \"e1817756-11b6-4955-b3b3-db0279608fe2\") " pod="openshift-image-registry/image-registry-86b6c6f876-9bvzg" Jul 01 19:13:09.751263 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:09.751222 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e1817756-11b6-4955-b3b3-db0279608fe2-image-registry-private-configuration\") pod \"image-registry-86b6c6f876-9bvzg\" (UID: \"e1817756-11b6-4955-b3b3-db0279608fe2\") " pod="openshift-image-registry/image-registry-86b6c6f876-9bvzg" Jul 01 19:13:09.751410 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:09.751277 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4kk8v\" (UniqueName: \"kubernetes.io/projected/e1817756-11b6-4955-b3b3-db0279608fe2-kube-api-access-4kk8v\") pod \"image-registry-86b6c6f876-9bvzg\" (UID: \"e1817756-11b6-4955-b3b3-db0279608fe2\") " pod="openshift-image-registry/image-registry-86b6c6f876-9bvzg" Jul 01 19:13:09.768990 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:09.768967 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-768b647755-nv6rr" Jul 01 19:13:09.852645 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:09.851870 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4kk8v\" (UniqueName: \"kubernetes.io/projected/e1817756-11b6-4955-b3b3-db0279608fe2-kube-api-access-4kk8v\") pod \"image-registry-86b6c6f876-9bvzg\" (UID: \"e1817756-11b6-4955-b3b3-db0279608fe2\") " pod="openshift-image-registry/image-registry-86b6c6f876-9bvzg" Jul 01 19:13:09.852645 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:09.851933 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e1817756-11b6-4955-b3b3-db0279608fe2-registry-certificates\") pod \"image-registry-86b6c6f876-9bvzg\" (UID: \"e1817756-11b6-4955-b3b3-db0279608fe2\") " pod="openshift-image-registry/image-registry-86b6c6f876-9bvzg" Jul 01 19:13:09.852645 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:09.851984 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e1817756-11b6-4955-b3b3-db0279608fe2-bound-sa-token\") pod \"image-registry-86b6c6f876-9bvzg\" (UID: \"e1817756-11b6-4955-b3b3-db0279608fe2\") " pod="openshift-image-registry/image-registry-86b6c6f876-9bvzg" Jul 01 19:13:09.852645 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:09.852038 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e1817756-11b6-4955-b3b3-db0279608fe2-registry-tls\") pod \"image-registry-86b6c6f876-9bvzg\" (UID: \"e1817756-11b6-4955-b3b3-db0279608fe2\") " pod="openshift-image-registry/image-registry-86b6c6f876-9bvzg" Jul 01 19:13:09.852645 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:09.852076 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e1817756-11b6-4955-b3b3-db0279608fe2-installation-pull-secrets\") pod \"image-registry-86b6c6f876-9bvzg\" (UID: \"e1817756-11b6-4955-b3b3-db0279608fe2\") " pod="openshift-image-registry/image-registry-86b6c6f876-9bvzg" Jul 01 19:13:09.852645 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:09.852120 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e1817756-11b6-4955-b3b3-db0279608fe2-trusted-ca\") pod \"image-registry-86b6c6f876-9bvzg\" (UID: \"e1817756-11b6-4955-b3b3-db0279608fe2\") " pod="openshift-image-registry/image-registry-86b6c6f876-9bvzg" Jul 01 19:13:09.852645 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:09.852151 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e1817756-11b6-4955-b3b3-db0279608fe2-ca-trust-extracted\") pod \"image-registry-86b6c6f876-9bvzg\" (UID: \"e1817756-11b6-4955-b3b3-db0279608fe2\") " pod="openshift-image-registry/image-registry-86b6c6f876-9bvzg" Jul 01 19:13:09.852645 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:09.852189 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e1817756-11b6-4955-b3b3-db0279608fe2-image-registry-private-configuration\") pod \"image-registry-86b6c6f876-9bvzg\" (UID: \"e1817756-11b6-4955-b3b3-db0279608fe2\") " pod="openshift-image-registry/image-registry-86b6c6f876-9bvzg" Jul 01 19:13:09.854343 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:09.853427 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e1817756-11b6-4955-b3b3-db0279608fe2-trusted-ca\") pod \"image-registry-86b6c6f876-9bvzg\" (UID: \"e1817756-11b6-4955-b3b3-db0279608fe2\") " pod="openshift-image-registry/image-registry-86b6c6f876-9bvzg" Jul 01 19:13:09.854343 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:09.854209 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e1817756-11b6-4955-b3b3-db0279608fe2-registry-certificates\") pod \"image-registry-86b6c6f876-9bvzg\" (UID: \"e1817756-11b6-4955-b3b3-db0279608fe2\") " pod="openshift-image-registry/image-registry-86b6c6f876-9bvzg" Jul 01 19:13:09.854343 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:09.854300 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e1817756-11b6-4955-b3b3-db0279608fe2-ca-trust-extracted\") pod \"image-registry-86b6c6f876-9bvzg\" (UID: \"e1817756-11b6-4955-b3b3-db0279608fe2\") " pod="openshift-image-registry/image-registry-86b6c6f876-9bvzg" Jul 01 19:13:09.855704 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:09.855668 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e1817756-11b6-4955-b3b3-db0279608fe2-image-registry-private-configuration\") pod \"image-registry-86b6c6f876-9bvzg\" (UID: \"e1817756-11b6-4955-b3b3-db0279608fe2\") " pod="openshift-image-registry/image-registry-86b6c6f876-9bvzg" Jul 01 19:13:09.856555 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:09.856459 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e1817756-11b6-4955-b3b3-db0279608fe2-installation-pull-secrets\") pod \"image-registry-86b6c6f876-9bvzg\" (UID: \"e1817756-11b6-4955-b3b3-db0279608fe2\") " pod="openshift-image-registry/image-registry-86b6c6f876-9bvzg" Jul 01 19:13:09.857148 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:09.857107 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e1817756-11b6-4955-b3b3-db0279608fe2-registry-tls\") pod \"image-registry-86b6c6f876-9bvzg\" (UID: \"e1817756-11b6-4955-b3b3-db0279608fe2\") " pod="openshift-image-registry/image-registry-86b6c6f876-9bvzg" Jul 01 19:13:09.871838 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:09.871812 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e1817756-11b6-4955-b3b3-db0279608fe2-bound-sa-token\") pod \"image-registry-86b6c6f876-9bvzg\" (UID: \"e1817756-11b6-4955-b3b3-db0279608fe2\") " pod="openshift-image-registry/image-registry-86b6c6f876-9bvzg" Jul 01 19:13:09.872440 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:09.872421 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4kk8v\" (UniqueName: \"kubernetes.io/projected/e1817756-11b6-4955-b3b3-db0279608fe2-kube-api-access-4kk8v\") pod \"image-registry-86b6c6f876-9bvzg\" (UID: \"e1817756-11b6-4955-b3b3-db0279608fe2\") " pod="openshift-image-registry/image-registry-86b6c6f876-9bvzg" Jul 01 19:13:09.880210 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:09.880190 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-86b6c6f876-9bvzg" Jul 01 19:13:09.913893 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:09.913854 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-768b647755-nv6rr"] Jul 01 19:13:09.917232 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:13:09.917195 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podeea10a40_468c_4742_b7b7_28872c3452e2.slice/crio-d01b4079116e5251fb0c21bf8b3cfc7267bf9bd4d40db823d85b23836e06c6d1 WatchSource:0}: Error finding container d01b4079116e5251fb0c21bf8b3cfc7267bf9bd4d40db823d85b23836e06c6d1: Status 404 returned error can't find the container with id d01b4079116e5251fb0c21bf8b3cfc7267bf9bd4d40db823d85b23836e06c6d1 Jul 01 19:13:10.018790 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:10.018761 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-86b6c6f876-9bvzg"] Jul 01 19:13:10.021530 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:13:10.021494 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1817756_11b6_4955_b3b3_db0279608fe2.slice/crio-e1dfd67d11e1a61080247d4b075c65b8d9f56a47138b3f5c3fa47246e6dc5048 WatchSource:0}: Error finding container e1dfd67d11e1a61080247d4b075c65b8d9f56a47138b3f5c3fa47246e6dc5048: Status 404 returned error can't find the container with id e1dfd67d11e1a61080247d4b075c65b8d9f56a47138b3f5c3fa47246e6dc5048 Jul 01 19:13:10.347386 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:10.347348 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-86b6c6f876-9bvzg" event={"ID":"e1817756-11b6-4955-b3b3-db0279608fe2","Type":"ContainerStarted","Data":"0db43c924384468a739f0ba6ba4876da14c271e99804c5b3bcb68d5192686962"} Jul 01 19:13:10.347813 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:10.347437 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-86b6c6f876-9bvzg" event={"ID":"e1817756-11b6-4955-b3b3-db0279608fe2","Type":"ContainerStarted","Data":"e1dfd67d11e1a61080247d4b075c65b8d9f56a47138b3f5c3fa47246e6dc5048"} Jul 01 19:13:10.347813 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:10.347464 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-86b6c6f876-9bvzg" Jul 01 19:13:10.348792 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:10.348770 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-768b647755-nv6rr" event={"ID":"eea10a40-468c-4742-b7b7-28872c3452e2","Type":"ContainerStarted","Data":"d01b4079116e5251fb0c21bf8b3cfc7267bf9bd4d40db823d85b23836e06c6d1"} Jul 01 19:13:10.366113 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:10.366064 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-86b6c6f876-9bvzg" podStartSLOduration=1.366047833 podStartE2EDuration="1.366047833s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:13:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:13:10.365022514 +0000 UTC m=+96.873463367" watchObservedRunningTime="2026-07-01 19:13:10.366047833 +0000 UTC m=+96.874488663" Jul 01 19:13:12.357844 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:12.357811 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zp5ps" event={"ID":"43534a28-eb76-425e-8c8f-bbb00ab5df95","Type":"ContainerStarted","Data":"1ca32e7adbab34b4c104f12a279bf95cb9a4c8b6c605e4aee36abb9fd0172c17"} Jul 01 19:13:12.576696 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:12.576613 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/85b15dc5-328c-41ea-adc4-c0b8fb36d860-metrics-tls\") pod \"dns-default-qndfd\" (UID: \"85b15dc5-328c-41ea-adc4-c0b8fb36d860\") " pod="openshift-dns/dns-default-qndfd" Jul 01 19:13:12.579349 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:12.579327 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/85b15dc5-328c-41ea-adc4-c0b8fb36d860-metrics-tls\") pod \"dns-default-qndfd\" (UID: \"85b15dc5-328c-41ea-adc4-c0b8fb36d860\") " pod="openshift-dns/dns-default-qndfd" Jul 01 19:13:12.811179 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:12.811141 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6ddhd\"" Jul 01 19:13:12.819606 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:12.819581 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qndfd" Jul 01 19:13:12.967450 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:12.967373 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qndfd"] Jul 01 19:13:12.977574 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:13:12.977544 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85b15dc5_328c_41ea_adc4_c0b8fb36d860.slice/crio-8767d04112a2fa2903b8115cbf42fcad2438966f31084ef7a353b957b02c7d64 WatchSource:0}: Error finding container 8767d04112a2fa2903b8115cbf42fcad2438966f31084ef7a353b957b02c7d64: Status 404 returned error can't find the container with id 8767d04112a2fa2903b8115cbf42fcad2438966f31084ef7a353b957b02c7d64 Jul 01 19:13:13.362752 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:13.362669 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qndfd" event={"ID":"85b15dc5-328c-41ea-adc4-c0b8fb36d860","Type":"ContainerStarted","Data":"8767d04112a2fa2903b8115cbf42fcad2438966f31084ef7a353b957b02c7d64"} Jul 01 19:13:13.364651 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:13.364625 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zp5ps" event={"ID":"43534a28-eb76-425e-8c8f-bbb00ab5df95","Type":"ContainerStarted","Data":"92c7c5d02120b19356dd18e0d69f1a137762f64f6c5efe100217c752ff1c002b"} Jul 01 19:13:15.096879 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:15.096840 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/892a8a50-8bf0-43e5-adc3-613a9dd16e33-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-pznw2\" (UID: \"892a8a50-8bf0-43e5-adc3-613a9dd16e33\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-pznw2" Jul 01 19:13:15.099582 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:15.099554 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/892a8a50-8bf0-43e5-adc3-613a9dd16e33-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-pznw2\" (UID: \"892a8a50-8bf0-43e5-adc3-613a9dd16e33\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-pznw2" Jul 01 19:13:15.372116 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:15.372030 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cdb5968b9-pznw2" Jul 01 19:13:16.379159 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:16.379107 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qndfd" event={"ID":"85b15dc5-328c-41ea-adc4-c0b8fb36d860","Type":"ContainerStarted","Data":"01a681adff5dfe19af33248b7fb2aeb850fa228b99d92cd8699cd6683d0370c4"} Jul 01 19:13:16.384691 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:16.384350 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cdb5968b9-pznw2"] Jul 01 19:13:16.384799 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:16.384767 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zp5ps" event={"ID":"43534a28-eb76-425e-8c8f-bbb00ab5df95","Type":"ContainerStarted","Data":"3972197c7833de2f98389d493830b7e30d7750f5be89dcad72f50a8488ab3c35"} Jul 01 19:13:16.387380 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:13:16.387355 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod892a8a50_8bf0_43e5_adc3_613a9dd16e33.slice/crio-d823566305960d93e196d44b84309e68364907c3b196127148b14e9b297a1dc0 WatchSource:0}: Error finding container d823566305960d93e196d44b84309e68364907c3b196127148b14e9b297a1dc0: Status 404 returned error can't find the container with id d823566305960d93e196d44b84309e68364907c3b196127148b14e9b297a1dc0 Jul 01 19:13:16.408408 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:16.408352 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-zp5ps" podStartSLOduration=32.741404467 podStartE2EDuration="40.408331643s" totalImagesPullingTime="7.666927176s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:12:36 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:13:16.406652359 +0000 UTC m=+102.915093187" watchObservedRunningTime="2026-07-01 19:13:16.408331643 +0000 UTC m=+102.916772468" Jul 01 19:13:17.270221 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:17.270192 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-mv2pp" Jul 01 19:13:17.390064 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:17.390033 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qndfd" event={"ID":"85b15dc5-328c-41ea-adc4-c0b8fb36d860","Type":"ContainerStarted","Data":"27a1f206a5906f5372de6e50eb2c189def5f1a111b770ceea8ba91366e07a84f"} Jul 01 19:13:17.390495 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:17.390118 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-qndfd" Jul 01 19:13:17.391179 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:17.391157 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cdb5968b9-pznw2" event={"ID":"892a8a50-8bf0-43e5-adc3-613a9dd16e33","Type":"ContainerStarted","Data":"d823566305960d93e196d44b84309e68364907c3b196127148b14e9b297a1dc0"} Jul 01 19:13:17.406593 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:17.406554 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-qndfd" podStartSLOduration=66.154266218 podStartE2EDuration="1m9.40654139s" totalImagesPullingTime="3.252275172s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:12:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:13:17.405188931 +0000 UTC m=+103.913629757" watchObservedRunningTime="2026-07-01 19:13:17.40654139 +0000 UTC m=+103.914982216" Jul 01 19:13:18.395830 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:18.395793 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cdb5968b9-pznw2" event={"ID":"892a8a50-8bf0-43e5-adc3-613a9dd16e33","Type":"ContainerStarted","Data":"cc7b040441fc2ac1b938e091a6cddf6d534c71801a09567223dc9b50f71b63c3"} Jul 01 19:13:18.413773 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:18.413691 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6cdb5968b9-pznw2" podStartSLOduration=33.646593087 podStartE2EDuration="35.413677347s" totalImagesPullingTime="1.76708426s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:12:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:13:18.413380181 +0000 UTC m=+104.921821034" watchObservedRunningTime="2026-07-01 19:13:18.413677347 +0000 UTC m=+104.922118173" Jul 01 19:13:21.165856 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:21.165826 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-sjfkk"] Jul 01 19:13:21.194118 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:21.194091 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-sjfkk" Jul 01 19:13:21.196269 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:21.196239 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 01 19:13:21.196386 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:21.196298 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 01 19:13:21.196386 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:21.196330 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 01 19:13:21.196501 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:21.196434 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 01 19:13:21.196587 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:21.196572 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 01 19:13:21.196670 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:21.196654 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 01 19:13:21.196728 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:21.196716 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-cx6h2\"" Jul 01 19:13:21.243559 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:21.243535 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/777c82cb-7aad-4c05-bfd3-a6159b3ea69f-sys\") pod \"node-exporter-sjfkk\" (UID: \"777c82cb-7aad-4c05-bfd3-a6159b3ea69f\") " pod="openshift-monitoring/node-exporter-sjfkk" Jul 01 19:13:21.243704 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:21.243568 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhh88\" (UniqueName: \"kubernetes.io/projected/777c82cb-7aad-4c05-bfd3-a6159b3ea69f-kube-api-access-nhh88\") pod \"node-exporter-sjfkk\" (UID: \"777c82cb-7aad-4c05-bfd3-a6159b3ea69f\") " pod="openshift-monitoring/node-exporter-sjfkk" Jul 01 19:13:21.243704 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:21.243591 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/777c82cb-7aad-4c05-bfd3-a6159b3ea69f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-sjfkk\" (UID: \"777c82cb-7aad-4c05-bfd3-a6159b3ea69f\") " pod="openshift-monitoring/node-exporter-sjfkk" Jul 01 19:13:21.243704 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:21.243633 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/777c82cb-7aad-4c05-bfd3-a6159b3ea69f-node-exporter-wtmp\") pod \"node-exporter-sjfkk\" (UID: \"777c82cb-7aad-4c05-bfd3-a6159b3ea69f\") " pod="openshift-monitoring/node-exporter-sjfkk" Jul 01 19:13:21.243704 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:21.243695 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/777c82cb-7aad-4c05-bfd3-a6159b3ea69f-root\") pod \"node-exporter-sjfkk\" (UID: \"777c82cb-7aad-4c05-bfd3-a6159b3ea69f\") " pod="openshift-monitoring/node-exporter-sjfkk" Jul 01 19:13:21.243893 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:21.243740 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/777c82cb-7aad-4c05-bfd3-a6159b3ea69f-node-exporter-tls\") pod \"node-exporter-sjfkk\" (UID: \"777c82cb-7aad-4c05-bfd3-a6159b3ea69f\") " pod="openshift-monitoring/node-exporter-sjfkk" Jul 01 19:13:21.243893 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:21.243791 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/777c82cb-7aad-4c05-bfd3-a6159b3ea69f-node-exporter-textfile\") pod \"node-exporter-sjfkk\" (UID: \"777c82cb-7aad-4c05-bfd3-a6159b3ea69f\") " pod="openshift-monitoring/node-exporter-sjfkk" Jul 01 19:13:21.243893 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:21.243815 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/777c82cb-7aad-4c05-bfd3-a6159b3ea69f-node-exporter-accelerators-collector-config\") pod \"node-exporter-sjfkk\" (UID: \"777c82cb-7aad-4c05-bfd3-a6159b3ea69f\") " pod="openshift-monitoring/node-exporter-sjfkk" Jul 01 19:13:21.243893 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:21.243834 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/777c82cb-7aad-4c05-bfd3-a6159b3ea69f-metrics-client-ca\") pod \"node-exporter-sjfkk\" (UID: \"777c82cb-7aad-4c05-bfd3-a6159b3ea69f\") " pod="openshift-monitoring/node-exporter-sjfkk" Jul 01 19:13:21.344247 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:21.344216 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/777c82cb-7aad-4c05-bfd3-a6159b3ea69f-root\") pod \"node-exporter-sjfkk\" (UID: \"777c82cb-7aad-4c05-bfd3-a6159b3ea69f\") " pod="openshift-monitoring/node-exporter-sjfkk" Jul 01 19:13:21.344402 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:21.344255 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/777c82cb-7aad-4c05-bfd3-a6159b3ea69f-node-exporter-tls\") pod \"node-exporter-sjfkk\" (UID: \"777c82cb-7aad-4c05-bfd3-a6159b3ea69f\") " pod="openshift-monitoring/node-exporter-sjfkk" Jul 01 19:13:21.344402 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:21.344276 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/777c82cb-7aad-4c05-bfd3-a6159b3ea69f-node-exporter-textfile\") pod \"node-exporter-sjfkk\" (UID: \"777c82cb-7aad-4c05-bfd3-a6159b3ea69f\") " pod="openshift-monitoring/node-exporter-sjfkk" Jul 01 19:13:21.344402 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:21.344293 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/777c82cb-7aad-4c05-bfd3-a6159b3ea69f-node-exporter-accelerators-collector-config\") pod \"node-exporter-sjfkk\" (UID: \"777c82cb-7aad-4c05-bfd3-a6159b3ea69f\") " pod="openshift-monitoring/node-exporter-sjfkk" Jul 01 19:13:21.344402 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:21.344331 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/777c82cb-7aad-4c05-bfd3-a6159b3ea69f-root\") pod \"node-exporter-sjfkk\" (UID: \"777c82cb-7aad-4c05-bfd3-a6159b3ea69f\") " pod="openshift-monitoring/node-exporter-sjfkk" Jul 01 19:13:21.344402 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:21.344377 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/777c82cb-7aad-4c05-bfd3-a6159b3ea69f-metrics-client-ca\") pod \"node-exporter-sjfkk\" (UID: \"777c82cb-7aad-4c05-bfd3-a6159b3ea69f\") " pod="openshift-monitoring/node-exporter-sjfkk" Jul 01 19:13:21.344402 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:13:21.344392 2561 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 01 19:13:21.344711 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:13:21.344457 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/777c82cb-7aad-4c05-bfd3-a6159b3ea69f-node-exporter-tls podName:777c82cb-7aad-4c05-bfd3-a6159b3ea69f nodeName:}" failed. No retries permitted until 2026-07-01 19:13:21.844435083 +0000 UTC m=+108.352875920 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/777c82cb-7aad-4c05-bfd3-a6159b3ea69f-node-exporter-tls") pod "node-exporter-sjfkk" (UID: "777c82cb-7aad-4c05-bfd3-a6159b3ea69f") : secret "node-exporter-tls" not found Jul 01 19:13:21.344711 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:21.344495 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/777c82cb-7aad-4c05-bfd3-a6159b3ea69f-sys\") pod \"node-exporter-sjfkk\" (UID: \"777c82cb-7aad-4c05-bfd3-a6159b3ea69f\") " pod="openshift-monitoring/node-exporter-sjfkk" Jul 01 19:13:21.344711 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:21.344532 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nhh88\" (UniqueName: \"kubernetes.io/projected/777c82cb-7aad-4c05-bfd3-a6159b3ea69f-kube-api-access-nhh88\") pod \"node-exporter-sjfkk\" (UID: \"777c82cb-7aad-4c05-bfd3-a6159b3ea69f\") " pod="openshift-monitoring/node-exporter-sjfkk" Jul 01 19:13:21.344711 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:21.344562 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/777c82cb-7aad-4c05-bfd3-a6159b3ea69f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-sjfkk\" (UID: \"777c82cb-7aad-4c05-bfd3-a6159b3ea69f\") " pod="openshift-monitoring/node-exporter-sjfkk" Jul 01 19:13:21.344711 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:21.344621 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/777c82cb-7aad-4c05-bfd3-a6159b3ea69f-sys\") pod \"node-exporter-sjfkk\" (UID: \"777c82cb-7aad-4c05-bfd3-a6159b3ea69f\") " pod="openshift-monitoring/node-exporter-sjfkk" Jul 01 19:13:21.344711 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:21.344621 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/777c82cb-7aad-4c05-bfd3-a6159b3ea69f-node-exporter-textfile\") pod \"node-exporter-sjfkk\" (UID: \"777c82cb-7aad-4c05-bfd3-a6159b3ea69f\") " pod="openshift-monitoring/node-exporter-sjfkk" Jul 01 19:13:21.344711 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:21.344682 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/777c82cb-7aad-4c05-bfd3-a6159b3ea69f-node-exporter-wtmp\") pod \"node-exporter-sjfkk\" (UID: \"777c82cb-7aad-4c05-bfd3-a6159b3ea69f\") " pod="openshift-monitoring/node-exporter-sjfkk" Jul 01 19:13:21.345099 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:21.344801 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/777c82cb-7aad-4c05-bfd3-a6159b3ea69f-node-exporter-wtmp\") pod \"node-exporter-sjfkk\" (UID: \"777c82cb-7aad-4c05-bfd3-a6159b3ea69f\") " pod="openshift-monitoring/node-exporter-sjfkk" Jul 01 19:13:21.345099 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:21.344863 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/777c82cb-7aad-4c05-bfd3-a6159b3ea69f-node-exporter-accelerators-collector-config\") pod \"node-exporter-sjfkk\" (UID: \"777c82cb-7aad-4c05-bfd3-a6159b3ea69f\") " pod="openshift-monitoring/node-exporter-sjfkk" Jul 01 19:13:21.345099 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:21.344982 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/777c82cb-7aad-4c05-bfd3-a6159b3ea69f-metrics-client-ca\") pod \"node-exporter-sjfkk\" (UID: \"777c82cb-7aad-4c05-bfd3-a6159b3ea69f\") " pod="openshift-monitoring/node-exporter-sjfkk" Jul 01 19:13:21.346836 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:21.346816 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/777c82cb-7aad-4c05-bfd3-a6159b3ea69f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-sjfkk\" (UID: \"777c82cb-7aad-4c05-bfd3-a6159b3ea69f\") " pod="openshift-monitoring/node-exporter-sjfkk" Jul 01 19:13:21.352444 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:21.352421 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhh88\" (UniqueName: \"kubernetes.io/projected/777c82cb-7aad-4c05-bfd3-a6159b3ea69f-kube-api-access-nhh88\") pod \"node-exporter-sjfkk\" (UID: \"777c82cb-7aad-4c05-bfd3-a6159b3ea69f\") " pod="openshift-monitoring/node-exporter-sjfkk" Jul 01 19:13:21.848240 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:21.848203 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/777c82cb-7aad-4c05-bfd3-a6159b3ea69f-node-exporter-tls\") pod \"node-exporter-sjfkk\" (UID: \"777c82cb-7aad-4c05-bfd3-a6159b3ea69f\") " pod="openshift-monitoring/node-exporter-sjfkk" Jul 01 19:13:21.850465 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:21.850440 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/777c82cb-7aad-4c05-bfd3-a6159b3ea69f-node-exporter-tls\") pod \"node-exporter-sjfkk\" (UID: \"777c82cb-7aad-4c05-bfd3-a6159b3ea69f\") " pod="openshift-monitoring/node-exporter-sjfkk" Jul 01 19:13:22.103553 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:22.103481 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-sjfkk" Jul 01 19:13:22.112702 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:13:22.112671 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod777c82cb_7aad_4c05_bfd3_a6159b3ea69f.slice/crio-c2e23d94d2c5e5146b83637cefa527a82e54269ddefceb28dde8cd13b61a6d93 WatchSource:0}: Error finding container c2e23d94d2c5e5146b83637cefa527a82e54269ddefceb28dde8cd13b61a6d93: Status 404 returned error can't find the container with id c2e23d94d2c5e5146b83637cefa527a82e54269ddefceb28dde8cd13b61a6d93 Jul 01 19:13:22.411865 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:22.411785 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-sjfkk" event={"ID":"777c82cb-7aad-4c05-bfd3-a6159b3ea69f","Type":"ContainerStarted","Data":"c2e23d94d2c5e5146b83637cefa527a82e54269ddefceb28dde8cd13b61a6d93"} Jul 01 19:13:23.416708 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:23.416629 2561 generic.go:356] "Generic (PLEG): container finished" podID="777c82cb-7aad-4c05-bfd3-a6159b3ea69f" containerID="46c814fea3331e2049746da2ddeec1085a7fceee6210e3dc797bf27694fbca28" exitCode=0 Jul 01 19:13:23.417084 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:23.416721 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-sjfkk" event={"ID":"777c82cb-7aad-4c05-bfd3-a6159b3ea69f","Type":"ContainerDied","Data":"46c814fea3331e2049746da2ddeec1085a7fceee6210e3dc797bf27694fbca28"} Jul 01 19:13:24.422193 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:24.422160 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-sjfkk" event={"ID":"777c82cb-7aad-4c05-bfd3-a6159b3ea69f","Type":"ContainerStarted","Data":"84b521236e24652a44d4071ac039a42650f03813d035b4d3d1030dada6f0cefd"} Jul 01 19:13:24.422647 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:24.422236 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-sjfkk" event={"ID":"777c82cb-7aad-4c05-bfd3-a6159b3ea69f","Type":"ContainerStarted","Data":"fbf9f39d30818a8fa27bf99a58c0582307493ba1132426f2ca7a5d908638c4c8"} Jul 01 19:13:24.443692 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:24.443651 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-sjfkk" podStartSLOduration=2.508563703 podStartE2EDuration="3.443637413s" totalImagesPullingTime="871.036863ms" totalInitContainerRuntime="64.036847ms" isStatefulPod=true podCreationTimestamp="2026-07-01 19:13:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:13:24.442774256 +0000 UTC m=+110.951215081" watchObservedRunningTime="2026-07-01 19:13:24.443637413 +0000 UTC m=+110.952078238" Jul 01 19:13:27.398247 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:27.398221 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-qndfd" Jul 01 19:13:31.356412 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:31.356384 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-86b6c6f876-9bvzg" Jul 01 19:13:33.452842 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:33.452817 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-768b647755-nv6rr" event={"ID":"eea10a40-468c-4742-b7b7-28872c3452e2","Type":"ContainerStarted","Data":"6bbb490f61ecb687d5cd95cb357896f1d643595598167bd84f5d68e42377fe30"} Jul 01 19:13:34.457826 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:34.457790 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-768b647755-nv6rr" event={"ID":"eea10a40-468c-4742-b7b7-28872c3452e2","Type":"ContainerStarted","Data":"7b5349497d485e11bb663aefa461516bfa8ec64adb5ffc92e04023d7ed14374e"} Jul 01 19:13:34.457826 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:34.457831 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-768b647755-nv6rr" event={"ID":"eea10a40-468c-4742-b7b7-28872c3452e2","Type":"ContainerStarted","Data":"6e54b5f89218e355207a2bd13c7bb387d20a2eddf0d8a06b9751a0db35006f83"} Jul 01 19:13:34.477394 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:34.477349 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-768b647755-nv6rr" podStartSLOduration=2.028251925 podStartE2EDuration="25.477336462s" totalImagesPullingTime="23.449084537s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:13:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:13:34.476777586 +0000 UTC m=+120.985218412" watchObservedRunningTime="2026-07-01 19:13:34.477336462 +0000 UTC m=+120.985777288" Jul 01 19:13:43.910099 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:43.910055 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a30b203c-f4ce-4746-a763-ffde940c4276-metrics-certs\") pod \"network-metrics-daemon-smtsc\" (UID: \"a30b203c-f4ce-4746-a763-ffde940c4276\") " pod="openshift-multus/network-metrics-daemon-smtsc" Jul 01 19:13:43.912261 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:43.912235 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a30b203c-f4ce-4746-a763-ffde940c4276-metrics-certs\") pod \"network-metrics-daemon-smtsc\" (UID: \"a30b203c-f4ce-4746-a763-ffde940c4276\") " pod="openshift-multus/network-metrics-daemon-smtsc" Jul 01 19:13:44.193828 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:44.193804 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9wqsv\"" Jul 01 19:13:44.202153 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:44.202138 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-smtsc" Jul 01 19:13:44.454445 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:44.454268 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-smtsc"] Jul 01 19:13:44.457093 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:13:44.457069 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda30b203c_f4ce_4746_a763_ffde940c4276.slice/crio-cbebe46006190ea9be030053d760146788beacef393baea9bfcbfc95a3228d21 WatchSource:0}: Error finding container cbebe46006190ea9be030053d760146788beacef393baea9bfcbfc95a3228d21: Status 404 returned error can't find the container with id cbebe46006190ea9be030053d760146788beacef393baea9bfcbfc95a3228d21 Jul 01 19:13:44.491709 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:44.491683 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-smtsc" event={"ID":"a30b203c-f4ce-4746-a763-ffde940c4276","Type":"ContainerStarted","Data":"cbebe46006190ea9be030053d760146788beacef393baea9bfcbfc95a3228d21"} Jul 01 19:13:45.497173 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:45.497093 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-smtsc" event={"ID":"a30b203c-f4ce-4746-a763-ffde940c4276","Type":"ContainerStarted","Data":"64e214bf4cb2b5a9bad60517018891a67cc70ead38cebf48ff0f81d2ebacd61f"} Jul 01 19:13:45.497508 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:45.497173 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-smtsc" event={"ID":"a30b203c-f4ce-4746-a763-ffde940c4276","Type":"ContainerStarted","Data":"d22c41f9ef936e000278b448ed033c3d66a9f5073683aa460b4eee901a79dbf6"} Jul 01 19:13:45.513264 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:45.513221 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-smtsc" podStartSLOduration=130.743606048 podStartE2EDuration="2m11.513206521s" totalImagesPullingTime="769.600473ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:11:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:13:45.512381132 +0000 UTC m=+132.020821981" watchObservedRunningTime="2026-07-01 19:13:45.513206521 +0000 UTC m=+132.021647420" Jul 01 19:13:54.533677 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:54.533586 2561 generic.go:356] "Generic (PLEG): container finished" podID="ebf9d613-2590-4a63-8890-fbca3d5fc32c" containerID="7237ed3af4a5d0d08cc48bcf5defe44616c2004da8ad47fec7da4390a4f1477b" exitCode=0 Jul 01 19:13:54.533677 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:54.533638 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-lkj58" event={"ID":"ebf9d613-2590-4a63-8890-fbca3d5fc32c","Type":"ContainerDied","Data":"7237ed3af4a5d0d08cc48bcf5defe44616c2004da8ad47fec7da4390a4f1477b"} Jul 01 19:13:54.534114 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:54.533933 2561 scope.go:117] "RemoveContainer" containerID="7237ed3af4a5d0d08cc48bcf5defe44616c2004da8ad47fec7da4390a4f1477b" Jul 01 19:13:55.538785 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:55.538751 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-lkj58" event={"ID":"ebf9d613-2590-4a63-8890-fbca3d5fc32c","Type":"ContainerStarted","Data":"07f92463284849e84ed58ccc876e6d3b8ad5ed62f94c096f9689bd8edd7cefb0"} Jul 01 19:13:56.545584 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:56.545544 2561 generic.go:356] "Generic (PLEG): container finished" podID="7d91805f-0e1f-4baa-ba7c-8b0bc1d69b9e" containerID="b1da47d4e5bb7b8e46a09f82aeab62a6db8254c8cd7867adbae5ccef56bd8745" exitCode=0 Jul 01 19:13:56.546063 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:56.545657 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-thr5g" event={"ID":"7d91805f-0e1f-4baa-ba7c-8b0bc1d69b9e","Type":"ContainerDied","Data":"b1da47d4e5bb7b8e46a09f82aeab62a6db8254c8cd7867adbae5ccef56bd8745"} Jul 01 19:13:56.546137 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:56.546115 2561 scope.go:117] "RemoveContainer" containerID="b1da47d4e5bb7b8e46a09f82aeab62a6db8254c8cd7867adbae5ccef56bd8745" Jul 01 19:13:57.550900 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:13:57.550865 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-thr5g" event={"ID":"7d91805f-0e1f-4baa-ba7c-8b0bc1d69b9e","Type":"ContainerStarted","Data":"8fdcea31ae1a01457a08f80c81696eb233740fb85521f8f55875063eebd155b1"} Jul 01 19:14:06.585666 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:14:06.585633 2561 generic.go:356] "Generic (PLEG): container finished" podID="dee2c113-9b3a-469d-af6a-c85146b4bf98" containerID="c57a9dc2984b37e89eab719de90be6cf4fa6a3c1dbb9425247cc439f7cd7cb73" exitCode=0 Jul 01 19:14:06.586080 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:14:06.585676 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5f67b55555-cjsn9" event={"ID":"dee2c113-9b3a-469d-af6a-c85146b4bf98","Type":"ContainerDied","Data":"c57a9dc2984b37e89eab719de90be6cf4fa6a3c1dbb9425247cc439f7cd7cb73"} Jul 01 19:14:06.586080 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:14:06.585946 2561 scope.go:117] "RemoveContainer" containerID="c57a9dc2984b37e89eab719de90be6cf4fa6a3c1dbb9425247cc439f7cd7cb73" Jul 01 19:14:07.593598 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:14:07.593567 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5f67b55555-cjsn9" event={"ID":"dee2c113-9b3a-469d-af6a-c85146b4bf98","Type":"ContainerStarted","Data":"09318d37870449b49a9851200ab9f3c820c3c50fe57b8ddfb6adf97b48611b4a"} Jul 01 19:16:33.914867 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:16:33.914835 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p4nbs_9315c387-a14c-4926-969a-64945926951e/ovn-acl-logging/0.log" Jul 01 19:16:33.918884 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:16:33.918862 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p4nbs_9315c387-a14c-4926-969a-64945926951e/ovn-acl-logging/0.log" Jul 01 19:16:33.922284 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:16:33.922265 2561 kubelet.go:1648] "Image garbage collection succeeded" Jul 01 19:17:22.694201 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:17:22.694170 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-59c77684cc-wfsk7"] Jul 01 19:17:22.697104 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:17:22.697089 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-wfsk7" Jul 01 19:17:22.699473 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:17:22.699453 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 01 19:17:22.700251 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:17:22.700229 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-tft6q\"" Jul 01 19:17:22.702541 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:17:22.702518 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 01 19:17:22.733163 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:17:22.733135 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-wfsk7"] Jul 01 19:17:22.805598 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:17:22.805570 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/80b16deb-ee84-4a15-8ca9-c693492ea70f-bound-sa-token\") pod \"cert-manager-59c77684cc-wfsk7\" (UID: \"80b16deb-ee84-4a15-8ca9-c693492ea70f\") " pod="cert-manager/cert-manager-59c77684cc-wfsk7" Jul 01 19:17:22.805731 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:17:22.805608 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cwrnr\" (UniqueName: \"kubernetes.io/projected/80b16deb-ee84-4a15-8ca9-c693492ea70f-kube-api-access-cwrnr\") pod \"cert-manager-59c77684cc-wfsk7\" (UID: \"80b16deb-ee84-4a15-8ca9-c693492ea70f\") " pod="cert-manager/cert-manager-59c77684cc-wfsk7" Jul 01 19:17:22.906236 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:17:22.906193 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cwrnr\" (UniqueName: \"kubernetes.io/projected/80b16deb-ee84-4a15-8ca9-c693492ea70f-kube-api-access-cwrnr\") pod \"cert-manager-59c77684cc-wfsk7\" (UID: \"80b16deb-ee84-4a15-8ca9-c693492ea70f\") " pod="cert-manager/cert-manager-59c77684cc-wfsk7" Jul 01 19:17:22.906377 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:17:22.906293 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/80b16deb-ee84-4a15-8ca9-c693492ea70f-bound-sa-token\") pod \"cert-manager-59c77684cc-wfsk7\" (UID: \"80b16deb-ee84-4a15-8ca9-c693492ea70f\") " pod="cert-manager/cert-manager-59c77684cc-wfsk7" Jul 01 19:17:22.921914 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:17:22.921887 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cwrnr\" (UniqueName: \"kubernetes.io/projected/80b16deb-ee84-4a15-8ca9-c693492ea70f-kube-api-access-cwrnr\") pod \"cert-manager-59c77684cc-wfsk7\" (UID: \"80b16deb-ee84-4a15-8ca9-c693492ea70f\") " pod="cert-manager/cert-manager-59c77684cc-wfsk7" Jul 01 19:17:22.923428 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:17:22.923408 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/80b16deb-ee84-4a15-8ca9-c693492ea70f-bound-sa-token\") pod \"cert-manager-59c77684cc-wfsk7\" (UID: \"80b16deb-ee84-4a15-8ca9-c693492ea70f\") " pod="cert-manager/cert-manager-59c77684cc-wfsk7" Jul 01 19:17:23.005464 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:17:23.005386 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-wfsk7" Jul 01 19:17:23.142854 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:17:23.142824 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-wfsk7"] Jul 01 19:17:23.145985 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:17:23.145938 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod80b16deb_ee84_4a15_8ca9_c693492ea70f.slice/crio-b513267a18be9ef49891c317ede20acf953dc9855f62b31626f758e299e6ccdd WatchSource:0}: Error finding container b513267a18be9ef49891c317ede20acf953dc9855f62b31626f758e299e6ccdd: Status 404 returned error can't find the container with id b513267a18be9ef49891c317ede20acf953dc9855f62b31626f758e299e6ccdd Jul 01 19:17:23.147935 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:17:23.147919 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 01 19:17:23.258748 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:17:23.258668 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-wfsk7" event={"ID":"80b16deb-ee84-4a15-8ca9-c693492ea70f","Type":"ContainerStarted","Data":"b513267a18be9ef49891c317ede20acf953dc9855f62b31626f758e299e6ccdd"} Jul 01 19:17:27.275595 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:17:27.275561 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-wfsk7" event={"ID":"80b16deb-ee84-4a15-8ca9-c693492ea70f","Type":"ContainerStarted","Data":"0a14699fe0999a2c33401650fe247513d504da71a7994b369c02c3e5bfe212c2"} Jul 01 19:17:27.296462 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:17:27.296416 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-59c77684cc-wfsk7" podStartSLOduration=2.154216049 podStartE2EDuration="5.296400212s" totalImagesPullingTime="3.142184163s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:17:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:17:27.295366997 +0000 UTC m=+353.803807824" watchObservedRunningTime="2026-07-01 19:17:27.296400212 +0000 UTC m=+353.804841038" Jul 01 19:17:44.132394 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:17:44.132364 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-85b6b744df-j9fss"] Jul 01 19:17:44.135547 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:17:44.135528 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-85b6b744df-j9fss" Jul 01 19:17:44.140263 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:17:44.140243 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 01 19:17:44.140372 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:17:44.140354 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 01 19:17:44.140886 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:17:44.140866 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 01 19:17:44.141006 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:17:44.140964 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-grp2q\"" Jul 01 19:17:44.141386 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:17:44.141372 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 01 19:17:44.146869 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:17:44.146848 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjmfw\" (UniqueName: \"kubernetes.io/projected/2f3ddb48-2aa3-4ebe-b8c0-639d4e67fad2-kube-api-access-wjmfw\") pod \"opendatahub-operator-controller-manager-85b6b744df-j9fss\" (UID: \"2f3ddb48-2aa3-4ebe-b8c0-639d4e67fad2\") " pod="opendatahub/opendatahub-operator-controller-manager-85b6b744df-j9fss" Jul 01 19:17:44.146965 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:17:44.146882 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2f3ddb48-2aa3-4ebe-b8c0-639d4e67fad2-apiservice-cert\") pod \"opendatahub-operator-controller-manager-85b6b744df-j9fss\" (UID: \"2f3ddb48-2aa3-4ebe-b8c0-639d4e67fad2\") " pod="opendatahub/opendatahub-operator-controller-manager-85b6b744df-j9fss" Jul 01 19:17:44.146965 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:17:44.146911 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2f3ddb48-2aa3-4ebe-b8c0-639d4e67fad2-webhook-cert\") pod \"opendatahub-operator-controller-manager-85b6b744df-j9fss\" (UID: \"2f3ddb48-2aa3-4ebe-b8c0-639d4e67fad2\") " pod="opendatahub/opendatahub-operator-controller-manager-85b6b744df-j9fss" Jul 01 19:17:44.147043 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:17:44.146987 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2f3ddb48-2aa3-4ebe-b8c0-639d4e67fad2-manifests\") pod \"opendatahub-operator-controller-manager-85b6b744df-j9fss\" (UID: \"2f3ddb48-2aa3-4ebe-b8c0-639d4e67fad2\") " pod="opendatahub/opendatahub-operator-controller-manager-85b6b744df-j9fss" Jul 01 19:17:44.147043 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:17:44.147021 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2f3ddb48-2aa3-4ebe-b8c0-639d4e67fad2-tmp\") pod \"opendatahub-operator-controller-manager-85b6b744df-j9fss\" (UID: \"2f3ddb48-2aa3-4ebe-b8c0-639d4e67fad2\") " pod="opendatahub/opendatahub-operator-controller-manager-85b6b744df-j9fss" Jul 01 19:17:44.178122 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:17:44.178094 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-85b6b744df-j9fss"] Jul 01 19:17:44.248007 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:17:44.247973 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wjmfw\" (UniqueName: \"kubernetes.io/projected/2f3ddb48-2aa3-4ebe-b8c0-639d4e67fad2-kube-api-access-wjmfw\") pod \"opendatahub-operator-controller-manager-85b6b744df-j9fss\" (UID: \"2f3ddb48-2aa3-4ebe-b8c0-639d4e67fad2\") " pod="opendatahub/opendatahub-operator-controller-manager-85b6b744df-j9fss" Jul 01 19:17:44.248158 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:17:44.248018 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2f3ddb48-2aa3-4ebe-b8c0-639d4e67fad2-apiservice-cert\") pod \"opendatahub-operator-controller-manager-85b6b744df-j9fss\" (UID: \"2f3ddb48-2aa3-4ebe-b8c0-639d4e67fad2\") " pod="opendatahub/opendatahub-operator-controller-manager-85b6b744df-j9fss" Jul 01 19:17:44.248158 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:17:44.248064 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2f3ddb48-2aa3-4ebe-b8c0-639d4e67fad2-webhook-cert\") pod \"opendatahub-operator-controller-manager-85b6b744df-j9fss\" (UID: \"2f3ddb48-2aa3-4ebe-b8c0-639d4e67fad2\") " pod="opendatahub/opendatahub-operator-controller-manager-85b6b744df-j9fss" Jul 01 19:17:44.248158 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:17:44.248103 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2f3ddb48-2aa3-4ebe-b8c0-639d4e67fad2-manifests\") pod \"opendatahub-operator-controller-manager-85b6b744df-j9fss\" (UID: \"2f3ddb48-2aa3-4ebe-b8c0-639d4e67fad2\") " pod="opendatahub/opendatahub-operator-controller-manager-85b6b744df-j9fss" Jul 01 19:17:44.248158 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:17:44.248137 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2f3ddb48-2aa3-4ebe-b8c0-639d4e67fad2-tmp\") pod \"opendatahub-operator-controller-manager-85b6b744df-j9fss\" (UID: \"2f3ddb48-2aa3-4ebe-b8c0-639d4e67fad2\") " pod="opendatahub/opendatahub-operator-controller-manager-85b6b744df-j9fss" Jul 01 19:17:44.248510 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:17:44.248480 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2f3ddb48-2aa3-4ebe-b8c0-639d4e67fad2-manifests\") pod \"opendatahub-operator-controller-manager-85b6b744df-j9fss\" (UID: \"2f3ddb48-2aa3-4ebe-b8c0-639d4e67fad2\") " pod="opendatahub/opendatahub-operator-controller-manager-85b6b744df-j9fss" Jul 01 19:17:44.250330 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:17:44.250310 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2f3ddb48-2aa3-4ebe-b8c0-639d4e67fad2-tmp\") pod \"opendatahub-operator-controller-manager-85b6b744df-j9fss\" (UID: \"2f3ddb48-2aa3-4ebe-b8c0-639d4e67fad2\") " pod="opendatahub/opendatahub-operator-controller-manager-85b6b744df-j9fss" Jul 01 19:17:44.250455 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:17:44.250437 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2f3ddb48-2aa3-4ebe-b8c0-639d4e67fad2-apiservice-cert\") pod \"opendatahub-operator-controller-manager-85b6b744df-j9fss\" (UID: \"2f3ddb48-2aa3-4ebe-b8c0-639d4e67fad2\") " pod="opendatahub/opendatahub-operator-controller-manager-85b6b744df-j9fss" Jul 01 19:17:44.250523 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:17:44.250508 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2f3ddb48-2aa3-4ebe-b8c0-639d4e67fad2-webhook-cert\") pod \"opendatahub-operator-controller-manager-85b6b744df-j9fss\" (UID: \"2f3ddb48-2aa3-4ebe-b8c0-639d4e67fad2\") " pod="opendatahub/opendatahub-operator-controller-manager-85b6b744df-j9fss" Jul 01 19:17:44.273996 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:17:44.273949 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjmfw\" (UniqueName: \"kubernetes.io/projected/2f3ddb48-2aa3-4ebe-b8c0-639d4e67fad2-kube-api-access-wjmfw\") pod \"opendatahub-operator-controller-manager-85b6b744df-j9fss\" (UID: \"2f3ddb48-2aa3-4ebe-b8c0-639d4e67fad2\") " pod="opendatahub/opendatahub-operator-controller-manager-85b6b744df-j9fss" Jul 01 19:17:44.444711 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:17:44.444691 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-85b6b744df-j9fss" Jul 01 19:17:44.599787 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:17:44.599764 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-85b6b744df-j9fss"] Jul 01 19:17:44.601276 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:17:44.601247 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f3ddb48_2aa3_4ebe_b8c0_639d4e67fad2.slice/crio-6ce71f1ee0f69c5c61fdd7b812b35b049351ee7e052b4b29788f7484dcad93fd WatchSource:0}: Error finding container 6ce71f1ee0f69c5c61fdd7b812b35b049351ee7e052b4b29788f7484dcad93fd: Status 404 returned error can't find the container with id 6ce71f1ee0f69c5c61fdd7b812b35b049351ee7e052b4b29788f7484dcad93fd Jul 01 19:17:45.344214 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:17:45.344175 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-85b6b744df-j9fss" event={"ID":"2f3ddb48-2aa3-4ebe-b8c0-639d4e67fad2","Type":"ContainerStarted","Data":"6ce71f1ee0f69c5c61fdd7b812b35b049351ee7e052b4b29788f7484dcad93fd"} Jul 01 19:17:48.357633 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:17:48.357598 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-85b6b744df-j9fss" event={"ID":"2f3ddb48-2aa3-4ebe-b8c0-639d4e67fad2","Type":"ContainerStarted","Data":"524580f948d5372f97fdfab0b11d9482d8094b5cffc2d50872c0afed3d1b3dd9"} Jul 01 19:17:49.362730 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:17:49.362697 2561 generic.go:356] "Generic (PLEG): container finished" podID="2f3ddb48-2aa3-4ebe-b8c0-639d4e67fad2" containerID="524580f948d5372f97fdfab0b11d9482d8094b5cffc2d50872c0afed3d1b3dd9" exitCode=0 Jul 01 19:17:49.363164 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:17:49.362738 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-85b6b744df-j9fss" event={"ID":"2f3ddb48-2aa3-4ebe-b8c0-639d4e67fad2","Type":"ContainerDied","Data":"524580f948d5372f97fdfab0b11d9482d8094b5cffc2d50872c0afed3d1b3dd9"} Jul 01 19:17:50.367980 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:17:50.367878 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-85b6b744df-j9fss" event={"ID":"2f3ddb48-2aa3-4ebe-b8c0-639d4e67fad2","Type":"ContainerStarted","Data":"442414e96b92bc8121819b89fc310b2058ec0699a38441a98f2b53a33f3034b2"} Jul 01 19:17:50.368374 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:17:50.368009 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-85b6b744df-j9fss" Jul 01 19:17:50.412436 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:17:50.412388 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-85b6b744df-j9fss" podStartSLOduration=2.043150476 podStartE2EDuration="6.412373252s" totalImagesPullingTime="3.463449459s" totalInitContainerRuntime="905.773317ms" isStatefulPod=false podCreationTimestamp="2026-07-01 19:17:44 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:17:50.40811716 +0000 UTC m=+376.916557986" watchObservedRunningTime="2026-07-01 19:17:50.412373252 +0000 UTC m=+376.920814078" Jul 01 19:18:01.373524 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:01.373497 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-85b6b744df-j9fss" Jul 01 19:18:05.034996 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:05.034947 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-658989848c-f6zvw"] Jul 01 19:18:05.041858 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:05.041839 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-658989848c-f6zvw" Jul 01 19:18:05.045474 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:05.045441 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 01 19:18:05.045474 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:05.045446 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 01 19:18:05.045641 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:05.045499 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 01 19:18:05.061097 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:05.061071 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 01 19:18:05.074421 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:05.074395 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-658989848c-f6zvw"] Jul 01 19:18:05.099387 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:05.099363 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kchkp\" (UniqueName: \"kubernetes.io/projected/8e1bd454-c549-4dcc-8d9a-3456621bac6d-kube-api-access-kchkp\") pod \"kube-auth-proxy-658989848c-f6zvw\" (UID: \"8e1bd454-c549-4dcc-8d9a-3456621bac6d\") " pod="openshift-ingress/kube-auth-proxy-658989848c-f6zvw" Jul 01 19:18:05.099481 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:05.099397 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8e1bd454-c549-4dcc-8d9a-3456621bac6d-tls-certs\") pod \"kube-auth-proxy-658989848c-f6zvw\" (UID: \"8e1bd454-c549-4dcc-8d9a-3456621bac6d\") " pod="openshift-ingress/kube-auth-proxy-658989848c-f6zvw" Jul 01 19:18:05.099481 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:05.099451 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8e1bd454-c549-4dcc-8d9a-3456621bac6d-tmp\") pod \"kube-auth-proxy-658989848c-f6zvw\" (UID: \"8e1bd454-c549-4dcc-8d9a-3456621bac6d\") " pod="openshift-ingress/kube-auth-proxy-658989848c-f6zvw" Jul 01 19:18:05.199868 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:05.199835 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8e1bd454-c549-4dcc-8d9a-3456621bac6d-tls-certs\") pod \"kube-auth-proxy-658989848c-f6zvw\" (UID: \"8e1bd454-c549-4dcc-8d9a-3456621bac6d\") " pod="openshift-ingress/kube-auth-proxy-658989848c-f6zvw" Jul 01 19:18:05.199868 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:05.199869 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8e1bd454-c549-4dcc-8d9a-3456621bac6d-tmp\") pod \"kube-auth-proxy-658989848c-f6zvw\" (UID: \"8e1bd454-c549-4dcc-8d9a-3456621bac6d\") " pod="openshift-ingress/kube-auth-proxy-658989848c-f6zvw" Jul 01 19:18:05.200046 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:05.199941 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kchkp\" (UniqueName: \"kubernetes.io/projected/8e1bd454-c549-4dcc-8d9a-3456621bac6d-kube-api-access-kchkp\") pod \"kube-auth-proxy-658989848c-f6zvw\" (UID: \"8e1bd454-c549-4dcc-8d9a-3456621bac6d\") " pod="openshift-ingress/kube-auth-proxy-658989848c-f6zvw" Jul 01 19:18:05.202194 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:05.202167 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8e1bd454-c549-4dcc-8d9a-3456621bac6d-tmp\") pod \"kube-auth-proxy-658989848c-f6zvw\" (UID: \"8e1bd454-c549-4dcc-8d9a-3456621bac6d\") " pod="openshift-ingress/kube-auth-proxy-658989848c-f6zvw" Jul 01 19:18:05.202400 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:05.202383 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8e1bd454-c549-4dcc-8d9a-3456621bac6d-tls-certs\") pod \"kube-auth-proxy-658989848c-f6zvw\" (UID: \"8e1bd454-c549-4dcc-8d9a-3456621bac6d\") " pod="openshift-ingress/kube-auth-proxy-658989848c-f6zvw" Jul 01 19:18:05.225485 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:05.225460 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-cn22b"] Jul 01 19:18:05.227885 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:05.227867 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-cn22b" Jul 01 19:18:05.240593 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:05.240568 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jul 01 19:18:05.240747 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:05.240731 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-2s2kd\"" Jul 01 19:18:05.241777 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:05.241760 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kchkp\" (UniqueName: \"kubernetes.io/projected/8e1bd454-c549-4dcc-8d9a-3456621bac6d-kube-api-access-kchkp\") pod \"kube-auth-proxy-658989848c-f6zvw\" (UID: \"8e1bd454-c549-4dcc-8d9a-3456621bac6d\") " pod="openshift-ingress/kube-auth-proxy-658989848c-f6zvw" Jul 01 19:18:05.264785 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:05.264759 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-cn22b"] Jul 01 19:18:05.301226 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:05.301159 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dccsv\" (UniqueName: \"kubernetes.io/projected/6d351df0-b1af-440b-b2fe-57ffbd83e9ec-kube-api-access-dccsv\") pod \"odh-model-controller-6dc94f689f-cn22b\" (UID: \"6d351df0-b1af-440b-b2fe-57ffbd83e9ec\") " pod="opendatahub/odh-model-controller-6dc94f689f-cn22b" Jul 01 19:18:05.301331 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:05.301229 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6d351df0-b1af-440b-b2fe-57ffbd83e9ec-cert\") pod \"odh-model-controller-6dc94f689f-cn22b\" (UID: \"6d351df0-b1af-440b-b2fe-57ffbd83e9ec\") " pod="opendatahub/odh-model-controller-6dc94f689f-cn22b" Jul 01 19:18:05.351012 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:05.350986 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-658989848c-f6zvw" Jul 01 19:18:05.402304 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:05.402270 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6d351df0-b1af-440b-b2fe-57ffbd83e9ec-cert\") pod \"odh-model-controller-6dc94f689f-cn22b\" (UID: \"6d351df0-b1af-440b-b2fe-57ffbd83e9ec\") " pod="opendatahub/odh-model-controller-6dc94f689f-cn22b" Jul 01 19:18:05.402431 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:05.402328 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dccsv\" (UniqueName: \"kubernetes.io/projected/6d351df0-b1af-440b-b2fe-57ffbd83e9ec-kube-api-access-dccsv\") pod \"odh-model-controller-6dc94f689f-cn22b\" (UID: \"6d351df0-b1af-440b-b2fe-57ffbd83e9ec\") " pod="opendatahub/odh-model-controller-6dc94f689f-cn22b" Jul 01 19:18:05.402526 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:18:05.402498 2561 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jul 01 19:18:05.402625 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:18:05.402585 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d351df0-b1af-440b-b2fe-57ffbd83e9ec-cert podName:6d351df0-b1af-440b-b2fe-57ffbd83e9ec nodeName:}" failed. No retries permitted until 2026-07-01 19:18:05.902559937 +0000 UTC m=+392.411000783 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/6d351df0-b1af-440b-b2fe-57ffbd83e9ec-cert") pod "odh-model-controller-6dc94f689f-cn22b" (UID: "6d351df0-b1af-440b-b2fe-57ffbd83e9ec") : secret "odh-model-controller-webhook-cert" not found Jul 01 19:18:05.429381 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:05.429354 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dccsv\" (UniqueName: \"kubernetes.io/projected/6d351df0-b1af-440b-b2fe-57ffbd83e9ec-kube-api-access-dccsv\") pod \"odh-model-controller-6dc94f689f-cn22b\" (UID: \"6d351df0-b1af-440b-b2fe-57ffbd83e9ec\") " pod="opendatahub/odh-model-controller-6dc94f689f-cn22b" Jul 01 19:18:05.528176 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:05.528153 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-658989848c-f6zvw"] Jul 01 19:18:05.530571 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:18:05.530548 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e1bd454_c549_4dcc_8d9a_3456621bac6d.slice/crio-41b7ac0e34cd911dda99c9c87e077f3c7b161ec0a4ee17f66b0e5cfff5211994 WatchSource:0}: Error finding container 41b7ac0e34cd911dda99c9c87e077f3c7b161ec0a4ee17f66b0e5cfff5211994: Status 404 returned error can't find the container with id 41b7ac0e34cd911dda99c9c87e077f3c7b161ec0a4ee17f66b0e5cfff5211994 Jul 01 19:18:05.906725 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:05.906697 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6d351df0-b1af-440b-b2fe-57ffbd83e9ec-cert\") pod \"odh-model-controller-6dc94f689f-cn22b\" (UID: \"6d351df0-b1af-440b-b2fe-57ffbd83e9ec\") " pod="opendatahub/odh-model-controller-6dc94f689f-cn22b" Jul 01 19:18:05.909066 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:05.909045 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6d351df0-b1af-440b-b2fe-57ffbd83e9ec-cert\") pod \"odh-model-controller-6dc94f689f-cn22b\" (UID: \"6d351df0-b1af-440b-b2fe-57ffbd83e9ec\") " pod="opendatahub/odh-model-controller-6dc94f689f-cn22b" Jul 01 19:18:06.140518 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:06.140473 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-cn22b" Jul 01 19:18:06.292336 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:06.292305 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-cn22b"] Jul 01 19:18:06.295274 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:18:06.295240 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d351df0_b1af_440b_b2fe_57ffbd83e9ec.slice/crio-5eba5283f5dc369885a45d9837726c7855c2b7394ded74cc66e07dd9cb164531 WatchSource:0}: Error finding container 5eba5283f5dc369885a45d9837726c7855c2b7394ded74cc66e07dd9cb164531: Status 404 returned error can't find the container with id 5eba5283f5dc369885a45d9837726c7855c2b7394ded74cc66e07dd9cb164531 Jul 01 19:18:06.427172 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:06.427143 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-cn22b" event={"ID":"6d351df0-b1af-440b-b2fe-57ffbd83e9ec","Type":"ContainerStarted","Data":"5eba5283f5dc369885a45d9837726c7855c2b7394ded74cc66e07dd9cb164531"} Jul 01 19:18:06.428427 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:06.428399 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-658989848c-f6zvw" event={"ID":"8e1bd454-c549-4dcc-8d9a-3456621bac6d","Type":"ContainerStarted","Data":"41b7ac0e34cd911dda99c9c87e077f3c7b161ec0a4ee17f66b0e5cfff5211994"} Jul 01 19:18:06.977403 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:06.977363 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-qjt29"] Jul 01 19:18:06.980235 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:06.980217 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-qjt29" Jul 01 19:18:06.984140 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:06.984121 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jul 01 19:18:07.015311 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:07.015270 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1bf74f91-32ee-4f16-ae74-71e41d8b26f4-tls-certs\") pod \"model-serving-api-5dd488fc48-qjt29\" (UID: \"1bf74f91-32ee-4f16-ae74-71e41d8b26f4\") " pod="opendatahub/model-serving-api-5dd488fc48-qjt29" Jul 01 19:18:07.015466 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:07.015341 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2qn25\" (UniqueName: \"kubernetes.io/projected/1bf74f91-32ee-4f16-ae74-71e41d8b26f4-kube-api-access-2qn25\") pod \"model-serving-api-5dd488fc48-qjt29\" (UID: \"1bf74f91-32ee-4f16-ae74-71e41d8b26f4\") " pod="opendatahub/model-serving-api-5dd488fc48-qjt29" Jul 01 19:18:07.040324 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:07.040291 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-qjt29"] Jul 01 19:18:07.116381 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:07.116338 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1bf74f91-32ee-4f16-ae74-71e41d8b26f4-tls-certs\") pod \"model-serving-api-5dd488fc48-qjt29\" (UID: \"1bf74f91-32ee-4f16-ae74-71e41d8b26f4\") " pod="opendatahub/model-serving-api-5dd488fc48-qjt29" Jul 01 19:18:07.116562 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:07.116401 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qn25\" (UniqueName: \"kubernetes.io/projected/1bf74f91-32ee-4f16-ae74-71e41d8b26f4-kube-api-access-2qn25\") pod \"model-serving-api-5dd488fc48-qjt29\" (UID: \"1bf74f91-32ee-4f16-ae74-71e41d8b26f4\") " pod="opendatahub/model-serving-api-5dd488fc48-qjt29" Jul 01 19:18:07.121020 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:07.120988 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1bf74f91-32ee-4f16-ae74-71e41d8b26f4-tls-certs\") pod \"model-serving-api-5dd488fc48-qjt29\" (UID: \"1bf74f91-32ee-4f16-ae74-71e41d8b26f4\") " pod="opendatahub/model-serving-api-5dd488fc48-qjt29" Jul 01 19:18:07.147841 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:07.147810 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qn25\" (UniqueName: \"kubernetes.io/projected/1bf74f91-32ee-4f16-ae74-71e41d8b26f4-kube-api-access-2qn25\") pod \"model-serving-api-5dd488fc48-qjt29\" (UID: \"1bf74f91-32ee-4f16-ae74-71e41d8b26f4\") " pod="opendatahub/model-serving-api-5dd488fc48-qjt29" Jul 01 19:18:07.290232 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:07.290143 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-qjt29" Jul 01 19:18:07.499797 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:07.499717 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-qjt29"] Jul 01 19:18:08.442140 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:08.442104 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-qjt29" event={"ID":"1bf74f91-32ee-4f16-ae74-71e41d8b26f4","Type":"ContainerStarted","Data":"6f01a220430611b8b48e901db8edbfd04b2c98f73d3947c4ede99d6f956db254"} Jul 01 19:18:08.782030 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:08.781913 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-sgs44"] Jul 01 19:18:08.784733 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:08.784632 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-sgs44" Jul 01 19:18:08.789459 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:08.789437 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 01 19:18:08.789908 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:08.789881 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 01 19:18:08.790044 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:08.789939 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-7sc9p\"" Jul 01 19:18:08.790181 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:08.790139 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 01 19:18:08.791861 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:08.791802 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 01 19:18:08.830433 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:08.830383 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-frlvn\" (UniqueName: \"kubernetes.io/projected/2bd9ff89-f73c-43e5-8f0b-d5eb2ae4a44a-kube-api-access-frlvn\") pod \"istiod-openshift-gateway-7574459656-sgs44\" (UID: \"2bd9ff89-f73c-43e5-8f0b-d5eb2ae4a44a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-sgs44" Jul 01 19:18:08.830655 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:08.830484 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/2bd9ff89-f73c-43e5-8f0b-d5eb2ae4a44a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-sgs44\" (UID: \"2bd9ff89-f73c-43e5-8f0b-d5eb2ae4a44a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-sgs44" Jul 01 19:18:08.830655 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:08.830536 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/2bd9ff89-f73c-43e5-8f0b-d5eb2ae4a44a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-sgs44\" (UID: \"2bd9ff89-f73c-43e5-8f0b-d5eb2ae4a44a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-sgs44" Jul 01 19:18:08.830655 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:08.830566 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2bd9ff89-f73c-43e5-8f0b-d5eb2ae4a44a-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-sgs44\" (UID: \"2bd9ff89-f73c-43e5-8f0b-d5eb2ae4a44a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-sgs44" Jul 01 19:18:08.830837 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:08.830679 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/2bd9ff89-f73c-43e5-8f0b-d5eb2ae4a44a-cacerts\") pod \"istiod-openshift-gateway-7574459656-sgs44\" (UID: \"2bd9ff89-f73c-43e5-8f0b-d5eb2ae4a44a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-sgs44" Jul 01 19:18:08.830837 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:08.830728 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2bd9ff89-f73c-43e5-8f0b-d5eb2ae4a44a-istio-token\") pod \"istiod-openshift-gateway-7574459656-sgs44\" (UID: \"2bd9ff89-f73c-43e5-8f0b-d5eb2ae4a44a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-sgs44" Jul 01 19:18:08.830837 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:08.830761 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/2bd9ff89-f73c-43e5-8f0b-d5eb2ae4a44a-local-certs\") pod \"istiod-openshift-gateway-7574459656-sgs44\" (UID: \"2bd9ff89-f73c-43e5-8f0b-d5eb2ae4a44a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-sgs44" Jul 01 19:18:08.833722 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:08.833697 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-sgs44"] Jul 01 19:18:08.931302 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:08.931263 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2bd9ff89-f73c-43e5-8f0b-d5eb2ae4a44a-istio-token\") pod \"istiod-openshift-gateway-7574459656-sgs44\" (UID: \"2bd9ff89-f73c-43e5-8f0b-d5eb2ae4a44a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-sgs44" Jul 01 19:18:08.931302 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:08.931303 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/2bd9ff89-f73c-43e5-8f0b-d5eb2ae4a44a-local-certs\") pod \"istiod-openshift-gateway-7574459656-sgs44\" (UID: \"2bd9ff89-f73c-43e5-8f0b-d5eb2ae4a44a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-sgs44" Jul 01 19:18:08.931555 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:08.931351 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-frlvn\" (UniqueName: \"kubernetes.io/projected/2bd9ff89-f73c-43e5-8f0b-d5eb2ae4a44a-kube-api-access-frlvn\") pod \"istiod-openshift-gateway-7574459656-sgs44\" (UID: \"2bd9ff89-f73c-43e5-8f0b-d5eb2ae4a44a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-sgs44" Jul 01 19:18:08.931555 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:08.931379 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/2bd9ff89-f73c-43e5-8f0b-d5eb2ae4a44a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-sgs44\" (UID: \"2bd9ff89-f73c-43e5-8f0b-d5eb2ae4a44a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-sgs44" Jul 01 19:18:08.931555 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:08.931512 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/2bd9ff89-f73c-43e5-8f0b-d5eb2ae4a44a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-sgs44\" (UID: \"2bd9ff89-f73c-43e5-8f0b-d5eb2ae4a44a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-sgs44" Jul 01 19:18:08.931681 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:08.931562 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2bd9ff89-f73c-43e5-8f0b-d5eb2ae4a44a-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-sgs44\" (UID: \"2bd9ff89-f73c-43e5-8f0b-d5eb2ae4a44a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-sgs44" Jul 01 19:18:08.931681 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:08.931626 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/2bd9ff89-f73c-43e5-8f0b-d5eb2ae4a44a-cacerts\") pod \"istiod-openshift-gateway-7574459656-sgs44\" (UID: \"2bd9ff89-f73c-43e5-8f0b-d5eb2ae4a44a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-sgs44" Jul 01 19:18:08.932226 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:08.932200 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/2bd9ff89-f73c-43e5-8f0b-d5eb2ae4a44a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-sgs44\" (UID: \"2bd9ff89-f73c-43e5-8f0b-d5eb2ae4a44a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-sgs44" Jul 01 19:18:08.933752 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:08.933727 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/2bd9ff89-f73c-43e5-8f0b-d5eb2ae4a44a-local-certs\") pod \"istiod-openshift-gateway-7574459656-sgs44\" (UID: \"2bd9ff89-f73c-43e5-8f0b-d5eb2ae4a44a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-sgs44" Jul 01 19:18:08.933869 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:08.933851 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/2bd9ff89-f73c-43e5-8f0b-d5eb2ae4a44a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-sgs44\" (UID: \"2bd9ff89-f73c-43e5-8f0b-d5eb2ae4a44a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-sgs44" Jul 01 19:18:08.934149 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:08.934129 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2bd9ff89-f73c-43e5-8f0b-d5eb2ae4a44a-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-sgs44\" (UID: \"2bd9ff89-f73c-43e5-8f0b-d5eb2ae4a44a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-sgs44" Jul 01 19:18:08.934218 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:08.934185 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/2bd9ff89-f73c-43e5-8f0b-d5eb2ae4a44a-cacerts\") pod \"istiod-openshift-gateway-7574459656-sgs44\" (UID: \"2bd9ff89-f73c-43e5-8f0b-d5eb2ae4a44a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-sgs44" Jul 01 19:18:08.953161 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:08.953135 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2bd9ff89-f73c-43e5-8f0b-d5eb2ae4a44a-istio-token\") pod \"istiod-openshift-gateway-7574459656-sgs44\" (UID: \"2bd9ff89-f73c-43e5-8f0b-d5eb2ae4a44a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-sgs44" Jul 01 19:18:08.953264 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:08.953236 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-frlvn\" (UniqueName: \"kubernetes.io/projected/2bd9ff89-f73c-43e5-8f0b-d5eb2ae4a44a-kube-api-access-frlvn\") pod \"istiod-openshift-gateway-7574459656-sgs44\" (UID: \"2bd9ff89-f73c-43e5-8f0b-d5eb2ae4a44a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-sgs44" Jul 01 19:18:09.097128 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:09.097053 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-sgs44" Jul 01 19:18:10.086226 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:10.086191 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-6cfb579549-6x4pr"] Jul 01 19:18:10.093831 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:10.093809 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-6cfb579549-6x4pr" Jul 01 19:18:10.097196 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:10.097167 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-qgtrr\"" Jul 01 19:18:10.097640 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:10.097624 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jul 01 19:18:10.123910 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:10.123877 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-6cfb579549-6x4pr"] Jul 01 19:18:10.144758 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:10.144727 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjz82\" (UniqueName: \"kubernetes.io/projected/c0beece7-0b95-458c-858e-f3fab30e2dbe-kube-api-access-sjz82\") pod \"dashboard-redirect-6cfb579549-6x4pr\" (UID: \"c0beece7-0b95-458c-858e-f3fab30e2dbe\") " pod="opendatahub/dashboard-redirect-6cfb579549-6x4pr" Jul 01 19:18:10.144905 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:10.144883 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/c0beece7-0b95-458c-858e-f3fab30e2dbe-redirect-config\") pod \"dashboard-redirect-6cfb579549-6x4pr\" (UID: \"c0beece7-0b95-458c-858e-f3fab30e2dbe\") " pod="opendatahub/dashboard-redirect-6cfb579549-6x4pr" Jul 01 19:18:10.245790 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:10.245760 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/c0beece7-0b95-458c-858e-f3fab30e2dbe-redirect-config\") pod \"dashboard-redirect-6cfb579549-6x4pr\" (UID: \"c0beece7-0b95-458c-858e-f3fab30e2dbe\") " pod="opendatahub/dashboard-redirect-6cfb579549-6x4pr" Jul 01 19:18:10.245983 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:10.245814 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sjz82\" (UniqueName: \"kubernetes.io/projected/c0beece7-0b95-458c-858e-f3fab30e2dbe-kube-api-access-sjz82\") pod \"dashboard-redirect-6cfb579549-6x4pr\" (UID: \"c0beece7-0b95-458c-858e-f3fab30e2dbe\") " pod="opendatahub/dashboard-redirect-6cfb579549-6x4pr" Jul 01 19:18:10.246454 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:10.246430 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/c0beece7-0b95-458c-858e-f3fab30e2dbe-redirect-config\") pod \"dashboard-redirect-6cfb579549-6x4pr\" (UID: \"c0beece7-0b95-458c-858e-f3fab30e2dbe\") " pod="opendatahub/dashboard-redirect-6cfb579549-6x4pr" Jul 01 19:18:10.269667 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:10.269640 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjz82\" (UniqueName: \"kubernetes.io/projected/c0beece7-0b95-458c-858e-f3fab30e2dbe-kube-api-access-sjz82\") pod \"dashboard-redirect-6cfb579549-6x4pr\" (UID: \"c0beece7-0b95-458c-858e-f3fab30e2dbe\") " pod="opendatahub/dashboard-redirect-6cfb579549-6x4pr" Jul 01 19:18:10.407281 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:10.407210 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-6cfb579549-6x4pr" Jul 01 19:18:11.292896 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:11.292862 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-6cfb579549-6x4pr"] Jul 01 19:18:11.295778 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:18:11.295749 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0beece7_0b95_458c_858e_f3fab30e2dbe.slice/crio-d96ef2bd3bf48d8a03022d33fe18dc4e3ca03999d11b6edbfbc8aa7e99886ed4 WatchSource:0}: Error finding container d96ef2bd3bf48d8a03022d33fe18dc4e3ca03999d11b6edbfbc8aa7e99886ed4: Status 404 returned error can't find the container with id d96ef2bd3bf48d8a03022d33fe18dc4e3ca03999d11b6edbfbc8aa7e99886ed4 Jul 01 19:18:11.306105 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:11.306084 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-sgs44"] Jul 01 19:18:11.307697 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:18:11.307675 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2bd9ff89_f73c_43e5_8f0b_d5eb2ae4a44a.slice/crio-0d62c2195ebb68ee1b46a91d1587dbfbc4671879b2c32ea72b9104f88ec9c5ef WatchSource:0}: Error finding container 0d62c2195ebb68ee1b46a91d1587dbfbc4671879b2c32ea72b9104f88ec9c5ef: Status 404 returned error can't find the container with id 0d62c2195ebb68ee1b46a91d1587dbfbc4671879b2c32ea72b9104f88ec9c5ef Jul 01 19:18:11.457167 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:11.457132 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-658989848c-f6zvw" event={"ID":"8e1bd454-c549-4dcc-8d9a-3456621bac6d","Type":"ContainerStarted","Data":"e526092ac7e683eca20e0c7c4ee82f07817627d7ce333bbe090a1c2fcbbbeb7f"} Jul 01 19:18:11.458296 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:11.458263 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-sgs44" event={"ID":"2bd9ff89-f73c-43e5-8f0b-d5eb2ae4a44a","Type":"ContainerStarted","Data":"0d62c2195ebb68ee1b46a91d1587dbfbc4671879b2c32ea72b9104f88ec9c5ef"} Jul 01 19:18:11.459267 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:11.459244 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-6cfb579549-6x4pr" event={"ID":"c0beece7-0b95-458c-858e-f3fab30e2dbe","Type":"ContainerStarted","Data":"d96ef2bd3bf48d8a03022d33fe18dc4e3ca03999d11b6edbfbc8aa7e99886ed4"} Jul 01 19:18:11.460465 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:11.460446 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-qjt29" event={"ID":"1bf74f91-32ee-4f16-ae74-71e41d8b26f4","Type":"ContainerStarted","Data":"eb7c37fd2025ccff990a096bdbea554e26ba36fefe2ddf16737daaa5b69c1739"} Jul 01 19:18:11.460559 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:11.460539 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-5dd488fc48-qjt29" Jul 01 19:18:11.462018 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:11.461997 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-cn22b" event={"ID":"6d351df0-b1af-440b-b2fe-57ffbd83e9ec","Type":"ContainerStarted","Data":"273328311f76eef458158098ca8c21eec927cd6ab3479384720ddc5507ab9a4a"} Jul 01 19:18:11.462113 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:11.462053 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-6dc94f689f-cn22b" Jul 01 19:18:11.495910 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:11.495846 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-658989848c-f6zvw" podStartSLOduration=1.913648041 podStartE2EDuration="7.495826964s" totalImagesPullingTime="5.582178923s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:18:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:18:11.493320897 +0000 UTC m=+398.001761748" watchObservedRunningTime="2026-07-01 19:18:11.495826964 +0000 UTC m=+398.004267790" Jul 01 19:18:11.525294 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:11.525062 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-5dd488fc48-qjt29" podStartSLOduration=1.896388193 podStartE2EDuration="5.525041058s" totalImagesPullingTime="3.628652865s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:18:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:18:11.524115326 +0000 UTC m=+398.032556183" watchObservedRunningTime="2026-07-01 19:18:11.525041058 +0000 UTC m=+398.033481885" Jul 01 19:18:11.549292 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:11.549210 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-6dc94f689f-cn22b" podStartSLOduration=1.7217155 podStartE2EDuration="6.549187616s" totalImagesPullingTime="4.827472116s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:18:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:18:11.548713426 +0000 UTC m=+398.057154279" watchObservedRunningTime="2026-07-01 19:18:11.549187616 +0000 UTC m=+398.057628443" Jul 01 19:18:16.784653 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:16.784610 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-9wbnq"] Jul 01 19:18:16.791493 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:16.791472 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-9wbnq" Jul 01 19:18:16.800221 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:16.800116 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-z2g28\"" Jul 01 19:18:16.800478 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:16.800447 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jul 01 19:18:16.814660 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:16.814629 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-9wbnq"] Jul 01 19:18:16.861883 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:16.861854 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-7k5vl"] Jul 01 19:18:16.865091 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:16.865063 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-7k5vl" Jul 01 19:18:16.867628 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:16.867603 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-v7trd\"" Jul 01 19:18:16.867793 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:16.867610 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jul 01 19:18:16.891519 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:16.891483 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-7k5vl"] Jul 01 19:18:16.903758 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:16.903729 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fprbh\" (UniqueName: \"kubernetes.io/projected/21b9abac-b9e5-411c-a3d2-4caa2898b751-kube-api-access-fprbh\") pod \"kserve-controller-manager-69fc866d76-9wbnq\" (UID: \"21b9abac-b9e5-411c-a3d2-4caa2898b751\") " pod="opendatahub/kserve-controller-manager-69fc866d76-9wbnq" Jul 01 19:18:16.903879 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:16.903782 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/21b9abac-b9e5-411c-a3d2-4caa2898b751-cert\") pod \"kserve-controller-manager-69fc866d76-9wbnq\" (UID: \"21b9abac-b9e5-411c-a3d2-4caa2898b751\") " pod="opendatahub/kserve-controller-manager-69fc866d76-9wbnq" Jul 01 19:18:17.004429 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:17.004396 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8b3a266c-af35-44a7-8bbb-6c6082edf7e0-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-7k5vl\" (UID: \"8b3a266c-af35-44a7-8bbb-6c6082edf7e0\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-7k5vl" Jul 01 19:18:17.004585 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:17.004447 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l6wfs\" (UniqueName: \"kubernetes.io/projected/8b3a266c-af35-44a7-8bbb-6c6082edf7e0-kube-api-access-l6wfs\") pod \"llmisvc-controller-manager-864bfd7bc9-7k5vl\" (UID: \"8b3a266c-af35-44a7-8bbb-6c6082edf7e0\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-7k5vl" Jul 01 19:18:17.004585 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:17.004567 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fprbh\" (UniqueName: \"kubernetes.io/projected/21b9abac-b9e5-411c-a3d2-4caa2898b751-kube-api-access-fprbh\") pod \"kserve-controller-manager-69fc866d76-9wbnq\" (UID: \"21b9abac-b9e5-411c-a3d2-4caa2898b751\") " pod="opendatahub/kserve-controller-manager-69fc866d76-9wbnq" Jul 01 19:18:17.004654 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:17.004611 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/21b9abac-b9e5-411c-a3d2-4caa2898b751-cert\") pod \"kserve-controller-manager-69fc866d76-9wbnq\" (UID: \"21b9abac-b9e5-411c-a3d2-4caa2898b751\") " pod="opendatahub/kserve-controller-manager-69fc866d76-9wbnq" Jul 01 19:18:17.004774 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:18:17.004760 2561 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found Jul 01 19:18:17.004857 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:18:17.004845 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21b9abac-b9e5-411c-a3d2-4caa2898b751-cert podName:21b9abac-b9e5-411c-a3d2-4caa2898b751 nodeName:}" failed. No retries permitted until 2026-07-01 19:18:17.504821894 +0000 UTC m=+404.013262701 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/21b9abac-b9e5-411c-a3d2-4caa2898b751-cert") pod "kserve-controller-manager-69fc866d76-9wbnq" (UID: "21b9abac-b9e5-411c-a3d2-4caa2898b751") : secret "kserve-webhook-server-cert" not found Jul 01 19:18:17.021724 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:17.021683 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fprbh\" (UniqueName: \"kubernetes.io/projected/21b9abac-b9e5-411c-a3d2-4caa2898b751-kube-api-access-fprbh\") pod \"kserve-controller-manager-69fc866d76-9wbnq\" (UID: \"21b9abac-b9e5-411c-a3d2-4caa2898b751\") " pod="opendatahub/kserve-controller-manager-69fc866d76-9wbnq" Jul 01 19:18:17.105454 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:17.105377 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8b3a266c-af35-44a7-8bbb-6c6082edf7e0-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-7k5vl\" (UID: \"8b3a266c-af35-44a7-8bbb-6c6082edf7e0\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-7k5vl" Jul 01 19:18:17.105614 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:17.105533 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6wfs\" (UniqueName: \"kubernetes.io/projected/8b3a266c-af35-44a7-8bbb-6c6082edf7e0-kube-api-access-l6wfs\") pod \"llmisvc-controller-manager-864bfd7bc9-7k5vl\" (UID: \"8b3a266c-af35-44a7-8bbb-6c6082edf7e0\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-7k5vl" Jul 01 19:18:17.108137 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:17.108109 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8b3a266c-af35-44a7-8bbb-6c6082edf7e0-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-7k5vl\" (UID: \"8b3a266c-af35-44a7-8bbb-6c6082edf7e0\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-7k5vl" Jul 01 19:18:17.119670 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:17.119643 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l6wfs\" (UniqueName: \"kubernetes.io/projected/8b3a266c-af35-44a7-8bbb-6c6082edf7e0-kube-api-access-l6wfs\") pod \"llmisvc-controller-manager-864bfd7bc9-7k5vl\" (UID: \"8b3a266c-af35-44a7-8bbb-6c6082edf7e0\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-7k5vl" Jul 01 19:18:17.176885 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:17.176852 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-7k5vl" Jul 01 19:18:17.276343 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:17.276302 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 01 19:18:17.276435 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:17.276375 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 01 19:18:17.453265 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:17.453218 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-7k5vl"] Jul 01 19:18:17.455294 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:18:17.455269 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod8b3a266c_af35_44a7_8bbb_6c6082edf7e0.slice/crio-1f8ab10d53a24ecff5e8dc02d0237e04cf7b1d9c16ae0aff96ff6269d0cd2e24 WatchSource:0}: Error finding container 1f8ab10d53a24ecff5e8dc02d0237e04cf7b1d9c16ae0aff96ff6269d0cd2e24: Status 404 returned error can't find the container with id 1f8ab10d53a24ecff5e8dc02d0237e04cf7b1d9c16ae0aff96ff6269d0cd2e24 Jul 01 19:18:17.491844 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:17.491814 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-6cfb579549-6x4pr" event={"ID":"c0beece7-0b95-458c-858e-f3fab30e2dbe","Type":"ContainerStarted","Data":"0faba2dcffb473a2bf71674df1f4cd889f2d97ff3c5effa3f817c0c68fc9f0bf"} Jul 01 19:18:17.493436 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:17.493411 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-sgs44" event={"ID":"2bd9ff89-f73c-43e5-8f0b-d5eb2ae4a44a","Type":"ContainerStarted","Data":"a169edddac97b125335435bb312e90bebdb28b0c0e133b106d9973c836bd4afd"} Jul 01 19:18:17.493555 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:17.493463 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-sgs44" Jul 01 19:18:17.494583 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:17.494564 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-7k5vl" event={"ID":"8b3a266c-af35-44a7-8bbb-6c6082edf7e0","Type":"ContainerStarted","Data":"1f8ab10d53a24ecff5e8dc02d0237e04cf7b1d9c16ae0aff96ff6269d0cd2e24"} Jul 01 19:18:17.507577 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:17.507559 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/21b9abac-b9e5-411c-a3d2-4caa2898b751-cert\") pod \"kserve-controller-manager-69fc866d76-9wbnq\" (UID: \"21b9abac-b9e5-411c-a3d2-4caa2898b751\") " pod="opendatahub/kserve-controller-manager-69fc866d76-9wbnq" Jul 01 19:18:17.509853 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:17.509835 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/21b9abac-b9e5-411c-a3d2-4caa2898b751-cert\") pod \"kserve-controller-manager-69fc866d76-9wbnq\" (UID: \"21b9abac-b9e5-411c-a3d2-4caa2898b751\") " pod="opendatahub/kserve-controller-manager-69fc866d76-9wbnq" Jul 01 19:18:17.520809 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:17.520772 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-6cfb579549-6x4pr" podStartSLOduration=1.545997546 podStartE2EDuration="7.520759624s" totalImagesPullingTime="5.974762078s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:18:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:18:17.520707926 +0000 UTC m=+404.029148752" watchObservedRunningTime="2026-07-01 19:18:17.520759624 +0000 UTC m=+404.029200450" Jul 01 19:18:17.564432 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:17.564381 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-sgs44" podStartSLOduration=3.597835853 podStartE2EDuration="9.564365429s" totalImagesPullingTime="5.966529576s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:18:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:18:17.564067892 +0000 UTC m=+404.072508745" watchObservedRunningTime="2026-07-01 19:18:17.564365429 +0000 UTC m=+404.072806252" Jul 01 19:18:17.705462 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:17.705378 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-9wbnq" Jul 01 19:18:17.858287 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:17.858255 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-9wbnq"] Jul 01 19:18:17.861018 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:18:17.860992 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21b9abac_b9e5_411c_a3d2_4caa2898b751.slice/crio-622a19c0954e9edd786b0bc7b3e9f97ef6b16f35366561070a8070d84dc2a1cd WatchSource:0}: Error finding container 622a19c0954e9edd786b0bc7b3e9f97ef6b16f35366561070a8070d84dc2a1cd: Status 404 returned error can't find the container with id 622a19c0954e9edd786b0bc7b3e9f97ef6b16f35366561070a8070d84dc2a1cd Jul 01 19:18:18.501243 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:18.501166 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-9wbnq" event={"ID":"21b9abac-b9e5-411c-a3d2-4caa2898b751","Type":"ContainerStarted","Data":"622a19c0954e9edd786b0bc7b3e9f97ef6b16f35366561070a8070d84dc2a1cd"} Jul 01 19:18:18.506466 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:18.506352 2561 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-sgs44 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 01 19:18:18.506466 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:18.506427 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-sgs44" podUID="2bd9ff89-f73c-43e5-8f0b-d5eb2ae4a44a" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 01 19:18:21.502971 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:21.502927 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-sgs44" Jul 01 19:18:21.517208 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:21.517181 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-9wbnq" event={"ID":"21b9abac-b9e5-411c-a3d2-4caa2898b751","Type":"ContainerStarted","Data":"c5c98fdf7da9fe503ef24450fd1c98695e9e77a33ac28a0b404163efdb5bfa69"} Jul 01 19:18:21.517360 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:21.517237 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-69fc866d76-9wbnq" Jul 01 19:18:21.518609 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:21.518588 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-7k5vl" event={"ID":"8b3a266c-af35-44a7-8bbb-6c6082edf7e0","Type":"ContainerStarted","Data":"6f1cc786d7d7322ae6b356467b5d23a4ac2c9adff70158d71d08dc7264813414"} Jul 01 19:18:21.518729 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:21.518716 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-7k5vl" Jul 01 19:18:21.565527 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:21.565473 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-7k5vl" podStartSLOduration=1.872489608 podStartE2EDuration="5.565452177s" totalImagesPullingTime="3.692962569s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:18:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:18:21.561626245 +0000 UTC m=+408.070067071" watchObservedRunningTime="2026-07-01 19:18:21.565452177 +0000 UTC m=+408.073893003" Jul 01 19:18:21.586571 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:21.586514 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-69fc866d76-9wbnq" podStartSLOduration=2.302653654 podStartE2EDuration="5.586493948s" totalImagesPullingTime="3.283840294s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:18:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:18:21.585828737 +0000 UTC m=+408.094269562" watchObservedRunningTime="2026-07-01 19:18:21.586493948 +0000 UTC m=+408.094934774" Jul 01 19:18:22.470123 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:22.470094 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-6dc94f689f-cn22b" Jul 01 19:18:22.472003 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:22.471986 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-5dd488fc48-qjt29" Jul 01 19:18:22.861354 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:22.861269 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-sgs44"] Jul 01 19:18:22.861714 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:22.861452 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-sgs44" podUID="2bd9ff89-f73c-43e5-8f0b-d5eb2ae4a44a" containerName="discovery" containerID="cri-o://a169edddac97b125335435bb312e90bebdb28b0c0e133b106d9973c836bd4afd" gracePeriod=30 Jul 01 19:18:23.117448 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:23.117387 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-sgs44" Jul 01 19:18:23.267809 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:23.267768 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2bd9ff89-f73c-43e5-8f0b-d5eb2ae4a44a-istio-token\") pod \"2bd9ff89-f73c-43e5-8f0b-d5eb2ae4a44a\" (UID: \"2bd9ff89-f73c-43e5-8f0b-d5eb2ae4a44a\") " Jul 01 19:18:23.268020 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:23.267845 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/2bd9ff89-f73c-43e5-8f0b-d5eb2ae4a44a-istio-csr-ca-configmap\") pod \"2bd9ff89-f73c-43e5-8f0b-d5eb2ae4a44a\" (UID: \"2bd9ff89-f73c-43e5-8f0b-d5eb2ae4a44a\") " Jul 01 19:18:23.268020 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:23.267872 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/2bd9ff89-f73c-43e5-8f0b-d5eb2ae4a44a-istio-csr-dns-cert\") pod \"2bd9ff89-f73c-43e5-8f0b-d5eb2ae4a44a\" (UID: \"2bd9ff89-f73c-43e5-8f0b-d5eb2ae4a44a\") " Jul 01 19:18:23.268020 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:23.267902 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-frlvn\" (UniqueName: \"kubernetes.io/projected/2bd9ff89-f73c-43e5-8f0b-d5eb2ae4a44a-kube-api-access-frlvn\") pod \"2bd9ff89-f73c-43e5-8f0b-d5eb2ae4a44a\" (UID: \"2bd9ff89-f73c-43e5-8f0b-d5eb2ae4a44a\") " Jul 01 19:18:23.268020 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:23.267920 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/2bd9ff89-f73c-43e5-8f0b-d5eb2ae4a44a-cacerts\") pod \"2bd9ff89-f73c-43e5-8f0b-d5eb2ae4a44a\" (UID: \"2bd9ff89-f73c-43e5-8f0b-d5eb2ae4a44a\") " Jul 01 19:18:23.268020 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:23.267973 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/2bd9ff89-f73c-43e5-8f0b-d5eb2ae4a44a-local-certs\") pod \"2bd9ff89-f73c-43e5-8f0b-d5eb2ae4a44a\" (UID: \"2bd9ff89-f73c-43e5-8f0b-d5eb2ae4a44a\") " Jul 01 19:18:23.268020 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:23.268007 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2bd9ff89-f73c-43e5-8f0b-d5eb2ae4a44a-istio-kubeconfig\") pod \"2bd9ff89-f73c-43e5-8f0b-d5eb2ae4a44a\" (UID: \"2bd9ff89-f73c-43e5-8f0b-d5eb2ae4a44a\") " Jul 01 19:18:23.268378 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:23.268349 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2bd9ff89-f73c-43e5-8f0b-d5eb2ae4a44a-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "2bd9ff89-f73c-43e5-8f0b-d5eb2ae4a44a" (UID: "2bd9ff89-f73c-43e5-8f0b-d5eb2ae4a44a"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 19:18:23.270546 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:23.270495 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2bd9ff89-f73c-43e5-8f0b-d5eb2ae4a44a-kube-api-access-frlvn" (OuterVolumeSpecName: "kube-api-access-frlvn") pod "2bd9ff89-f73c-43e5-8f0b-d5eb2ae4a44a" (UID: "2bd9ff89-f73c-43e5-8f0b-d5eb2ae4a44a"). InnerVolumeSpecName "kube-api-access-frlvn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 19:18:23.270766 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:23.270731 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2bd9ff89-f73c-43e5-8f0b-d5eb2ae4a44a-cacerts" (OuterVolumeSpecName: "cacerts") pod "2bd9ff89-f73c-43e5-8f0b-d5eb2ae4a44a" (UID: "2bd9ff89-f73c-43e5-8f0b-d5eb2ae4a44a"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 19:18:23.270766 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:23.270745 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2bd9ff89-f73c-43e5-8f0b-d5eb2ae4a44a-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "2bd9ff89-f73c-43e5-8f0b-d5eb2ae4a44a" (UID: "2bd9ff89-f73c-43e5-8f0b-d5eb2ae4a44a"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 19:18:23.270766 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:23.270757 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2bd9ff89-f73c-43e5-8f0b-d5eb2ae4a44a-istio-token" (OuterVolumeSpecName: "istio-token") pod "2bd9ff89-f73c-43e5-8f0b-d5eb2ae4a44a" (UID: "2bd9ff89-f73c-43e5-8f0b-d5eb2ae4a44a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 19:18:23.270925 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:23.270765 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2bd9ff89-f73c-43e5-8f0b-d5eb2ae4a44a-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "2bd9ff89-f73c-43e5-8f0b-d5eb2ae4a44a" (UID: "2bd9ff89-f73c-43e5-8f0b-d5eb2ae4a44a"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 19:18:23.270925 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:23.270812 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2bd9ff89-f73c-43e5-8f0b-d5eb2ae4a44a-local-certs" (OuterVolumeSpecName: "local-certs") pod "2bd9ff89-f73c-43e5-8f0b-d5eb2ae4a44a" (UID: "2bd9ff89-f73c-43e5-8f0b-d5eb2ae4a44a"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 19:18:23.369374 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:23.369290 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-frlvn\" (UniqueName: \"kubernetes.io/projected/2bd9ff89-f73c-43e5-8f0b-d5eb2ae4a44a-kube-api-access-frlvn\") on node \"ip-10-0-131-184.ec2.internal\" DevicePath \"\"" Jul 01 19:18:23.369374 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:23.369319 2561 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/2bd9ff89-f73c-43e5-8f0b-d5eb2ae4a44a-cacerts\") on node \"ip-10-0-131-184.ec2.internal\" DevicePath \"\"" Jul 01 19:18:23.369374 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:23.369328 2561 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/2bd9ff89-f73c-43e5-8f0b-d5eb2ae4a44a-local-certs\") on node \"ip-10-0-131-184.ec2.internal\" DevicePath \"\"" Jul 01 19:18:23.369374 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:23.369339 2561 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2bd9ff89-f73c-43e5-8f0b-d5eb2ae4a44a-istio-kubeconfig\") on node \"ip-10-0-131-184.ec2.internal\" DevicePath \"\"" Jul 01 19:18:23.369374 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:23.369346 2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2bd9ff89-f73c-43e5-8f0b-d5eb2ae4a44a-istio-token\") on node \"ip-10-0-131-184.ec2.internal\" DevicePath \"\"" Jul 01 19:18:23.369374 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:23.369356 2561 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/2bd9ff89-f73c-43e5-8f0b-d5eb2ae4a44a-istio-csr-ca-configmap\") on node \"ip-10-0-131-184.ec2.internal\" DevicePath \"\"" Jul 01 19:18:23.369374 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:23.369364 2561 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/2bd9ff89-f73c-43e5-8f0b-d5eb2ae4a44a-istio-csr-dns-cert\") on node \"ip-10-0-131-184.ec2.internal\" DevicePath \"\"" Jul 01 19:18:23.531264 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:23.531231 2561 generic.go:356] "Generic (PLEG): container finished" podID="2bd9ff89-f73c-43e5-8f0b-d5eb2ae4a44a" containerID="a169edddac97b125335435bb312e90bebdb28b0c0e133b106d9973c836bd4afd" exitCode=0 Jul 01 19:18:23.531264 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:23.531268 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-sgs44" event={"ID":"2bd9ff89-f73c-43e5-8f0b-d5eb2ae4a44a","Type":"ContainerDied","Data":"a169edddac97b125335435bb312e90bebdb28b0c0e133b106d9973c836bd4afd"} Jul 01 19:18:23.531509 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:23.531286 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-sgs44" Jul 01 19:18:23.531509 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:23.531305 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-sgs44" event={"ID":"2bd9ff89-f73c-43e5-8f0b-d5eb2ae4a44a","Type":"ContainerDied","Data":"0d62c2195ebb68ee1b46a91d1587dbfbc4671879b2c32ea72b9104f88ec9c5ef"} Jul 01 19:18:23.531509 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:23.531325 2561 scope.go:117] "RemoveContainer" containerID="a169edddac97b125335435bb312e90bebdb28b0c0e133b106d9973c836bd4afd" Jul 01 19:18:23.540119 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:23.540099 2561 scope.go:117] "RemoveContainer" containerID="a169edddac97b125335435bb312e90bebdb28b0c0e133b106d9973c836bd4afd" Jul 01 19:18:23.540376 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:18:23.540357 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a169edddac97b125335435bb312e90bebdb28b0c0e133b106d9973c836bd4afd\": container with ID starting with a169edddac97b125335435bb312e90bebdb28b0c0e133b106d9973c836bd4afd not found: ID does not exist" containerID="a169edddac97b125335435bb312e90bebdb28b0c0e133b106d9973c836bd4afd" Jul 01 19:18:23.540425 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:23.540384 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a169edddac97b125335435bb312e90bebdb28b0c0e133b106d9973c836bd4afd"} err="failed to get container status \"a169edddac97b125335435bb312e90bebdb28b0c0e133b106d9973c836bd4afd\": rpc error: code = NotFound desc = could not find container \"a169edddac97b125335435bb312e90bebdb28b0c0e133b106d9973c836bd4afd\": container with ID starting with a169edddac97b125335435bb312e90bebdb28b0c0e133b106d9973c836bd4afd not found: ID does not exist" Jul 01 19:18:23.555941 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:23.555916 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-sgs44"] Jul 01 19:18:23.560109 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:23.560090 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-sgs44"] Jul 01 19:18:23.982750 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:23.982708 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2bd9ff89-f73c-43e5-8f0b-d5eb2ae4a44a" path="/var/lib/kubelet/pods/2bd9ff89-f73c-43e5-8f0b-d5eb2ae4a44a/volumes" Jul 01 19:18:52.528819 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:52.528786 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-7k5vl" Jul 01 19:18:52.531756 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:18:52.531730 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-69fc866d76-9wbnq" Jul 01 19:19:05.375861 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:19:05.375788 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-2mbm8"] Jul 01 19:19:05.376228 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:19:05.376105 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2bd9ff89-f73c-43e5-8f0b-d5eb2ae4a44a" containerName="discovery" Jul 01 19:19:05.376228 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:19:05.376116 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="2bd9ff89-f73c-43e5-8f0b-d5eb2ae4a44a" containerName="discovery" Jul 01 19:19:05.376228 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:19:05.376183 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="2bd9ff89-f73c-43e5-8f0b-d5eb2ae4a44a" containerName="discovery" Jul 01 19:19:05.380233 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:19:05.380214 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-2mbm8" Jul 01 19:19:05.382422 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:19:05.382399 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-qwnn6\"" Jul 01 19:19:05.382550 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:19:05.382441 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 01 19:19:05.382809 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:19:05.382794 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 01 19:19:05.384240 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:19:05.384196 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nt7rj\" (UniqueName: \"kubernetes.io/projected/c841e6e2-43e0-4b2f-aa56-f661c2ae42d6-kube-api-access-nt7rj\") pod \"kuadrant-operator-catalog-2mbm8\" (UID: \"c841e6e2-43e0-4b2f-aa56-f661c2ae42d6\") " pod="kuadrant-system/kuadrant-operator-catalog-2mbm8" Jul 01 19:19:05.386512 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:19:05.386490 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-2mbm8"] Jul 01 19:19:05.484674 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:19:05.484642 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nt7rj\" (UniqueName: \"kubernetes.io/projected/c841e6e2-43e0-4b2f-aa56-f661c2ae42d6-kube-api-access-nt7rj\") pod \"kuadrant-operator-catalog-2mbm8\" (UID: \"c841e6e2-43e0-4b2f-aa56-f661c2ae42d6\") " pod="kuadrant-system/kuadrant-operator-catalog-2mbm8" Jul 01 19:19:05.492171 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:19:05.492145 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nt7rj\" (UniqueName: \"kubernetes.io/projected/c841e6e2-43e0-4b2f-aa56-f661c2ae42d6-kube-api-access-nt7rj\") pod \"kuadrant-operator-catalog-2mbm8\" (UID: \"c841e6e2-43e0-4b2f-aa56-f661c2ae42d6\") " pod="kuadrant-system/kuadrant-operator-catalog-2mbm8" Jul 01 19:19:05.692696 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:19:05.692667 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-2mbm8" Jul 01 19:19:05.737692 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:19:05.737643 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-2mbm8"] Jul 01 19:19:05.816867 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:19:05.816847 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-2mbm8"] Jul 01 19:19:05.819101 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:19:05.819077 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc841e6e2_43e0_4b2f_aa56_f661c2ae42d6.slice/crio-e5e0a394ca00bb5cc367434f0b6dbbdce6cf11daed4adc333a6077b2091020d8 WatchSource:0}: Error finding container e5e0a394ca00bb5cc367434f0b6dbbdce6cf11daed4adc333a6077b2091020d8: Status 404 returned error can't find the container with id e5e0a394ca00bb5cc367434f0b6dbbdce6cf11daed4adc333a6077b2091020d8 Jul 01 19:19:05.947718 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:19:05.947648 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-7tnk8"] Jul 01 19:19:05.951997 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:19:05.951982 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-7tnk8" Jul 01 19:19:05.958091 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:19:05.958068 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-7tnk8"] Jul 01 19:19:05.988853 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:19:05.988829 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m8kcw\" (UniqueName: \"kubernetes.io/projected/26b21b53-2ea2-4753-87ce-9f50e7fc1bd8-kube-api-access-m8kcw\") pod \"kuadrant-operator-catalog-7tnk8\" (UID: \"26b21b53-2ea2-4753-87ce-9f50e7fc1bd8\") " pod="kuadrant-system/kuadrant-operator-catalog-7tnk8" Jul 01 19:19:06.089885 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:19:06.089858 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m8kcw\" (UniqueName: \"kubernetes.io/projected/26b21b53-2ea2-4753-87ce-9f50e7fc1bd8-kube-api-access-m8kcw\") pod \"kuadrant-operator-catalog-7tnk8\" (UID: \"26b21b53-2ea2-4753-87ce-9f50e7fc1bd8\") " pod="kuadrant-system/kuadrant-operator-catalog-7tnk8" Jul 01 19:19:06.099365 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:19:06.099336 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m8kcw\" (UniqueName: \"kubernetes.io/projected/26b21b53-2ea2-4753-87ce-9f50e7fc1bd8-kube-api-access-m8kcw\") pod \"kuadrant-operator-catalog-7tnk8\" (UID: \"26b21b53-2ea2-4753-87ce-9f50e7fc1bd8\") " pod="kuadrant-system/kuadrant-operator-catalog-7tnk8" Jul 01 19:19:06.262642 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:19:06.262569 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-7tnk8" Jul 01 19:19:06.412244 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:19:06.412214 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-7tnk8"] Jul 01 19:19:06.447375 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:19:06.447341 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26b21b53_2ea2_4753_87ce_9f50e7fc1bd8.slice/crio-dcc5ffaa92513f41f400e0a348b7b9e6167ed2849f12045900c4c263fe84ea4b WatchSource:0}: Error finding container dcc5ffaa92513f41f400e0a348b7b9e6167ed2849f12045900c4c263fe84ea4b: Status 404 returned error can't find the container with id dcc5ffaa92513f41f400e0a348b7b9e6167ed2849f12045900c4c263fe84ea4b Jul 01 19:19:06.717158 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:19:06.717126 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-2mbm8" event={"ID":"c841e6e2-43e0-4b2f-aa56-f661c2ae42d6","Type":"ContainerStarted","Data":"e5e0a394ca00bb5cc367434f0b6dbbdce6cf11daed4adc333a6077b2091020d8"} Jul 01 19:19:06.718286 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:19:06.718259 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-7tnk8" event={"ID":"26b21b53-2ea2-4753-87ce-9f50e7fc1bd8","Type":"ContainerStarted","Data":"dcc5ffaa92513f41f400e0a348b7b9e6167ed2849f12045900c4c263fe84ea4b"} Jul 01 19:19:08.729037 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:19:08.728998 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-2mbm8" event={"ID":"c841e6e2-43e0-4b2f-aa56-f661c2ae42d6","Type":"ContainerStarted","Data":"8109fb2662a05a1495c2d62722592b0e9a0a01f2d514677f1cf96a9dc86a7e25"} Jul 01 19:19:08.729510 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:19:08.729070 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-2mbm8" podUID="c841e6e2-43e0-4b2f-aa56-f661c2ae42d6" containerName="registry-server" containerID="cri-o://8109fb2662a05a1495c2d62722592b0e9a0a01f2d514677f1cf96a9dc86a7e25" gracePeriod=2 Jul 01 19:19:08.730343 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:19:08.730314 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-7tnk8" event={"ID":"26b21b53-2ea2-4753-87ce-9f50e7fc1bd8","Type":"ContainerStarted","Data":"61438af136ea23c82ac2b4a664c1f2aa13a46e4710c5681ff384ee7f00623fd5"} Jul 01 19:19:08.744063 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:19:08.744013 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-2mbm8" podStartSLOduration=1.768328462 podStartE2EDuration="3.743996295s" totalImagesPullingTime="1.975667833s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:19:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:19:08.742541182 +0000 UTC m=+455.250982010" watchObservedRunningTime="2026-07-01 19:19:08.743996295 +0000 UTC m=+455.252437121" Jul 01 19:19:08.759057 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:19:08.759018 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-7tnk8" podStartSLOduration=2.408717823 podStartE2EDuration="3.759003147s" totalImagesPullingTime="1.350285324s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:19:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:19:08.757800119 +0000 UTC m=+455.266240945" watchObservedRunningTime="2026-07-01 19:19:08.759003147 +0000 UTC m=+455.267443972" Jul 01 19:19:08.980778 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:19:08.980720 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-2mbm8" Jul 01 19:19:09.011052 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:19:09.011026 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nt7rj\" (UniqueName: \"kubernetes.io/projected/c841e6e2-43e0-4b2f-aa56-f661c2ae42d6-kube-api-access-nt7rj\") pod \"c841e6e2-43e0-4b2f-aa56-f661c2ae42d6\" (UID: \"c841e6e2-43e0-4b2f-aa56-f661c2ae42d6\") " Jul 01 19:19:09.013172 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:19:09.013140 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c841e6e2-43e0-4b2f-aa56-f661c2ae42d6-kube-api-access-nt7rj" (OuterVolumeSpecName: "kube-api-access-nt7rj") pod "c841e6e2-43e0-4b2f-aa56-f661c2ae42d6" (UID: "c841e6e2-43e0-4b2f-aa56-f661c2ae42d6"). InnerVolumeSpecName "kube-api-access-nt7rj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 19:19:09.111725 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:19:09.111682 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nt7rj\" (UniqueName: \"kubernetes.io/projected/c841e6e2-43e0-4b2f-aa56-f661c2ae42d6-kube-api-access-nt7rj\") on node \"ip-10-0-131-184.ec2.internal\" DevicePath \"\"" Jul 01 19:19:09.736328 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:19:09.736296 2561 generic.go:356] "Generic (PLEG): container finished" podID="c841e6e2-43e0-4b2f-aa56-f661c2ae42d6" containerID="8109fb2662a05a1495c2d62722592b0e9a0a01f2d514677f1cf96a9dc86a7e25" exitCode=0 Jul 01 19:19:09.736779 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:19:09.736348 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-2mbm8" Jul 01 19:19:09.736779 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:19:09.736380 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-2mbm8" event={"ID":"c841e6e2-43e0-4b2f-aa56-f661c2ae42d6","Type":"ContainerDied","Data":"8109fb2662a05a1495c2d62722592b0e9a0a01f2d514677f1cf96a9dc86a7e25"} Jul 01 19:19:09.736779 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:19:09.736438 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-2mbm8" event={"ID":"c841e6e2-43e0-4b2f-aa56-f661c2ae42d6","Type":"ContainerDied","Data":"e5e0a394ca00bb5cc367434f0b6dbbdce6cf11daed4adc333a6077b2091020d8"} Jul 01 19:19:09.736779 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:19:09.736469 2561 scope.go:117] "RemoveContainer" containerID="8109fb2662a05a1495c2d62722592b0e9a0a01f2d514677f1cf96a9dc86a7e25" Jul 01 19:19:09.745268 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:19:09.745251 2561 scope.go:117] "RemoveContainer" containerID="8109fb2662a05a1495c2d62722592b0e9a0a01f2d514677f1cf96a9dc86a7e25" Jul 01 19:19:09.745517 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:19:09.745500 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8109fb2662a05a1495c2d62722592b0e9a0a01f2d514677f1cf96a9dc86a7e25\": container with ID starting with 8109fb2662a05a1495c2d62722592b0e9a0a01f2d514677f1cf96a9dc86a7e25 not found: ID does not exist" containerID="8109fb2662a05a1495c2d62722592b0e9a0a01f2d514677f1cf96a9dc86a7e25" Jul 01 19:19:09.745582 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:19:09.745525 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8109fb2662a05a1495c2d62722592b0e9a0a01f2d514677f1cf96a9dc86a7e25"} err="failed to get container status \"8109fb2662a05a1495c2d62722592b0e9a0a01f2d514677f1cf96a9dc86a7e25\": rpc error: code = NotFound desc = could not find container \"8109fb2662a05a1495c2d62722592b0e9a0a01f2d514677f1cf96a9dc86a7e25\": container with ID starting with 8109fb2662a05a1495c2d62722592b0e9a0a01f2d514677f1cf96a9dc86a7e25 not found: ID does not exist" Jul 01 19:19:09.756025 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:19:09.756001 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-2mbm8"] Jul 01 19:19:09.761741 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:19:09.761721 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-2mbm8"] Jul 01 19:19:09.977589 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:19:09.977560 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c841e6e2-43e0-4b2f-aa56-f661c2ae42d6" path="/var/lib/kubelet/pods/c841e6e2-43e0-4b2f-aa56-f661c2ae42d6/volumes" Jul 01 19:19:16.263674 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:19:16.263626 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-7tnk8" Jul 01 19:19:16.264099 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:19:16.263731 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-7tnk8" Jul 01 19:19:16.285671 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:19:16.285647 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-7tnk8" Jul 01 19:19:16.787436 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:19:16.787413 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-7tnk8" Jul 01 19:19:37.689964 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:19:37.689919 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-jbljx"] Jul 01 19:19:37.690369 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:19:37.690228 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c841e6e2-43e0-4b2f-aa56-f661c2ae42d6" containerName="registry-server" Jul 01 19:19:37.690369 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:19:37.690238 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="c841e6e2-43e0-4b2f-aa56-f661c2ae42d6" containerName="registry-server" Jul 01 19:19:37.690369 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:19:37.690296 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="c841e6e2-43e0-4b2f-aa56-f661c2ae42d6" containerName="registry-server" Jul 01 19:19:37.694339 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:19:37.694320 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-jbljx" Jul 01 19:19:37.696477 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:19:37.696457 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jul 01 19:19:37.696720 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:19:37.696706 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-h79ph\"" Jul 01 19:19:37.714667 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:19:37.714643 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-jbljx"] Jul 01 19:19:37.816136 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:19:37.816099 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxzrh\" (UniqueName: \"kubernetes.io/projected/4274774b-a705-4110-93e8-bdf8eaaae520-kube-api-access-xxzrh\") pod \"dns-operator-controller-manager-864dd78c4c-jbljx\" (UID: \"4274774b-a705-4110-93e8-bdf8eaaae520\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-jbljx" Jul 01 19:19:37.916471 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:19:37.916433 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxzrh\" (UniqueName: \"kubernetes.io/projected/4274774b-a705-4110-93e8-bdf8eaaae520-kube-api-access-xxzrh\") pod \"dns-operator-controller-manager-864dd78c4c-jbljx\" (UID: \"4274774b-a705-4110-93e8-bdf8eaaae520\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-jbljx" Jul 01 19:19:37.924474 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:19:37.924458 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxzrh\" (UniqueName: \"kubernetes.io/projected/4274774b-a705-4110-93e8-bdf8eaaae520-kube-api-access-xxzrh\") pod \"dns-operator-controller-manager-864dd78c4c-jbljx\" (UID: \"4274774b-a705-4110-93e8-bdf8eaaae520\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-jbljx" Jul 01 19:19:38.004669 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:19:38.004586 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-jbljx" Jul 01 19:19:38.132983 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:19:38.132939 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-jbljx"] Jul 01 19:19:38.135567 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:19:38.135538 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4274774b_a705_4110_93e8_bdf8eaaae520.slice/crio-9a26571eb2547e1b0ec0ed503812cf180f9e14419f956503da92b81131103883 WatchSource:0}: Error finding container 9a26571eb2547e1b0ec0ed503812cf180f9e14419f956503da92b81131103883: Status 404 returned error can't find the container with id 9a26571eb2547e1b0ec0ed503812cf180f9e14419f956503da92b81131103883 Jul 01 19:19:38.857873 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:19:38.857843 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-jbljx" event={"ID":"4274774b-a705-4110-93e8-bdf8eaaae520","Type":"ContainerStarted","Data":"9a26571eb2547e1b0ec0ed503812cf180f9e14419f956503da92b81131103883"} Jul 01 19:19:41.130914 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:19:41.130879 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mcgks"] Jul 01 19:19:41.134375 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:19:41.134350 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mcgks" Jul 01 19:19:41.136213 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:19:41.136192 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-ss2g6\"" Jul 01 19:19:41.145177 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:19:41.145154 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mcgks"] Jul 01 19:19:41.241342 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:19:41.241300 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjvvx\" (UniqueName: \"kubernetes.io/projected/034f0335-87ae-4ef2-a555-ba4e2951fdee-kube-api-access-vjvvx\") pod \"limitador-operator-controller-manager-859d7b78bd-mcgks\" (UID: \"034f0335-87ae-4ef2-a555-ba4e2951fdee\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mcgks" Jul 01 19:19:41.342692 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:19:41.342667 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjvvx\" (UniqueName: \"kubernetes.io/projected/034f0335-87ae-4ef2-a555-ba4e2951fdee-kube-api-access-vjvvx\") pod \"limitador-operator-controller-manager-859d7b78bd-mcgks\" (UID: \"034f0335-87ae-4ef2-a555-ba4e2951fdee\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mcgks" Jul 01 19:19:41.359694 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:19:41.359667 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjvvx\" (UniqueName: \"kubernetes.io/projected/034f0335-87ae-4ef2-a555-ba4e2951fdee-kube-api-access-vjvvx\") pod \"limitador-operator-controller-manager-859d7b78bd-mcgks\" (UID: \"034f0335-87ae-4ef2-a555-ba4e2951fdee\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mcgks" Jul 01 19:19:41.446811 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:19:41.446779 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mcgks" Jul 01 19:19:41.584145 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:19:41.578671 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mcgks"] Jul 01 19:19:41.872481 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:19:41.872401 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mcgks" event={"ID":"034f0335-87ae-4ef2-a555-ba4e2951fdee","Type":"ContainerStarted","Data":"d58f302f184faf466c0ce34bcbf567f5d20a1c4f8121e99e07c692d5790903c4"} Jul 01 19:19:41.873842 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:19:41.873819 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-jbljx" event={"ID":"4274774b-a705-4110-93e8-bdf8eaaae520","Type":"ContainerStarted","Data":"d39c2949a19b4cab4ed87540302d5f826d76bb545d908ffc5b7eef4c006a9126"} Jul 01 19:19:41.873999 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:19:41.873984 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-jbljx" Jul 01 19:19:41.896132 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:19:41.896090 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-jbljx" podStartSLOduration=1.750159586 podStartE2EDuration="4.896076258s" totalImagesPullingTime="3.145916672s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:19:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:19:41.894985708 +0000 UTC m=+488.403426550" watchObservedRunningTime="2026-07-01 19:19:41.896076258 +0000 UTC m=+488.404517146" Jul 01 19:19:43.885907 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:19:43.885871 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mcgks" event={"ID":"034f0335-87ae-4ef2-a555-ba4e2951fdee","Type":"ContainerStarted","Data":"b9b0864b440dd2e6a043623c3b771077769cc5c60a4ee0f973e28d63fdbafedd"} Jul 01 19:19:43.886306 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:19:43.886092 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mcgks" Jul 01 19:19:43.930665 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:19:43.930618 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mcgks" podStartSLOduration=0.78941956 podStartE2EDuration="2.930601971s" totalImagesPullingTime="2.141182411s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:19:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:19:43.930213489 +0000 UTC m=+490.438654346" watchObservedRunningTime="2026-07-01 19:19:43.930601971 +0000 UTC m=+490.439042804" Jul 01 19:19:46.086129 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:19:46.086098 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d8wms"] Jul 01 19:19:46.089061 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:19:46.089046 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d8wms" Jul 01 19:19:46.091056 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:19:46.091040 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-fcvx9\"" Jul 01 19:19:46.102307 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:19:46.102282 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d8wms"] Jul 01 19:19:46.181094 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:19:46.181060 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7qh7\" (UniqueName: \"kubernetes.io/projected/fa359e5c-05cc-4c43-90a0-d15f263dd306-kube-api-access-g7qh7\") pod \"kuadrant-operator-controller-manager-8684c9ff49-d8wms\" (UID: \"fa359e5c-05cc-4c43-90a0-d15f263dd306\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d8wms" Jul 01 19:19:46.181243 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:19:46.181119 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fa359e5c-05cc-4c43-90a0-d15f263dd306-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-d8wms\" (UID: \"fa359e5c-05cc-4c43-90a0-d15f263dd306\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d8wms" Jul 01 19:19:46.282245 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:19:46.282216 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fa359e5c-05cc-4c43-90a0-d15f263dd306-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-d8wms\" (UID: \"fa359e5c-05cc-4c43-90a0-d15f263dd306\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d8wms" Jul 01 19:19:46.282358 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:19:46.282270 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7qh7\" (UniqueName: \"kubernetes.io/projected/fa359e5c-05cc-4c43-90a0-d15f263dd306-kube-api-access-g7qh7\") pod \"kuadrant-operator-controller-manager-8684c9ff49-d8wms\" (UID: \"fa359e5c-05cc-4c43-90a0-d15f263dd306\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d8wms" Jul 01 19:19:46.282600 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:19:46.282578 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fa359e5c-05cc-4c43-90a0-d15f263dd306-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-d8wms\" (UID: \"fa359e5c-05cc-4c43-90a0-d15f263dd306\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d8wms" Jul 01 19:19:46.292867 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:19:46.292847 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7qh7\" (UniqueName: \"kubernetes.io/projected/fa359e5c-05cc-4c43-90a0-d15f263dd306-kube-api-access-g7qh7\") pod \"kuadrant-operator-controller-manager-8684c9ff49-d8wms\" (UID: \"fa359e5c-05cc-4c43-90a0-d15f263dd306\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d8wms" Jul 01 19:19:46.399043 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:19:46.398972 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d8wms" Jul 01 19:19:46.532139 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:19:46.532112 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d8wms"] Jul 01 19:19:46.534899 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:19:46.534865 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa359e5c_05cc_4c43_90a0_d15f263dd306.slice/crio-3f7b48482bbfc4ab7b093a6d8b396107ddc635849de484f1561875f330a1adba WatchSource:0}: Error finding container 3f7b48482bbfc4ab7b093a6d8b396107ddc635849de484f1561875f330a1adba: Status 404 returned error can't find the container with id 3f7b48482bbfc4ab7b093a6d8b396107ddc635849de484f1561875f330a1adba Jul 01 19:19:46.900841 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:19:46.900810 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d8wms" event={"ID":"fa359e5c-05cc-4c43-90a0-d15f263dd306","Type":"ContainerStarted","Data":"3f7b48482bbfc4ab7b093a6d8b396107ddc635849de484f1561875f330a1adba"} Jul 01 19:19:49.403305 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:19:49.403271 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-4fvzp"] Jul 01 19:19:49.406299 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:19:49.406282 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-4fvzp" Jul 01 19:19:49.408817 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:19:49.408802 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-8z88q\"" Jul 01 19:19:49.416233 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:19:49.416210 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-4fvzp"] Jul 01 19:19:49.506098 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:19:49.506070 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8rbhh\" (UniqueName: \"kubernetes.io/projected/04ce2fb2-a08b-4908-bf3b-41bc6916be3c-kube-api-access-8rbhh\") pod \"authorino-operator-75cc8d5cb7-4fvzp\" (UID: \"04ce2fb2-a08b-4908-bf3b-41bc6916be3c\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-4fvzp" Jul 01 19:19:49.607295 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:19:49.607266 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rbhh\" (UniqueName: \"kubernetes.io/projected/04ce2fb2-a08b-4908-bf3b-41bc6916be3c-kube-api-access-8rbhh\") pod \"authorino-operator-75cc8d5cb7-4fvzp\" (UID: \"04ce2fb2-a08b-4908-bf3b-41bc6916be3c\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-4fvzp" Jul 01 19:19:49.618407 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:19:49.618384 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rbhh\" (UniqueName: \"kubernetes.io/projected/04ce2fb2-a08b-4908-bf3b-41bc6916be3c-kube-api-access-8rbhh\") pod \"authorino-operator-75cc8d5cb7-4fvzp\" (UID: \"04ce2fb2-a08b-4908-bf3b-41bc6916be3c\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-4fvzp" Jul 01 19:19:49.717672 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:19:49.717642 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-4fvzp" Jul 01 19:19:49.852870 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:19:49.852801 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-4fvzp"] Jul 01 19:19:49.855332 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:19:49.855286 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04ce2fb2_a08b_4908_bf3b_41bc6916be3c.slice/crio-f8081c21d6f3c46a155a987d5d6f8dfe647888d7107ae06a45e1e4fad2c7a963 WatchSource:0}: Error finding container f8081c21d6f3c46a155a987d5d6f8dfe647888d7107ae06a45e1e4fad2c7a963: Status 404 returned error can't find the container with id f8081c21d6f3c46a155a987d5d6f8dfe647888d7107ae06a45e1e4fad2c7a963 Jul 01 19:19:49.915912 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:19:49.915878 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-4fvzp" event={"ID":"04ce2fb2-a08b-4908-bf3b-41bc6916be3c","Type":"ContainerStarted","Data":"f8081c21d6f3c46a155a987d5d6f8dfe647888d7107ae06a45e1e4fad2c7a963"} Jul 01 19:19:52.880689 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:19:52.880654 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-jbljx" Jul 01 19:19:53.937856 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:19:53.937827 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-4fvzp" event={"ID":"04ce2fb2-a08b-4908-bf3b-41bc6916be3c","Type":"ContainerStarted","Data":"b0c2ff7c346cbb366826ee4ae08c2f8c28bd78e6879d452cc74e357063ae9862"} Jul 01 19:19:53.938281 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:19:53.937888 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-4fvzp" Jul 01 19:19:53.939325 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:19:53.939304 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d8wms" event={"ID":"fa359e5c-05cc-4c43-90a0-d15f263dd306","Type":"ContainerStarted","Data":"3f8f855cc7150d382ce5d924753b620368df1c3d2325f6894ec5ab494d560398"} Jul 01 19:19:53.939447 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:19:53.939433 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d8wms" Jul 01 19:19:53.960730 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:19:53.960688 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-4fvzp" podStartSLOduration=1.533269097 podStartE2EDuration="4.960675176s" totalImagesPullingTime="3.427406079s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:19:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:19:53.959619023 +0000 UTC m=+500.468059866" watchObservedRunningTime="2026-07-01 19:19:53.960675176 +0000 UTC m=+500.469116001" Jul 01 19:19:53.988037 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:19:53.987996 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d8wms" podStartSLOduration=1.229919263 podStartE2EDuration="7.987982357s" totalImagesPullingTime="6.758063094s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:19:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:19:53.986739586 +0000 UTC m=+500.495180428" watchObservedRunningTime="2026-07-01 19:19:53.987982357 +0000 UTC m=+500.496423244" Jul 01 19:19:54.893095 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:19:54.893064 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mcgks" Jul 01 19:20:04.946901 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:04.946872 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d8wms" Jul 01 19:20:04.947339 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:04.946949 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-4fvzp" Jul 01 19:20:06.588377 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:06.588338 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d8wms"] Jul 01 19:20:06.588809 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:06.588546 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d8wms" podUID="fa359e5c-05cc-4c43-90a0-d15f263dd306" containerName="manager" containerID="cri-o://3f8f855cc7150d382ce5d924753b620368df1c3d2325f6894ec5ab494d560398" gracePeriod=2 Jul 01 19:20:06.601545 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:06.601514 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d8wms"] Jul 01 19:20:06.608502 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:20:06.608471 2561 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"fa359e5c-05cc-4c43-90a0-d15f263dd306\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-d8wms\": pods \"kuadrant-operator-controller-manager-8684c9ff49-d8wms\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d8wms" Jul 01 19:20:06.614334 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:06.614309 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mcgks"] Jul 01 19:20:06.614561 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:06.614536 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mcgks" podUID="034f0335-87ae-4ef2-a555-ba4e2951fdee" containerName="manager" containerID="cri-o://b9b0864b440dd2e6a043623c3b771077769cc5c60a4ee0f973e28d63fdbafedd" gracePeriod=2 Jul 01 19:20:06.620375 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:06.620353 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lq588"] Jul 01 19:20:06.620663 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:06.620652 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa359e5c-05cc-4c43-90a0-d15f263dd306" containerName="manager" Jul 01 19:20:06.620710 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:06.620665 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa359e5c-05cc-4c43-90a0-d15f263dd306" containerName="manager" Jul 01 19:20:06.620745 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:06.620728 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="fa359e5c-05cc-4c43-90a0-d15f263dd306" containerName="manager" Jul 01 19:20:06.623540 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:06.623521 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lq588" Jul 01 19:20:06.627728 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:06.627709 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mcgks"] Jul 01 19:20:06.628422 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:20:06.628388 2561 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"034f0335-87ae-4ef2-a555-ba4e2951fdee\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-859d7b78bd-mcgks\": pods \"limitador-operator-controller-manager-859d7b78bd-mcgks\" not found" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mcgks" Jul 01 19:20:06.630459 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:20:06.630430 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-d8wms\" is forbidden: User \"system:node:ip-10-0-131-184.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-184.ec2.internal' and this object" podUID="fa359e5c-05cc-4c43-90a0-d15f263dd306" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d8wms" Jul 01 19:20:06.632239 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:20:06.632214 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-d8wms\" is forbidden: User \"system:node:ip-10-0-131-184.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-184.ec2.internal' and this object" podUID="fa359e5c-05cc-4c43-90a0-d15f263dd306" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d8wms" Jul 01 19:20:06.633888 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:20:06.633867 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-mcgks\" is forbidden: User \"system:node:ip-10-0-131-184.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-184.ec2.internal' and this object" podUID="034f0335-87ae-4ef2-a555-ba4e2951fdee" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mcgks" Jul 01 19:20:06.641556 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:06.641523 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lq588"] Jul 01 19:20:06.643376 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:06.643357 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4dhv6"] Jul 01 19:20:06.643644 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:06.643632 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="034f0335-87ae-4ef2-a555-ba4e2951fdee" containerName="manager" Jul 01 19:20:06.643644 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:06.643644 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="034f0335-87ae-4ef2-a555-ba4e2951fdee" containerName="manager" Jul 01 19:20:06.643774 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:06.643711 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="034f0335-87ae-4ef2-a555-ba4e2951fdee" containerName="manager" Jul 01 19:20:06.646363 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:06.646345 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4dhv6" Jul 01 19:20:06.653328 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:20:06.653296 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-d8wms\" is forbidden: User \"system:node:ip-10-0-131-184.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-184.ec2.internal' and this object" podUID="fa359e5c-05cc-4c43-90a0-d15f263dd306" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d8wms" Jul 01 19:20:06.658291 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:06.658265 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4dhv6"] Jul 01 19:20:06.658460 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:20:06.658325 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-mcgks\" is forbidden: User \"system:node:ip-10-0-131-184.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-184.ec2.internal' and this object" podUID="034f0335-87ae-4ef2-a555-ba4e2951fdee" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mcgks" Jul 01 19:20:06.699076 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:06.699049 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fmzlh"] Jul 01 19:20:06.705274 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:06.705236 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fmzlh" Jul 01 19:20:06.707239 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:20:06.707211 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-mcgks\" is forbidden: User \"system:node:ip-10-0-131-184.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-184.ec2.internal' and this object" podUID="034f0335-87ae-4ef2-a555-ba4e2951fdee" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mcgks" Jul 01 19:20:06.717825 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:06.717798 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fmzlh"] Jul 01 19:20:06.734663 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:20:06.734617 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-d8wms\" is forbidden: User \"system:node:ip-10-0-131-184.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-184.ec2.internal' and this object" podUID="fa359e5c-05cc-4c43-90a0-d15f263dd306" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d8wms" Jul 01 19:20:06.751763 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:06.751737 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42464\" (UniqueName: \"kubernetes.io/projected/e8d801ff-48e1-41e5-81d5-af86333af1d6-kube-api-access-42464\") pod \"kuadrant-operator-controller-manager-8684c9ff49-lq588\" (UID: \"e8d801ff-48e1-41e5-81d5-af86333af1d6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lq588" Jul 01 19:20:06.751881 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:06.751789 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pnnld\" (UniqueName: \"kubernetes.io/projected/f26a1bee-ce9d-4c1a-9a6f-710e289abed2-kube-api-access-pnnld\") pod \"limitador-operator-controller-manager-859d7b78bd-4dhv6\" (UID: \"f26a1bee-ce9d-4c1a-9a6f-710e289abed2\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4dhv6" Jul 01 19:20:06.751881 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:06.751822 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e8d801ff-48e1-41e5-81d5-af86333af1d6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-lq588\" (UID: \"e8d801ff-48e1-41e5-81d5-af86333af1d6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lq588" Jul 01 19:20:06.852273 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:06.852197 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/87ae6bc6-95a0-4479-8644-0d5b352573b2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-fmzlh\" (UID: \"87ae6bc6-95a0-4479-8644-0d5b352573b2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fmzlh" Jul 01 19:20:06.852273 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:06.852258 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42464\" (UniqueName: \"kubernetes.io/projected/e8d801ff-48e1-41e5-81d5-af86333af1d6-kube-api-access-42464\") pod \"kuadrant-operator-controller-manager-8684c9ff49-lq588\" (UID: \"e8d801ff-48e1-41e5-81d5-af86333af1d6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lq588" Jul 01 19:20:06.852450 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:06.852289 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pnnld\" (UniqueName: \"kubernetes.io/projected/f26a1bee-ce9d-4c1a-9a6f-710e289abed2-kube-api-access-pnnld\") pod \"limitador-operator-controller-manager-859d7b78bd-4dhv6\" (UID: \"f26a1bee-ce9d-4c1a-9a6f-710e289abed2\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4dhv6" Jul 01 19:20:06.852450 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:06.852312 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kqmhh\" (UniqueName: \"kubernetes.io/projected/87ae6bc6-95a0-4479-8644-0d5b352573b2-kube-api-access-kqmhh\") pod \"kuadrant-operator-controller-manager-86878c769f-fmzlh\" (UID: \"87ae6bc6-95a0-4479-8644-0d5b352573b2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fmzlh" Jul 01 19:20:06.852450 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:06.852354 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e8d801ff-48e1-41e5-81d5-af86333af1d6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-lq588\" (UID: \"e8d801ff-48e1-41e5-81d5-af86333af1d6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lq588" Jul 01 19:20:06.852779 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:06.852756 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e8d801ff-48e1-41e5-81d5-af86333af1d6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-lq588\" (UID: \"e8d801ff-48e1-41e5-81d5-af86333af1d6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lq588" Jul 01 19:20:06.855614 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:06.855594 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d8wms" Jul 01 19:20:06.857214 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:20:06.857191 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-d8wms\" is forbidden: User \"system:node:ip-10-0-131-184.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-184.ec2.internal' and this object" podUID="fa359e5c-05cc-4c43-90a0-d15f263dd306" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d8wms" Jul 01 19:20:06.858468 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:20:06.858439 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-mcgks\" is forbidden: User \"system:node:ip-10-0-131-184.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-184.ec2.internal' and this object" podUID="034f0335-87ae-4ef2-a555-ba4e2951fdee" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mcgks" Jul 01 19:20:06.859855 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:06.859835 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pnnld\" (UniqueName: \"kubernetes.io/projected/f26a1bee-ce9d-4c1a-9a6f-710e289abed2-kube-api-access-pnnld\") pod \"limitador-operator-controller-manager-859d7b78bd-4dhv6\" (UID: \"f26a1bee-ce9d-4c1a-9a6f-710e289abed2\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4dhv6" Jul 01 19:20:06.860272 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:06.860256 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-42464\" (UniqueName: \"kubernetes.io/projected/e8d801ff-48e1-41e5-81d5-af86333af1d6-kube-api-access-42464\") pod \"kuadrant-operator-controller-manager-8684c9ff49-lq588\" (UID: \"e8d801ff-48e1-41e5-81d5-af86333af1d6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lq588" Jul 01 19:20:06.873896 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:06.873875 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mcgks" Jul 01 19:20:06.875357 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:20:06.875336 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-d8wms\" is forbidden: User \"system:node:ip-10-0-131-184.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-184.ec2.internal' and this object" podUID="fa359e5c-05cc-4c43-90a0-d15f263dd306" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d8wms" Jul 01 19:20:06.876733 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:20:06.876713 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-mcgks\" is forbidden: User \"system:node:ip-10-0-131-184.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-184.ec2.internal' and this object" podUID="034f0335-87ae-4ef2-a555-ba4e2951fdee" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mcgks" Jul 01 19:20:06.953618 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:06.953589 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g7qh7\" (UniqueName: \"kubernetes.io/projected/fa359e5c-05cc-4c43-90a0-d15f263dd306-kube-api-access-g7qh7\") pod \"fa359e5c-05cc-4c43-90a0-d15f263dd306\" (UID: \"fa359e5c-05cc-4c43-90a0-d15f263dd306\") " Jul 01 19:20:06.953709 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:06.953627 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fa359e5c-05cc-4c43-90a0-d15f263dd306-extensions-socket-volume\") pod \"fa359e5c-05cc-4c43-90a0-d15f263dd306\" (UID: \"fa359e5c-05cc-4c43-90a0-d15f263dd306\") " Jul 01 19:20:06.953864 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:06.953846 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/87ae6bc6-95a0-4479-8644-0d5b352573b2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-fmzlh\" (UID: \"87ae6bc6-95a0-4479-8644-0d5b352573b2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fmzlh" Jul 01 19:20:06.953977 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:06.953936 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kqmhh\" (UniqueName: \"kubernetes.io/projected/87ae6bc6-95a0-4479-8644-0d5b352573b2-kube-api-access-kqmhh\") pod \"kuadrant-operator-controller-manager-86878c769f-fmzlh\" (UID: \"87ae6bc6-95a0-4479-8644-0d5b352573b2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fmzlh" Jul 01 19:20:06.954133 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:06.954111 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa359e5c-05cc-4c43-90a0-d15f263dd306-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "fa359e5c-05cc-4c43-90a0-d15f263dd306" (UID: "fa359e5c-05cc-4c43-90a0-d15f263dd306"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 19:20:06.954267 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:06.954243 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/87ae6bc6-95a0-4479-8644-0d5b352573b2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-fmzlh\" (UID: \"87ae6bc6-95a0-4479-8644-0d5b352573b2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fmzlh" Jul 01 19:20:06.955625 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:06.955606 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa359e5c-05cc-4c43-90a0-d15f263dd306-kube-api-access-g7qh7" (OuterVolumeSpecName: "kube-api-access-g7qh7") pod "fa359e5c-05cc-4c43-90a0-d15f263dd306" (UID: "fa359e5c-05cc-4c43-90a0-d15f263dd306"). InnerVolumeSpecName "kube-api-access-g7qh7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 19:20:06.971699 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:06.971678 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kqmhh\" (UniqueName: \"kubernetes.io/projected/87ae6bc6-95a0-4479-8644-0d5b352573b2-kube-api-access-kqmhh\") pod \"kuadrant-operator-controller-manager-86878c769f-fmzlh\" (UID: \"87ae6bc6-95a0-4479-8644-0d5b352573b2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fmzlh" Jul 01 19:20:06.999380 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:06.999354 2561 generic.go:356] "Generic (PLEG): container finished" podID="034f0335-87ae-4ef2-a555-ba4e2951fdee" containerID="b9b0864b440dd2e6a043623c3b771077769cc5c60a4ee0f973e28d63fdbafedd" exitCode=0 Jul 01 19:20:06.999492 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:06.999403 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mcgks" Jul 01 19:20:06.999492 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:06.999433 2561 scope.go:117] "RemoveContainer" containerID="b9b0864b440dd2e6a043623c3b771077769cc5c60a4ee0f973e28d63fdbafedd" Jul 01 19:20:07.000793 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:07.000771 2561 generic.go:356] "Generic (PLEG): container finished" podID="fa359e5c-05cc-4c43-90a0-d15f263dd306" containerID="3f8f855cc7150d382ce5d924753b620368df1c3d2325f6894ec5ab494d560398" exitCode=0 Jul 01 19:20:07.000865 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:07.000807 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d8wms" Jul 01 19:20:07.001631 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:20:07.001607 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-d8wms\" is forbidden: User \"system:node:ip-10-0-131-184.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-184.ec2.internal' and this object" podUID="fa359e5c-05cc-4c43-90a0-d15f263dd306" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d8wms" Jul 01 19:20:07.006008 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:20:07.005982 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-mcgks\" is forbidden: User \"system:node:ip-10-0-131-184.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-184.ec2.internal' and this object" podUID="034f0335-87ae-4ef2-a555-ba4e2951fdee" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mcgks" Jul 01 19:20:07.007435 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:07.007419 2561 scope.go:117] "RemoveContainer" containerID="b9b0864b440dd2e6a043623c3b771077769cc5c60a4ee0f973e28d63fdbafedd" Jul 01 19:20:07.007623 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:20:07.007580 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-mcgks\" is forbidden: User \"system:node:ip-10-0-131-184.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-184.ec2.internal' and this object" podUID="034f0335-87ae-4ef2-a555-ba4e2951fdee" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mcgks" Jul 01 19:20:07.007740 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:20:07.007726 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b9b0864b440dd2e6a043623c3b771077769cc5c60a4ee0f973e28d63fdbafedd\": container with ID starting with b9b0864b440dd2e6a043623c3b771077769cc5c60a4ee0f973e28d63fdbafedd not found: ID does not exist" containerID="b9b0864b440dd2e6a043623c3b771077769cc5c60a4ee0f973e28d63fdbafedd" Jul 01 19:20:07.007806 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:07.007757 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9b0864b440dd2e6a043623c3b771077769cc5c60a4ee0f973e28d63fdbafedd"} err="failed to get container status \"b9b0864b440dd2e6a043623c3b771077769cc5c60a4ee0f973e28d63fdbafedd\": rpc error: code = NotFound desc = could not find container \"b9b0864b440dd2e6a043623c3b771077769cc5c60a4ee0f973e28d63fdbafedd\": container with ID starting with b9b0864b440dd2e6a043623c3b771077769cc5c60a4ee0f973e28d63fdbafedd not found: ID does not exist" Jul 01 19:20:07.007806 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:07.007773 2561 scope.go:117] "RemoveContainer" containerID="3f8f855cc7150d382ce5d924753b620368df1c3d2325f6894ec5ab494d560398" Jul 01 19:20:07.009206 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:20:07.009184 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-d8wms\" is forbidden: User \"system:node:ip-10-0-131-184.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-184.ec2.internal' and this object" podUID="fa359e5c-05cc-4c43-90a0-d15f263dd306" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d8wms" Jul 01 19:20:07.010671 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:20:07.010640 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-d8wms\" is forbidden: User \"system:node:ip-10-0-131-184.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-184.ec2.internal' and this object" podUID="fa359e5c-05cc-4c43-90a0-d15f263dd306" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d8wms" Jul 01 19:20:07.012075 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:20:07.012048 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-mcgks\" is forbidden: User \"system:node:ip-10-0-131-184.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-184.ec2.internal' and this object" podUID="034f0335-87ae-4ef2-a555-ba4e2951fdee" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mcgks" Jul 01 19:20:07.015470 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:07.015453 2561 scope.go:117] "RemoveContainer" containerID="3f8f855cc7150d382ce5d924753b620368df1c3d2325f6894ec5ab494d560398" Jul 01 19:20:07.015690 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:20:07.015674 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3f8f855cc7150d382ce5d924753b620368df1c3d2325f6894ec5ab494d560398\": container with ID starting with 3f8f855cc7150d382ce5d924753b620368df1c3d2325f6894ec5ab494d560398 not found: ID does not exist" containerID="3f8f855cc7150d382ce5d924753b620368df1c3d2325f6894ec5ab494d560398" Jul 01 19:20:07.015748 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:07.015696 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f8f855cc7150d382ce5d924753b620368df1c3d2325f6894ec5ab494d560398"} err="failed to get container status \"3f8f855cc7150d382ce5d924753b620368df1c3d2325f6894ec5ab494d560398\": rpc error: code = NotFound desc = could not find container \"3f8f855cc7150d382ce5d924753b620368df1c3d2325f6894ec5ab494d560398\": container with ID starting with 3f8f855cc7150d382ce5d924753b620368df1c3d2325f6894ec5ab494d560398 not found: ID does not exist" Jul 01 19:20:07.038862 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:07.038839 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lq588" Jul 01 19:20:07.045749 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:07.045731 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4dhv6" Jul 01 19:20:07.053572 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:07.053550 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fmzlh" Jul 01 19:20:07.054766 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:07.054747 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vjvvx\" (UniqueName: \"kubernetes.io/projected/034f0335-87ae-4ef2-a555-ba4e2951fdee-kube-api-access-vjvvx\") pod \"034f0335-87ae-4ef2-a555-ba4e2951fdee\" (UID: \"034f0335-87ae-4ef2-a555-ba4e2951fdee\") " Jul 01 19:20:07.055023 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:07.054984 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g7qh7\" (UniqueName: \"kubernetes.io/projected/fa359e5c-05cc-4c43-90a0-d15f263dd306-kube-api-access-g7qh7\") on node \"ip-10-0-131-184.ec2.internal\" DevicePath \"\"" Jul 01 19:20:07.055115 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:07.055025 2561 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fa359e5c-05cc-4c43-90a0-d15f263dd306-extensions-socket-volume\") on node \"ip-10-0-131-184.ec2.internal\" DevicePath \"\"" Jul 01 19:20:07.056786 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:07.056763 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/034f0335-87ae-4ef2-a555-ba4e2951fdee-kube-api-access-vjvvx" (OuterVolumeSpecName: "kube-api-access-vjvvx") pod "034f0335-87ae-4ef2-a555-ba4e2951fdee" (UID: "034f0335-87ae-4ef2-a555-ba4e2951fdee"). InnerVolumeSpecName "kube-api-access-vjvvx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 19:20:07.155648 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:07.155610 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vjvvx\" (UniqueName: \"kubernetes.io/projected/034f0335-87ae-4ef2-a555-ba4e2951fdee-kube-api-access-vjvvx\") on node \"ip-10-0-131-184.ec2.internal\" DevicePath \"\"" Jul 01 19:20:07.197045 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:07.197015 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lq588"] Jul 01 19:20:07.200738 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:20:07.200705 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8d801ff_48e1_41e5_81d5_af86333af1d6.slice/crio-7018a8891a3e252bc8d72b868fb709c0e1469ff96f9a8d2462b8c3ce0b165733 WatchSource:0}: Error finding container 7018a8891a3e252bc8d72b868fb709c0e1469ff96f9a8d2462b8c3ce0b165733: Status 404 returned error can't find the container with id 7018a8891a3e252bc8d72b868fb709c0e1469ff96f9a8d2462b8c3ce0b165733 Jul 01 19:20:07.220543 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:07.220516 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4dhv6"] Jul 01 19:20:07.223554 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:20:07.223530 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf26a1bee_ce9d_4c1a_9a6f_710e289abed2.slice/crio-6714bc62a383b4fa3aaca3b81c9ff952c5795af53a0464db939642d3beb02dcb WatchSource:0}: Error finding container 6714bc62a383b4fa3aaca3b81c9ff952c5795af53a0464db939642d3beb02dcb: Status 404 returned error can't find the container with id 6714bc62a383b4fa3aaca3b81c9ff952c5795af53a0464db939642d3beb02dcb Jul 01 19:20:07.249415 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:07.249397 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fmzlh"] Jul 01 19:20:07.252757 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:20:07.252726 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87ae6bc6_95a0_4479_8644_0d5b352573b2.slice/crio-10152a62eb8e8b66af1dbfe0118d7aed31f62cc1c5a91c46f2dd82a2b4b18392 WatchSource:0}: Error finding container 10152a62eb8e8b66af1dbfe0118d7aed31f62cc1c5a91c46f2dd82a2b4b18392: Status 404 returned error can't find the container with id 10152a62eb8e8b66af1dbfe0118d7aed31f62cc1c5a91c46f2dd82a2b4b18392 Jul 01 19:20:07.309196 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:20:07.309170 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-mcgks\" is forbidden: User \"system:node:ip-10-0-131-184.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-184.ec2.internal' and this object" podUID="034f0335-87ae-4ef2-a555-ba4e2951fdee" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mcgks" Jul 01 19:20:07.310478 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:20:07.310450 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-d8wms\" is forbidden: User \"system:node:ip-10-0-131-184.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-184.ec2.internal' and this object" podUID="fa359e5c-05cc-4c43-90a0-d15f263dd306" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d8wms" Jul 01 19:20:07.977997 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:07.977945 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="034f0335-87ae-4ef2-a555-ba4e2951fdee" path="/var/lib/kubelet/pods/034f0335-87ae-4ef2-a555-ba4e2951fdee/volumes" Jul 01 19:20:07.978340 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:07.978309 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fa359e5c-05cc-4c43-90a0-d15f263dd306" path="/var/lib/kubelet/pods/fa359e5c-05cc-4c43-90a0-d15f263dd306/volumes" Jul 01 19:20:08.006048 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:08.006023 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fmzlh" event={"ID":"87ae6bc6-95a0-4479-8644-0d5b352573b2","Type":"ContainerStarted","Data":"ea3824346d3367e2fc0c2c3f2bd2e631181f261725c755ab1ea29945f8e81f86"} Jul 01 19:20:08.006185 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:08.006166 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fmzlh" Jul 01 19:20:08.006253 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:08.006212 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fmzlh" event={"ID":"87ae6bc6-95a0-4479-8644-0d5b352573b2","Type":"ContainerStarted","Data":"10152a62eb8e8b66af1dbfe0118d7aed31f62cc1c5a91c46f2dd82a2b4b18392"} Jul 01 19:20:08.009283 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:08.009261 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lq588" event={"ID":"e8d801ff-48e1-41e5-81d5-af86333af1d6","Type":"ContainerStarted","Data":"1bc733e2dedf8ac75719ed364d968a53b8a1de18b2ae497598e43acc7993031b"} Jul 01 19:20:08.009384 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:08.009300 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lq588" event={"ID":"e8d801ff-48e1-41e5-81d5-af86333af1d6","Type":"ContainerStarted","Data":"7018a8891a3e252bc8d72b868fb709c0e1469ff96f9a8d2462b8c3ce0b165733"} Jul 01 19:20:08.009440 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:08.009390 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lq588" Jul 01 19:20:08.010832 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:08.010813 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4dhv6" event={"ID":"f26a1bee-ce9d-4c1a-9a6f-710e289abed2","Type":"ContainerStarted","Data":"a18f5a8b6728433bffa17a9f91a75e5940752b5d16e873b5ecbbc1f1474692a6"} Jul 01 19:20:08.010914 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:08.010866 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4dhv6" event={"ID":"f26a1bee-ce9d-4c1a-9a6f-710e289abed2","Type":"ContainerStarted","Data":"6714bc62a383b4fa3aaca3b81c9ff952c5795af53a0464db939642d3beb02dcb"} Jul 01 19:20:08.010914 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:08.010883 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4dhv6" Jul 01 19:20:08.027069 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:08.027028 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fmzlh" podStartSLOduration=2.02701521 podStartE2EDuration="2.02701521s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:20:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:20:08.026010299 +0000 UTC m=+514.534451136" watchObservedRunningTime="2026-07-01 19:20:08.02701521 +0000 UTC m=+514.535456013" Jul 01 19:20:08.050372 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:08.050323 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lq588" podStartSLOduration=2.05030975 podStartE2EDuration="2.05030975s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:20:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:20:08.049497769 +0000 UTC m=+514.557938612" watchObservedRunningTime="2026-07-01 19:20:08.05030975 +0000 UTC m=+514.558750576" Jul 01 19:20:08.072687 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:08.072648 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4dhv6" podStartSLOduration=2.072631452 podStartE2EDuration="2.072631452s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:20:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:20:08.071513439 +0000 UTC m=+514.579954264" watchObservedRunningTime="2026-07-01 19:20:08.072631452 +0000 UTC m=+514.581072277" Jul 01 19:20:19.018730 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:19.018697 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4dhv6" Jul 01 19:20:19.019163 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:19.018780 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lq588" Jul 01 19:20:19.019163 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:19.018966 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fmzlh" Jul 01 19:20:19.203076 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:19.203043 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lq588"] Jul 01 19:20:19.203243 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:19.203221 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lq588" podUID="e8d801ff-48e1-41e5-81d5-af86333af1d6" containerName="manager" containerID="cri-o://1bc733e2dedf8ac75719ed364d968a53b8a1de18b2ae497598e43acc7993031b" gracePeriod=10 Jul 01 19:20:19.445492 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:19.445472 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lq588" Jul 01 19:20:19.456963 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:19.456939 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e8d801ff-48e1-41e5-81d5-af86333af1d6-extensions-socket-volume\") pod \"e8d801ff-48e1-41e5-81d5-af86333af1d6\" (UID: \"e8d801ff-48e1-41e5-81d5-af86333af1d6\") " Jul 01 19:20:19.457027 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:19.457000 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-42464\" (UniqueName: \"kubernetes.io/projected/e8d801ff-48e1-41e5-81d5-af86333af1d6-kube-api-access-42464\") pod \"e8d801ff-48e1-41e5-81d5-af86333af1d6\" (UID: \"e8d801ff-48e1-41e5-81d5-af86333af1d6\") " Jul 01 19:20:19.457294 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:19.457274 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e8d801ff-48e1-41e5-81d5-af86333af1d6-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "e8d801ff-48e1-41e5-81d5-af86333af1d6" (UID: "e8d801ff-48e1-41e5-81d5-af86333af1d6"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 19:20:19.458888 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:19.458853 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8d801ff-48e1-41e5-81d5-af86333af1d6-kube-api-access-42464" (OuterVolumeSpecName: "kube-api-access-42464") pod "e8d801ff-48e1-41e5-81d5-af86333af1d6" (UID: "e8d801ff-48e1-41e5-81d5-af86333af1d6"). InnerVolumeSpecName "kube-api-access-42464". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 19:20:19.558242 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:19.558215 2561 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e8d801ff-48e1-41e5-81d5-af86333af1d6-extensions-socket-volume\") on node \"ip-10-0-131-184.ec2.internal\" DevicePath \"\"" Jul 01 19:20:19.558242 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:19.558237 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-42464\" (UniqueName: \"kubernetes.io/projected/e8d801ff-48e1-41e5-81d5-af86333af1d6-kube-api-access-42464\") on node \"ip-10-0-131-184.ec2.internal\" DevicePath \"\"" Jul 01 19:20:20.072963 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:20.072924 2561 generic.go:356] "Generic (PLEG): container finished" podID="e8d801ff-48e1-41e5-81d5-af86333af1d6" containerID="1bc733e2dedf8ac75719ed364d968a53b8a1de18b2ae497598e43acc7993031b" exitCode=0 Jul 01 19:20:20.073346 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:20.072974 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lq588" Jul 01 19:20:20.073346 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:20.072985 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lq588" event={"ID":"e8d801ff-48e1-41e5-81d5-af86333af1d6","Type":"ContainerDied","Data":"1bc733e2dedf8ac75719ed364d968a53b8a1de18b2ae497598e43acc7993031b"} Jul 01 19:20:20.073346 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:20.073038 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lq588" event={"ID":"e8d801ff-48e1-41e5-81d5-af86333af1d6","Type":"ContainerDied","Data":"7018a8891a3e252bc8d72b868fb709c0e1469ff96f9a8d2462b8c3ce0b165733"} Jul 01 19:20:20.073346 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:20.073059 2561 scope.go:117] "RemoveContainer" containerID="1bc733e2dedf8ac75719ed364d968a53b8a1de18b2ae497598e43acc7993031b" Jul 01 19:20:20.081243 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:20.081220 2561 scope.go:117] "RemoveContainer" containerID="1bc733e2dedf8ac75719ed364d968a53b8a1de18b2ae497598e43acc7993031b" Jul 01 19:20:20.081490 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:20:20.081472 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1bc733e2dedf8ac75719ed364d968a53b8a1de18b2ae497598e43acc7993031b\": container with ID starting with 1bc733e2dedf8ac75719ed364d968a53b8a1de18b2ae497598e43acc7993031b not found: ID does not exist" containerID="1bc733e2dedf8ac75719ed364d968a53b8a1de18b2ae497598e43acc7993031b" Jul 01 19:20:20.081566 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:20.081502 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1bc733e2dedf8ac75719ed364d968a53b8a1de18b2ae497598e43acc7993031b"} err="failed to get container status \"1bc733e2dedf8ac75719ed364d968a53b8a1de18b2ae497598e43acc7993031b\": rpc error: code = NotFound desc = could not find container \"1bc733e2dedf8ac75719ed364d968a53b8a1de18b2ae497598e43acc7993031b\": container with ID starting with 1bc733e2dedf8ac75719ed364d968a53b8a1de18b2ae497598e43acc7993031b not found: ID does not exist" Jul 01 19:20:20.095157 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:20.095131 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lq588"] Jul 01 19:20:20.100124 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:20.100105 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lq588"] Jul 01 19:20:21.977837 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:21.977806 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e8d801ff-48e1-41e5-81d5-af86333af1d6" path="/var/lib/kubelet/pods/e8d801ff-48e1-41e5-81d5-af86333af1d6/volumes" Jul 01 19:20:37.457450 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:37.457408 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-88b4k"] Jul 01 19:20:37.457854 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:37.457774 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8d801ff-48e1-41e5-81d5-af86333af1d6" containerName="manager" Jul 01 19:20:37.457854 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:37.457785 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8d801ff-48e1-41e5-81d5-af86333af1d6" containerName="manager" Jul 01 19:20:37.457854 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:37.457844 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="e8d801ff-48e1-41e5-81d5-af86333af1d6" containerName="manager" Jul 01 19:20:37.461019 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:37.460998 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-88b4k" Jul 01 19:20:37.462879 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:37.462850 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 01 19:20:37.462993 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:37.462912 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-pnstg\"" Jul 01 19:20:37.469118 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:37.469097 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-88b4k"] Jul 01 19:20:37.507177 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:37.507149 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3f17ac99-6d26-450c-9b37-684111c1f08b-config-file\") pod \"limitador-limitador-64c94fd64f-88b4k\" (UID: \"3f17ac99-6d26-450c-9b37-684111c1f08b\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-88b4k" Jul 01 19:20:37.507297 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:37.507193 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t7s7j\" (UniqueName: \"kubernetes.io/projected/3f17ac99-6d26-450c-9b37-684111c1f08b-kube-api-access-t7s7j\") pod \"limitador-limitador-64c94fd64f-88b4k\" (UID: \"3f17ac99-6d26-450c-9b37-684111c1f08b\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-88b4k" Jul 01 19:20:37.551320 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:37.551288 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-88b4k"] Jul 01 19:20:37.607821 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:37.607787 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t7s7j\" (UniqueName: \"kubernetes.io/projected/3f17ac99-6d26-450c-9b37-684111c1f08b-kube-api-access-t7s7j\") pod \"limitador-limitador-64c94fd64f-88b4k\" (UID: \"3f17ac99-6d26-450c-9b37-684111c1f08b\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-88b4k" Jul 01 19:20:37.608001 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:37.607875 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3f17ac99-6d26-450c-9b37-684111c1f08b-config-file\") pod \"limitador-limitador-64c94fd64f-88b4k\" (UID: \"3f17ac99-6d26-450c-9b37-684111c1f08b\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-88b4k" Jul 01 19:20:37.608468 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:37.608444 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3f17ac99-6d26-450c-9b37-684111c1f08b-config-file\") pod \"limitador-limitador-64c94fd64f-88b4k\" (UID: \"3f17ac99-6d26-450c-9b37-684111c1f08b\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-88b4k" Jul 01 19:20:37.615561 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:37.615542 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t7s7j\" (UniqueName: \"kubernetes.io/projected/3f17ac99-6d26-450c-9b37-684111c1f08b-kube-api-access-t7s7j\") pod \"limitador-limitador-64c94fd64f-88b4k\" (UID: \"3f17ac99-6d26-450c-9b37-684111c1f08b\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-88b4k" Jul 01 19:20:37.772202 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:37.772121 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-88b4k" Jul 01 19:20:37.907755 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:37.907731 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-88b4k"] Jul 01 19:20:37.909413 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:20:37.909383 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f17ac99_6d26_450c_9b37_684111c1f08b.slice/crio-a7b23ea0e052fb55c078f4903631b6445b8546145e25dbefdfd0036a8f7058b8 WatchSource:0}: Error finding container a7b23ea0e052fb55c078f4903631b6445b8546145e25dbefdfd0036a8f7058b8: Status 404 returned error can't find the container with id a7b23ea0e052fb55c078f4903631b6445b8546145e25dbefdfd0036a8f7058b8 Jul 01 19:20:38.163124 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:38.163048 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-88b4k" event={"ID":"3f17ac99-6d26-450c-9b37-684111c1f08b","Type":"ContainerStarted","Data":"a7b23ea0e052fb55c078f4903631b6445b8546145e25dbefdfd0036a8f7058b8"} Jul 01 19:20:38.284311 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:38.284282 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-s72l7"] Jul 01 19:20:38.287824 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:38.287805 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-s72l7" Jul 01 19:20:38.289788 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:38.289769 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-prbkh\"" Jul 01 19:20:38.294370 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:38.294350 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-s72l7"] Jul 01 19:20:38.414593 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:38.414518 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4nx9\" (UniqueName: \"kubernetes.io/projected/86979e6f-273a-40f3-8814-60ffdfacea77-kube-api-access-f4nx9\") pod \"authorino-58cd955675-s72l7\" (UID: \"86979e6f-273a-40f3-8814-60ffdfacea77\") " pod="kuadrant-system/authorino-58cd955675-s72l7" Jul 01 19:20:38.515390 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:38.515356 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4nx9\" (UniqueName: \"kubernetes.io/projected/86979e6f-273a-40f3-8814-60ffdfacea77-kube-api-access-f4nx9\") pod \"authorino-58cd955675-s72l7\" (UID: \"86979e6f-273a-40f3-8814-60ffdfacea77\") " pod="kuadrant-system/authorino-58cd955675-s72l7" Jul 01 19:20:38.523475 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:38.523450 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4nx9\" (UniqueName: \"kubernetes.io/projected/86979e6f-273a-40f3-8814-60ffdfacea77-kube-api-access-f4nx9\") pod \"authorino-58cd955675-s72l7\" (UID: \"86979e6f-273a-40f3-8814-60ffdfacea77\") " pod="kuadrant-system/authorino-58cd955675-s72l7" Jul 01 19:20:38.597510 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:38.597483 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-s72l7" Jul 01 19:20:38.751272 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:38.751241 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-s72l7"] Jul 01 19:20:38.754578 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:20:38.754499 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod86979e6f_273a_40f3_8814_60ffdfacea77.slice/crio-69fed6ea24713611575f985c14f69ab4ec2e2dd63333958b6c39feb6d2a55f3c WatchSource:0}: Error finding container 69fed6ea24713611575f985c14f69ab4ec2e2dd63333958b6c39feb6d2a55f3c: Status 404 returned error can't find the container with id 69fed6ea24713611575f985c14f69ab4ec2e2dd63333958b6c39feb6d2a55f3c Jul 01 19:20:39.172928 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:39.172790 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-s72l7" event={"ID":"86979e6f-273a-40f3-8814-60ffdfacea77","Type":"ContainerStarted","Data":"69fed6ea24713611575f985c14f69ab4ec2e2dd63333958b6c39feb6d2a55f3c"} Jul 01 19:20:42.490028 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:42.489982 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-s72l7"] Jul 01 19:20:43.196341 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:43.196305 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-s72l7" event={"ID":"86979e6f-273a-40f3-8814-60ffdfacea77","Type":"ContainerStarted","Data":"1277848eec44c585b291941c562d73e4bdaf830369483a950d6f85fdc0e3fc4b"} Jul 01 19:20:43.197763 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:43.197739 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-88b4k" event={"ID":"3f17ac99-6d26-450c-9b37-684111c1f08b","Type":"ContainerStarted","Data":"d67bd3e9c6c864f315272df994237b958e709d6e103045bd3f68f5ed9cde01f2"} Jul 01 19:20:43.197899 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:43.197797 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-88b4k" Jul 01 19:20:43.212353 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:43.212310 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-s72l7" podStartSLOduration=1.566732617 podStartE2EDuration="5.212295894s" totalImagesPullingTime="3.645563277s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:20:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:20:43.211380493 +0000 UTC m=+549.719821319" watchObservedRunningTime="2026-07-01 19:20:43.212295894 +0000 UTC m=+549.720736713" Jul 01 19:20:43.228341 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:43.228298 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-88b4k" podStartSLOduration=1.7755532920000001 podStartE2EDuration="6.228286546s" totalImagesPullingTime="4.452733254s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:20:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:20:43.226083993 +0000 UTC m=+549.734524818" watchObservedRunningTime="2026-07-01 19:20:43.228286546 +0000 UTC m=+549.736727370" Jul 01 19:20:44.202334 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:44.202300 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-s72l7" podUID="86979e6f-273a-40f3-8814-60ffdfacea77" containerName="authorino" containerID="cri-o://1277848eec44c585b291941c562d73e4bdaf830369483a950d6f85fdc0e3fc4b" gracePeriod=30 Jul 01 19:20:44.452453 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:44.452395 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-s72l7" Jul 01 19:20:44.565205 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:44.565174 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f4nx9\" (UniqueName: \"kubernetes.io/projected/86979e6f-273a-40f3-8814-60ffdfacea77-kube-api-access-f4nx9\") pod \"86979e6f-273a-40f3-8814-60ffdfacea77\" (UID: \"86979e6f-273a-40f3-8814-60ffdfacea77\") " Jul 01 19:20:44.567176 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:44.567149 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/86979e6f-273a-40f3-8814-60ffdfacea77-kube-api-access-f4nx9" (OuterVolumeSpecName: "kube-api-access-f4nx9") pod "86979e6f-273a-40f3-8814-60ffdfacea77" (UID: "86979e6f-273a-40f3-8814-60ffdfacea77"). InnerVolumeSpecName "kube-api-access-f4nx9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 19:20:44.666631 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:44.666605 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f4nx9\" (UniqueName: \"kubernetes.io/projected/86979e6f-273a-40f3-8814-60ffdfacea77-kube-api-access-f4nx9\") on node \"ip-10-0-131-184.ec2.internal\" DevicePath \"\"" Jul 01 19:20:45.212424 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:45.212385 2561 generic.go:356] "Generic (PLEG): container finished" podID="86979e6f-273a-40f3-8814-60ffdfacea77" containerID="1277848eec44c585b291941c562d73e4bdaf830369483a950d6f85fdc0e3fc4b" exitCode=0 Jul 01 19:20:45.212868 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:45.212433 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-s72l7" Jul 01 19:20:45.212868 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:45.212468 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-s72l7" event={"ID":"86979e6f-273a-40f3-8814-60ffdfacea77","Type":"ContainerDied","Data":"1277848eec44c585b291941c562d73e4bdaf830369483a950d6f85fdc0e3fc4b"} Jul 01 19:20:45.212868 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:45.212502 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-s72l7" event={"ID":"86979e6f-273a-40f3-8814-60ffdfacea77","Type":"ContainerDied","Data":"69fed6ea24713611575f985c14f69ab4ec2e2dd63333958b6c39feb6d2a55f3c"} Jul 01 19:20:45.212868 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:45.212518 2561 scope.go:117] "RemoveContainer" containerID="1277848eec44c585b291941c562d73e4bdaf830369483a950d6f85fdc0e3fc4b" Jul 01 19:20:45.220947 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:45.220933 2561 scope.go:117] "RemoveContainer" containerID="1277848eec44c585b291941c562d73e4bdaf830369483a950d6f85fdc0e3fc4b" Jul 01 19:20:45.221228 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:20:45.221210 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1277848eec44c585b291941c562d73e4bdaf830369483a950d6f85fdc0e3fc4b\": container with ID starting with 1277848eec44c585b291941c562d73e4bdaf830369483a950d6f85fdc0e3fc4b not found: ID does not exist" containerID="1277848eec44c585b291941c562d73e4bdaf830369483a950d6f85fdc0e3fc4b" Jul 01 19:20:45.221292 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:45.221234 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1277848eec44c585b291941c562d73e4bdaf830369483a950d6f85fdc0e3fc4b"} err="failed to get container status \"1277848eec44c585b291941c562d73e4bdaf830369483a950d6f85fdc0e3fc4b\": rpc error: code = NotFound desc = could not find container \"1277848eec44c585b291941c562d73e4bdaf830369483a950d6f85fdc0e3fc4b\": container with ID starting with 1277848eec44c585b291941c562d73e4bdaf830369483a950d6f85fdc0e3fc4b not found: ID does not exist" Jul 01 19:20:45.231752 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:45.231730 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-s72l7"] Jul 01 19:20:45.235262 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:45.235244 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-s72l7"] Jul 01 19:20:45.977457 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:45.977429 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="86979e6f-273a-40f3-8814-60ffdfacea77" path="/var/lib/kubelet/pods/86979e6f-273a-40f3-8814-60ffdfacea77/volumes" Jul 01 19:20:52.567468 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:52.567437 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-88b4k"] Jul 01 19:20:52.567907 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:52.567607 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-88b4k" podUID="3f17ac99-6d26-450c-9b37-684111c1f08b" containerName="limitador" containerID="cri-o://d67bd3e9c6c864f315272df994237b958e709d6e103045bd3f68f5ed9cde01f2" gracePeriod=30 Jul 01 19:20:52.568665 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:52.568647 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-88b4k" Jul 01 19:20:53.120405 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:53.120382 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-88b4k" Jul 01 19:20:53.237575 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:53.237550 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t7s7j\" (UniqueName: \"kubernetes.io/projected/3f17ac99-6d26-450c-9b37-684111c1f08b-kube-api-access-t7s7j\") pod \"3f17ac99-6d26-450c-9b37-684111c1f08b\" (UID: \"3f17ac99-6d26-450c-9b37-684111c1f08b\") " Jul 01 19:20:53.237735 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:53.237613 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3f17ac99-6d26-450c-9b37-684111c1f08b-config-file\") pod \"3f17ac99-6d26-450c-9b37-684111c1f08b\" (UID: \"3f17ac99-6d26-450c-9b37-684111c1f08b\") " Jul 01 19:20:53.237916 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:53.237895 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3f17ac99-6d26-450c-9b37-684111c1f08b-config-file" (OuterVolumeSpecName: "config-file") pod "3f17ac99-6d26-450c-9b37-684111c1f08b" (UID: "3f17ac99-6d26-450c-9b37-684111c1f08b"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 19:20:53.239547 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:53.239528 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f17ac99-6d26-450c-9b37-684111c1f08b-kube-api-access-t7s7j" (OuterVolumeSpecName: "kube-api-access-t7s7j") pod "3f17ac99-6d26-450c-9b37-684111c1f08b" (UID: "3f17ac99-6d26-450c-9b37-684111c1f08b"). InnerVolumeSpecName "kube-api-access-t7s7j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 19:20:53.250922 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:53.250895 2561 generic.go:356] "Generic (PLEG): container finished" podID="3f17ac99-6d26-450c-9b37-684111c1f08b" containerID="d67bd3e9c6c864f315272df994237b958e709d6e103045bd3f68f5ed9cde01f2" exitCode=0 Jul 01 19:20:53.251042 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:53.250939 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-88b4k" Jul 01 19:20:53.251042 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:53.250973 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-88b4k" event={"ID":"3f17ac99-6d26-450c-9b37-684111c1f08b","Type":"ContainerDied","Data":"d67bd3e9c6c864f315272df994237b958e709d6e103045bd3f68f5ed9cde01f2"} Jul 01 19:20:53.251127 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:53.251051 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-88b4k" event={"ID":"3f17ac99-6d26-450c-9b37-684111c1f08b","Type":"ContainerDied","Data":"a7b23ea0e052fb55c078f4903631b6445b8546145e25dbefdfd0036a8f7058b8"} Jul 01 19:20:53.251127 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:53.251078 2561 scope.go:117] "RemoveContainer" containerID="d67bd3e9c6c864f315272df994237b958e709d6e103045bd3f68f5ed9cde01f2" Jul 01 19:20:53.258861 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:53.258843 2561 scope.go:117] "RemoveContainer" containerID="d67bd3e9c6c864f315272df994237b958e709d6e103045bd3f68f5ed9cde01f2" Jul 01 19:20:53.259110 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:20:53.259092 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d67bd3e9c6c864f315272df994237b958e709d6e103045bd3f68f5ed9cde01f2\": container with ID starting with d67bd3e9c6c864f315272df994237b958e709d6e103045bd3f68f5ed9cde01f2 not found: ID does not exist" containerID="d67bd3e9c6c864f315272df994237b958e709d6e103045bd3f68f5ed9cde01f2" Jul 01 19:20:53.259180 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:53.259122 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d67bd3e9c6c864f315272df994237b958e709d6e103045bd3f68f5ed9cde01f2"} err="failed to get container status \"d67bd3e9c6c864f315272df994237b958e709d6e103045bd3f68f5ed9cde01f2\": rpc error: code = NotFound desc = could not find container \"d67bd3e9c6c864f315272df994237b958e709d6e103045bd3f68f5ed9cde01f2\": container with ID starting with d67bd3e9c6c864f315272df994237b958e709d6e103045bd3f68f5ed9cde01f2 not found: ID does not exist" Jul 01 19:20:53.271336 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:53.271314 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-88b4k"] Jul 01 19:20:53.274745 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:53.274726 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-88b4k"] Jul 01 19:20:53.338883 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:53.338857 2561 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3f17ac99-6d26-450c-9b37-684111c1f08b-config-file\") on node \"ip-10-0-131-184.ec2.internal\" DevicePath \"\"" Jul 01 19:20:53.338883 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:53.338878 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t7s7j\" (UniqueName: \"kubernetes.io/projected/3f17ac99-6d26-450c-9b37-684111c1f08b-kube-api-access-t7s7j\") on node \"ip-10-0-131-184.ec2.internal\" DevicePath \"\"" Jul 01 19:20:53.977237 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:53.977208 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3f17ac99-6d26-450c-9b37-684111c1f08b" path="/var/lib/kubelet/pods/3f17ac99-6d26-450c-9b37-684111c1f08b/volumes" Jul 01 19:20:58.941405 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:58.941375 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-6f8dm"] Jul 01 19:20:58.941875 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:58.941771 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86979e6f-273a-40f3-8814-60ffdfacea77" containerName="authorino" Jul 01 19:20:58.941875 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:58.941783 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="86979e6f-273a-40f3-8814-60ffdfacea77" containerName="authorino" Jul 01 19:20:58.941875 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:58.941802 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f17ac99-6d26-450c-9b37-684111c1f08b" containerName="limitador" Jul 01 19:20:58.941875 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:58.941807 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f17ac99-6d26-450c-9b37-684111c1f08b" containerName="limitador" Jul 01 19:20:58.941875 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:58.941863 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="86979e6f-273a-40f3-8814-60ffdfacea77" containerName="authorino" Jul 01 19:20:58.941875 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:58.941875 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f17ac99-6d26-450c-9b37-684111c1f08b" containerName="limitador" Jul 01 19:20:58.944790 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:58.944769 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-6f8dm" Jul 01 19:20:58.946648 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:58.946629 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jul 01 19:20:58.955616 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:58.955595 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-6f8dm"] Jul 01 19:20:59.083889 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:59.083862 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2prts\" (UniqueName: \"kubernetes.io/projected/9e02d052-4bd7-46f2-baa5-2086282e7538-kube-api-access-2prts\") pod \"postgres-69fb4594cf-6f8dm\" (UID: \"9e02d052-4bd7-46f2-baa5-2086282e7538\") " pod="opendatahub/postgres-69fb4594cf-6f8dm" Jul 01 19:20:59.084070 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:59.083927 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/9e02d052-4bd7-46f2-baa5-2086282e7538-data\") pod \"postgres-69fb4594cf-6f8dm\" (UID: \"9e02d052-4bd7-46f2-baa5-2086282e7538\") " pod="opendatahub/postgres-69fb4594cf-6f8dm" Jul 01 19:20:59.185123 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:59.185094 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/9e02d052-4bd7-46f2-baa5-2086282e7538-data\") pod \"postgres-69fb4594cf-6f8dm\" (UID: \"9e02d052-4bd7-46f2-baa5-2086282e7538\") " pod="opendatahub/postgres-69fb4594cf-6f8dm" Jul 01 19:20:59.185275 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:59.185139 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2prts\" (UniqueName: \"kubernetes.io/projected/9e02d052-4bd7-46f2-baa5-2086282e7538-kube-api-access-2prts\") pod \"postgres-69fb4594cf-6f8dm\" (UID: \"9e02d052-4bd7-46f2-baa5-2086282e7538\") " pod="opendatahub/postgres-69fb4594cf-6f8dm" Jul 01 19:20:59.185461 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:59.185443 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/9e02d052-4bd7-46f2-baa5-2086282e7538-data\") pod \"postgres-69fb4594cf-6f8dm\" (UID: \"9e02d052-4bd7-46f2-baa5-2086282e7538\") " pod="opendatahub/postgres-69fb4594cf-6f8dm" Jul 01 19:20:59.193570 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:59.193506 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2prts\" (UniqueName: \"kubernetes.io/projected/9e02d052-4bd7-46f2-baa5-2086282e7538-kube-api-access-2prts\") pod \"postgres-69fb4594cf-6f8dm\" (UID: \"9e02d052-4bd7-46f2-baa5-2086282e7538\") " pod="opendatahub/postgres-69fb4594cf-6f8dm" Jul 01 19:20:59.255552 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:59.255519 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-6f8dm" Jul 01 19:20:59.384899 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:20:59.384863 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-6f8dm"] Jul 01 19:20:59.387794 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:20:59.387768 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e02d052_4bd7_46f2_baa5_2086282e7538.slice/crio-2d1006a068485ef9bafaaa0e6065f041069109ba19355f8e658527fb6ddeb1b7 WatchSource:0}: Error finding container 2d1006a068485ef9bafaaa0e6065f041069109ba19355f8e658527fb6ddeb1b7: Status 404 returned error can't find the container with id 2d1006a068485ef9bafaaa0e6065f041069109ba19355f8e658527fb6ddeb1b7 Jul 01 19:21:00.285304 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:21:00.285272 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-6f8dm" event={"ID":"9e02d052-4bd7-46f2-baa5-2086282e7538","Type":"ContainerStarted","Data":"2d1006a068485ef9bafaaa0e6065f041069109ba19355f8e658527fb6ddeb1b7"} Jul 01 19:21:04.311628 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:21:04.311591 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-6f8dm" event={"ID":"9e02d052-4bd7-46f2-baa5-2086282e7538","Type":"ContainerStarted","Data":"9d882f182a0ff1c9a0f954be3eb510884a1cc851f7da2808a69960a7fdc850f9"} Jul 01 19:21:04.312124 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:21:04.311703 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-6f8dm" Jul 01 19:21:04.327376 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:21:04.327339 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-6f8dm" podStartSLOduration=2.191578004 podStartE2EDuration="6.327327045s" totalImagesPullingTime="4.135749041s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:20:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:21:04.325743092 +0000 UTC m=+570.834183919" watchObservedRunningTime="2026-07-01 19:21:04.327327045 +0000 UTC m=+570.835767869" Jul 01 19:21:10.344334 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:21:10.344308 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-6f8dm" Jul 01 19:21:19.508148 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:21:19.508119 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/keycloak-operator-d8b9d7b4d-d6wdr"] Jul 01 19:21:19.519751 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:21:19.519721 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d8b9d7b4d-d6wdr" Jul 01 19:21:19.520404 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:21:19.520377 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d8b9d7b4d-d6wdr"] Jul 01 19:21:19.521655 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:21:19.521620 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jul 01 19:21:19.522081 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:21:19.522061 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"keycloak-operator-dockercfg-7qxvl\"" Jul 01 19:21:19.522202 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:21:19.522097 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jul 01 19:21:19.540409 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:21:19.540385 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z88x5\" (UniqueName: \"kubernetes.io/projected/dd467688-7b21-4362-88e8-6f54f7a336e8-kube-api-access-z88x5\") pod \"keycloak-operator-d8b9d7b4d-d6wdr\" (UID: \"dd467688-7b21-4362-88e8-6f54f7a336e8\") " pod="keycloak-system/keycloak-operator-d8b9d7b4d-d6wdr" Jul 01 19:21:19.641339 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:21:19.641309 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z88x5\" (UniqueName: \"kubernetes.io/projected/dd467688-7b21-4362-88e8-6f54f7a336e8-kube-api-access-z88x5\") pod \"keycloak-operator-d8b9d7b4d-d6wdr\" (UID: \"dd467688-7b21-4362-88e8-6f54f7a336e8\") " pod="keycloak-system/keycloak-operator-d8b9d7b4d-d6wdr" Jul 01 19:21:19.648892 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:21:19.648862 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z88x5\" (UniqueName: \"kubernetes.io/projected/dd467688-7b21-4362-88e8-6f54f7a336e8-kube-api-access-z88x5\") pod \"keycloak-operator-d8b9d7b4d-d6wdr\" (UID: \"dd467688-7b21-4362-88e8-6f54f7a336e8\") " pod="keycloak-system/keycloak-operator-d8b9d7b4d-d6wdr" Jul 01 19:21:19.830986 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:21:19.830891 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d8b9d7b4d-d6wdr" Jul 01 19:21:19.967918 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:21:19.967895 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d8b9d7b4d-d6wdr"] Jul 01 19:21:19.971050 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:21:19.971023 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd467688_7b21_4362_88e8_6f54f7a336e8.slice/crio-82f4fb4256d9e37b6c499b3210378fe59eae3daa4e071ec9ce4deea4bb2d1f55 WatchSource:0}: Error finding container 82f4fb4256d9e37b6c499b3210378fe59eae3daa4e071ec9ce4deea4bb2d1f55: Status 404 returned error can't find the container with id 82f4fb4256d9e37b6c499b3210378fe59eae3daa4e071ec9ce4deea4bb2d1f55 Jul 01 19:21:20.385045 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:21:20.385006 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d8b9d7b4d-d6wdr" event={"ID":"dd467688-7b21-4362-88e8-6f54f7a336e8","Type":"ContainerStarted","Data":"82f4fb4256d9e37b6c499b3210378fe59eae3daa4e071ec9ce4deea4bb2d1f55"} Jul 01 19:21:26.417422 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:21:26.417342 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d8b9d7b4d-d6wdr" event={"ID":"dd467688-7b21-4362-88e8-6f54f7a336e8","Type":"ContainerStarted","Data":"061939fddc54fb870f9b2a1539843b72b2e6319ac65c584439d860a7002969e5"} Jul 01 19:21:26.436333 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:21:26.436270 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/keycloak-operator-d8b9d7b4d-d6wdr" podStartSLOduration=1.338304224 podStartE2EDuration="7.436250667s" totalImagesPullingTime="6.097946443s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:21:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:21:26.434032373 +0000 UTC m=+592.942473216" watchObservedRunningTime="2026-07-01 19:21:26.436250667 +0000 UTC m=+592.944691493" Jul 01 19:21:33.948290 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:21:33.948259 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p4nbs_9315c387-a14c-4926-969a-64945926951e/ovn-acl-logging/0.log" Jul 01 19:21:33.953476 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:21:33.953456 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p4nbs_9315c387-a14c-4926-969a-64945926951e/ovn-acl-logging/0.log" Jul 01 19:22:05.456053 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:22:05.455980 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-5q524"] Jul 01 19:22:05.463024 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:22:05.463000 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-5q524" Jul 01 19:22:05.467587 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:22:05.467567 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-prbkh\"" Jul 01 19:22:05.470887 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:22:05.470856 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-5q524"] Jul 01 19:22:05.541590 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:22:05.541556 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nt4wq\" (UniqueName: \"kubernetes.io/projected/bddd48f4-98ad-4c01-be42-0b4f3e107037-kube-api-access-nt4wq\") pod \"authorino-5d4b67c446-5q524\" (UID: \"bddd48f4-98ad-4c01-be42-0b4f3e107037\") " pod="kuadrant-system/authorino-5d4b67c446-5q524" Jul 01 19:22:05.643016 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:22:05.642987 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nt4wq\" (UniqueName: \"kubernetes.io/projected/bddd48f4-98ad-4c01-be42-0b4f3e107037-kube-api-access-nt4wq\") pod \"authorino-5d4b67c446-5q524\" (UID: \"bddd48f4-98ad-4c01-be42-0b4f3e107037\") " pod="kuadrant-system/authorino-5d4b67c446-5q524" Jul 01 19:22:05.645486 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:22:05.645464 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-5q524"] Jul 01 19:22:05.645725 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:22:05.645705 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-nt4wq], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-5q524" podUID="bddd48f4-98ad-4c01-be42-0b4f3e107037" Jul 01 19:22:05.653715 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:22:05.653688 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nt4wq\" (UniqueName: \"kubernetes.io/projected/bddd48f4-98ad-4c01-be42-0b4f3e107037-kube-api-access-nt4wq\") pod \"authorino-5d4b67c446-5q524\" (UID: \"bddd48f4-98ad-4c01-be42-0b4f3e107037\") " pod="kuadrant-system/authorino-5d4b67c446-5q524" Jul 01 19:22:05.673939 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:22:05.673915 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7896888ffb-7lw85"] Jul 01 19:22:05.676324 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:22:05.676308 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7896888ffb-7lw85" Jul 01 19:22:05.685232 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:22:05.685207 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7896888ffb-7lw85"] Jul 01 19:22:05.744229 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:22:05.744154 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tdf48\" (UniqueName: \"kubernetes.io/projected/c5785cb0-a98a-4bff-b3a4-28e00b002049-kube-api-access-tdf48\") pod \"authorino-7896888ffb-7lw85\" (UID: \"c5785cb0-a98a-4bff-b3a4-28e00b002049\") " pod="kuadrant-system/authorino-7896888ffb-7lw85" Jul 01 19:22:05.831236 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:22:05.831208 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7896888ffb-7lw85"] Jul 01 19:22:05.831464 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:22:05.831443 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-tdf48], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-7896888ffb-7lw85" podUID="c5785cb0-a98a-4bff-b3a4-28e00b002049" Jul 01 19:22:05.845030 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:22:05.845008 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tdf48\" (UniqueName: \"kubernetes.io/projected/c5785cb0-a98a-4bff-b3a4-28e00b002049-kube-api-access-tdf48\") pod \"authorino-7896888ffb-7lw85\" (UID: \"c5785cb0-a98a-4bff-b3a4-28e00b002049\") " pod="kuadrant-system/authorino-7896888ffb-7lw85" Jul 01 19:22:05.854118 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:22:05.854097 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tdf48\" (UniqueName: \"kubernetes.io/projected/c5785cb0-a98a-4bff-b3a4-28e00b002049-kube-api-access-tdf48\") pod \"authorino-7896888ffb-7lw85\" (UID: \"c5785cb0-a98a-4bff-b3a4-28e00b002049\") " pod="kuadrant-system/authorino-7896888ffb-7lw85" Jul 01 19:22:05.857775 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:22:05.857753 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7db7ddc568-s2m5d"] Jul 01 19:22:05.860673 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:22:05.860655 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7db7ddc568-s2m5d" Jul 01 19:22:05.862596 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:22:05.862576 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 01 19:22:05.867704 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:22:05.867603 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7db7ddc568-s2m5d"] Jul 01 19:22:05.946096 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:22:05.946066 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/3aac7ea5-dd20-41a8-838d-be7e225420ed-tls-cert\") pod \"authorino-7db7ddc568-s2m5d\" (UID: \"3aac7ea5-dd20-41a8-838d-be7e225420ed\") " pod="kuadrant-system/authorino-7db7ddc568-s2m5d" Jul 01 19:22:05.946250 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:22:05.946115 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jwqkh\" (UniqueName: \"kubernetes.io/projected/3aac7ea5-dd20-41a8-838d-be7e225420ed-kube-api-access-jwqkh\") pod \"authorino-7db7ddc568-s2m5d\" (UID: \"3aac7ea5-dd20-41a8-838d-be7e225420ed\") " pod="kuadrant-system/authorino-7db7ddc568-s2m5d" Jul 01 19:22:06.047138 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:22:06.047053 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/3aac7ea5-dd20-41a8-838d-be7e225420ed-tls-cert\") pod \"authorino-7db7ddc568-s2m5d\" (UID: \"3aac7ea5-dd20-41a8-838d-be7e225420ed\") " pod="kuadrant-system/authorino-7db7ddc568-s2m5d" Jul 01 19:22:06.047283 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:22:06.047215 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jwqkh\" (UniqueName: \"kubernetes.io/projected/3aac7ea5-dd20-41a8-838d-be7e225420ed-kube-api-access-jwqkh\") pod \"authorino-7db7ddc568-s2m5d\" (UID: \"3aac7ea5-dd20-41a8-838d-be7e225420ed\") " pod="kuadrant-system/authorino-7db7ddc568-s2m5d" Jul 01 19:22:06.049298 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:22:06.049272 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/3aac7ea5-dd20-41a8-838d-be7e225420ed-tls-cert\") pod \"authorino-7db7ddc568-s2m5d\" (UID: \"3aac7ea5-dd20-41a8-838d-be7e225420ed\") " pod="kuadrant-system/authorino-7db7ddc568-s2m5d" Jul 01 19:22:06.055683 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:22:06.055663 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jwqkh\" (UniqueName: \"kubernetes.io/projected/3aac7ea5-dd20-41a8-838d-be7e225420ed-kube-api-access-jwqkh\") pod \"authorino-7db7ddc568-s2m5d\" (UID: \"3aac7ea5-dd20-41a8-838d-be7e225420ed\") " pod="kuadrant-system/authorino-7db7ddc568-s2m5d" Jul 01 19:22:06.170766 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:22:06.170739 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7db7ddc568-s2m5d" Jul 01 19:22:06.306019 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:22:06.305993 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7db7ddc568-s2m5d"] Jul 01 19:22:06.308143 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:22:06.308120 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3aac7ea5_dd20_41a8_838d_be7e225420ed.slice/crio-2a5ed10aff4a4ccb2ca002f4cbf8a4cc7124daedc037995e46b8dd0af741009e WatchSource:0}: Error finding container 2a5ed10aff4a4ccb2ca002f4cbf8a4cc7124daedc037995e46b8dd0af741009e: Status 404 returned error can't find the container with id 2a5ed10aff4a4ccb2ca002f4cbf8a4cc7124daedc037995e46b8dd0af741009e Jul 01 19:22:06.606159 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:22:06.606086 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7896888ffb-7lw85" Jul 01 19:22:06.606159 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:22:06.606115 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-5q524" Jul 01 19:22:06.606159 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:22:06.606084 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7db7ddc568-s2m5d" event={"ID":"3aac7ea5-dd20-41a8-838d-be7e225420ed","Type":"ContainerStarted","Data":"2a5ed10aff4a4ccb2ca002f4cbf8a4cc7124daedc037995e46b8dd0af741009e"} Jul 01 19:22:06.612942 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:22:06.612923 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7896888ffb-7lw85" Jul 01 19:22:06.615042 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:22:06.615028 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-5q524" Jul 01 19:22:06.651730 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:22:06.651709 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nt4wq\" (UniqueName: \"kubernetes.io/projected/bddd48f4-98ad-4c01-be42-0b4f3e107037-kube-api-access-nt4wq\") pod \"bddd48f4-98ad-4c01-be42-0b4f3e107037\" (UID: \"bddd48f4-98ad-4c01-be42-0b4f3e107037\") " Jul 01 19:22:06.651858 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:22:06.651767 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tdf48\" (UniqueName: \"kubernetes.io/projected/c5785cb0-a98a-4bff-b3a4-28e00b002049-kube-api-access-tdf48\") pod \"c5785cb0-a98a-4bff-b3a4-28e00b002049\" (UID: \"c5785cb0-a98a-4bff-b3a4-28e00b002049\") " Jul 01 19:22:06.653840 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:22:06.653817 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c5785cb0-a98a-4bff-b3a4-28e00b002049-kube-api-access-tdf48" (OuterVolumeSpecName: "kube-api-access-tdf48") pod "c5785cb0-a98a-4bff-b3a4-28e00b002049" (UID: "c5785cb0-a98a-4bff-b3a4-28e00b002049"). InnerVolumeSpecName "kube-api-access-tdf48". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 19:22:06.653921 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:22:06.653885 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bddd48f4-98ad-4c01-be42-0b4f3e107037-kube-api-access-nt4wq" (OuterVolumeSpecName: "kube-api-access-nt4wq") pod "bddd48f4-98ad-4c01-be42-0b4f3e107037" (UID: "bddd48f4-98ad-4c01-be42-0b4f3e107037"). InnerVolumeSpecName "kube-api-access-nt4wq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 19:22:06.752990 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:22:06.752947 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nt4wq\" (UniqueName: \"kubernetes.io/projected/bddd48f4-98ad-4c01-be42-0b4f3e107037-kube-api-access-nt4wq\") on node \"ip-10-0-131-184.ec2.internal\" DevicePath \"\"" Jul 01 19:22:06.752990 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:22:06.752983 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tdf48\" (UniqueName: \"kubernetes.io/projected/c5785cb0-a98a-4bff-b3a4-28e00b002049-kube-api-access-tdf48\") on node \"ip-10-0-131-184.ec2.internal\" DevicePath \"\"" Jul 01 19:22:07.611750 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:22:07.611711 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7db7ddc568-s2m5d" event={"ID":"3aac7ea5-dd20-41a8-838d-be7e225420ed","Type":"ContainerStarted","Data":"7497151c188ae863ed2b706cf52833da6a296606a29fa43394b8eb689acf0ecb"} Jul 01 19:22:07.611750 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:22:07.611738 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-5q524" Jul 01 19:22:07.612243 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:22:07.611760 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7896888ffb-7lw85" Jul 01 19:22:07.628211 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:22:07.628172 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7db7ddc568-s2m5d" podStartSLOduration=1.925141928 podStartE2EDuration="2.628158663s" totalImagesPullingTime="703.016735ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:22:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:22:07.626495226 +0000 UTC m=+634.134936052" watchObservedRunningTime="2026-07-01 19:22:07.628158663 +0000 UTC m=+634.136599515" Jul 01 19:22:07.651234 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:22:07.651202 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-5q524"] Jul 01 19:22:07.658337 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:22:07.658311 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-5q524"] Jul 01 19:22:07.691842 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:22:07.691806 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7896888ffb-7lw85"] Jul 01 19:22:07.698272 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:22:07.698249 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7896888ffb-7lw85"] Jul 01 19:22:07.978711 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:22:07.978678 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bddd48f4-98ad-4c01-be42-0b4f3e107037" path="/var/lib/kubelet/pods/bddd48f4-98ad-4c01-be42-0b4f3e107037/volumes" Jul 01 19:22:07.978984 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:22:07.978948 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c5785cb0-a98a-4bff-b3a4-28e00b002049" path="/var/lib/kubelet/pods/c5785cb0-a98a-4bff-b3a4-28e00b002049/volumes" Jul 01 19:23:40.395355 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:23:40.395281 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-8547d876b-kvfv7"] Jul 01 19:23:40.397781 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:23:40.397761 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8547d876b-kvfv7" Jul 01 19:23:40.399721 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:23:40.399701 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\"" Jul 01 19:23:40.405457 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:23:40.405435 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8547d876b-kvfv7"] Jul 01 19:23:40.542703 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:23:40.542668 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/ec59cceb-3b42-440f-8d6e-f2f7038ac7da-oidc-ca\") pod \"authorino-8547d876b-kvfv7\" (UID: \"ec59cceb-3b42-440f-8d6e-f2f7038ac7da\") " pod="kuadrant-system/authorino-8547d876b-kvfv7" Jul 01 19:23:40.542872 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:23:40.542715 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ec59cceb-3b42-440f-8d6e-f2f7038ac7da-tls-cert\") pod \"authorino-8547d876b-kvfv7\" (UID: \"ec59cceb-3b42-440f-8d6e-f2f7038ac7da\") " pod="kuadrant-system/authorino-8547d876b-kvfv7" Jul 01 19:23:40.542872 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:23:40.542763 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qgrrp\" (UniqueName: \"kubernetes.io/projected/ec59cceb-3b42-440f-8d6e-f2f7038ac7da-kube-api-access-qgrrp\") pod \"authorino-8547d876b-kvfv7\" (UID: \"ec59cceb-3b42-440f-8d6e-f2f7038ac7da\") " pod="kuadrant-system/authorino-8547d876b-kvfv7" Jul 01 19:23:40.644019 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:23:40.643989 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/ec59cceb-3b42-440f-8d6e-f2f7038ac7da-oidc-ca\") pod \"authorino-8547d876b-kvfv7\" (UID: \"ec59cceb-3b42-440f-8d6e-f2f7038ac7da\") " pod="kuadrant-system/authorino-8547d876b-kvfv7" Jul 01 19:23:40.644168 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:23:40.644030 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ec59cceb-3b42-440f-8d6e-f2f7038ac7da-tls-cert\") pod \"authorino-8547d876b-kvfv7\" (UID: \"ec59cceb-3b42-440f-8d6e-f2f7038ac7da\") " pod="kuadrant-system/authorino-8547d876b-kvfv7" Jul 01 19:23:40.644168 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:23:40.644056 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qgrrp\" (UniqueName: \"kubernetes.io/projected/ec59cceb-3b42-440f-8d6e-f2f7038ac7da-kube-api-access-qgrrp\") pod \"authorino-8547d876b-kvfv7\" (UID: \"ec59cceb-3b42-440f-8d6e-f2f7038ac7da\") " pod="kuadrant-system/authorino-8547d876b-kvfv7" Jul 01 19:23:40.644676 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:23:40.644656 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/ec59cceb-3b42-440f-8d6e-f2f7038ac7da-oidc-ca\") pod \"authorino-8547d876b-kvfv7\" (UID: \"ec59cceb-3b42-440f-8d6e-f2f7038ac7da\") " pod="kuadrant-system/authorino-8547d876b-kvfv7" Jul 01 19:23:40.646520 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:23:40.646469 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ec59cceb-3b42-440f-8d6e-f2f7038ac7da-tls-cert\") pod \"authorino-8547d876b-kvfv7\" (UID: \"ec59cceb-3b42-440f-8d6e-f2f7038ac7da\") " pod="kuadrant-system/authorino-8547d876b-kvfv7" Jul 01 19:23:40.650725 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:23:40.650705 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qgrrp\" (UniqueName: \"kubernetes.io/projected/ec59cceb-3b42-440f-8d6e-f2f7038ac7da-kube-api-access-qgrrp\") pod \"authorino-8547d876b-kvfv7\" (UID: \"ec59cceb-3b42-440f-8d6e-f2f7038ac7da\") " pod="kuadrant-system/authorino-8547d876b-kvfv7" Jul 01 19:23:40.707892 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:23:40.707853 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8547d876b-kvfv7" Jul 01 19:23:40.842357 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:23:40.842328 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8547d876b-kvfv7"] Jul 01 19:23:40.844872 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:23:40.844848 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podec59cceb_3b42_440f_8d6e_f2f7038ac7da.slice/crio-d015ee1b1683c1555cd34d4ce780359a73dc85aa5d714f422dd71aa5bfca92bb WatchSource:0}: Error finding container d015ee1b1683c1555cd34d4ce780359a73dc85aa5d714f422dd71aa5bfca92bb: Status 404 returned error can't find the container with id d015ee1b1683c1555cd34d4ce780359a73dc85aa5d714f422dd71aa5bfca92bb Jul 01 19:23:40.846152 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:23:40.846136 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 01 19:23:41.059381 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:23:41.059351 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8547d876b-kvfv7" event={"ID":"ec59cceb-3b42-440f-8d6e-f2f7038ac7da","Type":"ContainerStarted","Data":"d015ee1b1683c1555cd34d4ce780359a73dc85aa5d714f422dd71aa5bfca92bb"} Jul 01 19:23:42.064940 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:23:42.064909 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8547d876b-kvfv7" event={"ID":"ec59cceb-3b42-440f-8d6e-f2f7038ac7da","Type":"ContainerStarted","Data":"eca877d97b3318d0e319bb213d96ac2388e920fbd751d3847feb74a1a54ce32d"} Jul 01 19:23:42.083242 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:23:42.083190 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-8547d876b-kvfv7" podStartSLOduration=1.560281028 podStartE2EDuration="2.083174999s" totalImagesPullingTime="522.893971ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:23:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:23:42.081851785 +0000 UTC m=+728.590292591" watchObservedRunningTime="2026-07-01 19:23:42.083174999 +0000 UTC m=+728.591615830" Jul 01 19:23:42.112114 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:23:42.112085 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7db7ddc568-s2m5d"] Jul 01 19:23:42.112319 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:23:42.112286 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-7db7ddc568-s2m5d" podUID="3aac7ea5-dd20-41a8-838d-be7e225420ed" containerName="authorino" containerID="cri-o://7497151c188ae863ed2b706cf52833da6a296606a29fa43394b8eb689acf0ecb" gracePeriod=30 Jul 01 19:23:42.358707 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:23:42.358684 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7db7ddc568-s2m5d" Jul 01 19:23:42.459685 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:23:42.459653 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/3aac7ea5-dd20-41a8-838d-be7e225420ed-tls-cert\") pod \"3aac7ea5-dd20-41a8-838d-be7e225420ed\" (UID: \"3aac7ea5-dd20-41a8-838d-be7e225420ed\") " Jul 01 19:23:42.459867 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:23:42.459738 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jwqkh\" (UniqueName: \"kubernetes.io/projected/3aac7ea5-dd20-41a8-838d-be7e225420ed-kube-api-access-jwqkh\") pod \"3aac7ea5-dd20-41a8-838d-be7e225420ed\" (UID: \"3aac7ea5-dd20-41a8-838d-be7e225420ed\") " Jul 01 19:23:42.461742 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:23:42.461717 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3aac7ea5-dd20-41a8-838d-be7e225420ed-kube-api-access-jwqkh" (OuterVolumeSpecName: "kube-api-access-jwqkh") pod "3aac7ea5-dd20-41a8-838d-be7e225420ed" (UID: "3aac7ea5-dd20-41a8-838d-be7e225420ed"). InnerVolumeSpecName "kube-api-access-jwqkh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 19:23:42.470647 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:23:42.470617 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3aac7ea5-dd20-41a8-838d-be7e225420ed-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "3aac7ea5-dd20-41a8-838d-be7e225420ed" (UID: "3aac7ea5-dd20-41a8-838d-be7e225420ed"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 19:23:42.560850 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:23:42.560815 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jwqkh\" (UniqueName: \"kubernetes.io/projected/3aac7ea5-dd20-41a8-838d-be7e225420ed-kube-api-access-jwqkh\") on node \"ip-10-0-131-184.ec2.internal\" DevicePath \"\"" Jul 01 19:23:42.560850 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:23:42.560844 2561 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/3aac7ea5-dd20-41a8-838d-be7e225420ed-tls-cert\") on node \"ip-10-0-131-184.ec2.internal\" DevicePath \"\"" Jul 01 19:23:43.070134 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:23:43.070100 2561 generic.go:356] "Generic (PLEG): container finished" podID="3aac7ea5-dd20-41a8-838d-be7e225420ed" containerID="7497151c188ae863ed2b706cf52833da6a296606a29fa43394b8eb689acf0ecb" exitCode=0 Jul 01 19:23:43.070134 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:23:43.070137 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7db7ddc568-s2m5d" Jul 01 19:23:43.070671 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:23:43.070181 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7db7ddc568-s2m5d" event={"ID":"3aac7ea5-dd20-41a8-838d-be7e225420ed","Type":"ContainerDied","Data":"7497151c188ae863ed2b706cf52833da6a296606a29fa43394b8eb689acf0ecb"} Jul 01 19:23:43.070671 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:23:43.070218 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7db7ddc568-s2m5d" event={"ID":"3aac7ea5-dd20-41a8-838d-be7e225420ed","Type":"ContainerDied","Data":"2a5ed10aff4a4ccb2ca002f4cbf8a4cc7124daedc037995e46b8dd0af741009e"} Jul 01 19:23:43.070671 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:23:43.070234 2561 scope.go:117] "RemoveContainer" containerID="7497151c188ae863ed2b706cf52833da6a296606a29fa43394b8eb689acf0ecb" Jul 01 19:23:43.079454 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:23:43.079438 2561 scope.go:117] "RemoveContainer" containerID="7497151c188ae863ed2b706cf52833da6a296606a29fa43394b8eb689acf0ecb" Jul 01 19:23:43.079693 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:23:43.079676 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7497151c188ae863ed2b706cf52833da6a296606a29fa43394b8eb689acf0ecb\": container with ID starting with 7497151c188ae863ed2b706cf52833da6a296606a29fa43394b8eb689acf0ecb not found: ID does not exist" containerID="7497151c188ae863ed2b706cf52833da6a296606a29fa43394b8eb689acf0ecb" Jul 01 19:23:43.079760 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:23:43.079700 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7497151c188ae863ed2b706cf52833da6a296606a29fa43394b8eb689acf0ecb"} err="failed to get container status \"7497151c188ae863ed2b706cf52833da6a296606a29fa43394b8eb689acf0ecb\": rpc error: code = NotFound desc = could not find container \"7497151c188ae863ed2b706cf52833da6a296606a29fa43394b8eb689acf0ecb\": container with ID starting with 7497151c188ae863ed2b706cf52833da6a296606a29fa43394b8eb689acf0ecb not found: ID does not exist" Jul 01 19:23:43.093298 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:23:43.093269 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7db7ddc568-s2m5d"] Jul 01 19:23:43.095257 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:23:43.095230 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7db7ddc568-s2m5d"] Jul 01 19:23:43.978332 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:23:43.978296 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3aac7ea5-dd20-41a8-838d-be7e225420ed" path="/var/lib/kubelet/pods/3aac7ea5-dd20-41a8-838d-be7e225420ed/volumes" Jul 01 19:24:41.284226 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:24:41.284196 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-6cqcn"] Jul 01 19:24:41.284651 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:24:41.284577 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3aac7ea5-dd20-41a8-838d-be7e225420ed" containerName="authorino" Jul 01 19:24:41.284651 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:24:41.284588 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="3aac7ea5-dd20-41a8-838d-be7e225420ed" containerName="authorino" Jul 01 19:24:41.284651 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:24:41.284648 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="3aac7ea5-dd20-41a8-838d-be7e225420ed" containerName="authorino" Jul 01 19:24:41.287254 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:24:41.287236 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-6cqcn" Jul 01 19:24:41.289381 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:24:41.289364 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 01 19:24:41.289771 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:24:41.289754 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-mf94x\"" Jul 01 19:24:41.289866 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:24:41.289775 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 01 19:24:41.289866 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:24:41.289805 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 01 19:24:41.299039 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:24:41.299010 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-6cqcn"] Jul 01 19:24:41.334267 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:24:41.334228 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jbj2r\" (UniqueName: \"kubernetes.io/projected/3d9bac04-b9b9-4c70-99c8-40d41efc6b1a-kube-api-access-jbj2r\") pod \"facebook-opt-125m-simulated-kserve-99c7dfb5c-6cqcn\" (UID: \"3d9bac04-b9b9-4c70-99c8-40d41efc6b1a\") " pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-6cqcn" Jul 01 19:24:41.334426 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:24:41.334294 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3d9bac04-b9b9-4c70-99c8-40d41efc6b1a-dshm\") pod \"facebook-opt-125m-simulated-kserve-99c7dfb5c-6cqcn\" (UID: \"3d9bac04-b9b9-4c70-99c8-40d41efc6b1a\") " pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-6cqcn" Jul 01 19:24:41.334426 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:24:41.334329 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3d9bac04-b9b9-4c70-99c8-40d41efc6b1a-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-99c7dfb5c-6cqcn\" (UID: \"3d9bac04-b9b9-4c70-99c8-40d41efc6b1a\") " pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-6cqcn" Jul 01 19:24:41.334426 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:24:41.334370 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3d9bac04-b9b9-4c70-99c8-40d41efc6b1a-home\") pod \"facebook-opt-125m-simulated-kserve-99c7dfb5c-6cqcn\" (UID: \"3d9bac04-b9b9-4c70-99c8-40d41efc6b1a\") " pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-6cqcn" Jul 01 19:24:41.334426 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:24:41.334404 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3d9bac04-b9b9-4c70-99c8-40d41efc6b1a-model-cache\") pod \"facebook-opt-125m-simulated-kserve-99c7dfb5c-6cqcn\" (UID: \"3d9bac04-b9b9-4c70-99c8-40d41efc6b1a\") " pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-6cqcn" Jul 01 19:24:41.435735 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:24:41.435703 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbj2r\" (UniqueName: \"kubernetes.io/projected/3d9bac04-b9b9-4c70-99c8-40d41efc6b1a-kube-api-access-jbj2r\") pod \"facebook-opt-125m-simulated-kserve-99c7dfb5c-6cqcn\" (UID: \"3d9bac04-b9b9-4c70-99c8-40d41efc6b1a\") " pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-6cqcn" Jul 01 19:24:41.435914 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:24:41.435742 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3d9bac04-b9b9-4c70-99c8-40d41efc6b1a-dshm\") pod \"facebook-opt-125m-simulated-kserve-99c7dfb5c-6cqcn\" (UID: \"3d9bac04-b9b9-4c70-99c8-40d41efc6b1a\") " pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-6cqcn" Jul 01 19:24:41.435914 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:24:41.435767 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3d9bac04-b9b9-4c70-99c8-40d41efc6b1a-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-99c7dfb5c-6cqcn\" (UID: \"3d9bac04-b9b9-4c70-99c8-40d41efc6b1a\") " pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-6cqcn" Jul 01 19:24:41.435914 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:24:41.435793 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3d9bac04-b9b9-4c70-99c8-40d41efc6b1a-home\") pod \"facebook-opt-125m-simulated-kserve-99c7dfb5c-6cqcn\" (UID: \"3d9bac04-b9b9-4c70-99c8-40d41efc6b1a\") " pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-6cqcn" Jul 01 19:24:41.435914 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:24:41.435815 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3d9bac04-b9b9-4c70-99c8-40d41efc6b1a-model-cache\") pod \"facebook-opt-125m-simulated-kserve-99c7dfb5c-6cqcn\" (UID: \"3d9bac04-b9b9-4c70-99c8-40d41efc6b1a\") " pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-6cqcn" Jul 01 19:24:41.436232 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:24:41.436204 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3d9bac04-b9b9-4c70-99c8-40d41efc6b1a-model-cache\") pod \"facebook-opt-125m-simulated-kserve-99c7dfb5c-6cqcn\" (UID: \"3d9bac04-b9b9-4c70-99c8-40d41efc6b1a\") " pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-6cqcn" Jul 01 19:24:41.436355 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:24:41.436236 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3d9bac04-b9b9-4c70-99c8-40d41efc6b1a-home\") pod \"facebook-opt-125m-simulated-kserve-99c7dfb5c-6cqcn\" (UID: \"3d9bac04-b9b9-4c70-99c8-40d41efc6b1a\") " pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-6cqcn" Jul 01 19:24:41.437940 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:24:41.437921 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3d9bac04-b9b9-4c70-99c8-40d41efc6b1a-dshm\") pod \"facebook-opt-125m-simulated-kserve-99c7dfb5c-6cqcn\" (UID: \"3d9bac04-b9b9-4c70-99c8-40d41efc6b1a\") " pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-6cqcn" Jul 01 19:24:41.438456 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:24:41.438430 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3d9bac04-b9b9-4c70-99c8-40d41efc6b1a-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-99c7dfb5c-6cqcn\" (UID: \"3d9bac04-b9b9-4c70-99c8-40d41efc6b1a\") " pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-6cqcn" Jul 01 19:24:41.442800 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:24:41.442783 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jbj2r\" (UniqueName: \"kubernetes.io/projected/3d9bac04-b9b9-4c70-99c8-40d41efc6b1a-kube-api-access-jbj2r\") pod \"facebook-opt-125m-simulated-kserve-99c7dfb5c-6cqcn\" (UID: \"3d9bac04-b9b9-4c70-99c8-40d41efc6b1a\") " pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-6cqcn" Jul 01 19:24:41.597932 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:24:41.597850 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-6cqcn" Jul 01 19:24:41.733449 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:24:41.733418 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-6cqcn"] Jul 01 19:24:41.736449 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:24:41.736423 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d9bac04_b9b9_4c70_99c8_40d41efc6b1a.slice/crio-77573f3be1acb7ccc9fe79d5f5af2b0db01296066d66418e30cbbabcd00929bd WatchSource:0}: Error finding container 77573f3be1acb7ccc9fe79d5f5af2b0db01296066d66418e30cbbabcd00929bd: Status 404 returned error can't find the container with id 77573f3be1acb7ccc9fe79d5f5af2b0db01296066d66418e30cbbabcd00929bd Jul 01 19:24:42.352751 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:24:42.352704 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-6cqcn" event={"ID":"3d9bac04-b9b9-4c70-99c8-40d41efc6b1a","Type":"ContainerStarted","Data":"77573f3be1acb7ccc9fe79d5f5af2b0db01296066d66418e30cbbabcd00929bd"} Jul 01 19:24:43.359492 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:24:43.359458 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-6cqcn" event={"ID":"3d9bac04-b9b9-4c70-99c8-40d41efc6b1a","Type":"ContainerStarted","Data":"04f62ca3bb61dcfab82560ce2845979797b9984b5e91c8c8248c0855dbbd7fb5"} Jul 01 19:24:43.380767 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:24:43.380720 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-6cqcn" podStartSLOduration=1.294287619 podStartE2EDuration="2.380704658s" totalImagesPullingTime="1.086417039s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:24:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:24:43.37927189 +0000 UTC m=+789.887712709" watchObservedRunningTime="2026-07-01 19:24:43.380704658 +0000 UTC m=+789.889145744" Jul 01 19:24:51.598596 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:24:51.598565 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-6cqcn" Jul 01 19:24:51.599139 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:24:51.598723 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-6cqcn" Jul 01 19:24:51.611098 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:24:51.611073 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-6cqcn" Jul 01 19:24:52.412233 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:24:52.412206 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-6cqcn" Jul 01 19:24:58.194505 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:24:58.194429 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-fr4w9"] Jul 01 19:24:58.196884 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:24:58.196865 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-fr4w9" Jul 01 19:24:58.198924 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:24:58.198908 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jul 01 19:24:58.207042 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:24:58.207021 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-fr4w9"] Jul 01 19:24:58.382186 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:24:58.382156 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9pj5\" (UniqueName: \"kubernetes.io/projected/86276270-08b6-464e-954d-9047c48a1816-kube-api-access-q9pj5\") pod \"premium-simulated-simulated-premium-kserve-6cfb9f9b9c-fr4w9\" (UID: \"86276270-08b6-464e-954d-9047c48a1816\") " pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-fr4w9" Jul 01 19:24:58.382348 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:24:58.382264 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/86276270-08b6-464e-954d-9047c48a1816-home\") pod \"premium-simulated-simulated-premium-kserve-6cfb9f9b9c-fr4w9\" (UID: \"86276270-08b6-464e-954d-9047c48a1816\") " pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-fr4w9" Jul 01 19:24:58.382348 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:24:58.382293 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/86276270-08b6-464e-954d-9047c48a1816-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6cfb9f9b9c-fr4w9\" (UID: \"86276270-08b6-464e-954d-9047c48a1816\") " pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-fr4w9" Jul 01 19:24:58.382420 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:24:58.382341 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/86276270-08b6-464e-954d-9047c48a1816-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6cfb9f9b9c-fr4w9\" (UID: \"86276270-08b6-464e-954d-9047c48a1816\") " pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-fr4w9" Jul 01 19:24:58.382420 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:24:58.382373 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/86276270-08b6-464e-954d-9047c48a1816-dshm\") pod \"premium-simulated-simulated-premium-kserve-6cfb9f9b9c-fr4w9\" (UID: \"86276270-08b6-464e-954d-9047c48a1816\") " pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-fr4w9" Jul 01 19:24:58.483387 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:24:58.483307 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9pj5\" (UniqueName: \"kubernetes.io/projected/86276270-08b6-464e-954d-9047c48a1816-kube-api-access-q9pj5\") pod \"premium-simulated-simulated-premium-kserve-6cfb9f9b9c-fr4w9\" (UID: \"86276270-08b6-464e-954d-9047c48a1816\") " pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-fr4w9" Jul 01 19:24:58.483387 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:24:58.483359 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/86276270-08b6-464e-954d-9047c48a1816-home\") pod \"premium-simulated-simulated-premium-kserve-6cfb9f9b9c-fr4w9\" (UID: \"86276270-08b6-464e-954d-9047c48a1816\") " pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-fr4w9" Jul 01 19:24:58.483387 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:24:58.483384 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/86276270-08b6-464e-954d-9047c48a1816-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6cfb9f9b9c-fr4w9\" (UID: \"86276270-08b6-464e-954d-9047c48a1816\") " pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-fr4w9" Jul 01 19:24:58.483613 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:24:58.483417 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/86276270-08b6-464e-954d-9047c48a1816-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6cfb9f9b9c-fr4w9\" (UID: \"86276270-08b6-464e-954d-9047c48a1816\") " pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-fr4w9" Jul 01 19:24:58.483613 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:24:58.483439 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/86276270-08b6-464e-954d-9047c48a1816-dshm\") pod \"premium-simulated-simulated-premium-kserve-6cfb9f9b9c-fr4w9\" (UID: \"86276270-08b6-464e-954d-9047c48a1816\") " pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-fr4w9" Jul 01 19:24:58.483742 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:24:58.483724 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/86276270-08b6-464e-954d-9047c48a1816-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6cfb9f9b9c-fr4w9\" (UID: \"86276270-08b6-464e-954d-9047c48a1816\") " pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-fr4w9" Jul 01 19:24:58.483809 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:24:58.483792 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/86276270-08b6-464e-954d-9047c48a1816-home\") pod \"premium-simulated-simulated-premium-kserve-6cfb9f9b9c-fr4w9\" (UID: \"86276270-08b6-464e-954d-9047c48a1816\") " pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-fr4w9" Jul 01 19:24:58.485688 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:24:58.485659 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/86276270-08b6-464e-954d-9047c48a1816-dshm\") pod \"premium-simulated-simulated-premium-kserve-6cfb9f9b9c-fr4w9\" (UID: \"86276270-08b6-464e-954d-9047c48a1816\") " pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-fr4w9" Jul 01 19:24:58.485856 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:24:58.485837 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/86276270-08b6-464e-954d-9047c48a1816-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6cfb9f9b9c-fr4w9\" (UID: \"86276270-08b6-464e-954d-9047c48a1816\") " pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-fr4w9" Jul 01 19:24:58.496501 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:24:58.496472 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9pj5\" (UniqueName: \"kubernetes.io/projected/86276270-08b6-464e-954d-9047c48a1816-kube-api-access-q9pj5\") pod \"premium-simulated-simulated-premium-kserve-6cfb9f9b9c-fr4w9\" (UID: \"86276270-08b6-464e-954d-9047c48a1816\") " pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-fr4w9" Jul 01 19:24:58.506271 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:24:58.506253 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-fr4w9" Jul 01 19:24:58.644452 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:24:58.644428 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-fr4w9"] Jul 01 19:24:58.646369 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:24:58.646342 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod86276270_08b6_464e_954d_9047c48a1816.slice/crio-3431a6cdf6c79e1f94ca4ca65d4f39441433e4dd06c103449f30d50a9971b778 WatchSource:0}: Error finding container 3431a6cdf6c79e1f94ca4ca65d4f39441433e4dd06c103449f30d50a9971b778: Status 404 returned error can't find the container with id 3431a6cdf6c79e1f94ca4ca65d4f39441433e4dd06c103449f30d50a9971b778 Jul 01 19:24:59.435156 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:24:59.435122 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-fr4w9" event={"ID":"86276270-08b6-464e-954d-9047c48a1816","Type":"ContainerStarted","Data":"840ffedf31a02750d818f7a84bc10901ec70df8d80a0fb5a674f3a6122f55b6e"} Jul 01 19:24:59.435538 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:24:59.435167 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-fr4w9" event={"ID":"86276270-08b6-464e-954d-9047c48a1816","Type":"ContainerStarted","Data":"3431a6cdf6c79e1f94ca4ca65d4f39441433e4dd06c103449f30d50a9971b778"} Jul 01 19:24:59.457853 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:24:59.457806 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-fr4w9" podStartSLOduration=1.280337476 podStartE2EDuration="1.457789403s" totalImagesPullingTime="177.451927ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:24:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:24:59.457743957 +0000 UTC m=+805.966184785" watchObservedRunningTime="2026-07-01 19:24:59.457789403 +0000 UTC m=+805.966230228" Jul 01 19:25:08.506594 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:25:08.506562 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-fr4w9" Jul 01 19:25:08.507065 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:25:08.506629 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-fr4w9" Jul 01 19:25:08.519198 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:25:08.519177 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-fr4w9" Jul 01 19:25:09.500665 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:25:09.500639 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-fr4w9" Jul 01 19:26:07.020895 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:26:07.020860 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-98956bd7-vp49q"] Jul 01 19:26:07.024223 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:26:07.024200 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-98956bd7-vp49q" Jul 01 19:26:07.038227 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:26:07.038202 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-98956bd7-vp49q"] Jul 01 19:26:07.039642 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:26:07.039613 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bcd61f64-40b0-4679-8773-f4eeddbfc563-tls-cert\") pod \"authorino-98956bd7-vp49q\" (UID: \"bcd61f64-40b0-4679-8773-f4eeddbfc563\") " pod="kuadrant-system/authorino-98956bd7-vp49q" Jul 01 19:26:07.039739 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:26:07.039696 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/bcd61f64-40b0-4679-8773-f4eeddbfc563-oidc-ca\") pod \"authorino-98956bd7-vp49q\" (UID: \"bcd61f64-40b0-4679-8773-f4eeddbfc563\") " pod="kuadrant-system/authorino-98956bd7-vp49q" Jul 01 19:26:07.039851 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:26:07.039819 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vz2vq\" (UniqueName: \"kubernetes.io/projected/bcd61f64-40b0-4679-8773-f4eeddbfc563-kube-api-access-vz2vq\") pod \"authorino-98956bd7-vp49q\" (UID: \"bcd61f64-40b0-4679-8773-f4eeddbfc563\") " pod="kuadrant-system/authorino-98956bd7-vp49q" Jul 01 19:26:07.140783 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:26:07.140750 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bcd61f64-40b0-4679-8773-f4eeddbfc563-tls-cert\") pod \"authorino-98956bd7-vp49q\" (UID: \"bcd61f64-40b0-4679-8773-f4eeddbfc563\") " pod="kuadrant-system/authorino-98956bd7-vp49q" Jul 01 19:26:07.140978 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:26:07.140793 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/bcd61f64-40b0-4679-8773-f4eeddbfc563-oidc-ca\") pod \"authorino-98956bd7-vp49q\" (UID: \"bcd61f64-40b0-4679-8773-f4eeddbfc563\") " pod="kuadrant-system/authorino-98956bd7-vp49q" Jul 01 19:26:07.140978 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:26:07.140838 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vz2vq\" (UniqueName: \"kubernetes.io/projected/bcd61f64-40b0-4679-8773-f4eeddbfc563-kube-api-access-vz2vq\") pod \"authorino-98956bd7-vp49q\" (UID: \"bcd61f64-40b0-4679-8773-f4eeddbfc563\") " pod="kuadrant-system/authorino-98956bd7-vp49q" Jul 01 19:26:07.141541 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:26:07.141509 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/bcd61f64-40b0-4679-8773-f4eeddbfc563-oidc-ca\") pod \"authorino-98956bd7-vp49q\" (UID: \"bcd61f64-40b0-4679-8773-f4eeddbfc563\") " pod="kuadrant-system/authorino-98956bd7-vp49q" Jul 01 19:26:07.143277 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:26:07.143249 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bcd61f64-40b0-4679-8773-f4eeddbfc563-tls-cert\") pod \"authorino-98956bd7-vp49q\" (UID: \"bcd61f64-40b0-4679-8773-f4eeddbfc563\") " pod="kuadrant-system/authorino-98956bd7-vp49q" Jul 01 19:26:07.148978 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:26:07.148929 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vz2vq\" (UniqueName: \"kubernetes.io/projected/bcd61f64-40b0-4679-8773-f4eeddbfc563-kube-api-access-vz2vq\") pod \"authorino-98956bd7-vp49q\" (UID: \"bcd61f64-40b0-4679-8773-f4eeddbfc563\") " pod="kuadrant-system/authorino-98956bd7-vp49q" Jul 01 19:26:07.332851 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:26:07.332778 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-98956bd7-vp49q" Jul 01 19:26:07.480041 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:26:07.480020 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-98956bd7-vp49q"] Jul 01 19:26:07.482052 ip-10-0-131-184 kubenswrapper[2561]: W0701 19:26:07.482023 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbcd61f64_40b0_4679_8773_f4eeddbfc563.slice/crio-2d451b47d2f124f4342cc31a7ff8dec184d7ccdc038da92a056c727c27f957ae WatchSource:0}: Error finding container 2d451b47d2f124f4342cc31a7ff8dec184d7ccdc038da92a056c727c27f957ae: Status 404 returned error can't find the container with id 2d451b47d2f124f4342cc31a7ff8dec184d7ccdc038da92a056c727c27f957ae Jul 01 19:26:07.763657 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:26:07.763617 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-98956bd7-vp49q" event={"ID":"bcd61f64-40b0-4679-8773-f4eeddbfc563","Type":"ContainerStarted","Data":"2d451b47d2f124f4342cc31a7ff8dec184d7ccdc038da92a056c727c27f957ae"} Jul 01 19:26:08.772757 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:26:08.772712 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-98956bd7-vp49q" event={"ID":"bcd61f64-40b0-4679-8773-f4eeddbfc563","Type":"ContainerStarted","Data":"37e04e1421f92cd3657b096782c9e6fa5397c492d88e256ddd3c05764fc4176a"} Jul 01 19:26:08.792520 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:26:08.792471 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-98956bd7-vp49q" podStartSLOduration=1.354874921 podStartE2EDuration="1.79245424s" totalImagesPullingTime="437.579319ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:26:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:26:08.792244409 +0000 UTC m=+875.300685235" watchObservedRunningTime="2026-07-01 19:26:08.79245424 +0000 UTC m=+875.300895068" Jul 01 19:26:08.837232 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:26:08.837200 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8547d876b-kvfv7"] Jul 01 19:26:08.837468 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:26:08.837428 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-8547d876b-kvfv7" podUID="ec59cceb-3b42-440f-8d6e-f2f7038ac7da" containerName="authorino" containerID="cri-o://eca877d97b3318d0e319bb213d96ac2388e920fbd751d3847feb74a1a54ce32d" gracePeriod=30 Jul 01 19:26:09.102864 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:26:09.102830 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8547d876b-kvfv7" Jul 01 19:26:09.158220 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:26:09.158193 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qgrrp\" (UniqueName: \"kubernetes.io/projected/ec59cceb-3b42-440f-8d6e-f2f7038ac7da-kube-api-access-qgrrp\") pod \"ec59cceb-3b42-440f-8d6e-f2f7038ac7da\" (UID: \"ec59cceb-3b42-440f-8d6e-f2f7038ac7da\") " Jul 01 19:26:09.160287 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:26:09.160257 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec59cceb-3b42-440f-8d6e-f2f7038ac7da-kube-api-access-qgrrp" (OuterVolumeSpecName: "kube-api-access-qgrrp") pod "ec59cceb-3b42-440f-8d6e-f2f7038ac7da" (UID: "ec59cceb-3b42-440f-8d6e-f2f7038ac7da"). InnerVolumeSpecName "kube-api-access-qgrrp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 19:26:09.259222 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:26:09.259186 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/ec59cceb-3b42-440f-8d6e-f2f7038ac7da-oidc-ca\") pod \"ec59cceb-3b42-440f-8d6e-f2f7038ac7da\" (UID: \"ec59cceb-3b42-440f-8d6e-f2f7038ac7da\") " Jul 01 19:26:09.259375 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:26:09.259229 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ec59cceb-3b42-440f-8d6e-f2f7038ac7da-tls-cert\") pod \"ec59cceb-3b42-440f-8d6e-f2f7038ac7da\" (UID: \"ec59cceb-3b42-440f-8d6e-f2f7038ac7da\") " Jul 01 19:26:09.259469 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:26:09.259452 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qgrrp\" (UniqueName: \"kubernetes.io/projected/ec59cceb-3b42-440f-8d6e-f2f7038ac7da-kube-api-access-qgrrp\") on node \"ip-10-0-131-184.ec2.internal\" DevicePath \"\"" Jul 01 19:26:09.264204 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:26:09.264167 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ec59cceb-3b42-440f-8d6e-f2f7038ac7da-oidc-ca" (OuterVolumeSpecName: "oidc-ca") pod "ec59cceb-3b42-440f-8d6e-f2f7038ac7da" (UID: "ec59cceb-3b42-440f-8d6e-f2f7038ac7da"). InnerVolumeSpecName "oidc-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 19:26:09.269289 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:26:09.269266 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ec59cceb-3b42-440f-8d6e-f2f7038ac7da-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "ec59cceb-3b42-440f-8d6e-f2f7038ac7da" (UID: "ec59cceb-3b42-440f-8d6e-f2f7038ac7da"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 19:26:09.359918 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:26:09.359845 2561 reconciler_common.go:299] "Volume detached for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/ec59cceb-3b42-440f-8d6e-f2f7038ac7da-oidc-ca\") on node \"ip-10-0-131-184.ec2.internal\" DevicePath \"\"" Jul 01 19:26:09.359918 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:26:09.359870 2561 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ec59cceb-3b42-440f-8d6e-f2f7038ac7da-tls-cert\") on node \"ip-10-0-131-184.ec2.internal\" DevicePath \"\"" Jul 01 19:26:09.778785 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:26:09.778748 2561 generic.go:356] "Generic (PLEG): container finished" podID="ec59cceb-3b42-440f-8d6e-f2f7038ac7da" containerID="eca877d97b3318d0e319bb213d96ac2388e920fbd751d3847feb74a1a54ce32d" exitCode=0 Jul 01 19:26:09.779229 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:26:09.778807 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8547d876b-kvfv7" Jul 01 19:26:09.779229 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:26:09.778821 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8547d876b-kvfv7" event={"ID":"ec59cceb-3b42-440f-8d6e-f2f7038ac7da","Type":"ContainerDied","Data":"eca877d97b3318d0e319bb213d96ac2388e920fbd751d3847feb74a1a54ce32d"} Jul 01 19:26:09.779229 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:26:09.778862 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8547d876b-kvfv7" event={"ID":"ec59cceb-3b42-440f-8d6e-f2f7038ac7da","Type":"ContainerDied","Data":"d015ee1b1683c1555cd34d4ce780359a73dc85aa5d714f422dd71aa5bfca92bb"} Jul 01 19:26:09.779229 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:26:09.778877 2561 scope.go:117] "RemoveContainer" containerID="eca877d97b3318d0e319bb213d96ac2388e920fbd751d3847feb74a1a54ce32d" Jul 01 19:26:09.787338 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:26:09.787321 2561 scope.go:117] "RemoveContainer" containerID="eca877d97b3318d0e319bb213d96ac2388e920fbd751d3847feb74a1a54ce32d" Jul 01 19:26:09.787567 ip-10-0-131-184 kubenswrapper[2561]: E0701 19:26:09.787549 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eca877d97b3318d0e319bb213d96ac2388e920fbd751d3847feb74a1a54ce32d\": container with ID starting with eca877d97b3318d0e319bb213d96ac2388e920fbd751d3847feb74a1a54ce32d not found: ID does not exist" containerID="eca877d97b3318d0e319bb213d96ac2388e920fbd751d3847feb74a1a54ce32d" Jul 01 19:26:09.787603 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:26:09.787573 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eca877d97b3318d0e319bb213d96ac2388e920fbd751d3847feb74a1a54ce32d"} err="failed to get container status \"eca877d97b3318d0e319bb213d96ac2388e920fbd751d3847feb74a1a54ce32d\": rpc error: code = NotFound desc = could not find container \"eca877d97b3318d0e319bb213d96ac2388e920fbd751d3847feb74a1a54ce32d\": container with ID starting with eca877d97b3318d0e319bb213d96ac2388e920fbd751d3847feb74a1a54ce32d not found: ID does not exist" Jul 01 19:26:09.798969 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:26:09.798925 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8547d876b-kvfv7"] Jul 01 19:26:09.803215 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:26:09.803196 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-8547d876b-kvfv7"] Jul 01 19:26:09.978023 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:26:09.977992 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ec59cceb-3b42-440f-8d6e-f2f7038ac7da" path="/var/lib/kubelet/pods/ec59cceb-3b42-440f-8d6e-f2f7038ac7da/volumes" Jul 01 19:26:33.979077 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:26:33.979007 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p4nbs_9315c387-a14c-4926-969a-64945926951e/ovn-acl-logging/0.log" Jul 01 19:26:33.982124 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:26:33.982101 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p4nbs_9315c387-a14c-4926-969a-64945926951e/ovn-acl-logging/0.log" Jul 01 19:26:52.290670 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:26:52.290641 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-98956bd7-vp49q_bcd61f64-40b0-4679-8773-f4eeddbfc563/authorino/0.log" Jul 01 19:26:56.650928 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:26:56.650897 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-6cfb579549-6x4pr_c0beece7-0b95-458c-858e-f3fab30e2dbe/nginx/0.log" Jul 01 19:26:56.873538 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:26:56.873504 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-9wbnq_21b9abac-b9e5-411c-a3d2-4caa2898b751/manager/0.log" Jul 01 19:26:56.989477 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:26:56.989445 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-7k5vl_8b3a266c-af35-44a7-8bbb-6c6082edf7e0/manager/0.log" Jul 01 19:26:57.334793 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:26:57.334724 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-qjt29_1bf74f91-32ee-4f16-ae74-71e41d8b26f4/server/0.log" Jul 01 19:26:57.447214 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:26:57.447175 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-cn22b_6d351df0-b1af-440b-b2fe-57ffbd83e9ec/manager/0.log" Jul 01 19:26:57.804768 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:26:57.804744 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-85b6b744df-j9fss_2f3ddb48-2aa3-4ebe-b8c0-639d4e67fad2/manager/0.log" Jul 01 19:26:57.811392 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:26:57.811371 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-85b6b744df-j9fss_2f3ddb48-2aa3-4ebe-b8c0-639d4e67fad2/copy-manifests/0.log" Jul 01 19:26:57.922272 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:26:57.922232 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-6f8dm_9e02d052-4bd7-46f2-baa5-2086282e7538/postgres/0.log" Jul 01 19:26:59.181519 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:26:59.181491 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-98956bd7-vp49q_bcd61f64-40b0-4679-8773-f4eeddbfc563/authorino/0.log" Jul 01 19:26:59.302562 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:26:59.302518 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-4fvzp_04ce2fb2-a08b-4908-bf3b-41bc6916be3c/manager/0.log" Jul 01 19:26:59.409187 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:26:59.409158 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-jbljx_4274774b-a705-4110-93e8-bdf8eaaae520/manager/0.log" Jul 01 19:26:59.632620 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:26:59.632582 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-7tnk8_26b21b53-2ea2-4753-87ce-9f50e7fc1bd8/registry-server/0.log" Jul 01 19:26:59.754488 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:26:59.754456 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-fmzlh_87ae6bc6-95a0-4479-8644-0d5b352573b2/manager/0.log" Jul 01 19:27:00.014650 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:27:00.014621 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-4dhv6_f26a1bee-ce9d-4c1a-9a6f-710e289abed2/manager/0.log" Jul 01 19:27:00.714116 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:27:00.714082 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-658989848c-f6zvw_8e1bd454-c549-4dcc-8d9a-3456621bac6d/kube-auth-proxy/0.log" Jul 01 19:27:01.973676 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:27:01.973645 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-99c7dfb5c-6cqcn_3d9bac04-b9b9-4c70-99c8-40d41efc6b1a/main/0.log" Jul 01 19:27:02.091025 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:27:02.090998 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-6cfb9f9b9c-fr4w9_86276270-08b6-464e-954d-9047c48a1816/main/0.log" Jul 01 19:27:09.773344 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:27:09.773318 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-2x822_7329e3ea-d499-46e5-8c07-935a27d6ab99/global-pull-secret-syncer/0.log" Jul 01 19:27:09.992339 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:27:09.992315 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-wqk2n_193abea0-56eb-4a19-a2a1-6d72265b07e6/konnectivity-agent/0.log" Jul 01 19:27:10.014747 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:27:10.014723 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-131-184.ec2.internal_66ca3bff8df40f7aecc6da1d0afc4ccd/haproxy/0.log" Jul 01 19:27:14.951335 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:27:14.951310 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-98956bd7-vp49q_bcd61f64-40b0-4679-8773-f4eeddbfc563/authorino/0.log" Jul 01 19:27:14.998570 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:27:14.998545 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-4fvzp_04ce2fb2-a08b-4908-bf3b-41bc6916be3c/manager/0.log" Jul 01 19:27:15.023155 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:27:15.023133 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-jbljx_4274774b-a705-4110-93e8-bdf8eaaae520/manager/0.log" Jul 01 19:27:15.087725 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:27:15.087698 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-7tnk8_26b21b53-2ea2-4753-87ce-9f50e7fc1bd8/registry-server/0.log" Jul 01 19:27:15.125576 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:27:15.125550 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-fmzlh_87ae6bc6-95a0-4479-8644-0d5b352573b2/manager/0.log" Jul 01 19:27:15.193841 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:27:15.193813 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-4dhv6_f26a1bee-ce9d-4c1a-9a6f-710e289abed2/manager/0.log" Jul 01 19:27:17.470272 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:27:17.470245 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-sjfkk_777c82cb-7aad-4c05-bfd3-a6159b3ea69f/node-exporter/0.log" Jul 01 19:27:17.525706 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:27:17.525681 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-sjfkk_777c82cb-7aad-4c05-bfd3-a6159b3ea69f/kube-rbac-proxy/0.log" Jul 01 19:27:17.597373 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:27:17.597350 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-sjfkk_777c82cb-7aad-4c05-bfd3-a6159b3ea69f/init-textfile/0.log" Jul 01 19:27:19.638489 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:27:19.638464 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6cdb5968b9-pznw2_892a8a50-8bf0-43e5-adc3-613a9dd16e33/networking-console-plugin/0.log" Jul 01 19:27:20.204112 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:27:20.204082 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-tj2n4/perf-node-gather-daemonset-6ktg8"] Jul 01 19:27:20.204441 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:27:20.204429 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec59cceb-3b42-440f-8d6e-f2f7038ac7da" containerName="authorino" Jul 01 19:27:20.204484 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:27:20.204442 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec59cceb-3b42-440f-8d6e-f2f7038ac7da" containerName="authorino" Jul 01 19:27:20.204525 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:27:20.204516 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec59cceb-3b42-440f-8d6e-f2f7038ac7da" containerName="authorino" Jul 01 19:27:20.207582 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:27:20.207563 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-tj2n4/perf-node-gather-daemonset-6ktg8" Jul 01 19:27:20.209380 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:27:20.209356 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-tj2n4\"/\"openshift-service-ca.crt\"" Jul 01 19:27:20.209506 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:27:20.209418 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-tj2n4\"/\"kube-root-ca.crt\"" Jul 01 19:27:20.209720 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:27:20.209706 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-tj2n4\"/\"default-dockercfg-bh6ct\"" Jul 01 19:27:20.216398 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:27:20.216378 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-tj2n4/perf-node-gather-daemonset-6ktg8"] Jul 01 19:27:20.319754 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:27:20.319723 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/08d9dcd0-7050-479c-a311-ec6894f686ea-sys\") pod \"perf-node-gather-daemonset-6ktg8\" (UID: \"08d9dcd0-7050-479c-a311-ec6894f686ea\") " pod="openshift-must-gather-tj2n4/perf-node-gather-daemonset-6ktg8" Jul 01 19:27:20.319928 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:27:20.319789 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/08d9dcd0-7050-479c-a311-ec6894f686ea-proc\") pod \"perf-node-gather-daemonset-6ktg8\" (UID: \"08d9dcd0-7050-479c-a311-ec6894f686ea\") " pod="openshift-must-gather-tj2n4/perf-node-gather-daemonset-6ktg8" Jul 01 19:27:20.319928 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:27:20.319826 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/08d9dcd0-7050-479c-a311-ec6894f686ea-lib-modules\") pod \"perf-node-gather-daemonset-6ktg8\" (UID: \"08d9dcd0-7050-479c-a311-ec6894f686ea\") " pod="openshift-must-gather-tj2n4/perf-node-gather-daemonset-6ktg8" Jul 01 19:27:20.319928 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:27:20.319856 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jlsvn\" (UniqueName: \"kubernetes.io/projected/08d9dcd0-7050-479c-a311-ec6894f686ea-kube-api-access-jlsvn\") pod \"perf-node-gather-daemonset-6ktg8\" (UID: \"08d9dcd0-7050-479c-a311-ec6894f686ea\") " pod="openshift-must-gather-tj2n4/perf-node-gather-daemonset-6ktg8" Jul 01 19:27:20.319928 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:27:20.319884 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/08d9dcd0-7050-479c-a311-ec6894f686ea-podres\") pod \"perf-node-gather-daemonset-6ktg8\" (UID: \"08d9dcd0-7050-479c-a311-ec6894f686ea\") " pod="openshift-must-gather-tj2n4/perf-node-gather-daemonset-6ktg8" Jul 01 19:27:20.420800 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:27:20.420771 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/08d9dcd0-7050-479c-a311-ec6894f686ea-proc\") pod \"perf-node-gather-daemonset-6ktg8\" (UID: \"08d9dcd0-7050-479c-a311-ec6894f686ea\") " pod="openshift-must-gather-tj2n4/perf-node-gather-daemonset-6ktg8" Jul 01 19:27:20.421028 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:27:20.420815 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/08d9dcd0-7050-479c-a311-ec6894f686ea-lib-modules\") pod \"perf-node-gather-daemonset-6ktg8\" (UID: \"08d9dcd0-7050-479c-a311-ec6894f686ea\") " pod="openshift-must-gather-tj2n4/perf-node-gather-daemonset-6ktg8" Jul 01 19:27:20.421028 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:27:20.420849 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jlsvn\" (UniqueName: \"kubernetes.io/projected/08d9dcd0-7050-479c-a311-ec6894f686ea-kube-api-access-jlsvn\") pod \"perf-node-gather-daemonset-6ktg8\" (UID: \"08d9dcd0-7050-479c-a311-ec6894f686ea\") " pod="openshift-must-gather-tj2n4/perf-node-gather-daemonset-6ktg8" Jul 01 19:27:20.421028 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:27:20.420871 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/08d9dcd0-7050-479c-a311-ec6894f686ea-podres\") pod \"perf-node-gather-daemonset-6ktg8\" (UID: \"08d9dcd0-7050-479c-a311-ec6894f686ea\") " pod="openshift-must-gather-tj2n4/perf-node-gather-daemonset-6ktg8" Jul 01 19:27:20.421028 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:27:20.420894 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/08d9dcd0-7050-479c-a311-ec6894f686ea-proc\") pod \"perf-node-gather-daemonset-6ktg8\" (UID: \"08d9dcd0-7050-479c-a311-ec6894f686ea\") " pod="openshift-must-gather-tj2n4/perf-node-gather-daemonset-6ktg8" Jul 01 19:27:20.421028 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:27:20.420930 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/08d9dcd0-7050-479c-a311-ec6894f686ea-sys\") pod \"perf-node-gather-daemonset-6ktg8\" (UID: \"08d9dcd0-7050-479c-a311-ec6894f686ea\") " pod="openshift-must-gather-tj2n4/perf-node-gather-daemonset-6ktg8" Jul 01 19:27:20.421221 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:27:20.421025 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/08d9dcd0-7050-479c-a311-ec6894f686ea-lib-modules\") pod \"perf-node-gather-daemonset-6ktg8\" (UID: \"08d9dcd0-7050-479c-a311-ec6894f686ea\") " pod="openshift-must-gather-tj2n4/perf-node-gather-daemonset-6ktg8" Jul 01 19:27:20.421221 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:27:20.421039 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/08d9dcd0-7050-479c-a311-ec6894f686ea-sys\") pod \"perf-node-gather-daemonset-6ktg8\" (UID: \"08d9dcd0-7050-479c-a311-ec6894f686ea\") " pod="openshift-must-gather-tj2n4/perf-node-gather-daemonset-6ktg8" Jul 01 19:27:20.421221 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:27:20.421078 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/08d9dcd0-7050-479c-a311-ec6894f686ea-podres\") pod \"perf-node-gather-daemonset-6ktg8\" (UID: \"08d9dcd0-7050-479c-a311-ec6894f686ea\") " pod="openshift-must-gather-tj2n4/perf-node-gather-daemonset-6ktg8" Jul 01 19:27:20.429150 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:27:20.429127 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jlsvn\" (UniqueName: \"kubernetes.io/projected/08d9dcd0-7050-479c-a311-ec6894f686ea-kube-api-access-jlsvn\") pod \"perf-node-gather-daemonset-6ktg8\" (UID: \"08d9dcd0-7050-479c-a311-ec6894f686ea\") " pod="openshift-must-gather-tj2n4/perf-node-gather-daemonset-6ktg8" Jul 01 19:27:20.517700 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:27:20.517632 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-tj2n4/perf-node-gather-daemonset-6ktg8" Jul 01 19:27:20.658122 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:27:20.658085 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-tj2n4/perf-node-gather-daemonset-6ktg8"] Jul 01 19:27:21.133559 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:27:21.133521 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tj2n4/perf-node-gather-daemonset-6ktg8" event={"ID":"08d9dcd0-7050-479c-a311-ec6894f686ea","Type":"ContainerStarted","Data":"3c988b3fb9576ddbf885f736b209b5517e38b3915246bf440f33a263c1710aa2"} Jul 01 19:27:21.133745 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:27:21.133580 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tj2n4/perf-node-gather-daemonset-6ktg8" event={"ID":"08d9dcd0-7050-479c-a311-ec6894f686ea","Type":"ContainerStarted","Data":"576f59897cfef2099ed323de82a2b8d66e1d017cc6e582ceb0ac000d70e29fc6"} Jul 01 19:27:21.133745 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:27:21.133632 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-tj2n4/perf-node-gather-daemonset-6ktg8" Jul 01 19:27:21.149726 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:27:21.149685 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-tj2n4/perf-node-gather-daemonset-6ktg8" podStartSLOduration=1.149671999 podStartE2EDuration="1.149671999s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:27:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:27:21.148772788 +0000 UTC m=+947.657213614" watchObservedRunningTime="2026-07-01 19:27:21.149671999 +0000 UTC m=+947.658112824" Jul 01 19:27:22.556683 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:27:22.556655 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qndfd_85b15dc5-328c-41ea-adc4-c0b8fb36d860/dns/0.log" Jul 01 19:27:22.588881 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:27:22.588856 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qndfd_85b15dc5-328c-41ea-adc4-c0b8fb36d860/kube-rbac-proxy/0.log" Jul 01 19:27:22.728707 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:27:22.728674 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-rkh5s_defe52c5-ead5-443a-a79e-6357cf3ce6f2/dns-node-resolver/0.log" Jul 01 19:27:23.289969 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:27:23.289935 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-86b6c6f876-9bvzg_e1817756-11b6-4955-b3b3-db0279608fe2/registry/0.log" Jul 01 19:27:23.323103 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:27:23.323080 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-5bfhm_8747f708-8d08-4b9b-a6f5-5f6a637ed029/node-ca/0.log" Jul 01 19:27:24.483651 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:27:24.483624 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-658989848c-f6zvw_8e1bd454-c549-4dcc-8d9a-3456621bac6d/kube-auth-proxy/0.log" Jul 01 19:27:25.287559 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:27:25.287530 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-8lhz2_ae718365-8e7b-426d-90ad-74d93647bb51/serve-healthcheck-canary/0.log" Jul 01 19:27:25.837280 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:27:25.837248 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5f67b55555-cjsn9_dee2c113-9b3a-469d-af6a-c85146b4bf98/insights-operator/1.log" Jul 01 19:27:25.837724 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:27:25.837362 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5f67b55555-cjsn9_dee2c113-9b3a-469d-af6a-c85146b4bf98/insights-operator/0.log" Jul 01 19:27:26.048941 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:27:26.048917 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zp5ps_43534a28-eb76-425e-8c8f-bbb00ab5df95/kube-rbac-proxy/0.log" Jul 01 19:27:26.079066 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:27:26.079042 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zp5ps_43534a28-eb76-425e-8c8f-bbb00ab5df95/exporter/0.log" Jul 01 19:27:26.104785 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:27:26.104726 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zp5ps_43534a28-eb76-425e-8c8f-bbb00ab5df95/extractor/0.log" Jul 01 19:27:27.148679 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:27:27.148654 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-tj2n4/perf-node-gather-daemonset-6ktg8" Jul 01 19:27:28.368328 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:27:28.368303 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-6cfb579549-6x4pr_c0beece7-0b95-458c-858e-f3fab30e2dbe/nginx/0.log" Jul 01 19:27:28.430752 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:27:28.430727 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-9wbnq_21b9abac-b9e5-411c-a3d2-4caa2898b751/manager/0.log" Jul 01 19:27:28.476461 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:27:28.476435 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-7k5vl_8b3a266c-af35-44a7-8bbb-6c6082edf7e0/manager/0.log" Jul 01 19:27:28.597058 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:27:28.597036 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-qjt29_1bf74f91-32ee-4f16-ae74-71e41d8b26f4/server/0.log" Jul 01 19:27:28.657477 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:27:28.657413 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-cn22b_6d351df0-b1af-440b-b2fe-57ffbd83e9ec/manager/0.log" Jul 01 19:27:28.859182 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:27:28.859156 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-85b6b744df-j9fss_2f3ddb48-2aa3-4ebe-b8c0-639d4e67fad2/manager/0.log" Jul 01 19:27:28.893178 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:27:28.893154 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-85b6b744df-j9fss_2f3ddb48-2aa3-4ebe-b8c0-639d4e67fad2/copy-manifests/0.log" Jul 01 19:27:28.930282 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:27:28.930194 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-6f8dm_9e02d052-4bd7-46f2-baa5-2086282e7538/postgres/0.log" Jul 01 19:27:30.824506 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:27:30.824478 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-658989848c-f6zvw_8e1bd454-c549-4dcc-8d9a-3456621bac6d/kube-auth-proxy/0.log" Jul 01 19:27:32.211561 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:27:32.211535 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-658989848c-f6zvw_8e1bd454-c549-4dcc-8d9a-3456621bac6d/kube-auth-proxy/0.log" Jul 01 19:27:35.648062 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:27:35.648023 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-786f9fbc5-vf6jb_8fedee21-609d-4861-8716-4a0d30506016/migrator/0.log" Jul 01 19:27:35.675820 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:27:35.675780 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-786f9fbc5-vf6jb_8fedee21-609d-4861-8716-4a0d30506016/graceful-termination/0.log" Jul 01 19:27:36.067583 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:27:36.067549 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-79964ff6f9-lkj58_ebf9d613-2590-4a63-8890-fbca3d5fc32c/kube-storage-version-migrator-operator/1.log" Jul 01 19:27:36.068412 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:27:36.068394 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-79964ff6f9-lkj58_ebf9d613-2590-4a63-8890-fbca3d5fc32c/kube-storage-version-migrator-operator/0.log" Jul 01 19:27:37.163012 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:27:37.162987 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vcrsx_5dd67e73-cf2f-4415-88d5-9e42762cb4d3/kube-multus-additional-cni-plugins/0.log" Jul 01 19:27:37.191023 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:27:37.190998 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vcrsx_5dd67e73-cf2f-4415-88d5-9e42762cb4d3/egress-router-binary-copy/0.log" Jul 01 19:27:37.223536 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:27:37.223512 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vcrsx_5dd67e73-cf2f-4415-88d5-9e42762cb4d3/cni-plugins/0.log" Jul 01 19:27:37.249227 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:27:37.249197 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vcrsx_5dd67e73-cf2f-4415-88d5-9e42762cb4d3/bond-cni-plugin/0.log" Jul 01 19:27:37.273531 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:27:37.273512 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vcrsx_5dd67e73-cf2f-4415-88d5-9e42762cb4d3/routeoverride-cni/0.log" Jul 01 19:27:37.298972 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:27:37.298930 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vcrsx_5dd67e73-cf2f-4415-88d5-9e42762cb4d3/whereabouts-cni-bincopy/0.log" Jul 01 19:27:37.325530 ip-10-0-131-184 kubenswrapper[2561]: I0701 19:27:37.325511 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vcrsx_5dd67e73-cf2f-4415-88d5-9e42762cb4d3/whereabouts-cni/0.log"