Jul 02 23:04:59.495618 ip-10-0-131-33 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 02 23:04:59.495629 ip-10-0-131-33 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 02 23:04:59.495636 ip-10-0-131-33 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 02 23:04:59.495884 ip-10-0-131-33 systemd[1]: Failed to start Kubernetes Kubelet. Jul 02 23:05:09.506705 ip-10-0-131-33 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 02 23:05:09.506721 ip-10-0-131-33 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 632ef4f0740946cebd3d2bf8cb9151ed -- Jul 02 23:07:02.113099 ip-10-0-131-33 systemd[1]: Starting Kubernetes Kubelet... Jul 02 23:07:02.469281 ip-10-0-131-33 kubenswrapper[2563]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 02 23:07:02.469281 ip-10-0-131-33 kubenswrapper[2563]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 02 23:07:02.469281 ip-10-0-131-33 kubenswrapper[2563]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 02 23:07:02.469281 ip-10-0-131-33 kubenswrapper[2563]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 02 23:07:02.469281 ip-10-0-131-33 kubenswrapper[2563]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 02 23:07:02.471182 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.471097 2563 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 02 23:07:02.476401 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.476385 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 23:07:02.476401 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.476400 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 23:07:02.476464 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.476405 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 23:07:02.476464 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.476408 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 23:07:02.476464 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.476411 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 23:07:02.476464 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.476414 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 23:07:02.476464 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.476418 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 23:07:02.476464 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.476421 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 23:07:02.476464 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.476424 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 23:07:02.476464 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.476426 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 23:07:02.476464 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.476434 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 23:07:02.476464 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.476437 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 23:07:02.476464 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.476440 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 23:07:02.476464 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.476442 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 23:07:02.476464 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.476445 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 23:07:02.476464 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.476447 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 23:07:02.476464 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.476450 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 23:07:02.476464 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.476453 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 23:07:02.476464 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.476455 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 23:07:02.476464 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.476458 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 23:07:02.476464 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.476460 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 23:07:02.476929 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.476463 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 23:07:02.476929 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.476465 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 23:07:02.476929 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.476468 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 23:07:02.476929 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.476471 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 23:07:02.476929 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.476473 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 23:07:02.476929 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.476476 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 23:07:02.476929 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.476479 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 23:07:02.476929 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.476481 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 23:07:02.476929 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.476484 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 23:07:02.476929 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.476487 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 23:07:02.476929 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.476489 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 23:07:02.476929 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.476492 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 23:07:02.476929 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.476494 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 23:07:02.476929 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.476497 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 23:07:02.476929 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.476499 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 23:07:02.476929 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.476502 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 23:07:02.476929 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.476504 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 23:07:02.476929 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.476507 2563 feature_gate.go:328] unrecognized feature gate: Example Jul 02 23:07:02.476929 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.476510 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 23:07:02.476929 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.476512 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 23:07:02.476929 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.476515 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 23:07:02.477441 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.476517 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 23:07:02.477441 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.476519 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 23:07:02.477441 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.476522 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 23:07:02.477441 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.476524 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 23:07:02.477441 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.476527 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 23:07:02.477441 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.476529 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 23:07:02.477441 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.476531 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 23:07:02.477441 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.476534 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 23:07:02.477441 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.476537 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 23:07:02.477441 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.476540 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 23:07:02.477441 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.476542 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 23:07:02.477441 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.476544 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 23:07:02.477441 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.476548 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 23:07:02.477441 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.476550 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 23:07:02.477441 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.476553 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 23:07:02.477441 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.476555 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 23:07:02.477441 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.476558 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 23:07:02.477441 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.476561 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 23:07:02.477441 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.476563 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 23:07:02.477441 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.476565 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 23:07:02.478007 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.476568 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 23:07:02.478007 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.476570 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 23:07:02.478007 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.476573 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 23:07:02.478007 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.476575 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 23:07:02.478007 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.476577 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 23:07:02.478007 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.476580 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 23:07:02.478007 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.476585 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 23:07:02.478007 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.476588 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 23:07:02.478007 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.476591 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 23:07:02.478007 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.476595 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 23:07:02.478007 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.476598 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 23:07:02.478007 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.476602 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 23:07:02.478007 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.476605 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 23:07:02.478007 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.476608 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 23:07:02.478007 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.476610 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 23:07:02.478007 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.476613 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 23:07:02.478007 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.476615 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 23:07:02.478007 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.476618 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 23:07:02.478007 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.476620 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 23:07:02.478477 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.476623 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 23:07:02.478477 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.476626 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 23:07:02.478477 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.476629 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 23:07:02.478477 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.476631 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 23:07:02.478477 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.476634 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 23:07:02.478477 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.476637 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 23:07:02.478477 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.476640 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 23:07:02.478477 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.476643 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 23:07:02.478477 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.476647 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 23:07:02.478477 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.476650 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 23:07:02.478477 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.476652 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 23:07:02.478477 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.476655 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 23:07:02.478477 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.476657 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 23:07:02.478477 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.476660 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 23:07:02.478477 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.476662 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 23:07:02.478477 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.476665 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 23:07:02.478477 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.476667 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 23:07:02.478477 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.476670 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 23:07:02.478477 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.477365 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 23:07:02.478477 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.477371 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 23:07:02.478982 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.477374 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 23:07:02.478982 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.477377 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 23:07:02.478982 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.477380 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 23:07:02.478982 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.477383 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 23:07:02.478982 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.477386 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 23:07:02.478982 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.477388 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 23:07:02.478982 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.477391 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 23:07:02.478982 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.477394 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 23:07:02.478982 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.477396 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 23:07:02.478982 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.477399 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 23:07:02.478982 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.477401 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 23:07:02.478982 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.477403 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 23:07:02.478982 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.477406 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 23:07:02.478982 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.477409 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 23:07:02.478982 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.477412 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 23:07:02.478982 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.477414 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 23:07:02.478982 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.477417 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 23:07:02.478982 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.477420 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 23:07:02.478982 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.477422 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 23:07:02.479455 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.477425 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 23:07:02.479455 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.477428 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 23:07:02.479455 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.477430 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 23:07:02.479455 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.477433 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 23:07:02.479455 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.477435 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 23:07:02.479455 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.477437 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 23:07:02.479455 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.477440 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 23:07:02.479455 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.477442 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 23:07:02.479455 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.477445 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 23:07:02.479455 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.477447 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 23:07:02.479455 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.477450 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 23:07:02.479455 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.477453 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 23:07:02.479455 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.477455 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 23:07:02.479455 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.477458 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 23:07:02.479455 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.477461 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 23:07:02.479455 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.477463 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 23:07:02.479455 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.477466 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 23:07:02.479455 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.477469 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 23:07:02.479455 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.477471 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 23:07:02.479455 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.477474 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 23:07:02.479959 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.477476 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 23:07:02.479959 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.477479 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 23:07:02.479959 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.477481 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 23:07:02.479959 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.477484 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 23:07:02.479959 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.477486 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 23:07:02.479959 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.477489 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 23:07:02.479959 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.477495 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 23:07:02.479959 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.477498 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 23:07:02.479959 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.477501 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 23:07:02.479959 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.477503 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 23:07:02.479959 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.477506 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 23:07:02.479959 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.477508 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 23:07:02.479959 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.477511 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 23:07:02.479959 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.477513 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 23:07:02.479959 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.477516 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 23:07:02.479959 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.477521 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 23:07:02.479959 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.477524 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 23:07:02.479959 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.477527 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 23:07:02.479959 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.477530 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 23:07:02.480416 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.477533 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 23:07:02.480416 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.477536 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 23:07:02.480416 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.477539 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 23:07:02.480416 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.477541 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 23:07:02.480416 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.477544 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 23:07:02.480416 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.477547 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 23:07:02.480416 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.477549 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 23:07:02.480416 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.477552 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 23:07:02.480416 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.477555 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 23:07:02.480416 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.477557 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 23:07:02.480416 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.477561 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 23:07:02.480416 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.477565 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 23:07:02.480416 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.477568 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 23:07:02.480416 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.477571 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 23:07:02.480416 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.477573 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 23:07:02.480416 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.477576 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 23:07:02.480416 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.477578 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 23:07:02.480416 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.477581 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 23:07:02.480416 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.477583 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 23:07:02.480416 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.477587 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 23:07:02.480920 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.477590 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 23:07:02.480920 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.477592 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 23:07:02.480920 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.477595 2563 feature_gate.go:328] unrecognized feature gate: Example Jul 02 23:07:02.480920 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.477597 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 23:07:02.480920 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.477600 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 23:07:02.480920 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.477602 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 23:07:02.480920 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.477605 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 23:07:02.480920 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.477607 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 23:07:02.480920 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.477610 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 23:07:02.480920 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.477612 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 23:07:02.480920 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.477617 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 23:07:02.480920 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.477620 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 23:07:02.480920 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.477622 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 23:07:02.480920 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.477625 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 23:07:02.480920 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.477627 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 23:07:02.480920 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.477630 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 23:07:02.480920 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.477632 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 23:07:02.480920 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.477635 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 23:07:02.480920 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.477638 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 23:07:02.480920 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.478037 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 23:07:02.481416 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.478043 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 23:07:02.481416 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.478046 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 23:07:02.481416 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.478049 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 23:07:02.481416 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.478053 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 23:07:02.481416 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.478056 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 23:07:02.481416 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.478058 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 23:07:02.481416 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.478061 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 23:07:02.481416 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.478064 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 23:07:02.481416 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.478066 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 23:07:02.481416 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.478069 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 23:07:02.481416 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.478071 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 23:07:02.481416 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.478075 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 23:07:02.481416 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.478078 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 23:07:02.481416 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.478080 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 23:07:02.481416 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.478083 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 23:07:02.481416 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.478087 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 23:07:02.481416 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.478091 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 23:07:02.481416 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.478094 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 23:07:02.481416 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.478096 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 23:07:02.481416 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.478099 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 23:07:02.481932 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.478102 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 23:07:02.481932 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.478105 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 23:07:02.481932 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.478108 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 23:07:02.481932 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.478110 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 23:07:02.481932 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.478113 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 23:07:02.481932 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.478115 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 23:07:02.481932 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.478120 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 23:07:02.481932 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.478122 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 23:07:02.481932 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.478125 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 23:07:02.481932 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.478127 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 23:07:02.481932 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.478130 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 23:07:02.481932 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.478132 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 23:07:02.481932 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.478134 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 23:07:02.481932 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.478137 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 23:07:02.481932 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.478139 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 23:07:02.481932 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.478141 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 23:07:02.481932 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.478144 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 23:07:02.481932 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.478147 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 23:07:02.481932 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.478149 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 23:07:02.481932 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.478152 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 23:07:02.482449 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.478155 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 23:07:02.482449 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.478158 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 23:07:02.482449 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.478160 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 23:07:02.482449 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.478164 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 23:07:02.482449 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.478166 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 23:07:02.482449 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.478169 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 23:07:02.482449 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.478171 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 23:07:02.482449 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.478173 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 23:07:02.482449 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.478176 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 23:07:02.482449 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.478179 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 23:07:02.482449 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.478181 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 23:07:02.482449 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.478183 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 23:07:02.482449 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.478186 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 23:07:02.482449 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.478188 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 23:07:02.482449 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.478191 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 23:07:02.482449 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.478193 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 23:07:02.482449 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.478196 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 23:07:02.482449 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.478198 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 23:07:02.482449 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.478202 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 23:07:02.482449 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.478204 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 23:07:02.482939 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.478208 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 23:07:02.482939 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.478211 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 23:07:02.482939 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.478214 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 23:07:02.482939 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.478216 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 23:07:02.482939 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.478219 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 23:07:02.482939 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.478222 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 23:07:02.482939 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.478224 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 23:07:02.482939 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.478227 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 23:07:02.482939 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.478230 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 23:07:02.482939 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.478232 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 23:07:02.482939 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.478235 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 23:07:02.482939 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.478238 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 23:07:02.482939 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.478240 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 23:07:02.482939 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.478242 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 23:07:02.482939 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.478245 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 23:07:02.482939 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.478249 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 23:07:02.482939 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.478251 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 23:07:02.482939 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.478253 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 23:07:02.482939 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.478256 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 23:07:02.483386 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.478259 2563 feature_gate.go:328] unrecognized feature gate: Example Jul 02 23:07:02.483386 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.478261 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 23:07:02.483386 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.478264 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 23:07:02.483386 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.478267 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 23:07:02.483386 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.478270 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 23:07:02.483386 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.478272 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 23:07:02.483386 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.478274 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 23:07:02.483386 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.478277 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 23:07:02.483386 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.478281 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 23:07:02.483386 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.478284 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 23:07:02.483386 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.478287 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 23:07:02.483386 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.478293 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 23:07:02.483386 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.478296 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 23:07:02.483386 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.478298 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 23:07:02.483386 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.478301 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 23:07:02.483386 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.478303 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 23:07:02.483386 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.478305 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 23:07:02.483386 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.478308 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 23:07:02.483386 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.478310 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 23:07:02.483386 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478376 2563 flags.go:64] FLAG: --address="0.0.0.0" Jul 02 23:07:02.483912 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478383 2563 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 02 23:07:02.483912 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478389 2563 flags.go:64] FLAG: --anonymous-auth="true" Jul 02 23:07:02.483912 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478393 2563 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 02 23:07:02.483912 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478397 2563 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 02 23:07:02.483912 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478401 2563 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 02 23:07:02.483912 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478404 2563 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 02 23:07:02.483912 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478408 2563 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 02 23:07:02.483912 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478411 2563 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 02 23:07:02.483912 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478416 2563 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 02 23:07:02.483912 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478419 2563 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 02 23:07:02.483912 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478422 2563 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 02 23:07:02.483912 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478425 2563 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 02 23:07:02.483912 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478428 2563 flags.go:64] FLAG: --cgroup-root="" Jul 02 23:07:02.483912 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478431 2563 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 02 23:07:02.483912 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478434 2563 flags.go:64] FLAG: --client-ca-file="" Jul 02 23:07:02.483912 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478437 2563 flags.go:64] FLAG: --cloud-provider="external" Jul 02 23:07:02.483912 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478439 2563 flags.go:64] FLAG: --cluster-dns="[]" Jul 02 23:07:02.483912 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478443 2563 flags.go:64] FLAG: --cluster-domain="" Jul 02 23:07:02.483912 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478446 2563 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 02 23:07:02.483912 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478449 2563 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 02 23:07:02.483912 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478452 2563 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 02 23:07:02.483912 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478455 2563 flags.go:64] FLAG: --container-log-max-files="5" Jul 02 23:07:02.483912 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478459 2563 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 02 23:07:02.483912 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478462 2563 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 02 23:07:02.484517 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478466 2563 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 02 23:07:02.484517 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478469 2563 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 02 23:07:02.484517 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478472 2563 flags.go:64] FLAG: --contention-profiling="false" Jul 02 23:07:02.484517 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478474 2563 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 02 23:07:02.484517 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478477 2563 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 02 23:07:02.484517 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478480 2563 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 02 23:07:02.484517 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478483 2563 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 02 23:07:02.484517 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478487 2563 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 02 23:07:02.484517 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478490 2563 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 02 23:07:02.484517 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478493 2563 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 02 23:07:02.484517 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478496 2563 flags.go:64] FLAG: --enable-load-reader="false" Jul 02 23:07:02.484517 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478499 2563 flags.go:64] FLAG: --enable-server="true" Jul 02 23:07:02.484517 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478502 2563 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 02 23:07:02.484517 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478506 2563 flags.go:64] FLAG: --event-burst="100" Jul 02 23:07:02.484517 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478509 2563 flags.go:64] FLAG: --event-qps="50" Jul 02 23:07:02.484517 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478512 2563 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 02 23:07:02.484517 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478516 2563 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 02 23:07:02.484517 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478519 2563 flags.go:64] FLAG: --eviction-hard="" Jul 02 23:07:02.484517 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478522 2563 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 02 23:07:02.484517 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478525 2563 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 02 23:07:02.484517 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478528 2563 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 02 23:07:02.484517 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478531 2563 flags.go:64] FLAG: --eviction-soft="" Jul 02 23:07:02.484517 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478534 2563 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 02 23:07:02.484517 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478536 2563 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 02 23:07:02.484517 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478539 2563 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 02 23:07:02.485194 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478542 2563 flags.go:64] FLAG: --experimental-mounter-path="" Jul 02 23:07:02.485194 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478545 2563 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 02 23:07:02.485194 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478547 2563 flags.go:64] FLAG: --fail-swap-on="true" Jul 02 23:07:02.485194 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478550 2563 flags.go:64] FLAG: --feature-gates="" Jul 02 23:07:02.485194 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478554 2563 flags.go:64] FLAG: --file-check-frequency="20s" Jul 02 23:07:02.485194 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478557 2563 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 02 23:07:02.485194 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478561 2563 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 02 23:07:02.485194 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478564 2563 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 02 23:07:02.485194 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478567 2563 flags.go:64] FLAG: --healthz-port="10248" Jul 02 23:07:02.485194 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478570 2563 flags.go:64] FLAG: --help="false" Jul 02 23:07:02.485194 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478572 2563 flags.go:64] FLAG: --hostname-override="ip-10-0-131-33.ec2.internal" Jul 02 23:07:02.485194 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478575 2563 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 02 23:07:02.485194 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478578 2563 flags.go:64] FLAG: --http-check-frequency="20s" Jul 02 23:07:02.485194 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478581 2563 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 02 23:07:02.485194 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478584 2563 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 02 23:07:02.485194 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478587 2563 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 02 23:07:02.485194 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478589 2563 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 02 23:07:02.485194 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478592 2563 flags.go:64] FLAG: --image-service-endpoint="" Jul 02 23:07:02.485194 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478595 2563 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 02 23:07:02.485194 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478597 2563 flags.go:64] FLAG: --kube-api-burst="100" Jul 02 23:07:02.485194 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478601 2563 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 02 23:07:02.485194 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478604 2563 flags.go:64] FLAG: --kube-api-qps="50" Jul 02 23:07:02.485194 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478607 2563 flags.go:64] FLAG: --kube-reserved="" Jul 02 23:07:02.485194 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478611 2563 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 02 23:07:02.485774 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478614 2563 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 02 23:07:02.485774 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478617 2563 flags.go:64] FLAG: --kubelet-cgroups="" Jul 02 23:07:02.485774 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478619 2563 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 02 23:07:02.485774 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478622 2563 flags.go:64] FLAG: --lock-file="" Jul 02 23:07:02.485774 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478625 2563 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 02 23:07:02.485774 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478628 2563 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 02 23:07:02.485774 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478631 2563 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 02 23:07:02.485774 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478636 2563 flags.go:64] FLAG: --log-json-split-stream="false" Jul 02 23:07:02.485774 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478639 2563 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 02 23:07:02.485774 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478641 2563 flags.go:64] FLAG: --log-text-split-stream="false" Jul 02 23:07:02.485774 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478644 2563 flags.go:64] FLAG: --logging-format="text" Jul 02 23:07:02.485774 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478647 2563 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 02 23:07:02.485774 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478650 2563 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 02 23:07:02.485774 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478652 2563 flags.go:64] FLAG: --manifest-url="" Jul 02 23:07:02.485774 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478656 2563 flags.go:64] FLAG: --manifest-url-header="" Jul 02 23:07:02.485774 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478660 2563 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 02 23:07:02.485774 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478663 2563 flags.go:64] FLAG: --max-open-files="1000000" Jul 02 23:07:02.485774 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478667 2563 flags.go:64] FLAG: --max-pods="110" Jul 02 23:07:02.485774 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478670 2563 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 02 23:07:02.485774 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478672 2563 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 02 23:07:02.485774 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478676 2563 flags.go:64] FLAG: --memory-manager-policy="None" Jul 02 23:07:02.485774 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478678 2563 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 02 23:07:02.485774 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478681 2563 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 02 23:07:02.485774 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478684 2563 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 02 23:07:02.485774 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478687 2563 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 02 23:07:02.486406 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478694 2563 flags.go:64] FLAG: --node-status-max-images="50" Jul 02 23:07:02.486406 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478696 2563 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 02 23:07:02.486406 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478700 2563 flags.go:64] FLAG: --oom-score-adj="-999" Jul 02 23:07:02.486406 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478702 2563 flags.go:64] FLAG: --pod-cidr="" Jul 02 23:07:02.486406 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478706 2563 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 02 23:07:02.486406 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478711 2563 flags.go:64] FLAG: --pod-manifest-path="" Jul 02 23:07:02.486406 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478714 2563 flags.go:64] FLAG: --pod-max-pids="-1" Jul 02 23:07:02.486406 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478719 2563 flags.go:64] FLAG: --pods-per-core="0" Jul 02 23:07:02.486406 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478722 2563 flags.go:64] FLAG: --port="10250" Jul 02 23:07:02.486406 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478725 2563 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 02 23:07:02.486406 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478727 2563 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-048077aa73f90cb69" Jul 02 23:07:02.486406 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478730 2563 flags.go:64] FLAG: --qos-reserved="" Jul 02 23:07:02.486406 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478733 2563 flags.go:64] FLAG: --read-only-port="10255" Jul 02 23:07:02.486406 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478736 2563 flags.go:64] FLAG: --register-node="true" Jul 02 23:07:02.486406 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478739 2563 flags.go:64] FLAG: --register-with-taints="" Jul 02 23:07:02.486406 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478742 2563 flags.go:64] FLAG: --registry-burst="10" Jul 02 23:07:02.486406 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478745 2563 flags.go:64] FLAG: --registry-qps="5" Jul 02 23:07:02.486406 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478748 2563 flags.go:64] FLAG: --reserved-cpus="" Jul 02 23:07:02.486406 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478751 2563 flags.go:64] FLAG: --reserved-memory="" Jul 02 23:07:02.486406 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478754 2563 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 02 23:07:02.486406 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478757 2563 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 02 23:07:02.486406 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478761 2563 flags.go:64] FLAG: --rotate-certificates="false" Jul 02 23:07:02.486406 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478764 2563 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 02 23:07:02.486406 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478766 2563 flags.go:64] FLAG: --runonce="false" Jul 02 23:07:02.486406 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478769 2563 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 02 23:07:02.487089 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478772 2563 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 02 23:07:02.487089 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478775 2563 flags.go:64] FLAG: --seccomp-default="false" Jul 02 23:07:02.487089 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478778 2563 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 02 23:07:02.487089 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478780 2563 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 02 23:07:02.487089 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478783 2563 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 02 23:07:02.487089 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478786 2563 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 02 23:07:02.487089 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478789 2563 flags.go:64] FLAG: --storage-driver-password="root" Jul 02 23:07:02.487089 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478792 2563 flags.go:64] FLAG: --storage-driver-secure="false" Jul 02 23:07:02.487089 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478795 2563 flags.go:64] FLAG: --storage-driver-table="stats" Jul 02 23:07:02.487089 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478797 2563 flags.go:64] FLAG: --storage-driver-user="root" Jul 02 23:07:02.487089 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478800 2563 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 02 23:07:02.487089 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478803 2563 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 02 23:07:02.487089 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478806 2563 flags.go:64] FLAG: --system-cgroups="" Jul 02 23:07:02.487089 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478809 2563 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 02 23:07:02.487089 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478831 2563 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 02 23:07:02.487089 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478834 2563 flags.go:64] FLAG: --tls-cert-file="" Jul 02 23:07:02.487089 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478837 2563 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 02 23:07:02.487089 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478840 2563 flags.go:64] FLAG: --tls-min-version="" Jul 02 23:07:02.487089 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478843 2563 flags.go:64] FLAG: --tls-private-key-file="" Jul 02 23:07:02.487089 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478846 2563 flags.go:64] FLAG: --topology-manager-policy="none" Jul 02 23:07:02.487089 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478848 2563 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 02 23:07:02.487089 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478851 2563 flags.go:64] FLAG: --topology-manager-scope="container" Jul 02 23:07:02.487089 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478854 2563 flags.go:64] FLAG: --v="2" Jul 02 23:07:02.487089 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478858 2563 flags.go:64] FLAG: --version="false" Jul 02 23:07:02.487089 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478861 2563 flags.go:64] FLAG: --vmodule="" Jul 02 23:07:02.487684 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478865 2563 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 02 23:07:02.487684 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.478868 2563 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 02 23:07:02.487684 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.478978 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 23:07:02.487684 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.478985 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 23:07:02.487684 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.478988 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 23:07:02.487684 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.478991 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 23:07:02.487684 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.478994 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 23:07:02.487684 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.478997 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 23:07:02.487684 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.479000 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 23:07:02.487684 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.479003 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 23:07:02.487684 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.479005 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 23:07:02.487684 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.479008 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 23:07:02.487684 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.479011 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 23:07:02.487684 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.479013 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 23:07:02.487684 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.479016 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 23:07:02.487684 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.479020 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 23:07:02.487684 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.479023 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 23:07:02.487684 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.479026 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 23:07:02.487684 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.479028 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 23:07:02.487684 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.479031 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 23:07:02.488197 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.479034 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 23:07:02.488197 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.479037 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 23:07:02.488197 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.479039 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 23:07:02.488197 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.479042 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 23:07:02.488197 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.479044 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 23:07:02.488197 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.479047 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 23:07:02.488197 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.479049 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 23:07:02.488197 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.479052 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 23:07:02.488197 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.479054 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 23:07:02.488197 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.479057 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 23:07:02.488197 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.479059 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 23:07:02.488197 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.479061 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 23:07:02.488197 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.479063 2563 feature_gate.go:328] unrecognized feature gate: Example Jul 02 23:07:02.488197 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.479066 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 23:07:02.488197 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.479068 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 23:07:02.488197 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.479072 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 23:07:02.488197 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.479075 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 23:07:02.488197 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.479079 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 23:07:02.488197 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.479081 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 23:07:02.488197 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.479084 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 23:07:02.489076 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.479087 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 23:07:02.489076 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.479090 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 23:07:02.489076 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.479092 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 23:07:02.489076 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.479095 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 23:07:02.489076 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.479097 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 23:07:02.489076 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.479100 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 23:07:02.489076 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.479102 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 23:07:02.489076 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.479104 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 23:07:02.489076 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.479106 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 23:07:02.489076 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.479109 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 23:07:02.489076 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.479111 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 23:07:02.489076 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.479114 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 23:07:02.489076 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.479116 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 23:07:02.489076 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.479119 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 23:07:02.489076 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.479122 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 23:07:02.489076 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.479125 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 23:07:02.489076 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.479127 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 23:07:02.489076 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.479129 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 23:07:02.489076 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.479132 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 23:07:02.489662 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.479134 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 23:07:02.489662 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.479137 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 23:07:02.489662 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.479140 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 23:07:02.489662 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.479142 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 23:07:02.489662 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.479144 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 23:07:02.489662 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.479147 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 23:07:02.489662 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.479149 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 23:07:02.489662 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.479152 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 23:07:02.489662 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.479156 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 23:07:02.489662 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.479158 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 23:07:02.489662 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.479161 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 23:07:02.489662 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.479163 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 23:07:02.489662 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.479166 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 23:07:02.489662 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.479168 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 23:07:02.489662 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.479171 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 23:07:02.489662 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.479173 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 23:07:02.489662 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.479176 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 23:07:02.489662 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.479179 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 23:07:02.489662 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.479181 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 23:07:02.489662 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.479183 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 23:07:02.490181 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.479186 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 23:07:02.490181 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.479188 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 23:07:02.490181 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.479190 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 23:07:02.490181 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.479193 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 23:07:02.490181 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.479195 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 23:07:02.490181 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.479198 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 23:07:02.490181 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.479200 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 23:07:02.490181 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.479203 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 23:07:02.490181 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.479206 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 23:07:02.490181 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.479208 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 23:07:02.490181 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.479211 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 23:07:02.490181 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.479213 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 23:07:02.490181 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.479215 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 23:07:02.490181 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.479218 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 23:07:02.490181 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.479220 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 23:07:02.490181 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.479222 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 23:07:02.490181 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.479225 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 23:07:02.490181 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.479227 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 23:07:02.490181 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.479230 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 23:07:02.490181 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.479233 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 23:07:02.490699 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.479237 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 23:07:02.490699 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.479240 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 23:07:02.490699 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.479248 2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 02 23:07:02.490699 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.485833 2563 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 02 23:07:02.490699 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.485849 2563 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 02 23:07:02.490699 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.485865 2563 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 02 23:07:02.490699 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.485871 2563 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 02 23:07:02.490699 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.485926 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 23:07:02.490699 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.485930 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 23:07:02.490699 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.485934 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 23:07:02.490699 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.485937 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 23:07:02.490699 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.485939 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 23:07:02.490699 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.485942 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 23:07:02.490699 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.485945 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 23:07:02.491151 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.485947 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 23:07:02.491151 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.485950 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 23:07:02.491151 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.485953 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 23:07:02.491151 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.485955 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 23:07:02.491151 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.485958 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 23:07:02.491151 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.485960 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 23:07:02.491151 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.485963 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 23:07:02.491151 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.485966 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 23:07:02.491151 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.485968 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 23:07:02.491151 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.485970 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 23:07:02.491151 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.485973 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 23:07:02.491151 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.485975 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 23:07:02.491151 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.485978 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 23:07:02.491151 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.485980 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 23:07:02.491151 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.485982 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 23:07:02.491151 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.485985 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 23:07:02.491151 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.485987 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 23:07:02.491151 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.485990 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 23:07:02.491151 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.485992 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 23:07:02.491151 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.485995 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 23:07:02.491628 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.485997 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 23:07:02.491628 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486000 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 23:07:02.491628 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486005 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 23:07:02.491628 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486007 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 23:07:02.491628 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486010 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 23:07:02.491628 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486012 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 23:07:02.491628 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486015 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 23:07:02.491628 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486017 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 23:07:02.491628 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486020 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 23:07:02.491628 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486022 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 23:07:02.491628 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486024 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 23:07:02.491628 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486027 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 23:07:02.491628 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486029 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 23:07:02.491628 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486032 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 23:07:02.491628 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486034 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 23:07:02.491628 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486036 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 23:07:02.491628 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486039 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 23:07:02.491628 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486041 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 23:07:02.491628 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486043 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 23:07:02.491628 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486047 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 23:07:02.492122 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486049 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 23:07:02.492122 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486052 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 23:07:02.492122 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486054 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 23:07:02.492122 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486057 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 23:07:02.492122 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486060 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 23:07:02.492122 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486062 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 23:07:02.492122 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486065 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 23:07:02.492122 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486067 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 23:07:02.492122 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486070 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 23:07:02.492122 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486072 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 23:07:02.492122 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486075 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 23:07:02.492122 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486077 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 23:07:02.492122 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486079 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 23:07:02.492122 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486082 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 23:07:02.492122 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486085 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 23:07:02.492122 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486089 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 23:07:02.492122 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486093 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 23:07:02.492122 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486096 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 23:07:02.492122 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486099 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 23:07:02.492122 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486102 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 23:07:02.492610 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486105 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 23:07:02.492610 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486107 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 23:07:02.492610 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486110 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 23:07:02.492610 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486112 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 23:07:02.492610 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486115 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 23:07:02.492610 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486118 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 23:07:02.492610 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486120 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 23:07:02.492610 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486123 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 23:07:02.492610 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486125 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 23:07:02.492610 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486129 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 23:07:02.492610 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486132 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 23:07:02.492610 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486135 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 23:07:02.492610 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486138 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 23:07:02.492610 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486142 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 23:07:02.492610 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486146 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 23:07:02.492610 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486149 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 23:07:02.492610 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486152 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 23:07:02.492610 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486155 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 23:07:02.492610 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486157 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 23:07:02.493070 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486159 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 23:07:02.493070 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486162 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 23:07:02.493070 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486164 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 23:07:02.493070 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486166 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 23:07:02.493070 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486169 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 23:07:02.493070 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486172 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 23:07:02.493070 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486174 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 23:07:02.493070 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486177 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 23:07:02.493070 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486180 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 23:07:02.493070 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486182 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 23:07:02.493070 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486185 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 23:07:02.493070 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486187 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 23:07:02.493070 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486190 2563 feature_gate.go:328] unrecognized feature gate: Example Jul 02 23:07:02.493070 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.486195 2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 02 23:07:02.493070 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486328 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 23:07:02.493451 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486333 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 23:07:02.493451 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486336 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 23:07:02.493451 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486339 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 23:07:02.493451 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486341 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 23:07:02.493451 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486344 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 23:07:02.493451 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486347 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 23:07:02.493451 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486349 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 23:07:02.493451 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486351 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 23:07:02.493451 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486355 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 23:07:02.493451 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486357 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 23:07:02.493451 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486361 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 23:07:02.493451 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486366 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 23:07:02.493451 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486369 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 23:07:02.493451 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486371 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 23:07:02.493451 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486374 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 23:07:02.493451 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486376 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 23:07:02.493451 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486378 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 23:07:02.493451 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486382 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 23:07:02.493451 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486385 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 23:07:02.493948 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486388 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 23:07:02.493948 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486391 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 23:07:02.493948 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486393 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 23:07:02.493948 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486396 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 23:07:02.493948 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486398 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 23:07:02.493948 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486401 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 23:07:02.493948 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486403 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 23:07:02.493948 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486406 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 23:07:02.493948 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486410 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 23:07:02.493948 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486413 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 23:07:02.493948 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486415 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 23:07:02.493948 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486417 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 23:07:02.493948 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486420 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 23:07:02.493948 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486423 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 23:07:02.493948 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486425 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 23:07:02.493948 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486428 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 23:07:02.493948 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486430 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 23:07:02.493948 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486433 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 23:07:02.493948 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486435 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 23:07:02.494433 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486438 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 23:07:02.494433 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486440 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 23:07:02.494433 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486443 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 23:07:02.494433 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486445 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 23:07:02.494433 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486447 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 23:07:02.494433 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486450 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 23:07:02.494433 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486452 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 23:07:02.494433 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486454 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 23:07:02.494433 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486457 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 23:07:02.494433 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486459 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 23:07:02.494433 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486461 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 23:07:02.494433 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486463 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 23:07:02.494433 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486466 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 23:07:02.494433 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486468 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 23:07:02.494433 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486471 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 23:07:02.494433 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486474 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 23:07:02.494433 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486477 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 23:07:02.494433 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486480 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 23:07:02.494433 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486483 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 23:07:02.494433 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486486 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 23:07:02.494969 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486489 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 23:07:02.494969 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486491 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 23:07:02.494969 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486494 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 23:07:02.494969 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486497 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 23:07:02.494969 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486499 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 23:07:02.494969 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486502 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 23:07:02.494969 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486504 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 23:07:02.494969 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486507 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 23:07:02.494969 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486509 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 23:07:02.494969 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486512 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 23:07:02.494969 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486515 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 23:07:02.494969 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486517 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 23:07:02.494969 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486519 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 23:07:02.494969 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486522 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 23:07:02.494969 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486525 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 23:07:02.494969 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486527 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 23:07:02.494969 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486529 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 23:07:02.494969 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486532 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 23:07:02.494969 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486534 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 23:07:02.494969 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486537 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 23:07:02.495556 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486539 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 23:07:02.495556 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486542 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 23:07:02.495556 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486544 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 23:07:02.495556 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486546 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 23:07:02.495556 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486549 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 23:07:02.495556 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486551 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 23:07:02.495556 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486554 2563 feature_gate.go:328] unrecognized feature gate: Example Jul 02 23:07:02.495556 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486556 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 23:07:02.495556 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486558 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 23:07:02.495556 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486561 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 23:07:02.495556 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486563 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 23:07:02.495556 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486566 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 23:07:02.495556 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486568 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 23:07:02.495556 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486571 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 23:07:02.495556 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486573 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 23:07:02.495556 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486577 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 23:07:02.495556 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486579 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 23:07:02.495556 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486581 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 23:07:02.495556 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486584 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 23:07:02.495556 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:02.486586 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 23:07:02.496145 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.486591 2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 02 23:07:02.496145 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.486705 2563 server.go:962] "Client rotation is on, will bootstrap in background" Jul 02 23:07:02.496145 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.490315 2563 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 02 23:07:02.496145 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.491793 2563 server.go:1019] "Starting client certificate rotation" Jul 02 23:07:02.496145 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.491851 2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 02 23:07:02.496145 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.491885 2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 02 23:07:02.496145 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.494022 2563 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 02 23:07:02.496145 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.495146 2563 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 02 23:07:02.504899 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.504884 2563 log.go:25] "Validated CRI v1 runtime API" Jul 02 23:07:02.509366 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.509351 2563 log.go:25] "Validated CRI v1 image API" Jul 02 23:07:02.510255 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.510233 2563 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 02 23:07:02.514122 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.514101 2563 fs.go:135] Filesystem UUIDs: map[1c1bcfd0-792e-4a3f-a78f-0abcafc55d8a:/dev/nvme0n1p4 47eb9c89-1567-4c1e-a2fa-f93742099f3b:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] Jul 02 23:07:02.514183 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.514120 2563 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 02 23:07:02.519055 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.518955 2563 manager.go:216] Machine: {Timestamp:2026-07-02 23:07:02.51848264 +0000 UTC m=+0.298444672 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3103639 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec218edfef4c1367faa656d45fb2e7fa SystemUUID:ec218edf-ef4c-1367-faa6-56d45fb2e7fa BootID:632ef4f0-7409-46ce-bd3d-2bf8cb9151ed Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:f8:8b:ea:2a:11 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:f8:8b:ea:2a:11 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:5a:0b:11:ba:38:76 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 02 23:07:02.519055 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.519047 2563 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 02 23:07:02.519195 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.519117 2563 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 02 23:07:02.522302 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.522272 2563 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 02 23:07:02.522440 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.522304 2563 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-33.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 02 23:07:02.523417 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.523407 2563 topology_manager.go:138] "Creating topology manager with none policy" Jul 02 23:07:02.523450 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.523421 2563 container_manager_linux.go:309] "Creating device plugin manager" Jul 02 23:07:02.523450 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.523433 2563 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 02 23:07:02.523884 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.523863 2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 02 23:07:02.523975 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.523962 2563 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 02 23:07:02.525166 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.525155 2563 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 02 23:07:02.527975 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.527963 2563 state_mem.go:36] "Initialized new in-memory state store" Jul 02 23:07:02.528095 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.528085 2563 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 02 23:07:02.528136 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.528113 2563 kubelet.go:486] "Attempting to sync node with API server" Jul 02 23:07:02.528136 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.528130 2563 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 02 23:07:02.528225 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.528144 2563 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 02 23:07:02.528225 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.528199 2563 kubelet.go:398] "Adding apiserver pod source" Jul 02 23:07:02.528225 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.528207 2563 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 02 23:07:02.528592 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.528581 2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 02 23:07:02.528628 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.528599 2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 02 23:07:02.531427 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.531404 2563 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 02 23:07:02.533182 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.533166 2563 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 02 23:07:02.533250 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.533196 2563 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 02 23:07:02.534177 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.534167 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 02 23:07:02.534213 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.534183 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 02 23:07:02.534213 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.534189 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 02 23:07:02.534213 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.534195 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 02 23:07:02.534213 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.534204 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 02 23:07:02.534213 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.534209 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 02 23:07:02.534348 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.534218 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 02 23:07:02.534348 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.534223 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 02 23:07:02.534348 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.534230 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 02 23:07:02.534348 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.534235 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 02 23:07:02.534348 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.534244 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 02 23:07:02.534348 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.534248 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 02 23:07:02.534914 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.534903 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 02 23:07:02.534914 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.534912 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 02 23:07:02.537961 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.537947 2563 server.go:1268] "Started kubelet" Jul 02 23:07:02.538083 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.538038 2563 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 02 23:07:02.538151 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.538106 2563 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 02 23:07:02.538206 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.538165 2563 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 02 23:07:02.538916 ip-10-0-131-33 systemd[1]: Started Kubernetes Kubelet. Jul 02 23:07:02.540856 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.540844 2563 server.go:310] "Adding debug handlers to kubelet server" Jul 02 23:07:02.541581 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:02.541522 2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 02 23:07:02.541679 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:02.541579 2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-131-33.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 02 23:07:02.541770 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.541753 2563 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-131-33.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 02 23:07:02.542476 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:02.542451 2563 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 02 23:07:02.542684 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.542668 2563 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 02 23:07:02.548548 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.548532 2563 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 02 23:07:02.548609 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.548538 2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 02 23:07:02.548698 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:02.548680 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-33.ec2.internal\" not found" Jul 02 23:07:02.549147 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:02.548172 2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-33.ec2.internal.18be9ba1fdf36550 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-33.ec2.internal,UID:ip-10-0-131-33.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-131-33.ec2.internal,},FirstTimestamp:2026-07-02 23:07:02.537921872 +0000 UTC m=+0.317883903,LastTimestamp:2026-07-02 23:07:02.537921872 +0000 UTC m=+0.317883903,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-33.ec2.internal,}" Jul 02 23:07:02.549432 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.549327 2563 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 02 23:07:02.549432 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.549346 2563 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 02 23:07:02.549432 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.549332 2563 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 02 23:07:02.549631 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.549459 2563 reconstruct.go:97] "Volume reconstruction finished" Jul 02 23:07:02.549631 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.549467 2563 reconciler.go:29] "Reconciler: start to sync state" Jul 02 23:07:02.549777 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.549736 2563 factory.go:55] Registering systemd factory Jul 02 23:07:02.549777 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.549750 2563 factory.go:223] Registration of the systemd container factory successfully Jul 02 23:07:02.551679 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.551661 2563 factory.go:153] Registering CRI-O factory Jul 02 23:07:02.551679 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.551677 2563 factory.go:223] Registration of the crio container factory successfully Jul 02 23:07:02.551810 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.551728 2563 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 02 23:07:02.551810 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.551750 2563 factory.go:103] Registering Raw factory Jul 02 23:07:02.551810 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.551765 2563 manager.go:1196] Started watching for new ooms in manager Jul 02 23:07:02.552212 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.552193 2563 manager.go:349] Starting recovery of all containers Jul 02 23:07:02.552324 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:02.552298 2563 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-131-33.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 02 23:07:02.552498 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:02.552477 2563 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 02 23:07:02.563640 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.563511 2563 manager.go:354] Recovery completed Jul 02 23:07:02.567750 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.567729 2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-jxxpw" Jul 02 23:07:02.567905 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.567887 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 23:07:02.569765 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.569752 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-33.ec2.internal" event="NodeHasSufficientMemory" Jul 02 23:07:02.569826 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.569777 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-33.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 23:07:02.569826 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.569787 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-33.ec2.internal" event="NodeHasSufficientPID" Jul 02 23:07:02.570279 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.570264 2563 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 02 23:07:02.570345 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.570279 2563 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 02 23:07:02.570345 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.570293 2563 state_mem.go:36] "Initialized new in-memory state store" Jul 02 23:07:02.570345 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.570331 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 23:07:02.571022 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.571008 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-33.ec2.internal" event="NodeHasSufficientMemory" Jul 02 23:07:02.571069 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.571034 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-33.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 23:07:02.571069 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.571047 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-33.ec2.internal" event="NodeHasSufficientPID" Jul 02 23:07:02.571627 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.571616 2563 policy_none.go:49] "None policy: Start" Jul 02 23:07:02.571684 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.571630 2563 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 02 23:07:02.571684 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.571644 2563 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 02 23:07:02.571835 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:02.571743 2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-33.ec2.internal.18be9ba1ffd94aab default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-33.ec2.internal,UID:ip-10-0-131-33.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-131-33.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-131-33.ec2.internal,},FirstTimestamp:2026-07-02 23:07:02.569765547 +0000 UTC m=+0.349727582,LastTimestamp:2026-07-02 23:07:02.569765547 +0000 UTC m=+0.349727582,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-33.ec2.internal,}" Jul 02 23:07:02.572679 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.572668 2563 policy_none.go:47] "Start" Jul 02 23:07:02.576486 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.576466 2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-jxxpw" Jul 02 23:07:02.604338 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.604324 2563 manager.go:337] "Starting Device Plugin manager" Jul 02 23:07:02.604429 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:02.604354 2563 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 02 23:07:02.604429 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.604364 2563 server.go:87] "Starting device plugin registration server" Jul 02 23:07:02.604615 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.604602 2563 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 02 23:07:02.604668 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.604619 2563 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 02 23:07:02.604710 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.604691 2563 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 02 23:07:02.604783 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.604770 2563 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 02 23:07:02.604850 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.604785 2563 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 02 23:07:02.605328 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:02.605308 2563 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 02 23:07:02.605426 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:02.605353 2563 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-33.ec2.internal\" not found" Jul 02 23:07:02.694259 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.694217 2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 02 23:07:02.695570 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.695556 2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 02 23:07:02.695640 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.695598 2563 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 02 23:07:02.695640 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.695625 2563 kubelet.go:2448] "Starting kubelet main sync loop" Jul 02 23:07:02.695731 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:02.695663 2563 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 02 23:07:02.698172 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.698154 2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 23:07:02.705188 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.705175 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 23:07:02.705966 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.705946 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-33.ec2.internal" event="NodeHasSufficientMemory" Jul 02 23:07:02.706066 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.705978 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-33.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 23:07:02.706066 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.705989 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-33.ec2.internal" event="NodeHasSufficientPID" Jul 02 23:07:02.706066 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.706012 2563 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-131-33.ec2.internal" Jul 02 23:07:02.712546 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.712532 2563 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-131-33.ec2.internal" Jul 02 23:07:02.712600 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:02.712552 2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-131-33.ec2.internal\": node \"ip-10-0-131-33.ec2.internal\" not found" Jul 02 23:07:02.738563 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:02.738507 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-33.ec2.internal\" not found" Jul 02 23:07:02.796477 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.796454 2563 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-33.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-131-33.ec2.internal"] Jul 02 23:07:02.796550 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.796530 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 23:07:02.798214 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.798200 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-33.ec2.internal" event="NodeHasSufficientMemory" Jul 02 23:07:02.798272 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.798227 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-33.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 23:07:02.798272 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.798237 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-33.ec2.internal" event="NodeHasSufficientPID" Jul 02 23:07:02.799555 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.799544 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 23:07:02.799674 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.799659 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-33.ec2.internal" Jul 02 23:07:02.799708 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.799697 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 23:07:02.800359 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.800342 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-33.ec2.internal" event="NodeHasSufficientMemory" Jul 02 23:07:02.800434 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.800350 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-33.ec2.internal" event="NodeHasSufficientMemory" Jul 02 23:07:02.800434 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.800399 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-33.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 23:07:02.800434 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.800411 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-33.ec2.internal" event="NodeHasSufficientPID" Jul 02 23:07:02.800624 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.800374 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-33.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 23:07:02.800624 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.800465 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-33.ec2.internal" event="NodeHasSufficientPID" Jul 02 23:07:02.801621 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.801605 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-33.ec2.internal" Jul 02 23:07:02.801698 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.801628 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 23:07:02.802305 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.802291 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-33.ec2.internal" event="NodeHasSufficientMemory" Jul 02 23:07:02.802375 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.802315 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-33.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 23:07:02.802375 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.802323 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-33.ec2.internal" event="NodeHasSufficientPID" Jul 02 23:07:02.832416 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:02.832398 2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-33.ec2.internal\" not found" node="ip-10-0-131-33.ec2.internal" Jul 02 23:07:02.836637 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:02.836621 2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-33.ec2.internal\" not found" node="ip-10-0-131-33.ec2.internal" Jul 02 23:07:02.838608 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:02.838594 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-33.ec2.internal\" not found" Jul 02 23:07:02.850846 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.850806 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9c4e7fa9daec587c25fb6cbf2b540d88-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-33.ec2.internal\" (UID: \"9c4e7fa9daec587c25fb6cbf2b540d88\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-33.ec2.internal" Jul 02 23:07:02.850903 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.850852 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9c4e7fa9daec587c25fb6cbf2b540d88-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-33.ec2.internal\" (UID: \"9c4e7fa9daec587c25fb6cbf2b540d88\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-33.ec2.internal" Jul 02 23:07:02.850903 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.850871 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/398da86d6561510d06f9aff443828ae1-config\") pod \"kube-apiserver-proxy-ip-10-0-131-33.ec2.internal\" (UID: \"398da86d6561510d06f9aff443828ae1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-33.ec2.internal" Jul 02 23:07:02.939539 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:02.939513 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-33.ec2.internal\" not found" Jul 02 23:07:02.951862 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.951838 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9c4e7fa9daec587c25fb6cbf2b540d88-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-33.ec2.internal\" (UID: \"9c4e7fa9daec587c25fb6cbf2b540d88\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-33.ec2.internal" Jul 02 23:07:02.951919 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.951871 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9c4e7fa9daec587c25fb6cbf2b540d88-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-33.ec2.internal\" (UID: \"9c4e7fa9daec587c25fb6cbf2b540d88\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-33.ec2.internal" Jul 02 23:07:02.951919 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.951888 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/398da86d6561510d06f9aff443828ae1-config\") pod \"kube-apiserver-proxy-ip-10-0-131-33.ec2.internal\" (UID: \"398da86d6561510d06f9aff443828ae1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-33.ec2.internal" Jul 02 23:07:02.951982 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.951922 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/398da86d6561510d06f9aff443828ae1-config\") pod \"kube-apiserver-proxy-ip-10-0-131-33.ec2.internal\" (UID: \"398da86d6561510d06f9aff443828ae1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-33.ec2.internal" Jul 02 23:07:02.951982 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.951924 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9c4e7fa9daec587c25fb6cbf2b540d88-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-33.ec2.internal\" (UID: \"9c4e7fa9daec587c25fb6cbf2b540d88\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-33.ec2.internal" Jul 02 23:07:02.951982 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:02.951951 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9c4e7fa9daec587c25fb6cbf2b540d88-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-33.ec2.internal\" (UID: \"9c4e7fa9daec587c25fb6cbf2b540d88\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-33.ec2.internal" Jul 02 23:07:03.040351 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:03.040277 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-33.ec2.internal\" not found" Jul 02 23:07:03.135853 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:03.135788 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-33.ec2.internal" Jul 02 23:07:03.140091 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:03.139697 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-33.ec2.internal" Jul 02 23:07:03.140766 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:03.140750 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-33.ec2.internal\" not found" Jul 02 23:07:03.241115 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:03.241077 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-33.ec2.internal\" not found" Jul 02 23:07:03.341688 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:03.341630 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-33.ec2.internal\" not found" Jul 02 23:07:04.589273 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:04.589252 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-33.ec2.internal\" not found" Jul 02 23:07:04.638698 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:04.638674 2563 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 02 23:07:04.639148 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:04.638817 2563 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 02 23:07:04.689326 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:04.689302 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-33.ec2.internal\" not found" Jul 02 23:07:04.725543 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:04.725514 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-01 23:02:03 +0000 UTC" deadline="2028-04-08 07:15:49.394288796 +0000 UTC" Jul 02 23:07:04.725543 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:04.725539 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15488h8m44.668753106s" Jul 02 23:07:04.789824 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:04.789797 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-33.ec2.internal\" not found" Jul 02 23:07:04.859086 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:04.859057 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c4e7fa9daec587c25fb6cbf2b540d88.slice/crio-8d0668f9682971b671687e9ab4d7074db1ba0bddf40d3de346a61d1ca735e73f WatchSource:0}: Error finding container 8d0668f9682971b671687e9ab4d7074db1ba0bddf40d3de346a61d1ca735e73f: Status 404 returned error can't find the container with id 8d0668f9682971b671687e9ab4d7074db1ba0bddf40d3de346a61d1ca735e73f Jul 02 23:07:04.859535 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:04.859519 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod398da86d6561510d06f9aff443828ae1.slice/crio-c0cb30c82eb7c5f8661cf40476de7f52f86b72b87a3f3c906f9fcf3384e8180a WatchSource:0}: Error finding container c0cb30c82eb7c5f8661cf40476de7f52f86b72b87a3f3c906f9fcf3384e8180a: Status 404 returned error can't find the container with id c0cb30c82eb7c5f8661cf40476de7f52f86b72b87a3f3c906f9fcf3384e8180a Jul 02 23:07:04.864329 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:04.864316 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 02 23:07:04.890258 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:04.890238 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-33.ec2.internal\" not found" Jul 02 23:07:04.903173 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:04.903151 2563 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 23:07:04.990582 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:04.990536 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-33.ec2.internal\" not found" Jul 02 23:07:05.091117 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:05.091044 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-33.ec2.internal\" not found" Jul 02 23:07:05.177116 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.177089 2563 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 23:07:05.192001 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:05.191980 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-33.ec2.internal\" not found" Jul 02 23:07:05.237056 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.237033 2563 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 23:07:05.296159 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.296138 2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-33.ec2.internal" Jul 02 23:07:05.310159 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.310137 2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 02 23:07:05.312073 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.312059 2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-33.ec2.internal" Jul 02 23:07:05.321221 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.321202 2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 02 23:07:05.544661 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.544587 2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 23:07:05.676188 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.676156 2563 apiserver.go:52] "Watching apiserver" Jul 02 23:07:05.683102 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.683076 2563 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 02 23:07:05.683569 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.683548 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-hhc6h","kube-system/kube-apiserver-proxy-ip-10-0-131-33.ec2.internal","openshift-cluster-node-tuning-operator/tuned-47sfd","openshift-dns/node-resolver-q5c49","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-33.ec2.internal","openshift-multus/multus-2jt79","openshift-multus/network-metrics-daemon-tzfzk","kube-system/global-pull-secret-syncer-r7d5c","kube-system/konnectivity-agent-z6p55","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wpqd6","openshift-image-registry/node-ca-m5zq4","openshift-multus/multus-additional-cni-plugins-97j6n","openshift-network-diagnostics/network-check-target-jxwvg","openshift-network-operator/iptables-alerter-2g949"] Jul 02 23:07:05.685225 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.685203 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jxwvg" Jul 02 23:07:05.685326 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:05.685288 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jxwvg" podUID="0ecba3b1-7f8d-4896-8c34-967f37704feb" Jul 02 23:07:05.686633 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.686611 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-2g949" Jul 02 23:07:05.687879 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.687860 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-47sfd" Jul 02 23:07:05.689062 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.689042 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-h85zb\"" Jul 02 23:07:05.689231 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.689217 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 02 23:07:05.689445 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.689420 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 02 23:07:05.689613 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.689597 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 02 23:07:05.689865 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.689848 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-q5c49" Jul 02 23:07:05.690316 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.690296 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 02 23:07:05.690406 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.690330 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-dkdwc\"" Jul 02 23:07:05.690498 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.690484 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 02 23:07:05.690847 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.690828 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tzfzk" Jul 02 23:07:05.690929 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:05.690895 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tzfzk" podUID="fad8c2d0-090a-4bac-8774-26cac496f9f7" Jul 02 23:07:05.692132 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.692114 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 02 23:07:05.692455 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.692439 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2jt79" Jul 02 23:07:05.692538 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.692503 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-nld5w\"" Jul 02 23:07:05.692909 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.692893 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 02 23:07:05.693832 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.693813 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-hhc6h" Jul 02 23:07:05.694787 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.694770 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 02 23:07:05.694870 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.694807 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 02 23:07:05.695029 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.695012 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 02 23:07:05.695086 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.695062 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 02 23:07:05.695086 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.695015 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-vlvr2\"" Jul 02 23:07:05.695844 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.695812 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r7d5c" Jul 02 23:07:05.695945 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:05.695870 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r7d5c" podUID="b17963a2-4797-4722-ae65-4ac1801913a5" Jul 02 23:07:05.696054 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.695944 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 02 23:07:05.696054 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.695984 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-m9kq9\"" Jul 02 23:07:05.696181 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.696163 2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 02 23:07:05.696274 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.696206 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 02 23:07:05.696331 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.696314 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 02 23:07:05.696656 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.696640 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 02 23:07:05.696856 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.696838 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 02 23:07:05.697469 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.697451 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-z6p55" Jul 02 23:07:05.697882 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.697862 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 02 23:07:05.699139 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.698719 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wpqd6" Jul 02 23:07:05.699906 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.699762 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 02 23:07:05.699906 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.699794 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 02 23:07:05.699906 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.699880 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-cdxff\"" Jul 02 23:07:05.700896 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.700878 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-m5zq4" Jul 02 23:07:05.703014 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.702960 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 02 23:07:05.703241 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.703162 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-68nph\"" Jul 02 23:07:05.703334 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.703314 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-97j6n" Jul 02 23:07:05.704296 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.704254 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 02 23:07:05.704378 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.704334 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 02 23:07:05.704378 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.704363 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 02 23:07:05.704468 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.704259 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 02 23:07:05.704799 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.704685 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-qqxds\"" Jul 02 23:07:05.704799 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.704732 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 02 23:07:05.706330 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.705844 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 02 23:07:05.706330 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.705856 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-8b927\"" Jul 02 23:07:05.706465 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.706373 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 02 23:07:05.709436 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.709413 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fad8c2d0-090a-4bac-8774-26cac496f9f7-metrics-certs\") pod \"network-metrics-daemon-tzfzk\" (UID: \"fad8c2d0-090a-4bac-8774-26cac496f9f7\") " pod="openshift-multus/network-metrics-daemon-tzfzk" Jul 02 23:07:05.709537 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.709448 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/74fc0401-b598-40fc-acca-508ba1a1c001-host-run-netns\") pod \"multus-2jt79\" (UID: \"74fc0401-b598-40fc-acca-508ba1a1c001\") " pod="openshift-multus/multus-2jt79" Jul 02 23:07:05.709537 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.709474 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f946205c-023a-4a7d-9a6c-c40b23c3b771-ovn-node-metrics-cert\") pod \"ovnkube-node-hhc6h\" (UID: \"f946205c-023a-4a7d-9a6c-c40b23c3b771\") " pod="openshift-ovn-kubernetes/ovnkube-node-hhc6h" Jul 02 23:07:05.709537 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.709514 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a2a8144d-1894-42b4-be25-ae456f79f041-run\") pod \"tuned-47sfd\" (UID: \"a2a8144d-1894-42b4-be25-ae456f79f041\") " pod="openshift-cluster-node-tuning-operator/tuned-47sfd" Jul 02 23:07:05.709702 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.709538 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/74fc0401-b598-40fc-acca-508ba1a1c001-host-run-multus-certs\") pod \"multus-2jt79\" (UID: \"74fc0401-b598-40fc-acca-508ba1a1c001\") " pod="openshift-multus/multus-2jt79" Jul 02 23:07:05.709702 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.709560 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4lx6m\" (UniqueName: \"kubernetes.io/projected/f66de8fe-bac5-43ab-80bd-f8b818e69f7b-kube-api-access-4lx6m\") pod \"iptables-alerter-2g949\" (UID: \"f66de8fe-bac5-43ab-80bd-f8b818e69f7b\") " pod="openshift-network-operator/iptables-alerter-2g949" Jul 02 23:07:05.709702 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.709581 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f946205c-023a-4a7d-9a6c-c40b23c3b771-host-run-netns\") pod \"ovnkube-node-hhc6h\" (UID: \"f946205c-023a-4a7d-9a6c-c40b23c3b771\") " pod="openshift-ovn-kubernetes/ovnkube-node-hhc6h" Jul 02 23:07:05.709702 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.709605 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/74fc0401-b598-40fc-acca-508ba1a1c001-host-var-lib-kubelet\") pod \"multus-2jt79\" (UID: \"74fc0401-b598-40fc-acca-508ba1a1c001\") " pod="openshift-multus/multus-2jt79" Jul 02 23:07:05.709702 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.709627 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a6eddff0-475c-41b7-b072-e1cdd661392f-hosts-file\") pod \"node-resolver-q5c49\" (UID: \"a6eddff0-475c-41b7-b072-e1cdd661392f\") " pod="openshift-dns/node-resolver-q5c49" Jul 02 23:07:05.709702 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.709648 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a2a8144d-1894-42b4-be25-ae456f79f041-etc-sysctl-d\") pod \"tuned-47sfd\" (UID: \"a2a8144d-1894-42b4-be25-ae456f79f041\") " pod="openshift-cluster-node-tuning-operator/tuned-47sfd" Jul 02 23:07:05.709702 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.709670 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/74fc0401-b598-40fc-acca-508ba1a1c001-hostroot\") pod \"multus-2jt79\" (UID: \"74fc0401-b598-40fc-acca-508ba1a1c001\") " pod="openshift-multus/multus-2jt79" Jul 02 23:07:05.709702 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.709686 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f66de8fe-bac5-43ab-80bd-f8b818e69f7b-iptables-alerter-script\") pod \"iptables-alerter-2g949\" (UID: \"f66de8fe-bac5-43ab-80bd-f8b818e69f7b\") " pod="openshift-network-operator/iptables-alerter-2g949" Jul 02 23:07:05.709702 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.709699 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f946205c-023a-4a7d-9a6c-c40b23c3b771-var-lib-openvswitch\") pod \"ovnkube-node-hhc6h\" (UID: \"f946205c-023a-4a7d-9a6c-c40b23c3b771\") " pod="openshift-ovn-kubernetes/ovnkube-node-hhc6h" Jul 02 23:07:05.710148 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.709715 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7frtk\" (UniqueName: \"kubernetes.io/projected/0ecba3b1-7f8d-4896-8c34-967f37704feb-kube-api-access-7frtk\") pod \"network-check-target-jxwvg\" (UID: \"0ecba3b1-7f8d-4896-8c34-967f37704feb\") " pod="openshift-network-diagnostics/network-check-target-jxwvg" Jul 02 23:07:05.710148 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.709729 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f946205c-023a-4a7d-9a6c-c40b23c3b771-systemd-units\") pod \"ovnkube-node-hhc6h\" (UID: \"f946205c-023a-4a7d-9a6c-c40b23c3b771\") " pod="openshift-ovn-kubernetes/ovnkube-node-hhc6h" Jul 02 23:07:05.710148 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.709760 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a2a8144d-1894-42b4-be25-ae456f79f041-lib-modules\") pod \"tuned-47sfd\" (UID: \"a2a8144d-1894-42b4-be25-ae456f79f041\") " pod="openshift-cluster-node-tuning-operator/tuned-47sfd" Jul 02 23:07:05.710148 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.709773 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a2a8144d-1894-42b4-be25-ae456f79f041-host\") pod \"tuned-47sfd\" (UID: \"a2a8144d-1894-42b4-be25-ae456f79f041\") " pod="openshift-cluster-node-tuning-operator/tuned-47sfd" Jul 02 23:07:05.710148 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.709801 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b17963a2-4797-4722-ae65-4ac1801913a5-kubelet-config\") pod \"global-pull-secret-syncer-r7d5c\" (UID: \"b17963a2-4797-4722-ae65-4ac1801913a5\") " pod="kube-system/global-pull-secret-syncer-r7d5c" Jul 02 23:07:05.710148 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.709826 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a2a8144d-1894-42b4-be25-ae456f79f041-tmp\") pod \"tuned-47sfd\" (UID: \"a2a8144d-1894-42b4-be25-ae456f79f041\") " pod="openshift-cluster-node-tuning-operator/tuned-47sfd" Jul 02 23:07:05.710148 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.709841 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a2a8144d-1894-42b4-be25-ae456f79f041-etc-sysconfig\") pod \"tuned-47sfd\" (UID: \"a2a8144d-1894-42b4-be25-ae456f79f041\") " pod="openshift-cluster-node-tuning-operator/tuned-47sfd" Jul 02 23:07:05.710148 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.709868 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a2a8144d-1894-42b4-be25-ae456f79f041-etc-tuned\") pod \"tuned-47sfd\" (UID: \"a2a8144d-1894-42b4-be25-ae456f79f041\") " pod="openshift-cluster-node-tuning-operator/tuned-47sfd" Jul 02 23:07:05.710148 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.709883 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckl2l\" (UniqueName: \"kubernetes.io/projected/a2a8144d-1894-42b4-be25-ae456f79f041-kube-api-access-ckl2l\") pod \"tuned-47sfd\" (UID: \"a2a8144d-1894-42b4-be25-ae456f79f041\") " pod="openshift-cluster-node-tuning-operator/tuned-47sfd" Jul 02 23:07:05.710148 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.709898 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/74fc0401-b598-40fc-acca-508ba1a1c001-multus-cni-dir\") pod \"multus-2jt79\" (UID: \"74fc0401-b598-40fc-acca-508ba1a1c001\") " pod="openshift-multus/multus-2jt79" Jul 02 23:07:05.710148 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.709917 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/74fc0401-b598-40fc-acca-508ba1a1c001-host-var-lib-cni-bin\") pod \"multus-2jt79\" (UID: \"74fc0401-b598-40fc-acca-508ba1a1c001\") " pod="openshift-multus/multus-2jt79" Jul 02 23:07:05.710148 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.709932 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f946205c-023a-4a7d-9a6c-c40b23c3b771-run-systemd\") pod \"ovnkube-node-hhc6h\" (UID: \"f946205c-023a-4a7d-9a6c-c40b23c3b771\") " pod="openshift-ovn-kubernetes/ovnkube-node-hhc6h" Jul 02 23:07:05.710148 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.709947 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f946205c-023a-4a7d-9a6c-c40b23c3b771-etc-openvswitch\") pod \"ovnkube-node-hhc6h\" (UID: \"f946205c-023a-4a7d-9a6c-c40b23c3b771\") " pod="openshift-ovn-kubernetes/ovnkube-node-hhc6h" Jul 02 23:07:05.710148 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.709961 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6qrt\" (UniqueName: \"kubernetes.io/projected/f946205c-023a-4a7d-9a6c-c40b23c3b771-kube-api-access-w6qrt\") pod \"ovnkube-node-hhc6h\" (UID: \"f946205c-023a-4a7d-9a6c-c40b23c3b771\") " pod="openshift-ovn-kubernetes/ovnkube-node-hhc6h" Jul 02 23:07:05.710148 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.709975 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/74fc0401-b598-40fc-acca-508ba1a1c001-cni-binary-copy\") pod \"multus-2jt79\" (UID: \"74fc0401-b598-40fc-acca-508ba1a1c001\") " pod="openshift-multus/multus-2jt79" Jul 02 23:07:05.710148 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.709989 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/74fc0401-b598-40fc-acca-508ba1a1c001-host-run-k8s-cni-cncf-io\") pod \"multus-2jt79\" (UID: \"74fc0401-b598-40fc-acca-508ba1a1c001\") " pod="openshift-multus/multus-2jt79" Jul 02 23:07:05.710798 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.710003 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a2a8144d-1894-42b4-be25-ae456f79f041-etc-sysctl-conf\") pod \"tuned-47sfd\" (UID: \"a2a8144d-1894-42b4-be25-ae456f79f041\") " pod="openshift-cluster-node-tuning-operator/tuned-47sfd" Jul 02 23:07:05.710798 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.710018 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/74fc0401-b598-40fc-acca-508ba1a1c001-host-var-lib-cni-multus\") pod \"multus-2jt79\" (UID: \"74fc0401-b598-40fc-acca-508ba1a1c001\") " pod="openshift-multus/multus-2jt79" Jul 02 23:07:05.710798 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.710004 2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 02 23:07:05.710798 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.710034 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f946205c-023a-4a7d-9a6c-c40b23c3b771-host-slash\") pod \"ovnkube-node-hhc6h\" (UID: \"f946205c-023a-4a7d-9a6c-c40b23c3b771\") " pod="openshift-ovn-kubernetes/ovnkube-node-hhc6h" Jul 02 23:07:05.710798 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.710049 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f946205c-023a-4a7d-9a6c-c40b23c3b771-host-run-ovn-kubernetes\") pod \"ovnkube-node-hhc6h\" (UID: \"f946205c-023a-4a7d-9a6c-c40b23c3b771\") " pod="openshift-ovn-kubernetes/ovnkube-node-hhc6h" Jul 02 23:07:05.710798 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.710065 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f946205c-023a-4a7d-9a6c-c40b23c3b771-host-cni-bin\") pod \"ovnkube-node-hhc6h\" (UID: \"f946205c-023a-4a7d-9a6c-c40b23c3b771\") " pod="openshift-ovn-kubernetes/ovnkube-node-hhc6h" Jul 02 23:07:05.710798 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.710084 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b08f4b68-d33f-48a2-90d0-0c6511ba679a-konnectivity-ca\") pod \"konnectivity-agent-z6p55\" (UID: \"b08f4b68-d33f-48a2-90d0-0c6511ba679a\") " pod="kube-system/konnectivity-agent-z6p55" Jul 02 23:07:05.710798 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.710097 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a2a8144d-1894-42b4-be25-ae456f79f041-etc-systemd\") pod \"tuned-47sfd\" (UID: \"a2a8144d-1894-42b4-be25-ae456f79f041\") " pod="openshift-cluster-node-tuning-operator/tuned-47sfd" Jul 02 23:07:05.710798 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.710111 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s6cbq\" (UniqueName: \"kubernetes.io/projected/fad8c2d0-090a-4bac-8774-26cac496f9f7-kube-api-access-s6cbq\") pod \"network-metrics-daemon-tzfzk\" (UID: \"fad8c2d0-090a-4bac-8774-26cac496f9f7\") " pod="openshift-multus/network-metrics-daemon-tzfzk" Jul 02 23:07:05.710798 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.710131 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fz4zb\" (UniqueName: \"kubernetes.io/projected/a6eddff0-475c-41b7-b072-e1cdd661392f-kube-api-access-fz4zb\") pod \"node-resolver-q5c49\" (UID: \"a6eddff0-475c-41b7-b072-e1cdd661392f\") " pod="openshift-dns/node-resolver-q5c49" Jul 02 23:07:05.710798 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.710152 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f946205c-023a-4a7d-9a6c-c40b23c3b771-host-kubelet\") pod \"ovnkube-node-hhc6h\" (UID: \"f946205c-023a-4a7d-9a6c-c40b23c3b771\") " pod="openshift-ovn-kubernetes/ovnkube-node-hhc6h" Jul 02 23:07:05.710798 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.710173 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f946205c-023a-4a7d-9a6c-c40b23c3b771-node-log\") pod \"ovnkube-node-hhc6h\" (UID: \"f946205c-023a-4a7d-9a6c-c40b23c3b771\") " pod="openshift-ovn-kubernetes/ovnkube-node-hhc6h" Jul 02 23:07:05.710798 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.710198 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f946205c-023a-4a7d-9a6c-c40b23c3b771-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hhc6h\" (UID: \"f946205c-023a-4a7d-9a6c-c40b23c3b771\") " pod="openshift-ovn-kubernetes/ovnkube-node-hhc6h" Jul 02 23:07:05.710798 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.710230 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f946205c-023a-4a7d-9a6c-c40b23c3b771-ovnkube-script-lib\") pod \"ovnkube-node-hhc6h\" (UID: \"f946205c-023a-4a7d-9a6c-c40b23c3b771\") " pod="openshift-ovn-kubernetes/ovnkube-node-hhc6h" Jul 02 23:07:05.710798 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.710255 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b08f4b68-d33f-48a2-90d0-0c6511ba679a-agent-certs\") pod \"konnectivity-agent-z6p55\" (UID: \"b08f4b68-d33f-48a2-90d0-0c6511ba679a\") " pod="kube-system/konnectivity-agent-z6p55" Jul 02 23:07:05.710798 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.710296 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a2a8144d-1894-42b4-be25-ae456f79f041-sys\") pod \"tuned-47sfd\" (UID: \"a2a8144d-1894-42b4-be25-ae456f79f041\") " pod="openshift-cluster-node-tuning-operator/tuned-47sfd" Jul 02 23:07:05.710798 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.710332 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/74fc0401-b598-40fc-acca-508ba1a1c001-multus-daemon-config\") pod \"multus-2jt79\" (UID: \"74fc0401-b598-40fc-acca-508ba1a1c001\") " pod="openshift-multus/multus-2jt79" Jul 02 23:07:05.711533 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.710357 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f946205c-023a-4a7d-9a6c-c40b23c3b771-run-openvswitch\") pod \"ovnkube-node-hhc6h\" (UID: \"f946205c-023a-4a7d-9a6c-c40b23c3b771\") " pod="openshift-ovn-kubernetes/ovnkube-node-hhc6h" Jul 02 23:07:05.711533 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.710403 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f946205c-023a-4a7d-9a6c-c40b23c3b771-ovnkube-config\") pod \"ovnkube-node-hhc6h\" (UID: \"f946205c-023a-4a7d-9a6c-c40b23c3b771\") " pod="openshift-ovn-kubernetes/ovnkube-node-hhc6h" Jul 02 23:07:05.711533 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.710437 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/74fc0401-b598-40fc-acca-508ba1a1c001-multus-socket-dir-parent\") pod \"multus-2jt79\" (UID: \"74fc0401-b598-40fc-acca-508ba1a1c001\") " pod="openshift-multus/multus-2jt79" Jul 02 23:07:05.711533 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.710470 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/74fc0401-b598-40fc-acca-508ba1a1c001-etc-kubernetes\") pod \"multus-2jt79\" (UID: \"74fc0401-b598-40fc-acca-508ba1a1c001\") " pod="openshift-multus/multus-2jt79" Jul 02 23:07:05.711533 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.710497 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hjpt4\" (UniqueName: \"kubernetes.io/projected/74fc0401-b598-40fc-acca-508ba1a1c001-kube-api-access-hjpt4\") pod \"multus-2jt79\" (UID: \"74fc0401-b598-40fc-acca-508ba1a1c001\") " pod="openshift-multus/multus-2jt79" Jul 02 23:07:05.711533 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.710514 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f946205c-023a-4a7d-9a6c-c40b23c3b771-host-cni-netd\") pod \"ovnkube-node-hhc6h\" (UID: \"f946205c-023a-4a7d-9a6c-c40b23c3b771\") " pod="openshift-ovn-kubernetes/ovnkube-node-hhc6h" Jul 02 23:07:05.711533 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.710548 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a2a8144d-1894-42b4-be25-ae456f79f041-etc-modprobe-d\") pod \"tuned-47sfd\" (UID: \"a2a8144d-1894-42b4-be25-ae456f79f041\") " pod="openshift-cluster-node-tuning-operator/tuned-47sfd" Jul 02 23:07:05.711533 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.710566 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a2a8144d-1894-42b4-be25-ae456f79f041-etc-kubernetes\") pod \"tuned-47sfd\" (UID: \"a2a8144d-1894-42b4-be25-ae456f79f041\") " pod="openshift-cluster-node-tuning-operator/tuned-47sfd" Jul 02 23:07:05.711533 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.710588 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a2a8144d-1894-42b4-be25-ae456f79f041-var-lib-kubelet\") pod \"tuned-47sfd\" (UID: \"a2a8144d-1894-42b4-be25-ae456f79f041\") " pod="openshift-cluster-node-tuning-operator/tuned-47sfd" Jul 02 23:07:05.711533 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.710619 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/74fc0401-b598-40fc-acca-508ba1a1c001-os-release\") pod \"multus-2jt79\" (UID: \"74fc0401-b598-40fc-acca-508ba1a1c001\") " pod="openshift-multus/multus-2jt79" Jul 02 23:07:05.711533 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.710659 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f66de8fe-bac5-43ab-80bd-f8b818e69f7b-host-slash\") pod \"iptables-alerter-2g949\" (UID: \"f66de8fe-bac5-43ab-80bd-f8b818e69f7b\") " pod="openshift-network-operator/iptables-alerter-2g949" Jul 02 23:07:05.711533 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.710679 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a6eddff0-475c-41b7-b072-e1cdd661392f-tmp-dir\") pod \"node-resolver-q5c49\" (UID: \"a6eddff0-475c-41b7-b072-e1cdd661392f\") " pod="openshift-dns/node-resolver-q5c49" Jul 02 23:07:05.711533 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.710694 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f946205c-023a-4a7d-9a6c-c40b23c3b771-log-socket\") pod \"ovnkube-node-hhc6h\" (UID: \"f946205c-023a-4a7d-9a6c-c40b23c3b771\") " pod="openshift-ovn-kubernetes/ovnkube-node-hhc6h" Jul 02 23:07:05.711533 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.710721 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/74fc0401-b598-40fc-acca-508ba1a1c001-system-cni-dir\") pod \"multus-2jt79\" (UID: \"74fc0401-b598-40fc-acca-508ba1a1c001\") " pod="openshift-multus/multus-2jt79" Jul 02 23:07:05.711533 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.710783 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/74fc0401-b598-40fc-acca-508ba1a1c001-cnibin\") pod \"multus-2jt79\" (UID: \"74fc0401-b598-40fc-acca-508ba1a1c001\") " pod="openshift-multus/multus-2jt79" Jul 02 23:07:05.711533 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.710820 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/74fc0401-b598-40fc-acca-508ba1a1c001-multus-conf-dir\") pod \"multus-2jt79\" (UID: \"74fc0401-b598-40fc-acca-508ba1a1c001\") " pod="openshift-multus/multus-2jt79" Jul 02 23:07:05.711533 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.710847 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b17963a2-4797-4722-ae65-4ac1801913a5-dbus\") pod \"global-pull-secret-syncer-r7d5c\" (UID: \"b17963a2-4797-4722-ae65-4ac1801913a5\") " pod="kube-system/global-pull-secret-syncer-r7d5c" Jul 02 23:07:05.712516 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.710874 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b17963a2-4797-4722-ae65-4ac1801913a5-original-pull-secret\") pod \"global-pull-secret-syncer-r7d5c\" (UID: \"b17963a2-4797-4722-ae65-4ac1801913a5\") " pod="kube-system/global-pull-secret-syncer-r7d5c" Jul 02 23:07:05.712516 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.710905 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f946205c-023a-4a7d-9a6c-c40b23c3b771-run-ovn\") pod \"ovnkube-node-hhc6h\" (UID: \"f946205c-023a-4a7d-9a6c-c40b23c3b771\") " pod="openshift-ovn-kubernetes/ovnkube-node-hhc6h" Jul 02 23:07:05.712516 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.710921 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f946205c-023a-4a7d-9a6c-c40b23c3b771-env-overrides\") pod \"ovnkube-node-hhc6h\" (UID: \"f946205c-023a-4a7d-9a6c-c40b23c3b771\") " pod="openshift-ovn-kubernetes/ovnkube-node-hhc6h" Jul 02 23:07:05.729099 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.729081 2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-k48pq" Jul 02 23:07:05.740352 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.740330 2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-k48pq" Jul 02 23:07:05.797631 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.797559 2563 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 02 23:07:05.812031 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.811990 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f946205c-023a-4a7d-9a6c-c40b23c3b771-systemd-units\") pod \"ovnkube-node-hhc6h\" (UID: \"f946205c-023a-4a7d-9a6c-c40b23c3b771\") " pod="openshift-ovn-kubernetes/ovnkube-node-hhc6h" Jul 02 23:07:05.812191 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.812044 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-97hv9\" (UniqueName: \"kubernetes.io/projected/4234f128-0de0-4ac9-b880-c2024b729867-kube-api-access-97hv9\") pod \"aws-ebs-csi-driver-node-wpqd6\" (UID: \"4234f128-0de0-4ac9-b880-c2024b729867\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wpqd6" Jul 02 23:07:05.812191 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.812077 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2d6bdb50-bc8b-4f01-b13c-8ff9cd87740f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-97j6n\" (UID: \"2d6bdb50-bc8b-4f01-b13c-8ff9cd87740f\") " pod="openshift-multus/multus-additional-cni-plugins-97j6n" Jul 02 23:07:05.812191 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.812102 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a2a8144d-1894-42b4-be25-ae456f79f041-lib-modules\") pod \"tuned-47sfd\" (UID: \"a2a8144d-1894-42b4-be25-ae456f79f041\") " pod="openshift-cluster-node-tuning-operator/tuned-47sfd" Jul 02 23:07:05.812191 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.812124 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a2a8144d-1894-42b4-be25-ae456f79f041-host\") pod \"tuned-47sfd\" (UID: \"a2a8144d-1894-42b4-be25-ae456f79f041\") " pod="openshift-cluster-node-tuning-operator/tuned-47sfd" Jul 02 23:07:05.812191 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.812121 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f946205c-023a-4a7d-9a6c-c40b23c3b771-systemd-units\") pod \"ovnkube-node-hhc6h\" (UID: \"f946205c-023a-4a7d-9a6c-c40b23c3b771\") " pod="openshift-ovn-kubernetes/ovnkube-node-hhc6h" Jul 02 23:07:05.812191 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.812164 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b17963a2-4797-4722-ae65-4ac1801913a5-kubelet-config\") pod \"global-pull-secret-syncer-r7d5c\" (UID: \"b17963a2-4797-4722-ae65-4ac1801913a5\") " pod="kube-system/global-pull-secret-syncer-r7d5c" Jul 02 23:07:05.812491 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.812197 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4234f128-0de0-4ac9-b880-c2024b729867-socket-dir\") pod \"aws-ebs-csi-driver-node-wpqd6\" (UID: \"4234f128-0de0-4ac9-b880-c2024b729867\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wpqd6" Jul 02 23:07:05.812491 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.812220 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2d6bdb50-bc8b-4f01-b13c-8ff9cd87740f-cnibin\") pod \"multus-additional-cni-plugins-97j6n\" (UID: \"2d6bdb50-bc8b-4f01-b13c-8ff9cd87740f\") " pod="openshift-multus/multus-additional-cni-plugins-97j6n" Jul 02 23:07:05.812491 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.812245 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4c2848a5-a93f-4b79-be6e-31d430c7839d-serviceca\") pod \"node-ca-m5zq4\" (UID: \"4c2848a5-a93f-4b79-be6e-31d430c7839d\") " pod="openshift-image-registry/node-ca-m5zq4" Jul 02 23:07:05.812491 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.812270 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a2a8144d-1894-42b4-be25-ae456f79f041-tmp\") pod \"tuned-47sfd\" (UID: \"a2a8144d-1894-42b4-be25-ae456f79f041\") " pod="openshift-cluster-node-tuning-operator/tuned-47sfd" Jul 02 23:07:05.812491 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.812294 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2d6bdb50-bc8b-4f01-b13c-8ff9cd87740f-system-cni-dir\") pod \"multus-additional-cni-plugins-97j6n\" (UID: \"2d6bdb50-bc8b-4f01-b13c-8ff9cd87740f\") " pod="openshift-multus/multus-additional-cni-plugins-97j6n" Jul 02 23:07:05.812491 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.812313 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a2a8144d-1894-42b4-be25-ae456f79f041-lib-modules\") pod \"tuned-47sfd\" (UID: \"a2a8144d-1894-42b4-be25-ae456f79f041\") " pod="openshift-cluster-node-tuning-operator/tuned-47sfd" Jul 02 23:07:05.812491 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.812318 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a2a8144d-1894-42b4-be25-ae456f79f041-etc-sysconfig\") pod \"tuned-47sfd\" (UID: \"a2a8144d-1894-42b4-be25-ae456f79f041\") " pod="openshift-cluster-node-tuning-operator/tuned-47sfd" Jul 02 23:07:05.812491 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.812356 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a2a8144d-1894-42b4-be25-ae456f79f041-etc-tuned\") pod \"tuned-47sfd\" (UID: \"a2a8144d-1894-42b4-be25-ae456f79f041\") " pod="openshift-cluster-node-tuning-operator/tuned-47sfd" Jul 02 23:07:05.812491 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.812362 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a2a8144d-1894-42b4-be25-ae456f79f041-etc-sysconfig\") pod \"tuned-47sfd\" (UID: \"a2a8144d-1894-42b4-be25-ae456f79f041\") " pod="openshift-cluster-node-tuning-operator/tuned-47sfd" Jul 02 23:07:05.812491 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.812379 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ckl2l\" (UniqueName: \"kubernetes.io/projected/a2a8144d-1894-42b4-be25-ae456f79f041-kube-api-access-ckl2l\") pod \"tuned-47sfd\" (UID: \"a2a8144d-1894-42b4-be25-ae456f79f041\") " pod="openshift-cluster-node-tuning-operator/tuned-47sfd" Jul 02 23:07:05.812491 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.812406 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/74fc0401-b598-40fc-acca-508ba1a1c001-multus-cni-dir\") pod \"multus-2jt79\" (UID: \"74fc0401-b598-40fc-acca-508ba1a1c001\") " pod="openshift-multus/multus-2jt79" Jul 02 23:07:05.812491 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.812421 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b17963a2-4797-4722-ae65-4ac1801913a5-kubelet-config\") pod \"global-pull-secret-syncer-r7d5c\" (UID: \"b17963a2-4797-4722-ae65-4ac1801913a5\") " pod="kube-system/global-pull-secret-syncer-r7d5c" Jul 02 23:07:05.812491 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.812431 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/74fc0401-b598-40fc-acca-508ba1a1c001-host-var-lib-cni-bin\") pod \"multus-2jt79\" (UID: \"74fc0401-b598-40fc-acca-508ba1a1c001\") " pod="openshift-multus/multus-2jt79" Jul 02 23:07:05.813081 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.812523 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f946205c-023a-4a7d-9a6c-c40b23c3b771-run-systemd\") pod \"ovnkube-node-hhc6h\" (UID: \"f946205c-023a-4a7d-9a6c-c40b23c3b771\") " pod="openshift-ovn-kubernetes/ovnkube-node-hhc6h" Jul 02 23:07:05.813081 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.812593 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f946205c-023a-4a7d-9a6c-c40b23c3b771-etc-openvswitch\") pod \"ovnkube-node-hhc6h\" (UID: \"f946205c-023a-4a7d-9a6c-c40b23c3b771\") " pod="openshift-ovn-kubernetes/ovnkube-node-hhc6h" Jul 02 23:07:05.813081 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.812616 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6qrt\" (UniqueName: \"kubernetes.io/projected/f946205c-023a-4a7d-9a6c-c40b23c3b771-kube-api-access-w6qrt\") pod \"ovnkube-node-hhc6h\" (UID: \"f946205c-023a-4a7d-9a6c-c40b23c3b771\") " pod="openshift-ovn-kubernetes/ovnkube-node-hhc6h" Jul 02 23:07:05.813081 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.812642 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4234f128-0de0-4ac9-b880-c2024b729867-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wpqd6\" (UID: \"4234f128-0de0-4ac9-b880-c2024b729867\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wpqd6" Jul 02 23:07:05.813081 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.812666 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/74fc0401-b598-40fc-acca-508ba1a1c001-cni-binary-copy\") pod \"multus-2jt79\" (UID: \"74fc0401-b598-40fc-acca-508ba1a1c001\") " pod="openshift-multus/multus-2jt79" Jul 02 23:07:05.813081 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.812690 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/74fc0401-b598-40fc-acca-508ba1a1c001-host-run-k8s-cni-cncf-io\") pod \"multus-2jt79\" (UID: \"74fc0401-b598-40fc-acca-508ba1a1c001\") " pod="openshift-multus/multus-2jt79" Jul 02 23:07:05.813081 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.812715 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4c2848a5-a93f-4b79-be6e-31d430c7839d-host\") pod \"node-ca-m5zq4\" (UID: \"4c2848a5-a93f-4b79-be6e-31d430c7839d\") " pod="openshift-image-registry/node-ca-m5zq4" Jul 02 23:07:05.813081 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.812758 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a2a8144d-1894-42b4-be25-ae456f79f041-etc-sysctl-conf\") pod \"tuned-47sfd\" (UID: \"a2a8144d-1894-42b4-be25-ae456f79f041\") " pod="openshift-cluster-node-tuning-operator/tuned-47sfd" Jul 02 23:07:05.813081 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.812760 2563 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 02 23:07:05.813081 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.812784 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/74fc0401-b598-40fc-acca-508ba1a1c001-host-var-lib-cni-multus\") pod \"multus-2jt79\" (UID: \"74fc0401-b598-40fc-acca-508ba1a1c001\") " pod="openshift-multus/multus-2jt79" Jul 02 23:07:05.813081 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.812807 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f946205c-023a-4a7d-9a6c-c40b23c3b771-host-slash\") pod \"ovnkube-node-hhc6h\" (UID: \"f946205c-023a-4a7d-9a6c-c40b23c3b771\") " pod="openshift-ovn-kubernetes/ovnkube-node-hhc6h" Jul 02 23:07:05.813081 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.812849 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f946205c-023a-4a7d-9a6c-c40b23c3b771-host-run-ovn-kubernetes\") pod \"ovnkube-node-hhc6h\" (UID: \"f946205c-023a-4a7d-9a6c-c40b23c3b771\") " pod="openshift-ovn-kubernetes/ovnkube-node-hhc6h" Jul 02 23:07:05.813081 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.812873 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f946205c-023a-4a7d-9a6c-c40b23c3b771-host-cni-bin\") pod \"ovnkube-node-hhc6h\" (UID: \"f946205c-023a-4a7d-9a6c-c40b23c3b771\") " pod="openshift-ovn-kubernetes/ovnkube-node-hhc6h" Jul 02 23:07:05.813081 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.812899 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b08f4b68-d33f-48a2-90d0-0c6511ba679a-konnectivity-ca\") pod \"konnectivity-agent-z6p55\" (UID: \"b08f4b68-d33f-48a2-90d0-0c6511ba679a\") " pod="kube-system/konnectivity-agent-z6p55" Jul 02 23:07:05.813081 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.812922 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a2a8144d-1894-42b4-be25-ae456f79f041-etc-systemd\") pod \"tuned-47sfd\" (UID: \"a2a8144d-1894-42b4-be25-ae456f79f041\") " pod="openshift-cluster-node-tuning-operator/tuned-47sfd" Jul 02 23:07:05.813081 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.812946 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s6cbq\" (UniqueName: \"kubernetes.io/projected/fad8c2d0-090a-4bac-8774-26cac496f9f7-kube-api-access-s6cbq\") pod \"network-metrics-daemon-tzfzk\" (UID: \"fad8c2d0-090a-4bac-8774-26cac496f9f7\") " pod="openshift-multus/network-metrics-daemon-tzfzk" Jul 02 23:07:05.813081 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.812970 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fz4zb\" (UniqueName: \"kubernetes.io/projected/a6eddff0-475c-41b7-b072-e1cdd661392f-kube-api-access-fz4zb\") pod \"node-resolver-q5c49\" (UID: \"a6eddff0-475c-41b7-b072-e1cdd661392f\") " pod="openshift-dns/node-resolver-q5c49" Jul 02 23:07:05.813081 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.812994 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f946205c-023a-4a7d-9a6c-c40b23c3b771-host-kubelet\") pod \"ovnkube-node-hhc6h\" (UID: \"f946205c-023a-4a7d-9a6c-c40b23c3b771\") " pod="openshift-ovn-kubernetes/ovnkube-node-hhc6h" Jul 02 23:07:05.813704 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.813016 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f946205c-023a-4a7d-9a6c-c40b23c3b771-node-log\") pod \"ovnkube-node-hhc6h\" (UID: \"f946205c-023a-4a7d-9a6c-c40b23c3b771\") " pod="openshift-ovn-kubernetes/ovnkube-node-hhc6h" Jul 02 23:07:05.813704 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.813043 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f946205c-023a-4a7d-9a6c-c40b23c3b771-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hhc6h\" (UID: \"f946205c-023a-4a7d-9a6c-c40b23c3b771\") " pod="openshift-ovn-kubernetes/ovnkube-node-hhc6h" Jul 02 23:07:05.813704 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.813069 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f946205c-023a-4a7d-9a6c-c40b23c3b771-ovnkube-script-lib\") pod \"ovnkube-node-hhc6h\" (UID: \"f946205c-023a-4a7d-9a6c-c40b23c3b771\") " pod="openshift-ovn-kubernetes/ovnkube-node-hhc6h" Jul 02 23:07:05.813704 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.813094 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b08f4b68-d33f-48a2-90d0-0c6511ba679a-agent-certs\") pod \"konnectivity-agent-z6p55\" (UID: \"b08f4b68-d33f-48a2-90d0-0c6511ba679a\") " pod="kube-system/konnectivity-agent-z6p55" Jul 02 23:07:05.813704 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.813100 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a2a8144d-1894-42b4-be25-ae456f79f041-host\") pod \"tuned-47sfd\" (UID: \"a2a8144d-1894-42b4-be25-ae456f79f041\") " pod="openshift-cluster-node-tuning-operator/tuned-47sfd" Jul 02 23:07:05.813704 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.813116 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a2a8144d-1894-42b4-be25-ae456f79f041-sys\") pod \"tuned-47sfd\" (UID: \"a2a8144d-1894-42b4-be25-ae456f79f041\") " pod="openshift-cluster-node-tuning-operator/tuned-47sfd" Jul 02 23:07:05.813704 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.813139 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/74fc0401-b598-40fc-acca-508ba1a1c001-multus-daemon-config\") pod \"multus-2jt79\" (UID: \"74fc0401-b598-40fc-acca-508ba1a1c001\") " pod="openshift-multus/multus-2jt79" Jul 02 23:07:05.813704 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.813163 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f946205c-023a-4a7d-9a6c-c40b23c3b771-run-openvswitch\") pod \"ovnkube-node-hhc6h\" (UID: \"f946205c-023a-4a7d-9a6c-c40b23c3b771\") " pod="openshift-ovn-kubernetes/ovnkube-node-hhc6h" Jul 02 23:07:05.813704 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.813186 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f946205c-023a-4a7d-9a6c-c40b23c3b771-ovnkube-config\") pod \"ovnkube-node-hhc6h\" (UID: \"f946205c-023a-4a7d-9a6c-c40b23c3b771\") " pod="openshift-ovn-kubernetes/ovnkube-node-hhc6h" Jul 02 23:07:05.813704 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.813213 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f946205c-023a-4a7d-9a6c-c40b23c3b771-etc-openvswitch\") pod \"ovnkube-node-hhc6h\" (UID: \"f946205c-023a-4a7d-9a6c-c40b23c3b771\") " pod="openshift-ovn-kubernetes/ovnkube-node-hhc6h" Jul 02 23:07:05.813704 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.813228 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2d6bdb50-bc8b-4f01-b13c-8ff9cd87740f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-97j6n\" (UID: \"2d6bdb50-bc8b-4f01-b13c-8ff9cd87740f\") " pod="openshift-multus/multus-additional-cni-plugins-97j6n" Jul 02 23:07:05.813704 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.813260 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/74fc0401-b598-40fc-acca-508ba1a1c001-multus-socket-dir-parent\") pod \"multus-2jt79\" (UID: \"74fc0401-b598-40fc-acca-508ba1a1c001\") " pod="openshift-multus/multus-2jt79" Jul 02 23:07:05.813704 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.813283 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/74fc0401-b598-40fc-acca-508ba1a1c001-etc-kubernetes\") pod \"multus-2jt79\" (UID: \"74fc0401-b598-40fc-acca-508ba1a1c001\") " pod="openshift-multus/multus-2jt79" Jul 02 23:07:05.813704 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.813312 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hjpt4\" (UniqueName: \"kubernetes.io/projected/74fc0401-b598-40fc-acca-508ba1a1c001-kube-api-access-hjpt4\") pod \"multus-2jt79\" (UID: \"74fc0401-b598-40fc-acca-508ba1a1c001\") " pod="openshift-multus/multus-2jt79" Jul 02 23:07:05.813704 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.813333 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a2a8144d-1894-42b4-be25-ae456f79f041-etc-sysctl-conf\") pod \"tuned-47sfd\" (UID: \"a2a8144d-1894-42b4-be25-ae456f79f041\") " pod="openshift-cluster-node-tuning-operator/tuned-47sfd" Jul 02 23:07:05.813704 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.813338 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f946205c-023a-4a7d-9a6c-c40b23c3b771-host-cni-netd\") pod \"ovnkube-node-hhc6h\" (UID: \"f946205c-023a-4a7d-9a6c-c40b23c3b771\") " pod="openshift-ovn-kubernetes/ovnkube-node-hhc6h" Jul 02 23:07:05.813704 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.813365 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2d6bdb50-bc8b-4f01-b13c-8ff9cd87740f-cni-binary-copy\") pod \"multus-additional-cni-plugins-97j6n\" (UID: \"2d6bdb50-bc8b-4f01-b13c-8ff9cd87740f\") " pod="openshift-multus/multus-additional-cni-plugins-97j6n" Jul 02 23:07:05.814243 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.813377 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f946205c-023a-4a7d-9a6c-c40b23c3b771-host-kubelet\") pod \"ovnkube-node-hhc6h\" (UID: \"f946205c-023a-4a7d-9a6c-c40b23c3b771\") " pod="openshift-ovn-kubernetes/ovnkube-node-hhc6h" Jul 02 23:07:05.814243 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.813383 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a2a8144d-1894-42b4-be25-ae456f79f041-etc-modprobe-d\") pod \"tuned-47sfd\" (UID: \"a2a8144d-1894-42b4-be25-ae456f79f041\") " pod="openshift-cluster-node-tuning-operator/tuned-47sfd" Jul 02 23:07:05.814243 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.813411 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a2a8144d-1894-42b4-be25-ae456f79f041-etc-kubernetes\") pod \"tuned-47sfd\" (UID: \"a2a8144d-1894-42b4-be25-ae456f79f041\") " pod="openshift-cluster-node-tuning-operator/tuned-47sfd" Jul 02 23:07:05.814243 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.813436 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a2a8144d-1894-42b4-be25-ae456f79f041-var-lib-kubelet\") pod \"tuned-47sfd\" (UID: \"a2a8144d-1894-42b4-be25-ae456f79f041\") " pod="openshift-cluster-node-tuning-operator/tuned-47sfd" Jul 02 23:07:05.814243 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.813459 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a2a8144d-1894-42b4-be25-ae456f79f041-etc-modprobe-d\") pod \"tuned-47sfd\" (UID: \"a2a8144d-1894-42b4-be25-ae456f79f041\") " pod="openshift-cluster-node-tuning-operator/tuned-47sfd" Jul 02 23:07:05.814243 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.813465 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/74fc0401-b598-40fc-acca-508ba1a1c001-os-release\") pod \"multus-2jt79\" (UID: \"74fc0401-b598-40fc-acca-508ba1a1c001\") " pod="openshift-multus/multus-2jt79" Jul 02 23:07:05.814243 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.813487 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f66de8fe-bac5-43ab-80bd-f8b818e69f7b-host-slash\") pod \"iptables-alerter-2g949\" (UID: \"f66de8fe-bac5-43ab-80bd-f8b818e69f7b\") " pod="openshift-network-operator/iptables-alerter-2g949" Jul 02 23:07:05.814243 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.813537 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f946205c-023a-4a7d-9a6c-c40b23c3b771-host-slash\") pod \"ovnkube-node-hhc6h\" (UID: \"f946205c-023a-4a7d-9a6c-c40b23c3b771\") " pod="openshift-ovn-kubernetes/ovnkube-node-hhc6h" Jul 02 23:07:05.814243 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.813550 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a2a8144d-1894-42b4-be25-ae456f79f041-sys\") pod \"tuned-47sfd\" (UID: \"a2a8144d-1894-42b4-be25-ae456f79f041\") " pod="openshift-cluster-node-tuning-operator/tuned-47sfd" Jul 02 23:07:05.814243 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.813576 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/74fc0401-b598-40fc-acca-508ba1a1c001-etc-kubernetes\") pod \"multus-2jt79\" (UID: \"74fc0401-b598-40fc-acca-508ba1a1c001\") " pod="openshift-multus/multus-2jt79" Jul 02 23:07:05.814243 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.813591 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/74fc0401-b598-40fc-acca-508ba1a1c001-multus-cni-dir\") pod \"multus-2jt79\" (UID: \"74fc0401-b598-40fc-acca-508ba1a1c001\") " pod="openshift-multus/multus-2jt79" Jul 02 23:07:05.814243 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.813614 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f946205c-023a-4a7d-9a6c-c40b23c3b771-host-run-ovn-kubernetes\") pod \"ovnkube-node-hhc6h\" (UID: \"f946205c-023a-4a7d-9a6c-c40b23c3b771\") " pod="openshift-ovn-kubernetes/ovnkube-node-hhc6h" Jul 02 23:07:05.814243 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.813629 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/74fc0401-b598-40fc-acca-508ba1a1c001-os-release\") pod \"multus-2jt79\" (UID: \"74fc0401-b598-40fc-acca-508ba1a1c001\") " pod="openshift-multus/multus-2jt79" Jul 02 23:07:05.814243 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.813653 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a6eddff0-475c-41b7-b072-e1cdd661392f-tmp-dir\") pod \"node-resolver-q5c49\" (UID: \"a6eddff0-475c-41b7-b072-e1cdd661392f\") " pod="openshift-dns/node-resolver-q5c49" Jul 02 23:07:05.814243 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.813661 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/74fc0401-b598-40fc-acca-508ba1a1c001-host-var-lib-cni-bin\") pod \"multus-2jt79\" (UID: \"74fc0401-b598-40fc-acca-508ba1a1c001\") " pod="openshift-multus/multus-2jt79" Jul 02 23:07:05.814243 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.813672 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f946205c-023a-4a7d-9a6c-c40b23c3b771-log-socket\") pod \"ovnkube-node-hhc6h\" (UID: \"f946205c-023a-4a7d-9a6c-c40b23c3b771\") " pod="openshift-ovn-kubernetes/ovnkube-node-hhc6h" Jul 02 23:07:05.814243 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.813695 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4234f128-0de0-4ac9-b880-c2024b729867-sys-fs\") pod \"aws-ebs-csi-driver-node-wpqd6\" (UID: \"4234f128-0de0-4ac9-b880-c2024b729867\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wpqd6" Jul 02 23:07:05.814243 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.813701 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a2a8144d-1894-42b4-be25-ae456f79f041-etc-kubernetes\") pod \"tuned-47sfd\" (UID: \"a2a8144d-1894-42b4-be25-ae456f79f041\") " pod="openshift-cluster-node-tuning-operator/tuned-47sfd" Jul 02 23:07:05.814814 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.813758 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/74fc0401-b598-40fc-acca-508ba1a1c001-system-cni-dir\") pod \"multus-2jt79\" (UID: \"74fc0401-b598-40fc-acca-508ba1a1c001\") " pod="openshift-multus/multus-2jt79" Jul 02 23:07:05.814814 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.813761 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f946205c-023a-4a7d-9a6c-c40b23c3b771-run-systemd\") pod \"ovnkube-node-hhc6h\" (UID: \"f946205c-023a-4a7d-9a6c-c40b23c3b771\") " pod="openshift-ovn-kubernetes/ovnkube-node-hhc6h" Jul 02 23:07:05.814814 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.813783 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/74fc0401-b598-40fc-acca-508ba1a1c001-cnibin\") pod \"multus-2jt79\" (UID: \"74fc0401-b598-40fc-acca-508ba1a1c001\") " pod="openshift-multus/multus-2jt79" Jul 02 23:07:05.814814 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.813798 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f946205c-023a-4a7d-9a6c-c40b23c3b771-log-socket\") pod \"ovnkube-node-hhc6h\" (UID: \"f946205c-023a-4a7d-9a6c-c40b23c3b771\") " pod="openshift-ovn-kubernetes/ovnkube-node-hhc6h" Jul 02 23:07:05.814814 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.813807 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/74fc0401-b598-40fc-acca-508ba1a1c001-multus-conf-dir\") pod \"multus-2jt79\" (UID: \"74fc0401-b598-40fc-acca-508ba1a1c001\") " pod="openshift-multus/multus-2jt79" Jul 02 23:07:05.814814 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.813830 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b17963a2-4797-4722-ae65-4ac1801913a5-dbus\") pod \"global-pull-secret-syncer-r7d5c\" (UID: \"b17963a2-4797-4722-ae65-4ac1801913a5\") " pod="kube-system/global-pull-secret-syncer-r7d5c" Jul 02 23:07:05.814814 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.813858 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f946205c-023a-4a7d-9a6c-c40b23c3b771-run-openvswitch\") pod \"ovnkube-node-hhc6h\" (UID: \"f946205c-023a-4a7d-9a6c-c40b23c3b771\") " pod="openshift-ovn-kubernetes/ovnkube-node-hhc6h" Jul 02 23:07:05.814814 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.813858 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b17963a2-4797-4722-ae65-4ac1801913a5-original-pull-secret\") pod \"global-pull-secret-syncer-r7d5c\" (UID: \"b17963a2-4797-4722-ae65-4ac1801913a5\") " pod="kube-system/global-pull-secret-syncer-r7d5c" Jul 02 23:07:05.814814 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.813903 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f946205c-023a-4a7d-9a6c-c40b23c3b771-run-ovn\") pod \"ovnkube-node-hhc6h\" (UID: \"f946205c-023a-4a7d-9a6c-c40b23c3b771\") " pod="openshift-ovn-kubernetes/ovnkube-node-hhc6h" Jul 02 23:07:05.814814 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.813928 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a2a8144d-1894-42b4-be25-ae456f79f041-etc-systemd\") pod \"tuned-47sfd\" (UID: \"a2a8144d-1894-42b4-be25-ae456f79f041\") " pod="openshift-cluster-node-tuning-operator/tuned-47sfd" Jul 02 23:07:05.814814 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:05.813931 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 23:07:05.814814 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.813943 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f946205c-023a-4a7d-9a6c-c40b23c3b771-node-log\") pod \"ovnkube-node-hhc6h\" (UID: \"f946205c-023a-4a7d-9a6c-c40b23c3b771\") " pod="openshift-ovn-kubernetes/ovnkube-node-hhc6h" Jul 02 23:07:05.814814 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.813977 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/74fc0401-b598-40fc-acca-508ba1a1c001-multus-conf-dir\") pod \"multus-2jt79\" (UID: \"74fc0401-b598-40fc-acca-508ba1a1c001\") " pod="openshift-multus/multus-2jt79" Jul 02 23:07:05.814814 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.813981 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f946205c-023a-4a7d-9a6c-c40b23c3b771-env-overrides\") pod \"ovnkube-node-hhc6h\" (UID: \"f946205c-023a-4a7d-9a6c-c40b23c3b771\") " pod="openshift-ovn-kubernetes/ovnkube-node-hhc6h" Jul 02 23:07:05.814814 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.814012 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fad8c2d0-090a-4bac-8774-26cac496f9f7-metrics-certs\") pod \"network-metrics-daemon-tzfzk\" (UID: \"fad8c2d0-090a-4bac-8774-26cac496f9f7\") " pod="openshift-multus/network-metrics-daemon-tzfzk" Jul 02 23:07:05.814814 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.814040 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/74fc0401-b598-40fc-acca-508ba1a1c001-host-run-netns\") pod \"multus-2jt79\" (UID: \"74fc0401-b598-40fc-acca-508ba1a1c001\") " pod="openshift-multus/multus-2jt79" Jul 02 23:07:05.814814 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.814064 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f946205c-023a-4a7d-9a6c-c40b23c3b771-ovn-node-metrics-cert\") pod \"ovnkube-node-hhc6h\" (UID: \"f946205c-023a-4a7d-9a6c-c40b23c3b771\") " pod="openshift-ovn-kubernetes/ovnkube-node-hhc6h" Jul 02 23:07:05.814814 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.814087 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a2a8144d-1894-42b4-be25-ae456f79f041-run\") pod \"tuned-47sfd\" (UID: \"a2a8144d-1894-42b4-be25-ae456f79f041\") " pod="openshift-cluster-node-tuning-operator/tuned-47sfd" Jul 02 23:07:05.815345 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.814112 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/74fc0401-b598-40fc-acca-508ba1a1c001-host-run-multus-certs\") pod \"multus-2jt79\" (UID: \"74fc0401-b598-40fc-acca-508ba1a1c001\") " pod="openshift-multus/multus-2jt79" Jul 02 23:07:05.815345 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.814140 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4lx6m\" (UniqueName: \"kubernetes.io/projected/f66de8fe-bac5-43ab-80bd-f8b818e69f7b-kube-api-access-4lx6m\") pod \"iptables-alerter-2g949\" (UID: \"f66de8fe-bac5-43ab-80bd-f8b818e69f7b\") " pod="openshift-network-operator/iptables-alerter-2g949" Jul 02 23:07:05.815345 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.814148 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/74fc0401-b598-40fc-acca-508ba1a1c001-multus-daemon-config\") pod \"multus-2jt79\" (UID: \"74fc0401-b598-40fc-acca-508ba1a1c001\") " pod="openshift-multus/multus-2jt79" Jul 02 23:07:05.815345 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.814166 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f946205c-023a-4a7d-9a6c-c40b23c3b771-host-run-netns\") pod \"ovnkube-node-hhc6h\" (UID: \"f946205c-023a-4a7d-9a6c-c40b23c3b771\") " pod="openshift-ovn-kubernetes/ovnkube-node-hhc6h" Jul 02 23:07:05.815345 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.814195 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rbmh5\" (UniqueName: \"kubernetes.io/projected/4c2848a5-a93f-4b79-be6e-31d430c7839d-kube-api-access-rbmh5\") pod \"node-ca-m5zq4\" (UID: \"4c2848a5-a93f-4b79-be6e-31d430c7839d\") " pod="openshift-image-registry/node-ca-m5zq4" Jul 02 23:07:05.815345 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.814223 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/74fc0401-b598-40fc-acca-508ba1a1c001-host-var-lib-kubelet\") pod \"multus-2jt79\" (UID: \"74fc0401-b598-40fc-acca-508ba1a1c001\") " pod="openshift-multus/multus-2jt79" Jul 02 23:07:05.815345 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.814233 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f946205c-023a-4a7d-9a6c-c40b23c3b771-run-ovn\") pod \"ovnkube-node-hhc6h\" (UID: \"f946205c-023a-4a7d-9a6c-c40b23c3b771\") " pod="openshift-ovn-kubernetes/ovnkube-node-hhc6h" Jul 02 23:07:05.815345 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.814249 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a6eddff0-475c-41b7-b072-e1cdd661392f-hosts-file\") pod \"node-resolver-q5c49\" (UID: \"a6eddff0-475c-41b7-b072-e1cdd661392f\") " pod="openshift-dns/node-resolver-q5c49" Jul 02 23:07:05.815345 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.814196 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/74fc0401-b598-40fc-acca-508ba1a1c001-host-var-lib-cni-multus\") pod \"multus-2jt79\" (UID: \"74fc0401-b598-40fc-acca-508ba1a1c001\") " pod="openshift-multus/multus-2jt79" Jul 02 23:07:05.815345 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.814312 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/74fc0401-b598-40fc-acca-508ba1a1c001-host-run-k8s-cni-cncf-io\") pod \"multus-2jt79\" (UID: \"74fc0401-b598-40fc-acca-508ba1a1c001\") " pod="openshift-multus/multus-2jt79" Jul 02 23:07:05.815345 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.814370 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b17963a2-4797-4722-ae65-4ac1801913a5-dbus\") pod \"global-pull-secret-syncer-r7d5c\" (UID: \"b17963a2-4797-4722-ae65-4ac1801913a5\") " pod="kube-system/global-pull-secret-syncer-r7d5c" Jul 02 23:07:05.815345 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.814409 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f946205c-023a-4a7d-9a6c-c40b23c3b771-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hhc6h\" (UID: \"f946205c-023a-4a7d-9a6c-c40b23c3b771\") " pod="openshift-ovn-kubernetes/ovnkube-node-hhc6h" Jul 02 23:07:05.815345 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.814442 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f66de8fe-bac5-43ab-80bd-f8b818e69f7b-host-slash\") pod \"iptables-alerter-2g949\" (UID: \"f66de8fe-bac5-43ab-80bd-f8b818e69f7b\") " pod="openshift-network-operator/iptables-alerter-2g949" Jul 02 23:07:05.815345 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.814434 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f946205c-023a-4a7d-9a6c-c40b23c3b771-env-overrides\") pod \"ovnkube-node-hhc6h\" (UID: \"f946205c-023a-4a7d-9a6c-c40b23c3b771\") " pod="openshift-ovn-kubernetes/ovnkube-node-hhc6h" Jul 02 23:07:05.815345 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.814471 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f946205c-023a-4a7d-9a6c-c40b23c3b771-host-cni-bin\") pod \"ovnkube-node-hhc6h\" (UID: \"f946205c-023a-4a7d-9a6c-c40b23c3b771\") " pod="openshift-ovn-kubernetes/ovnkube-node-hhc6h" Jul 02 23:07:05.815345 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.814523 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/74fc0401-b598-40fc-acca-508ba1a1c001-multus-socket-dir-parent\") pod \"multus-2jt79\" (UID: \"74fc0401-b598-40fc-acca-508ba1a1c001\") " pod="openshift-multus/multus-2jt79" Jul 02 23:07:05.815345 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.814553 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2d6bdb50-bc8b-4f01-b13c-8ff9cd87740f-os-release\") pod \"multus-additional-cni-plugins-97j6n\" (UID: \"2d6bdb50-bc8b-4f01-b13c-8ff9cd87740f\") " pod="openshift-multus/multus-additional-cni-plugins-97j6n" Jul 02 23:07:05.815931 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.814573 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f946205c-023a-4a7d-9a6c-c40b23c3b771-ovnkube-config\") pod \"ovnkube-node-hhc6h\" (UID: \"f946205c-023a-4a7d-9a6c-c40b23c3b771\") " pod="openshift-ovn-kubernetes/ovnkube-node-hhc6h" Jul 02 23:07:05.815931 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.814582 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2d6bdb50-bc8b-4f01-b13c-8ff9cd87740f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-97j6n\" (UID: \"2d6bdb50-bc8b-4f01-b13c-8ff9cd87740f\") " pod="openshift-multus/multus-additional-cni-plugins-97j6n" Jul 02 23:07:05.815931 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.814608 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5w9vd\" (UniqueName: \"kubernetes.io/projected/2d6bdb50-bc8b-4f01-b13c-8ff9cd87740f-kube-api-access-5w9vd\") pod \"multus-additional-cni-plugins-97j6n\" (UID: \"2d6bdb50-bc8b-4f01-b13c-8ff9cd87740f\") " pod="openshift-multus/multus-additional-cni-plugins-97j6n" Jul 02 23:07:05.815931 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.814643 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a6eddff0-475c-41b7-b072-e1cdd661392f-hosts-file\") pod \"node-resolver-q5c49\" (UID: \"a6eddff0-475c-41b7-b072-e1cdd661392f\") " pod="openshift-dns/node-resolver-q5c49" Jul 02 23:07:05.815931 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.814648 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a2a8144d-1894-42b4-be25-ae456f79f041-etc-sysctl-d\") pod \"tuned-47sfd\" (UID: \"a2a8144d-1894-42b4-be25-ae456f79f041\") " pod="openshift-cluster-node-tuning-operator/tuned-47sfd" Jul 02 23:07:05.815931 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.814669 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f946205c-023a-4a7d-9a6c-c40b23c3b771-host-cni-netd\") pod \"ovnkube-node-hhc6h\" (UID: \"f946205c-023a-4a7d-9a6c-c40b23c3b771\") " pod="openshift-ovn-kubernetes/ovnkube-node-hhc6h" Jul 02 23:07:05.815931 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.814675 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/74fc0401-b598-40fc-acca-508ba1a1c001-hostroot\") pod \"multus-2jt79\" (UID: \"74fc0401-b598-40fc-acca-508ba1a1c001\") " pod="openshift-multus/multus-2jt79" Jul 02 23:07:05.815931 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.814716 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f66de8fe-bac5-43ab-80bd-f8b818e69f7b-iptables-alerter-script\") pod \"iptables-alerter-2g949\" (UID: \"f66de8fe-bac5-43ab-80bd-f8b818e69f7b\") " pod="openshift-network-operator/iptables-alerter-2g949" Jul 02 23:07:05.815931 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.814765 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f946205c-023a-4a7d-9a6c-c40b23c3b771-var-lib-openvswitch\") pod \"ovnkube-node-hhc6h\" (UID: \"f946205c-023a-4a7d-9a6c-c40b23c3b771\") " pod="openshift-ovn-kubernetes/ovnkube-node-hhc6h" Jul 02 23:07:05.815931 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.814733 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/74fc0401-b598-40fc-acca-508ba1a1c001-hostroot\") pod \"multus-2jt79\" (UID: \"74fc0401-b598-40fc-acca-508ba1a1c001\") " pod="openshift-multus/multus-2jt79" Jul 02 23:07:05.815931 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.814814 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f946205c-023a-4a7d-9a6c-c40b23c3b771-host-run-netns\") pod \"ovnkube-node-hhc6h\" (UID: \"f946205c-023a-4a7d-9a6c-c40b23c3b771\") " pod="openshift-ovn-kubernetes/ovnkube-node-hhc6h" Jul 02 23:07:05.815931 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.814793 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4234f128-0de0-4ac9-b880-c2024b729867-registration-dir\") pod \"aws-ebs-csi-driver-node-wpqd6\" (UID: \"4234f128-0de0-4ac9-b880-c2024b729867\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wpqd6" Jul 02 23:07:05.815931 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.814782 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b08f4b68-d33f-48a2-90d0-0c6511ba679a-konnectivity-ca\") pod \"konnectivity-agent-z6p55\" (UID: \"b08f4b68-d33f-48a2-90d0-0c6511ba679a\") " pod="kube-system/konnectivity-agent-z6p55" Jul 02 23:07:05.815931 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.814855 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4234f128-0de0-4ac9-b880-c2024b729867-device-dir\") pod \"aws-ebs-csi-driver-node-wpqd6\" (UID: \"4234f128-0de0-4ac9-b880-c2024b729867\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wpqd6" Jul 02 23:07:05.815931 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.814997 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4234f128-0de0-4ac9-b880-c2024b729867-etc-selinux\") pod \"aws-ebs-csi-driver-node-wpqd6\" (UID: \"4234f128-0de0-4ac9-b880-c2024b729867\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wpqd6" Jul 02 23:07:05.815931 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.815040 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7frtk\" (UniqueName: \"kubernetes.io/projected/0ecba3b1-7f8d-4896-8c34-967f37704feb-kube-api-access-7frtk\") pod \"network-check-target-jxwvg\" (UID: \"0ecba3b1-7f8d-4896-8c34-967f37704feb\") " pod="openshift-network-diagnostics/network-check-target-jxwvg" Jul 02 23:07:05.815931 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.815096 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/74fc0401-b598-40fc-acca-508ba1a1c001-cni-binary-copy\") pod \"multus-2jt79\" (UID: \"74fc0401-b598-40fc-acca-508ba1a1c001\") " pod="openshift-multus/multus-2jt79" Jul 02 23:07:05.816562 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:05.815182 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b17963a2-4797-4722-ae65-4ac1801913a5-original-pull-secret podName:b17963a2-4797-4722-ae65-4ac1801913a5 nodeName:}" failed. No retries permitted until 2026-07-02 23:07:06.315146173 +0000 UTC m=+2.948187312 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b17963a2-4797-4722-ae65-4ac1801913a5-original-pull-secret") pod "global-pull-secret-syncer-r7d5c" (UID: "b17963a2-4797-4722-ae65-4ac1801913a5") : object "kube-system"/"original-pull-secret" not registered Jul 02 23:07:05.816562 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.815268 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f946205c-023a-4a7d-9a6c-c40b23c3b771-ovnkube-script-lib\") pod \"ovnkube-node-hhc6h\" (UID: \"f946205c-023a-4a7d-9a6c-c40b23c3b771\") " pod="openshift-ovn-kubernetes/ovnkube-node-hhc6h" Jul 02 23:07:05.816562 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.815283 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a6eddff0-475c-41b7-b072-e1cdd661392f-tmp-dir\") pod \"node-resolver-q5c49\" (UID: \"a6eddff0-475c-41b7-b072-e1cdd661392f\") " pod="openshift-dns/node-resolver-q5c49" Jul 02 23:07:05.816562 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.815307 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a2a8144d-1894-42b4-be25-ae456f79f041-var-lib-kubelet\") pod \"tuned-47sfd\" (UID: \"a2a8144d-1894-42b4-be25-ae456f79f041\") " pod="openshift-cluster-node-tuning-operator/tuned-47sfd" Jul 02 23:07:05.816562 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.815332 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a2a8144d-1894-42b4-be25-ae456f79f041-run\") pod \"tuned-47sfd\" (UID: \"a2a8144d-1894-42b4-be25-ae456f79f041\") " pod="openshift-cluster-node-tuning-operator/tuned-47sfd" Jul 02 23:07:05.816562 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.815370 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f946205c-023a-4a7d-9a6c-c40b23c3b771-var-lib-openvswitch\") pod \"ovnkube-node-hhc6h\" (UID: \"f946205c-023a-4a7d-9a6c-c40b23c3b771\") " pod="openshift-ovn-kubernetes/ovnkube-node-hhc6h" Jul 02 23:07:05.816562 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.815417 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a2a8144d-1894-42b4-be25-ae456f79f041-etc-sysctl-d\") pod \"tuned-47sfd\" (UID: \"a2a8144d-1894-42b4-be25-ae456f79f041\") " pod="openshift-cluster-node-tuning-operator/tuned-47sfd" Jul 02 23:07:05.816562 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.815423 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/74fc0401-b598-40fc-acca-508ba1a1c001-cnibin\") pod \"multus-2jt79\" (UID: \"74fc0401-b598-40fc-acca-508ba1a1c001\") " pod="openshift-multus/multus-2jt79" Jul 02 23:07:05.816562 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.815458 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/74fc0401-b598-40fc-acca-508ba1a1c001-host-var-lib-kubelet\") pod \"multus-2jt79\" (UID: \"74fc0401-b598-40fc-acca-508ba1a1c001\") " pod="openshift-multus/multus-2jt79" Jul 02 23:07:05.816562 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:05.815493 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 23:07:05.816562 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.815498 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/74fc0401-b598-40fc-acca-508ba1a1c001-host-run-multus-certs\") pod \"multus-2jt79\" (UID: \"74fc0401-b598-40fc-acca-508ba1a1c001\") " pod="openshift-multus/multus-2jt79" Jul 02 23:07:05.816562 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.815540 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/74fc0401-b598-40fc-acca-508ba1a1c001-host-run-netns\") pod \"multus-2jt79\" (UID: \"74fc0401-b598-40fc-acca-508ba1a1c001\") " pod="openshift-multus/multus-2jt79" Jul 02 23:07:05.816562 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:05.815544 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fad8c2d0-090a-4bac-8774-26cac496f9f7-metrics-certs podName:fad8c2d0-090a-4bac-8774-26cac496f9f7 nodeName:}" failed. No retries permitted until 2026-07-02 23:07:06.315525894 +0000 UTC m=+2.948567018 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fad8c2d0-090a-4bac-8774-26cac496f9f7-metrics-certs") pod "network-metrics-daemon-tzfzk" (UID: "fad8c2d0-090a-4bac-8774-26cac496f9f7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 23:07:05.816562 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.815589 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/74fc0401-b598-40fc-acca-508ba1a1c001-system-cni-dir\") pod \"multus-2jt79\" (UID: \"74fc0401-b598-40fc-acca-508ba1a1c001\") " pod="openshift-multus/multus-2jt79" Jul 02 23:07:05.816562 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.815827 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f66de8fe-bac5-43ab-80bd-f8b818e69f7b-iptables-alerter-script\") pod \"iptables-alerter-2g949\" (UID: \"f66de8fe-bac5-43ab-80bd-f8b818e69f7b\") " pod="openshift-network-operator/iptables-alerter-2g949" Jul 02 23:07:05.817414 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.816759 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a2a8144d-1894-42b4-be25-ae456f79f041-tmp\") pod \"tuned-47sfd\" (UID: \"a2a8144d-1894-42b4-be25-ae456f79f041\") " pod="openshift-cluster-node-tuning-operator/tuned-47sfd" Jul 02 23:07:05.817414 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.816918 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a2a8144d-1894-42b4-be25-ae456f79f041-etc-tuned\") pod \"tuned-47sfd\" (UID: \"a2a8144d-1894-42b4-be25-ae456f79f041\") " pod="openshift-cluster-node-tuning-operator/tuned-47sfd" Jul 02 23:07:05.817850 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.817828 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b08f4b68-d33f-48a2-90d0-0c6511ba679a-agent-certs\") pod \"konnectivity-agent-z6p55\" (UID: \"b08f4b68-d33f-48a2-90d0-0c6511ba679a\") " pod="kube-system/konnectivity-agent-z6p55" Jul 02 23:07:05.818506 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.818483 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f946205c-023a-4a7d-9a6c-c40b23c3b771-ovn-node-metrics-cert\") pod \"ovnkube-node-hhc6h\" (UID: \"f946205c-023a-4a7d-9a6c-c40b23c3b771\") " pod="openshift-ovn-kubernetes/ovnkube-node-hhc6h" Jul 02 23:07:05.823135 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.822659 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fz4zb\" (UniqueName: \"kubernetes.io/projected/a6eddff0-475c-41b7-b072-e1cdd661392f-kube-api-access-fz4zb\") pod \"node-resolver-q5c49\" (UID: \"a6eddff0-475c-41b7-b072-e1cdd661392f\") " pod="openshift-dns/node-resolver-q5c49" Jul 02 23:07:05.823135 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.822866 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckl2l\" (UniqueName: \"kubernetes.io/projected/a2a8144d-1894-42b4-be25-ae456f79f041-kube-api-access-ckl2l\") pod \"tuned-47sfd\" (UID: \"a2a8144d-1894-42b4-be25-ae456f79f041\") " pod="openshift-cluster-node-tuning-operator/tuned-47sfd" Jul 02 23:07:05.823135 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.823057 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6qrt\" (UniqueName: \"kubernetes.io/projected/f946205c-023a-4a7d-9a6c-c40b23c3b771-kube-api-access-w6qrt\") pod \"ovnkube-node-hhc6h\" (UID: \"f946205c-023a-4a7d-9a6c-c40b23c3b771\") " pod="openshift-ovn-kubernetes/ovnkube-node-hhc6h" Jul 02 23:07:05.823455 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.823434 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hjpt4\" (UniqueName: \"kubernetes.io/projected/74fc0401-b598-40fc-acca-508ba1a1c001-kube-api-access-hjpt4\") pod \"multus-2jt79\" (UID: \"74fc0401-b598-40fc-acca-508ba1a1c001\") " pod="openshift-multus/multus-2jt79" Jul 02 23:07:05.824423 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.824399 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s6cbq\" (UniqueName: \"kubernetes.io/projected/fad8c2d0-090a-4bac-8774-26cac496f9f7-kube-api-access-s6cbq\") pod \"network-metrics-daemon-tzfzk\" (UID: \"fad8c2d0-090a-4bac-8774-26cac496f9f7\") " pod="openshift-multus/network-metrics-daemon-tzfzk" Jul 02 23:07:05.826407 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.826385 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4lx6m\" (UniqueName: \"kubernetes.io/projected/f66de8fe-bac5-43ab-80bd-f8b818e69f7b-kube-api-access-4lx6m\") pod \"iptables-alerter-2g949\" (UID: \"f66de8fe-bac5-43ab-80bd-f8b818e69f7b\") " pod="openshift-network-operator/iptables-alerter-2g949" Jul 02 23:07:05.827143 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:05.827125 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 23:07:05.827223 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:05.827151 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 23:07:05.827223 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:05.827166 2563 projected.go:196] Error preparing data for projected volume kube-api-access-7frtk for pod openshift-network-diagnostics/network-check-target-jxwvg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 23:07:05.827306 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:05.827238 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0ecba3b1-7f8d-4896-8c34-967f37704feb-kube-api-access-7frtk podName:0ecba3b1-7f8d-4896-8c34-967f37704feb nodeName:}" failed. No retries permitted until 2026-07-02 23:07:06.327221497 +0000 UTC m=+2.960262639 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-7frtk" (UniqueName: "kubernetes.io/projected/0ecba3b1-7f8d-4896-8c34-967f37704feb-kube-api-access-7frtk") pod "network-check-target-jxwvg" (UID: "0ecba3b1-7f8d-4896-8c34-967f37704feb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 23:07:05.848150 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.848092 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-33.ec2.internal" event={"ID":"398da86d6561510d06f9aff443828ae1","Type":"ContainerStarted","Data":"c0cb30c82eb7c5f8661cf40476de7f52f86b72b87a3f3c906f9fcf3384e8180a"} Jul 02 23:07:05.849818 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.849788 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-33.ec2.internal" event={"ID":"9c4e7fa9daec587c25fb6cbf2b540d88","Type":"ContainerStarted","Data":"8d0668f9682971b671687e9ab4d7074db1ba0bddf40d3de346a61d1ca735e73f"} Jul 02 23:07:05.916234 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.916202 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rbmh5\" (UniqueName: \"kubernetes.io/projected/4c2848a5-a93f-4b79-be6e-31d430c7839d-kube-api-access-rbmh5\") pod \"node-ca-m5zq4\" (UID: \"4c2848a5-a93f-4b79-be6e-31d430c7839d\") " pod="openshift-image-registry/node-ca-m5zq4" Jul 02 23:07:05.916387 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.916242 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2d6bdb50-bc8b-4f01-b13c-8ff9cd87740f-os-release\") pod \"multus-additional-cni-plugins-97j6n\" (UID: \"2d6bdb50-bc8b-4f01-b13c-8ff9cd87740f\") " pod="openshift-multus/multus-additional-cni-plugins-97j6n" Jul 02 23:07:05.916387 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.916267 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2d6bdb50-bc8b-4f01-b13c-8ff9cd87740f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-97j6n\" (UID: \"2d6bdb50-bc8b-4f01-b13c-8ff9cd87740f\") " pod="openshift-multus/multus-additional-cni-plugins-97j6n" Jul 02 23:07:05.916387 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.916292 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5w9vd\" (UniqueName: \"kubernetes.io/projected/2d6bdb50-bc8b-4f01-b13c-8ff9cd87740f-kube-api-access-5w9vd\") pod \"multus-additional-cni-plugins-97j6n\" (UID: \"2d6bdb50-bc8b-4f01-b13c-8ff9cd87740f\") " pod="openshift-multus/multus-additional-cni-plugins-97j6n" Jul 02 23:07:05.916387 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.916320 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4234f128-0de0-4ac9-b880-c2024b729867-registration-dir\") pod \"aws-ebs-csi-driver-node-wpqd6\" (UID: \"4234f128-0de0-4ac9-b880-c2024b729867\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wpqd6" Jul 02 23:07:05.916387 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.916341 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4234f128-0de0-4ac9-b880-c2024b729867-device-dir\") pod \"aws-ebs-csi-driver-node-wpqd6\" (UID: \"4234f128-0de0-4ac9-b880-c2024b729867\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wpqd6" Jul 02 23:07:05.916387 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.916350 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2d6bdb50-bc8b-4f01-b13c-8ff9cd87740f-os-release\") pod \"multus-additional-cni-plugins-97j6n\" (UID: \"2d6bdb50-bc8b-4f01-b13c-8ff9cd87740f\") " pod="openshift-multus/multus-additional-cni-plugins-97j6n" Jul 02 23:07:05.916387 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.916360 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4234f128-0de0-4ac9-b880-c2024b729867-etc-selinux\") pod \"aws-ebs-csi-driver-node-wpqd6\" (UID: \"4234f128-0de0-4ac9-b880-c2024b729867\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wpqd6" Jul 02 23:07:05.916728 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.916429 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97hv9\" (UniqueName: \"kubernetes.io/projected/4234f128-0de0-4ac9-b880-c2024b729867-kube-api-access-97hv9\") pod \"aws-ebs-csi-driver-node-wpqd6\" (UID: \"4234f128-0de0-4ac9-b880-c2024b729867\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wpqd6" Jul 02 23:07:05.916728 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.916457 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2d6bdb50-bc8b-4f01-b13c-8ff9cd87740f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-97j6n\" (UID: \"2d6bdb50-bc8b-4f01-b13c-8ff9cd87740f\") " pod="openshift-multus/multus-additional-cni-plugins-97j6n" Jul 02 23:07:05.916728 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.916466 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4234f128-0de0-4ac9-b880-c2024b729867-etc-selinux\") pod \"aws-ebs-csi-driver-node-wpqd6\" (UID: \"4234f128-0de0-4ac9-b880-c2024b729867\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wpqd6" Jul 02 23:07:05.916728 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.916485 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4234f128-0de0-4ac9-b880-c2024b729867-socket-dir\") pod \"aws-ebs-csi-driver-node-wpqd6\" (UID: \"4234f128-0de0-4ac9-b880-c2024b729867\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wpqd6" Jul 02 23:07:05.916728 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.916510 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2d6bdb50-bc8b-4f01-b13c-8ff9cd87740f-cnibin\") pod \"multus-additional-cni-plugins-97j6n\" (UID: \"2d6bdb50-bc8b-4f01-b13c-8ff9cd87740f\") " pod="openshift-multus/multus-additional-cni-plugins-97j6n" Jul 02 23:07:05.916728 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.916523 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4234f128-0de0-4ac9-b880-c2024b729867-registration-dir\") pod \"aws-ebs-csi-driver-node-wpqd6\" (UID: \"4234f128-0de0-4ac9-b880-c2024b729867\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wpqd6" Jul 02 23:07:05.916728 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.916534 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4c2848a5-a93f-4b79-be6e-31d430c7839d-serviceca\") pod \"node-ca-m5zq4\" (UID: \"4c2848a5-a93f-4b79-be6e-31d430c7839d\") " pod="openshift-image-registry/node-ca-m5zq4" Jul 02 23:07:05.916728 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.916561 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2d6bdb50-bc8b-4f01-b13c-8ff9cd87740f-system-cni-dir\") pod \"multus-additional-cni-plugins-97j6n\" (UID: \"2d6bdb50-bc8b-4f01-b13c-8ff9cd87740f\") " pod="openshift-multus/multus-additional-cni-plugins-97j6n" Jul 02 23:07:05.916728 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.916591 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4234f128-0de0-4ac9-b880-c2024b729867-device-dir\") pod \"aws-ebs-csi-driver-node-wpqd6\" (UID: \"4234f128-0de0-4ac9-b880-c2024b729867\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wpqd6" Jul 02 23:07:05.916728 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.916592 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4234f128-0de0-4ac9-b880-c2024b729867-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wpqd6\" (UID: \"4234f128-0de0-4ac9-b880-c2024b729867\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wpqd6" Jul 02 23:07:05.916728 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.916630 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4234f128-0de0-4ac9-b880-c2024b729867-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wpqd6\" (UID: \"4234f128-0de0-4ac9-b880-c2024b729867\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wpqd6" Jul 02 23:07:05.916728 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.916642 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4c2848a5-a93f-4b79-be6e-31d430c7839d-host\") pod \"node-ca-m5zq4\" (UID: \"4c2848a5-a93f-4b79-be6e-31d430c7839d\") " pod="openshift-image-registry/node-ca-m5zq4" Jul 02 23:07:05.916728 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.916669 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2d6bdb50-bc8b-4f01-b13c-8ff9cd87740f-cnibin\") pod \"multus-additional-cni-plugins-97j6n\" (UID: \"2d6bdb50-bc8b-4f01-b13c-8ff9cd87740f\") " pod="openshift-multus/multus-additional-cni-plugins-97j6n" Jul 02 23:07:05.916728 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.916691 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2d6bdb50-bc8b-4f01-b13c-8ff9cd87740f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-97j6n\" (UID: \"2d6bdb50-bc8b-4f01-b13c-8ff9cd87740f\") " pod="openshift-multus/multus-additional-cni-plugins-97j6n" Jul 02 23:07:05.916728 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.916696 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4234f128-0de0-4ac9-b880-c2024b729867-socket-dir\") pod \"aws-ebs-csi-driver-node-wpqd6\" (UID: \"4234f128-0de0-4ac9-b880-c2024b729867\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wpqd6" Jul 02 23:07:05.916728 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.916722 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2d6bdb50-bc8b-4f01-b13c-8ff9cd87740f-cni-binary-copy\") pod \"multus-additional-cni-plugins-97j6n\" (UID: \"2d6bdb50-bc8b-4f01-b13c-8ff9cd87740f\") " pod="openshift-multus/multus-additional-cni-plugins-97j6n" Jul 02 23:07:05.917443 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.916776 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4234f128-0de0-4ac9-b880-c2024b729867-sys-fs\") pod \"aws-ebs-csi-driver-node-wpqd6\" (UID: \"4234f128-0de0-4ac9-b880-c2024b729867\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wpqd6" Jul 02 23:07:05.917443 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.916892 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4234f128-0de0-4ac9-b880-c2024b729867-sys-fs\") pod \"aws-ebs-csi-driver-node-wpqd6\" (UID: \"4234f128-0de0-4ac9-b880-c2024b729867\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wpqd6" Jul 02 23:07:05.917443 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.916941 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4c2848a5-a93f-4b79-be6e-31d430c7839d-host\") pod \"node-ca-m5zq4\" (UID: \"4c2848a5-a93f-4b79-be6e-31d430c7839d\") " pod="openshift-image-registry/node-ca-m5zq4" Jul 02 23:07:05.917443 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.917077 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2d6bdb50-bc8b-4f01-b13c-8ff9cd87740f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-97j6n\" (UID: \"2d6bdb50-bc8b-4f01-b13c-8ff9cd87740f\") " pod="openshift-multus/multus-additional-cni-plugins-97j6n" Jul 02 23:07:05.917443 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.917090 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4c2848a5-a93f-4b79-be6e-31d430c7839d-serviceca\") pod \"node-ca-m5zq4\" (UID: \"4c2848a5-a93f-4b79-be6e-31d430c7839d\") " pod="openshift-image-registry/node-ca-m5zq4" Jul 02 23:07:05.917443 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.917110 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2d6bdb50-bc8b-4f01-b13c-8ff9cd87740f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-97j6n\" (UID: \"2d6bdb50-bc8b-4f01-b13c-8ff9cd87740f\") " pod="openshift-multus/multus-additional-cni-plugins-97j6n" Jul 02 23:07:05.917443 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.917135 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2d6bdb50-bc8b-4f01-b13c-8ff9cd87740f-system-cni-dir\") pod \"multus-additional-cni-plugins-97j6n\" (UID: \"2d6bdb50-bc8b-4f01-b13c-8ff9cd87740f\") " pod="openshift-multus/multus-additional-cni-plugins-97j6n" Jul 02 23:07:05.917443 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.917366 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2d6bdb50-bc8b-4f01-b13c-8ff9cd87740f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-97j6n\" (UID: \"2d6bdb50-bc8b-4f01-b13c-8ff9cd87740f\") " pod="openshift-multus/multus-additional-cni-plugins-97j6n" Jul 02 23:07:05.917752 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.917457 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2d6bdb50-bc8b-4f01-b13c-8ff9cd87740f-cni-binary-copy\") pod \"multus-additional-cni-plugins-97j6n\" (UID: \"2d6bdb50-bc8b-4f01-b13c-8ff9cd87740f\") " pod="openshift-multus/multus-additional-cni-plugins-97j6n" Jul 02 23:07:05.924716 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.924687 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rbmh5\" (UniqueName: \"kubernetes.io/projected/4c2848a5-a93f-4b79-be6e-31d430c7839d-kube-api-access-rbmh5\") pod \"node-ca-m5zq4\" (UID: \"4c2848a5-a93f-4b79-be6e-31d430c7839d\") " pod="openshift-image-registry/node-ca-m5zq4" Jul 02 23:07:05.924926 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.924908 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5w9vd\" (UniqueName: \"kubernetes.io/projected/2d6bdb50-bc8b-4f01-b13c-8ff9cd87740f-kube-api-access-5w9vd\") pod \"multus-additional-cni-plugins-97j6n\" (UID: \"2d6bdb50-bc8b-4f01-b13c-8ff9cd87740f\") " pod="openshift-multus/multus-additional-cni-plugins-97j6n" Jul 02 23:07:05.926865 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.926844 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-97hv9\" (UniqueName: \"kubernetes.io/projected/4234f128-0de0-4ac9-b880-c2024b729867-kube-api-access-97hv9\") pod \"aws-ebs-csi-driver-node-wpqd6\" (UID: \"4234f128-0de0-4ac9-b880-c2024b729867\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wpqd6" Jul 02 23:07:05.998819 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:05.998778 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-2g949" Jul 02 23:07:06.008716 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:06.008695 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-47sfd" Jul 02 23:07:06.017547 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:06.017532 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-q5c49" Jul 02 23:07:06.023336 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:06.023312 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2jt79" Jul 02 23:07:06.032086 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:06.032066 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-hhc6h" Jul 02 23:07:06.041039 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:06.041017 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-z6p55" Jul 02 23:07:06.058810 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:06.058758 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wpqd6" Jul 02 23:07:06.065637 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:06.065617 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-m5zq4" Jul 02 23:07:06.072253 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:06.072232 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-97j6n" Jul 02 23:07:06.319608 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:06.319537 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b17963a2-4797-4722-ae65-4ac1801913a5-original-pull-secret\") pod \"global-pull-secret-syncer-r7d5c\" (UID: \"b17963a2-4797-4722-ae65-4ac1801913a5\") " pod="kube-system/global-pull-secret-syncer-r7d5c" Jul 02 23:07:06.319608 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:06.319571 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fad8c2d0-090a-4bac-8774-26cac496f9f7-metrics-certs\") pod \"network-metrics-daemon-tzfzk\" (UID: \"fad8c2d0-090a-4bac-8774-26cac496f9f7\") " pod="openshift-multus/network-metrics-daemon-tzfzk" Jul 02 23:07:06.319798 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:06.319686 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 23:07:06.319798 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:06.319686 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 23:07:06.319798 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:06.319765 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b17963a2-4797-4722-ae65-4ac1801913a5-original-pull-secret podName:b17963a2-4797-4722-ae65-4ac1801913a5 nodeName:}" failed. No retries permitted until 2026-07-02 23:07:07.319731172 +0000 UTC m=+3.952772293 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b17963a2-4797-4722-ae65-4ac1801913a5-original-pull-secret") pod "global-pull-secret-syncer-r7d5c" (UID: "b17963a2-4797-4722-ae65-4ac1801913a5") : object "kube-system"/"original-pull-secret" not registered Jul 02 23:07:06.319798 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:06.319786 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fad8c2d0-090a-4bac-8774-26cac496f9f7-metrics-certs podName:fad8c2d0-090a-4bac-8774-26cac496f9f7 nodeName:}" failed. No retries permitted until 2026-07-02 23:07:07.319776548 +0000 UTC m=+3.952817685 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fad8c2d0-090a-4bac-8774-26cac496f9f7-metrics-certs") pod "network-metrics-daemon-tzfzk" (UID: "fad8c2d0-090a-4bac-8774-26cac496f9f7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 23:07:06.420260 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:06.420228 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7frtk\" (UniqueName: \"kubernetes.io/projected/0ecba3b1-7f8d-4896-8c34-967f37704feb-kube-api-access-7frtk\") pod \"network-check-target-jxwvg\" (UID: \"0ecba3b1-7f8d-4896-8c34-967f37704feb\") " pod="openshift-network-diagnostics/network-check-target-jxwvg" Jul 02 23:07:06.420440 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:06.420410 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 23:07:06.420440 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:06.420432 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 23:07:06.420525 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:06.420446 2563 projected.go:196] Error preparing data for projected volume kube-api-access-7frtk for pod openshift-network-diagnostics/network-check-target-jxwvg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 23:07:06.420571 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:06.420524 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0ecba3b1-7f8d-4896-8c34-967f37704feb-kube-api-access-7frtk podName:0ecba3b1-7f8d-4896-8c34-967f37704feb nodeName:}" failed. No retries permitted until 2026-07-02 23:07:07.420492613 +0000 UTC m=+4.053533757 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-7frtk" (UniqueName: "kubernetes.io/projected/0ecba3b1-7f8d-4896-8c34-967f37704feb-kube-api-access-7frtk") pod "network-check-target-jxwvg" (UID: "0ecba3b1-7f8d-4896-8c34-967f37704feb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 23:07:06.742441 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:06.742400 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-01 23:02:05 +0000 UTC" deadline="2028-01-13 07:28:06.605734502 +0000 UTC" Jul 02 23:07:06.742441 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:06.742437 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13424h20m59.863301602s" Jul 02 23:07:06.843224 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:06.843141 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r7d5c" Jul 02 23:07:06.843388 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:06.843143 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tzfzk" Jul 02 23:07:06.843388 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:06.843247 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r7d5c" podUID="b17963a2-4797-4722-ae65-4ac1801913a5" Jul 02 23:07:06.843388 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:06.843329 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tzfzk" podUID="fad8c2d0-090a-4bac-8774-26cac496f9f7" Jul 02 23:07:06.947794 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:06.947772 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74fc0401_b598_40fc_acca_508ba1a1c001.slice/crio-9149d18f2be7b21b61ecb595169f60c0ff8157b684654f289ff2bde18f5a8316 WatchSource:0}: Error finding container 9149d18f2be7b21b61ecb595169f60c0ff8157b684654f289ff2bde18f5a8316: Status 404 returned error can't find the container with id 9149d18f2be7b21b61ecb595169f60c0ff8157b684654f289ff2bde18f5a8316 Jul 02 23:07:06.949717 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:06.949683 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4234f128_0de0_4ac9_b880_c2024b729867.slice/crio-41eeba170a5f20aaa99383240c036d8a89b6c9a9b72305e292c49672ce42dee1 WatchSource:0}: Error finding container 41eeba170a5f20aaa99383240c036d8a89b6c9a9b72305e292c49672ce42dee1: Status 404 returned error can't find the container with id 41eeba170a5f20aaa99383240c036d8a89b6c9a9b72305e292c49672ce42dee1 Jul 02 23:07:06.950467 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:06.950442 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf946205c_023a_4a7d_9a6c_c40b23c3b771.slice/crio-b73d7956acd87cd0270b56fb6210497d875ebc02e22411ac6b148cdaa1a54388 WatchSource:0}: Error finding container b73d7956acd87cd0270b56fb6210497d875ebc02e22411ac6b148cdaa1a54388: Status 404 returned error can't find the container with id b73d7956acd87cd0270b56fb6210497d875ebc02e22411ac6b148cdaa1a54388 Jul 02 23:07:06.951909 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:06.951779 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c2848a5_a93f_4b79_be6e_31d430c7839d.slice/crio-ad16067683cae546f4e4cb287cf8b205f1c43cd1004cdf36cf786ed6bc8e3906 WatchSource:0}: Error finding container ad16067683cae546f4e4cb287cf8b205f1c43cd1004cdf36cf786ed6bc8e3906: Status 404 returned error can't find the container with id ad16067683cae546f4e4cb287cf8b205f1c43cd1004cdf36cf786ed6bc8e3906 Jul 02 23:07:06.953727 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:06.953678 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb08f4b68_d33f_48a2_90d0_0c6511ba679a.slice/crio-cebdcf7712260ddd43e5d423515c53f311d42ded3ea3c87a5586e20fcf39ce87 WatchSource:0}: Error finding container cebdcf7712260ddd43e5d423515c53f311d42ded3ea3c87a5586e20fcf39ce87: Status 404 returned error can't find the container with id cebdcf7712260ddd43e5d423515c53f311d42ded3ea3c87a5586e20fcf39ce87 Jul 02 23:07:06.955008 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:06.954984 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf66de8fe_bac5_43ab_80bd_f8b818e69f7b.slice/crio-6676d17dcdfaf0acdd5d94c20a939d64587fa7fa3370f47069222185bce1bfa2 WatchSource:0}: Error finding container 6676d17dcdfaf0acdd5d94c20a939d64587fa7fa3370f47069222185bce1bfa2: Status 404 returned error can't find the container with id 6676d17dcdfaf0acdd5d94c20a939d64587fa7fa3370f47069222185bce1bfa2 Jul 02 23:07:07.324926 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:07.324700 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b17963a2-4797-4722-ae65-4ac1801913a5-original-pull-secret\") pod \"global-pull-secret-syncer-r7d5c\" (UID: \"b17963a2-4797-4722-ae65-4ac1801913a5\") " pod="kube-system/global-pull-secret-syncer-r7d5c" Jul 02 23:07:07.325087 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:07.324947 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fad8c2d0-090a-4bac-8774-26cac496f9f7-metrics-certs\") pod \"network-metrics-daemon-tzfzk\" (UID: \"fad8c2d0-090a-4bac-8774-26cac496f9f7\") " pod="openshift-multus/network-metrics-daemon-tzfzk" Jul 02 23:07:07.325087 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:07.324860 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 23:07:07.325087 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:07.325016 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b17963a2-4797-4722-ae65-4ac1801913a5-original-pull-secret podName:b17963a2-4797-4722-ae65-4ac1801913a5 nodeName:}" failed. No retries permitted until 2026-07-02 23:07:09.324997788 +0000 UTC m=+5.958038911 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b17963a2-4797-4722-ae65-4ac1801913a5-original-pull-secret") pod "global-pull-secret-syncer-r7d5c" (UID: "b17963a2-4797-4722-ae65-4ac1801913a5") : object "kube-system"/"original-pull-secret" not registered Jul 02 23:07:07.325236 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:07.325095 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 23:07:07.325236 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:07.325140 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fad8c2d0-090a-4bac-8774-26cac496f9f7-metrics-certs podName:fad8c2d0-090a-4bac-8774-26cac496f9f7 nodeName:}" failed. No retries permitted until 2026-07-02 23:07:09.325127566 +0000 UTC m=+5.958168688 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fad8c2d0-090a-4bac-8774-26cac496f9f7-metrics-certs") pod "network-metrics-daemon-tzfzk" (UID: "fad8c2d0-090a-4bac-8774-26cac496f9f7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 23:07:07.425966 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:07.425881 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7frtk\" (UniqueName: \"kubernetes.io/projected/0ecba3b1-7f8d-4896-8c34-967f37704feb-kube-api-access-7frtk\") pod \"network-check-target-jxwvg\" (UID: \"0ecba3b1-7f8d-4896-8c34-967f37704feb\") " pod="openshift-network-diagnostics/network-check-target-jxwvg" Jul 02 23:07:07.426099 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:07.426052 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 23:07:07.426099 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:07.426076 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 23:07:07.426099 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:07.426087 2563 projected.go:196] Error preparing data for projected volume kube-api-access-7frtk for pod openshift-network-diagnostics/network-check-target-jxwvg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 23:07:07.426195 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:07.426132 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0ecba3b1-7f8d-4896-8c34-967f37704feb-kube-api-access-7frtk podName:0ecba3b1-7f8d-4896-8c34-967f37704feb nodeName:}" failed. No retries permitted until 2026-07-02 23:07:09.426118388 +0000 UTC m=+6.059159522 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-7frtk" (UniqueName: "kubernetes.io/projected/0ecba3b1-7f8d-4896-8c34-967f37704feb-kube-api-access-7frtk") pod "network-check-target-jxwvg" (UID: "0ecba3b1-7f8d-4896-8c34-967f37704feb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 23:07:07.743335 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:07.743227 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-01 23:02:05 +0000 UTC" deadline="2028-01-22 04:42:05.146357904 +0000 UTC" Jul 02 23:07:07.743335 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:07.743288 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13637h34m57.403074356s" Jul 02 23:07:07.845107 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:07.845079 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jxwvg" Jul 02 23:07:07.845274 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:07.845221 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jxwvg" podUID="0ecba3b1-7f8d-4896-8c34-967f37704feb" Jul 02 23:07:07.855229 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:07.855196 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-m5zq4" event={"ID":"4c2848a5-a93f-4b79-be6e-31d430c7839d","Type":"ContainerStarted","Data":"ad16067683cae546f4e4cb287cf8b205f1c43cd1004cdf36cf786ed6bc8e3906"} Jul 02 23:07:07.859620 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:07.859587 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hhc6h" event={"ID":"f946205c-023a-4a7d-9a6c-c40b23c3b771","Type":"ContainerStarted","Data":"b73d7956acd87cd0270b56fb6210497d875ebc02e22411ac6b148cdaa1a54388"} Jul 02 23:07:07.870048 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:07.870016 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wpqd6" event={"ID":"4234f128-0de0-4ac9-b880-c2024b729867","Type":"ContainerStarted","Data":"41eeba170a5f20aaa99383240c036d8a89b6c9a9b72305e292c49672ce42dee1"} Jul 02 23:07:07.878216 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:07.878186 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-47sfd" event={"ID":"a2a8144d-1894-42b4-be25-ae456f79f041","Type":"ContainerStarted","Data":"283c5521c097f2bf029cae55c905b89b992946f0ea74bffc0f4ba58f1342578a"} Jul 02 23:07:07.881086 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:07.881058 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-97j6n" event={"ID":"2d6bdb50-bc8b-4f01-b13c-8ff9cd87740f","Type":"ContainerStarted","Data":"7163e68f6122fd37f909dc6f685d882d9da08d2fb16f23a066c481a19ab30b75"} Jul 02 23:07:07.886241 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:07.886215 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-2g949" event={"ID":"f66de8fe-bac5-43ab-80bd-f8b818e69f7b","Type":"ContainerStarted","Data":"6676d17dcdfaf0acdd5d94c20a939d64587fa7fa3370f47069222185bce1bfa2"} Jul 02 23:07:07.887906 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:07.887880 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2jt79" event={"ID":"74fc0401-b598-40fc-acca-508ba1a1c001","Type":"ContainerStarted","Data":"9149d18f2be7b21b61ecb595169f60c0ff8157b684654f289ff2bde18f5a8316"} Jul 02 23:07:07.896043 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:07.896015 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-33.ec2.internal" event={"ID":"398da86d6561510d06f9aff443828ae1","Type":"ContainerStarted","Data":"409feeda41ca903a770060896a49bf53d97e8569a10381c6d9c58cb06e45b0d6"} Jul 02 23:07:07.921998 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:07.921659 2563 generic.go:356] "Generic (PLEG): container finished" podID="9c4e7fa9daec587c25fb6cbf2b540d88" containerID="188e69b0d82ab09e41dfc47dce940814703803c1544d09934b2fc8f2621ae727" exitCode=0 Jul 02 23:07:07.921998 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:07.921771 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-33.ec2.internal" event={"ID":"9c4e7fa9daec587c25fb6cbf2b540d88","Type":"ContainerDied","Data":"188e69b0d82ab09e41dfc47dce940814703803c1544d09934b2fc8f2621ae727"} Jul 02 23:07:07.925619 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:07.924707 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-q5c49" event={"ID":"a6eddff0-475c-41b7-b072-e1cdd661392f","Type":"ContainerStarted","Data":"53b6e61a119d5643fc17d50c97bb6e17f8fcbf6a90aa6c0ef20384fa5c2be7b7"} Jul 02 23:07:07.934557 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:07.934456 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-z6p55" event={"ID":"b08f4b68-d33f-48a2-90d0-0c6511ba679a","Type":"ContainerStarted","Data":"cebdcf7712260ddd43e5d423515c53f311d42ded3ea3c87a5586e20fcf39ce87"} Jul 02 23:07:07.938115 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:07.937959 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-33.ec2.internal" podStartSLOduration=2.937942575 podStartE2EDuration="2.937942575s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 23:07:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:07:07.912242252 +0000 UTC m=+4.545283397" watchObservedRunningTime="2026-07-02 23:07:07.937942575 +0000 UTC m=+4.570983718" Jul 02 23:07:08.843444 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:08.842756 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r7d5c" Jul 02 23:07:08.843444 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:08.842886 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r7d5c" podUID="b17963a2-4797-4722-ae65-4ac1801913a5" Jul 02 23:07:08.843444 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:08.843268 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tzfzk" Jul 02 23:07:08.843444 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:08.843370 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tzfzk" podUID="fad8c2d0-090a-4bac-8774-26cac496f9f7" Jul 02 23:07:08.955415 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:08.955381 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-33.ec2.internal" event={"ID":"9c4e7fa9daec587c25fb6cbf2b540d88","Type":"ContainerStarted","Data":"ff7d21d8d5b1196d5788d24b6d0d4957c45329f28312294dd4da3b96a8afcd85"} Jul 02 23:07:08.970521 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:08.970460 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-33.ec2.internal" podStartSLOduration=3.970437511 podStartE2EDuration="3.970437511s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 23:07:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:07:08.970035866 +0000 UTC m=+5.603077019" watchObservedRunningTime="2026-07-02 23:07:08.970437511 +0000 UTC m=+5.603478670" Jul 02 23:07:09.342110 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:09.342035 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b17963a2-4797-4722-ae65-4ac1801913a5-original-pull-secret\") pod \"global-pull-secret-syncer-r7d5c\" (UID: \"b17963a2-4797-4722-ae65-4ac1801913a5\") " pod="kube-system/global-pull-secret-syncer-r7d5c" Jul 02 23:07:09.342110 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:09.342081 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fad8c2d0-090a-4bac-8774-26cac496f9f7-metrics-certs\") pod \"network-metrics-daemon-tzfzk\" (UID: \"fad8c2d0-090a-4bac-8774-26cac496f9f7\") " pod="openshift-multus/network-metrics-daemon-tzfzk" Jul 02 23:07:09.342326 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:09.342192 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 23:07:09.342326 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:09.342235 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 23:07:09.342326 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:09.342264 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b17963a2-4797-4722-ae65-4ac1801913a5-original-pull-secret podName:b17963a2-4797-4722-ae65-4ac1801913a5 nodeName:}" failed. No retries permitted until 2026-07-02 23:07:13.342242916 +0000 UTC m=+9.975284042 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b17963a2-4797-4722-ae65-4ac1801913a5-original-pull-secret") pod "global-pull-secret-syncer-r7d5c" (UID: "b17963a2-4797-4722-ae65-4ac1801913a5") : object "kube-system"/"original-pull-secret" not registered Jul 02 23:07:09.342326 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:09.342286 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fad8c2d0-090a-4bac-8774-26cac496f9f7-metrics-certs podName:fad8c2d0-090a-4bac-8774-26cac496f9f7 nodeName:}" failed. No retries permitted until 2026-07-02 23:07:13.342270814 +0000 UTC m=+9.975311942 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fad8c2d0-090a-4bac-8774-26cac496f9f7-metrics-certs") pod "network-metrics-daemon-tzfzk" (UID: "fad8c2d0-090a-4bac-8774-26cac496f9f7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 23:07:09.443090 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:09.442973 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7frtk\" (UniqueName: \"kubernetes.io/projected/0ecba3b1-7f8d-4896-8c34-967f37704feb-kube-api-access-7frtk\") pod \"network-check-target-jxwvg\" (UID: \"0ecba3b1-7f8d-4896-8c34-967f37704feb\") " pod="openshift-network-diagnostics/network-check-target-jxwvg" Jul 02 23:07:09.443291 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:09.443155 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 23:07:09.443291 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:09.443179 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 23:07:09.443291 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:09.443192 2563 projected.go:196] Error preparing data for projected volume kube-api-access-7frtk for pod openshift-network-diagnostics/network-check-target-jxwvg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 23:07:09.443291 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:09.443250 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0ecba3b1-7f8d-4896-8c34-967f37704feb-kube-api-access-7frtk podName:0ecba3b1-7f8d-4896-8c34-967f37704feb nodeName:}" failed. No retries permitted until 2026-07-02 23:07:13.443231005 +0000 UTC m=+10.076272128 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-7frtk" (UniqueName: "kubernetes.io/projected/0ecba3b1-7f8d-4896-8c34-967f37704feb-kube-api-access-7frtk") pod "network-check-target-jxwvg" (UID: "0ecba3b1-7f8d-4896-8c34-967f37704feb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 23:07:09.845376 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:09.845346 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jxwvg" Jul 02 23:07:09.845925 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:09.845477 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jxwvg" podUID="0ecba3b1-7f8d-4896-8c34-967f37704feb" Jul 02 23:07:10.843719 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:10.842997 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r7d5c" Jul 02 23:07:10.843719 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:10.843129 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r7d5c" podUID="b17963a2-4797-4722-ae65-4ac1801913a5" Jul 02 23:07:10.843719 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:10.843555 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tzfzk" Jul 02 23:07:10.843719 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:10.843668 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tzfzk" podUID="fad8c2d0-090a-4bac-8774-26cac496f9f7" Jul 02 23:07:11.843291 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:11.843251 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jxwvg" Jul 02 23:07:11.843677 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:11.843369 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jxwvg" podUID="0ecba3b1-7f8d-4896-8c34-967f37704feb" Jul 02 23:07:12.843626 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:12.843589 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r7d5c" Jul 02 23:07:12.844123 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:12.843720 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r7d5c" podUID="b17963a2-4797-4722-ae65-4ac1801913a5" Jul 02 23:07:12.844123 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:12.843800 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tzfzk" Jul 02 23:07:12.844123 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:12.843890 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tzfzk" podUID="fad8c2d0-090a-4bac-8774-26cac496f9f7" Jul 02 23:07:13.380792 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:13.380752 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b17963a2-4797-4722-ae65-4ac1801913a5-original-pull-secret\") pod \"global-pull-secret-syncer-r7d5c\" (UID: \"b17963a2-4797-4722-ae65-4ac1801913a5\") " pod="kube-system/global-pull-secret-syncer-r7d5c" Jul 02 23:07:13.380792 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:13.380797 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fad8c2d0-090a-4bac-8774-26cac496f9f7-metrics-certs\") pod \"network-metrics-daemon-tzfzk\" (UID: \"fad8c2d0-090a-4bac-8774-26cac496f9f7\") " pod="openshift-multus/network-metrics-daemon-tzfzk" Jul 02 23:07:13.381033 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:13.380902 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 23:07:13.381033 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:13.380965 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 23:07:13.381033 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:13.380973 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b17963a2-4797-4722-ae65-4ac1801913a5-original-pull-secret podName:b17963a2-4797-4722-ae65-4ac1801913a5 nodeName:}" failed. No retries permitted until 2026-07-02 23:07:21.380953598 +0000 UTC m=+18.013994723 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b17963a2-4797-4722-ae65-4ac1801913a5-original-pull-secret") pod "global-pull-secret-syncer-r7d5c" (UID: "b17963a2-4797-4722-ae65-4ac1801913a5") : object "kube-system"/"original-pull-secret" not registered Jul 02 23:07:13.381191 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:13.381038 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fad8c2d0-090a-4bac-8774-26cac496f9f7-metrics-certs podName:fad8c2d0-090a-4bac-8774-26cac496f9f7 nodeName:}" failed. No retries permitted until 2026-07-02 23:07:21.381019432 +0000 UTC m=+18.014060559 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fad8c2d0-090a-4bac-8774-26cac496f9f7-metrics-certs") pod "network-metrics-daemon-tzfzk" (UID: "fad8c2d0-090a-4bac-8774-26cac496f9f7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 23:07:13.481881 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:13.481843 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7frtk\" (UniqueName: \"kubernetes.io/projected/0ecba3b1-7f8d-4896-8c34-967f37704feb-kube-api-access-7frtk\") pod \"network-check-target-jxwvg\" (UID: \"0ecba3b1-7f8d-4896-8c34-967f37704feb\") " pod="openshift-network-diagnostics/network-check-target-jxwvg" Jul 02 23:07:13.482078 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:13.482017 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 23:07:13.482078 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:13.482033 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 23:07:13.482078 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:13.482042 2563 projected.go:196] Error preparing data for projected volume kube-api-access-7frtk for pod openshift-network-diagnostics/network-check-target-jxwvg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 23:07:13.482187 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:13.482095 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0ecba3b1-7f8d-4896-8c34-967f37704feb-kube-api-access-7frtk podName:0ecba3b1-7f8d-4896-8c34-967f37704feb nodeName:}" failed. No retries permitted until 2026-07-02 23:07:21.482076918 +0000 UTC m=+18.115118044 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-7frtk" (UniqueName: "kubernetes.io/projected/0ecba3b1-7f8d-4896-8c34-967f37704feb-kube-api-access-7frtk") pod "network-check-target-jxwvg" (UID: "0ecba3b1-7f8d-4896-8c34-967f37704feb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 23:07:13.844763 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:13.844330 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jxwvg" Jul 02 23:07:13.844763 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:13.844455 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jxwvg" podUID="0ecba3b1-7f8d-4896-8c34-967f37704feb" Jul 02 23:07:14.843773 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:14.843557 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r7d5c" Jul 02 23:07:14.843773 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:14.843705 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r7d5c" podUID="b17963a2-4797-4722-ae65-4ac1801913a5" Jul 02 23:07:14.844019 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:14.843773 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tzfzk" Jul 02 23:07:14.844019 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:14.843933 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tzfzk" podUID="fad8c2d0-090a-4bac-8774-26cac496f9f7" Jul 02 23:07:15.843777 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:15.843726 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jxwvg" Jul 02 23:07:15.844229 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:15.843878 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jxwvg" podUID="0ecba3b1-7f8d-4896-8c34-967f37704feb" Jul 02 23:07:16.843030 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:16.843000 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r7d5c" Jul 02 23:07:16.843184 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:16.843113 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r7d5c" podUID="b17963a2-4797-4722-ae65-4ac1801913a5" Jul 02 23:07:16.843420 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:16.843406 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tzfzk" Jul 02 23:07:16.843506 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:16.843490 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tzfzk" podUID="fad8c2d0-090a-4bac-8774-26cac496f9f7" Jul 02 23:07:17.843667 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:17.843581 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jxwvg" Jul 02 23:07:17.844101 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:17.843720 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jxwvg" podUID="0ecba3b1-7f8d-4896-8c34-967f37704feb" Jul 02 23:07:18.843346 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:18.843309 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r7d5c" Jul 02 23:07:18.843346 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:18.843321 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tzfzk" Jul 02 23:07:18.843556 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:18.843439 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r7d5c" podUID="b17963a2-4797-4722-ae65-4ac1801913a5" Jul 02 23:07:18.843627 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:18.843593 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tzfzk" podUID="fad8c2d0-090a-4bac-8774-26cac496f9f7" Jul 02 23:07:19.843181 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:19.843150 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jxwvg" Jul 02 23:07:19.843669 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:19.843270 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jxwvg" podUID="0ecba3b1-7f8d-4896-8c34-967f37704feb" Jul 02 23:07:20.843019 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:20.842989 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r7d5c" Jul 02 23:07:20.843210 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:20.842991 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tzfzk" Jul 02 23:07:20.843210 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:20.843110 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r7d5c" podUID="b17963a2-4797-4722-ae65-4ac1801913a5" Jul 02 23:07:20.843210 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:20.843184 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tzfzk" podUID="fad8c2d0-090a-4bac-8774-26cac496f9f7" Jul 02 23:07:21.440923 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:21.440887 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b17963a2-4797-4722-ae65-4ac1801913a5-original-pull-secret\") pod \"global-pull-secret-syncer-r7d5c\" (UID: \"b17963a2-4797-4722-ae65-4ac1801913a5\") " pod="kube-system/global-pull-secret-syncer-r7d5c" Jul 02 23:07:21.441109 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:21.440939 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fad8c2d0-090a-4bac-8774-26cac496f9f7-metrics-certs\") pod \"network-metrics-daemon-tzfzk\" (UID: \"fad8c2d0-090a-4bac-8774-26cac496f9f7\") " pod="openshift-multus/network-metrics-daemon-tzfzk" Jul 02 23:07:21.441109 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:21.441049 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 23:07:21.441109 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:21.441061 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 23:07:21.441231 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:21.441134 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b17963a2-4797-4722-ae65-4ac1801913a5-original-pull-secret podName:b17963a2-4797-4722-ae65-4ac1801913a5 nodeName:}" failed. No retries permitted until 2026-07-02 23:07:37.441112277 +0000 UTC m=+34.074153399 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b17963a2-4797-4722-ae65-4ac1801913a5-original-pull-secret") pod "global-pull-secret-syncer-r7d5c" (UID: "b17963a2-4797-4722-ae65-4ac1801913a5") : object "kube-system"/"original-pull-secret" not registered Jul 02 23:07:21.441231 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:21.441156 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fad8c2d0-090a-4bac-8774-26cac496f9f7-metrics-certs podName:fad8c2d0-090a-4bac-8774-26cac496f9f7 nodeName:}" failed. No retries permitted until 2026-07-02 23:07:37.441145818 +0000 UTC m=+34.074186942 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fad8c2d0-090a-4bac-8774-26cac496f9f7-metrics-certs") pod "network-metrics-daemon-tzfzk" (UID: "fad8c2d0-090a-4bac-8774-26cac496f9f7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 23:07:21.542313 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:21.542269 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7frtk\" (UniqueName: \"kubernetes.io/projected/0ecba3b1-7f8d-4896-8c34-967f37704feb-kube-api-access-7frtk\") pod \"network-check-target-jxwvg\" (UID: \"0ecba3b1-7f8d-4896-8c34-967f37704feb\") " pod="openshift-network-diagnostics/network-check-target-jxwvg" Jul 02 23:07:21.542491 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:21.542436 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 23:07:21.542491 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:21.542458 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 23:07:21.542491 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:21.542473 2563 projected.go:196] Error preparing data for projected volume kube-api-access-7frtk for pod openshift-network-diagnostics/network-check-target-jxwvg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 23:07:21.542629 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:21.542535 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0ecba3b1-7f8d-4896-8c34-967f37704feb-kube-api-access-7frtk podName:0ecba3b1-7f8d-4896-8c34-967f37704feb nodeName:}" failed. No retries permitted until 2026-07-02 23:07:37.542521091 +0000 UTC m=+34.175562211 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-7frtk" (UniqueName: "kubernetes.io/projected/0ecba3b1-7f8d-4896-8c34-967f37704feb-kube-api-access-7frtk") pod "network-check-target-jxwvg" (UID: "0ecba3b1-7f8d-4896-8c34-967f37704feb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 23:07:21.843166 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:21.843074 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jxwvg" Jul 02 23:07:21.843339 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:21.843213 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jxwvg" podUID="0ecba3b1-7f8d-4896-8c34-967f37704feb" Jul 02 23:07:22.843541 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:22.843509 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r7d5c" Jul 02 23:07:22.844023 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:22.843513 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tzfzk" Jul 02 23:07:22.844023 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:22.843643 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r7d5c" podUID="b17963a2-4797-4722-ae65-4ac1801913a5" Jul 02 23:07:22.844023 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:22.843755 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tzfzk" podUID="fad8c2d0-090a-4bac-8774-26cac496f9f7" Jul 02 23:07:23.844587 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:23.844556 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jxwvg" Jul 02 23:07:23.845152 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:23.844660 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jxwvg" podUID="0ecba3b1-7f8d-4896-8c34-967f37704feb" Jul 02 23:07:24.842924 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:24.842895 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r7d5c" Jul 02 23:07:24.843085 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:24.842899 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tzfzk" Jul 02 23:07:24.843085 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:24.843011 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r7d5c" podUID="b17963a2-4797-4722-ae65-4ac1801913a5" Jul 02 23:07:24.843180 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:24.843117 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tzfzk" podUID="fad8c2d0-090a-4bac-8774-26cac496f9f7" Jul 02 23:07:25.842944 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:25.842915 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jxwvg" Jul 02 23:07:25.843391 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:25.843043 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jxwvg" podUID="0ecba3b1-7f8d-4896-8c34-967f37704feb" Jul 02 23:07:25.994005 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:25.993968 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-97j6n" event={"ID":"2d6bdb50-bc8b-4f01-b13c-8ff9cd87740f","Type":"ContainerStarted","Data":"e6f2e1b672575d24c7bd23a0aa658f331a94d05dafc9eb9e85e9ea1e6a060dcc"} Jul 02 23:07:25.995788 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:25.995758 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2jt79" event={"ID":"74fc0401-b598-40fc-acca-508ba1a1c001","Type":"ContainerStarted","Data":"ee5b22d1563e377048e094be3420714c31572a17c0c8dac31c116153fb79852b"} Jul 02 23:07:25.997002 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:25.996981 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-q5c49" event={"ID":"a6eddff0-475c-41b7-b072-e1cdd661392f","Type":"ContainerStarted","Data":"7551ecf2ef4c22e83d549f81ecdc5387d144cff2b3aaea7f0e7f0da6fa6e4a7c"} Jul 02 23:07:25.998331 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:25.998304 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-z6p55" event={"ID":"b08f4b68-d33f-48a2-90d0-0c6511ba679a","Type":"ContainerStarted","Data":"d54dc6270997149644f5a50b0bba42a6c356c8a8266dd114c20fa7dbd5c7239c"} Jul 02 23:07:25.999553 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:25.999529 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-m5zq4" event={"ID":"4c2848a5-a93f-4b79-be6e-31d430c7839d","Type":"ContainerStarted","Data":"145febeb24936ce8f5575dd5541ddcbaf26c696f71914875c9bd77f23680a9f6"} Jul 02 23:07:26.001085 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:26.001070 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hhc6h_f946205c-023a-4a7d-9a6c-c40b23c3b771/ovn-acl-logging/0.log" Jul 02 23:07:26.001400 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:26.001384 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hhc6h" event={"ID":"f946205c-023a-4a7d-9a6c-c40b23c3b771","Type":"ContainerStarted","Data":"3befc34949494fb0e3dba734e74d1d0fb221fb947035c66741687f2695e3f4c3"} Jul 02 23:07:26.001448 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:26.001432 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hhc6h" event={"ID":"f946205c-023a-4a7d-9a6c-c40b23c3b771","Type":"ContainerStarted","Data":"ae0fb7ce17db06843611251a387900492ea0f24c8aff25ac012b27ccc136e28b"} Jul 02 23:07:26.002669 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:26.002651 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wpqd6" event={"ID":"4234f128-0de0-4ac9-b880-c2024b729867","Type":"ContainerStarted","Data":"7a3d04a53c4f5da1fd89a98d27d6bc2bb2305f726d4b15e0062fe44435f3203c"} Jul 02 23:07:26.004251 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:26.004225 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-47sfd" event={"ID":"a2a8144d-1894-42b4-be25-ae456f79f041","Type":"ContainerStarted","Data":"704a9ed8e066ae0fb479e0ba4ad3f354acfd8181f965b86edd3754588666b52b"} Jul 02 23:07:26.043851 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:26.043798 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-z6p55" podStartSLOduration=11.566688869 podStartE2EDuration="22.043776291s" totalImagesPullingTime="10.477087422s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:07:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:07:26.030549625 +0000 UTC m=+22.663590790" watchObservedRunningTime="2026-07-02 23:07:26.043776291 +0000 UTC m=+22.676817440" Jul 02 23:07:26.044011 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:26.043972 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-m5zq4" podStartSLOduration=11.572418649 podStartE2EDuration="22.043966187s" totalImagesPullingTime="10.471547538s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 23:07:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:07:26.043700042 +0000 UTC m=+22.676741214" watchObservedRunningTime="2026-07-02 23:07:26.043966187 +0000 UTC m=+22.677007323" Jul 02 23:07:26.060273 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:26.060221 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-47sfd" podStartSLOduration=4.411486325 podStartE2EDuration="23.060200328s" totalImagesPullingTime="18.648714003s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 23:07:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:07:26.059447321 +0000 UTC m=+22.692488465" watchObservedRunningTime="2026-07-02 23:07:26.060200328 +0000 UTC m=+22.693241473" Jul 02 23:07:26.076797 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:26.076719 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-q5c49" podStartSLOduration=12.604999336 podStartE2EDuration="23.076704524s" totalImagesPullingTime="10.471705188s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 23:07:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:07:26.07618652 +0000 UTC m=+22.709227666" watchObservedRunningTime="2026-07-02 23:07:26.076704524 +0000 UTC m=+22.709745666" Jul 02 23:07:26.843253 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:26.843026 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r7d5c" Jul 02 23:07:26.843918 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:26.843037 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tzfzk" Jul 02 23:07:26.843918 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:26.843355 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r7d5c" podUID="b17963a2-4797-4722-ae65-4ac1801913a5" Jul 02 23:07:26.843918 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:26.843425 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tzfzk" podUID="fad8c2d0-090a-4bac-8774-26cac496f9f7" Jul 02 23:07:26.893249 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:26.893203 2563 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 02 23:07:27.009056 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:27.009032 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hhc6h_f946205c-023a-4a7d-9a6c-c40b23c3b771/ovn-acl-logging/0.log" Jul 02 23:07:27.009368 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:27.009345 2563 generic.go:356] "Generic (PLEG): container finished" podID="f946205c-023a-4a7d-9a6c-c40b23c3b771" containerID="3befc34949494fb0e3dba734e74d1d0fb221fb947035c66741687f2695e3f4c3" exitCode=1 Jul 02 23:07:27.009447 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:27.009426 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hhc6h" event={"ID":"f946205c-023a-4a7d-9a6c-c40b23c3b771","Type":"ContainerDied","Data":"3befc34949494fb0e3dba734e74d1d0fb221fb947035c66741687f2695e3f4c3"} Jul 02 23:07:27.009538 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:27.009511 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hhc6h" event={"ID":"f946205c-023a-4a7d-9a6c-c40b23c3b771","Type":"ContainerStarted","Data":"826d8fdc2f623553b44f71a7e58b4dc01231be138c70c45e1a6f7ede286a2d68"} Jul 02 23:07:27.009642 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:27.009560 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hhc6h" event={"ID":"f946205c-023a-4a7d-9a6c-c40b23c3b771","Type":"ContainerStarted","Data":"1a13da2fc22efaf08695107254cecf49f258b7aa1ddd8a4b9a308902a9affbbc"} Jul 02 23:07:27.009642 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:27.009607 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hhc6h" event={"ID":"f946205c-023a-4a7d-9a6c-c40b23c3b771","Type":"ContainerStarted","Data":"109e59186151b1da9ea2c2bc3ac32f39d79373a918dd06c59ac68bf5cc7c1418"} Jul 02 23:07:27.009732 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:27.009654 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hhc6h" event={"ID":"f946205c-023a-4a7d-9a6c-c40b23c3b771","Type":"ContainerStarted","Data":"6375887d0d26fd43a48e35c8d1b447b71667e5b64574ab1931a99a62f2604d97"} Jul 02 23:07:27.013114 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:27.013085 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wpqd6" event={"ID":"4234f128-0de0-4ac9-b880-c2024b729867","Type":"ContainerStarted","Data":"43370ea83362d3163f707de7d04ea02b3963c0dffec97962d01e8a63a7e83802"} Jul 02 23:07:27.014611 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:27.014593 2563 generic.go:356] "Generic (PLEG): container finished" podID="2d6bdb50-bc8b-4f01-b13c-8ff9cd87740f" containerID="e6f2e1b672575d24c7bd23a0aa658f331a94d05dafc9eb9e85e9ea1e6a060dcc" exitCode=0 Jul 02 23:07:27.014694 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:27.014617 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-97j6n" event={"ID":"2d6bdb50-bc8b-4f01-b13c-8ff9cd87740f","Type":"ContainerDied","Data":"e6f2e1b672575d24c7bd23a0aa658f331a94d05dafc9eb9e85e9ea1e6a060dcc"} Jul 02 23:07:27.037477 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:27.037435 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-2jt79" podStartSLOduration=4.293821317 podStartE2EDuration="23.037423723s" totalImagesPullingTime="18.743602406s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 23:07:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:07:26.099082624 +0000 UTC m=+22.732123786" watchObservedRunningTime="2026-07-02 23:07:27.037423723 +0000 UTC m=+23.670464865" Jul 02 23:07:27.775724 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:27.775624 2563 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-02T23:07:26.893218656Z","UUID":"afe65083-a5b3-474e-9b53-23ac500e7a1a","Handler":null,"Name":"","Endpoint":""} Jul 02 23:07:27.777191 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:27.777171 2563 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 02 23:07:27.777323 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:27.777211 2563 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 02 23:07:27.843146 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:27.843115 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jxwvg" Jul 02 23:07:27.843303 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:27.843255 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jxwvg" podUID="0ecba3b1-7f8d-4896-8c34-967f37704feb" Jul 02 23:07:28.019807 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:28.019757 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wpqd6" event={"ID":"4234f128-0de0-4ac9-b880-c2024b729867","Type":"ContainerStarted","Data":"6cc9d84d021c40703c15e6deb90d025b6f896a14b33cc8727c5057de652f2557"} Jul 02 23:07:28.021314 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:28.021282 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-2g949" event={"ID":"f66de8fe-bac5-43ab-80bd-f8b818e69f7b","Type":"ContainerStarted","Data":"a06c46d3e805ff2679524ad135ba3d3642ef4bf850a0c6605a7d81487b05aead"} Jul 02 23:07:28.036804 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:28.036699 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wpqd6" podStartSLOduration=3.478695587 podStartE2EDuration="24.036684227s" totalImagesPullingTime="20.55798864s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 23:07:04 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:07:28.036645877 +0000 UTC m=+24.669687020" watchObservedRunningTime="2026-07-02 23:07:28.036684227 +0000 UTC m=+24.669725393" Jul 02 23:07:28.050060 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:28.050022 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-2g949" podStartSLOduration=10.408215388 podStartE2EDuration="25.050009692s" totalImagesPullingTime="14.641794304s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 23:07:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:07:28.049538872 +0000 UTC m=+24.682580015" watchObservedRunningTime="2026-07-02 23:07:28.050009692 +0000 UTC m=+24.683050843" Jul 02 23:07:28.843122 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:28.843086 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r7d5c" Jul 02 23:07:28.843122 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:28.843114 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tzfzk" Jul 02 23:07:28.843316 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:28.843189 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r7d5c" podUID="b17963a2-4797-4722-ae65-4ac1801913a5" Jul 02 23:07:28.843559 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:28.843313 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tzfzk" podUID="fad8c2d0-090a-4bac-8774-26cac496f9f7" Jul 02 23:07:29.027380 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:29.027340 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hhc6h_f946205c-023a-4a7d-9a6c-c40b23c3b771/ovn-acl-logging/0.log" Jul 02 23:07:29.027725 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:29.027694 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hhc6h" event={"ID":"f946205c-023a-4a7d-9a6c-c40b23c3b771","Type":"ContainerStarted","Data":"81288819b6a38e210fe1249e6f849594c4db00b2576196753ae7a353ba709bfa"} Jul 02 23:07:29.843700 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:29.843521 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jxwvg" Jul 02 23:07:29.844185 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:29.843787 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jxwvg" podUID="0ecba3b1-7f8d-4896-8c34-967f37704feb" Jul 02 23:07:30.473385 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:30.473359 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-z6p55" Jul 02 23:07:30.474142 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:30.474124 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-z6p55" Jul 02 23:07:30.842943 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:30.842914 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r7d5c" Jul 02 23:07:30.842943 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:30.842930 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tzfzk" Jul 02 23:07:30.843137 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:30.843046 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r7d5c" podUID="b17963a2-4797-4722-ae65-4ac1801913a5" Jul 02 23:07:30.843137 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:30.843074 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tzfzk" podUID="fad8c2d0-090a-4bac-8774-26cac496f9f7" Jul 02 23:07:31.036279 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:31.036250 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hhc6h_f946205c-023a-4a7d-9a6c-c40b23c3b771/ovn-acl-logging/0.log" Jul 02 23:07:31.036992 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:31.036688 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hhc6h" event={"ID":"f946205c-023a-4a7d-9a6c-c40b23c3b771","Type":"ContainerStarted","Data":"6f31a224b4f834f3c31b41abe05412fdea46518a73d1eaab37a5e0089552b20f"} Jul 02 23:07:31.037180 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:31.037163 2563 scope.go:117] "RemoveContainer" containerID="3befc34949494fb0e3dba734e74d1d0fb221fb947035c66741687f2695e3f4c3" Jul 02 23:07:31.843542 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:31.843240 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jxwvg" Jul 02 23:07:31.843691 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:31.843566 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jxwvg" podUID="0ecba3b1-7f8d-4896-8c34-967f37704feb" Jul 02 23:07:32.690212 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:32.690175 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jxwvg"] Jul 02 23:07:32.690589 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:32.690285 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jxwvg" Jul 02 23:07:32.690589 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:32.690395 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jxwvg" podUID="0ecba3b1-7f8d-4896-8c34-967f37704feb" Jul 02 23:07:32.693182 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:32.693119 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-r7d5c"] Jul 02 23:07:32.693328 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:32.693210 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r7d5c" Jul 02 23:07:32.693328 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:32.693286 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r7d5c" podUID="b17963a2-4797-4722-ae65-4ac1801913a5" Jul 02 23:07:32.693693 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:32.693668 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-tzfzk"] Jul 02 23:07:32.693804 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:32.693779 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tzfzk" Jul 02 23:07:32.693902 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:32.693879 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tzfzk" podUID="fad8c2d0-090a-4bac-8774-26cac496f9f7" Jul 02 23:07:33.044469 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:33.044397 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hhc6h_f946205c-023a-4a7d-9a6c-c40b23c3b771/ovn-acl-logging/0.log" Jul 02 23:07:33.044850 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:33.044825 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hhc6h" event={"ID":"f946205c-023a-4a7d-9a6c-c40b23c3b771","Type":"ContainerStarted","Data":"5d05851428e92758ab9c82509c61f13f52f68ccf8bd3a19d04dfd3aeb6dc0a89"} Jul 02 23:07:33.044982 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:33.044928 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hhc6h" Jul 02 23:07:33.044982 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:33.044975 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hhc6h" Jul 02 23:07:33.045186 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:33.045153 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hhc6h" Jul 02 23:07:33.046996 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:33.046972 2563 generic.go:356] "Generic (PLEG): container finished" podID="2d6bdb50-bc8b-4f01-b13c-8ff9cd87740f" containerID="b6aa9918513ad5c98c2394d488adb28b6450833a8681f1be5613a05c690d2a6e" exitCode=0 Jul 02 23:07:33.047106 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:33.047010 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-97j6n" event={"ID":"2d6bdb50-bc8b-4f01-b13c-8ff9cd87740f","Type":"ContainerDied","Data":"b6aa9918513ad5c98c2394d488adb28b6450833a8681f1be5613a05c690d2a6e"} Jul 02 23:07:33.060857 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:33.060837 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hhc6h" Jul 02 23:07:33.060955 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:33.060930 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hhc6h" Jul 02 23:07:33.072016 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:33.071969 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-hhc6h" podStartSLOduration=10.342822579 podStartE2EDuration="29.071957219s" totalImagesPullingTime="18.72913464s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 23:07:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:07:33.070485375 +0000 UTC m=+29.703526530" watchObservedRunningTime="2026-07-02 23:07:33.071957219 +0000 UTC m=+29.704998361" Jul 02 23:07:34.063062 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:34.063033 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-z6p55" Jul 02 23:07:34.063523 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:34.063140 2563 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 02 23:07:34.063675 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:34.063658 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-z6p55" Jul 02 23:07:34.842777 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:34.842717 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r7d5c" Jul 02 23:07:34.842777 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:34.842781 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jxwvg" Jul 02 23:07:34.842983 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:34.842847 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tzfzk" Jul 02 23:07:34.842983 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:34.842862 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r7d5c" podUID="b17963a2-4797-4722-ae65-4ac1801913a5" Jul 02 23:07:34.842983 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:34.842909 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jxwvg" podUID="0ecba3b1-7f8d-4896-8c34-967f37704feb" Jul 02 23:07:34.843069 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:34.843009 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tzfzk" podUID="fad8c2d0-090a-4bac-8774-26cac496f9f7" Jul 02 23:07:35.056217 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:35.056183 2563 generic.go:356] "Generic (PLEG): container finished" podID="2d6bdb50-bc8b-4f01-b13c-8ff9cd87740f" containerID="42a11c819f904950099d62e51109d427ca7763545d6bc53bfdfd50de4b93aeea" exitCode=0 Jul 02 23:07:35.056360 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:35.056220 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-97j6n" event={"ID":"2d6bdb50-bc8b-4f01-b13c-8ff9cd87740f","Type":"ContainerDied","Data":"42a11c819f904950099d62e51109d427ca7763545d6bc53bfdfd50de4b93aeea"} Jul 02 23:07:35.072561 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:35.072527 2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-hhc6h" podUID="f946205c-023a-4a7d-9a6c-c40b23c3b771" containerName="ovnkube-controller" probeResult="failure" output="" Jul 02 23:07:36.843288 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:36.843253 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r7d5c" Jul 02 23:07:36.843780 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:36.843355 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jxwvg" Jul 02 23:07:36.843780 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:36.843358 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r7d5c" podUID="b17963a2-4797-4722-ae65-4ac1801913a5" Jul 02 23:07:36.843780 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:36.843458 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jxwvg" podUID="0ecba3b1-7f8d-4896-8c34-967f37704feb" Jul 02 23:07:36.843780 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:36.843360 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tzfzk" Jul 02 23:07:36.843780 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:36.843558 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tzfzk" podUID="fad8c2d0-090a-4bac-8774-26cac496f9f7" Jul 02 23:07:37.062351 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:37.062320 2563 generic.go:356] "Generic (PLEG): container finished" podID="2d6bdb50-bc8b-4f01-b13c-8ff9cd87740f" containerID="0cd46e38114febd2c1b91b77c2ffc510a7b622da9e435d0fde18790560386acd" exitCode=0 Jul 02 23:07:37.062579 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:37.062364 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-97j6n" event={"ID":"2d6bdb50-bc8b-4f01-b13c-8ff9cd87740f","Type":"ContainerDied","Data":"0cd46e38114febd2c1b91b77c2ffc510a7b622da9e435d0fde18790560386acd"} Jul 02 23:07:37.470633 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:37.470599 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b17963a2-4797-4722-ae65-4ac1801913a5-original-pull-secret\") pod \"global-pull-secret-syncer-r7d5c\" (UID: \"b17963a2-4797-4722-ae65-4ac1801913a5\") " pod="kube-system/global-pull-secret-syncer-r7d5c" Jul 02 23:07:37.470633 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:37.470633 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fad8c2d0-090a-4bac-8774-26cac496f9f7-metrics-certs\") pod \"network-metrics-daemon-tzfzk\" (UID: \"fad8c2d0-090a-4bac-8774-26cac496f9f7\") " pod="openshift-multus/network-metrics-daemon-tzfzk" Jul 02 23:07:37.470878 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:37.470722 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 23:07:37.470878 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:37.470752 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 23:07:37.470878 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:37.470785 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fad8c2d0-090a-4bac-8774-26cac496f9f7-metrics-certs podName:fad8c2d0-090a-4bac-8774-26cac496f9f7 nodeName:}" failed. No retries permitted until 2026-07-02 23:08:09.470772875 +0000 UTC m=+66.103813996 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fad8c2d0-090a-4bac-8774-26cac496f9f7-metrics-certs") pod "network-metrics-daemon-tzfzk" (UID: "fad8c2d0-090a-4bac-8774-26cac496f9f7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 23:07:37.470878 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:37.470804 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b17963a2-4797-4722-ae65-4ac1801913a5-original-pull-secret podName:b17963a2-4797-4722-ae65-4ac1801913a5 nodeName:}" failed. No retries permitted until 2026-07-02 23:08:09.470791359 +0000 UTC m=+66.103832480 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b17963a2-4797-4722-ae65-4ac1801913a5-original-pull-secret") pod "global-pull-secret-syncer-r7d5c" (UID: "b17963a2-4797-4722-ae65-4ac1801913a5") : object "kube-system"/"original-pull-secret" not registered Jul 02 23:07:37.571916 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:37.571880 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7frtk\" (UniqueName: \"kubernetes.io/projected/0ecba3b1-7f8d-4896-8c34-967f37704feb-kube-api-access-7frtk\") pod \"network-check-target-jxwvg\" (UID: \"0ecba3b1-7f8d-4896-8c34-967f37704feb\") " pod="openshift-network-diagnostics/network-check-target-jxwvg" Jul 02 23:07:37.572083 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:37.572014 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 23:07:37.572083 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:37.572032 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 23:07:37.572083 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:37.572043 2563 projected.go:196] Error preparing data for projected volume kube-api-access-7frtk for pod openshift-network-diagnostics/network-check-target-jxwvg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 23:07:37.572249 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:37.572096 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0ecba3b1-7f8d-4896-8c34-967f37704feb-kube-api-access-7frtk podName:0ecba3b1-7f8d-4896-8c34-967f37704feb nodeName:}" failed. No retries permitted until 2026-07-02 23:08:09.572078851 +0000 UTC m=+66.205119973 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-7frtk" (UniqueName: "kubernetes.io/projected/0ecba3b1-7f8d-4896-8c34-967f37704feb-kube-api-access-7frtk") pod "network-check-target-jxwvg" (UID: "0ecba3b1-7f8d-4896-8c34-967f37704feb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 23:07:38.730229 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:38.730195 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-33.ec2.internal" event="NodeReady" Jul 02 23:07:38.730827 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:38.730354 2563 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 02 23:07:38.767815 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:38.767785 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5897776f99-njm4b"] Jul 02 23:07:38.787897 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:38.787862 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-wljkx"] Jul 02 23:07:38.790608 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:38.790428 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5897776f99-njm4b" Jul 02 23:07:38.794732 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:38.794709 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-mpx6s\"" Jul 02 23:07:38.796466 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:38.796441 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 02 23:07:38.796905 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:38.796710 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 02 23:07:38.797465 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:38.797433 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 02 23:07:38.803881 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:38.803859 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-92c6f"] Jul 02 23:07:38.805068 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:38.804852 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-wljkx" Jul 02 23:07:38.806872 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:38.806386 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 02 23:07:38.808801 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:38.808370 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 02 23:07:38.808801 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:38.808680 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 02 23:07:38.809449 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:38.809430 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 02 23:07:38.809636 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:38.809618 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 02 23:07:38.810018 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:38.809999 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-vsc8z\"" Jul 02 23:07:38.814586 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:38.814567 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 02 23:07:38.829827 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:38.829801 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-slv8j"] Jul 02 23:07:38.829973 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:38.829921 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-92c6f" Jul 02 23:07:38.832377 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:38.832353 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-j2kg8\"" Jul 02 23:07:38.832488 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:38.832355 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 02 23:07:38.832488 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:38.832355 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 02 23:07:38.832598 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:38.832507 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 02 23:07:38.856034 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:38.856012 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-dkbs8"] Jul 02 23:07:38.856171 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:38.856124 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-slv8j" Jul 02 23:07:38.859158 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:38.858951 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 02 23:07:38.859158 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:38.859002 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-7q82j\"" Jul 02 23:07:38.859158 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:38.859091 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 02 23:07:38.859378 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:38.859349 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 02 23:07:38.861731 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:38.859572 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 02 23:07:38.871415 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:38.871396 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-gz8jl"] Jul 02 23:07:38.871509 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:38.871478 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jxwvg" Jul 02 23:07:38.871574 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:38.871478 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tzfzk" Jul 02 23:07:38.871759 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:38.871479 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r7d5c" Jul 02 23:07:38.871888 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:38.871481 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-dkbs8" Jul 02 23:07:38.873846 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:38.873805 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 02 23:07:38.873846 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:38.873809 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-dptv4\"" Jul 02 23:07:38.874017 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:38.873958 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jkmkq\"" Jul 02 23:07:38.874104 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:38.874063 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 02 23:07:38.874200 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:38.874185 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 02 23:07:38.874287 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:38.874254 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 02 23:07:38.874287 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:38.874270 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 02 23:07:38.874385 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:38.874352 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 02 23:07:38.874461 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:38.874447 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-2kldc\"" Jul 02 23:07:38.881664 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:38.881644 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/de0c5637-bfd8-4989-a233-abc9a7cf1210-registry-certificates\") pod \"image-registry-5897776f99-njm4b\" (UID: \"de0c5637-bfd8-4989-a233-abc9a7cf1210\") " pod="openshift-image-registry/image-registry-5897776f99-njm4b" Jul 02 23:07:38.881772 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:38.881720 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/de0c5637-bfd8-4989-a233-abc9a7cf1210-image-registry-private-configuration\") pod \"image-registry-5897776f99-njm4b\" (UID: \"de0c5637-bfd8-4989-a233-abc9a7cf1210\") " pod="openshift-image-registry/image-registry-5897776f99-njm4b" Jul 02 23:07:38.881818 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:38.881767 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/de0c5637-bfd8-4989-a233-abc9a7cf1210-bound-sa-token\") pod \"image-registry-5897776f99-njm4b\" (UID: \"de0c5637-bfd8-4989-a233-abc9a7cf1210\") " pod="openshift-image-registry/image-registry-5897776f99-njm4b" Jul 02 23:07:38.881818 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:38.881799 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/de0c5637-bfd8-4989-a233-abc9a7cf1210-installation-pull-secrets\") pod \"image-registry-5897776f99-njm4b\" (UID: \"de0c5637-bfd8-4989-a233-abc9a7cf1210\") " pod="openshift-image-registry/image-registry-5897776f99-njm4b" Jul 02 23:07:38.881880 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:38.881824 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bfc7d\" (UniqueName: \"kubernetes.io/projected/de0c5637-bfd8-4989-a233-abc9a7cf1210-kube-api-access-bfc7d\") pod \"image-registry-5897776f99-njm4b\" (UID: \"de0c5637-bfd8-4989-a233-abc9a7cf1210\") " pod="openshift-image-registry/image-registry-5897776f99-njm4b" Jul 02 23:07:38.881880 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:38.881857 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/de0c5637-bfd8-4989-a233-abc9a7cf1210-registry-tls\") pod \"image-registry-5897776f99-njm4b\" (UID: \"de0c5637-bfd8-4989-a233-abc9a7cf1210\") " pod="openshift-image-registry/image-registry-5897776f99-njm4b" Jul 02 23:07:38.881965 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:38.881879 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/de0c5637-bfd8-4989-a233-abc9a7cf1210-ca-trust-extracted\") pod \"image-registry-5897776f99-njm4b\" (UID: \"de0c5637-bfd8-4989-a233-abc9a7cf1210\") " pod="openshift-image-registry/image-registry-5897776f99-njm4b" Jul 02 23:07:38.881965 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:38.881920 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/de0c5637-bfd8-4989-a233-abc9a7cf1210-trusted-ca\") pod \"image-registry-5897776f99-njm4b\" (UID: \"de0c5637-bfd8-4989-a233-abc9a7cf1210\") " pod="openshift-image-registry/image-registry-5897776f99-njm4b" Jul 02 23:07:38.893684 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:38.893665 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-92c6f"] Jul 02 23:07:38.893808 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:38.893706 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-dkbs8"] Jul 02 23:07:38.893808 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:38.893729 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5897776f99-njm4b"] Jul 02 23:07:38.893808 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:38.893773 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-6744ddf86c-cr66l"] Jul 02 23:07:38.893808 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:38.893799 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-gz8jl" Jul 02 23:07:38.896035 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:38.896014 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 02 23:07:38.896216 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:38.896197 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 02 23:07:38.896364 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:38.896344 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 02 23:07:38.896439 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:38.896402 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-xbwtx\"" Jul 02 23:07:38.896601 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:38.896582 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 02 23:07:38.901348 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:38.901329 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 02 23:07:38.915573 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:38.915552 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-9m5nh"] Jul 02 23:07:38.915672 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:38.915657 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6744ddf86c-cr66l" Jul 02 23:07:38.918308 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:38.918284 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 02 23:07:38.918438 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:38.918421 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 02 23:07:38.918501 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:38.918440 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 02 23:07:38.918589 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:38.918532 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 02 23:07:38.918709 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:38.918533 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 02 23:07:38.918709 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:38.918703 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-rhgbk\"" Jul 02 23:07:38.918896 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:38.918876 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 02 23:07:38.933717 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:38.933689 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-8nlmv"] Jul 02 23:07:38.933849 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:38.933832 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9m5nh" Jul 02 23:07:38.936458 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:38.936442 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 02 23:07:38.936725 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:38.936679 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-dl5xp\"" Jul 02 23:07:38.936725 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:38.936680 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 02 23:07:38.954086 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:38.954064 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-frm7j"] Jul 02 23:07:38.954189 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:38.954175 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-8nlmv" Jul 02 23:07:38.956093 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:38.956072 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-z6p55_b08f4b68-d33f-48a2-90d0-0c6511ba679a/konnectivity-agent/0.log" limit=1024 Jul 02 23:07:38.956796 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:38.956777 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 02 23:07:38.956905 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:38.956799 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 02 23:07:38.956905 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:38.956830 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-49flz\"" Jul 02 23:07:38.956905 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:38.956801 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 02 23:07:38.956905 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:38.956777 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 02 23:07:38.976858 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:38.976831 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-297wc"] Jul 02 23:07:38.976977 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:38.976962 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-frm7j" Jul 02 23:07:38.981328 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:38.981267 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 02 23:07:38.981591 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:38.981574 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 02 23:07:38.981814 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:38.981799 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 02 23:07:38.982296 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:38.982272 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/de0c5637-bfd8-4989-a233-abc9a7cf1210-registry-tls\") pod \"image-registry-5897776f99-njm4b\" (UID: \"de0c5637-bfd8-4989-a233-abc9a7cf1210\") " pod="openshift-image-registry/image-registry-5897776f99-njm4b" Jul 02 23:07:38.982296 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:38.982288 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-hjpqf\"" Jul 02 23:07:38.982436 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:38.982319 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5tsvb\" (UniqueName: \"kubernetes.io/projected/746b57b7-42ad-4c35-b0e4-778b0732ea77-kube-api-access-5tsvb\") pod \"volume-data-source-validator-5d456fdbcd-dkbs8\" (UID: \"746b57b7-42ad-4c35-b0e4-778b0732ea77\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-dkbs8" Jul 02 23:07:38.982436 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:38.982355 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/de0c5637-bfd8-4989-a233-abc9a7cf1210-ca-trust-extracted\") pod \"image-registry-5897776f99-njm4b\" (UID: \"de0c5637-bfd8-4989-a233-abc9a7cf1210\") " pod="openshift-image-registry/image-registry-5897776f99-njm4b" Jul 02 23:07:38.982436 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:38.982389 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e5ac3fd0-32b9-4947-a0a7-ed6d6cd3c8f0-serving-cert\") pod \"insights-operator-5c847dcfc4-gz8jl\" (UID: \"e5ac3fd0-32b9-4947-a0a7-ed6d6cd3c8f0\") " pod="openshift-insights/insights-operator-5c847dcfc4-gz8jl" Jul 02 23:07:38.982436 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:38.982410 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 23:07:38.982436 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:38.982431 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5897776f99-njm4b: secret "image-registry-tls" not found Jul 02 23:07:38.982680 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:38.982461 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/de0c5637-bfd8-4989-a233-abc9a7cf1210-trusted-ca\") pod \"image-registry-5897776f99-njm4b\" (UID: \"de0c5637-bfd8-4989-a233-abc9a7cf1210\") " pod="openshift-image-registry/image-registry-5897776f99-njm4b" Jul 02 23:07:38.982680 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:38.982555 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 02 23:07:38.982819 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:38.982703 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/de0c5637-bfd8-4989-a233-abc9a7cf1210-registry-tls podName:de0c5637-bfd8-4989-a233-abc9a7cf1210 nodeName:}" failed. No retries permitted until 2026-07-02 23:07:39.482511634 +0000 UTC m=+36.115552755 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/de0c5637-bfd8-4989-a233-abc9a7cf1210-registry-tls") pod "image-registry-5897776f99-njm4b" (UID: "de0c5637-bfd8-4989-a233-abc9a7cf1210") : secret "image-registry-tls" not found Jul 02 23:07:38.982819 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:38.982782 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/de0c5637-bfd8-4989-a233-abc9a7cf1210-ca-trust-extracted\") pod \"image-registry-5897776f99-njm4b\" (UID: \"de0c5637-bfd8-4989-a233-abc9a7cf1210\") " pod="openshift-image-registry/image-registry-5897776f99-njm4b" Jul 02 23:07:38.982934 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:38.982851 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kltwx\" (UniqueName: \"kubernetes.io/projected/f9de3ef6-3258-45ea-aa0a-79fde3689e1d-kube-api-access-kltwx\") pod \"service-ca-operator-5d46d9ffd4-slv8j\" (UID: \"f9de3ef6-3258-45ea-aa0a-79fde3689e1d\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-slv8j" Jul 02 23:07:38.982934 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:38.982890 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4530ab49-f26f-4e05-83ad-d40e9327478a-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-92c6f\" (UID: \"4530ab49-f26f-4e05-83ad-d40e9327478a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-92c6f" Jul 02 23:07:38.982934 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:38.982925 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x8kd2\" (UniqueName: \"kubernetes.io/projected/4530ab49-f26f-4e05-83ad-d40e9327478a-kube-api-access-x8kd2\") pod \"cluster-samples-operator-56fcf86bf-92c6f\" (UID: \"4530ab49-f26f-4e05-83ad-d40e9327478a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-92c6f" Jul 02 23:07:38.983113 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:38.982990 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e5ac3fd0-32b9-4947-a0a7-ed6d6cd3c8f0-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-gz8jl\" (UID: \"e5ac3fd0-32b9-4947-a0a7-ed6d6cd3c8f0\") " pod="openshift-insights/insights-operator-5c847dcfc4-gz8jl" Jul 02 23:07:38.983113 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:38.983056 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5d4e781e-d925-477e-98c6-cb41099c6cb0-config\") pod \"console-operator-68b757fb67-wljkx\" (UID: \"5d4e781e-d925-477e-98c6-cb41099c6cb0\") " pod="openshift-console-operator/console-operator-68b757fb67-wljkx" Jul 02 23:07:38.983113 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:38.983088 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f9de3ef6-3258-45ea-aa0a-79fde3689e1d-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-slv8j\" (UID: \"f9de3ef6-3258-45ea-aa0a-79fde3689e1d\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-slv8j" Jul 02 23:07:38.983252 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:38.983118 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x2cxv\" (UniqueName: \"kubernetes.io/projected/e5ac3fd0-32b9-4947-a0a7-ed6d6cd3c8f0-kube-api-access-x2cxv\") pod \"insights-operator-5c847dcfc4-gz8jl\" (UID: \"e5ac3fd0-32b9-4947-a0a7-ed6d6cd3c8f0\") " pod="openshift-insights/insights-operator-5c847dcfc4-gz8jl" Jul 02 23:07:38.983252 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:38.983193 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/de0c5637-bfd8-4989-a233-abc9a7cf1210-registry-certificates\") pod \"image-registry-5897776f99-njm4b\" (UID: \"de0c5637-bfd8-4989-a233-abc9a7cf1210\") " pod="openshift-image-registry/image-registry-5897776f99-njm4b" Jul 02 23:07:38.983252 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:38.983232 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5d4e781e-d925-477e-98c6-cb41099c6cb0-trusted-ca\") pod \"console-operator-68b757fb67-wljkx\" (UID: \"5d4e781e-d925-477e-98c6-cb41099c6cb0\") " pod="openshift-console-operator/console-operator-68b757fb67-wljkx" Jul 02 23:07:38.983367 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:38.983343 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/de0c5637-bfd8-4989-a233-abc9a7cf1210-image-registry-private-configuration\") pod \"image-registry-5897776f99-njm4b\" (UID: \"de0c5637-bfd8-4989-a233-abc9a7cf1210\") " pod="openshift-image-registry/image-registry-5897776f99-njm4b" Jul 02 23:07:38.983416 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:38.983377 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/de0c5637-bfd8-4989-a233-abc9a7cf1210-bound-sa-token\") pod \"image-registry-5897776f99-njm4b\" (UID: \"de0c5637-bfd8-4989-a233-abc9a7cf1210\") " pod="openshift-image-registry/image-registry-5897776f99-njm4b" Jul 02 23:07:38.983416 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:38.983410 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f9de3ef6-3258-45ea-aa0a-79fde3689e1d-config\") pod \"service-ca-operator-5d46d9ffd4-slv8j\" (UID: \"f9de3ef6-3258-45ea-aa0a-79fde3689e1d\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-slv8j" Jul 02 23:07:38.983492 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:38.983441 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e5ac3fd0-32b9-4947-a0a7-ed6d6cd3c8f0-tmp\") pod \"insights-operator-5c847dcfc4-gz8jl\" (UID: \"e5ac3fd0-32b9-4947-a0a7-ed6d6cd3c8f0\") " pod="openshift-insights/insights-operator-5c847dcfc4-gz8jl" Jul 02 23:07:38.983492 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:38.983472 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/de0c5637-bfd8-4989-a233-abc9a7cf1210-installation-pull-secrets\") pod \"image-registry-5897776f99-njm4b\" (UID: \"de0c5637-bfd8-4989-a233-abc9a7cf1210\") " pod="openshift-image-registry/image-registry-5897776f99-njm4b" Jul 02 23:07:38.983563 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:38.983501 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bfc7d\" (UniqueName: \"kubernetes.io/projected/de0c5637-bfd8-4989-a233-abc9a7cf1210-kube-api-access-bfc7d\") pod \"image-registry-5897776f99-njm4b\" (UID: \"de0c5637-bfd8-4989-a233-abc9a7cf1210\") " pod="openshift-image-registry/image-registry-5897776f99-njm4b" Jul 02 23:07:38.983563 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:38.983534 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5d4e781e-d925-477e-98c6-cb41099c6cb0-serving-cert\") pod \"console-operator-68b757fb67-wljkx\" (UID: \"5d4e781e-d925-477e-98c6-cb41099c6cb0\") " pod="openshift-console-operator/console-operator-68b757fb67-wljkx" Jul 02 23:07:38.983644 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:38.983576 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7tjbr\" (UniqueName: \"kubernetes.io/projected/5d4e781e-d925-477e-98c6-cb41099c6cb0-kube-api-access-7tjbr\") pod \"console-operator-68b757fb67-wljkx\" (UID: \"5d4e781e-d925-477e-98c6-cb41099c6cb0\") " pod="openshift-console-operator/console-operator-68b757fb67-wljkx" Jul 02 23:07:38.983644 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:38.983611 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/e5ac3fd0-32b9-4947-a0a7-ed6d6cd3c8f0-snapshots\") pod \"insights-operator-5c847dcfc4-gz8jl\" (UID: \"e5ac3fd0-32b9-4947-a0a7-ed6d6cd3c8f0\") " pod="openshift-insights/insights-operator-5c847dcfc4-gz8jl" Jul 02 23:07:38.983724 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:38.983697 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e5ac3fd0-32b9-4947-a0a7-ed6d6cd3c8f0-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-gz8jl\" (UID: \"e5ac3fd0-32b9-4947-a0a7-ed6d6cd3c8f0\") " pod="openshift-insights/insights-operator-5c847dcfc4-gz8jl" Jul 02 23:07:38.983929 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:38.983908 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/de0c5637-bfd8-4989-a233-abc9a7cf1210-registry-certificates\") pod \"image-registry-5897776f99-njm4b\" (UID: \"de0c5637-bfd8-4989-a233-abc9a7cf1210\") " pod="openshift-image-registry/image-registry-5897776f99-njm4b" Jul 02 23:07:38.984420 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:38.984399 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/de0c5637-bfd8-4989-a233-abc9a7cf1210-trusted-ca\") pod \"image-registry-5897776f99-njm4b\" (UID: \"de0c5637-bfd8-4989-a233-abc9a7cf1210\") " pod="openshift-image-registry/image-registry-5897776f99-njm4b" Jul 02 23:07:38.988252 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:38.988229 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/de0c5637-bfd8-4989-a233-abc9a7cf1210-installation-pull-secrets\") pod \"image-registry-5897776f99-njm4b\" (UID: \"de0c5637-bfd8-4989-a233-abc9a7cf1210\") " pod="openshift-image-registry/image-registry-5897776f99-njm4b" Jul 02 23:07:38.988252 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:38.988246 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/de0c5637-bfd8-4989-a233-abc9a7cf1210-image-registry-private-configuration\") pod \"image-registry-5897776f99-njm4b\" (UID: \"de0c5637-bfd8-4989-a233-abc9a7cf1210\") " pod="openshift-image-registry/image-registry-5897776f99-njm4b" Jul 02 23:07:38.992494 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:38.992470 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bfc7d\" (UniqueName: \"kubernetes.io/projected/de0c5637-bfd8-4989-a233-abc9a7cf1210-kube-api-access-bfc7d\") pod \"image-registry-5897776f99-njm4b\" (UID: \"de0c5637-bfd8-4989-a233-abc9a7cf1210\") " pod="openshift-image-registry/image-registry-5897776f99-njm4b" Jul 02 23:07:38.992803 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:38.992787 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/de0c5637-bfd8-4989-a233-abc9a7cf1210-bound-sa-token\") pod \"image-registry-5897776f99-njm4b\" (UID: \"de0c5637-bfd8-4989-a233-abc9a7cf1210\") " pod="openshift-image-registry/image-registry-5897776f99-njm4b" Jul 02 23:07:38.999252 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:38.999230 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-qt5c9"] Jul 02 23:07:39.000637 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:38.999484 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-297wc" Jul 02 23:07:39.003261 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:39.003238 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 02 23:07:39.003374 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:39.003281 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 02 23:07:39.003374 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:39.003302 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-hwg5h\"" Jul 02 23:07:39.019314 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:39.019298 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-wljkx"] Jul 02 23:07:39.019396 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:39.019325 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-2plj4"] Jul 02 23:07:39.019441 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:39.019407 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-qt5c9" Jul 02 23:07:39.021964 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:39.021945 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 02 23:07:39.022058 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:39.021945 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 02 23:07:39.022058 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:39.022027 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 02 23:07:39.022156 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:39.022071 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-rwcd4\"" Jul 02 23:07:39.029650 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:39.029632 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-297wc"] Jul 02 23:07:39.029723 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:39.029660 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-9m5nh"] Jul 02 23:07:39.029723 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:39.029681 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-qt5c9"] Jul 02 23:07:39.029723 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:39.029695 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-8nlmv"] Jul 02 23:07:39.029723 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:39.029709 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-slv8j"] Jul 02 23:07:39.029723 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:39.029720 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6744ddf86c-cr66l"] Jul 02 23:07:39.029880 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:39.029732 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-gz8jl"] Jul 02 23:07:39.029880 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:39.029760 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-2plj4" Jul 02 23:07:39.029880 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:39.029773 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-2plj4"] Jul 02 23:07:39.029880 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:39.029788 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-frm7j"] Jul 02 23:07:39.032664 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:39.032490 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-95679\"" Jul 02 23:07:39.048994 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:39.048947 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-z6p55_b08f4b68-d33f-48a2-90d0-0c6511ba679a/konnectivity-agent/0.log" limit=1024 Jul 02 23:07:39.084946 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:39.084917 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d7c5d79d-d705-4d68-8e46-a31b1603915e-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-8nlmv\" (UID: \"d7c5d79d-d705-4d68-8e46-a31b1603915e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-8nlmv" Jul 02 23:07:39.085071 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:39.084954 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2690f25f-010b-41df-9514-f57323b17283-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-frm7j\" (UID: \"2690f25f-010b-41df-9514-f57323b17283\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-frm7j" Jul 02 23:07:39.085071 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:39.084996 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d7c5d79d-d705-4d68-8e46-a31b1603915e-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-8nlmv\" (UID: \"d7c5d79d-d705-4d68-8e46-a31b1603915e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-8nlmv" Jul 02 23:07:39.085071 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:39.085034 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/758d5a7d-658b-40b4-ac5d-7629e8172325-config-volume\") pod \"dns-default-9m5nh\" (UID: \"758d5a7d-658b-40b4-ac5d-7629e8172325\") " pod="openshift-dns/dns-default-9m5nh" Jul 02 23:07:39.085071 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:39.085061 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e5ac3fd0-32b9-4947-a0a7-ed6d6cd3c8f0-serving-cert\") pod \"insights-operator-5c847dcfc4-gz8jl\" (UID: \"e5ac3fd0-32b9-4947-a0a7-ed6d6cd3c8f0\") " pod="openshift-insights/insights-operator-5c847dcfc4-gz8jl" Jul 02 23:07:39.085218 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:39.085092 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/758d5a7d-658b-40b4-ac5d-7629e8172325-tmp-dir\") pod \"dns-default-9m5nh\" (UID: \"758d5a7d-658b-40b4-ac5d-7629e8172325\") " pod="openshift-dns/dns-default-9m5nh" Jul 02 23:07:39.085282 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:39.085263 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5d4e781e-d925-477e-98c6-cb41099c6cb0-trusted-ca\") pod \"console-operator-68b757fb67-wljkx\" (UID: \"5d4e781e-d925-477e-98c6-cb41099c6cb0\") " pod="openshift-console-operator/console-operator-68b757fb67-wljkx" Jul 02 23:07:39.085350 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:39.085333 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/758d5a7d-658b-40b4-ac5d-7629e8172325-metrics-tls\") pod \"dns-default-9m5nh\" (UID: \"758d5a7d-658b-40b4-ac5d-7629e8172325\") " pod="openshift-dns/dns-default-9m5nh" Jul 02 23:07:39.085397 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:39.085369 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/e5ac3fd0-32b9-4947-a0a7-ed6d6cd3c8f0-snapshots\") pod \"insights-operator-5c847dcfc4-gz8jl\" (UID: \"e5ac3fd0-32b9-4947-a0a7-ed6d6cd3c8f0\") " pod="openshift-insights/insights-operator-5c847dcfc4-gz8jl" Jul 02 23:07:39.085443 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:39.085407 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e5ac3fd0-32b9-4947-a0a7-ed6d6cd3c8f0-tmp\") pod \"insights-operator-5c847dcfc4-gz8jl\" (UID: \"e5ac3fd0-32b9-4947-a0a7-ed6d6cd3c8f0\") " pod="openshift-insights/insights-operator-5c847dcfc4-gz8jl" Jul 02 23:07:39.085443 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:39.085432 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/0ca0d12d-9442-4bbb-8c4c-d2e4e513dd18-stats-auth\") pod \"router-default-6744ddf86c-cr66l\" (UID: \"0ca0d12d-9442-4bbb-8c4c-d2e4e513dd18\") " pod="openshift-ingress/router-default-6744ddf86c-cr66l" Jul 02 23:07:39.085540 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:39.085458 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5xrf5\" (UniqueName: \"kubernetes.io/projected/0ca0d12d-9442-4bbb-8c4c-d2e4e513dd18-kube-api-access-5xrf5\") pod \"router-default-6744ddf86c-cr66l\" (UID: \"0ca0d12d-9442-4bbb-8c4c-d2e4e513dd18\") " pod="openshift-ingress/router-default-6744ddf86c-cr66l" Jul 02 23:07:39.085540 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:39.085485 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7tjbr\" (UniqueName: \"kubernetes.io/projected/5d4e781e-d925-477e-98c6-cb41099c6cb0-kube-api-access-7tjbr\") pod \"console-operator-68b757fb67-wljkx\" (UID: \"5d4e781e-d925-477e-98c6-cb41099c6cb0\") " pod="openshift-console-operator/console-operator-68b757fb67-wljkx" Jul 02 23:07:39.085540 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:39.085526 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0ca0d12d-9442-4bbb-8c4c-d2e4e513dd18-metrics-certs\") pod \"router-default-6744ddf86c-cr66l\" (UID: \"0ca0d12d-9442-4bbb-8c4c-d2e4e513dd18\") " pod="openshift-ingress/router-default-6744ddf86c-cr66l" Jul 02 23:07:39.085664 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:39.085624 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4dhf\" (UniqueName: \"kubernetes.io/projected/758d5a7d-658b-40b4-ac5d-7629e8172325-kube-api-access-w4dhf\") pod \"dns-default-9m5nh\" (UID: \"758d5a7d-658b-40b4-ac5d-7629e8172325\") " pod="openshift-dns/dns-default-9m5nh" Jul 02 23:07:39.085664 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:39.085658 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5tsvb\" (UniqueName: \"kubernetes.io/projected/746b57b7-42ad-4c35-b0e4-778b0732ea77-kube-api-access-5tsvb\") pod \"volume-data-source-validator-5d456fdbcd-dkbs8\" (UID: \"746b57b7-42ad-4c35-b0e4-778b0732ea77\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-dkbs8" Jul 02 23:07:39.085776 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:39.085682 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/0ca0d12d-9442-4bbb-8c4c-d2e4e513dd18-default-certificate\") pod \"router-default-6744ddf86c-cr66l\" (UID: \"0ca0d12d-9442-4bbb-8c4c-d2e4e513dd18\") " pod="openshift-ingress/router-default-6744ddf86c-cr66l" Jul 02 23:07:39.085776 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:39.085712 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kltwx\" (UniqueName: \"kubernetes.io/projected/f9de3ef6-3258-45ea-aa0a-79fde3689e1d-kube-api-access-kltwx\") pod \"service-ca-operator-5d46d9ffd4-slv8j\" (UID: \"f9de3ef6-3258-45ea-aa0a-79fde3689e1d\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-slv8j" Jul 02 23:07:39.085776 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:39.085761 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4530ab49-f26f-4e05-83ad-d40e9327478a-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-92c6f\" (UID: \"4530ab49-f26f-4e05-83ad-d40e9327478a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-92c6f" Jul 02 23:07:39.085918 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:39.085788 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x8kd2\" (UniqueName: \"kubernetes.io/projected/4530ab49-f26f-4e05-83ad-d40e9327478a-kube-api-access-x8kd2\") pod \"cluster-samples-operator-56fcf86bf-92c6f\" (UID: \"4530ab49-f26f-4e05-83ad-d40e9327478a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-92c6f" Jul 02 23:07:39.085918 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:39.085815 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e5ac3fd0-32b9-4947-a0a7-ed6d6cd3c8f0-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-gz8jl\" (UID: \"e5ac3fd0-32b9-4947-a0a7-ed6d6cd3c8f0\") " pod="openshift-insights/insights-operator-5c847dcfc4-gz8jl" Jul 02 23:07:39.085998 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:39.085979 2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 02 23:07:39.086044 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:39.085966 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5d4e781e-d925-477e-98c6-cb41099c6cb0-config\") pod \"console-operator-68b757fb67-wljkx\" (UID: \"5d4e781e-d925-477e-98c6-cb41099c6cb0\") " pod="openshift-console-operator/console-operator-68b757fb67-wljkx" Jul 02 23:07:39.086044 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:39.086021 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4530ab49-f26f-4e05-83ad-d40e9327478a-samples-operator-tls podName:4530ab49-f26f-4e05-83ad-d40e9327478a nodeName:}" failed. No retries permitted until 2026-07-02 23:07:39.586008819 +0000 UTC m=+36.219049940 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/4530ab49-f26f-4e05-83ad-d40e9327478a-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-92c6f" (UID: "4530ab49-f26f-4e05-83ad-d40e9327478a") : secret "samples-operator-tls" not found Jul 02 23:07:39.086044 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:39.086042 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x2cxv\" (UniqueName: \"kubernetes.io/projected/e5ac3fd0-32b9-4947-a0a7-ed6d6cd3c8f0-kube-api-access-x2cxv\") pod \"insights-operator-5c847dcfc4-gz8jl\" (UID: \"e5ac3fd0-32b9-4947-a0a7-ed6d6cd3c8f0\") " pod="openshift-insights/insights-operator-5c847dcfc4-gz8jl" Jul 02 23:07:39.086191 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:39.086061 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/2690f25f-010b-41df-9514-f57323b17283-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-frm7j\" (UID: \"2690f25f-010b-41df-9514-f57323b17283\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-frm7j" Jul 02 23:07:39.086191 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:39.086071 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/e5ac3fd0-32b9-4947-a0a7-ed6d6cd3c8f0-snapshots\") pod \"insights-operator-5c847dcfc4-gz8jl\" (UID: \"e5ac3fd0-32b9-4947-a0a7-ed6d6cd3c8f0\") " pod="openshift-insights/insights-operator-5c847dcfc4-gz8jl" Jul 02 23:07:39.086191 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:39.086080 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f9de3ef6-3258-45ea-aa0a-79fde3689e1d-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-slv8j\" (UID: \"f9de3ef6-3258-45ea-aa0a-79fde3689e1d\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-slv8j" Jul 02 23:07:39.086191 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:39.086097 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6ljpv\" (UniqueName: \"kubernetes.io/projected/d7c5d79d-d705-4d68-8e46-a31b1603915e-kube-api-access-6ljpv\") pod \"kube-storage-version-migrator-operator-846bf668f7-8nlmv\" (UID: \"d7c5d79d-d705-4d68-8e46-a31b1603915e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-8nlmv" Jul 02 23:07:39.086191 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:39.086113 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rksjd\" (UniqueName: \"kubernetes.io/projected/2690f25f-010b-41df-9514-f57323b17283-kube-api-access-rksjd\") pod \"cluster-monitoring-operator-64786d9cbb-frm7j\" (UID: \"2690f25f-010b-41df-9514-f57323b17283\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-frm7j" Jul 02 23:07:39.086191 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:39.086128 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5d4e781e-d925-477e-98c6-cb41099c6cb0-trusted-ca\") pod \"console-operator-68b757fb67-wljkx\" (UID: \"5d4e781e-d925-477e-98c6-cb41099c6cb0\") " pod="openshift-console-operator/console-operator-68b757fb67-wljkx" Jul 02 23:07:39.086483 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:39.086305 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ca0d12d-9442-4bbb-8c4c-d2e4e513dd18-service-ca-bundle\") pod \"router-default-6744ddf86c-cr66l\" (UID: \"0ca0d12d-9442-4bbb-8c4c-d2e4e513dd18\") " pod="openshift-ingress/router-default-6744ddf86c-cr66l" Jul 02 23:07:39.086483 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:39.086327 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5d4e781e-d925-477e-98c6-cb41099c6cb0-serving-cert\") pod \"console-operator-68b757fb67-wljkx\" (UID: \"5d4e781e-d925-477e-98c6-cb41099c6cb0\") " pod="openshift-console-operator/console-operator-68b757fb67-wljkx" Jul 02 23:07:39.086483 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:39.086352 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f9de3ef6-3258-45ea-aa0a-79fde3689e1d-config\") pod \"service-ca-operator-5d46d9ffd4-slv8j\" (UID: \"f9de3ef6-3258-45ea-aa0a-79fde3689e1d\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-slv8j" Jul 02 23:07:39.086483 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:39.086372 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e5ac3fd0-32b9-4947-a0a7-ed6d6cd3c8f0-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-gz8jl\" (UID: \"e5ac3fd0-32b9-4947-a0a7-ed6d6cd3c8f0\") " pod="openshift-insights/insights-operator-5c847dcfc4-gz8jl" Jul 02 23:07:39.086690 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:39.086623 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5d4e781e-d925-477e-98c6-cb41099c6cb0-config\") pod \"console-operator-68b757fb67-wljkx\" (UID: \"5d4e781e-d925-477e-98c6-cb41099c6cb0\") " pod="openshift-console-operator/console-operator-68b757fb67-wljkx" Jul 02 23:07:39.086932 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:39.086908 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e5ac3fd0-32b9-4947-a0a7-ed6d6cd3c8f0-tmp\") pod \"insights-operator-5c847dcfc4-gz8jl\" (UID: \"e5ac3fd0-32b9-4947-a0a7-ed6d6cd3c8f0\") " pod="openshift-insights/insights-operator-5c847dcfc4-gz8jl" Jul 02 23:07:39.087154 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:39.087130 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e5ac3fd0-32b9-4947-a0a7-ed6d6cd3c8f0-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-gz8jl\" (UID: \"e5ac3fd0-32b9-4947-a0a7-ed6d6cd3c8f0\") " pod="openshift-insights/insights-operator-5c847dcfc4-gz8jl" Jul 02 23:07:39.087271 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:39.087228 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e5ac3fd0-32b9-4947-a0a7-ed6d6cd3c8f0-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-gz8jl\" (UID: \"e5ac3fd0-32b9-4947-a0a7-ed6d6cd3c8f0\") " pod="openshift-insights/insights-operator-5c847dcfc4-gz8jl" Jul 02 23:07:39.087348 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:39.087305 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f9de3ef6-3258-45ea-aa0a-79fde3689e1d-config\") pod \"service-ca-operator-5d46d9ffd4-slv8j\" (UID: \"f9de3ef6-3258-45ea-aa0a-79fde3689e1d\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-slv8j" Jul 02 23:07:39.088260 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:39.088237 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e5ac3fd0-32b9-4947-a0a7-ed6d6cd3c8f0-serving-cert\") pod \"insights-operator-5c847dcfc4-gz8jl\" (UID: \"e5ac3fd0-32b9-4947-a0a7-ed6d6cd3c8f0\") " pod="openshift-insights/insights-operator-5c847dcfc4-gz8jl" Jul 02 23:07:39.088680 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:39.088657 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f9de3ef6-3258-45ea-aa0a-79fde3689e1d-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-slv8j\" (UID: \"f9de3ef6-3258-45ea-aa0a-79fde3689e1d\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-slv8j" Jul 02 23:07:39.089306 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:39.089287 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5d4e781e-d925-477e-98c6-cb41099c6cb0-serving-cert\") pod \"console-operator-68b757fb67-wljkx\" (UID: \"5d4e781e-d925-477e-98c6-cb41099c6cb0\") " pod="openshift-console-operator/console-operator-68b757fb67-wljkx" Jul 02 23:07:39.098207 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:39.098162 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7tjbr\" (UniqueName: \"kubernetes.io/projected/5d4e781e-d925-477e-98c6-cb41099c6cb0-kube-api-access-7tjbr\") pod \"console-operator-68b757fb67-wljkx\" (UID: \"5d4e781e-d925-477e-98c6-cb41099c6cb0\") " pod="openshift-console-operator/console-operator-68b757fb67-wljkx" Jul 02 23:07:39.098333 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:39.098308 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x8kd2\" (UniqueName: \"kubernetes.io/projected/4530ab49-f26f-4e05-83ad-d40e9327478a-kube-api-access-x8kd2\") pod \"cluster-samples-operator-56fcf86bf-92c6f\" (UID: \"4530ab49-f26f-4e05-83ad-d40e9327478a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-92c6f" Jul 02 23:07:39.098564 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:39.098545 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x2cxv\" (UniqueName: \"kubernetes.io/projected/e5ac3fd0-32b9-4947-a0a7-ed6d6cd3c8f0-kube-api-access-x2cxv\") pod \"insights-operator-5c847dcfc4-gz8jl\" (UID: \"e5ac3fd0-32b9-4947-a0a7-ed6d6cd3c8f0\") " pod="openshift-insights/insights-operator-5c847dcfc4-gz8jl" Jul 02 23:07:39.098866 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:39.098844 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5tsvb\" (UniqueName: \"kubernetes.io/projected/746b57b7-42ad-4c35-b0e4-778b0732ea77-kube-api-access-5tsvb\") pod \"volume-data-source-validator-5d456fdbcd-dkbs8\" (UID: \"746b57b7-42ad-4c35-b0e4-778b0732ea77\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-dkbs8" Jul 02 23:07:39.099586 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:39.099548 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kltwx\" (UniqueName: \"kubernetes.io/projected/f9de3ef6-3258-45ea-aa0a-79fde3689e1d-kube-api-access-kltwx\") pod \"service-ca-operator-5d46d9ffd4-slv8j\" (UID: \"f9de3ef6-3258-45ea-aa0a-79fde3689e1d\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-slv8j" Jul 02 23:07:39.117589 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:39.117568 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-wljkx" Jul 02 23:07:39.166906 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:39.166886 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-slv8j" Jul 02 23:07:39.186929 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:39.186900 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w4dhf\" (UniqueName: \"kubernetes.io/projected/758d5a7d-658b-40b4-ac5d-7629e8172325-kube-api-access-w4dhf\") pod \"dns-default-9m5nh\" (UID: \"758d5a7d-658b-40b4-ac5d-7629e8172325\") " pod="openshift-dns/dns-default-9m5nh" Jul 02 23:07:39.187025 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:39.186941 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/0ca0d12d-9442-4bbb-8c4c-d2e4e513dd18-default-certificate\") pod \"router-default-6744ddf86c-cr66l\" (UID: \"0ca0d12d-9442-4bbb-8c4c-d2e4e513dd18\") " pod="openshift-ingress/router-default-6744ddf86c-cr66l" Jul 02 23:07:39.187025 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:39.186976 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rn6nf\" (UniqueName: \"kubernetes.io/projected/477877c9-88e5-4eb4-afc4-3e9a45bb78fd-kube-api-access-rn6nf\") pod \"network-check-source-989f8b8dc-2plj4\" (UID: \"477877c9-88e5-4eb4-afc4-3e9a45bb78fd\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-2plj4" Jul 02 23:07:39.187025 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:39.187011 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/cd1134b6-429c-4008-8b58-5da7f4e9fc3f-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-297wc\" (UID: \"cd1134b6-429c-4008-8b58-5da7f4e9fc3f\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-297wc" Jul 02 23:07:39.187154 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:39.187058 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/2690f25f-010b-41df-9514-f57323b17283-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-frm7j\" (UID: \"2690f25f-010b-41df-9514-f57323b17283\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-frm7j" Jul 02 23:07:39.187154 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:39.187086 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6ljpv\" (UniqueName: \"kubernetes.io/projected/d7c5d79d-d705-4d68-8e46-a31b1603915e-kube-api-access-6ljpv\") pod \"kube-storage-version-migrator-operator-846bf668f7-8nlmv\" (UID: \"d7c5d79d-d705-4d68-8e46-a31b1603915e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-8nlmv" Jul 02 23:07:39.187154 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:39.187109 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rksjd\" (UniqueName: \"kubernetes.io/projected/2690f25f-010b-41df-9514-f57323b17283-kube-api-access-rksjd\") pod \"cluster-monitoring-operator-64786d9cbb-frm7j\" (UID: \"2690f25f-010b-41df-9514-f57323b17283\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-frm7j" Jul 02 23:07:39.187154 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:39.187135 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ca0d12d-9442-4bbb-8c4c-d2e4e513dd18-service-ca-bundle\") pod \"router-default-6744ddf86c-cr66l\" (UID: \"0ca0d12d-9442-4bbb-8c4c-d2e4e513dd18\") " pod="openshift-ingress/router-default-6744ddf86c-cr66l" Jul 02 23:07:39.187292 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:39.187172 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/cd1134b6-429c-4008-8b58-5da7f4e9fc3f-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-297wc\" (UID: \"cd1134b6-429c-4008-8b58-5da7f4e9fc3f\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-297wc" Jul 02 23:07:39.187754 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:39.187718 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0ca0d12d-9442-4bbb-8c4c-d2e4e513dd18-service-ca-bundle podName:0ca0d12d-9442-4bbb-8c4c-d2e4e513dd18 nodeName:}" failed. No retries permitted until 2026-07-02 23:07:39.687697988 +0000 UTC m=+36.320739109 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0ca0d12d-9442-4bbb-8c4c-d2e4e513dd18-service-ca-bundle") pod "router-default-6744ddf86c-cr66l" (UID: "0ca0d12d-9442-4bbb-8c4c-d2e4e513dd18") : configmap references non-existent config key: service-ca.crt Jul 02 23:07:39.187861 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:39.187822 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d7c5d79d-d705-4d68-8e46-a31b1603915e-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-8nlmv\" (UID: \"d7c5d79d-d705-4d68-8e46-a31b1603915e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-8nlmv" Jul 02 23:07:39.187921 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:39.187860 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2690f25f-010b-41df-9514-f57323b17283-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-frm7j\" (UID: \"2690f25f-010b-41df-9514-f57323b17283\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-frm7j" Jul 02 23:07:39.187921 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:39.187905 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d7c5d79d-d705-4d68-8e46-a31b1603915e-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-8nlmv\" (UID: \"d7c5d79d-d705-4d68-8e46-a31b1603915e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-8nlmv" Jul 02 23:07:39.188028 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:39.187927 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/2690f25f-010b-41df-9514-f57323b17283-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-frm7j\" (UID: \"2690f25f-010b-41df-9514-f57323b17283\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-frm7j" Jul 02 23:07:39.188028 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:39.187934 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vz8cn\" (UniqueName: \"kubernetes.io/projected/54034b49-3b9e-4f1c-bf13-fd5e97aa8f72-kube-api-access-vz8cn\") pod \"ingress-canary-qt5c9\" (UID: \"54034b49-3b9e-4f1c-bf13-fd5e97aa8f72\") " pod="openshift-ingress-canary/ingress-canary-qt5c9" Jul 02 23:07:39.188206 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:39.188026 2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 02 23:07:39.188206 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:39.188088 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2690f25f-010b-41df-9514-f57323b17283-cluster-monitoring-operator-tls podName:2690f25f-010b-41df-9514-f57323b17283 nodeName:}" failed. No retries permitted until 2026-07-02 23:07:39.688068381 +0000 UTC m=+36.321109503 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2690f25f-010b-41df-9514-f57323b17283-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-frm7j" (UID: "2690f25f-010b-41df-9514-f57323b17283") : secret "cluster-monitoring-operator-tls" not found Jul 02 23:07:39.188206 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:39.188142 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/758d5a7d-658b-40b4-ac5d-7629e8172325-config-volume\") pod \"dns-default-9m5nh\" (UID: \"758d5a7d-658b-40b4-ac5d-7629e8172325\") " pod="openshift-dns/dns-default-9m5nh" Jul 02 23:07:39.188206 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:39.188184 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/54034b49-3b9e-4f1c-bf13-fd5e97aa8f72-cert\") pod \"ingress-canary-qt5c9\" (UID: \"54034b49-3b9e-4f1c-bf13-fd5e97aa8f72\") " pod="openshift-ingress-canary/ingress-canary-qt5c9" Jul 02 23:07:39.188476 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:39.188213 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/758d5a7d-658b-40b4-ac5d-7629e8172325-tmp-dir\") pod \"dns-default-9m5nh\" (UID: \"758d5a7d-658b-40b4-ac5d-7629e8172325\") " pod="openshift-dns/dns-default-9m5nh" Jul 02 23:07:39.188476 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:39.188250 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/758d5a7d-658b-40b4-ac5d-7629e8172325-metrics-tls\") pod \"dns-default-9m5nh\" (UID: \"758d5a7d-658b-40b4-ac5d-7629e8172325\") " pod="openshift-dns/dns-default-9m5nh" Jul 02 23:07:39.188476 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:39.188292 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/0ca0d12d-9442-4bbb-8c4c-d2e4e513dd18-stats-auth\") pod \"router-default-6744ddf86c-cr66l\" (UID: \"0ca0d12d-9442-4bbb-8c4c-d2e4e513dd18\") " pod="openshift-ingress/router-default-6744ddf86c-cr66l" Jul 02 23:07:39.188476 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:39.188321 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5xrf5\" (UniqueName: \"kubernetes.io/projected/0ca0d12d-9442-4bbb-8c4c-d2e4e513dd18-kube-api-access-5xrf5\") pod \"router-default-6744ddf86c-cr66l\" (UID: \"0ca0d12d-9442-4bbb-8c4c-d2e4e513dd18\") " pod="openshift-ingress/router-default-6744ddf86c-cr66l" Jul 02 23:07:39.188476 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:39.188354 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0ca0d12d-9442-4bbb-8c4c-d2e4e513dd18-metrics-certs\") pod \"router-default-6744ddf86c-cr66l\" (UID: \"0ca0d12d-9442-4bbb-8c4c-d2e4e513dd18\") " pod="openshift-ingress/router-default-6744ddf86c-cr66l" Jul 02 23:07:39.188476 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:39.188396 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d7c5d79d-d705-4d68-8e46-a31b1603915e-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-8nlmv\" (UID: \"d7c5d79d-d705-4d68-8e46-a31b1603915e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-8nlmv" Jul 02 23:07:39.188476 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:39.188459 2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 02 23:07:39.188865 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:39.188505 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ca0d12d-9442-4bbb-8c4c-d2e4e513dd18-metrics-certs podName:0ca0d12d-9442-4bbb-8c4c-d2e4e513dd18 nodeName:}" failed. No retries permitted until 2026-07-02 23:07:39.688490612 +0000 UTC m=+36.321531733 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0ca0d12d-9442-4bbb-8c4c-d2e4e513dd18-metrics-certs") pod "router-default-6744ddf86c-cr66l" (UID: "0ca0d12d-9442-4bbb-8c4c-d2e4e513dd18") : secret "router-metrics-certs-default" not found Jul 02 23:07:39.188996 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:39.188978 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 23:07:39.188996 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:39.188986 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/758d5a7d-658b-40b4-ac5d-7629e8172325-tmp-dir\") pod \"dns-default-9m5nh\" (UID: \"758d5a7d-658b-40b4-ac5d-7629e8172325\") " pod="openshift-dns/dns-default-9m5nh" Jul 02 23:07:39.189118 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:39.189027 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/758d5a7d-658b-40b4-ac5d-7629e8172325-metrics-tls podName:758d5a7d-658b-40b4-ac5d-7629e8172325 nodeName:}" failed. No retries permitted until 2026-07-02 23:07:39.689012346 +0000 UTC m=+36.322053468 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/758d5a7d-658b-40b4-ac5d-7629e8172325-metrics-tls") pod "dns-default-9m5nh" (UID: "758d5a7d-658b-40b4-ac5d-7629e8172325") : secret "dns-default-metrics-tls" not found Jul 02 23:07:39.189916 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:39.189873 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/758d5a7d-658b-40b4-ac5d-7629e8172325-config-volume\") pod \"dns-default-9m5nh\" (UID: \"758d5a7d-658b-40b4-ac5d-7629e8172325\") " pod="openshift-dns/dns-default-9m5nh" Jul 02 23:07:39.190605 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:39.190561 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/0ca0d12d-9442-4bbb-8c4c-d2e4e513dd18-default-certificate\") pod \"router-default-6744ddf86c-cr66l\" (UID: \"0ca0d12d-9442-4bbb-8c4c-d2e4e513dd18\") " pod="openshift-ingress/router-default-6744ddf86c-cr66l" Jul 02 23:07:39.192423 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:39.192401 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d7c5d79d-d705-4d68-8e46-a31b1603915e-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-8nlmv\" (UID: \"d7c5d79d-d705-4d68-8e46-a31b1603915e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-8nlmv" Jul 02 23:07:39.193365 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:39.193330 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/0ca0d12d-9442-4bbb-8c4c-d2e4e513dd18-stats-auth\") pod \"router-default-6744ddf86c-cr66l\" (UID: \"0ca0d12d-9442-4bbb-8c4c-d2e4e513dd18\") " pod="openshift-ingress/router-default-6744ddf86c-cr66l" Jul 02 23:07:39.198117 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:39.198068 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rksjd\" (UniqueName: \"kubernetes.io/projected/2690f25f-010b-41df-9514-f57323b17283-kube-api-access-rksjd\") pod \"cluster-monitoring-operator-64786d9cbb-frm7j\" (UID: \"2690f25f-010b-41df-9514-f57323b17283\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-frm7j" Jul 02 23:07:39.198571 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:39.198536 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5xrf5\" (UniqueName: \"kubernetes.io/projected/0ca0d12d-9442-4bbb-8c4c-d2e4e513dd18-kube-api-access-5xrf5\") pod \"router-default-6744ddf86c-cr66l\" (UID: \"0ca0d12d-9442-4bbb-8c4c-d2e4e513dd18\") " pod="openshift-ingress/router-default-6744ddf86c-cr66l" Jul 02 23:07:39.199477 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:39.199444 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4dhf\" (UniqueName: \"kubernetes.io/projected/758d5a7d-658b-40b4-ac5d-7629e8172325-kube-api-access-w4dhf\") pod \"dns-default-9m5nh\" (UID: \"758d5a7d-658b-40b4-ac5d-7629e8172325\") " pod="openshift-dns/dns-default-9m5nh" Jul 02 23:07:39.200794 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:39.199904 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6ljpv\" (UniqueName: \"kubernetes.io/projected/d7c5d79d-d705-4d68-8e46-a31b1603915e-kube-api-access-6ljpv\") pod \"kube-storage-version-migrator-operator-846bf668f7-8nlmv\" (UID: \"d7c5d79d-d705-4d68-8e46-a31b1603915e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-8nlmv" Jul 02 23:07:39.200794 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:39.200579 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-dkbs8" Jul 02 23:07:39.206100 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:39.206080 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-gz8jl" Jul 02 23:07:39.264539 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:39.263937 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-8nlmv" Jul 02 23:07:39.288863 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:39.288840 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/54034b49-3b9e-4f1c-bf13-fd5e97aa8f72-cert\") pod \"ingress-canary-qt5c9\" (UID: \"54034b49-3b9e-4f1c-bf13-fd5e97aa8f72\") " pod="openshift-ingress-canary/ingress-canary-qt5c9" Jul 02 23:07:39.288974 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:39.288938 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rn6nf\" (UniqueName: \"kubernetes.io/projected/477877c9-88e5-4eb4-afc4-3e9a45bb78fd-kube-api-access-rn6nf\") pod \"network-check-source-989f8b8dc-2plj4\" (UID: \"477877c9-88e5-4eb4-afc4-3e9a45bb78fd\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-2plj4" Jul 02 23:07:39.288974 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:39.288969 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/cd1134b6-429c-4008-8b58-5da7f4e9fc3f-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-297wc\" (UID: \"cd1134b6-429c-4008-8b58-5da7f4e9fc3f\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-297wc" Jul 02 23:07:39.289086 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:39.289047 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/cd1134b6-429c-4008-8b58-5da7f4e9fc3f-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-297wc\" (UID: \"cd1134b6-429c-4008-8b58-5da7f4e9fc3f\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-297wc" Jul 02 23:07:39.289139 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:39.289110 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vz8cn\" (UniqueName: \"kubernetes.io/projected/54034b49-3b9e-4f1c-bf13-fd5e97aa8f72-kube-api-access-vz8cn\") pod \"ingress-canary-qt5c9\" (UID: \"54034b49-3b9e-4f1c-bf13-fd5e97aa8f72\") " pod="openshift-ingress-canary/ingress-canary-qt5c9" Jul 02 23:07:39.290015 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:39.289978 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/cd1134b6-429c-4008-8b58-5da7f4e9fc3f-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-297wc\" (UID: \"cd1134b6-429c-4008-8b58-5da7f4e9fc3f\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-297wc" Jul 02 23:07:39.290015 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:39.289987 2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 02 23:07:39.290179 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:39.290084 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd1134b6-429c-4008-8b58-5da7f4e9fc3f-networking-console-plugin-cert podName:cd1134b6-429c-4008-8b58-5da7f4e9fc3f nodeName:}" failed. No retries permitted until 2026-07-02 23:07:39.790047317 +0000 UTC m=+36.423088442 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/cd1134b6-429c-4008-8b58-5da7f4e9fc3f-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-297wc" (UID: "cd1134b6-429c-4008-8b58-5da7f4e9fc3f") : secret "networking-console-plugin-cert" not found Jul 02 23:07:39.294694 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:39.294649 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/54034b49-3b9e-4f1c-bf13-fd5e97aa8f72-cert\") pod \"ingress-canary-qt5c9\" (UID: \"54034b49-3b9e-4f1c-bf13-fd5e97aa8f72\") " pod="openshift-ingress-canary/ingress-canary-qt5c9" Jul 02 23:07:39.302878 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:39.302808 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rn6nf\" (UniqueName: \"kubernetes.io/projected/477877c9-88e5-4eb4-afc4-3e9a45bb78fd-kube-api-access-rn6nf\") pod \"network-check-source-989f8b8dc-2plj4\" (UID: \"477877c9-88e5-4eb4-afc4-3e9a45bb78fd\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-2plj4" Jul 02 23:07:39.304806 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:39.304662 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vz8cn\" (UniqueName: \"kubernetes.io/projected/54034b49-3b9e-4f1c-bf13-fd5e97aa8f72-kube-api-access-vz8cn\") pod \"ingress-canary-qt5c9\" (UID: \"54034b49-3b9e-4f1c-bf13-fd5e97aa8f72\") " pod="openshift-ingress-canary/ingress-canary-qt5c9" Jul 02 23:07:39.332242 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:39.327798 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-qt5c9" Jul 02 23:07:39.337467 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:39.337224 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-2plj4" Jul 02 23:07:39.379198 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:39.379073 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-slv8j"] Jul 02 23:07:39.395113 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:39.394600 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-wljkx"] Jul 02 23:07:39.490883 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:39.490623 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/de0c5637-bfd8-4989-a233-abc9a7cf1210-registry-tls\") pod \"image-registry-5897776f99-njm4b\" (UID: \"de0c5637-bfd8-4989-a233-abc9a7cf1210\") " pod="openshift-image-registry/image-registry-5897776f99-njm4b" Jul 02 23:07:39.490991 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:39.490901 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 23:07:39.490991 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:39.490924 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5897776f99-njm4b: secret "image-registry-tls" not found Jul 02 23:07:39.490991 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:39.490985 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/de0c5637-bfd8-4989-a233-abc9a7cf1210-registry-tls podName:de0c5637-bfd8-4989-a233-abc9a7cf1210 nodeName:}" failed. No retries permitted until 2026-07-02 23:07:40.490965307 +0000 UTC m=+37.124006431 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/de0c5637-bfd8-4989-a233-abc9a7cf1210-registry-tls") pod "image-registry-5897776f99-njm4b" (UID: "de0c5637-bfd8-4989-a233-abc9a7cf1210") : secret "image-registry-tls" not found Jul 02 23:07:39.497531 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:39.497506 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-dkbs8"] Jul 02 23:07:39.501900 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:39.501812 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-gz8jl"] Jul 02 23:07:39.511807 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:39.510767 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-8nlmv"] Jul 02 23:07:39.516956 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:39.516866 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7c5d79d_d705_4d68_8e46_a31b1603915e.slice/crio-eb254c543682e5519cd2c0d3bb6e56c30a32599463a589bb8334edf16fb09942 WatchSource:0}: Error finding container eb254c543682e5519cd2c0d3bb6e56c30a32599463a589bb8334edf16fb09942: Status 404 returned error can't find the container with id eb254c543682e5519cd2c0d3bb6e56c30a32599463a589bb8334edf16fb09942 Jul 02 23:07:39.559237 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:39.559207 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-qt5c9"] Jul 02 23:07:39.563018 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:39.562978 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54034b49_3b9e_4f1c_bf13_fd5e97aa8f72.slice/crio-d5a3c44f13332c1b6bd2e9600b25ae7574095f171b840b2691e2f8e6051693d1 WatchSource:0}: Error finding container d5a3c44f13332c1b6bd2e9600b25ae7574095f171b840b2691e2f8e6051693d1: Status 404 returned error can't find the container with id d5a3c44f13332c1b6bd2e9600b25ae7574095f171b840b2691e2f8e6051693d1 Jul 02 23:07:39.564237 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:39.564175 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-2plj4"] Jul 02 23:07:39.566772 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:39.566724 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod477877c9_88e5_4eb4_afc4_3e9a45bb78fd.slice/crio-95964f40225bbe9aff163eb5526a776d2d89d5bb6bf6180ff58423b449b72291 WatchSource:0}: Error finding container 95964f40225bbe9aff163eb5526a776d2d89d5bb6bf6180ff58423b449b72291: Status 404 returned error can't find the container with id 95964f40225bbe9aff163eb5526a776d2d89d5bb6bf6180ff58423b449b72291 Jul 02 23:07:39.592117 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:39.592084 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4530ab49-f26f-4e05-83ad-d40e9327478a-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-92c6f\" (UID: \"4530ab49-f26f-4e05-83ad-d40e9327478a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-92c6f" Jul 02 23:07:39.592273 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:39.592249 2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 02 23:07:39.592360 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:39.592315 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4530ab49-f26f-4e05-83ad-d40e9327478a-samples-operator-tls podName:4530ab49-f26f-4e05-83ad-d40e9327478a nodeName:}" failed. No retries permitted until 2026-07-02 23:07:40.592299942 +0000 UTC m=+37.225341067 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/4530ab49-f26f-4e05-83ad-d40e9327478a-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-92c6f" (UID: "4530ab49-f26f-4e05-83ad-d40e9327478a") : secret "samples-operator-tls" not found Jul 02 23:07:39.693282 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:39.693252 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2690f25f-010b-41df-9514-f57323b17283-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-frm7j\" (UID: \"2690f25f-010b-41df-9514-f57323b17283\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-frm7j" Jul 02 23:07:39.693506 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:39.693345 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/758d5a7d-658b-40b4-ac5d-7629e8172325-metrics-tls\") pod \"dns-default-9m5nh\" (UID: \"758d5a7d-658b-40b4-ac5d-7629e8172325\") " pod="openshift-dns/dns-default-9m5nh" Jul 02 23:07:39.693506 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:39.693395 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0ca0d12d-9442-4bbb-8c4c-d2e4e513dd18-metrics-certs\") pod \"router-default-6744ddf86c-cr66l\" (UID: \"0ca0d12d-9442-4bbb-8c4c-d2e4e513dd18\") " pod="openshift-ingress/router-default-6744ddf86c-cr66l" Jul 02 23:07:39.693506 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:39.693436 2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 02 23:07:39.693506 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:39.693451 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 23:07:39.693506 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:39.693475 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ca0d12d-9442-4bbb-8c4c-d2e4e513dd18-service-ca-bundle\") pod \"router-default-6744ddf86c-cr66l\" (UID: \"0ca0d12d-9442-4bbb-8c4c-d2e4e513dd18\") " pod="openshift-ingress/router-default-6744ddf86c-cr66l" Jul 02 23:07:39.693506 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:39.693507 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/758d5a7d-658b-40b4-ac5d-7629e8172325-metrics-tls podName:758d5a7d-658b-40b4-ac5d-7629e8172325 nodeName:}" failed. No retries permitted until 2026-07-02 23:07:40.693487616 +0000 UTC m=+37.326528742 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/758d5a7d-658b-40b4-ac5d-7629e8172325-metrics-tls") pod "dns-default-9m5nh" (UID: "758d5a7d-658b-40b4-ac5d-7629e8172325") : secret "dns-default-metrics-tls" not found Jul 02 23:07:39.693876 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:39.693562 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2690f25f-010b-41df-9514-f57323b17283-cluster-monitoring-operator-tls podName:2690f25f-010b-41df-9514-f57323b17283 nodeName:}" failed. No retries permitted until 2026-07-02 23:07:40.693550888 +0000 UTC m=+37.326592016 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2690f25f-010b-41df-9514-f57323b17283-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-frm7j" (UID: "2690f25f-010b-41df-9514-f57323b17283") : secret "cluster-monitoring-operator-tls" not found Jul 02 23:07:39.693876 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:39.693579 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0ca0d12d-9442-4bbb-8c4c-d2e4e513dd18-service-ca-bundle podName:0ca0d12d-9442-4bbb-8c4c-d2e4e513dd18 nodeName:}" failed. No retries permitted until 2026-07-02 23:07:40.693569363 +0000 UTC m=+37.326610490 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0ca0d12d-9442-4bbb-8c4c-d2e4e513dd18-service-ca-bundle") pod "router-default-6744ddf86c-cr66l" (UID: "0ca0d12d-9442-4bbb-8c4c-d2e4e513dd18") : configmap references non-existent config key: service-ca.crt Jul 02 23:07:39.693876 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:39.693581 2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 02 23:07:39.693876 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:39.693630 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ca0d12d-9442-4bbb-8c4c-d2e4e513dd18-metrics-certs podName:0ca0d12d-9442-4bbb-8c4c-d2e4e513dd18 nodeName:}" failed. No retries permitted until 2026-07-02 23:07:40.693612605 +0000 UTC m=+37.326653730 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0ca0d12d-9442-4bbb-8c4c-d2e4e513dd18-metrics-certs") pod "router-default-6744ddf86c-cr66l" (UID: "0ca0d12d-9442-4bbb-8c4c-d2e4e513dd18") : secret "router-metrics-certs-default" not found Jul 02 23:07:39.794160 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:39.794085 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/cd1134b6-429c-4008-8b58-5da7f4e9fc3f-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-297wc\" (UID: \"cd1134b6-429c-4008-8b58-5da7f4e9fc3f\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-297wc" Jul 02 23:07:39.794755 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:39.794205 2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 02 23:07:39.794755 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:39.794257 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd1134b6-429c-4008-8b58-5da7f4e9fc3f-networking-console-plugin-cert podName:cd1134b6-429c-4008-8b58-5da7f4e9fc3f nodeName:}" failed. No retries permitted until 2026-07-02 23:07:40.79424393 +0000 UTC m=+37.427285051 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/cd1134b6-429c-4008-8b58-5da7f4e9fc3f-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-297wc" (UID: "cd1134b6-429c-4008-8b58-5da7f4e9fc3f") : secret "networking-console-plugin-cert" not found Jul 02 23:07:40.070531 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:40.070417 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-dkbs8" event={"ID":"746b57b7-42ad-4c35-b0e4-778b0732ea77","Type":"ContainerStarted","Data":"23e7e52a8bfeddc4f0c0995dc91c41304750764a479f7c2122d83dc89ef930c2"} Jul 02 23:07:40.071693 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:40.071656 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-slv8j" event={"ID":"f9de3ef6-3258-45ea-aa0a-79fde3689e1d","Type":"ContainerStarted","Data":"56fa53ef3e0b68e65ac6b33a97e572e496493297468eaace1aaa3a70da5b3e76"} Jul 02 23:07:40.073074 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:40.073047 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-wljkx" event={"ID":"5d4e781e-d925-477e-98c6-cb41099c6cb0","Type":"ContainerStarted","Data":"a017a35dbf8c75963d75499c1e70db38dd8104ca7f0ee459b8492c00af8f776d"} Jul 02 23:07:40.074669 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:40.074615 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-qt5c9" event={"ID":"54034b49-3b9e-4f1c-bf13-fd5e97aa8f72","Type":"ContainerStarted","Data":"d5a3c44f13332c1b6bd2e9600b25ae7574095f171b840b2691e2f8e6051693d1"} Jul 02 23:07:40.077029 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:40.077001 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-gz8jl" event={"ID":"e5ac3fd0-32b9-4947-a0a7-ed6d6cd3c8f0","Type":"ContainerStarted","Data":"1d3076c8178089f9e0ca8542892161a5f92ad62384f33237dd6633dd27aeda80"} Jul 02 23:07:40.078412 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:40.078387 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-2plj4" event={"ID":"477877c9-88e5-4eb4-afc4-3e9a45bb78fd","Type":"ContainerStarted","Data":"95964f40225bbe9aff163eb5526a776d2d89d5bb6bf6180ff58423b449b72291"} Jul 02 23:07:40.088948 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:40.088920 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-8nlmv" event={"ID":"d7c5d79d-d705-4d68-8e46-a31b1603915e","Type":"ContainerStarted","Data":"eb254c543682e5519cd2c0d3bb6e56c30a32599463a589bb8334edf16fb09942"} Jul 02 23:07:40.502043 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:40.501346 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/de0c5637-bfd8-4989-a233-abc9a7cf1210-registry-tls\") pod \"image-registry-5897776f99-njm4b\" (UID: \"de0c5637-bfd8-4989-a233-abc9a7cf1210\") " pod="openshift-image-registry/image-registry-5897776f99-njm4b" Jul 02 23:07:40.502043 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:40.501597 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 23:07:40.502043 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:40.501612 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5897776f99-njm4b: secret "image-registry-tls" not found Jul 02 23:07:40.502043 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:40.501663 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/de0c5637-bfd8-4989-a233-abc9a7cf1210-registry-tls podName:de0c5637-bfd8-4989-a233-abc9a7cf1210 nodeName:}" failed. No retries permitted until 2026-07-02 23:07:42.501648503 +0000 UTC m=+39.134689623 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/de0c5637-bfd8-4989-a233-abc9a7cf1210-registry-tls") pod "image-registry-5897776f99-njm4b" (UID: "de0c5637-bfd8-4989-a233-abc9a7cf1210") : secret "image-registry-tls" not found Jul 02 23:07:40.603279 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:40.602582 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4530ab49-f26f-4e05-83ad-d40e9327478a-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-92c6f\" (UID: \"4530ab49-f26f-4e05-83ad-d40e9327478a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-92c6f" Jul 02 23:07:40.603279 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:40.602853 2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 02 23:07:40.603279 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:40.602922 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4530ab49-f26f-4e05-83ad-d40e9327478a-samples-operator-tls podName:4530ab49-f26f-4e05-83ad-d40e9327478a nodeName:}" failed. No retries permitted until 2026-07-02 23:07:42.602900827 +0000 UTC m=+39.235941947 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/4530ab49-f26f-4e05-83ad-d40e9327478a-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-92c6f" (UID: "4530ab49-f26f-4e05-83ad-d40e9327478a") : secret "samples-operator-tls" not found Jul 02 23:07:40.704659 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:40.703533 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/758d5a7d-658b-40b4-ac5d-7629e8172325-metrics-tls\") pod \"dns-default-9m5nh\" (UID: \"758d5a7d-658b-40b4-ac5d-7629e8172325\") " pod="openshift-dns/dns-default-9m5nh" Jul 02 23:07:40.704659 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:40.703601 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0ca0d12d-9442-4bbb-8c4c-d2e4e513dd18-metrics-certs\") pod \"router-default-6744ddf86c-cr66l\" (UID: \"0ca0d12d-9442-4bbb-8c4c-d2e4e513dd18\") " pod="openshift-ingress/router-default-6744ddf86c-cr66l" Jul 02 23:07:40.704659 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:40.703672 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ca0d12d-9442-4bbb-8c4c-d2e4e513dd18-service-ca-bundle\") pod \"router-default-6744ddf86c-cr66l\" (UID: \"0ca0d12d-9442-4bbb-8c4c-d2e4e513dd18\") " pod="openshift-ingress/router-default-6744ddf86c-cr66l" Jul 02 23:07:40.704659 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:40.703732 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2690f25f-010b-41df-9514-f57323b17283-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-frm7j\" (UID: \"2690f25f-010b-41df-9514-f57323b17283\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-frm7j" Jul 02 23:07:40.704659 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:40.703906 2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 02 23:07:40.704659 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:40.703968 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2690f25f-010b-41df-9514-f57323b17283-cluster-monitoring-operator-tls podName:2690f25f-010b-41df-9514-f57323b17283 nodeName:}" failed. No retries permitted until 2026-07-02 23:07:42.703949961 +0000 UTC m=+39.336991084 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2690f25f-010b-41df-9514-f57323b17283-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-frm7j" (UID: "2690f25f-010b-41df-9514-f57323b17283") : secret "cluster-monitoring-operator-tls" not found Jul 02 23:07:40.704659 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:40.704388 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 23:07:40.704659 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:40.704442 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/758d5a7d-658b-40b4-ac5d-7629e8172325-metrics-tls podName:758d5a7d-658b-40b4-ac5d-7629e8172325 nodeName:}" failed. No retries permitted until 2026-07-02 23:07:42.704426572 +0000 UTC m=+39.337467697 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/758d5a7d-658b-40b4-ac5d-7629e8172325-metrics-tls") pod "dns-default-9m5nh" (UID: "758d5a7d-658b-40b4-ac5d-7629e8172325") : secret "dns-default-metrics-tls" not found Jul 02 23:07:40.704659 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:40.704497 2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 02 23:07:40.704659 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:40.704528 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ca0d12d-9442-4bbb-8c4c-d2e4e513dd18-metrics-certs podName:0ca0d12d-9442-4bbb-8c4c-d2e4e513dd18 nodeName:}" failed. No retries permitted until 2026-07-02 23:07:42.704517606 +0000 UTC m=+39.337558733 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0ca0d12d-9442-4bbb-8c4c-d2e4e513dd18-metrics-certs") pod "router-default-6744ddf86c-cr66l" (UID: "0ca0d12d-9442-4bbb-8c4c-d2e4e513dd18") : secret "router-metrics-certs-default" not found Jul 02 23:07:40.704659 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:40.704618 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0ca0d12d-9442-4bbb-8c4c-d2e4e513dd18-service-ca-bundle podName:0ca0d12d-9442-4bbb-8c4c-d2e4e513dd18 nodeName:}" failed. No retries permitted until 2026-07-02 23:07:42.704607989 +0000 UTC m=+39.337649115 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0ca0d12d-9442-4bbb-8c4c-d2e4e513dd18-service-ca-bundle") pod "router-default-6744ddf86c-cr66l" (UID: "0ca0d12d-9442-4bbb-8c4c-d2e4e513dd18") : configmap references non-existent config key: service-ca.crt Jul 02 23:07:40.804335 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:40.804247 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/cd1134b6-429c-4008-8b58-5da7f4e9fc3f-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-297wc\" (UID: \"cd1134b6-429c-4008-8b58-5da7f4e9fc3f\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-297wc" Jul 02 23:07:40.804871 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:40.804570 2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 02 23:07:40.804871 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:40.804638 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd1134b6-429c-4008-8b58-5da7f4e9fc3f-networking-console-plugin-cert podName:cd1134b6-429c-4008-8b58-5da7f4e9fc3f nodeName:}" failed. No retries permitted until 2026-07-02 23:07:42.80461856 +0000 UTC m=+39.437659898 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/cd1134b6-429c-4008-8b58-5da7f4e9fc3f-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-297wc" (UID: "cd1134b6-429c-4008-8b58-5da7f4e9fc3f") : secret "networking-console-plugin-cert" not found Jul 02 23:07:42.521676 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:42.521553 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/de0c5637-bfd8-4989-a233-abc9a7cf1210-registry-tls\") pod \"image-registry-5897776f99-njm4b\" (UID: \"de0c5637-bfd8-4989-a233-abc9a7cf1210\") " pod="openshift-image-registry/image-registry-5897776f99-njm4b" Jul 02 23:07:42.522139 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:42.521706 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 23:07:42.522139 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:42.521723 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5897776f99-njm4b: secret "image-registry-tls" not found Jul 02 23:07:42.522139 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:42.521802 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/de0c5637-bfd8-4989-a233-abc9a7cf1210-registry-tls podName:de0c5637-bfd8-4989-a233-abc9a7cf1210 nodeName:}" failed. No retries permitted until 2026-07-02 23:07:46.521782394 +0000 UTC m=+43.154823515 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/de0c5637-bfd8-4989-a233-abc9a7cf1210-registry-tls") pod "image-registry-5897776f99-njm4b" (UID: "de0c5637-bfd8-4989-a233-abc9a7cf1210") : secret "image-registry-tls" not found Jul 02 23:07:42.622624 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:42.622479 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4530ab49-f26f-4e05-83ad-d40e9327478a-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-92c6f\" (UID: \"4530ab49-f26f-4e05-83ad-d40e9327478a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-92c6f" Jul 02 23:07:42.622920 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:42.622901 2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 02 23:07:42.622990 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:42.622979 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4530ab49-f26f-4e05-83ad-d40e9327478a-samples-operator-tls podName:4530ab49-f26f-4e05-83ad-d40e9327478a nodeName:}" failed. No retries permitted until 2026-07-02 23:07:46.622959599 +0000 UTC m=+43.256000727 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/4530ab49-f26f-4e05-83ad-d40e9327478a-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-92c6f" (UID: "4530ab49-f26f-4e05-83ad-d40e9327478a") : secret "samples-operator-tls" not found Jul 02 23:07:42.723907 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:42.723876 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/758d5a7d-658b-40b4-ac5d-7629e8172325-metrics-tls\") pod \"dns-default-9m5nh\" (UID: \"758d5a7d-658b-40b4-ac5d-7629e8172325\") " pod="openshift-dns/dns-default-9m5nh" Jul 02 23:07:42.724107 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:42.723934 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0ca0d12d-9442-4bbb-8c4c-d2e4e513dd18-metrics-certs\") pod \"router-default-6744ddf86c-cr66l\" (UID: \"0ca0d12d-9442-4bbb-8c4c-d2e4e513dd18\") " pod="openshift-ingress/router-default-6744ddf86c-cr66l" Jul 02 23:07:42.724107 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:42.724084 2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 02 23:07:42.724244 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:42.724100 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 23:07:42.724244 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:42.724149 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ca0d12d-9442-4bbb-8c4c-d2e4e513dd18-metrics-certs podName:0ca0d12d-9442-4bbb-8c4c-d2e4e513dd18 nodeName:}" failed. No retries permitted until 2026-07-02 23:07:46.724130241 +0000 UTC m=+43.357171379 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0ca0d12d-9442-4bbb-8c4c-d2e4e513dd18-metrics-certs") pod "router-default-6744ddf86c-cr66l" (UID: "0ca0d12d-9442-4bbb-8c4c-d2e4e513dd18") : secret "router-metrics-certs-default" not found Jul 02 23:07:42.724244 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:42.724214 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ca0d12d-9442-4bbb-8c4c-d2e4e513dd18-service-ca-bundle\") pod \"router-default-6744ddf86c-cr66l\" (UID: \"0ca0d12d-9442-4bbb-8c4c-d2e4e513dd18\") " pod="openshift-ingress/router-default-6744ddf86c-cr66l" Jul 02 23:07:42.724393 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:42.724270 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/758d5a7d-658b-40b4-ac5d-7629e8172325-metrics-tls podName:758d5a7d-658b-40b4-ac5d-7629e8172325 nodeName:}" failed. No retries permitted until 2026-07-02 23:07:46.724250131 +0000 UTC m=+43.357291255 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/758d5a7d-658b-40b4-ac5d-7629e8172325-metrics-tls") pod "dns-default-9m5nh" (UID: "758d5a7d-658b-40b4-ac5d-7629e8172325") : secret "dns-default-metrics-tls" not found Jul 02 23:07:42.724393 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:42.724377 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2690f25f-010b-41df-9514-f57323b17283-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-frm7j\" (UID: \"2690f25f-010b-41df-9514-f57323b17283\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-frm7j" Jul 02 23:07:42.724519 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:42.724500 2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 02 23:07:42.724589 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:42.724552 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2690f25f-010b-41df-9514-f57323b17283-cluster-monitoring-operator-tls podName:2690f25f-010b-41df-9514-f57323b17283 nodeName:}" failed. No retries permitted until 2026-07-02 23:07:46.724530644 +0000 UTC m=+43.357571767 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2690f25f-010b-41df-9514-f57323b17283-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-frm7j" (UID: "2690f25f-010b-41df-9514-f57323b17283") : secret "cluster-monitoring-operator-tls" not found Jul 02 23:07:42.724651 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:42.724619 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0ca0d12d-9442-4bbb-8c4c-d2e4e513dd18-service-ca-bundle podName:0ca0d12d-9442-4bbb-8c4c-d2e4e513dd18 nodeName:}" failed. No retries permitted until 2026-07-02 23:07:46.724612413 +0000 UTC m=+43.357653534 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0ca0d12d-9442-4bbb-8c4c-d2e4e513dd18-service-ca-bundle") pod "router-default-6744ddf86c-cr66l" (UID: "0ca0d12d-9442-4bbb-8c4c-d2e4e513dd18") : configmap references non-existent config key: service-ca.crt Jul 02 23:07:42.825167 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:42.825066 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/cd1134b6-429c-4008-8b58-5da7f4e9fc3f-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-297wc\" (UID: \"cd1134b6-429c-4008-8b58-5da7f4e9fc3f\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-297wc" Jul 02 23:07:42.825336 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:42.825241 2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 02 23:07:42.825336 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:42.825324 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd1134b6-429c-4008-8b58-5da7f4e9fc3f-networking-console-plugin-cert podName:cd1134b6-429c-4008-8b58-5da7f4e9fc3f nodeName:}" failed. No retries permitted until 2026-07-02 23:07:46.825302925 +0000 UTC m=+43.458344049 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/cd1134b6-429c-4008-8b58-5da7f4e9fc3f-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-297wc" (UID: "cd1134b6-429c-4008-8b58-5da7f4e9fc3f") : secret "networking-console-plugin-cert" not found Jul 02 23:07:46.558268 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:46.558220 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/de0c5637-bfd8-4989-a233-abc9a7cf1210-registry-tls\") pod \"image-registry-5897776f99-njm4b\" (UID: \"de0c5637-bfd8-4989-a233-abc9a7cf1210\") " pod="openshift-image-registry/image-registry-5897776f99-njm4b" Jul 02 23:07:46.558675 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:46.558390 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 23:07:46.558675 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:46.558413 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5897776f99-njm4b: secret "image-registry-tls" not found Jul 02 23:07:46.558675 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:46.558475 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/de0c5637-bfd8-4989-a233-abc9a7cf1210-registry-tls podName:de0c5637-bfd8-4989-a233-abc9a7cf1210 nodeName:}" failed. No retries permitted until 2026-07-02 23:07:54.558454754 +0000 UTC m=+51.191495875 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/de0c5637-bfd8-4989-a233-abc9a7cf1210-registry-tls") pod "image-registry-5897776f99-njm4b" (UID: "de0c5637-bfd8-4989-a233-abc9a7cf1210") : secret "image-registry-tls" not found Jul 02 23:07:46.659696 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:46.659654 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4530ab49-f26f-4e05-83ad-d40e9327478a-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-92c6f\" (UID: \"4530ab49-f26f-4e05-83ad-d40e9327478a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-92c6f" Jul 02 23:07:46.659882 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:46.659832 2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 02 23:07:46.659924 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:46.659897 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4530ab49-f26f-4e05-83ad-d40e9327478a-samples-operator-tls podName:4530ab49-f26f-4e05-83ad-d40e9327478a nodeName:}" failed. No retries permitted until 2026-07-02 23:07:54.659881087 +0000 UTC m=+51.292922211 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/4530ab49-f26f-4e05-83ad-d40e9327478a-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-92c6f" (UID: "4530ab49-f26f-4e05-83ad-d40e9327478a") : secret "samples-operator-tls" not found Jul 02 23:07:46.760902 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:46.760868 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/758d5a7d-658b-40b4-ac5d-7629e8172325-metrics-tls\") pod \"dns-default-9m5nh\" (UID: \"758d5a7d-658b-40b4-ac5d-7629e8172325\") " pod="openshift-dns/dns-default-9m5nh" Jul 02 23:07:46.761052 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:46.760913 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0ca0d12d-9442-4bbb-8c4c-d2e4e513dd18-metrics-certs\") pod \"router-default-6744ddf86c-cr66l\" (UID: \"0ca0d12d-9442-4bbb-8c4c-d2e4e513dd18\") " pod="openshift-ingress/router-default-6744ddf86c-cr66l" Jul 02 23:07:46.761052 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:46.760958 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ca0d12d-9442-4bbb-8c4c-d2e4e513dd18-service-ca-bundle\") pod \"router-default-6744ddf86c-cr66l\" (UID: \"0ca0d12d-9442-4bbb-8c4c-d2e4e513dd18\") " pod="openshift-ingress/router-default-6744ddf86c-cr66l" Jul 02 23:07:46.761188 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:46.761067 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 23:07:46.761188 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:46.761124 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2690f25f-010b-41df-9514-f57323b17283-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-frm7j\" (UID: \"2690f25f-010b-41df-9514-f57323b17283\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-frm7j" Jul 02 23:07:46.761188 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:46.761150 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/758d5a7d-658b-40b4-ac5d-7629e8172325-metrics-tls podName:758d5a7d-658b-40b4-ac5d-7629e8172325 nodeName:}" failed. No retries permitted until 2026-07-02 23:07:54.76111873 +0000 UTC m=+51.394159867 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/758d5a7d-658b-40b4-ac5d-7629e8172325-metrics-tls") pod "dns-default-9m5nh" (UID: "758d5a7d-658b-40b4-ac5d-7629e8172325") : secret "dns-default-metrics-tls" not found Jul 02 23:07:46.761335 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:46.761226 2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 02 23:07:46.761335 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:46.761231 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0ca0d12d-9442-4bbb-8c4c-d2e4e513dd18-service-ca-bundle podName:0ca0d12d-9442-4bbb-8c4c-d2e4e513dd18 nodeName:}" failed. No retries permitted until 2026-07-02 23:07:54.761219937 +0000 UTC m=+51.394261058 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0ca0d12d-9442-4bbb-8c4c-d2e4e513dd18-service-ca-bundle") pod "router-default-6744ddf86c-cr66l" (UID: "0ca0d12d-9442-4bbb-8c4c-d2e4e513dd18") : configmap references non-existent config key: service-ca.crt Jul 02 23:07:46.761335 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:46.761262 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2690f25f-010b-41df-9514-f57323b17283-cluster-monitoring-operator-tls podName:2690f25f-010b-41df-9514-f57323b17283 nodeName:}" failed. No retries permitted until 2026-07-02 23:07:54.76124934 +0000 UTC m=+51.394290460 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2690f25f-010b-41df-9514-f57323b17283-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-frm7j" (UID: "2690f25f-010b-41df-9514-f57323b17283") : secret "cluster-monitoring-operator-tls" not found Jul 02 23:07:46.761335 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:46.761291 2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 02 23:07:46.761335 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:46.761330 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ca0d12d-9442-4bbb-8c4c-d2e4e513dd18-metrics-certs podName:0ca0d12d-9442-4bbb-8c4c-d2e4e513dd18 nodeName:}" failed. No retries permitted until 2026-07-02 23:07:54.761318708 +0000 UTC m=+51.394359829 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0ca0d12d-9442-4bbb-8c4c-d2e4e513dd18-metrics-certs") pod "router-default-6744ddf86c-cr66l" (UID: "0ca0d12d-9442-4bbb-8c4c-d2e4e513dd18") : secret "router-metrics-certs-default" not found Jul 02 23:07:46.862338 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:46.862261 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/cd1134b6-429c-4008-8b58-5da7f4e9fc3f-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-297wc\" (UID: \"cd1134b6-429c-4008-8b58-5da7f4e9fc3f\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-297wc" Jul 02 23:07:46.862482 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:46.862415 2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 02 23:07:46.862546 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:46.862491 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd1134b6-429c-4008-8b58-5da7f4e9fc3f-networking-console-plugin-cert podName:cd1134b6-429c-4008-8b58-5da7f4e9fc3f nodeName:}" failed. No retries permitted until 2026-07-02 23:07:54.862461773 +0000 UTC m=+51.495502912 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/cd1134b6-429c-4008-8b58-5da7f4e9fc3f-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-297wc" (UID: "cd1134b6-429c-4008-8b58-5da7f4e9fc3f") : secret "networking-console-plugin-cert" not found Jul 02 23:07:49.120073 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:49.119955 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-2plj4" event={"ID":"477877c9-88e5-4eb4-afc4-3e9a45bb78fd","Type":"ContainerStarted","Data":"7809ddd46e94e4a1e9de3aa50d79c6644e097ec1651b8bfc63fd0061f139d7e7"} Jul 02 23:07:49.122227 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:49.122195 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-8nlmv" event={"ID":"d7c5d79d-d705-4d68-8e46-a31b1603915e","Type":"ContainerStarted","Data":"f685f039b14aa17d7d046ff287b08bf9023352e76b41597f2791c0b2ee6ebcc0"} Jul 02 23:07:49.124164 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:49.124142 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-dkbs8" event={"ID":"746b57b7-42ad-4c35-b0e4-778b0732ea77","Type":"ContainerStarted","Data":"3fb46e5355cbd4e8125012aa5874a7307059c51f93cc3e6a827488bf485ca53f"} Jul 02 23:07:49.125930 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:49.125906 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-slv8j" event={"ID":"f9de3ef6-3258-45ea-aa0a-79fde3689e1d","Type":"ContainerStarted","Data":"894f8206d9e5a63fdf46ee256fba159be5f72a937cb58d43406b7332b4da2e64"} Jul 02 23:07:49.127719 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:49.127702 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-wljkx_5d4e781e-d925-477e-98c6-cb41099c6cb0/console-operator/0.log" Jul 02 23:07:49.127807 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:49.127755 2563 generic.go:356] "Generic (PLEG): container finished" podID="5d4e781e-d925-477e-98c6-cb41099c6cb0" containerID="ef483fcdd6aa834e922ecda9b8ff78e0c8f1934b1bbdb02bc3d5384bb0f497d3" exitCode=255 Jul 02 23:07:49.127861 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:49.127832 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-wljkx" event={"ID":"5d4e781e-d925-477e-98c6-cb41099c6cb0","Type":"ContainerDied","Data":"ef483fcdd6aa834e922ecda9b8ff78e0c8f1934b1bbdb02bc3d5384bb0f497d3"} Jul 02 23:07:49.128154 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:49.128141 2563 scope.go:117] "RemoveContainer" containerID="ef483fcdd6aa834e922ecda9b8ff78e0c8f1934b1bbdb02bc3d5384bb0f497d3" Jul 02 23:07:49.134239 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:49.132141 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-qt5c9" event={"ID":"54034b49-3b9e-4f1c-bf13-fd5e97aa8f72","Type":"ContainerStarted","Data":"3c8427c5953b335e26ce1663940d5d01630b5207dc22f28e7675bf0fd8a537ce"} Jul 02 23:07:49.134239 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:49.134052 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-gz8jl" event={"ID":"e5ac3fd0-32b9-4947-a0a7-ed6d6cd3c8f0","Type":"ContainerStarted","Data":"2ab1604848040622b421ec0f0242d7ccf264cc27ca0dbb15fe02bd3c9e207891"} Jul 02 23:07:49.138204 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:49.136993 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-2plj4" podStartSLOduration=6.916021661 podStartE2EDuration="16.136977844s" totalImagesPullingTime="9.220956183s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:07:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:07:49.13517637 +0000 UTC m=+45.768217512" watchObservedRunningTime="2026-07-02 23:07:49.136977844 +0000 UTC m=+45.770018969" Jul 02 23:07:49.140920 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:49.140898 2563 generic.go:356] "Generic (PLEG): container finished" podID="2d6bdb50-bc8b-4f01-b13c-8ff9cd87740f" containerID="d6927137e3b82dbed853de3a5f3c7742a84dcb825ac4ccb044cc3150bef68ab8" exitCode=0 Jul 02 23:07:49.141021 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:49.140933 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-97j6n" event={"ID":"2d6bdb50-bc8b-4f01-b13c-8ff9cd87740f","Type":"ContainerDied","Data":"d6927137e3b82dbed853de3a5f3c7742a84dcb825ac4ccb044cc3150bef68ab8"} Jul 02 23:07:49.154462 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:49.154121 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-8nlmv" podStartSLOduration=6.892622452 podStartE2EDuration="16.154104261s" totalImagesPullingTime="9.261481809s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:07:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:07:49.153042938 +0000 UTC m=+45.786084081" watchObservedRunningTime="2026-07-02 23:07:49.154104261 +0000 UTC m=+45.787145496" Jul 02 23:07:49.211831 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:49.210577 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-slv8j" podStartSLOduration=6.824196482 podStartE2EDuration="16.210555785s" totalImagesPullingTime="9.386359303s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:07:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:07:49.190914783 +0000 UTC m=+45.823955942" watchObservedRunningTime="2026-07-02 23:07:49.210555785 +0000 UTC m=+45.843596930" Jul 02 23:07:49.239948 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:49.239186 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-qt5c9" podStartSLOduration=2.029555371 podStartE2EDuration="11.239165402s" totalImagesPullingTime="9.209610031s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:07:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:07:49.21168543 +0000 UTC m=+45.844726572" watchObservedRunningTime="2026-07-02 23:07:49.239165402 +0000 UTC m=+45.872206545" Jul 02 23:07:49.256366 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:49.255966 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5c847dcfc4-gz8jl" podStartSLOduration=6.990218823 podStartE2EDuration="16.255947446s" totalImagesPullingTime="9.265728623s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:07:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:07:49.255357259 +0000 UTC m=+45.888398411" watchObservedRunningTime="2026-07-02 23:07:49.255947446 +0000 UTC m=+45.888988589" Jul 02 23:07:49.256927 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:49.256895 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-dkbs8" podStartSLOduration=6.991612125 podStartE2EDuration="16.256885137s" totalImagesPullingTime="9.265273012s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:07:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:07:49.239644655 +0000 UTC m=+45.872685798" watchObservedRunningTime="2026-07-02 23:07:49.256885137 +0000 UTC m=+45.889926282" Jul 02 23:07:50.152154 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:50.152124 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-wljkx_5d4e781e-d925-477e-98c6-cb41099c6cb0/console-operator/1.log" Jul 02 23:07:50.152611 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:50.152566 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-wljkx_5d4e781e-d925-477e-98c6-cb41099c6cb0/console-operator/0.log" Jul 02 23:07:50.152611 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:50.152600 2563 generic.go:356] "Generic (PLEG): container finished" podID="5d4e781e-d925-477e-98c6-cb41099c6cb0" containerID="f34c54511f73ca2ecca62b1594f16e3bc376486c183970b3d87c081bf084ef52" exitCode=255 Jul 02 23:07:50.152720 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:50.152691 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-wljkx" event={"ID":"5d4e781e-d925-477e-98c6-cb41099c6cb0","Type":"ContainerDied","Data":"f34c54511f73ca2ecca62b1594f16e3bc376486c183970b3d87c081bf084ef52"} Jul 02 23:07:50.152810 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:50.152794 2563 scope.go:117] "RemoveContainer" containerID="ef483fcdd6aa834e922ecda9b8ff78e0c8f1934b1bbdb02bc3d5384bb0f497d3" Jul 02 23:07:50.152940 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:50.152922 2563 scope.go:117] "RemoveContainer" containerID="f34c54511f73ca2ecca62b1594f16e3bc376486c183970b3d87c081bf084ef52" Jul 02 23:07:50.153155 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:50.153116 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-wljkx_openshift-console-operator(5d4e781e-d925-477e-98c6-cb41099c6cb0)\"" pod="openshift-console-operator/console-operator-68b757fb67-wljkx" podUID="5d4e781e-d925-477e-98c6-cb41099c6cb0" Jul 02 23:07:50.155835 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:50.155812 2563 generic.go:356] "Generic (PLEG): container finished" podID="2d6bdb50-bc8b-4f01-b13c-8ff9cd87740f" containerID="d592b2d4827b6aea0c4c174d794f6cec973df3cec92de71312e36854b4a2f147" exitCode=0 Jul 02 23:07:50.155919 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:50.155903 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-97j6n" event={"ID":"2d6bdb50-bc8b-4f01-b13c-8ff9cd87740f","Type":"ContainerDied","Data":"d592b2d4827b6aea0c4c174d794f6cec973df3cec92de71312e36854b4a2f147"} Jul 02 23:07:50.335701 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:50.335663 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-n5tqq"] Jul 02 23:07:50.338494 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:50.338468 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-n5tqq" Jul 02 23:07:50.340971 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:50.340947 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 02 23:07:50.341097 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:50.341017 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 02 23:07:50.341239 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:50.341223 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-xpm5t\"" Jul 02 23:07:50.351871 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:50.351848 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-n5tqq"] Jul 02 23:07:50.394061 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:50.394031 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e37e66ff-54f9-4531-bd63-b1b491e8408b-crio-socket\") pod \"insights-runtime-extractor-n5tqq\" (UID: \"e37e66ff-54f9-4531-bd63-b1b491e8408b\") " pod="openshift-insights/insights-runtime-extractor-n5tqq" Jul 02 23:07:50.394206 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:50.394129 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e37e66ff-54f9-4531-bd63-b1b491e8408b-data-volume\") pod \"insights-runtime-extractor-n5tqq\" (UID: \"e37e66ff-54f9-4531-bd63-b1b491e8408b\") " pod="openshift-insights/insights-runtime-extractor-n5tqq" Jul 02 23:07:50.394274 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:50.394201 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e37e66ff-54f9-4531-bd63-b1b491e8408b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-n5tqq\" (UID: \"e37e66ff-54f9-4531-bd63-b1b491e8408b\") " pod="openshift-insights/insights-runtime-extractor-n5tqq" Jul 02 23:07:50.394274 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:50.394262 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8xcf\" (UniqueName: \"kubernetes.io/projected/e37e66ff-54f9-4531-bd63-b1b491e8408b-kube-api-access-r8xcf\") pod \"insights-runtime-extractor-n5tqq\" (UID: \"e37e66ff-54f9-4531-bd63-b1b491e8408b\") " pod="openshift-insights/insights-runtime-extractor-n5tqq" Jul 02 23:07:50.394374 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:50.394296 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e37e66ff-54f9-4531-bd63-b1b491e8408b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-n5tqq\" (UID: \"e37e66ff-54f9-4531-bd63-b1b491e8408b\") " pod="openshift-insights/insights-runtime-extractor-n5tqq" Jul 02 23:07:50.495615 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:50.495529 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8xcf\" (UniqueName: \"kubernetes.io/projected/e37e66ff-54f9-4531-bd63-b1b491e8408b-kube-api-access-r8xcf\") pod \"insights-runtime-extractor-n5tqq\" (UID: \"e37e66ff-54f9-4531-bd63-b1b491e8408b\") " pod="openshift-insights/insights-runtime-extractor-n5tqq" Jul 02 23:07:50.495615 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:50.495587 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e37e66ff-54f9-4531-bd63-b1b491e8408b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-n5tqq\" (UID: \"e37e66ff-54f9-4531-bd63-b1b491e8408b\") " pod="openshift-insights/insights-runtime-extractor-n5tqq" Jul 02 23:07:50.495825 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:50.495645 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e37e66ff-54f9-4531-bd63-b1b491e8408b-crio-socket\") pod \"insights-runtime-extractor-n5tqq\" (UID: \"e37e66ff-54f9-4531-bd63-b1b491e8408b\") " pod="openshift-insights/insights-runtime-extractor-n5tqq" Jul 02 23:07:50.495825 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:50.495723 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e37e66ff-54f9-4531-bd63-b1b491e8408b-crio-socket\") pod \"insights-runtime-extractor-n5tqq\" (UID: \"e37e66ff-54f9-4531-bd63-b1b491e8408b\") " pod="openshift-insights/insights-runtime-extractor-n5tqq" Jul 02 23:07:50.495825 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:50.495723 2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 02 23:07:50.495946 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:50.495884 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e37e66ff-54f9-4531-bd63-b1b491e8408b-kube-rbac-proxy-cm podName:e37e66ff-54f9-4531-bd63-b1b491e8408b nodeName:}" failed. No retries permitted until 2026-07-02 23:07:50.995859425 +0000 UTC m=+47.628900569 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e37e66ff-54f9-4531-bd63-b1b491e8408b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-n5tqq" (UID: "e37e66ff-54f9-4531-bd63-b1b491e8408b") : configmap "kube-rbac-proxy" not found Jul 02 23:07:50.495946 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:50.495808 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e37e66ff-54f9-4531-bd63-b1b491e8408b-data-volume\") pod \"insights-runtime-extractor-n5tqq\" (UID: \"e37e66ff-54f9-4531-bd63-b1b491e8408b\") " pod="openshift-insights/insights-runtime-extractor-n5tqq" Jul 02 23:07:50.496075 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:50.495963 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e37e66ff-54f9-4531-bd63-b1b491e8408b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-n5tqq\" (UID: \"e37e66ff-54f9-4531-bd63-b1b491e8408b\") " pod="openshift-insights/insights-runtime-extractor-n5tqq" Jul 02 23:07:50.496124 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:50.496084 2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 23:07:50.496161 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:50.496129 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e37e66ff-54f9-4531-bd63-b1b491e8408b-insights-runtime-extractor-tls podName:e37e66ff-54f9-4531-bd63-b1b491e8408b nodeName:}" failed. No retries permitted until 2026-07-02 23:07:50.996114962 +0000 UTC m=+47.629156083 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e37e66ff-54f9-4531-bd63-b1b491e8408b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-n5tqq" (UID: "e37e66ff-54f9-4531-bd63-b1b491e8408b") : secret "insights-runtime-extractor-tls" not found Jul 02 23:07:50.496161 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:50.496149 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e37e66ff-54f9-4531-bd63-b1b491e8408b-data-volume\") pod \"insights-runtime-extractor-n5tqq\" (UID: \"e37e66ff-54f9-4531-bd63-b1b491e8408b\") " pod="openshift-insights/insights-runtime-extractor-n5tqq" Jul 02 23:07:50.504571 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:50.504545 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8xcf\" (UniqueName: \"kubernetes.io/projected/e37e66ff-54f9-4531-bd63-b1b491e8408b-kube-api-access-r8xcf\") pod \"insights-runtime-extractor-n5tqq\" (UID: \"e37e66ff-54f9-4531-bd63-b1b491e8408b\") " pod="openshift-insights/insights-runtime-extractor-n5tqq" Jul 02 23:07:50.647691 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:50.647659 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-k46vb"] Jul 02 23:07:50.649995 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:50.649969 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-k46vb" Jul 02 23:07:50.652702 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:50.652677 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 02 23:07:50.652851 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:50.652830 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 02 23:07:50.652935 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:50.652849 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-cz4q9\"" Jul 02 23:07:50.667241 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:50.667211 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-k46vb"] Jul 02 23:07:50.697844 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:50.697812 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-727zq\" (UniqueName: \"kubernetes.io/projected/f4797aab-f33c-4f95-93e2-131366537ad5-kube-api-access-727zq\") pod \"migrator-d57d58cc9-k46vb\" (UID: \"f4797aab-f33c-4f95-93e2-131366537ad5\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-k46vb" Jul 02 23:07:50.799205 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:50.799121 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-727zq\" (UniqueName: \"kubernetes.io/projected/f4797aab-f33c-4f95-93e2-131366537ad5-kube-api-access-727zq\") pod \"migrator-d57d58cc9-k46vb\" (UID: \"f4797aab-f33c-4f95-93e2-131366537ad5\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-k46vb" Jul 02 23:07:50.808497 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:50.808461 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-727zq\" (UniqueName: \"kubernetes.io/projected/f4797aab-f33c-4f95-93e2-131366537ad5-kube-api-access-727zq\") pod \"migrator-d57d58cc9-k46vb\" (UID: \"f4797aab-f33c-4f95-93e2-131366537ad5\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-k46vb" Jul 02 23:07:50.959536 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:50.959501 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-k46vb" Jul 02 23:07:51.001159 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:51.001106 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e37e66ff-54f9-4531-bd63-b1b491e8408b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-n5tqq\" (UID: \"e37e66ff-54f9-4531-bd63-b1b491e8408b\") " pod="openshift-insights/insights-runtime-extractor-n5tqq" Jul 02 23:07:51.001330 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:51.001223 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e37e66ff-54f9-4531-bd63-b1b491e8408b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-n5tqq\" (UID: \"e37e66ff-54f9-4531-bd63-b1b491e8408b\") " pod="openshift-insights/insights-runtime-extractor-n5tqq" Jul 02 23:07:51.001330 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:51.001260 2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 23:07:51.001408 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:51.001330 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e37e66ff-54f9-4531-bd63-b1b491e8408b-insights-runtime-extractor-tls podName:e37e66ff-54f9-4531-bd63-b1b491e8408b nodeName:}" failed. No retries permitted until 2026-07-02 23:07:52.001314113 +0000 UTC m=+48.634355432 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e37e66ff-54f9-4531-bd63-b1b491e8408b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-n5tqq" (UID: "e37e66ff-54f9-4531-bd63-b1b491e8408b") : secret "insights-runtime-extractor-tls" not found Jul 02 23:07:51.001408 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:51.001353 2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 02 23:07:51.001477 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:51.001418 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e37e66ff-54f9-4531-bd63-b1b491e8408b-kube-rbac-proxy-cm podName:e37e66ff-54f9-4531-bd63-b1b491e8408b nodeName:}" failed. No retries permitted until 2026-07-02 23:07:52.001402126 +0000 UTC m=+48.634443248 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e37e66ff-54f9-4531-bd63-b1b491e8408b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-n5tqq" (UID: "e37e66ff-54f9-4531-bd63-b1b491e8408b") : configmap "kube-rbac-proxy" not found Jul 02 23:07:51.083689 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:51.083668 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-k46vb"] Jul 02 23:07:51.085941 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:07:51.085916 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4797aab_f33c_4f95_93e2_131366537ad5.slice/crio-95eaca006c9d9dc0fc11db185131aae23b8425790f87a4f222dc742b7ae0bd9d WatchSource:0}: Error finding container 95eaca006c9d9dc0fc11db185131aae23b8425790f87a4f222dc742b7ae0bd9d: Status 404 returned error can't find the container with id 95eaca006c9d9dc0fc11db185131aae23b8425790f87a4f222dc742b7ae0bd9d Jul 02 23:07:51.161910 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:51.161867 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-97j6n" event={"ID":"2d6bdb50-bc8b-4f01-b13c-8ff9cd87740f","Type":"ContainerStarted","Data":"7b5cf35bb5ae761df34577fdde5df1a4f24c72b48e1bb3481dd55ba776721bc5"} Jul 02 23:07:51.163241 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:51.163223 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-wljkx_5d4e781e-d925-477e-98c6-cb41099c6cb0/console-operator/1.log" Jul 02 23:07:51.163517 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:51.163498 2563 scope.go:117] "RemoveContainer" containerID="f34c54511f73ca2ecca62b1594f16e3bc376486c183970b3d87c081bf084ef52" Jul 02 23:07:51.163665 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:51.163645 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-wljkx_openshift-console-operator(5d4e781e-d925-477e-98c6-cb41099c6cb0)\"" pod="openshift-console-operator/console-operator-68b757fb67-wljkx" podUID="5d4e781e-d925-477e-98c6-cb41099c6cb0" Jul 02 23:07:51.164288 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:51.164268 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-k46vb" event={"ID":"f4797aab-f33c-4f95-93e2-131366537ad5","Type":"ContainerStarted","Data":"95eaca006c9d9dc0fc11db185131aae23b8425790f87a4f222dc742b7ae0bd9d"} Jul 02 23:07:51.182563 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:51.182525 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-97j6n" podStartSLOduration=17.477553525 podStartE2EDuration="47.182511275s" totalImagesPullingTime="29.70495775s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 23:07:04 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:07:51.180844369 +0000 UTC m=+47.813885511" watchObservedRunningTime="2026-07-02 23:07:51.182511275 +0000 UTC m=+47.815552417" Jul 02 23:07:51.742700 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:51.742663 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-q5c49_a6eddff0-475c-41b7-b072-e1cdd661392f/dns-node-resolver/0.log" Jul 02 23:07:52.009427 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:52.009352 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e37e66ff-54f9-4531-bd63-b1b491e8408b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-n5tqq\" (UID: \"e37e66ff-54f9-4531-bd63-b1b491e8408b\") " pod="openshift-insights/insights-runtime-extractor-n5tqq" Jul 02 23:07:52.009572 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:52.009459 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e37e66ff-54f9-4531-bd63-b1b491e8408b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-n5tqq\" (UID: \"e37e66ff-54f9-4531-bd63-b1b491e8408b\") " pod="openshift-insights/insights-runtime-extractor-n5tqq" Jul 02 23:07:52.009572 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:52.009473 2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 02 23:07:52.009572 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:52.009542 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e37e66ff-54f9-4531-bd63-b1b491e8408b-kube-rbac-proxy-cm podName:e37e66ff-54f9-4531-bd63-b1b491e8408b nodeName:}" failed. No retries permitted until 2026-07-02 23:07:54.009528041 +0000 UTC m=+50.642569163 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e37e66ff-54f9-4531-bd63-b1b491e8408b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-n5tqq" (UID: "e37e66ff-54f9-4531-bd63-b1b491e8408b") : configmap "kube-rbac-proxy" not found Jul 02 23:07:52.009572 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:52.009553 2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 23:07:52.009722 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:52.009601 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e37e66ff-54f9-4531-bd63-b1b491e8408b-insights-runtime-extractor-tls podName:e37e66ff-54f9-4531-bd63-b1b491e8408b nodeName:}" failed. No retries permitted until 2026-07-02 23:07:54.009590089 +0000 UTC m=+50.642631209 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e37e66ff-54f9-4531-bd63-b1b491e8408b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-n5tqq" (UID: "e37e66ff-54f9-4531-bd63-b1b491e8408b") : secret "insights-runtime-extractor-tls" not found Jul 02 23:07:52.741594 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:52.741570 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-m5zq4_4c2848a5-a93f-4b79-be6e-31d430c7839d/node-ca/0.log" Jul 02 23:07:53.146142 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:53.146116 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-qt5c9_54034b49-3b9e-4f1c-bf13-fd5e97aa8f72/serve-healthcheck-canary/0.log" Jul 02 23:07:53.172500 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:53.172470 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-k46vb" event={"ID":"f4797aab-f33c-4f95-93e2-131366537ad5","Type":"ContainerStarted","Data":"a9b7f925e06407fb7c1f4cd7bd553869e0b0d020221abdc62092775d07aeb53d"} Jul 02 23:07:53.172637 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:53.172517 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-k46vb" event={"ID":"f4797aab-f33c-4f95-93e2-131366537ad5","Type":"ContainerStarted","Data":"2f3b1546d4d51ca29342b54f4d4b3e6a15615c352c4e976ac9f7148e550e0dc0"} Jul 02 23:07:53.187590 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:53.187546 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-k46vb" podStartSLOduration=1.904583257 podStartE2EDuration="3.18753301s" totalImagesPullingTime="1.282949753s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:07:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:07:53.18682925 +0000 UTC m=+49.819870391" watchObservedRunningTime="2026-07-02 23:07:53.18753301 +0000 UTC m=+49.820574181" Jul 02 23:07:54.026992 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:54.026951 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e37e66ff-54f9-4531-bd63-b1b491e8408b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-n5tqq\" (UID: \"e37e66ff-54f9-4531-bd63-b1b491e8408b\") " pod="openshift-insights/insights-runtime-extractor-n5tqq" Jul 02 23:07:54.027398 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:54.027043 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e37e66ff-54f9-4531-bd63-b1b491e8408b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-n5tqq\" (UID: \"e37e66ff-54f9-4531-bd63-b1b491e8408b\") " pod="openshift-insights/insights-runtime-extractor-n5tqq" Jul 02 23:07:54.027398 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:54.027147 2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 23:07:54.027398 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:54.027210 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e37e66ff-54f9-4531-bd63-b1b491e8408b-insights-runtime-extractor-tls podName:e37e66ff-54f9-4531-bd63-b1b491e8408b nodeName:}" failed. No retries permitted until 2026-07-02 23:07:58.027194616 +0000 UTC m=+54.660235740 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e37e66ff-54f9-4531-bd63-b1b491e8408b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-n5tqq" (UID: "e37e66ff-54f9-4531-bd63-b1b491e8408b") : secret "insights-runtime-extractor-tls" not found Jul 02 23:07:54.027398 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:54.027154 2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 02 23:07:54.027398 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:54.027275 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e37e66ff-54f9-4531-bd63-b1b491e8408b-kube-rbac-proxy-cm podName:e37e66ff-54f9-4531-bd63-b1b491e8408b nodeName:}" failed. No retries permitted until 2026-07-02 23:07:58.027263481 +0000 UTC m=+54.660304601 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e37e66ff-54f9-4531-bd63-b1b491e8408b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-n5tqq" (UID: "e37e66ff-54f9-4531-bd63-b1b491e8408b") : configmap "kube-rbac-proxy" not found Jul 02 23:07:54.632071 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:54.632003 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/de0c5637-bfd8-4989-a233-abc9a7cf1210-registry-tls\") pod \"image-registry-5897776f99-njm4b\" (UID: \"de0c5637-bfd8-4989-a233-abc9a7cf1210\") " pod="openshift-image-registry/image-registry-5897776f99-njm4b" Jul 02 23:07:54.632242 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:54.632187 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 23:07:54.632242 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:54.632208 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5897776f99-njm4b: secret "image-registry-tls" not found Jul 02 23:07:54.632316 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:54.632268 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/de0c5637-bfd8-4989-a233-abc9a7cf1210-registry-tls podName:de0c5637-bfd8-4989-a233-abc9a7cf1210 nodeName:}" failed. No retries permitted until 2026-07-02 23:08:10.632251871 +0000 UTC m=+67.265292992 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/de0c5637-bfd8-4989-a233-abc9a7cf1210-registry-tls") pod "image-registry-5897776f99-njm4b" (UID: "de0c5637-bfd8-4989-a233-abc9a7cf1210") : secret "image-registry-tls" not found Jul 02 23:07:54.732682 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:54.732642 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4530ab49-f26f-4e05-83ad-d40e9327478a-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-92c6f\" (UID: \"4530ab49-f26f-4e05-83ad-d40e9327478a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-92c6f" Jul 02 23:07:54.732873 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:54.732780 2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 02 23:07:54.732873 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:54.732832 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4530ab49-f26f-4e05-83ad-d40e9327478a-samples-operator-tls podName:4530ab49-f26f-4e05-83ad-d40e9327478a nodeName:}" failed. No retries permitted until 2026-07-02 23:08:10.732818534 +0000 UTC m=+67.365859655 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/4530ab49-f26f-4e05-83ad-d40e9327478a-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-92c6f" (UID: "4530ab49-f26f-4e05-83ad-d40e9327478a") : secret "samples-operator-tls" not found Jul 02 23:07:54.833232 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:54.833199 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0ca0d12d-9442-4bbb-8c4c-d2e4e513dd18-metrics-certs\") pod \"router-default-6744ddf86c-cr66l\" (UID: \"0ca0d12d-9442-4bbb-8c4c-d2e4e513dd18\") " pod="openshift-ingress/router-default-6744ddf86c-cr66l" Jul 02 23:07:54.833383 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:54.833269 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ca0d12d-9442-4bbb-8c4c-d2e4e513dd18-service-ca-bundle\") pod \"router-default-6744ddf86c-cr66l\" (UID: \"0ca0d12d-9442-4bbb-8c4c-d2e4e513dd18\") " pod="openshift-ingress/router-default-6744ddf86c-cr66l" Jul 02 23:07:54.833383 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:54.833326 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2690f25f-010b-41df-9514-f57323b17283-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-frm7j\" (UID: \"2690f25f-010b-41df-9514-f57323b17283\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-frm7j" Jul 02 23:07:54.833383 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:54.833353 2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 02 23:07:54.833480 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:54.833408 2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 02 23:07:54.833480 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:54.833414 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ca0d12d-9442-4bbb-8c4c-d2e4e513dd18-metrics-certs podName:0ca0d12d-9442-4bbb-8c4c-d2e4e513dd18 nodeName:}" failed. No retries permitted until 2026-07-02 23:08:10.833396922 +0000 UTC m=+67.466438046 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0ca0d12d-9442-4bbb-8c4c-d2e4e513dd18-metrics-certs") pod "router-default-6744ddf86c-cr66l" (UID: "0ca0d12d-9442-4bbb-8c4c-d2e4e513dd18") : secret "router-metrics-certs-default" not found Jul 02 23:07:54.833480 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:54.833435 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0ca0d12d-9442-4bbb-8c4c-d2e4e513dd18-service-ca-bundle podName:0ca0d12d-9442-4bbb-8c4c-d2e4e513dd18 nodeName:}" failed. No retries permitted until 2026-07-02 23:08:10.833421142 +0000 UTC m=+67.466462262 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0ca0d12d-9442-4bbb-8c4c-d2e4e513dd18-service-ca-bundle") pod "router-default-6744ddf86c-cr66l" (UID: "0ca0d12d-9442-4bbb-8c4c-d2e4e513dd18") : configmap references non-existent config key: service-ca.crt Jul 02 23:07:54.833480 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:54.833456 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2690f25f-010b-41df-9514-f57323b17283-cluster-monitoring-operator-tls podName:2690f25f-010b-41df-9514-f57323b17283 nodeName:}" failed. No retries permitted until 2026-07-02 23:08:10.83344994 +0000 UTC m=+67.466491060 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2690f25f-010b-41df-9514-f57323b17283-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-frm7j" (UID: "2690f25f-010b-41df-9514-f57323b17283") : secret "cluster-monitoring-operator-tls" not found Jul 02 23:07:54.833623 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:54.833524 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/758d5a7d-658b-40b4-ac5d-7629e8172325-metrics-tls\") pod \"dns-default-9m5nh\" (UID: \"758d5a7d-658b-40b4-ac5d-7629e8172325\") " pod="openshift-dns/dns-default-9m5nh" Jul 02 23:07:54.833623 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:54.833621 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 23:07:54.833694 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:54.833649 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/758d5a7d-658b-40b4-ac5d-7629e8172325-metrics-tls podName:758d5a7d-658b-40b4-ac5d-7629e8172325 nodeName:}" failed. No retries permitted until 2026-07-02 23:08:10.833642115 +0000 UTC m=+67.466683235 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/758d5a7d-658b-40b4-ac5d-7629e8172325-metrics-tls") pod "dns-default-9m5nh" (UID: "758d5a7d-658b-40b4-ac5d-7629e8172325") : secret "dns-default-metrics-tls" not found Jul 02 23:07:54.934104 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:54.934074 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/cd1134b6-429c-4008-8b58-5da7f4e9fc3f-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-297wc\" (UID: \"cd1134b6-429c-4008-8b58-5da7f4e9fc3f\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-297wc" Jul 02 23:07:54.934255 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:54.934218 2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 02 23:07:54.934293 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:54.934279 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd1134b6-429c-4008-8b58-5da7f4e9fc3f-networking-console-plugin-cert podName:cd1134b6-429c-4008-8b58-5da7f4e9fc3f nodeName:}" failed. No retries permitted until 2026-07-02 23:08:10.934265226 +0000 UTC m=+67.567306346 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/cd1134b6-429c-4008-8b58-5da7f4e9fc3f-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-297wc" (UID: "cd1134b6-429c-4008-8b58-5da7f4e9fc3f") : secret "networking-console-plugin-cert" not found Jul 02 23:07:58.059114 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:58.059080 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e37e66ff-54f9-4531-bd63-b1b491e8408b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-n5tqq\" (UID: \"e37e66ff-54f9-4531-bd63-b1b491e8408b\") " pod="openshift-insights/insights-runtime-extractor-n5tqq" Jul 02 23:07:58.059584 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:58.059144 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e37e66ff-54f9-4531-bd63-b1b491e8408b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-n5tqq\" (UID: \"e37e66ff-54f9-4531-bd63-b1b491e8408b\") " pod="openshift-insights/insights-runtime-extractor-n5tqq" Jul 02 23:07:58.059584 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:58.059236 2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 23:07:58.059584 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:58.059302 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e37e66ff-54f9-4531-bd63-b1b491e8408b-insights-runtime-extractor-tls podName:e37e66ff-54f9-4531-bd63-b1b491e8408b nodeName:}" failed. No retries permitted until 2026-07-02 23:08:06.059286981 +0000 UTC m=+62.692328101 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e37e66ff-54f9-4531-bd63-b1b491e8408b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-n5tqq" (UID: "e37e66ff-54f9-4531-bd63-b1b491e8408b") : secret "insights-runtime-extractor-tls" not found Jul 02 23:07:58.059584 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:58.059556 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e37e66ff-54f9-4531-bd63-b1b491e8408b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-n5tqq\" (UID: \"e37e66ff-54f9-4531-bd63-b1b491e8408b\") " pod="openshift-insights/insights-runtime-extractor-n5tqq" Jul 02 23:07:59.118471 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:59.118438 2563 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-wljkx" Jul 02 23:07:59.118849 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:59.118489 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-wljkx" Jul 02 23:07:59.118849 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:07:59.118811 2563 scope.go:117] "RemoveContainer" containerID="f34c54511f73ca2ecca62b1594f16e3bc376486c183970b3d87c081bf084ef52" Jul 02 23:07:59.118965 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:07:59.118948 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-wljkx_openshift-console-operator(5d4e781e-d925-477e-98c6-cb41099c6cb0)\"" pod="openshift-console-operator/console-operator-68b757fb67-wljkx" podUID="5d4e781e-d925-477e-98c6-cb41099c6cb0" Jul 02 23:08:05.066694 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:05.066668 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hhc6h" Jul 02 23:08:06.125434 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:06.125394 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e37e66ff-54f9-4531-bd63-b1b491e8408b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-n5tqq\" (UID: \"e37e66ff-54f9-4531-bd63-b1b491e8408b\") " pod="openshift-insights/insights-runtime-extractor-n5tqq" Jul 02 23:08:06.127724 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:06.127700 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e37e66ff-54f9-4531-bd63-b1b491e8408b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-n5tqq\" (UID: \"e37e66ff-54f9-4531-bd63-b1b491e8408b\") " pod="openshift-insights/insights-runtime-extractor-n5tqq" Jul 02 23:08:06.252985 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:06.252955 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-xpm5t\"" Jul 02 23:08:06.260803 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:06.260785 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-n5tqq" Jul 02 23:08:06.383966 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:06.383897 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-n5tqq"] Jul 02 23:08:06.387990 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:08:06.387961 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode37e66ff_54f9_4531_bd63_b1b491e8408b.slice/crio-4aebe673b4ba440e7623b4cead91968107c257a5e235face9b31dd8b68838078 WatchSource:0}: Error finding container 4aebe673b4ba440e7623b4cead91968107c257a5e235face9b31dd8b68838078: Status 404 returned error can't find the container with id 4aebe673b4ba440e7623b4cead91968107c257a5e235face9b31dd8b68838078 Jul 02 23:08:07.216446 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:07.216371 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-n5tqq" event={"ID":"e37e66ff-54f9-4531-bd63-b1b491e8408b","Type":"ContainerStarted","Data":"4aebe673b4ba440e7623b4cead91968107c257a5e235face9b31dd8b68838078"} Jul 02 23:08:09.557902 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:09.557850 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fad8c2d0-090a-4bac-8774-26cac496f9f7-metrics-certs\") pod \"network-metrics-daemon-tzfzk\" (UID: \"fad8c2d0-090a-4bac-8774-26cac496f9f7\") " pod="openshift-multus/network-metrics-daemon-tzfzk" Jul 02 23:08:09.558451 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:09.557983 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b17963a2-4797-4722-ae65-4ac1801913a5-original-pull-secret\") pod \"global-pull-secret-syncer-r7d5c\" (UID: \"b17963a2-4797-4722-ae65-4ac1801913a5\") " pod="kube-system/global-pull-secret-syncer-r7d5c" Jul 02 23:08:09.560404 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:09.560382 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 02 23:08:09.561166 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:09.561144 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 02 23:08:09.571626 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:09.571605 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fad8c2d0-090a-4bac-8774-26cac496f9f7-metrics-certs\") pod \"network-metrics-daemon-tzfzk\" (UID: \"fad8c2d0-090a-4bac-8774-26cac496f9f7\") " pod="openshift-multus/network-metrics-daemon-tzfzk" Jul 02 23:08:09.571781 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:09.571762 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b17963a2-4797-4722-ae65-4ac1801913a5-original-pull-secret\") pod \"global-pull-secret-syncer-r7d5c\" (UID: \"b17963a2-4797-4722-ae65-4ac1801913a5\") " pod="kube-system/global-pull-secret-syncer-r7d5c" Jul 02 23:08:09.659391 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:09.659356 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7frtk\" (UniqueName: \"kubernetes.io/projected/0ecba3b1-7f8d-4896-8c34-967f37704feb-kube-api-access-7frtk\") pod \"network-check-target-jxwvg\" (UID: \"0ecba3b1-7f8d-4896-8c34-967f37704feb\") " pod="openshift-network-diagnostics/network-check-target-jxwvg" Jul 02 23:08:09.662185 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:09.662158 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7frtk\" (UniqueName: \"kubernetes.io/projected/0ecba3b1-7f8d-4896-8c34-967f37704feb-kube-api-access-7frtk\") pod \"network-check-target-jxwvg\" (UID: \"0ecba3b1-7f8d-4896-8c34-967f37704feb\") " pod="openshift-network-diagnostics/network-check-target-jxwvg" Jul 02 23:08:09.784287 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:09.784247 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-dptv4\"" Jul 02 23:08:09.789284 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:09.789259 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jkmkq\"" Jul 02 23:08:09.792182 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:09.792158 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jxwvg" Jul 02 23:08:09.793437 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:09.793416 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r7d5c" Jul 02 23:08:09.797612 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:09.797595 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tzfzk" Jul 02 23:08:10.090518 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:10.090482 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-r7d5c"] Jul 02 23:08:10.093582 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:08:10.093556 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb17963a2_4797_4722_ae65_4ac1801913a5.slice/crio-ba1f00a10e3bed9c9cfc85ab1480225bbd626c8db33a4b1a85acac29ae74f2c6 WatchSource:0}: Error finding container ba1f00a10e3bed9c9cfc85ab1480225bbd626c8db33a4b1a85acac29ae74f2c6: Status 404 returned error can't find the container with id ba1f00a10e3bed9c9cfc85ab1480225bbd626c8db33a4b1a85acac29ae74f2c6 Jul 02 23:08:10.228791 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:10.228689 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-r7d5c" event={"ID":"b17963a2-4797-4722-ae65-4ac1801913a5","Type":"ContainerStarted","Data":"ba1f00a10e3bed9c9cfc85ab1480225bbd626c8db33a4b1a85acac29ae74f2c6"} Jul 02 23:08:10.230127 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:10.230103 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-n5tqq" event={"ID":"e37e66ff-54f9-4531-bd63-b1b491e8408b","Type":"ContainerStarted","Data":"a4ae4255e1c9e5c535dfefddf3da2d174c40ed6bb618731ec23b665938b20f36"} Jul 02 23:08:10.317346 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:10.317317 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-tzfzk"] Jul 02 23:08:10.319473 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:08:10.319434 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfad8c2d0_090a_4bac_8774_26cac496f9f7.slice/crio-86c066ea27cfbd56efe40614b0d8effe6478fb4b190294d0ac4275b14d24ef1a WatchSource:0}: Error finding container 86c066ea27cfbd56efe40614b0d8effe6478fb4b190294d0ac4275b14d24ef1a: Status 404 returned error can't find the container with id 86c066ea27cfbd56efe40614b0d8effe6478fb4b190294d0ac4275b14d24ef1a Jul 02 23:08:10.320279 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:10.320259 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jxwvg"] Jul 02 23:08:10.323768 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:08:10.323726 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ecba3b1_7f8d_4896_8c34_967f37704feb.slice/crio-c865114d05abd2a74e67b1adb65a27680a68fbb52f3a2b0ab1e45b1b9becf2d0 WatchSource:0}: Error finding container c865114d05abd2a74e67b1adb65a27680a68fbb52f3a2b0ab1e45b1b9becf2d0: Status 404 returned error can't find the container with id c865114d05abd2a74e67b1adb65a27680a68fbb52f3a2b0ab1e45b1b9becf2d0 Jul 02 23:08:10.669270 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:10.669243 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/de0c5637-bfd8-4989-a233-abc9a7cf1210-registry-tls\") pod \"image-registry-5897776f99-njm4b\" (UID: \"de0c5637-bfd8-4989-a233-abc9a7cf1210\") " pod="openshift-image-registry/image-registry-5897776f99-njm4b" Jul 02 23:08:10.671606 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:10.671585 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/de0c5637-bfd8-4989-a233-abc9a7cf1210-registry-tls\") pod \"image-registry-5897776f99-njm4b\" (UID: \"de0c5637-bfd8-4989-a233-abc9a7cf1210\") " pod="openshift-image-registry/image-registry-5897776f99-njm4b" Jul 02 23:08:10.769677 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:10.769646 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4530ab49-f26f-4e05-83ad-d40e9327478a-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-92c6f\" (UID: \"4530ab49-f26f-4e05-83ad-d40e9327478a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-92c6f" Jul 02 23:08:10.772777 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:10.772722 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4530ab49-f26f-4e05-83ad-d40e9327478a-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-92c6f\" (UID: \"4530ab49-f26f-4e05-83ad-d40e9327478a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-92c6f" Jul 02 23:08:10.870514 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:10.870425 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2690f25f-010b-41df-9514-f57323b17283-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-frm7j\" (UID: \"2690f25f-010b-41df-9514-f57323b17283\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-frm7j" Jul 02 23:08:10.870514 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:10.870493 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/758d5a7d-658b-40b4-ac5d-7629e8172325-metrics-tls\") pod \"dns-default-9m5nh\" (UID: \"758d5a7d-658b-40b4-ac5d-7629e8172325\") " pod="openshift-dns/dns-default-9m5nh" Jul 02 23:08:10.870689 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:10.870534 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0ca0d12d-9442-4bbb-8c4c-d2e4e513dd18-metrics-certs\") pod \"router-default-6744ddf86c-cr66l\" (UID: \"0ca0d12d-9442-4bbb-8c4c-d2e4e513dd18\") " pod="openshift-ingress/router-default-6744ddf86c-cr66l" Jul 02 23:08:10.870689 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:10.870590 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ca0d12d-9442-4bbb-8c4c-d2e4e513dd18-service-ca-bundle\") pod \"router-default-6744ddf86c-cr66l\" (UID: \"0ca0d12d-9442-4bbb-8c4c-d2e4e513dd18\") " pod="openshift-ingress/router-default-6744ddf86c-cr66l" Jul 02 23:08:10.871300 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:10.871274 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ca0d12d-9442-4bbb-8c4c-d2e4e513dd18-service-ca-bundle\") pod \"router-default-6744ddf86c-cr66l\" (UID: \"0ca0d12d-9442-4bbb-8c4c-d2e4e513dd18\") " pod="openshift-ingress/router-default-6744ddf86c-cr66l" Jul 02 23:08:10.873307 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:10.873260 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/758d5a7d-658b-40b4-ac5d-7629e8172325-metrics-tls\") pod \"dns-default-9m5nh\" (UID: \"758d5a7d-658b-40b4-ac5d-7629e8172325\") " pod="openshift-dns/dns-default-9m5nh" Jul 02 23:08:10.873637 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:10.873617 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2690f25f-010b-41df-9514-f57323b17283-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-frm7j\" (UID: \"2690f25f-010b-41df-9514-f57323b17283\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-frm7j" Jul 02 23:08:10.873725 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:10.873676 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0ca0d12d-9442-4bbb-8c4c-d2e4e513dd18-metrics-certs\") pod \"router-default-6744ddf86c-cr66l\" (UID: \"0ca0d12d-9442-4bbb-8c4c-d2e4e513dd18\") " pod="openshift-ingress/router-default-6744ddf86c-cr66l" Jul 02 23:08:10.908949 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:10.908923 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-mpx6s\"" Jul 02 23:08:10.917079 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:10.917054 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5897776f99-njm4b" Jul 02 23:08:10.942700 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:10.942649 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-j2kg8\"" Jul 02 23:08:10.951806 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:10.951575 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-92c6f" Jul 02 23:08:10.971966 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:10.971902 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/cd1134b6-429c-4008-8b58-5da7f4e9fc3f-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-297wc\" (UID: \"cd1134b6-429c-4008-8b58-5da7f4e9fc3f\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-297wc" Jul 02 23:08:10.976563 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:10.976473 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/cd1134b6-429c-4008-8b58-5da7f4e9fc3f-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-297wc\" (UID: \"cd1134b6-429c-4008-8b58-5da7f4e9fc3f\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-297wc" Jul 02 23:08:11.037108 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:11.037023 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-rhgbk\"" Jul 02 23:08:11.042147 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:11.041919 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6744ddf86c-cr66l" Jul 02 23:08:11.059878 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:11.059852 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-dl5xp\"" Jul 02 23:08:11.066401 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:11.066194 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9m5nh" Jul 02 23:08:11.109601 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:11.109453 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-hjpqf\"" Jul 02 23:08:11.114100 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:11.114072 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-hwg5h\"" Jul 02 23:08:11.114386 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:11.114367 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5897776f99-njm4b"] Jul 02 23:08:11.116139 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:11.116119 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-frm7j" Jul 02 23:08:11.122171 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:11.121986 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-297wc" Jul 02 23:08:11.155282 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:11.155252 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-92c6f"] Jul 02 23:08:11.246582 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:11.246485 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-92c6f" event={"ID":"4530ab49-f26f-4e05-83ad-d40e9327478a","Type":"ContainerStarted","Data":"d449d01c67d7f3ddbdbefce1316c3c3eaa8c8a687c3a22a729a0514fac257bf4"} Jul 02 23:08:11.250053 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:11.249640 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tzfzk" event={"ID":"fad8c2d0-090a-4bac-8774-26cac496f9f7","Type":"ContainerStarted","Data":"86c066ea27cfbd56efe40614b0d8effe6478fb4b190294d0ac4275b14d24ef1a"} Jul 02 23:08:11.254139 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:11.254079 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6744ddf86c-cr66l"] Jul 02 23:08:11.266691 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:11.266662 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jxwvg" event={"ID":"0ecba3b1-7f8d-4896-8c34-967f37704feb","Type":"ContainerStarted","Data":"f7ec32718dea2b0c580e14856f0494fb04d6f6bfe0fb64d77a0672ba6439ea4a"} Jul 02 23:08:11.266899 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:11.266878 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jxwvg" event={"ID":"0ecba3b1-7f8d-4896-8c34-967f37704feb","Type":"ContainerStarted","Data":"c865114d05abd2a74e67b1adb65a27680a68fbb52f3a2b0ab1e45b1b9becf2d0"} Jul 02 23:08:11.267041 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:11.267029 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-jxwvg" Jul 02 23:08:11.272887 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:11.272689 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5897776f99-njm4b" event={"ID":"de0c5637-bfd8-4989-a233-abc9a7cf1210","Type":"ContainerStarted","Data":"fdd18d76df4bf42715e688e856a211d0d07063c1acda70bf366c3879447ed51b"} Jul 02 23:08:11.273566 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:11.273527 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5897776f99-njm4b" Jul 02 23:08:11.278861 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:11.278723 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-n5tqq" event={"ID":"e37e66ff-54f9-4531-bd63-b1b491e8408b","Type":"ContainerStarted","Data":"a6bfd149ed21d5f1e0a0435f8a2c949d0657fd4c5a351c616a3d36d86a7da2c3"} Jul 02 23:08:11.289520 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:11.285613 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-9m5nh"] Jul 02 23:08:11.306966 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:11.306372 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5897776f99-njm4b" podStartSLOduration=67.306355121 podStartE2EDuration="1m7.306355121s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:07:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:08:11.305675793 +0000 UTC m=+67.938716936" watchObservedRunningTime="2026-07-02 23:08:11.306355121 +0000 UTC m=+67.939396265" Jul 02 23:08:11.308276 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:11.307093 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-jxwvg" podStartSLOduration=68.307076012 podStartE2EDuration="1m8.307076012s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:07:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:08:11.287029915 +0000 UTC m=+67.920071058" watchObservedRunningTime="2026-07-02 23:08:11.307076012 +0000 UTC m=+67.940117154" Jul 02 23:08:11.347184 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:11.347113 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-297wc"] Jul 02 23:08:11.355980 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:08:11.355950 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd1134b6_429c_4008_8b58_5da7f4e9fc3f.slice/crio-67bf61f929af5c49aa988bb6afb7d5d3a33fcba765dbad98fbed71046aabe6e6 WatchSource:0}: Error finding container 67bf61f929af5c49aa988bb6afb7d5d3a33fcba765dbad98fbed71046aabe6e6: Status 404 returned error can't find the container with id 67bf61f929af5c49aa988bb6afb7d5d3a33fcba765dbad98fbed71046aabe6e6 Jul 02 23:08:11.370594 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:11.370555 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-frm7j"] Jul 02 23:08:11.373651 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:08:11.373018 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2690f25f_010b_41df_9514_f57323b17283.slice/crio-5f3b5942473847f68d922a0b260aada2888791f74d95e5d570e6b74741316a97 WatchSource:0}: Error finding container 5f3b5942473847f68d922a0b260aada2888791f74d95e5d570e6b74741316a97: Status 404 returned error can't find the container with id 5f3b5942473847f68d922a0b260aada2888791f74d95e5d570e6b74741316a97 Jul 02 23:08:11.844248 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:11.844226 2563 scope.go:117] "RemoveContainer" containerID="f34c54511f73ca2ecca62b1594f16e3bc376486c183970b3d87c081bf084ef52" Jul 02 23:08:12.300789 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:12.300144 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6744ddf86c-cr66l" event={"ID":"0ca0d12d-9442-4bbb-8c4c-d2e4e513dd18","Type":"ContainerStarted","Data":"31d7d70b6964ee825181ebdd19f4ddcd8a428c573bf1e79bf91d5e91d76ca671"} Jul 02 23:08:12.300789 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:12.300242 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6744ddf86c-cr66l" event={"ID":"0ca0d12d-9442-4bbb-8c4c-d2e4e513dd18","Type":"ContainerStarted","Data":"d65ef6c3699556d87962750acae2c45c932136f8f63db08a3f882b0cb2f60bc6"} Jul 02 23:08:12.306519 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:12.305387 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5897776f99-njm4b" event={"ID":"de0c5637-bfd8-4989-a233-abc9a7cf1210","Type":"ContainerStarted","Data":"c94816fc195a7c96c153de76c7d2d2c52ced18cdf926e4387a68300a77ea8ecb"} Jul 02 23:08:12.309884 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:12.309856 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-297wc" event={"ID":"cd1134b6-429c-4008-8b58-5da7f4e9fc3f","Type":"ContainerStarted","Data":"67bf61f929af5c49aa988bb6afb7d5d3a33fcba765dbad98fbed71046aabe6e6"} Jul 02 23:08:12.323051 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:12.321632 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tzfzk" event={"ID":"fad8c2d0-090a-4bac-8774-26cac496f9f7","Type":"ContainerStarted","Data":"575307d07b45a3cc210ca9bc1629875ba6b8df17f4db9478d1310a3281a24af5"} Jul 02 23:08:12.323051 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:12.321681 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tzfzk" event={"ID":"fad8c2d0-090a-4bac-8774-26cac496f9f7","Type":"ContainerStarted","Data":"d24256cbc5f9a9752a693138041d3cba4966ed2fd9e059f5f17d73a473d76d48"} Jul 02 23:08:12.323051 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:12.322220 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-6744ddf86c-cr66l" podStartSLOduration=39.322204733 podStartE2EDuration="39.322204733s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:07:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:08:12.321120056 +0000 UTC m=+68.954161200" watchObservedRunningTime="2026-07-02 23:08:12.322204733 +0000 UTC m=+68.955245876" Jul 02 23:08:12.326581 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:12.326513 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-frm7j" event={"ID":"2690f25f-010b-41df-9514-f57323b17283","Type":"ContainerStarted","Data":"5f3b5942473847f68d922a0b260aada2888791f74d95e5d570e6b74741316a97"} Jul 02 23:08:12.328336 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:12.328268 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9m5nh" event={"ID":"758d5a7d-658b-40b4-ac5d-7629e8172325","Type":"ContainerStarted","Data":"89ef6c4bcb1826a92a8fbb45c4ff9368a54dcdafc1bb882e7e74d38dc9f4e811"} Jul 02 23:08:12.341301 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:12.339110 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-wljkx_5d4e781e-d925-477e-98c6-cb41099c6cb0/console-operator/1.log" Jul 02 23:08:12.341301 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:12.339547 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-wljkx" event={"ID":"5d4e781e-d925-477e-98c6-cb41099c6cb0","Type":"ContainerStarted","Data":"a67107b5a07a13b98c66bba6bd0135fba387c1dfc3473991b160d6f427881a92"} Jul 02 23:08:12.341301 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:12.340253 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-tzfzk" podStartSLOduration=66.820742175 podStartE2EDuration="1m8.34023859s" totalImagesPullingTime="1.519496415s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:07:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:08:12.338584823 +0000 UTC m=+68.971625966" watchObservedRunningTime="2026-07-02 23:08:12.34023859 +0000 UTC m=+68.973279745" Jul 02 23:08:12.341301 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:12.340397 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-wljkx" Jul 02 23:08:12.605349 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:12.605118 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-68b757fb67-wljkx" Jul 02 23:08:12.622776 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:12.621873 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-68b757fb67-wljkx" podStartSLOduration=30.257128206 podStartE2EDuration="39.621852182s" totalImagesPullingTime="9.364723976s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:07:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:08:12.35651292 +0000 UTC m=+68.989554064" watchObservedRunningTime="2026-07-02 23:08:12.621852182 +0000 UTC m=+69.254893329" Jul 02 23:08:13.043079 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:13.043047 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-6744ddf86c-cr66l" Jul 02 23:08:13.046390 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:13.046013 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-6744ddf86c-cr66l" Jul 02 23:08:13.347655 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:13.347440 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-6744ddf86c-cr66l" Jul 02 23:08:13.348999 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:13.348808 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-6744ddf86c-cr66l" Jul 02 23:08:19.371156 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:19.371114 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-r7d5c" event={"ID":"b17963a2-4797-4722-ae65-4ac1801913a5","Type":"ContainerStarted","Data":"2638d1d7e1762cc5f1dc065deeddd486a17eb0ca7494d51e5c4c87143bb7b94b"} Jul 02 23:08:19.372773 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:19.372727 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-297wc" event={"ID":"cd1134b6-429c-4008-8b58-5da7f4e9fc3f","Type":"ContainerStarted","Data":"e88191a3b0bf76f677f3e0cc04ebebac0245818c2e117b0bd9c475b17c455936"} Jul 02 23:08:19.374776 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:19.374753 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-n5tqq" event={"ID":"e37e66ff-54f9-4531-bd63-b1b491e8408b","Type":"ContainerStarted","Data":"a9b59c6eba89b53c4ee3b280c3ad555eb0b00635baa815ad28069df5173084d7"} Jul 02 23:08:19.376458 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:19.376401 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-92c6f" event={"ID":"4530ab49-f26f-4e05-83ad-d40e9327478a","Type":"ContainerStarted","Data":"f9d90d9e46ec2374fcbced9b60be83b2031425a84a9cf4cd5e7190d62d32bb11"} Jul 02 23:08:19.376458 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:19.376444 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-92c6f" event={"ID":"4530ab49-f26f-4e05-83ad-d40e9327478a","Type":"ContainerStarted","Data":"85893e68db3926d2a11e7a6fa5b11d09d715b64a8a58aa86ef5d1bb338eab53c"} Jul 02 23:08:19.377959 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:19.377941 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-frm7j" event={"ID":"2690f25f-010b-41df-9514-f57323b17283","Type":"ContainerStarted","Data":"3d6f2aff798c54b14f6e6996322fecdbac2f9bf1a5eaa5f51606bf73a4a39651"} Jul 02 23:08:19.379556 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:19.379537 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9m5nh" event={"ID":"758d5a7d-658b-40b4-ac5d-7629e8172325","Type":"ContainerStarted","Data":"0078fd7a64c9d7f987e74d665b37b5dac53519cc7c7a4862e132c7a9b8396977"} Jul 02 23:08:19.379649 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:19.379570 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9m5nh" event={"ID":"758d5a7d-658b-40b4-ac5d-7629e8172325","Type":"ContainerStarted","Data":"04c17a93f0d9e539459f18ae22e90c6c199f6ea684ce124a215c25b2361538a4"} Jul 02 23:08:19.379702 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:19.379654 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-9m5nh" Jul 02 23:08:19.388252 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:19.388208 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-r7d5c" podStartSLOduration=66.687192973 podStartE2EDuration="1m15.388173997s" totalImagesPullingTime="8.700981024s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 23:07:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:08:19.38786668 +0000 UTC m=+76.020907821" watchObservedRunningTime="2026-07-02 23:08:19.388173997 +0000 UTC m=+76.021215141" Jul 02 23:08:19.405649 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:19.405608 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-n5tqq" podStartSLOduration=17.433144256 podStartE2EDuration="29.405594512s" totalImagesPullingTime="11.972450256s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 23:07:50 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:08:19.405059988 +0000 UTC m=+76.038101131" watchObservedRunningTime="2026-07-02 23:08:19.405594512 +0000 UTC m=+76.038635677" Jul 02 23:08:19.421270 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:19.421212 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-92c6f" podStartSLOduration=39.14500968 podStartE2EDuration="46.42119925s" totalImagesPullingTime="7.27618957s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:07:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:08:19.42063194 +0000 UTC m=+76.053673084" watchObservedRunningTime="2026-07-02 23:08:19.42119925 +0000 UTC m=+76.054240392" Jul 02 23:08:19.436520 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:19.436484 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-9m5nh" podStartSLOduration=34.217267232 podStartE2EDuration="41.436472153s" totalImagesPullingTime="7.219204921s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:07:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:08:19.436090164 +0000 UTC m=+76.069131306" watchObservedRunningTime="2026-07-02 23:08:19.436472153 +0000 UTC m=+76.069513296" Jul 02 23:08:19.454636 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:19.454588 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6bffdf9778-297wc" podStartSLOduration=39.331349775 podStartE2EDuration="46.454574791s" totalImagesPullingTime="7.123225016s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:07:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:08:19.453700887 +0000 UTC m=+76.086742028" watchObservedRunningTime="2026-07-02 23:08:19.454574791 +0000 UTC m=+76.087615932" Jul 02 23:08:19.472610 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:19.472568 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-frm7j" podStartSLOduration=39.339502278 podStartE2EDuration="46.472554249s" totalImagesPullingTime="7.133051971s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:07:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:08:19.471974895 +0000 UTC m=+76.105016038" watchObservedRunningTime="2026-07-02 23:08:19.472554249 +0000 UTC m=+76.105595391" Jul 02 23:08:29.387018 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:29.386906 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-9m5nh" Jul 02 23:08:30.921241 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:30.921202 2563 patch_prober.go:28] interesting pod/image-registry-5897776f99-njm4b container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 02 23:08:30.921621 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:30.921259 2563 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5897776f99-njm4b" podUID="de0c5637-bfd8-4989-a233-abc9a7cf1210" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 02 23:08:33.351790 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:33.351762 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5897776f99-njm4b" Jul 02 23:08:37.902540 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:37.902505 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5897776f99-njm4b"] Jul 02 23:08:40.512524 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:40.512488 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-kgdl8"] Jul 02 23:08:40.515645 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:40.515626 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-kgdl8" Jul 02 23:08:40.519146 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:40.519078 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 02 23:08:40.519146 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:40.519095 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-gvhx5\"" Jul 02 23:08:40.519146 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:40.519116 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 02 23:08:40.519146 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:40.519120 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 02 23:08:40.519411 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:40.519258 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 02 23:08:40.526765 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:40.526727 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-kgdl8"] Jul 02 23:08:40.532846 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:40.532822 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-fcjj9"] Jul 02 23:08:40.538087 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:40.538063 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-fcjj9" Jul 02 23:08:40.540715 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:40.540692 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 02 23:08:40.541014 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:40.540992 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 02 23:08:40.541216 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:40.541199 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 02 23:08:40.541296 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:40.541248 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-tk5z5\"" Jul 02 23:08:40.615329 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:40.615288 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/cfa039cb-5d08-4fb1-87e6-7b0b5bf90947-node-exporter-wtmp\") pod \"node-exporter-fcjj9\" (UID: \"cfa039cb-5d08-4fb1-87e6-7b0b5bf90947\") " pod="openshift-monitoring/node-exporter-fcjj9" Jul 02 23:08:40.615329 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:40.615328 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cfa039cb-5d08-4fb1-87e6-7b0b5bf90947-sys\") pod \"node-exporter-fcjj9\" (UID: \"cfa039cb-5d08-4fb1-87e6-7b0b5bf90947\") " pod="openshift-monitoring/node-exporter-fcjj9" Jul 02 23:08:40.615518 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:40.615350 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e35b0672-54b5-46cf-b747-b56fa8158d9e-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-kgdl8\" (UID: \"e35b0672-54b5-46cf-b747-b56fa8158d9e\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-kgdl8" Jul 02 23:08:40.615518 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:40.615372 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/e35b0672-54b5-46cf-b747-b56fa8158d9e-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-kgdl8\" (UID: \"e35b0672-54b5-46cf-b747-b56fa8158d9e\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-kgdl8" Jul 02 23:08:40.615518 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:40.615424 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/e35b0672-54b5-46cf-b747-b56fa8158d9e-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-kgdl8\" (UID: \"e35b0672-54b5-46cf-b747-b56fa8158d9e\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-kgdl8" Jul 02 23:08:40.615518 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:40.615450 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cfa039cb-5d08-4fb1-87e6-7b0b5bf90947-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fcjj9\" (UID: \"cfa039cb-5d08-4fb1-87e6-7b0b5bf90947\") " pod="openshift-monitoring/node-exporter-fcjj9" Jul 02 23:08:40.615518 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:40.615491 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/cfa039cb-5d08-4fb1-87e6-7b0b5bf90947-node-exporter-accelerators-collector-config\") pod \"node-exporter-fcjj9\" (UID: \"cfa039cb-5d08-4fb1-87e6-7b0b5bf90947\") " pod="openshift-monitoring/node-exporter-fcjj9" Jul 02 23:08:40.615669 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:40.615535 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pzhhx\" (UniqueName: \"kubernetes.io/projected/e35b0672-54b5-46cf-b747-b56fa8158d9e-kube-api-access-pzhhx\") pod \"kube-state-metrics-7c9dbb8b7d-kgdl8\" (UID: \"e35b0672-54b5-46cf-b747-b56fa8158d9e\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-kgdl8" Jul 02 23:08:40.615669 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:40.615560 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e35b0672-54b5-46cf-b747-b56fa8158d9e-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-kgdl8\" (UID: \"e35b0672-54b5-46cf-b747-b56fa8158d9e\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-kgdl8" Jul 02 23:08:40.615669 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:40.615579 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/cfa039cb-5d08-4fb1-87e6-7b0b5bf90947-node-exporter-tls\") pod \"node-exporter-fcjj9\" (UID: \"cfa039cb-5d08-4fb1-87e6-7b0b5bf90947\") " pod="openshift-monitoring/node-exporter-fcjj9" Jul 02 23:08:40.615669 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:40.615599 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/cfa039cb-5d08-4fb1-87e6-7b0b5bf90947-root\") pod \"node-exporter-fcjj9\" (UID: \"cfa039cb-5d08-4fb1-87e6-7b0b5bf90947\") " pod="openshift-monitoring/node-exporter-fcjj9" Jul 02 23:08:40.615669 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:40.615622 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/cfa039cb-5d08-4fb1-87e6-7b0b5bf90947-node-exporter-textfile\") pod \"node-exporter-fcjj9\" (UID: \"cfa039cb-5d08-4fb1-87e6-7b0b5bf90947\") " pod="openshift-monitoring/node-exporter-fcjj9" Jul 02 23:08:40.615669 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:40.615637 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cfa039cb-5d08-4fb1-87e6-7b0b5bf90947-metrics-client-ca\") pod \"node-exporter-fcjj9\" (UID: \"cfa039cb-5d08-4fb1-87e6-7b0b5bf90947\") " pod="openshift-monitoring/node-exporter-fcjj9" Jul 02 23:08:40.615669 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:40.615656 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e35b0672-54b5-46cf-b747-b56fa8158d9e-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-kgdl8\" (UID: \"e35b0672-54b5-46cf-b747-b56fa8158d9e\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-kgdl8" Jul 02 23:08:40.615929 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:40.615685 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zs5ct\" (UniqueName: \"kubernetes.io/projected/cfa039cb-5d08-4fb1-87e6-7b0b5bf90947-kube-api-access-zs5ct\") pod \"node-exporter-fcjj9\" (UID: \"cfa039cb-5d08-4fb1-87e6-7b0b5bf90947\") " pod="openshift-monitoring/node-exporter-fcjj9" Jul 02 23:08:40.716302 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:40.716271 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e35b0672-54b5-46cf-b747-b56fa8158d9e-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-kgdl8\" (UID: \"e35b0672-54b5-46cf-b747-b56fa8158d9e\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-kgdl8" Jul 02 23:08:40.716302 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:40.716309 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zs5ct\" (UniqueName: \"kubernetes.io/projected/cfa039cb-5d08-4fb1-87e6-7b0b5bf90947-kube-api-access-zs5ct\") pod \"node-exporter-fcjj9\" (UID: \"cfa039cb-5d08-4fb1-87e6-7b0b5bf90947\") " pod="openshift-monitoring/node-exporter-fcjj9" Jul 02 23:08:40.716551 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:40.716330 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/cfa039cb-5d08-4fb1-87e6-7b0b5bf90947-node-exporter-wtmp\") pod \"node-exporter-fcjj9\" (UID: \"cfa039cb-5d08-4fb1-87e6-7b0b5bf90947\") " pod="openshift-monitoring/node-exporter-fcjj9" Jul 02 23:08:40.716551 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:40.716348 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cfa039cb-5d08-4fb1-87e6-7b0b5bf90947-sys\") pod \"node-exporter-fcjj9\" (UID: \"cfa039cb-5d08-4fb1-87e6-7b0b5bf90947\") " pod="openshift-monitoring/node-exporter-fcjj9" Jul 02 23:08:40.716551 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:40.716423 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cfa039cb-5d08-4fb1-87e6-7b0b5bf90947-sys\") pod \"node-exporter-fcjj9\" (UID: \"cfa039cb-5d08-4fb1-87e6-7b0b5bf90947\") " pod="openshift-monitoring/node-exporter-fcjj9" Jul 02 23:08:40.716551 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:40.716453 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e35b0672-54b5-46cf-b747-b56fa8158d9e-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-kgdl8\" (UID: \"e35b0672-54b5-46cf-b747-b56fa8158d9e\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-kgdl8" Jul 02 23:08:40.716551 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:40.716473 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/e35b0672-54b5-46cf-b747-b56fa8158d9e-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-kgdl8\" (UID: \"e35b0672-54b5-46cf-b747-b56fa8158d9e\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-kgdl8" Jul 02 23:08:40.716551 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:40.716475 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/cfa039cb-5d08-4fb1-87e6-7b0b5bf90947-node-exporter-wtmp\") pod \"node-exporter-fcjj9\" (UID: \"cfa039cb-5d08-4fb1-87e6-7b0b5bf90947\") " pod="openshift-monitoring/node-exporter-fcjj9" Jul 02 23:08:40.716551 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:40.716495 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/e35b0672-54b5-46cf-b747-b56fa8158d9e-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-kgdl8\" (UID: \"e35b0672-54b5-46cf-b747-b56fa8158d9e\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-kgdl8" Jul 02 23:08:40.716551 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:40.716512 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cfa039cb-5d08-4fb1-87e6-7b0b5bf90947-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fcjj9\" (UID: \"cfa039cb-5d08-4fb1-87e6-7b0b5bf90947\") " pod="openshift-monitoring/node-exporter-fcjj9" Jul 02 23:08:40.716985 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:40.716544 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/cfa039cb-5d08-4fb1-87e6-7b0b5bf90947-node-exporter-accelerators-collector-config\") pod \"node-exporter-fcjj9\" (UID: \"cfa039cb-5d08-4fb1-87e6-7b0b5bf90947\") " pod="openshift-monitoring/node-exporter-fcjj9" Jul 02 23:08:40.716985 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:40.716615 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pzhhx\" (UniqueName: \"kubernetes.io/projected/e35b0672-54b5-46cf-b747-b56fa8158d9e-kube-api-access-pzhhx\") pod \"kube-state-metrics-7c9dbb8b7d-kgdl8\" (UID: \"e35b0672-54b5-46cf-b747-b56fa8158d9e\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-kgdl8" Jul 02 23:08:40.716985 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:40.716640 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e35b0672-54b5-46cf-b747-b56fa8158d9e-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-kgdl8\" (UID: \"e35b0672-54b5-46cf-b747-b56fa8158d9e\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-kgdl8" Jul 02 23:08:40.716985 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:40.716662 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/cfa039cb-5d08-4fb1-87e6-7b0b5bf90947-node-exporter-tls\") pod \"node-exporter-fcjj9\" (UID: \"cfa039cb-5d08-4fb1-87e6-7b0b5bf90947\") " pod="openshift-monitoring/node-exporter-fcjj9" Jul 02 23:08:40.716985 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:40.716699 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/cfa039cb-5d08-4fb1-87e6-7b0b5bf90947-root\") pod \"node-exporter-fcjj9\" (UID: \"cfa039cb-5d08-4fb1-87e6-7b0b5bf90947\") " pod="openshift-monitoring/node-exporter-fcjj9" Jul 02 23:08:40.716985 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:40.716723 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/cfa039cb-5d08-4fb1-87e6-7b0b5bf90947-node-exporter-textfile\") pod \"node-exporter-fcjj9\" (UID: \"cfa039cb-5d08-4fb1-87e6-7b0b5bf90947\") " pod="openshift-monitoring/node-exporter-fcjj9" Jul 02 23:08:40.716985 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:40.716779 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cfa039cb-5d08-4fb1-87e6-7b0b5bf90947-metrics-client-ca\") pod \"node-exporter-fcjj9\" (UID: \"cfa039cb-5d08-4fb1-87e6-7b0b5bf90947\") " pod="openshift-monitoring/node-exporter-fcjj9" Jul 02 23:08:40.716985 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:40.716971 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/e35b0672-54b5-46cf-b747-b56fa8158d9e-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-kgdl8\" (UID: \"e35b0672-54b5-46cf-b747-b56fa8158d9e\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-kgdl8" Jul 02 23:08:40.716985 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:08:40.716986 2563 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 02 23:08:40.717420 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:40.717034 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/cfa039cb-5d08-4fb1-87e6-7b0b5bf90947-root\") pod \"node-exporter-fcjj9\" (UID: \"cfa039cb-5d08-4fb1-87e6-7b0b5bf90947\") " pod="openshift-monitoring/node-exporter-fcjj9" Jul 02 23:08:40.717420 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:08:40.717076 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cfa039cb-5d08-4fb1-87e6-7b0b5bf90947-node-exporter-tls podName:cfa039cb-5d08-4fb1-87e6-7b0b5bf90947 nodeName:}" failed. No retries permitted until 2026-07-02 23:08:41.217055847 +0000 UTC m=+97.850096974 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/cfa039cb-5d08-4fb1-87e6-7b0b5bf90947-node-exporter-tls") pod "node-exporter-fcjj9" (UID: "cfa039cb-5d08-4fb1-87e6-7b0b5bf90947") : secret "node-exporter-tls" not found Jul 02 23:08:40.717420 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:40.717216 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e35b0672-54b5-46cf-b747-b56fa8158d9e-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-kgdl8\" (UID: \"e35b0672-54b5-46cf-b747-b56fa8158d9e\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-kgdl8" Jul 02 23:08:40.717420 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:40.717270 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/e35b0672-54b5-46cf-b747-b56fa8158d9e-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-kgdl8\" (UID: \"e35b0672-54b5-46cf-b747-b56fa8158d9e\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-kgdl8" Jul 02 23:08:40.717420 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:40.717389 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/cfa039cb-5d08-4fb1-87e6-7b0b5bf90947-node-exporter-accelerators-collector-config\") pod \"node-exporter-fcjj9\" (UID: \"cfa039cb-5d08-4fb1-87e6-7b0b5bf90947\") " pod="openshift-monitoring/node-exporter-fcjj9" Jul 02 23:08:40.717658 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:40.717425 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cfa039cb-5d08-4fb1-87e6-7b0b5bf90947-metrics-client-ca\") pod \"node-exporter-fcjj9\" (UID: \"cfa039cb-5d08-4fb1-87e6-7b0b5bf90947\") " pod="openshift-monitoring/node-exporter-fcjj9" Jul 02 23:08:40.717658 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:40.717539 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/cfa039cb-5d08-4fb1-87e6-7b0b5bf90947-node-exporter-textfile\") pod \"node-exporter-fcjj9\" (UID: \"cfa039cb-5d08-4fb1-87e6-7b0b5bf90947\") " pod="openshift-monitoring/node-exporter-fcjj9" Jul 02 23:08:40.719553 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:40.719441 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e35b0672-54b5-46cf-b747-b56fa8158d9e-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-kgdl8\" (UID: \"e35b0672-54b5-46cf-b747-b56fa8158d9e\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-kgdl8" Jul 02 23:08:40.719770 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:40.719726 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cfa039cb-5d08-4fb1-87e6-7b0b5bf90947-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fcjj9\" (UID: \"cfa039cb-5d08-4fb1-87e6-7b0b5bf90947\") " pod="openshift-monitoring/node-exporter-fcjj9" Jul 02 23:08:40.719888 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:40.719873 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e35b0672-54b5-46cf-b747-b56fa8158d9e-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-kgdl8\" (UID: \"e35b0672-54b5-46cf-b747-b56fa8158d9e\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-kgdl8" Jul 02 23:08:40.727938 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:40.727897 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pzhhx\" (UniqueName: \"kubernetes.io/projected/e35b0672-54b5-46cf-b747-b56fa8158d9e-kube-api-access-pzhhx\") pod \"kube-state-metrics-7c9dbb8b7d-kgdl8\" (UID: \"e35b0672-54b5-46cf-b747-b56fa8158d9e\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-kgdl8" Jul 02 23:08:40.727938 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:40.727923 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zs5ct\" (UniqueName: \"kubernetes.io/projected/cfa039cb-5d08-4fb1-87e6-7b0b5bf90947-kube-api-access-zs5ct\") pod \"node-exporter-fcjj9\" (UID: \"cfa039cb-5d08-4fb1-87e6-7b0b5bf90947\") " pod="openshift-monitoring/node-exporter-fcjj9" Jul 02 23:08:40.825226 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:40.825145 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-kgdl8" Jul 02 23:08:40.962469 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:40.962443 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-kgdl8"] Jul 02 23:08:40.964824 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:08:40.964792 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode35b0672_54b5_46cf_b747_b56fa8158d9e.slice/crio-1f6f754db909a36353dafa805c3edbe5682773fca30eed49fc8246bcee35b137 WatchSource:0}: Error finding container 1f6f754db909a36353dafa805c3edbe5682773fca30eed49fc8246bcee35b137: Status 404 returned error can't find the container with id 1f6f754db909a36353dafa805c3edbe5682773fca30eed49fc8246bcee35b137 Jul 02 23:08:41.221055 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:41.221020 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/cfa039cb-5d08-4fb1-87e6-7b0b5bf90947-node-exporter-tls\") pod \"node-exporter-fcjj9\" (UID: \"cfa039cb-5d08-4fb1-87e6-7b0b5bf90947\") " pod="openshift-monitoring/node-exporter-fcjj9" Jul 02 23:08:41.223412 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:41.223381 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/cfa039cb-5d08-4fb1-87e6-7b0b5bf90947-node-exporter-tls\") pod \"node-exporter-fcjj9\" (UID: \"cfa039cb-5d08-4fb1-87e6-7b0b5bf90947\") " pod="openshift-monitoring/node-exporter-fcjj9" Jul 02 23:08:41.447888 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:41.447852 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-fcjj9" Jul 02 23:08:41.460761 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:08:41.460676 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfa039cb_5d08_4fb1_87e6_7b0b5bf90947.slice/crio-bf60db2539d64da3f660e48a012bbcc86e5c1e86b23ff9e08fcfad876717f2c5 WatchSource:0}: Error finding container bf60db2539d64da3f660e48a012bbcc86e5c1e86b23ff9e08fcfad876717f2c5: Status 404 returned error can't find the container with id bf60db2539d64da3f660e48a012bbcc86e5c1e86b23ff9e08fcfad876717f2c5 Jul 02 23:08:41.462318 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:41.462285 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-kgdl8" event={"ID":"e35b0672-54b5-46cf-b747-b56fa8158d9e","Type":"ContainerStarted","Data":"1f6f754db909a36353dafa805c3edbe5682773fca30eed49fc8246bcee35b137"} Jul 02 23:08:42.341969 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:42.341937 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-jxwvg" Jul 02 23:08:42.470351 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:42.470277 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fcjj9" event={"ID":"cfa039cb-5d08-4fb1-87e6-7b0b5bf90947","Type":"ContainerStarted","Data":"bf60db2539d64da3f660e48a012bbcc86e5c1e86b23ff9e08fcfad876717f2c5"} Jul 02 23:08:44.480391 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:44.480355 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-kgdl8" event={"ID":"e35b0672-54b5-46cf-b747-b56fa8158d9e","Type":"ContainerStarted","Data":"16f07c8474f18185ec2a5b3424a4bc251fdc0c609a1d263324a673e8f77aed6f"} Jul 02 23:08:44.480916 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:44.480443 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-kgdl8" event={"ID":"e35b0672-54b5-46cf-b747-b56fa8158d9e","Type":"ContainerStarted","Data":"f2a48af95b781ea695b5a628f72e1490ce8224b3bd57b887f0fb6620f6ff61ee"} Jul 02 23:08:44.480916 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:44.480473 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-kgdl8" event={"ID":"e35b0672-54b5-46cf-b747-b56fa8158d9e","Type":"ContainerStarted","Data":"830d17feaafbb8370dc36be7a02b71dc6d9019492f53b2f6992bb4d952e3045a"} Jul 02 23:08:44.482006 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:44.481982 2563 generic.go:356] "Generic (PLEG): container finished" podID="cfa039cb-5d08-4fb1-87e6-7b0b5bf90947" containerID="5b17c0ec7007287f405089bad93a38119be7ba8e8e9cc1458f5abd59b04c6984" exitCode=0 Jul 02 23:08:44.482110 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:44.482061 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fcjj9" event={"ID":"cfa039cb-5d08-4fb1-87e6-7b0b5bf90947","Type":"ContainerDied","Data":"5b17c0ec7007287f405089bad93a38119be7ba8e8e9cc1458f5abd59b04c6984"} Jul 02 23:08:44.502283 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:44.502243 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-kgdl8" podStartSLOduration=2.109827551 podStartE2EDuration="4.50222928s" totalImagesPullingTime="2.392401729s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:08:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:08:44.50055696 +0000 UTC m=+101.133598103" watchObservedRunningTime="2026-07-02 23:08:44.50222928 +0000 UTC m=+101.135270453" Jul 02 23:08:45.489104 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:45.489065 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fcjj9" event={"ID":"cfa039cb-5d08-4fb1-87e6-7b0b5bf90947","Type":"ContainerStarted","Data":"162dfd0e975e6c422415173218c4dbb1de3d17fa5af7a08f0618a7eb7a1b4ea8"} Jul 02 23:08:45.489633 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:45.489135 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fcjj9" event={"ID":"cfa039cb-5d08-4fb1-87e6-7b0b5bf90947","Type":"ContainerStarted","Data":"ec75cf92555ee56e204ff8f888f56bbfa9c08d062efbb4d6eeac5cdac3d1b17e"} Jul 02 23:08:45.742176 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:45.742063 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-fcjj9" podStartSLOduration=3.7084449619999997 podStartE2EDuration="5.7420439s" totalImagesPullingTime="1.893922399s" totalInitContainerRuntime="139.676539ms" isStatefulPod=true podCreationTimestamp="2026-07-02 23:08:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:08:45.508625823 +0000 UTC m=+102.141666977" watchObservedRunningTime="2026-07-02 23:08:45.7420439 +0000 UTC m=+102.375085042" Jul 02 23:08:45.742912 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:45.742888 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-6744645b9d-jldvn"] Jul 02 23:08:45.762245 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:45.762222 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6744645b9d-jldvn"] Jul 02 23:08:45.762375 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:45.762334 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6744645b9d-jldvn" Jul 02 23:08:45.764800 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:45.764769 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 02 23:08:45.764910 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:45.764811 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 02 23:08:45.764910 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:45.764777 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 02 23:08:45.765120 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:45.765104 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 02 23:08:45.765183 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:45.765154 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 02 23:08:45.765245 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:45.765210 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-z87rs\"" Jul 02 23:08:45.772515 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:45.772494 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 02 23:08:45.864082 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:45.864052 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98b45909-a769-47b6-91d9-59b8be86f421-serving-certs-ca-bundle\") pod \"telemeter-client-6744645b9d-jldvn\" (UID: \"98b45909-a769-47b6-91d9-59b8be86f421\") " pod="openshift-monitoring/telemeter-client-6744645b9d-jldvn" Jul 02 23:08:45.864252 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:45.864093 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/98b45909-a769-47b6-91d9-59b8be86f421-telemeter-client-tls\") pod \"telemeter-client-6744645b9d-jldvn\" (UID: \"98b45909-a769-47b6-91d9-59b8be86f421\") " pod="openshift-monitoring/telemeter-client-6744645b9d-jldvn" Jul 02 23:08:45.864252 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:45.864126 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/98b45909-a769-47b6-91d9-59b8be86f421-federate-client-tls\") pod \"telemeter-client-6744645b9d-jldvn\" (UID: \"98b45909-a769-47b6-91d9-59b8be86f421\") " pod="openshift-monitoring/telemeter-client-6744645b9d-jldvn" Jul 02 23:08:45.864252 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:45.864210 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/98b45909-a769-47b6-91d9-59b8be86f421-secret-telemeter-client\") pod \"telemeter-client-6744645b9d-jldvn\" (UID: \"98b45909-a769-47b6-91d9-59b8be86f421\") " pod="openshift-monitoring/telemeter-client-6744645b9d-jldvn" Jul 02 23:08:45.864252 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:45.864246 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98b45909-a769-47b6-91d9-59b8be86f421-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6744645b9d-jldvn\" (UID: \"98b45909-a769-47b6-91d9-59b8be86f421\") " pod="openshift-monitoring/telemeter-client-6744645b9d-jldvn" Jul 02 23:08:45.864415 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:45.864264 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bgpnj\" (UniqueName: \"kubernetes.io/projected/98b45909-a769-47b6-91d9-59b8be86f421-kube-api-access-bgpnj\") pod \"telemeter-client-6744645b9d-jldvn\" (UID: \"98b45909-a769-47b6-91d9-59b8be86f421\") " pod="openshift-monitoring/telemeter-client-6744645b9d-jldvn" Jul 02 23:08:45.864415 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:45.864302 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/98b45909-a769-47b6-91d9-59b8be86f421-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6744645b9d-jldvn\" (UID: \"98b45909-a769-47b6-91d9-59b8be86f421\") " pod="openshift-monitoring/telemeter-client-6744645b9d-jldvn" Jul 02 23:08:45.864415 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:45.864321 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/98b45909-a769-47b6-91d9-59b8be86f421-metrics-client-ca\") pod \"telemeter-client-6744645b9d-jldvn\" (UID: \"98b45909-a769-47b6-91d9-59b8be86f421\") " pod="openshift-monitoring/telemeter-client-6744645b9d-jldvn" Jul 02 23:08:45.965418 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:45.965375 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/98b45909-a769-47b6-91d9-59b8be86f421-federate-client-tls\") pod \"telemeter-client-6744645b9d-jldvn\" (UID: \"98b45909-a769-47b6-91d9-59b8be86f421\") " pod="openshift-monitoring/telemeter-client-6744645b9d-jldvn" Jul 02 23:08:45.965601 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:45.965436 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/98b45909-a769-47b6-91d9-59b8be86f421-secret-telemeter-client\") pod \"telemeter-client-6744645b9d-jldvn\" (UID: \"98b45909-a769-47b6-91d9-59b8be86f421\") " pod="openshift-monitoring/telemeter-client-6744645b9d-jldvn" Jul 02 23:08:45.965601 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:45.965470 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98b45909-a769-47b6-91d9-59b8be86f421-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6744645b9d-jldvn\" (UID: \"98b45909-a769-47b6-91d9-59b8be86f421\") " pod="openshift-monitoring/telemeter-client-6744645b9d-jldvn" Jul 02 23:08:45.965601 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:45.965492 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bgpnj\" (UniqueName: \"kubernetes.io/projected/98b45909-a769-47b6-91d9-59b8be86f421-kube-api-access-bgpnj\") pod \"telemeter-client-6744645b9d-jldvn\" (UID: \"98b45909-a769-47b6-91d9-59b8be86f421\") " pod="openshift-monitoring/telemeter-client-6744645b9d-jldvn" Jul 02 23:08:45.965601 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:45.965547 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/98b45909-a769-47b6-91d9-59b8be86f421-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6744645b9d-jldvn\" (UID: \"98b45909-a769-47b6-91d9-59b8be86f421\") " pod="openshift-monitoring/telemeter-client-6744645b9d-jldvn" Jul 02 23:08:45.965601 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:45.965575 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/98b45909-a769-47b6-91d9-59b8be86f421-metrics-client-ca\") pod \"telemeter-client-6744645b9d-jldvn\" (UID: \"98b45909-a769-47b6-91d9-59b8be86f421\") " pod="openshift-monitoring/telemeter-client-6744645b9d-jldvn" Jul 02 23:08:45.965892 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:45.965631 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98b45909-a769-47b6-91d9-59b8be86f421-serving-certs-ca-bundle\") pod \"telemeter-client-6744645b9d-jldvn\" (UID: \"98b45909-a769-47b6-91d9-59b8be86f421\") " pod="openshift-monitoring/telemeter-client-6744645b9d-jldvn" Jul 02 23:08:45.965892 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:45.965666 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/98b45909-a769-47b6-91d9-59b8be86f421-telemeter-client-tls\") pod \"telemeter-client-6744645b9d-jldvn\" (UID: \"98b45909-a769-47b6-91d9-59b8be86f421\") " pod="openshift-monitoring/telemeter-client-6744645b9d-jldvn" Jul 02 23:08:45.966432 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:45.966404 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/98b45909-a769-47b6-91d9-59b8be86f421-metrics-client-ca\") pod \"telemeter-client-6744645b9d-jldvn\" (UID: \"98b45909-a769-47b6-91d9-59b8be86f421\") " pod="openshift-monitoring/telemeter-client-6744645b9d-jldvn" Jul 02 23:08:45.966670 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:45.966644 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98b45909-a769-47b6-91d9-59b8be86f421-serving-certs-ca-bundle\") pod \"telemeter-client-6744645b9d-jldvn\" (UID: \"98b45909-a769-47b6-91d9-59b8be86f421\") " pod="openshift-monitoring/telemeter-client-6744645b9d-jldvn" Jul 02 23:08:45.967367 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:45.967334 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98b45909-a769-47b6-91d9-59b8be86f421-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6744645b9d-jldvn\" (UID: \"98b45909-a769-47b6-91d9-59b8be86f421\") " pod="openshift-monitoring/telemeter-client-6744645b9d-jldvn" Jul 02 23:08:45.968301 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:45.968276 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/98b45909-a769-47b6-91d9-59b8be86f421-secret-telemeter-client\") pod \"telemeter-client-6744645b9d-jldvn\" (UID: \"98b45909-a769-47b6-91d9-59b8be86f421\") " pod="openshift-monitoring/telemeter-client-6744645b9d-jldvn" Jul 02 23:08:45.968494 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:45.968475 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/98b45909-a769-47b6-91d9-59b8be86f421-federate-client-tls\") pod \"telemeter-client-6744645b9d-jldvn\" (UID: \"98b45909-a769-47b6-91d9-59b8be86f421\") " pod="openshift-monitoring/telemeter-client-6744645b9d-jldvn" Jul 02 23:08:45.968606 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:45.968590 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/98b45909-a769-47b6-91d9-59b8be86f421-telemeter-client-tls\") pod \"telemeter-client-6744645b9d-jldvn\" (UID: \"98b45909-a769-47b6-91d9-59b8be86f421\") " pod="openshift-monitoring/telemeter-client-6744645b9d-jldvn" Jul 02 23:08:45.968643 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:45.968600 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/98b45909-a769-47b6-91d9-59b8be86f421-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6744645b9d-jldvn\" (UID: \"98b45909-a769-47b6-91d9-59b8be86f421\") " pod="openshift-monitoring/telemeter-client-6744645b9d-jldvn" Jul 02 23:08:45.973994 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:45.973975 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bgpnj\" (UniqueName: \"kubernetes.io/projected/98b45909-a769-47b6-91d9-59b8be86f421-kube-api-access-bgpnj\") pod \"telemeter-client-6744645b9d-jldvn\" (UID: \"98b45909-a769-47b6-91d9-59b8be86f421\") " pod="openshift-monitoring/telemeter-client-6744645b9d-jldvn" Jul 02 23:08:46.074147 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:46.074071 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6744645b9d-jldvn" Jul 02 23:08:46.242153 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:46.242123 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6744645b9d-jldvn"] Jul 02 23:08:46.245665 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:08:46.244916 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98b45909_a769_47b6_91d9_59b8be86f421.slice/crio-02fb25a4d4d188df3680a9ad10136f09c934d237fd0dfeb864bc1e384ad78f26 WatchSource:0}: Error finding container 02fb25a4d4d188df3680a9ad10136f09c934d237fd0dfeb864bc1e384ad78f26: Status 404 returned error can't find the container with id 02fb25a4d4d188df3680a9ad10136f09c934d237fd0dfeb864bc1e384ad78f26 Jul 02 23:08:46.494219 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:46.494179 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6744645b9d-jldvn" event={"ID":"98b45909-a769-47b6-91d9-59b8be86f421","Type":"ContainerStarted","Data":"02fb25a4d4d188df3680a9ad10136f09c934d237fd0dfeb864bc1e384ad78f26"} Jul 02 23:08:49.508450 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:49.508414 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6744645b9d-jldvn" event={"ID":"98b45909-a769-47b6-91d9-59b8be86f421","Type":"ContainerStarted","Data":"6e5bf23e37134e194621014b5a74a873787eab0cf415b233937bfe7560baff7e"} Jul 02 23:08:50.515171 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:50.515144 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6744645b9d-jldvn" event={"ID":"98b45909-a769-47b6-91d9-59b8be86f421","Type":"ContainerStarted","Data":"a2f229fafa6edb3e1a2bcb3459c93c8838ec141f579a9a06aa8bcdf48ce2ef94"} Jul 02 23:08:51.521109 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:51.521075 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6744645b9d-jldvn" event={"ID":"98b45909-a769-47b6-91d9-59b8be86f421","Type":"ContainerStarted","Data":"6cbf48ead884ad4e65bc2402f39f3496121f743355f05913d5f122d252c1121c"} Jul 02 23:08:51.541980 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:51.541929 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-6744645b9d-jldvn" podStartSLOduration=2.637125834 podStartE2EDuration="6.541909111s" totalImagesPullingTime="3.904783277s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:08:45 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:08:51.539579296 +0000 UTC m=+108.172620433" watchObservedRunningTime="2026-07-02 23:08:51.541909111 +0000 UTC m=+108.174950274" Jul 02 23:08:59.553208 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:59.553166 2563 generic.go:356] "Generic (PLEG): container finished" podID="e5ac3fd0-32b9-4947-a0a7-ed6d6cd3c8f0" containerID="2ab1604848040622b421ec0f0242d7ccf264cc27ca0dbb15fe02bd3c9e207891" exitCode=0 Jul 02 23:08:59.553675 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:59.553313 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-gz8jl" event={"ID":"e5ac3fd0-32b9-4947-a0a7-ed6d6cd3c8f0","Type":"ContainerDied","Data":"2ab1604848040622b421ec0f0242d7ccf264cc27ca0dbb15fe02bd3c9e207891"} Jul 02 23:08:59.553757 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:08:59.553689 2563 scope.go:117] "RemoveContainer" containerID="2ab1604848040622b421ec0f0242d7ccf264cc27ca0dbb15fe02bd3c9e207891" Jul 02 23:09:00.559982 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:09:00.559946 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-gz8jl" event={"ID":"e5ac3fd0-32b9-4947-a0a7-ed6d6cd3c8f0","Type":"ContainerStarted","Data":"5a4a614638eba17c86b8b1057e3270a59264b2d822d4716cda5d42063545151f"} Jul 02 23:09:00.684658 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:09:00.684629 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6744ddf86c-cr66l_0ca0d12d-9442-4bbb-8c4c-d2e4e513dd18/router/0.log" Jul 02 23:09:00.697006 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:09:00.696979 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-qt5c9_54034b49-3b9e-4f1c-bf13-fd5e97aa8f72/serve-healthcheck-canary/0.log" Jul 02 23:09:02.922970 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:09:02.922930 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5897776f99-njm4b" podUID="de0c5637-bfd8-4989-a233-abc9a7cf1210" containerName="registry" containerID="cri-o://c94816fc195a7c96c153de76c7d2d2c52ced18cdf926e4387a68300a77ea8ecb" gracePeriod=30 Jul 02 23:09:03.166218 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:09:03.166188 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5897776f99-njm4b" Jul 02 23:09:03.309797 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:09:03.309687 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bfc7d\" (UniqueName: \"kubernetes.io/projected/de0c5637-bfd8-4989-a233-abc9a7cf1210-kube-api-access-bfc7d\") pod \"de0c5637-bfd8-4989-a233-abc9a7cf1210\" (UID: \"de0c5637-bfd8-4989-a233-abc9a7cf1210\") " Jul 02 23:09:03.309797 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:09:03.309724 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/de0c5637-bfd8-4989-a233-abc9a7cf1210-installation-pull-secrets\") pod \"de0c5637-bfd8-4989-a233-abc9a7cf1210\" (UID: \"de0c5637-bfd8-4989-a233-abc9a7cf1210\") " Jul 02 23:09:03.309797 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:09:03.309765 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/de0c5637-bfd8-4989-a233-abc9a7cf1210-bound-sa-token\") pod \"de0c5637-bfd8-4989-a233-abc9a7cf1210\" (UID: \"de0c5637-bfd8-4989-a233-abc9a7cf1210\") " Jul 02 23:09:03.310074 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:09:03.309804 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/de0c5637-bfd8-4989-a233-abc9a7cf1210-registry-tls\") pod \"de0c5637-bfd8-4989-a233-abc9a7cf1210\" (UID: \"de0c5637-bfd8-4989-a233-abc9a7cf1210\") " Jul 02 23:09:03.310074 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:09:03.309852 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/de0c5637-bfd8-4989-a233-abc9a7cf1210-trusted-ca\") pod \"de0c5637-bfd8-4989-a233-abc9a7cf1210\" (UID: \"de0c5637-bfd8-4989-a233-abc9a7cf1210\") " Jul 02 23:09:03.310074 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:09:03.309880 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/de0c5637-bfd8-4989-a233-abc9a7cf1210-registry-certificates\") pod \"de0c5637-bfd8-4989-a233-abc9a7cf1210\" (UID: \"de0c5637-bfd8-4989-a233-abc9a7cf1210\") " Jul 02 23:09:03.310074 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:09:03.309915 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/de0c5637-bfd8-4989-a233-abc9a7cf1210-ca-trust-extracted\") pod \"de0c5637-bfd8-4989-a233-abc9a7cf1210\" (UID: \"de0c5637-bfd8-4989-a233-abc9a7cf1210\") " Jul 02 23:09:03.310538 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:09:03.310312 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/de0c5637-bfd8-4989-a233-abc9a7cf1210-image-registry-private-configuration\") pod \"de0c5637-bfd8-4989-a233-abc9a7cf1210\" (UID: \"de0c5637-bfd8-4989-a233-abc9a7cf1210\") " Jul 02 23:09:03.310538 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:09:03.310320 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/de0c5637-bfd8-4989-a233-abc9a7cf1210-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "de0c5637-bfd8-4989-a233-abc9a7cf1210" (UID: "de0c5637-bfd8-4989-a233-abc9a7cf1210"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 23:09:03.310538 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:09:03.310394 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/de0c5637-bfd8-4989-a233-abc9a7cf1210-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "de0c5637-bfd8-4989-a233-abc9a7cf1210" (UID: "de0c5637-bfd8-4989-a233-abc9a7cf1210"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 23:09:03.310806 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:09:03.310625 2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/de0c5637-bfd8-4989-a233-abc9a7cf1210-trusted-ca\") on node \"ip-10-0-131-33.ec2.internal\" DevicePath \"\"" Jul 02 23:09:03.310806 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:09:03.310648 2563 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/de0c5637-bfd8-4989-a233-abc9a7cf1210-registry-certificates\") on node \"ip-10-0-131-33.ec2.internal\" DevicePath \"\"" Jul 02 23:09:03.312711 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:09:03.312683 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/de0c5637-bfd8-4989-a233-abc9a7cf1210-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "de0c5637-bfd8-4989-a233-abc9a7cf1210" (UID: "de0c5637-bfd8-4989-a233-abc9a7cf1210"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 23:09:03.312845 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:09:03.312712 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de0c5637-bfd8-4989-a233-abc9a7cf1210-kube-api-access-bfc7d" (OuterVolumeSpecName: "kube-api-access-bfc7d") pod "de0c5637-bfd8-4989-a233-abc9a7cf1210" (UID: "de0c5637-bfd8-4989-a233-abc9a7cf1210"). InnerVolumeSpecName "kube-api-access-bfc7d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 23:09:03.312845 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:09:03.312794 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/de0c5637-bfd8-4989-a233-abc9a7cf1210-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "de0c5637-bfd8-4989-a233-abc9a7cf1210" (UID: "de0c5637-bfd8-4989-a233-abc9a7cf1210"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 23:09:03.312845 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:09:03.312823 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de0c5637-bfd8-4989-a233-abc9a7cf1210-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "de0c5637-bfd8-4989-a233-abc9a7cf1210" (UID: "de0c5637-bfd8-4989-a233-abc9a7cf1210"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 23:09:03.312986 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:09:03.312900 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de0c5637-bfd8-4989-a233-abc9a7cf1210-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "de0c5637-bfd8-4989-a233-abc9a7cf1210" (UID: "de0c5637-bfd8-4989-a233-abc9a7cf1210"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 23:09:03.322042 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:09:03.322015 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de0c5637-bfd8-4989-a233-abc9a7cf1210-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "de0c5637-bfd8-4989-a233-abc9a7cf1210" (UID: "de0c5637-bfd8-4989-a233-abc9a7cf1210"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 23:09:03.411487 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:09:03.411445 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bfc7d\" (UniqueName: \"kubernetes.io/projected/de0c5637-bfd8-4989-a233-abc9a7cf1210-kube-api-access-bfc7d\") on node \"ip-10-0-131-33.ec2.internal\" DevicePath \"\"" Jul 02 23:09:03.411487 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:09:03.411477 2563 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/de0c5637-bfd8-4989-a233-abc9a7cf1210-installation-pull-secrets\") on node \"ip-10-0-131-33.ec2.internal\" DevicePath \"\"" Jul 02 23:09:03.411487 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:09:03.411487 2563 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/de0c5637-bfd8-4989-a233-abc9a7cf1210-bound-sa-token\") on node \"ip-10-0-131-33.ec2.internal\" DevicePath \"\"" Jul 02 23:09:03.411733 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:09:03.411515 2563 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/de0c5637-bfd8-4989-a233-abc9a7cf1210-registry-tls\") on node \"ip-10-0-131-33.ec2.internal\" DevicePath \"\"" Jul 02 23:09:03.411733 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:09:03.411524 2563 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/de0c5637-bfd8-4989-a233-abc9a7cf1210-ca-trust-extracted\") on node \"ip-10-0-131-33.ec2.internal\" DevicePath \"\"" Jul 02 23:09:03.411733 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:09:03.411537 2563 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/de0c5637-bfd8-4989-a233-abc9a7cf1210-image-registry-private-configuration\") on node \"ip-10-0-131-33.ec2.internal\" DevicePath \"\"" Jul 02 23:09:03.571805 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:09:03.571698 2563 generic.go:356] "Generic (PLEG): container finished" podID="de0c5637-bfd8-4989-a233-abc9a7cf1210" containerID="c94816fc195a7c96c153de76c7d2d2c52ced18cdf926e4387a68300a77ea8ecb" exitCode=0 Jul 02 23:09:03.571805 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:09:03.571764 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5897776f99-njm4b" Jul 02 23:09:03.571805 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:09:03.571779 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5897776f99-njm4b" event={"ID":"de0c5637-bfd8-4989-a233-abc9a7cf1210","Type":"ContainerDied","Data":"c94816fc195a7c96c153de76c7d2d2c52ced18cdf926e4387a68300a77ea8ecb"} Jul 02 23:09:03.572005 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:09:03.571824 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5897776f99-njm4b" event={"ID":"de0c5637-bfd8-4989-a233-abc9a7cf1210","Type":"ContainerDied","Data":"fdd18d76df4bf42715e688e856a211d0d07063c1acda70bf366c3879447ed51b"} Jul 02 23:09:03.572005 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:09:03.571847 2563 scope.go:117] "RemoveContainer" containerID="c94816fc195a7c96c153de76c7d2d2c52ced18cdf926e4387a68300a77ea8ecb" Jul 02 23:09:03.580860 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:09:03.580843 2563 scope.go:117] "RemoveContainer" containerID="c94816fc195a7c96c153de76c7d2d2c52ced18cdf926e4387a68300a77ea8ecb" Jul 02 23:09:03.581133 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:09:03.581115 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c94816fc195a7c96c153de76c7d2d2c52ced18cdf926e4387a68300a77ea8ecb\": container with ID starting with c94816fc195a7c96c153de76c7d2d2c52ced18cdf926e4387a68300a77ea8ecb not found: ID does not exist" containerID="c94816fc195a7c96c153de76c7d2d2c52ced18cdf926e4387a68300a77ea8ecb" Jul 02 23:09:03.581179 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:09:03.581140 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c94816fc195a7c96c153de76c7d2d2c52ced18cdf926e4387a68300a77ea8ecb"} err="failed to get container status \"c94816fc195a7c96c153de76c7d2d2c52ced18cdf926e4387a68300a77ea8ecb\": rpc error: code = NotFound desc = could not find container \"c94816fc195a7c96c153de76c7d2d2c52ced18cdf926e4387a68300a77ea8ecb\": container with ID starting with c94816fc195a7c96c153de76c7d2d2c52ced18cdf926e4387a68300a77ea8ecb not found: ID does not exist" Jul 02 23:09:03.591404 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:09:03.591378 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5897776f99-njm4b"] Jul 02 23:09:03.595325 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:09:03.595303 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5897776f99-njm4b"] Jul 02 23:09:03.847691 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:09:03.847591 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="de0c5637-bfd8-4989-a233-abc9a7cf1210" path="/var/lib/kubelet/pods/de0c5637-bfd8-4989-a233-abc9a7cf1210/volumes" Jul 02 23:09:09.596165 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:09:09.596125 2563 generic.go:356] "Generic (PLEG): container finished" podID="f9de3ef6-3258-45ea-aa0a-79fde3689e1d" containerID="894f8206d9e5a63fdf46ee256fba159be5f72a937cb58d43406b7332b4da2e64" exitCode=0 Jul 02 23:09:09.596569 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:09:09.596195 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-slv8j" event={"ID":"f9de3ef6-3258-45ea-aa0a-79fde3689e1d","Type":"ContainerDied","Data":"894f8206d9e5a63fdf46ee256fba159be5f72a937cb58d43406b7332b4da2e64"} Jul 02 23:09:09.596569 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:09:09.596518 2563 scope.go:117] "RemoveContainer" containerID="894f8206d9e5a63fdf46ee256fba159be5f72a937cb58d43406b7332b4da2e64" Jul 02 23:09:10.602297 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:09:10.602265 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-slv8j" event={"ID":"f9de3ef6-3258-45ea-aa0a-79fde3689e1d","Type":"ContainerStarted","Data":"676ef3dfdf147edcd3ba64e4fae4e2e118cf070762925bd8a16a6db10ca78e0f"} Jul 02 23:09:19.638010 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:09:19.637981 2563 generic.go:356] "Generic (PLEG): container finished" podID="d7c5d79d-d705-4d68-8e46-a31b1603915e" containerID="f685f039b14aa17d7d046ff287b08bf9023352e76b41597f2791c0b2ee6ebcc0" exitCode=0 Jul 02 23:09:19.638364 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:09:19.638061 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-8nlmv" event={"ID":"d7c5d79d-d705-4d68-8e46-a31b1603915e","Type":"ContainerDied","Data":"f685f039b14aa17d7d046ff287b08bf9023352e76b41597f2791c0b2ee6ebcc0"} Jul 02 23:09:19.638364 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:09:19.638355 2563 scope.go:117] "RemoveContainer" containerID="f685f039b14aa17d7d046ff287b08bf9023352e76b41597f2791c0b2ee6ebcc0" Jul 02 23:09:20.643640 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:09:20.643601 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-8nlmv" event={"ID":"d7c5d79d-d705-4d68-8e46-a31b1603915e","Type":"ContainerStarted","Data":"057292bc186d0e33b3faacf57fd525cbeb6b79dd434b16eb2cdbf64a67b049d4"} Jul 02 23:10:02.457060 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:10:02.456984 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 02 23:10:02.457453 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:10:02.457277 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de0c5637-bfd8-4989-a233-abc9a7cf1210" containerName="registry" Jul 02 23:10:02.457453 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:10:02.457287 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="de0c5637-bfd8-4989-a233-abc9a7cf1210" containerName="registry" Jul 02 23:10:02.457453 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:10:02.457354 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="de0c5637-bfd8-4989-a233-abc9a7cf1210" containerName="registry" Jul 02 23:10:02.460311 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:10:02.460293 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 02 23:10:02.462725 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:10:02.462703 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 02 23:10:02.462867 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:10:02.462726 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 02 23:10:02.462867 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:10:02.462709 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 02 23:10:02.462982 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:10:02.462966 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 02 23:10:02.463177 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:10:02.463164 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 02 23:10:02.463402 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:10:02.463387 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 02 23:10:02.463483 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:10:02.463460 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 02 23:10:02.463483 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:10:02.463474 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 02 23:10:02.463796 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:10:02.463781 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-rs45x\"" Jul 02 23:10:02.468887 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:10:02.468869 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 02 23:10:02.472981 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:10:02.472958 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 02 23:10:02.566879 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:10:02.566840 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/238ac15d-89c2-4729-8c1b-5ab92f49cbe0-config-out\") pod \"alertmanager-main-0\" (UID: \"238ac15d-89c2-4729-8c1b-5ab92f49cbe0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 23:10:02.566879 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:10:02.566878 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/238ac15d-89c2-4729-8c1b-5ab92f49cbe0-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"238ac15d-89c2-4729-8c1b-5ab92f49cbe0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 23:10:02.567098 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:10:02.566898 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/238ac15d-89c2-4729-8c1b-5ab92f49cbe0-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"238ac15d-89c2-4729-8c1b-5ab92f49cbe0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 23:10:02.567098 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:10:02.566981 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/238ac15d-89c2-4729-8c1b-5ab92f49cbe0-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"238ac15d-89c2-4729-8c1b-5ab92f49cbe0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 23:10:02.567098 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:10:02.567009 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/238ac15d-89c2-4729-8c1b-5ab92f49cbe0-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"238ac15d-89c2-4729-8c1b-5ab92f49cbe0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 23:10:02.567098 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:10:02.567050 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/238ac15d-89c2-4729-8c1b-5ab92f49cbe0-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"238ac15d-89c2-4729-8c1b-5ab92f49cbe0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 23:10:02.567098 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:10:02.567073 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/238ac15d-89c2-4729-8c1b-5ab92f49cbe0-config-volume\") pod \"alertmanager-main-0\" (UID: \"238ac15d-89c2-4729-8c1b-5ab92f49cbe0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 23:10:02.567098 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:10:02.567096 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/238ac15d-89c2-4729-8c1b-5ab92f49cbe0-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"238ac15d-89c2-4729-8c1b-5ab92f49cbe0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 23:10:02.567292 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:10:02.567117 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/238ac15d-89c2-4729-8c1b-5ab92f49cbe0-web-config\") pod \"alertmanager-main-0\" (UID: \"238ac15d-89c2-4729-8c1b-5ab92f49cbe0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 23:10:02.567292 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:10:02.567131 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/238ac15d-89c2-4729-8c1b-5ab92f49cbe0-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"238ac15d-89c2-4729-8c1b-5ab92f49cbe0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 23:10:02.567292 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:10:02.567151 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/238ac15d-89c2-4729-8c1b-5ab92f49cbe0-tls-assets\") pod \"alertmanager-main-0\" (UID: \"238ac15d-89c2-4729-8c1b-5ab92f49cbe0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 23:10:02.567292 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:10:02.567185 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/238ac15d-89c2-4729-8c1b-5ab92f49cbe0-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"238ac15d-89c2-4729-8c1b-5ab92f49cbe0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 23:10:02.567292 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:10:02.567214 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fk7fr\" (UniqueName: \"kubernetes.io/projected/238ac15d-89c2-4729-8c1b-5ab92f49cbe0-kube-api-access-fk7fr\") pod \"alertmanager-main-0\" (UID: \"238ac15d-89c2-4729-8c1b-5ab92f49cbe0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 23:10:02.668036 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:10:02.667995 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/238ac15d-89c2-4729-8c1b-5ab92f49cbe0-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"238ac15d-89c2-4729-8c1b-5ab92f49cbe0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 23:10:02.668036 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:10:02.668044 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/238ac15d-89c2-4729-8c1b-5ab92f49cbe0-config-volume\") pod \"alertmanager-main-0\" (UID: \"238ac15d-89c2-4729-8c1b-5ab92f49cbe0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 23:10:02.668281 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:10:02.668062 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/238ac15d-89c2-4729-8c1b-5ab92f49cbe0-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"238ac15d-89c2-4729-8c1b-5ab92f49cbe0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 23:10:02.668281 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:10:02.668080 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/238ac15d-89c2-4729-8c1b-5ab92f49cbe0-web-config\") pod \"alertmanager-main-0\" (UID: \"238ac15d-89c2-4729-8c1b-5ab92f49cbe0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 23:10:02.668281 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:10:02.668099 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/238ac15d-89c2-4729-8c1b-5ab92f49cbe0-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"238ac15d-89c2-4729-8c1b-5ab92f49cbe0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 23:10:02.668281 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:10:02.668127 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/238ac15d-89c2-4729-8c1b-5ab92f49cbe0-tls-assets\") pod \"alertmanager-main-0\" (UID: \"238ac15d-89c2-4729-8c1b-5ab92f49cbe0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 23:10:02.668281 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:10:02.668155 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/238ac15d-89c2-4729-8c1b-5ab92f49cbe0-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"238ac15d-89c2-4729-8c1b-5ab92f49cbe0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 23:10:02.668281 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:10:02.668199 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fk7fr\" (UniqueName: \"kubernetes.io/projected/238ac15d-89c2-4729-8c1b-5ab92f49cbe0-kube-api-access-fk7fr\") pod \"alertmanager-main-0\" (UID: \"238ac15d-89c2-4729-8c1b-5ab92f49cbe0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 23:10:02.668584 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:10:02.668273 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/238ac15d-89c2-4729-8c1b-5ab92f49cbe0-config-out\") pod \"alertmanager-main-0\" (UID: \"238ac15d-89c2-4729-8c1b-5ab92f49cbe0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 23:10:02.668584 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:10:02.668321 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/238ac15d-89c2-4729-8c1b-5ab92f49cbe0-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"238ac15d-89c2-4729-8c1b-5ab92f49cbe0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 23:10:02.668584 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:10:02.668351 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/238ac15d-89c2-4729-8c1b-5ab92f49cbe0-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"238ac15d-89c2-4729-8c1b-5ab92f49cbe0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 23:10:02.668584 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:10:02.668395 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/238ac15d-89c2-4729-8c1b-5ab92f49cbe0-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"238ac15d-89c2-4729-8c1b-5ab92f49cbe0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 23:10:02.668584 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:10:02.668439 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/238ac15d-89c2-4729-8c1b-5ab92f49cbe0-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"238ac15d-89c2-4729-8c1b-5ab92f49cbe0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 23:10:02.669231 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:10:02.669162 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/238ac15d-89c2-4729-8c1b-5ab92f49cbe0-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"238ac15d-89c2-4729-8c1b-5ab92f49cbe0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 23:10:02.669231 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:10:02.669273 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/238ac15d-89c2-4729-8c1b-5ab92f49cbe0-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"238ac15d-89c2-4729-8c1b-5ab92f49cbe0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 23:10:02.669865 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:10:02.669523 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/238ac15d-89c2-4729-8c1b-5ab92f49cbe0-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"238ac15d-89c2-4729-8c1b-5ab92f49cbe0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 23:10:02.671547 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:10:02.671464 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/238ac15d-89c2-4729-8c1b-5ab92f49cbe0-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"238ac15d-89c2-4729-8c1b-5ab92f49cbe0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 23:10:02.671547 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:10:02.671529 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/238ac15d-89c2-4729-8c1b-5ab92f49cbe0-web-config\") pod \"alertmanager-main-0\" (UID: \"238ac15d-89c2-4729-8c1b-5ab92f49cbe0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 23:10:02.671703 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:10:02.671633 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/238ac15d-89c2-4729-8c1b-5ab92f49cbe0-config-volume\") pod \"alertmanager-main-0\" (UID: \"238ac15d-89c2-4729-8c1b-5ab92f49cbe0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 23:10:02.671703 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:10:02.671664 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/238ac15d-89c2-4729-8c1b-5ab92f49cbe0-config-out\") pod \"alertmanager-main-0\" (UID: \"238ac15d-89c2-4729-8c1b-5ab92f49cbe0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 23:10:02.672120 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:10:02.672096 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/238ac15d-89c2-4729-8c1b-5ab92f49cbe0-tls-assets\") pod \"alertmanager-main-0\" (UID: \"238ac15d-89c2-4729-8c1b-5ab92f49cbe0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 23:10:02.672208 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:10:02.672185 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/238ac15d-89c2-4729-8c1b-5ab92f49cbe0-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"238ac15d-89c2-4729-8c1b-5ab92f49cbe0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 23:10:02.672264 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:10:02.672231 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/238ac15d-89c2-4729-8c1b-5ab92f49cbe0-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"238ac15d-89c2-4729-8c1b-5ab92f49cbe0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 23:10:02.672555 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:10:02.672531 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/238ac15d-89c2-4729-8c1b-5ab92f49cbe0-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"238ac15d-89c2-4729-8c1b-5ab92f49cbe0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 23:10:02.673570 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:10:02.673552 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/238ac15d-89c2-4729-8c1b-5ab92f49cbe0-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"238ac15d-89c2-4729-8c1b-5ab92f49cbe0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 23:10:02.677010 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:10:02.676986 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fk7fr\" (UniqueName: \"kubernetes.io/projected/238ac15d-89c2-4729-8c1b-5ab92f49cbe0-kube-api-access-fk7fr\") pod \"alertmanager-main-0\" (UID: \"238ac15d-89c2-4729-8c1b-5ab92f49cbe0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 23:10:02.770006 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:10:02.769922 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 02 23:10:02.910171 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:10:02.910139 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 02 23:10:02.912939 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:10:02.912913 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod238ac15d_89c2_4729_8c1b_5ab92f49cbe0.slice/crio-33e4e9b7b8ffb5867a93db058c4db65c88e7cc43bb967e10b65707d49606ea6d WatchSource:0}: Error finding container 33e4e9b7b8ffb5867a93db058c4db65c88e7cc43bb967e10b65707d49606ea6d: Status 404 returned error can't find the container with id 33e4e9b7b8ffb5867a93db058c4db65c88e7cc43bb967e10b65707d49606ea6d Jul 02 23:10:03.811411 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:10:03.811378 2563 generic.go:356] "Generic (PLEG): container finished" podID="238ac15d-89c2-4729-8c1b-5ab92f49cbe0" containerID="77760e255af5e12fb904667e4dd4ad3935530d52d079529451d511059e4b5958" exitCode=0 Jul 02 23:10:03.811828 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:10:03.811464 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"238ac15d-89c2-4729-8c1b-5ab92f49cbe0","Type":"ContainerDied","Data":"77760e255af5e12fb904667e4dd4ad3935530d52d079529451d511059e4b5958"} Jul 02 23:10:03.811828 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:10:03.811562 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"238ac15d-89c2-4729-8c1b-5ab92f49cbe0","Type":"ContainerStarted","Data":"33e4e9b7b8ffb5867a93db058c4db65c88e7cc43bb967e10b65707d49606ea6d"} Jul 02 23:10:05.824074 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:10:05.824038 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"238ac15d-89c2-4729-8c1b-5ab92f49cbe0","Type":"ContainerStarted","Data":"27b44965aff06dc20395df752a167f70e16b66407c061326c9b5967f6b220ed0"} Jul 02 23:10:05.824431 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:10:05.824131 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"238ac15d-89c2-4729-8c1b-5ab92f49cbe0","Type":"ContainerStarted","Data":"355e0dfc27c7eba5c08a5f45d0849d8aba0664260ace10a8203a895acc923f41"} Jul 02 23:10:05.824431 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:10:05.824156 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"238ac15d-89c2-4729-8c1b-5ab92f49cbe0","Type":"ContainerStarted","Data":"d0912c4254a014a526b0248a2f2e3f90a246ae89083d5a32400e73fbe76b5052"} Jul 02 23:10:05.824431 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:10:05.824183 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"238ac15d-89c2-4729-8c1b-5ab92f49cbe0","Type":"ContainerStarted","Data":"f2478244b2163d2440890f194b4fa5a393505967d1175579224dea8538120867"} Jul 02 23:10:05.824431 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:10:05.824206 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"238ac15d-89c2-4729-8c1b-5ab92f49cbe0","Type":"ContainerStarted","Data":"3b1c6c4150b44895b354a19e0611aa0588842d254191a8c2c1ffeb7fb328bf67"} Jul 02 23:10:06.831486 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:10:06.831450 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"238ac15d-89c2-4729-8c1b-5ab92f49cbe0","Type":"ContainerStarted","Data":"5f30d20300562599147918b052623c70b201ec8d27bfd7cb485357f555fe39f3"} Jul 02 23:10:06.858101 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:10:06.858050 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.285216286 podStartE2EDuration="4.858032536s" totalImagesPullingTime="2.552755914s" totalInitContainerRuntime="20.060336ms" isStatefulPod=false podCreationTimestamp="2026-07-02 23:10:02 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:10:06.857202325 +0000 UTC m=+183.490243503" watchObservedRunningTime="2026-07-02 23:10:06.858032536 +0000 UTC m=+183.491073679" Jul 02 23:10:47.841754 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:10:47.841712 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bwv4h"] Jul 02 23:10:47.846715 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:10:47.846692 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bwv4h" Jul 02 23:10:47.849122 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:10:47.849104 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 02 23:10:47.850013 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:10:47.849985 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-g8qqh\"" Jul 02 23:10:47.850142 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:10:47.849993 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 02 23:10:47.853849 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:10:47.853825 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bwv4h"] Jul 02 23:10:47.935550 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:10:47.935510 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c811b709-5742-475b-95ed-d45664dc4d13-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bwv4h\" (UID: \"c811b709-5742-475b-95ed-d45664dc4d13\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bwv4h" Jul 02 23:10:47.935724 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:10:47.935623 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-flx8j\" (UniqueName: \"kubernetes.io/projected/c811b709-5742-475b-95ed-d45664dc4d13-kube-api-access-flx8j\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bwv4h\" (UID: \"c811b709-5742-475b-95ed-d45664dc4d13\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bwv4h" Jul 02 23:10:47.935816 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:10:47.935719 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c811b709-5742-475b-95ed-d45664dc4d13-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bwv4h\" (UID: \"c811b709-5742-475b-95ed-d45664dc4d13\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bwv4h" Jul 02 23:10:48.036943 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:10:48.036908 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c811b709-5742-475b-95ed-d45664dc4d13-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bwv4h\" (UID: \"c811b709-5742-475b-95ed-d45664dc4d13\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bwv4h" Jul 02 23:10:48.037115 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:10:48.036967 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c811b709-5742-475b-95ed-d45664dc4d13-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bwv4h\" (UID: \"c811b709-5742-475b-95ed-d45664dc4d13\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bwv4h" Jul 02 23:10:48.037115 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:10:48.037000 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-flx8j\" (UniqueName: \"kubernetes.io/projected/c811b709-5742-475b-95ed-d45664dc4d13-kube-api-access-flx8j\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bwv4h\" (UID: \"c811b709-5742-475b-95ed-d45664dc4d13\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bwv4h" Jul 02 23:10:48.037353 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:10:48.037334 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c811b709-5742-475b-95ed-d45664dc4d13-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bwv4h\" (UID: \"c811b709-5742-475b-95ed-d45664dc4d13\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bwv4h" Jul 02 23:10:48.037389 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:10:48.037358 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c811b709-5742-475b-95ed-d45664dc4d13-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bwv4h\" (UID: \"c811b709-5742-475b-95ed-d45664dc4d13\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bwv4h" Jul 02 23:10:48.045662 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:10:48.045631 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-flx8j\" (UniqueName: \"kubernetes.io/projected/c811b709-5742-475b-95ed-d45664dc4d13-kube-api-access-flx8j\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bwv4h\" (UID: \"c811b709-5742-475b-95ed-d45664dc4d13\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bwv4h" Jul 02 23:10:48.158112 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:10:48.158080 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bwv4h" Jul 02 23:10:48.291638 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:10:48.291613 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bwv4h"] Jul 02 23:10:48.294270 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:10:48.294241 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc811b709_5742_475b_95ed_d45664dc4d13.slice/crio-3f82c3e98cb9162c7a648973a5dbc4f1ba9e2d326f4ff210ef3f4cadc220f106 WatchSource:0}: Error finding container 3f82c3e98cb9162c7a648973a5dbc4f1ba9e2d326f4ff210ef3f4cadc220f106: Status 404 returned error can't find the container with id 3f82c3e98cb9162c7a648973a5dbc4f1ba9e2d326f4ff210ef3f4cadc220f106 Jul 02 23:10:48.997842 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:10:48.997773 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bwv4h" event={"ID":"c811b709-5742-475b-95ed-d45664dc4d13","Type":"ContainerStarted","Data":"3f82c3e98cb9162c7a648973a5dbc4f1ba9e2d326f4ff210ef3f4cadc220f106"} Jul 02 23:10:55.025103 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:10:55.025019 2563 generic.go:356] "Generic (PLEG): container finished" podID="c811b709-5742-475b-95ed-d45664dc4d13" containerID="006800666e069ec538facd70b81836fc6a14a40b067f7570bdfa22921133b84d" exitCode=0 Jul 02 23:10:55.025103 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:10:55.025063 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bwv4h" event={"ID":"c811b709-5742-475b-95ed-d45664dc4d13","Type":"ContainerDied","Data":"006800666e069ec538facd70b81836fc6a14a40b067f7570bdfa22921133b84d"} Jul 02 23:10:57.035941 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:10:57.035898 2563 generic.go:356] "Generic (PLEG): container finished" podID="c811b709-5742-475b-95ed-d45664dc4d13" containerID="49cf76b600a362d33b1d7571c5669dc142b6eb5c40d74bdd39fa925a20929eb2" exitCode=0 Jul 02 23:10:57.036398 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:10:57.035963 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bwv4h" event={"ID":"c811b709-5742-475b-95ed-d45664dc4d13","Type":"ContainerDied","Data":"49cf76b600a362d33b1d7571c5669dc142b6eb5c40d74bdd39fa925a20929eb2"} Jul 02 23:11:04.068134 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:04.068052 2563 generic.go:356] "Generic (PLEG): container finished" podID="c811b709-5742-475b-95ed-d45664dc4d13" containerID="af16e949d6902795bd74ca721b5543d3e7d16dc48cb1db3a75b6421483ec3178" exitCode=0 Jul 02 23:11:04.068458 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:04.068143 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bwv4h" event={"ID":"c811b709-5742-475b-95ed-d45664dc4d13","Type":"ContainerDied","Data":"af16e949d6902795bd74ca721b5543d3e7d16dc48cb1db3a75b6421483ec3178"} Jul 02 23:11:05.193473 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:05.193447 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bwv4h" Jul 02 23:11:05.294404 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:05.294370 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-flx8j\" (UniqueName: \"kubernetes.io/projected/c811b709-5742-475b-95ed-d45664dc4d13-kube-api-access-flx8j\") pod \"c811b709-5742-475b-95ed-d45664dc4d13\" (UID: \"c811b709-5742-475b-95ed-d45664dc4d13\") " Jul 02 23:11:05.294582 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:05.294432 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c811b709-5742-475b-95ed-d45664dc4d13-bundle\") pod \"c811b709-5742-475b-95ed-d45664dc4d13\" (UID: \"c811b709-5742-475b-95ed-d45664dc4d13\") " Jul 02 23:11:05.294582 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:05.294465 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c811b709-5742-475b-95ed-d45664dc4d13-util\") pod \"c811b709-5742-475b-95ed-d45664dc4d13\" (UID: \"c811b709-5742-475b-95ed-d45664dc4d13\") " Jul 02 23:11:05.295115 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:05.295082 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c811b709-5742-475b-95ed-d45664dc4d13-bundle" (OuterVolumeSpecName: "bundle") pod "c811b709-5742-475b-95ed-d45664dc4d13" (UID: "c811b709-5742-475b-95ed-d45664dc4d13"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 23:11:05.296689 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:05.296668 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c811b709-5742-475b-95ed-d45664dc4d13-kube-api-access-flx8j" (OuterVolumeSpecName: "kube-api-access-flx8j") pod "c811b709-5742-475b-95ed-d45664dc4d13" (UID: "c811b709-5742-475b-95ed-d45664dc4d13"). InnerVolumeSpecName "kube-api-access-flx8j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 23:11:05.299304 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:05.299279 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c811b709-5742-475b-95ed-d45664dc4d13-util" (OuterVolumeSpecName: "util") pod "c811b709-5742-475b-95ed-d45664dc4d13" (UID: "c811b709-5742-475b-95ed-d45664dc4d13"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 23:11:05.395417 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:05.395377 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-flx8j\" (UniqueName: \"kubernetes.io/projected/c811b709-5742-475b-95ed-d45664dc4d13-kube-api-access-flx8j\") on node \"ip-10-0-131-33.ec2.internal\" DevicePath \"\"" Jul 02 23:11:05.395558 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:05.395438 2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c811b709-5742-475b-95ed-d45664dc4d13-bundle\") on node \"ip-10-0-131-33.ec2.internal\" DevicePath \"\"" Jul 02 23:11:05.395558 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:05.395449 2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c811b709-5742-475b-95ed-d45664dc4d13-util\") on node \"ip-10-0-131-33.ec2.internal\" DevicePath \"\"" Jul 02 23:11:06.077639 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:06.077611 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bwv4h" event={"ID":"c811b709-5742-475b-95ed-d45664dc4d13","Type":"ContainerDied","Data":"3f82c3e98cb9162c7a648973a5dbc4f1ba9e2d326f4ff210ef3f4cadc220f106"} Jul 02 23:11:06.077639 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:06.077643 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bwv4h" Jul 02 23:11:06.077868 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:06.077657 2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3f82c3e98cb9162c7a648973a5dbc4f1ba9e2d326f4ff210ef3f4cadc220f106" Jul 02 23:11:10.792272 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:10.792234 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4t4qh"] Jul 02 23:11:10.792729 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:10.792551 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c811b709-5742-475b-95ed-d45664dc4d13" containerName="extract" Jul 02 23:11:10.792729 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:10.792562 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="c811b709-5742-475b-95ed-d45664dc4d13" containerName="extract" Jul 02 23:11:10.792729 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:10.792570 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c811b709-5742-475b-95ed-d45664dc4d13" containerName="util" Jul 02 23:11:10.792729 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:10.792575 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="c811b709-5742-475b-95ed-d45664dc4d13" containerName="util" Jul 02 23:11:10.792729 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:10.792582 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c811b709-5742-475b-95ed-d45664dc4d13" containerName="pull" Jul 02 23:11:10.792729 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:10.792588 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="c811b709-5742-475b-95ed-d45664dc4d13" containerName="pull" Jul 02 23:11:10.792729 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:10.792637 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="c811b709-5742-475b-95ed-d45664dc4d13" containerName="extract" Jul 02 23:11:10.839380 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:10.839347 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4t4qh"] Jul 02 23:11:10.839537 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:10.839437 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4t4qh" Jul 02 23:11:10.842101 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:10.842079 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-ldqkh\"" Jul 02 23:11:10.842215 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:10.842079 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 02 23:11:10.842215 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:10.842079 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 02 23:11:10.941010 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:10.940974 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/36e1ccec-f9c6-4c84-a70c-64e4d8e58ad4-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-4t4qh\" (UID: \"36e1ccec-f9c6-4c84-a70c-64e4d8e58ad4\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4t4qh" Jul 02 23:11:10.941163 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:10.941016 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rf98\" (UniqueName: \"kubernetes.io/projected/36e1ccec-f9c6-4c84-a70c-64e4d8e58ad4-kube-api-access-5rf98\") pod \"cert-manager-operator-controller-manager-55c444bf86-4t4qh\" (UID: \"36e1ccec-f9c6-4c84-a70c-64e4d8e58ad4\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4t4qh" Jul 02 23:11:11.041892 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:11.041854 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/36e1ccec-f9c6-4c84-a70c-64e4d8e58ad4-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-4t4qh\" (UID: \"36e1ccec-f9c6-4c84-a70c-64e4d8e58ad4\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4t4qh" Jul 02 23:11:11.042051 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:11.041905 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5rf98\" (UniqueName: \"kubernetes.io/projected/36e1ccec-f9c6-4c84-a70c-64e4d8e58ad4-kube-api-access-5rf98\") pod \"cert-manager-operator-controller-manager-55c444bf86-4t4qh\" (UID: \"36e1ccec-f9c6-4c84-a70c-64e4d8e58ad4\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4t4qh" Jul 02 23:11:11.042184 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:11.042165 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/36e1ccec-f9c6-4c84-a70c-64e4d8e58ad4-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-4t4qh\" (UID: \"36e1ccec-f9c6-4c84-a70c-64e4d8e58ad4\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4t4qh" Jul 02 23:11:11.050081 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:11.050024 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rf98\" (UniqueName: \"kubernetes.io/projected/36e1ccec-f9c6-4c84-a70c-64e4d8e58ad4-kube-api-access-5rf98\") pod \"cert-manager-operator-controller-manager-55c444bf86-4t4qh\" (UID: \"36e1ccec-f9c6-4c84-a70c-64e4d8e58ad4\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4t4qh" Jul 02 23:11:11.148657 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:11.148631 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4t4qh" Jul 02 23:11:11.300267 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:11.300219 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4t4qh"] Jul 02 23:11:11.303234 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:11:11.303204 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36e1ccec_f9c6_4c84_a70c_64e4d8e58ad4.slice/crio-2257e899135ce246b085bff240f125a79b7f6720f2ad3a648c9f07bd99e717ee WatchSource:0}: Error finding container 2257e899135ce246b085bff240f125a79b7f6720f2ad3a648c9f07bd99e717ee: Status 404 returned error can't find the container with id 2257e899135ce246b085bff240f125a79b7f6720f2ad3a648c9f07bd99e717ee Jul 02 23:11:12.104143 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:12.104093 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4t4qh" event={"ID":"36e1ccec-f9c6-4c84-a70c-64e4d8e58ad4","Type":"ContainerStarted","Data":"2257e899135ce246b085bff240f125a79b7f6720f2ad3a648c9f07bd99e717ee"} Jul 02 23:11:14.116092 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:14.116056 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4t4qh" event={"ID":"36e1ccec-f9c6-4c84-a70c-64e4d8e58ad4","Type":"ContainerStarted","Data":"b3c8bf6fda9b11b88b19fcb382cb63b35f9c56a3b86595b84c5d43380ee27362"} Jul 02 23:11:14.137439 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:14.137392 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4t4qh" podStartSLOduration=2.180611032 podStartE2EDuration="4.137377006s" totalImagesPullingTime="1.956765974s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:11:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:11:14.13503386 +0000 UTC m=+250.768075004" watchObservedRunningTime="2026-07-02 23:11:14.137377006 +0000 UTC m=+250.770418148" Jul 02 23:11:14.234956 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:14.234911 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-p6pqj"] Jul 02 23:11:14.255631 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:14.255600 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-p6pqj"] Jul 02 23:11:14.255821 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:14.255694 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-p6pqj" Jul 02 23:11:14.258431 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:14.258406 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-9p8q9\"" Jul 02 23:11:14.258571 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:14.258408 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 02 23:11:14.258571 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:14.258408 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 02 23:11:14.368501 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:14.368406 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c7f69809-843a-4786-9078-2f0134d69807-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-p6pqj\" (UID: \"c7f69809-843a-4786-9078-2f0134d69807\") " pod="cert-manager/cert-manager-webhook-6486ffd997-p6pqj" Jul 02 23:11:14.368501 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:14.368458 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ndgkq\" (UniqueName: \"kubernetes.io/projected/c7f69809-843a-4786-9078-2f0134d69807-kube-api-access-ndgkq\") pod \"cert-manager-webhook-6486ffd997-p6pqj\" (UID: \"c7f69809-843a-4786-9078-2f0134d69807\") " pod="cert-manager/cert-manager-webhook-6486ffd997-p6pqj" Jul 02 23:11:14.469378 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:14.469342 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c7f69809-843a-4786-9078-2f0134d69807-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-p6pqj\" (UID: \"c7f69809-843a-4786-9078-2f0134d69807\") " pod="cert-manager/cert-manager-webhook-6486ffd997-p6pqj" Jul 02 23:11:14.469669 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:14.469412 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ndgkq\" (UniqueName: \"kubernetes.io/projected/c7f69809-843a-4786-9078-2f0134d69807-kube-api-access-ndgkq\") pod \"cert-manager-webhook-6486ffd997-p6pqj\" (UID: \"c7f69809-843a-4786-9078-2f0134d69807\") " pod="cert-manager/cert-manager-webhook-6486ffd997-p6pqj" Jul 02 23:11:14.503322 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:14.503293 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c7f69809-843a-4786-9078-2f0134d69807-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-p6pqj\" (UID: \"c7f69809-843a-4786-9078-2f0134d69807\") " pod="cert-manager/cert-manager-webhook-6486ffd997-p6pqj" Jul 02 23:11:14.507397 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:14.507366 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ndgkq\" (UniqueName: \"kubernetes.io/projected/c7f69809-843a-4786-9078-2f0134d69807-kube-api-access-ndgkq\") pod \"cert-manager-webhook-6486ffd997-p6pqj\" (UID: \"c7f69809-843a-4786-9078-2f0134d69807\") " pod="cert-manager/cert-manager-webhook-6486ffd997-p6pqj" Jul 02 23:11:14.572857 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:14.572825 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-p6pqj" Jul 02 23:11:14.726716 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:14.726681 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-p6pqj"] Jul 02 23:11:14.729634 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:11:14.729607 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc7f69809_843a_4786_9078_2f0134d69807.slice/crio-20785f79ca5f34bc4dc93a3d240280b363f4e5a88fcd2cb32b9cb2b1b8249133 WatchSource:0}: Error finding container 20785f79ca5f34bc4dc93a3d240280b363f4e5a88fcd2cb32b9cb2b1b8249133: Status 404 returned error can't find the container with id 20785f79ca5f34bc4dc93a3d240280b363f4e5a88fcd2cb32b9cb2b1b8249133 Jul 02 23:11:15.121060 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:15.121026 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-p6pqj" event={"ID":"c7f69809-843a-4786-9078-2f0134d69807","Type":"ContainerStarted","Data":"20785f79ca5f34bc4dc93a3d240280b363f4e5a88fcd2cb32b9cb2b1b8249133"} Jul 02 23:11:15.142763 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:15.142714 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmtpj7"] Jul 02 23:11:15.177175 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:15.177146 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmtpj7"] Jul 02 23:11:15.177314 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:15.177241 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmtpj7" Jul 02 23:11:15.179843 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:15.179822 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 02 23:11:15.180678 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:15.180659 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-g8qqh\"" Jul 02 23:11:15.180784 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:15.180697 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 02 23:11:15.377379 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:15.377299 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a7e76909-a277-4fb6-9a43-48248afd3b25-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmtpj7\" (UID: \"a7e76909-a277-4fb6-9a43-48248afd3b25\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmtpj7" Jul 02 23:11:15.377379 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:15.377343 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a7e76909-a277-4fb6-9a43-48248afd3b25-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmtpj7\" (UID: \"a7e76909-a277-4fb6-9a43-48248afd3b25\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmtpj7" Jul 02 23:11:15.377560 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:15.377421 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lvm4z\" (UniqueName: \"kubernetes.io/projected/a7e76909-a277-4fb6-9a43-48248afd3b25-kube-api-access-lvm4z\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmtpj7\" (UID: \"a7e76909-a277-4fb6-9a43-48248afd3b25\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmtpj7" Jul 02 23:11:15.478360 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:15.478331 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a7e76909-a277-4fb6-9a43-48248afd3b25-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmtpj7\" (UID: \"a7e76909-a277-4fb6-9a43-48248afd3b25\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmtpj7" Jul 02 23:11:15.478541 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:15.478386 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lvm4z\" (UniqueName: \"kubernetes.io/projected/a7e76909-a277-4fb6-9a43-48248afd3b25-kube-api-access-lvm4z\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmtpj7\" (UID: \"a7e76909-a277-4fb6-9a43-48248afd3b25\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmtpj7" Jul 02 23:11:15.478541 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:15.478423 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a7e76909-a277-4fb6-9a43-48248afd3b25-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmtpj7\" (UID: \"a7e76909-a277-4fb6-9a43-48248afd3b25\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmtpj7" Jul 02 23:11:15.478807 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:15.478787 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a7e76909-a277-4fb6-9a43-48248afd3b25-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmtpj7\" (UID: \"a7e76909-a277-4fb6-9a43-48248afd3b25\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmtpj7" Jul 02 23:11:15.478878 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:15.478793 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a7e76909-a277-4fb6-9a43-48248afd3b25-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmtpj7\" (UID: \"a7e76909-a277-4fb6-9a43-48248afd3b25\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmtpj7" Jul 02 23:11:15.488106 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:15.488077 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lvm4z\" (UniqueName: \"kubernetes.io/projected/a7e76909-a277-4fb6-9a43-48248afd3b25-kube-api-access-lvm4z\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmtpj7\" (UID: \"a7e76909-a277-4fb6-9a43-48248afd3b25\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmtpj7" Jul 02 23:11:15.786915 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:15.786871 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmtpj7" Jul 02 23:11:15.959950 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:15.959916 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmtpj7"] Jul 02 23:11:15.963721 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:11:15.963686 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7e76909_a277_4fb6_9a43_48248afd3b25.slice/crio-e4771e839bfb43316b07f8f327614bb39e09aef23bf6ae0f65e672c6079fef21 WatchSource:0}: Error finding container e4771e839bfb43316b07f8f327614bb39e09aef23bf6ae0f65e672c6079fef21: Status 404 returned error can't find the container with id e4771e839bfb43316b07f8f327614bb39e09aef23bf6ae0f65e672c6079fef21 Jul 02 23:11:16.128848 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:16.128820 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmtpj7" event={"ID":"a7e76909-a277-4fb6-9a43-48248afd3b25","Type":"ContainerStarted","Data":"c0a793f47abf6756ac972d07e387fec0a990801eeafa1695642b518573d46182"} Jul 02 23:11:16.129242 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:16.128869 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmtpj7" event={"ID":"a7e76909-a277-4fb6-9a43-48248afd3b25","Type":"ContainerStarted","Data":"e4771e839bfb43316b07f8f327614bb39e09aef23bf6ae0f65e672c6079fef21"} Jul 02 23:11:17.136692 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:17.136654 2563 generic.go:356] "Generic (PLEG): container finished" podID="a7e76909-a277-4fb6-9a43-48248afd3b25" containerID="c0a793f47abf6756ac972d07e387fec0a990801eeafa1695642b518573d46182" exitCode=0 Jul 02 23:11:17.137242 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:17.136718 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmtpj7" event={"ID":"a7e76909-a277-4fb6-9a43-48248afd3b25","Type":"ContainerDied","Data":"c0a793f47abf6756ac972d07e387fec0a990801eeafa1695642b518573d46182"} Jul 02 23:11:18.144050 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:18.143968 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-p6pqj" event={"ID":"c7f69809-843a-4786-9078-2f0134d69807","Type":"ContainerStarted","Data":"c04d9c4fd7052c074ddb0864d66514f4746437ee5b4b22d48058411651a44d63"} Jul 02 23:11:18.144050 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:18.144044 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-p6pqj" Jul 02 23:11:18.176776 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:18.176698 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-p6pqj" podStartSLOduration=1.353243604 podStartE2EDuration="4.176677989s" totalImagesPullingTime="2.823434385s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:11:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:11:18.175508777 +0000 UTC m=+254.808549950" watchObservedRunningTime="2026-07-02 23:11:18.176677989 +0000 UTC m=+254.809719136" Jul 02 23:11:20.158086 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:20.158049 2563 generic.go:356] "Generic (PLEG): container finished" podID="a7e76909-a277-4fb6-9a43-48248afd3b25" containerID="b9f0f807b9347c6cdb1d82869a3ae3c9d4dd66fa835d9a466299e1351389c01d" exitCode=0 Jul 02 23:11:20.158562 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:20.158153 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmtpj7" event={"ID":"a7e76909-a277-4fb6-9a43-48248afd3b25","Type":"ContainerDied","Data":"b9f0f807b9347c6cdb1d82869a3ae3c9d4dd66fa835d9a466299e1351389c01d"} Jul 02 23:11:21.165300 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:21.165261 2563 generic.go:356] "Generic (PLEG): container finished" podID="a7e76909-a277-4fb6-9a43-48248afd3b25" containerID="cda10b869317eb47db6a76d3fe86d9f1ac910dcee1d8dc67c06d315818d90f8c" exitCode=0 Jul 02 23:11:21.165700 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:21.165346 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmtpj7" event={"ID":"a7e76909-a277-4fb6-9a43-48248afd3b25","Type":"ContainerDied","Data":"cda10b869317eb47db6a76d3fe86d9f1ac910dcee1d8dc67c06d315818d90f8c"} Jul 02 23:11:22.295440 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:22.295413 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmtpj7" Jul 02 23:11:22.333451 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:22.333419 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a7e76909-a277-4fb6-9a43-48248afd3b25-util\") pod \"a7e76909-a277-4fb6-9a43-48248afd3b25\" (UID: \"a7e76909-a277-4fb6-9a43-48248afd3b25\") " Jul 02 23:11:22.333611 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:22.333494 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lvm4z\" (UniqueName: \"kubernetes.io/projected/a7e76909-a277-4fb6-9a43-48248afd3b25-kube-api-access-lvm4z\") pod \"a7e76909-a277-4fb6-9a43-48248afd3b25\" (UID: \"a7e76909-a277-4fb6-9a43-48248afd3b25\") " Jul 02 23:11:22.333611 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:22.333525 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a7e76909-a277-4fb6-9a43-48248afd3b25-bundle\") pod \"a7e76909-a277-4fb6-9a43-48248afd3b25\" (UID: \"a7e76909-a277-4fb6-9a43-48248afd3b25\") " Jul 02 23:11:22.333978 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:22.333952 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7e76909-a277-4fb6-9a43-48248afd3b25-bundle" (OuterVolumeSpecName: "bundle") pod "a7e76909-a277-4fb6-9a43-48248afd3b25" (UID: "a7e76909-a277-4fb6-9a43-48248afd3b25"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 23:11:22.335697 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:22.335671 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7e76909-a277-4fb6-9a43-48248afd3b25-kube-api-access-lvm4z" (OuterVolumeSpecName: "kube-api-access-lvm4z") pod "a7e76909-a277-4fb6-9a43-48248afd3b25" (UID: "a7e76909-a277-4fb6-9a43-48248afd3b25"). InnerVolumeSpecName "kube-api-access-lvm4z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 23:11:22.337852 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:22.337829 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7e76909-a277-4fb6-9a43-48248afd3b25-util" (OuterVolumeSpecName: "util") pod "a7e76909-a277-4fb6-9a43-48248afd3b25" (UID: "a7e76909-a277-4fb6-9a43-48248afd3b25"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 23:11:22.434164 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:22.434085 2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a7e76909-a277-4fb6-9a43-48248afd3b25-util\") on node \"ip-10-0-131-33.ec2.internal\" DevicePath \"\"" Jul 02 23:11:22.434164 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:22.434109 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lvm4z\" (UniqueName: \"kubernetes.io/projected/a7e76909-a277-4fb6-9a43-48248afd3b25-kube-api-access-lvm4z\") on node \"ip-10-0-131-33.ec2.internal\" DevicePath \"\"" Jul 02 23:11:22.434164 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:22.434120 2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a7e76909-a277-4fb6-9a43-48248afd3b25-bundle\") on node \"ip-10-0-131-33.ec2.internal\" DevicePath \"\"" Jul 02 23:11:23.176641 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:23.176601 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmtpj7" event={"ID":"a7e76909-a277-4fb6-9a43-48248afd3b25","Type":"ContainerDied","Data":"e4771e839bfb43316b07f8f327614bb39e09aef23bf6ae0f65e672c6079fef21"} Jul 02 23:11:23.176641 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:23.176636 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmtpj7" Jul 02 23:11:23.176866 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:23.176649 2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e4771e839bfb43316b07f8f327614bb39e09aef23bf6ae0f65e672c6079fef21" Jul 02 23:11:24.151070 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:24.150992 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-p6pqj" Jul 02 23:11:25.790184 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:25.790148 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-8jpv6"] Jul 02 23:11:25.791366 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:25.791338 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7e76909-a277-4fb6-9a43-48248afd3b25" containerName="util" Jul 02 23:11:25.791496 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:25.791486 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7e76909-a277-4fb6-9a43-48248afd3b25" containerName="util" Jul 02 23:11:25.791607 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:25.791597 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7e76909-a277-4fb6-9a43-48248afd3b25" containerName="extract" Jul 02 23:11:25.791671 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:25.791663 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7e76909-a277-4fb6-9a43-48248afd3b25" containerName="extract" Jul 02 23:11:25.791845 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:25.791833 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7e76909-a277-4fb6-9a43-48248afd3b25" containerName="pull" Jul 02 23:11:25.791935 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:25.791926 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7e76909-a277-4fb6-9a43-48248afd3b25" containerName="pull" Jul 02 23:11:25.792209 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:25.792194 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="a7e76909-a277-4fb6-9a43-48248afd3b25" containerName="extract" Jul 02 23:11:25.794924 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:25.794900 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-8jpv6" Jul 02 23:11:25.797603 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:25.797580 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-98qn2\"" Jul 02 23:11:25.802819 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:25.802798 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-8jpv6"] Jul 02 23:11:25.862805 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:25.862768 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-plp7q\" (UniqueName: \"kubernetes.io/projected/870c399a-0601-42ef-8699-7a67fb202e01-kube-api-access-plp7q\") pod \"cert-manager-55b4d954d5-8jpv6\" (UID: \"870c399a-0601-42ef-8699-7a67fb202e01\") " pod="cert-manager/cert-manager-55b4d954d5-8jpv6" Jul 02 23:11:25.862974 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:25.862811 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/870c399a-0601-42ef-8699-7a67fb202e01-bound-sa-token\") pod \"cert-manager-55b4d954d5-8jpv6\" (UID: \"870c399a-0601-42ef-8699-7a67fb202e01\") " pod="cert-manager/cert-manager-55b4d954d5-8jpv6" Jul 02 23:11:25.964098 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:25.964056 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plp7q\" (UniqueName: \"kubernetes.io/projected/870c399a-0601-42ef-8699-7a67fb202e01-kube-api-access-plp7q\") pod \"cert-manager-55b4d954d5-8jpv6\" (UID: \"870c399a-0601-42ef-8699-7a67fb202e01\") " pod="cert-manager/cert-manager-55b4d954d5-8jpv6" Jul 02 23:11:25.964098 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:25.964102 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/870c399a-0601-42ef-8699-7a67fb202e01-bound-sa-token\") pod \"cert-manager-55b4d954d5-8jpv6\" (UID: \"870c399a-0601-42ef-8699-7a67fb202e01\") " pod="cert-manager/cert-manager-55b4d954d5-8jpv6" Jul 02 23:11:25.972921 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:25.972894 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/870c399a-0601-42ef-8699-7a67fb202e01-bound-sa-token\") pod \"cert-manager-55b4d954d5-8jpv6\" (UID: \"870c399a-0601-42ef-8699-7a67fb202e01\") " pod="cert-manager/cert-manager-55b4d954d5-8jpv6" Jul 02 23:11:25.973052 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:25.973029 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-plp7q\" (UniqueName: \"kubernetes.io/projected/870c399a-0601-42ef-8699-7a67fb202e01-kube-api-access-plp7q\") pod \"cert-manager-55b4d954d5-8jpv6\" (UID: \"870c399a-0601-42ef-8699-7a67fb202e01\") " pod="cert-manager/cert-manager-55b4d954d5-8jpv6" Jul 02 23:11:26.104493 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:26.104405 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-8jpv6" Jul 02 23:11:26.231818 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:26.231794 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-8jpv6"] Jul 02 23:11:26.234456 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:11:26.234419 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod870c399a_0601_42ef_8699_7a67fb202e01.slice/crio-155da836209bc2c0fdd19076cbd0e8a8020257aad745bb3445d74a16a24c95cc WatchSource:0}: Error finding container 155da836209bc2c0fdd19076cbd0e8a8020257aad745bb3445d74a16a24c95cc: Status 404 returned error can't find the container with id 155da836209bc2c0fdd19076cbd0e8a8020257aad745bb3445d74a16a24c95cc Jul 02 23:11:27.198875 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:27.198829 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-8jpv6" event={"ID":"870c399a-0601-42ef-8699-7a67fb202e01","Type":"ContainerStarted","Data":"ff6d72a7c4984a64806ca94b32ef4832247a42ff9873acd6142b5b0546a0292e"} Jul 02 23:11:27.198875 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:27.198877 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-8jpv6" event={"ID":"870c399a-0601-42ef-8699-7a67fb202e01","Type":"ContainerStarted","Data":"155da836209bc2c0fdd19076cbd0e8a8020257aad745bb3445d74a16a24c95cc"} Jul 02 23:11:27.213225 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:27.213178 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-8jpv6" podStartSLOduration=2.213145188 podStartE2EDuration="2.213145188s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:11:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:11:27.212810692 +0000 UTC m=+263.845851835" watchObservedRunningTime="2026-07-02 23:11:27.213145188 +0000 UTC m=+263.846186331" Jul 02 23:11:40.890752 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:40.890696 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afv9gml"] Jul 02 23:11:40.893699 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:40.893676 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afv9gml" Jul 02 23:11:40.896003 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:40.895983 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-g8qqh\"" Jul 02 23:11:40.896003 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:40.895999 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 02 23:11:40.896966 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:40.896951 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 02 23:11:40.901406 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:40.901114 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afv9gml"] Jul 02 23:11:40.998935 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:40.998892 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/811acd62-cdc3-4dc9-a83d-5100c02bb858-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afv9gml\" (UID: \"811acd62-cdc3-4dc9-a83d-5100c02bb858\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afv9gml" Jul 02 23:11:40.999118 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:40.998974 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/811acd62-cdc3-4dc9-a83d-5100c02bb858-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afv9gml\" (UID: \"811acd62-cdc3-4dc9-a83d-5100c02bb858\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afv9gml" Jul 02 23:11:40.999118 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:40.999003 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lrdcx\" (UniqueName: \"kubernetes.io/projected/811acd62-cdc3-4dc9-a83d-5100c02bb858-kube-api-access-lrdcx\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afv9gml\" (UID: \"811acd62-cdc3-4dc9-a83d-5100c02bb858\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afv9gml" Jul 02 23:11:41.100395 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:41.100356 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/811acd62-cdc3-4dc9-a83d-5100c02bb858-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afv9gml\" (UID: \"811acd62-cdc3-4dc9-a83d-5100c02bb858\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afv9gml" Jul 02 23:11:41.100564 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:41.100402 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lrdcx\" (UniqueName: \"kubernetes.io/projected/811acd62-cdc3-4dc9-a83d-5100c02bb858-kube-api-access-lrdcx\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afv9gml\" (UID: \"811acd62-cdc3-4dc9-a83d-5100c02bb858\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afv9gml" Jul 02 23:11:41.100564 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:41.100450 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/811acd62-cdc3-4dc9-a83d-5100c02bb858-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afv9gml\" (UID: \"811acd62-cdc3-4dc9-a83d-5100c02bb858\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afv9gml" Jul 02 23:11:41.100870 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:41.100849 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/811acd62-cdc3-4dc9-a83d-5100c02bb858-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afv9gml\" (UID: \"811acd62-cdc3-4dc9-a83d-5100c02bb858\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afv9gml" Jul 02 23:11:41.100911 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:41.100849 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/811acd62-cdc3-4dc9-a83d-5100c02bb858-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afv9gml\" (UID: \"811acd62-cdc3-4dc9-a83d-5100c02bb858\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afv9gml" Jul 02 23:11:41.109044 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:41.109021 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lrdcx\" (UniqueName: \"kubernetes.io/projected/811acd62-cdc3-4dc9-a83d-5100c02bb858-kube-api-access-lrdcx\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afv9gml\" (UID: \"811acd62-cdc3-4dc9-a83d-5100c02bb858\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afv9gml" Jul 02 23:11:41.204148 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:41.204108 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afv9gml" Jul 02 23:11:41.335494 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:41.335459 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afv9gml"] Jul 02 23:11:41.339126 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:11:41.339086 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod811acd62_cdc3_4dc9_a83d_5100c02bb858.slice/crio-3cd4ce24a727e308a80b3a629655cac2ddf9c7eedcc54bdbcdac592f8cf71966 WatchSource:0}: Error finding container 3cd4ce24a727e308a80b3a629655cac2ddf9c7eedcc54bdbcdac592f8cf71966: Status 404 returned error can't find the container with id 3cd4ce24a727e308a80b3a629655cac2ddf9c7eedcc54bdbcdac592f8cf71966 Jul 02 23:11:42.268466 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:42.268434 2563 generic.go:356] "Generic (PLEG): container finished" podID="811acd62-cdc3-4dc9-a83d-5100c02bb858" containerID="8d34f907d36ab5e1bd03ce0f408a3178c13072a9d095971e00e4707cad13de89" exitCode=0 Jul 02 23:11:42.268876 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:42.268519 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afv9gml" event={"ID":"811acd62-cdc3-4dc9-a83d-5100c02bb858","Type":"ContainerDied","Data":"8d34f907d36ab5e1bd03ce0f408a3178c13072a9d095971e00e4707cad13de89"} Jul 02 23:11:42.268876 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:42.268560 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afv9gml" event={"ID":"811acd62-cdc3-4dc9-a83d-5100c02bb858","Type":"ContainerStarted","Data":"3cd4ce24a727e308a80b3a629655cac2ddf9c7eedcc54bdbcdac592f8cf71966"} Jul 02 23:11:43.274556 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:43.274525 2563 generic.go:356] "Generic (PLEG): container finished" podID="811acd62-cdc3-4dc9-a83d-5100c02bb858" containerID="eb0b049863ac405ec6230ca9a1a481db2d9c846e59b23af37ec61563d28adcd8" exitCode=0 Jul 02 23:11:43.274953 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:43.274582 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afv9gml" event={"ID":"811acd62-cdc3-4dc9-a83d-5100c02bb858","Type":"ContainerDied","Data":"eb0b049863ac405ec6230ca9a1a481db2d9c846e59b23af37ec61563d28adcd8"} Jul 02 23:11:44.281713 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:44.281676 2563 generic.go:356] "Generic (PLEG): container finished" podID="811acd62-cdc3-4dc9-a83d-5100c02bb858" containerID="78e5b1e4d7868d3dbb992d5b62535baaeb50dcc72ff4ae0c7fb5df3214bba728" exitCode=0 Jul 02 23:11:44.282110 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:44.281776 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afv9gml" event={"ID":"811acd62-cdc3-4dc9-a83d-5100c02bb858","Type":"ContainerDied","Data":"78e5b1e4d7868d3dbb992d5b62535baaeb50dcc72ff4ae0c7fb5df3214bba728"} Jul 02 23:11:45.420832 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:45.420808 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afv9gml" Jul 02 23:11:45.538808 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:45.538707 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lrdcx\" (UniqueName: \"kubernetes.io/projected/811acd62-cdc3-4dc9-a83d-5100c02bb858-kube-api-access-lrdcx\") pod \"811acd62-cdc3-4dc9-a83d-5100c02bb858\" (UID: \"811acd62-cdc3-4dc9-a83d-5100c02bb858\") " Jul 02 23:11:45.538808 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:45.538765 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/811acd62-cdc3-4dc9-a83d-5100c02bb858-util\") pod \"811acd62-cdc3-4dc9-a83d-5100c02bb858\" (UID: \"811acd62-cdc3-4dc9-a83d-5100c02bb858\") " Jul 02 23:11:45.538994 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:45.538832 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/811acd62-cdc3-4dc9-a83d-5100c02bb858-bundle\") pod \"811acd62-cdc3-4dc9-a83d-5100c02bb858\" (UID: \"811acd62-cdc3-4dc9-a83d-5100c02bb858\") " Jul 02 23:11:45.539539 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:45.539506 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/811acd62-cdc3-4dc9-a83d-5100c02bb858-bundle" (OuterVolumeSpecName: "bundle") pod "811acd62-cdc3-4dc9-a83d-5100c02bb858" (UID: "811acd62-cdc3-4dc9-a83d-5100c02bb858"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 23:11:45.541009 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:45.540988 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/811acd62-cdc3-4dc9-a83d-5100c02bb858-kube-api-access-lrdcx" (OuterVolumeSpecName: "kube-api-access-lrdcx") pod "811acd62-cdc3-4dc9-a83d-5100c02bb858" (UID: "811acd62-cdc3-4dc9-a83d-5100c02bb858"). InnerVolumeSpecName "kube-api-access-lrdcx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 23:11:45.544523 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:45.544487 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/811acd62-cdc3-4dc9-a83d-5100c02bb858-util" (OuterVolumeSpecName: "util") pod "811acd62-cdc3-4dc9-a83d-5100c02bb858" (UID: "811acd62-cdc3-4dc9-a83d-5100c02bb858"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 23:11:45.639466 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:45.639439 2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/811acd62-cdc3-4dc9-a83d-5100c02bb858-bundle\") on node \"ip-10-0-131-33.ec2.internal\" DevicePath \"\"" Jul 02 23:11:45.639574 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:45.639465 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lrdcx\" (UniqueName: \"kubernetes.io/projected/811acd62-cdc3-4dc9-a83d-5100c02bb858-kube-api-access-lrdcx\") on node \"ip-10-0-131-33.ec2.internal\" DevicePath \"\"" Jul 02 23:11:45.639574 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:45.639481 2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/811acd62-cdc3-4dc9-a83d-5100c02bb858-util\") on node \"ip-10-0-131-33.ec2.internal\" DevicePath \"\"" Jul 02 23:11:46.293176 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:46.293145 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afv9gml" event={"ID":"811acd62-cdc3-4dc9-a83d-5100c02bb858","Type":"ContainerDied","Data":"3cd4ce24a727e308a80b3a629655cac2ddf9c7eedcc54bdbcdac592f8cf71966"} Jul 02 23:11:46.293339 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:46.293196 2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3cd4ce24a727e308a80b3a629655cac2ddf9c7eedcc54bdbcdac592f8cf71966" Jul 02 23:11:46.293339 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:46.293156 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afv9gml" Jul 02 23:11:54.028255 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:54.028226 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-fb7747bfc-hzxw5"] Jul 02 23:11:54.028627 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:54.028564 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="811acd62-cdc3-4dc9-a83d-5100c02bb858" containerName="pull" Jul 02 23:11:54.028627 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:54.028577 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="811acd62-cdc3-4dc9-a83d-5100c02bb858" containerName="pull" Jul 02 23:11:54.028627 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:54.028602 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="811acd62-cdc3-4dc9-a83d-5100c02bb858" containerName="extract" Jul 02 23:11:54.028627 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:54.028609 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="811acd62-cdc3-4dc9-a83d-5100c02bb858" containerName="extract" Jul 02 23:11:54.028627 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:54.028623 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="811acd62-cdc3-4dc9-a83d-5100c02bb858" containerName="util" Jul 02 23:11:54.028627 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:54.028629 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="811acd62-cdc3-4dc9-a83d-5100c02bb858" containerName="util" Jul 02 23:11:54.028827 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:54.028676 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="811acd62-cdc3-4dc9-a83d-5100c02bb858" containerName="extract" Jul 02 23:11:54.031041 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:54.031021 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-fb7747bfc-hzxw5" Jul 02 23:11:54.033520 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:54.033494 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 02 23:11:54.033841 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:54.033828 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-mfznl\"" Jul 02 23:11:54.034008 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:54.033991 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 02 23:11:54.034048 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:54.034028 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 02 23:11:54.034533 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:54.034519 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 02 23:11:54.048193 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:54.048168 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-fb7747bfc-hzxw5"] Jul 02 23:11:54.107554 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:54.107523 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/81ac38f0-bf7c-4459-88f3-1348b39cf316-tmp\") pod \"opendatahub-operator-controller-manager-fb7747bfc-hzxw5\" (UID: \"81ac38f0-bf7c-4459-88f3-1348b39cf316\") " pod="opendatahub/opendatahub-operator-controller-manager-fb7747bfc-hzxw5" Jul 02 23:11:54.107762 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:54.107566 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/81ac38f0-bf7c-4459-88f3-1348b39cf316-manifests\") pod \"opendatahub-operator-controller-manager-fb7747bfc-hzxw5\" (UID: \"81ac38f0-bf7c-4459-88f3-1348b39cf316\") " pod="opendatahub/opendatahub-operator-controller-manager-fb7747bfc-hzxw5" Jul 02 23:11:54.107762 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:54.107597 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/81ac38f0-bf7c-4459-88f3-1348b39cf316-apiservice-cert\") pod \"opendatahub-operator-controller-manager-fb7747bfc-hzxw5\" (UID: \"81ac38f0-bf7c-4459-88f3-1348b39cf316\") " pod="opendatahub/opendatahub-operator-controller-manager-fb7747bfc-hzxw5" Jul 02 23:11:54.107762 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:54.107663 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4szs\" (UniqueName: \"kubernetes.io/projected/81ac38f0-bf7c-4459-88f3-1348b39cf316-kube-api-access-j4szs\") pod \"opendatahub-operator-controller-manager-fb7747bfc-hzxw5\" (UID: \"81ac38f0-bf7c-4459-88f3-1348b39cf316\") " pod="opendatahub/opendatahub-operator-controller-manager-fb7747bfc-hzxw5" Jul 02 23:11:54.107762 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:54.107687 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/81ac38f0-bf7c-4459-88f3-1348b39cf316-webhook-cert\") pod \"opendatahub-operator-controller-manager-fb7747bfc-hzxw5\" (UID: \"81ac38f0-bf7c-4459-88f3-1348b39cf316\") " pod="opendatahub/opendatahub-operator-controller-manager-fb7747bfc-hzxw5" Jul 02 23:11:54.209425 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:54.209381 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/81ac38f0-bf7c-4459-88f3-1348b39cf316-manifests\") pod \"opendatahub-operator-controller-manager-fb7747bfc-hzxw5\" (UID: \"81ac38f0-bf7c-4459-88f3-1348b39cf316\") " pod="opendatahub/opendatahub-operator-controller-manager-fb7747bfc-hzxw5" Jul 02 23:11:54.209625 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:54.209460 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/81ac38f0-bf7c-4459-88f3-1348b39cf316-apiservice-cert\") pod \"opendatahub-operator-controller-manager-fb7747bfc-hzxw5\" (UID: \"81ac38f0-bf7c-4459-88f3-1348b39cf316\") " pod="opendatahub/opendatahub-operator-controller-manager-fb7747bfc-hzxw5" Jul 02 23:11:54.209625 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:54.209521 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4szs\" (UniqueName: \"kubernetes.io/projected/81ac38f0-bf7c-4459-88f3-1348b39cf316-kube-api-access-j4szs\") pod \"opendatahub-operator-controller-manager-fb7747bfc-hzxw5\" (UID: \"81ac38f0-bf7c-4459-88f3-1348b39cf316\") " pod="opendatahub/opendatahub-operator-controller-manager-fb7747bfc-hzxw5" Jul 02 23:11:54.209625 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:54.209554 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/81ac38f0-bf7c-4459-88f3-1348b39cf316-webhook-cert\") pod \"opendatahub-operator-controller-manager-fb7747bfc-hzxw5\" (UID: \"81ac38f0-bf7c-4459-88f3-1348b39cf316\") " pod="opendatahub/opendatahub-operator-controller-manager-fb7747bfc-hzxw5" Jul 02 23:11:54.209810 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:54.209640 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/81ac38f0-bf7c-4459-88f3-1348b39cf316-tmp\") pod \"opendatahub-operator-controller-manager-fb7747bfc-hzxw5\" (UID: \"81ac38f0-bf7c-4459-88f3-1348b39cf316\") " pod="opendatahub/opendatahub-operator-controller-manager-fb7747bfc-hzxw5" Jul 02 23:11:54.213403 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:54.212723 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/81ac38f0-bf7c-4459-88f3-1348b39cf316-tmp\") pod \"opendatahub-operator-controller-manager-fb7747bfc-hzxw5\" (UID: \"81ac38f0-bf7c-4459-88f3-1348b39cf316\") " pod="opendatahub/opendatahub-operator-controller-manager-fb7747bfc-hzxw5" Jul 02 23:11:54.213403 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:54.213038 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/81ac38f0-bf7c-4459-88f3-1348b39cf316-manifests\") pod \"opendatahub-operator-controller-manager-fb7747bfc-hzxw5\" (UID: \"81ac38f0-bf7c-4459-88f3-1348b39cf316\") " pod="opendatahub/opendatahub-operator-controller-manager-fb7747bfc-hzxw5" Jul 02 23:11:54.216260 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:54.216226 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/81ac38f0-bf7c-4459-88f3-1348b39cf316-apiservice-cert\") pod \"opendatahub-operator-controller-manager-fb7747bfc-hzxw5\" (UID: \"81ac38f0-bf7c-4459-88f3-1348b39cf316\") " pod="opendatahub/opendatahub-operator-controller-manager-fb7747bfc-hzxw5" Jul 02 23:11:54.217565 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:54.217542 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/81ac38f0-bf7c-4459-88f3-1348b39cf316-webhook-cert\") pod \"opendatahub-operator-controller-manager-fb7747bfc-hzxw5\" (UID: \"81ac38f0-bf7c-4459-88f3-1348b39cf316\") " pod="opendatahub/opendatahub-operator-controller-manager-fb7747bfc-hzxw5" Jul 02 23:11:54.226891 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:54.226864 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4szs\" (UniqueName: \"kubernetes.io/projected/81ac38f0-bf7c-4459-88f3-1348b39cf316-kube-api-access-j4szs\") pod \"opendatahub-operator-controller-manager-fb7747bfc-hzxw5\" (UID: \"81ac38f0-bf7c-4459-88f3-1348b39cf316\") " pod="opendatahub/opendatahub-operator-controller-manager-fb7747bfc-hzxw5" Jul 02 23:11:54.341894 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:54.341805 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-fb7747bfc-hzxw5" Jul 02 23:11:54.475168 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:54.474138 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-fb7747bfc-hzxw5"] Jul 02 23:11:55.335491 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:55.335453 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-fb7747bfc-hzxw5" event={"ID":"81ac38f0-bf7c-4459-88f3-1348b39cf316","Type":"ContainerStarted","Data":"90dfcd3b43bfd4a6010eb8e6271f78f7dd0b5da86e0c2ccb0d80fed290cd34af"} Jul 02 23:11:58.354032 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:58.353996 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-fb7747bfc-hzxw5" event={"ID":"81ac38f0-bf7c-4459-88f3-1348b39cf316","Type":"ContainerStarted","Data":"4ffc89ca1df4b936ae20c87f63837fe7c3661ab63bcd8732338d74020a62d74c"} Jul 02 23:11:59.360289 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:59.360252 2563 generic.go:356] "Generic (PLEG): container finished" podID="81ac38f0-bf7c-4459-88f3-1348b39cf316" containerID="4ffc89ca1df4b936ae20c87f63837fe7c3661ab63bcd8732338d74020a62d74c" exitCode=0 Jul 02 23:11:59.360730 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:11:59.360322 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-fb7747bfc-hzxw5" event={"ID":"81ac38f0-bf7c-4459-88f3-1348b39cf316","Type":"ContainerDied","Data":"4ffc89ca1df4b936ae20c87f63837fe7c3661ab63bcd8732338d74020a62d74c"} Jul 02 23:12:00.367029 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:12:00.366998 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-fb7747bfc-hzxw5" event={"ID":"81ac38f0-bf7c-4459-88f3-1348b39cf316","Type":"ContainerStarted","Data":"b10d2568f7bd90f3e6b1588ba1eb69c21ff01c3f0688b2f64cad0c14a1168eff"} Jul 02 23:12:00.367418 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:12:00.367119 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-fb7747bfc-hzxw5" Jul 02 23:12:00.389679 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:12:00.389628 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-fb7747bfc-hzxw5" podStartSLOduration=2.095927668 podStartE2EDuration="6.389611655s" totalImagesPullingTime="3.285375612s" totalInitContainerRuntime="1.008308375s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:11:54 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:12:00.38762403 +0000 UTC m=+297.020665168" watchObservedRunningTime="2026-07-02 23:12:00.389611655 +0000 UTC m=+297.022652835" Jul 02 23:12:03.714198 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:12:03.714169 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-wljkx_5d4e781e-d925-477e-98c6-cb41099c6cb0/console-operator/1.log" Jul 02 23:12:03.720663 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:12:03.720637 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hhc6h_f946205c-023a-4a7d-9a6c-c40b23c3b771/ovn-acl-logging/0.log" Jul 02 23:12:03.724421 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:12:03.724400 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-wljkx_5d4e781e-d925-477e-98c6-cb41099c6cb0/console-operator/1.log" Jul 02 23:12:03.725117 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:12:03.725096 2563 kubelet.go:1648] "Image garbage collection succeeded" Jul 02 23:12:03.730088 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:12:03.730071 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hhc6h_f946205c-023a-4a7d-9a6c-c40b23c3b771/ovn-acl-logging/0.log" Jul 02 23:12:11.373666 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:12:11.373634 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-fb7747bfc-hzxw5" Jul 02 23:12:13.840722 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:12:13.840690 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-z79g4"] Jul 02 23:12:13.845598 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:12:13.845578 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-z79g4" Jul 02 23:12:13.852807 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:12:13.852774 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-r2gqc\"" Jul 02 23:12:13.853061 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:12:13.853039 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jul 02 23:12:13.895999 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:12:13.895965 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-z79g4"] Jul 02 23:12:13.972617 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:12:13.972584 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rccp5\" (UniqueName: \"kubernetes.io/projected/b63d08e3-f29e-44c4-96c5-fe7545e75ee1-kube-api-access-rccp5\") pod \"odh-model-controller-7998c67dc4-z79g4\" (UID: \"b63d08e3-f29e-44c4-96c5-fe7545e75ee1\") " pod="opendatahub/odh-model-controller-7998c67dc4-z79g4" Jul 02 23:12:13.972809 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:12:13.972709 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b63d08e3-f29e-44c4-96c5-fe7545e75ee1-cert\") pod \"odh-model-controller-7998c67dc4-z79g4\" (UID: \"b63d08e3-f29e-44c4-96c5-fe7545e75ee1\") " pod="opendatahub/odh-model-controller-7998c67dc4-z79g4" Jul 02 23:12:14.073796 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:12:14.073764 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b63d08e3-f29e-44c4-96c5-fe7545e75ee1-cert\") pod \"odh-model-controller-7998c67dc4-z79g4\" (UID: \"b63d08e3-f29e-44c4-96c5-fe7545e75ee1\") " pod="opendatahub/odh-model-controller-7998c67dc4-z79g4" Jul 02 23:12:14.073968 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:12:14.073814 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rccp5\" (UniqueName: \"kubernetes.io/projected/b63d08e3-f29e-44c4-96c5-fe7545e75ee1-kube-api-access-rccp5\") pod \"odh-model-controller-7998c67dc4-z79g4\" (UID: \"b63d08e3-f29e-44c4-96c5-fe7545e75ee1\") " pod="opendatahub/odh-model-controller-7998c67dc4-z79g4" Jul 02 23:12:14.073968 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:12:14.073912 2563 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jul 02 23:12:14.074087 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:12:14.073994 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b63d08e3-f29e-44c4-96c5-fe7545e75ee1-cert podName:b63d08e3-f29e-44c4-96c5-fe7545e75ee1 nodeName:}" failed. No retries permitted until 2026-07-02 23:12:14.573972873 +0000 UTC m=+311.207014013 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b63d08e3-f29e-44c4-96c5-fe7545e75ee1-cert") pod "odh-model-controller-7998c67dc4-z79g4" (UID: "b63d08e3-f29e-44c4-96c5-fe7545e75ee1") : secret "odh-model-controller-webhook-cert" not found Jul 02 23:12:14.084612 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:12:14.084582 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rccp5\" (UniqueName: \"kubernetes.io/projected/b63d08e3-f29e-44c4-96c5-fe7545e75ee1-kube-api-access-rccp5\") pod \"odh-model-controller-7998c67dc4-z79g4\" (UID: \"b63d08e3-f29e-44c4-96c5-fe7545e75ee1\") " pod="opendatahub/odh-model-controller-7998c67dc4-z79g4" Jul 02 23:12:14.389517 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:12:14.389486 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-675f46f85c-554sp"] Jul 02 23:12:14.392845 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:12:14.392828 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-675f46f85c-554sp" Jul 02 23:12:14.395480 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:12:14.395459 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 02 23:12:14.395623 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:12:14.395510 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 02 23:12:14.395687 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:12:14.395647 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 02 23:12:14.395774 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:12:14.395726 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 02 23:12:14.397235 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:12:14.397215 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 02 23:12:14.397324 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:12:14.397236 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-dx7kz\"" Jul 02 23:12:14.403504 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:12:14.403485 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-675f46f85c-554sp"] Jul 02 23:12:14.578067 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:12:14.578029 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tbkjk\" (UniqueName: \"kubernetes.io/projected/6d73b4a9-a1fb-4f54-bd70-413713f8cb7e-kube-api-access-tbkjk\") pod \"lws-controller-manager-675f46f85c-554sp\" (UID: \"6d73b4a9-a1fb-4f54-bd70-413713f8cb7e\") " pod="openshift-lws-operator/lws-controller-manager-675f46f85c-554sp" Jul 02 23:12:14.578067 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:12:14.578073 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/6d73b4a9-a1fb-4f54-bd70-413713f8cb7e-manager-config\") pod \"lws-controller-manager-675f46f85c-554sp\" (UID: \"6d73b4a9-a1fb-4f54-bd70-413713f8cb7e\") " pod="openshift-lws-operator/lws-controller-manager-675f46f85c-554sp" Jul 02 23:12:14.578298 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:12:14.578090 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/6d73b4a9-a1fb-4f54-bd70-413713f8cb7e-metrics-cert\") pod \"lws-controller-manager-675f46f85c-554sp\" (UID: \"6d73b4a9-a1fb-4f54-bd70-413713f8cb7e\") " pod="openshift-lws-operator/lws-controller-manager-675f46f85c-554sp" Jul 02 23:12:14.578298 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:12:14.578116 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b63d08e3-f29e-44c4-96c5-fe7545e75ee1-cert\") pod \"odh-model-controller-7998c67dc4-z79g4\" (UID: \"b63d08e3-f29e-44c4-96c5-fe7545e75ee1\") " pod="opendatahub/odh-model-controller-7998c67dc4-z79g4" Jul 02 23:12:14.578298 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:12:14.578152 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6d73b4a9-a1fb-4f54-bd70-413713f8cb7e-cert\") pod \"lws-controller-manager-675f46f85c-554sp\" (UID: \"6d73b4a9-a1fb-4f54-bd70-413713f8cb7e\") " pod="openshift-lws-operator/lws-controller-manager-675f46f85c-554sp" Jul 02 23:12:14.580612 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:12:14.580583 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b63d08e3-f29e-44c4-96c5-fe7545e75ee1-cert\") pod \"odh-model-controller-7998c67dc4-z79g4\" (UID: \"b63d08e3-f29e-44c4-96c5-fe7545e75ee1\") " pod="opendatahub/odh-model-controller-7998c67dc4-z79g4" Jul 02 23:12:14.679192 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:12:14.679158 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tbkjk\" (UniqueName: \"kubernetes.io/projected/6d73b4a9-a1fb-4f54-bd70-413713f8cb7e-kube-api-access-tbkjk\") pod \"lws-controller-manager-675f46f85c-554sp\" (UID: \"6d73b4a9-a1fb-4f54-bd70-413713f8cb7e\") " pod="openshift-lws-operator/lws-controller-manager-675f46f85c-554sp" Jul 02 23:12:14.679347 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:12:14.679203 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/6d73b4a9-a1fb-4f54-bd70-413713f8cb7e-manager-config\") pod \"lws-controller-manager-675f46f85c-554sp\" (UID: \"6d73b4a9-a1fb-4f54-bd70-413713f8cb7e\") " pod="openshift-lws-operator/lws-controller-manager-675f46f85c-554sp" Jul 02 23:12:14.679347 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:12:14.679221 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/6d73b4a9-a1fb-4f54-bd70-413713f8cb7e-metrics-cert\") pod \"lws-controller-manager-675f46f85c-554sp\" (UID: \"6d73b4a9-a1fb-4f54-bd70-413713f8cb7e\") " pod="openshift-lws-operator/lws-controller-manager-675f46f85c-554sp" Jul 02 23:12:14.679347 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:12:14.679246 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6d73b4a9-a1fb-4f54-bd70-413713f8cb7e-cert\") pod \"lws-controller-manager-675f46f85c-554sp\" (UID: \"6d73b4a9-a1fb-4f54-bd70-413713f8cb7e\") " pod="openshift-lws-operator/lws-controller-manager-675f46f85c-554sp" Jul 02 23:12:14.679894 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:12:14.679865 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/6d73b4a9-a1fb-4f54-bd70-413713f8cb7e-manager-config\") pod \"lws-controller-manager-675f46f85c-554sp\" (UID: \"6d73b4a9-a1fb-4f54-bd70-413713f8cb7e\") " pod="openshift-lws-operator/lws-controller-manager-675f46f85c-554sp" Jul 02 23:12:14.681728 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:12:14.681703 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/6d73b4a9-a1fb-4f54-bd70-413713f8cb7e-metrics-cert\") pod \"lws-controller-manager-675f46f85c-554sp\" (UID: \"6d73b4a9-a1fb-4f54-bd70-413713f8cb7e\") " pod="openshift-lws-operator/lws-controller-manager-675f46f85c-554sp" Jul 02 23:12:14.681839 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:12:14.681766 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6d73b4a9-a1fb-4f54-bd70-413713f8cb7e-cert\") pod \"lws-controller-manager-675f46f85c-554sp\" (UID: \"6d73b4a9-a1fb-4f54-bd70-413713f8cb7e\") " pod="openshift-lws-operator/lws-controller-manager-675f46f85c-554sp" Jul 02 23:12:14.687187 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:12:14.687167 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tbkjk\" (UniqueName: \"kubernetes.io/projected/6d73b4a9-a1fb-4f54-bd70-413713f8cb7e-kube-api-access-tbkjk\") pod \"lws-controller-manager-675f46f85c-554sp\" (UID: \"6d73b4a9-a1fb-4f54-bd70-413713f8cb7e\") " pod="openshift-lws-operator/lws-controller-manager-675f46f85c-554sp" Jul 02 23:12:14.703029 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:12:14.703008 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-675f46f85c-554sp" Jul 02 23:12:14.756122 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:12:14.756092 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-z79g4" Jul 02 23:12:14.844703 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:12:14.844669 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-675f46f85c-554sp"] Jul 02 23:12:14.848626 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:12:14.848580 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d73b4a9_a1fb_4f54_bd70_413713f8cb7e.slice/crio-bd5123856a9021e0e9ddc82d522e8a2fcb37bca32551549aa1587bb569e8009b WatchSource:0}: Error finding container bd5123856a9021e0e9ddc82d522e8a2fcb37bca32551549aa1587bb569e8009b: Status 404 returned error can't find the container with id bd5123856a9021e0e9ddc82d522e8a2fcb37bca32551549aa1587bb569e8009b Jul 02 23:12:14.850909 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:12:14.850887 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 02 23:12:14.906358 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:12:14.906336 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-z79g4"] Jul 02 23:12:14.908509 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:12:14.908478 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb63d08e3_f29e_44c4_96c5_fe7545e75ee1.slice/crio-3a02b5ccde9a6613f62bfd3a8ed4d2a590e118371892e153a0140ff01e6027c5 WatchSource:0}: Error finding container 3a02b5ccde9a6613f62bfd3a8ed4d2a590e118371892e153a0140ff01e6027c5: Status 404 returned error can't find the container with id 3a02b5ccde9a6613f62bfd3a8ed4d2a590e118371892e153a0140ff01e6027c5 Jul 02 23:12:15.447644 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:12:15.447610 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-z79g4" event={"ID":"b63d08e3-f29e-44c4-96c5-fe7545e75ee1","Type":"ContainerStarted","Data":"3a02b5ccde9a6613f62bfd3a8ed4d2a590e118371892e153a0140ff01e6027c5"} Jul 02 23:12:15.448923 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:12:15.448890 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-675f46f85c-554sp" event={"ID":"6d73b4a9-a1fb-4f54-bd70-413713f8cb7e","Type":"ContainerStarted","Data":"bd5123856a9021e0e9ddc82d522e8a2fcb37bca32551549aa1587bb569e8009b"} Jul 02 23:12:17.463204 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:12:17.463165 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-675f46f85c-554sp" event={"ID":"6d73b4a9-a1fb-4f54-bd70-413713f8cb7e","Type":"ContainerStarted","Data":"2d29b1469d3dc0056f9431b5b0a70a26e40c278510214044c6f67541235907e2"} Jul 02 23:12:17.463605 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:12:17.463317 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-675f46f85c-554sp" Jul 02 23:12:17.480868 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:12:17.480813 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-675f46f85c-554sp" podStartSLOduration=1.773145753 podStartE2EDuration="3.480797892s" totalImagesPullingTime="1.707652139s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:12:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:12:17.478146934 +0000 UTC m=+314.111188079" watchObservedRunningTime="2026-07-02 23:12:17.480797892 +0000 UTC m=+314.113839035" Jul 02 23:12:18.473306 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:12:18.473267 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-z79g4" event={"ID":"b63d08e3-f29e-44c4-96c5-fe7545e75ee1","Type":"ContainerStarted","Data":"fb096281dc4a6afebb37d8a3c044ab92f880a392896ba8b04a1ade1a833ce4bf"} Jul 02 23:12:18.473812 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:12:18.473392 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-z79g4" Jul 02 23:12:18.490689 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:12:18.490639 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-z79g4" podStartSLOduration=2.390312903 podStartE2EDuration="5.490624628s" totalImagesPullingTime="3.100311725s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:12:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:12:18.489167612 +0000 UTC m=+315.122208755" watchObservedRunningTime="2026-07-02 23:12:18.490624628 +0000 UTC m=+315.123665771" Jul 02 23:12:21.545549 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:12:21.545512 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qdw8p"] Jul 02 23:12:21.548902 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:12:21.548879 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qdw8p" Jul 02 23:12:21.553260 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:12:21.553243 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 02 23:12:21.553438 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:12:21.553271 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-tzqch\"" Jul 02 23:12:21.553507 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:12:21.553450 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 02 23:12:21.553507 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:12:21.553471 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 02 23:12:21.555108 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:12:21.555089 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 02 23:12:21.576831 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:12:21.576803 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qdw8p"] Jul 02 23:12:21.642335 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:12:21.642300 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/43b74966-ee55-43c7-8313-e353592ca860-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-qdw8p\" (UID: \"43b74966-ee55-43c7-8313-e353592ca860\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qdw8p" Jul 02 23:12:21.642532 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:12:21.642343 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/43b74966-ee55-43c7-8313-e353592ca860-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-qdw8p\" (UID: \"43b74966-ee55-43c7-8313-e353592ca860\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qdw8p" Jul 02 23:12:21.642532 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:12:21.642397 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/43b74966-ee55-43c7-8313-e353592ca860-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-qdw8p\" (UID: \"43b74966-ee55-43c7-8313-e353592ca860\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qdw8p" Jul 02 23:12:21.642532 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:12:21.642422 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/43b74966-ee55-43c7-8313-e353592ca860-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-qdw8p\" (UID: \"43b74966-ee55-43c7-8313-e353592ca860\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qdw8p" Jul 02 23:12:21.642532 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:12:21.642480 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7rhjk\" (UniqueName: \"kubernetes.io/projected/43b74966-ee55-43c7-8313-e353592ca860-kube-api-access-7rhjk\") pod \"istiod-openshift-gateway-94bb8fbfd-qdw8p\" (UID: \"43b74966-ee55-43c7-8313-e353592ca860\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qdw8p" Jul 02 23:12:21.642532 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:12:21.642512 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/43b74966-ee55-43c7-8313-e353592ca860-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-qdw8p\" (UID: \"43b74966-ee55-43c7-8313-e353592ca860\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qdw8p" Jul 02 23:12:21.642532 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:12:21.642535 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/43b74966-ee55-43c7-8313-e353592ca860-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-qdw8p\" (UID: \"43b74966-ee55-43c7-8313-e353592ca860\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qdw8p" Jul 02 23:12:21.747987 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:12:21.747947 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/43b74966-ee55-43c7-8313-e353592ca860-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-qdw8p\" (UID: \"43b74966-ee55-43c7-8313-e353592ca860\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qdw8p" Jul 02 23:12:21.748195 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:12:21.748024 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/43b74966-ee55-43c7-8313-e353592ca860-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-qdw8p\" (UID: \"43b74966-ee55-43c7-8313-e353592ca860\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qdw8p" Jul 02 23:12:21.748195 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:12:21.748059 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/43b74966-ee55-43c7-8313-e353592ca860-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-qdw8p\" (UID: \"43b74966-ee55-43c7-8313-e353592ca860\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qdw8p" Jul 02 23:12:21.748195 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:12:21.748105 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7rhjk\" (UniqueName: \"kubernetes.io/projected/43b74966-ee55-43c7-8313-e353592ca860-kube-api-access-7rhjk\") pod \"istiod-openshift-gateway-94bb8fbfd-qdw8p\" (UID: \"43b74966-ee55-43c7-8313-e353592ca860\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qdw8p" Jul 02 23:12:21.748195 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:12:21.748142 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/43b74966-ee55-43c7-8313-e353592ca860-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-qdw8p\" (UID: \"43b74966-ee55-43c7-8313-e353592ca860\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qdw8p" Jul 02 23:12:21.748195 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:12:21.748164 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/43b74966-ee55-43c7-8313-e353592ca860-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-qdw8p\" (UID: \"43b74966-ee55-43c7-8313-e353592ca860\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qdw8p" Jul 02 23:12:21.748464 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:12:21.748202 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/43b74966-ee55-43c7-8313-e353592ca860-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-qdw8p\" (UID: \"43b74966-ee55-43c7-8313-e353592ca860\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qdw8p" Jul 02 23:12:21.748824 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:12:21.748779 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/43b74966-ee55-43c7-8313-e353592ca860-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-qdw8p\" (UID: \"43b74966-ee55-43c7-8313-e353592ca860\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qdw8p" Jul 02 23:12:21.750590 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:12:21.750562 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/43b74966-ee55-43c7-8313-e353592ca860-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-qdw8p\" (UID: \"43b74966-ee55-43c7-8313-e353592ca860\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qdw8p" Jul 02 23:12:21.750707 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:12:21.750675 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/43b74966-ee55-43c7-8313-e353592ca860-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-qdw8p\" (UID: \"43b74966-ee55-43c7-8313-e353592ca860\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qdw8p" Jul 02 23:12:21.750707 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:12:21.750696 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/43b74966-ee55-43c7-8313-e353592ca860-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-qdw8p\" (UID: \"43b74966-ee55-43c7-8313-e353592ca860\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qdw8p" Jul 02 23:12:21.751157 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:12:21.751140 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/43b74966-ee55-43c7-8313-e353592ca860-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-qdw8p\" (UID: \"43b74966-ee55-43c7-8313-e353592ca860\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qdw8p" Jul 02 23:12:21.757096 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:12:21.757072 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/43b74966-ee55-43c7-8313-e353592ca860-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-qdw8p\" (UID: \"43b74966-ee55-43c7-8313-e353592ca860\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qdw8p" Jul 02 23:12:21.757201 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:12:21.757185 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7rhjk\" (UniqueName: \"kubernetes.io/projected/43b74966-ee55-43c7-8313-e353592ca860-kube-api-access-7rhjk\") pod \"istiod-openshift-gateway-94bb8fbfd-qdw8p\" (UID: \"43b74966-ee55-43c7-8313-e353592ca860\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qdw8p" Jul 02 23:12:21.858801 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:12:21.858704 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qdw8p" Jul 02 23:12:22.027630 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:12:22.027598 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qdw8p"] Jul 02 23:12:22.028895 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:12:22.028872 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43b74966_ee55_43c7_8313_e353592ca860.slice/crio-2ee750498f8f0fb8f72df0a6fc419733680e5a0470143b7270382bbeea758c1e WatchSource:0}: Error finding container 2ee750498f8f0fb8f72df0a6fc419733680e5a0470143b7270382bbeea758c1e: Status 404 returned error can't find the container with id 2ee750498f8f0fb8f72df0a6fc419733680e5a0470143b7270382bbeea758c1e Jul 02 23:12:22.495183 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:12:22.495147 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qdw8p" event={"ID":"43b74966-ee55-43c7-8313-e353592ca860","Type":"ContainerStarted","Data":"2ee750498f8f0fb8f72df0a6fc419733680e5a0470143b7270382bbeea758c1e"} Jul 02 23:12:24.991823 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:12:24.991788 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 02 23:12:24.992088 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:12:24.991853 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 02 23:12:25.515525 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:12:25.515482 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qdw8p" event={"ID":"43b74966-ee55-43c7-8313-e353592ca860","Type":"ContainerStarted","Data":"91eaaeea03b3f03e99e4e121e78aa6384aa9cf943e40ef8585028e8c88c70f8a"} Jul 02 23:12:25.515715 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:12:25.515553 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qdw8p" Jul 02 23:12:25.558409 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:12:25.558356 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qdw8p" podStartSLOduration=1.597753951 podStartE2EDuration="4.558337113s" totalImagesPullingTime="2.960583162s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:12:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:12:25.555660841 +0000 UTC m=+322.188702001" watchObservedRunningTime="2026-07-02 23:12:25.558337113 +0000 UTC m=+322.191378256" Jul 02 23:12:26.522888 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:12:26.522860 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qdw8p" Jul 02 23:12:28.475391 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:12:28.475356 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-675f46f85c-554sp" Jul 02 23:12:29.479965 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:12:29.479935 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-z79g4" Jul 02 23:13:30.431062 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:13:30.431030 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q5ck6"] Jul 02 23:13:30.434355 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:13:30.434339 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q5ck6" Jul 02 23:13:30.437432 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:13:30.437410 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-ccp89\"" Jul 02 23:13:30.438274 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:13:30.438255 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 02 23:13:30.447949 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:13:30.447931 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 02 23:13:30.451427 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:13:30.451407 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q5ck6"] Jul 02 23:13:30.544487 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:13:30.544450 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e40e75e1-fb91-4e5d-bc8f-13ebaf3cc542-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q5ck6\" (UID: \"e40e75e1-fb91-4e5d-bc8f-13ebaf3cc542\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q5ck6" Jul 02 23:13:30.544672 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:13:30.544524 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e40e75e1-fb91-4e5d-bc8f-13ebaf3cc542-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q5ck6\" (UID: \"e40e75e1-fb91-4e5d-bc8f-13ebaf3cc542\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q5ck6" Jul 02 23:13:30.544672 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:13:30.544557 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mkqlt\" (UniqueName: \"kubernetes.io/projected/e40e75e1-fb91-4e5d-bc8f-13ebaf3cc542-kube-api-access-mkqlt\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q5ck6\" (UID: \"e40e75e1-fb91-4e5d-bc8f-13ebaf3cc542\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q5ck6" Jul 02 23:13:30.645940 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:13:30.645907 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e40e75e1-fb91-4e5d-bc8f-13ebaf3cc542-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q5ck6\" (UID: \"e40e75e1-fb91-4e5d-bc8f-13ebaf3cc542\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q5ck6" Jul 02 23:13:30.646123 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:13:30.645973 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e40e75e1-fb91-4e5d-bc8f-13ebaf3cc542-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q5ck6\" (UID: \"e40e75e1-fb91-4e5d-bc8f-13ebaf3cc542\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q5ck6" Jul 02 23:13:30.646123 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:13:30.646004 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mkqlt\" (UniqueName: \"kubernetes.io/projected/e40e75e1-fb91-4e5d-bc8f-13ebaf3cc542-kube-api-access-mkqlt\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q5ck6\" (UID: \"e40e75e1-fb91-4e5d-bc8f-13ebaf3cc542\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q5ck6" Jul 02 23:13:30.646278 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:13:30.646257 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e40e75e1-fb91-4e5d-bc8f-13ebaf3cc542-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q5ck6\" (UID: \"e40e75e1-fb91-4e5d-bc8f-13ebaf3cc542\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q5ck6" Jul 02 23:13:30.646342 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:13:30.646325 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e40e75e1-fb91-4e5d-bc8f-13ebaf3cc542-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q5ck6\" (UID: \"e40e75e1-fb91-4e5d-bc8f-13ebaf3cc542\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q5ck6" Jul 02 23:13:30.654023 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:13:30.654001 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mkqlt\" (UniqueName: \"kubernetes.io/projected/e40e75e1-fb91-4e5d-bc8f-13ebaf3cc542-kube-api-access-mkqlt\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q5ck6\" (UID: \"e40e75e1-fb91-4e5d-bc8f-13ebaf3cc542\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q5ck6" Jul 02 23:13:30.743853 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:13:30.743779 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q5ck6" Jul 02 23:13:30.874146 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:13:30.874121 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q5ck6"] Jul 02 23:13:30.876560 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:13:30.876533 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode40e75e1_fb91_4e5d_bc8f_13ebaf3cc542.slice/crio-a092573c204a1a6f0f8406f2f01eb15495ba57012bb51731f823d21934ca86f8 WatchSource:0}: Error finding container a092573c204a1a6f0f8406f2f01eb15495ba57012bb51731f823d21934ca86f8: Status 404 returned error can't find the container with id a092573c204a1a6f0f8406f2f01eb15495ba57012bb51731f823d21934ca86f8 Jul 02 23:13:31.214495 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:13:31.214463 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0szjt2"] Jul 02 23:13:31.217978 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:13:31.217962 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0szjt2" Jul 02 23:13:31.226276 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:13:31.226253 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0szjt2"] Jul 02 23:13:31.353055 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:13:31.353019 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vds68\" (UniqueName: \"kubernetes.io/projected/820763c7-08fd-4de9-b8ef-aed0951ccc0e-kube-api-access-vds68\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0szjt2\" (UID: \"820763c7-08fd-4de9-b8ef-aed0951ccc0e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0szjt2" Jul 02 23:13:31.353227 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:13:31.353069 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/820763c7-08fd-4de9-b8ef-aed0951ccc0e-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0szjt2\" (UID: \"820763c7-08fd-4de9-b8ef-aed0951ccc0e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0szjt2" Jul 02 23:13:31.353227 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:13:31.353176 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/820763c7-08fd-4de9-b8ef-aed0951ccc0e-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0szjt2\" (UID: \"820763c7-08fd-4de9-b8ef-aed0951ccc0e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0szjt2" Jul 02 23:13:31.454135 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:13:31.454096 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vds68\" (UniqueName: \"kubernetes.io/projected/820763c7-08fd-4de9-b8ef-aed0951ccc0e-kube-api-access-vds68\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0szjt2\" (UID: \"820763c7-08fd-4de9-b8ef-aed0951ccc0e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0szjt2" Jul 02 23:13:31.454502 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:13:31.454154 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/820763c7-08fd-4de9-b8ef-aed0951ccc0e-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0szjt2\" (UID: \"820763c7-08fd-4de9-b8ef-aed0951ccc0e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0szjt2" Jul 02 23:13:31.454502 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:13:31.454222 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/820763c7-08fd-4de9-b8ef-aed0951ccc0e-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0szjt2\" (UID: \"820763c7-08fd-4de9-b8ef-aed0951ccc0e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0szjt2" Jul 02 23:13:31.454575 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:13:31.454546 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/820763c7-08fd-4de9-b8ef-aed0951ccc0e-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0szjt2\" (UID: \"820763c7-08fd-4de9-b8ef-aed0951ccc0e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0szjt2" Jul 02 23:13:31.454575 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:13:31.454562 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/820763c7-08fd-4de9-b8ef-aed0951ccc0e-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0szjt2\" (UID: \"820763c7-08fd-4de9-b8ef-aed0951ccc0e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0szjt2" Jul 02 23:13:31.462267 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:13:31.462240 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vds68\" (UniqueName: \"kubernetes.io/projected/820763c7-08fd-4de9-b8ef-aed0951ccc0e-kube-api-access-vds68\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0szjt2\" (UID: \"820763c7-08fd-4de9-b8ef-aed0951ccc0e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0szjt2" Jul 02 23:13:31.528110 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:13:31.528033 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0szjt2" Jul 02 23:13:31.615321 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:13:31.615242 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739kp9p"] Jul 02 23:13:31.619648 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:13:31.619623 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739kp9p" Jul 02 23:13:31.628558 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:13:31.628069 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739kp9p"] Jul 02 23:13:31.672052 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:13:31.672030 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0szjt2"] Jul 02 23:13:31.673955 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:13:31.673929 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod820763c7_08fd_4de9_b8ef_aed0951ccc0e.slice/crio-ec93e10012f11f04009e3d072a564b9e7f1ded4f959cd6c3d2258da94d247a88 WatchSource:0}: Error finding container ec93e10012f11f04009e3d072a564b9e7f1ded4f959cd6c3d2258da94d247a88: Status 404 returned error can't find the container with id ec93e10012f11f04009e3d072a564b9e7f1ded4f959cd6c3d2258da94d247a88 Jul 02 23:13:31.757054 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:13:31.757013 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-57ngd\" (UniqueName: \"kubernetes.io/projected/7c532bce-e740-4a27-b5b8-bd29733b712e-kube-api-access-57ngd\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739kp9p\" (UID: \"7c532bce-e740-4a27-b5b8-bd29733b712e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739kp9p" Jul 02 23:13:31.757236 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:13:31.757102 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7c532bce-e740-4a27-b5b8-bd29733b712e-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739kp9p\" (UID: \"7c532bce-e740-4a27-b5b8-bd29733b712e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739kp9p" Jul 02 23:13:31.757236 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:13:31.757136 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7c532bce-e740-4a27-b5b8-bd29733b712e-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739kp9p\" (UID: \"7c532bce-e740-4a27-b5b8-bd29733b712e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739kp9p" Jul 02 23:13:31.841153 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:13:31.841069 2563 generic.go:356] "Generic (PLEG): container finished" podID="e40e75e1-fb91-4e5d-bc8f-13ebaf3cc542" containerID="4ce39d40cb3200aaba0135c2213896d4551f6a2200117d8e5dea41436866500e" exitCode=0 Jul 02 23:13:31.841304 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:13:31.841164 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q5ck6" event={"ID":"e40e75e1-fb91-4e5d-bc8f-13ebaf3cc542","Type":"ContainerDied","Data":"4ce39d40cb3200aaba0135c2213896d4551f6a2200117d8e5dea41436866500e"} Jul 02 23:13:31.841304 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:13:31.841223 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q5ck6" event={"ID":"e40e75e1-fb91-4e5d-bc8f-13ebaf3cc542","Type":"ContainerStarted","Data":"a092573c204a1a6f0f8406f2f01eb15495ba57012bb51731f823d21934ca86f8"} Jul 02 23:13:31.842803 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:13:31.842772 2563 generic.go:356] "Generic (PLEG): container finished" podID="820763c7-08fd-4de9-b8ef-aed0951ccc0e" containerID="620f7ddf67a363271dcdead91061e9e3a3071f9559d565db22498bbafc13de13" exitCode=0 Jul 02 23:13:31.848335 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:13:31.848312 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0szjt2" event={"ID":"820763c7-08fd-4de9-b8ef-aed0951ccc0e","Type":"ContainerDied","Data":"620f7ddf67a363271dcdead91061e9e3a3071f9559d565db22498bbafc13de13"} Jul 02 23:13:31.848447 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:13:31.848348 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0szjt2" event={"ID":"820763c7-08fd-4de9-b8ef-aed0951ccc0e","Type":"ContainerStarted","Data":"ec93e10012f11f04009e3d072a564b9e7f1ded4f959cd6c3d2258da94d247a88"} Jul 02 23:13:31.857964 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:13:31.857918 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-57ngd\" (UniqueName: \"kubernetes.io/projected/7c532bce-e740-4a27-b5b8-bd29733b712e-kube-api-access-57ngd\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739kp9p\" (UID: \"7c532bce-e740-4a27-b5b8-bd29733b712e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739kp9p" Jul 02 23:13:31.858089 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:13:31.858067 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7c532bce-e740-4a27-b5b8-bd29733b712e-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739kp9p\" (UID: \"7c532bce-e740-4a27-b5b8-bd29733b712e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739kp9p" Jul 02 23:13:31.858180 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:13:31.858101 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7c532bce-e740-4a27-b5b8-bd29733b712e-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739kp9p\" (UID: \"7c532bce-e740-4a27-b5b8-bd29733b712e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739kp9p" Jul 02 23:13:31.858532 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:13:31.858507 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7c532bce-e740-4a27-b5b8-bd29733b712e-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739kp9p\" (UID: \"7c532bce-e740-4a27-b5b8-bd29733b712e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739kp9p" Jul 02 23:13:31.858618 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:13:31.858572 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7c532bce-e740-4a27-b5b8-bd29733b712e-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739kp9p\" (UID: \"7c532bce-e740-4a27-b5b8-bd29733b712e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739kp9p" Jul 02 23:13:31.866111 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:13:31.866084 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-57ngd\" (UniqueName: \"kubernetes.io/projected/7c532bce-e740-4a27-b5b8-bd29733b712e-kube-api-access-57ngd\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739kp9p\" (UID: \"7c532bce-e740-4a27-b5b8-bd29733b712e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739kp9p" Jul 02 23:13:31.932021 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:13:31.931980 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739kp9p" Jul 02 23:13:32.019413 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:13:32.019380 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fsqlp"] Jul 02 23:13:32.025806 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:13:32.025712 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fsqlp" Jul 02 23:13:32.031355 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:13:32.031325 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fsqlp"] Jul 02 23:13:32.094117 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:13:32.094092 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739kp9p"] Jul 02 23:13:32.095642 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:13:32.095615 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c532bce_e740_4a27_b5b8_bd29733b712e.slice/crio-459a6eaa7038250a65198873584558e1dd4010889f2e20c18b6aa2492863cd07 WatchSource:0}: Error finding container 459a6eaa7038250a65198873584558e1dd4010889f2e20c18b6aa2492863cd07: Status 404 returned error can't find the container with id 459a6eaa7038250a65198873584558e1dd4010889f2e20c18b6aa2492863cd07 Jul 02 23:13:32.160893 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:13:32.160869 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/77bb6a70-49ae-48ed-aba5-abf6fba6243a-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fsqlp\" (UID: \"77bb6a70-49ae-48ed-aba5-abf6fba6243a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fsqlp" Jul 02 23:13:32.161020 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:13:32.160897 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/77bb6a70-49ae-48ed-aba5-abf6fba6243a-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fsqlp\" (UID: \"77bb6a70-49ae-48ed-aba5-abf6fba6243a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fsqlp" Jul 02 23:13:32.161020 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:13:32.160920 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qzg78\" (UniqueName: \"kubernetes.io/projected/77bb6a70-49ae-48ed-aba5-abf6fba6243a-kube-api-access-qzg78\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fsqlp\" (UID: \"77bb6a70-49ae-48ed-aba5-abf6fba6243a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fsqlp" Jul 02 23:13:32.261815 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:13:32.261781 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/77bb6a70-49ae-48ed-aba5-abf6fba6243a-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fsqlp\" (UID: \"77bb6a70-49ae-48ed-aba5-abf6fba6243a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fsqlp" Jul 02 23:13:32.261815 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:13:32.261819 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/77bb6a70-49ae-48ed-aba5-abf6fba6243a-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fsqlp\" (UID: \"77bb6a70-49ae-48ed-aba5-abf6fba6243a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fsqlp" Jul 02 23:13:32.262020 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:13:32.261843 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzg78\" (UniqueName: \"kubernetes.io/projected/77bb6a70-49ae-48ed-aba5-abf6fba6243a-kube-api-access-qzg78\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fsqlp\" (UID: \"77bb6a70-49ae-48ed-aba5-abf6fba6243a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fsqlp" Jul 02 23:13:32.262155 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:13:32.262136 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/77bb6a70-49ae-48ed-aba5-abf6fba6243a-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fsqlp\" (UID: \"77bb6a70-49ae-48ed-aba5-abf6fba6243a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fsqlp" Jul 02 23:13:32.262191 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:13:32.262176 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/77bb6a70-49ae-48ed-aba5-abf6fba6243a-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fsqlp\" (UID: \"77bb6a70-49ae-48ed-aba5-abf6fba6243a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fsqlp" Jul 02 23:13:32.271611 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:13:32.271591 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qzg78\" (UniqueName: \"kubernetes.io/projected/77bb6a70-49ae-48ed-aba5-abf6fba6243a-kube-api-access-qzg78\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fsqlp\" (UID: \"77bb6a70-49ae-48ed-aba5-abf6fba6243a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fsqlp" Jul 02 23:13:32.340217 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:13:32.340180 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fsqlp" Jul 02 23:13:32.481769 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:13:32.481728 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fsqlp"] Jul 02 23:13:32.560754 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:13:32.560707 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77bb6a70_49ae_48ed_aba5_abf6fba6243a.slice/crio-24abffde0bc6a999910e4a2dbe1efadcc2aa5bc0bf17424740db2b9cb4a11cf8 WatchSource:0}: Error finding container 24abffde0bc6a999910e4a2dbe1efadcc2aa5bc0bf17424740db2b9cb4a11cf8: Status 404 returned error can't find the container with id 24abffde0bc6a999910e4a2dbe1efadcc2aa5bc0bf17424740db2b9cb4a11cf8 Jul 02 23:13:32.850404 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:13:32.850324 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q5ck6" event={"ID":"e40e75e1-fb91-4e5d-bc8f-13ebaf3cc542","Type":"ContainerStarted","Data":"1518c8693631f099e1ede6a262316f3801882d60964feac6b57de318c544a6d7"} Jul 02 23:13:32.852016 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:13:32.851985 2563 generic.go:356] "Generic (PLEG): container finished" podID="77bb6a70-49ae-48ed-aba5-abf6fba6243a" containerID="094ed83e062c14e827bd0a7c68d5116419c63a223784cf00b1ef0a7ab64bf2ce" exitCode=0 Jul 02 23:13:32.852113 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:13:32.852062 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fsqlp" event={"ID":"77bb6a70-49ae-48ed-aba5-abf6fba6243a","Type":"ContainerDied","Data":"094ed83e062c14e827bd0a7c68d5116419c63a223784cf00b1ef0a7ab64bf2ce"} Jul 02 23:13:32.852184 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:13:32.852119 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fsqlp" event={"ID":"77bb6a70-49ae-48ed-aba5-abf6fba6243a","Type":"ContainerStarted","Data":"24abffde0bc6a999910e4a2dbe1efadcc2aa5bc0bf17424740db2b9cb4a11cf8"} Jul 02 23:13:32.854690 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:13:32.854667 2563 generic.go:356] "Generic (PLEG): container finished" podID="820763c7-08fd-4de9-b8ef-aed0951ccc0e" containerID="3d2b4a3324c4977d3a9f60f88ca9e98199f895eb3a9088ea4d6860ddbc2166df" exitCode=0 Jul 02 23:13:32.854827 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:13:32.854779 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0szjt2" event={"ID":"820763c7-08fd-4de9-b8ef-aed0951ccc0e","Type":"ContainerDied","Data":"3d2b4a3324c4977d3a9f60f88ca9e98199f895eb3a9088ea4d6860ddbc2166df"} Jul 02 23:13:32.857598 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:13:32.857579 2563 generic.go:356] "Generic (PLEG): container finished" podID="7c532bce-e740-4a27-b5b8-bd29733b712e" containerID="26a9515bf67254b48f6b9275fcfdf083489afc4b29069f8897472a7137f3bea3" exitCode=0 Jul 02 23:13:32.857677 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:13:32.857655 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739kp9p" event={"ID":"7c532bce-e740-4a27-b5b8-bd29733b712e","Type":"ContainerDied","Data":"26a9515bf67254b48f6b9275fcfdf083489afc4b29069f8897472a7137f3bea3"} Jul 02 23:13:32.857756 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:13:32.857688 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739kp9p" event={"ID":"7c532bce-e740-4a27-b5b8-bd29733b712e","Type":"ContainerStarted","Data":"459a6eaa7038250a65198873584558e1dd4010889f2e20c18b6aa2492863cd07"} Jul 02 23:13:33.864649 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:13:33.864621 2563 generic.go:356] "Generic (PLEG): container finished" podID="e40e75e1-fb91-4e5d-bc8f-13ebaf3cc542" containerID="1518c8693631f099e1ede6a262316f3801882d60964feac6b57de318c544a6d7" exitCode=0 Jul 02 23:13:33.865046 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:13:33.864693 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q5ck6" event={"ID":"e40e75e1-fb91-4e5d-bc8f-13ebaf3cc542","Type":"ContainerDied","Data":"1518c8693631f099e1ede6a262316f3801882d60964feac6b57de318c544a6d7"} Jul 02 23:13:33.866588 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:13:33.866566 2563 generic.go:356] "Generic (PLEG): container finished" podID="77bb6a70-49ae-48ed-aba5-abf6fba6243a" containerID="9b6d2d5c28480daece8130a477c5c0961c893709c2dd6726b3abf5be079d6088" exitCode=0 Jul 02 23:13:33.866685 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:13:33.866642 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fsqlp" event={"ID":"77bb6a70-49ae-48ed-aba5-abf6fba6243a","Type":"ContainerDied","Data":"9b6d2d5c28480daece8130a477c5c0961c893709c2dd6726b3abf5be079d6088"} Jul 02 23:13:33.868888 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:13:33.868870 2563 generic.go:356] "Generic (PLEG): container finished" podID="820763c7-08fd-4de9-b8ef-aed0951ccc0e" containerID="5c3de4a70ac5d781438b4481408e02138cc8a6c18f4297347c16661b9fdc9d8f" exitCode=0 Jul 02 23:13:33.868979 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:13:33.868932 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0szjt2" event={"ID":"820763c7-08fd-4de9-b8ef-aed0951ccc0e","Type":"ContainerDied","Data":"5c3de4a70ac5d781438b4481408e02138cc8a6c18f4297347c16661b9fdc9d8f"} Jul 02 23:13:33.870663 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:13:33.870631 2563 generic.go:356] "Generic (PLEG): container finished" podID="7c532bce-e740-4a27-b5b8-bd29733b712e" containerID="713332a24e51ca3629ff20d21f3f4185c675b20682a8e29907d29b9fcc52b504" exitCode=0 Jul 02 23:13:33.870796 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:13:33.870711 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739kp9p" event={"ID":"7c532bce-e740-4a27-b5b8-bd29733b712e","Type":"ContainerDied","Data":"713332a24e51ca3629ff20d21f3f4185c675b20682a8e29907d29b9fcc52b504"} Jul 02 23:13:34.878653 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:13:34.878622 2563 generic.go:356] "Generic (PLEG): container finished" podID="e40e75e1-fb91-4e5d-bc8f-13ebaf3cc542" containerID="3db4ee18bb027a2fb59d7e06b13b8f006a6ef33be807c4978758d7234e20dd6d" exitCode=0 Jul 02 23:13:34.879092 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:13:34.878694 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q5ck6" event={"ID":"e40e75e1-fb91-4e5d-bc8f-13ebaf3cc542","Type":"ContainerDied","Data":"3db4ee18bb027a2fb59d7e06b13b8f006a6ef33be807c4978758d7234e20dd6d"} Jul 02 23:13:34.880805 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:13:34.880785 2563 generic.go:356] "Generic (PLEG): container finished" podID="77bb6a70-49ae-48ed-aba5-abf6fba6243a" containerID="47e86c298a04e00a9301b59c9aaf3deffd2e526a62c65d5b4a57f3b4e85ca92c" exitCode=0 Jul 02 23:13:34.880867 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:13:34.880811 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fsqlp" event={"ID":"77bb6a70-49ae-48ed-aba5-abf6fba6243a","Type":"ContainerDied","Data":"47e86c298a04e00a9301b59c9aaf3deffd2e526a62c65d5b4a57f3b4e85ca92c"} Jul 02 23:13:34.883002 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:13:34.882980 2563 generic.go:356] "Generic (PLEG): container finished" podID="7c532bce-e740-4a27-b5b8-bd29733b712e" containerID="d2d8ab1b3e41d27913a1edd4642440fb2371fea4a8ee72adef49804f8c81e1f3" exitCode=0 Jul 02 23:13:34.883139 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:13:34.883056 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739kp9p" event={"ID":"7c532bce-e740-4a27-b5b8-bd29733b712e","Type":"ContainerDied","Data":"d2d8ab1b3e41d27913a1edd4642440fb2371fea4a8ee72adef49804f8c81e1f3"} Jul 02 23:13:35.016634 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:13:35.016609 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0szjt2" Jul 02 23:13:35.189305 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:13:35.189225 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/820763c7-08fd-4de9-b8ef-aed0951ccc0e-util\") pod \"820763c7-08fd-4de9-b8ef-aed0951ccc0e\" (UID: \"820763c7-08fd-4de9-b8ef-aed0951ccc0e\") " Jul 02 23:13:35.189445 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:13:35.189323 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vds68\" (UniqueName: \"kubernetes.io/projected/820763c7-08fd-4de9-b8ef-aed0951ccc0e-kube-api-access-vds68\") pod \"820763c7-08fd-4de9-b8ef-aed0951ccc0e\" (UID: \"820763c7-08fd-4de9-b8ef-aed0951ccc0e\") " Jul 02 23:13:35.189445 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:13:35.189399 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/820763c7-08fd-4de9-b8ef-aed0951ccc0e-bundle\") pod \"820763c7-08fd-4de9-b8ef-aed0951ccc0e\" (UID: \"820763c7-08fd-4de9-b8ef-aed0951ccc0e\") " Jul 02 23:13:35.189856 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:13:35.189835 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/820763c7-08fd-4de9-b8ef-aed0951ccc0e-bundle" (OuterVolumeSpecName: "bundle") pod "820763c7-08fd-4de9-b8ef-aed0951ccc0e" (UID: "820763c7-08fd-4de9-b8ef-aed0951ccc0e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 23:13:35.191652 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:13:35.191631 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/820763c7-08fd-4de9-b8ef-aed0951ccc0e-kube-api-access-vds68" (OuterVolumeSpecName: "kube-api-access-vds68") pod "820763c7-08fd-4de9-b8ef-aed0951ccc0e" (UID: "820763c7-08fd-4de9-b8ef-aed0951ccc0e"). InnerVolumeSpecName "kube-api-access-vds68". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 23:13:35.194378 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:13:35.194358 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/820763c7-08fd-4de9-b8ef-aed0951ccc0e-util" (OuterVolumeSpecName: "util") pod "820763c7-08fd-4de9-b8ef-aed0951ccc0e" (UID: "820763c7-08fd-4de9-b8ef-aed0951ccc0e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 23:13:35.290296 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:13:35.290250 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vds68\" (UniqueName: \"kubernetes.io/projected/820763c7-08fd-4de9-b8ef-aed0951ccc0e-kube-api-access-vds68\") on node \"ip-10-0-131-33.ec2.internal\" DevicePath \"\"" Jul 02 23:13:35.290296 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:13:35.290291 2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/820763c7-08fd-4de9-b8ef-aed0951ccc0e-bundle\") on node \"ip-10-0-131-33.ec2.internal\" DevicePath \"\"" Jul 02 23:13:35.290296 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:13:35.290302 2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/820763c7-08fd-4de9-b8ef-aed0951ccc0e-util\") on node \"ip-10-0-131-33.ec2.internal\" DevicePath \"\"" Jul 02 23:13:35.889513 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:13:35.889487 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0szjt2" Jul 02 23:13:35.889871 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:13:35.889509 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0szjt2" event={"ID":"820763c7-08fd-4de9-b8ef-aed0951ccc0e","Type":"ContainerDied","Data":"ec93e10012f11f04009e3d072a564b9e7f1ded4f959cd6c3d2258da94d247a88"} Jul 02 23:13:35.889871 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:13:35.889556 2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ec93e10012f11f04009e3d072a564b9e7f1ded4f959cd6c3d2258da94d247a88" Jul 02 23:13:36.029632 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:13:36.029606 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q5ck6" Jul 02 23:13:36.078591 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:13:36.078572 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fsqlp" Jul 02 23:13:36.081681 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:13:36.081664 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739kp9p" Jul 02 23:13:36.196838 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:13:36.196807 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e40e75e1-fb91-4e5d-bc8f-13ebaf3cc542-util\") pod \"e40e75e1-fb91-4e5d-bc8f-13ebaf3cc542\" (UID: \"e40e75e1-fb91-4e5d-bc8f-13ebaf3cc542\") " Jul 02 23:13:36.196838 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:13:36.196843 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e40e75e1-fb91-4e5d-bc8f-13ebaf3cc542-bundle\") pod \"e40e75e1-fb91-4e5d-bc8f-13ebaf3cc542\" (UID: \"e40e75e1-fb91-4e5d-bc8f-13ebaf3cc542\") " Jul 02 23:13:36.197065 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:13:36.196876 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qzg78\" (UniqueName: \"kubernetes.io/projected/77bb6a70-49ae-48ed-aba5-abf6fba6243a-kube-api-access-qzg78\") pod \"77bb6a70-49ae-48ed-aba5-abf6fba6243a\" (UID: \"77bb6a70-49ae-48ed-aba5-abf6fba6243a\") " Jul 02 23:13:36.197065 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:13:36.196902 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-57ngd\" (UniqueName: \"kubernetes.io/projected/7c532bce-e740-4a27-b5b8-bd29733b712e-kube-api-access-57ngd\") pod \"7c532bce-e740-4a27-b5b8-bd29733b712e\" (UID: \"7c532bce-e740-4a27-b5b8-bd29733b712e\") " Jul 02 23:13:36.197065 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:13:36.196944 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/77bb6a70-49ae-48ed-aba5-abf6fba6243a-util\") pod \"77bb6a70-49ae-48ed-aba5-abf6fba6243a\" (UID: \"77bb6a70-49ae-48ed-aba5-abf6fba6243a\") " Jul 02 23:13:36.197336 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:13:36.197300 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7c532bce-e740-4a27-b5b8-bd29733b712e-bundle\") pod \"7c532bce-e740-4a27-b5b8-bd29733b712e\" (UID: \"7c532bce-e740-4a27-b5b8-bd29733b712e\") " Jul 02 23:13:36.197465 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:13:36.197422 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e40e75e1-fb91-4e5d-bc8f-13ebaf3cc542-bundle" (OuterVolumeSpecName: "bundle") pod "e40e75e1-fb91-4e5d-bc8f-13ebaf3cc542" (UID: "e40e75e1-fb91-4e5d-bc8f-13ebaf3cc542"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 23:13:36.197657 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:13:36.197555 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7c532bce-e740-4a27-b5b8-bd29733b712e-util\") pod \"7c532bce-e740-4a27-b5b8-bd29733b712e\" (UID: \"7c532bce-e740-4a27-b5b8-bd29733b712e\") " Jul 02 23:13:36.197657 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:13:36.197715 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/77bb6a70-49ae-48ed-aba5-abf6fba6243a-bundle\") pod \"77bb6a70-49ae-48ed-aba5-abf6fba6243a\" (UID: \"77bb6a70-49ae-48ed-aba5-abf6fba6243a\") " Jul 02 23:13:36.197657 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:13:36.197770 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mkqlt\" (UniqueName: \"kubernetes.io/projected/e40e75e1-fb91-4e5d-bc8f-13ebaf3cc542-kube-api-access-mkqlt\") pod \"e40e75e1-fb91-4e5d-bc8f-13ebaf3cc542\" (UID: \"e40e75e1-fb91-4e5d-bc8f-13ebaf3cc542\") " Jul 02 23:13:36.198116 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:13:36.198096 2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e40e75e1-fb91-4e5d-bc8f-13ebaf3cc542-bundle\") on node \"ip-10-0-131-33.ec2.internal\" DevicePath \"\"" Jul 02 23:13:36.198286 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:13:36.198255 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c532bce-e740-4a27-b5b8-bd29733b712e-bundle" (OuterVolumeSpecName: "bundle") pod "7c532bce-e740-4a27-b5b8-bd29733b712e" (UID: "7c532bce-e740-4a27-b5b8-bd29733b712e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 23:13:36.198845 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:13:36.198785 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77bb6a70-49ae-48ed-aba5-abf6fba6243a-bundle" (OuterVolumeSpecName: "bundle") pod "77bb6a70-49ae-48ed-aba5-abf6fba6243a" (UID: "77bb6a70-49ae-48ed-aba5-abf6fba6243a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 23:13:36.199618 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:13:36.199591 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c532bce-e740-4a27-b5b8-bd29733b712e-kube-api-access-57ngd" (OuterVolumeSpecName: "kube-api-access-57ngd") pod "7c532bce-e740-4a27-b5b8-bd29733b712e" (UID: "7c532bce-e740-4a27-b5b8-bd29733b712e"). InnerVolumeSpecName "kube-api-access-57ngd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 23:13:36.199884 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:13:36.199856 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/77bb6a70-49ae-48ed-aba5-abf6fba6243a-kube-api-access-qzg78" (OuterVolumeSpecName: "kube-api-access-qzg78") pod "77bb6a70-49ae-48ed-aba5-abf6fba6243a" (UID: "77bb6a70-49ae-48ed-aba5-abf6fba6243a"). InnerVolumeSpecName "kube-api-access-qzg78". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 23:13:36.200300 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:13:36.200279 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e40e75e1-fb91-4e5d-bc8f-13ebaf3cc542-kube-api-access-mkqlt" (OuterVolumeSpecName: "kube-api-access-mkqlt") pod "e40e75e1-fb91-4e5d-bc8f-13ebaf3cc542" (UID: "e40e75e1-fb91-4e5d-bc8f-13ebaf3cc542"). InnerVolumeSpecName "kube-api-access-mkqlt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 23:13:36.203972 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:13:36.203949 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c532bce-e740-4a27-b5b8-bd29733b712e-util" (OuterVolumeSpecName: "util") pod "7c532bce-e740-4a27-b5b8-bd29733b712e" (UID: "7c532bce-e740-4a27-b5b8-bd29733b712e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 23:13:36.205228 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:13:36.205192 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77bb6a70-49ae-48ed-aba5-abf6fba6243a-util" (OuterVolumeSpecName: "util") pod "77bb6a70-49ae-48ed-aba5-abf6fba6243a" (UID: "77bb6a70-49ae-48ed-aba5-abf6fba6243a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 23:13:36.299104 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:13:36.299074 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qzg78\" (UniqueName: \"kubernetes.io/projected/77bb6a70-49ae-48ed-aba5-abf6fba6243a-kube-api-access-qzg78\") on node \"ip-10-0-131-33.ec2.internal\" DevicePath \"\"" Jul 02 23:13:36.299104 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:13:36.299101 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-57ngd\" (UniqueName: \"kubernetes.io/projected/7c532bce-e740-4a27-b5b8-bd29733b712e-kube-api-access-57ngd\") on node \"ip-10-0-131-33.ec2.internal\" DevicePath \"\"" Jul 02 23:13:36.299104 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:13:36.299110 2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/77bb6a70-49ae-48ed-aba5-abf6fba6243a-util\") on node \"ip-10-0-131-33.ec2.internal\" DevicePath \"\"" Jul 02 23:13:36.299324 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:13:36.299120 2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7c532bce-e740-4a27-b5b8-bd29733b712e-bundle\") on node \"ip-10-0-131-33.ec2.internal\" DevicePath \"\"" Jul 02 23:13:36.299324 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:13:36.299128 2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7c532bce-e740-4a27-b5b8-bd29733b712e-util\") on node \"ip-10-0-131-33.ec2.internal\" DevicePath \"\"" Jul 02 23:13:36.299324 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:13:36.299138 2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/77bb6a70-49ae-48ed-aba5-abf6fba6243a-bundle\") on node \"ip-10-0-131-33.ec2.internal\" DevicePath \"\"" Jul 02 23:13:36.299324 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:13:36.299149 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mkqlt\" (UniqueName: \"kubernetes.io/projected/e40e75e1-fb91-4e5d-bc8f-13ebaf3cc542-kube-api-access-mkqlt\") on node \"ip-10-0-131-33.ec2.internal\" DevicePath \"\"" Jul 02 23:13:36.306024 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:13:36.306000 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e40e75e1-fb91-4e5d-bc8f-13ebaf3cc542-util" (OuterVolumeSpecName: "util") pod "e40e75e1-fb91-4e5d-bc8f-13ebaf3cc542" (UID: "e40e75e1-fb91-4e5d-bc8f-13ebaf3cc542"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 23:13:36.400343 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:13:36.400312 2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e40e75e1-fb91-4e5d-bc8f-13ebaf3cc542-util\") on node \"ip-10-0-131-33.ec2.internal\" DevicePath \"\"" Jul 02 23:13:36.896311 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:13:36.896273 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739kp9p" Jul 02 23:13:36.896311 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:13:36.896302 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739kp9p" event={"ID":"7c532bce-e740-4a27-b5b8-bd29733b712e","Type":"ContainerDied","Data":"459a6eaa7038250a65198873584558e1dd4010889f2e20c18b6aa2492863cd07"} Jul 02 23:13:36.896795 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:13:36.896351 2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="459a6eaa7038250a65198873584558e1dd4010889f2e20c18b6aa2492863cd07" Jul 02 23:13:36.898283 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:13:36.898261 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q5ck6" event={"ID":"e40e75e1-fb91-4e5d-bc8f-13ebaf3cc542","Type":"ContainerDied","Data":"a092573c204a1a6f0f8406f2f01eb15495ba57012bb51731f823d21934ca86f8"} Jul 02 23:13:36.898283 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:13:36.898278 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q5ck6" Jul 02 23:13:36.898473 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:13:36.898294 2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a092573c204a1a6f0f8406f2f01eb15495ba57012bb51731f823d21934ca86f8" Jul 02 23:13:36.900205 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:13:36.900183 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fsqlp" event={"ID":"77bb6a70-49ae-48ed-aba5-abf6fba6243a","Type":"ContainerDied","Data":"24abffde0bc6a999910e4a2dbe1efadcc2aa5bc0bf17424740db2b9cb4a11cf8"} Jul 02 23:13:36.900310 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:13:36.900222 2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="24abffde0bc6a999910e4a2dbe1efadcc2aa5bc0bf17424740db2b9cb4a11cf8" Jul 02 23:13:36.900310 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:13:36.900231 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fsqlp" Jul 02 23:14:12.563853 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:14:12.563821 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vvc2c"] Jul 02 23:14:12.564336 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:14:12.564162 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e40e75e1-fb91-4e5d-bc8f-13ebaf3cc542" containerName="util" Jul 02 23:14:12.564336 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:14:12.564173 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="e40e75e1-fb91-4e5d-bc8f-13ebaf3cc542" containerName="util" Jul 02 23:14:12.564336 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:14:12.564183 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77bb6a70-49ae-48ed-aba5-abf6fba6243a" containerName="util" Jul 02 23:14:12.564336 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:14:12.564188 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="77bb6a70-49ae-48ed-aba5-abf6fba6243a" containerName="util" Jul 02 23:14:12.564336 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:14:12.564197 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e40e75e1-fb91-4e5d-bc8f-13ebaf3cc542" containerName="pull" Jul 02 23:14:12.564336 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:14:12.564203 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="e40e75e1-fb91-4e5d-bc8f-13ebaf3cc542" containerName="pull" Jul 02 23:14:12.564336 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:14:12.564209 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c532bce-e740-4a27-b5b8-bd29733b712e" containerName="extract" Jul 02 23:14:12.564336 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:14:12.564215 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c532bce-e740-4a27-b5b8-bd29733b712e" containerName="extract" Jul 02 23:14:12.564336 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:14:12.564227 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c532bce-e740-4a27-b5b8-bd29733b712e" containerName="util" Jul 02 23:14:12.564336 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:14:12.564232 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c532bce-e740-4a27-b5b8-bd29733b712e" containerName="util" Jul 02 23:14:12.564336 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:14:12.564238 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77bb6a70-49ae-48ed-aba5-abf6fba6243a" containerName="extract" Jul 02 23:14:12.564336 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:14:12.564243 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="77bb6a70-49ae-48ed-aba5-abf6fba6243a" containerName="extract" Jul 02 23:14:12.564336 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:14:12.564250 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77bb6a70-49ae-48ed-aba5-abf6fba6243a" containerName="pull" Jul 02 23:14:12.564336 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:14:12.564255 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="77bb6a70-49ae-48ed-aba5-abf6fba6243a" containerName="pull" Jul 02 23:14:12.564336 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:14:12.564270 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="820763c7-08fd-4de9-b8ef-aed0951ccc0e" containerName="util" Jul 02 23:14:12.564336 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:14:12.564275 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="820763c7-08fd-4de9-b8ef-aed0951ccc0e" containerName="util" Jul 02 23:14:12.564336 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:14:12.564283 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="820763c7-08fd-4de9-b8ef-aed0951ccc0e" containerName="pull" Jul 02 23:14:12.564336 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:14:12.564287 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="820763c7-08fd-4de9-b8ef-aed0951ccc0e" containerName="pull" Jul 02 23:14:12.564336 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:14:12.564293 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="820763c7-08fd-4de9-b8ef-aed0951ccc0e" containerName="extract" Jul 02 23:14:12.564336 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:14:12.564299 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="820763c7-08fd-4de9-b8ef-aed0951ccc0e" containerName="extract" Jul 02 23:14:12.564336 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:14:12.564305 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c532bce-e740-4a27-b5b8-bd29733b712e" containerName="pull" Jul 02 23:14:12.564336 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:14:12.564310 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c532bce-e740-4a27-b5b8-bd29733b712e" containerName="pull" Jul 02 23:14:12.564336 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:14:12.564317 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e40e75e1-fb91-4e5d-bc8f-13ebaf3cc542" containerName="extract" Jul 02 23:14:12.564336 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:14:12.564322 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="e40e75e1-fb91-4e5d-bc8f-13ebaf3cc542" containerName="extract" Jul 02 23:14:12.565060 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:14:12.564372 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="820763c7-08fd-4de9-b8ef-aed0951ccc0e" containerName="extract" Jul 02 23:14:12.565060 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:14:12.564379 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="e40e75e1-fb91-4e5d-bc8f-13ebaf3cc542" containerName="extract" Jul 02 23:14:12.565060 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:14:12.564385 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="77bb6a70-49ae-48ed-aba5-abf6fba6243a" containerName="extract" Jul 02 23:14:12.565060 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:14:12.564392 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c532bce-e740-4a27-b5b8-bd29733b712e" containerName="extract" Jul 02 23:14:12.568684 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:14:12.568668 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vvc2c" Jul 02 23:14:12.571510 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:14:12.571488 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 02 23:14:12.571910 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:14:12.571891 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-mprfg\"" Jul 02 23:14:12.572456 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:14:12.572439 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 02 23:14:12.579706 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:14:12.579685 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vvc2c"] Jul 02 23:14:12.615945 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:14:12.615915 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-54mf5\" (UniqueName: \"kubernetes.io/projected/9c2042a6-e856-4270-a401-60fae6f8858b-kube-api-access-54mf5\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-vvc2c\" (UID: \"9c2042a6-e856-4270-a401-60fae6f8858b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vvc2c" Jul 02 23:14:12.616061 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:14:12.615985 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9c2042a6-e856-4270-a401-60fae6f8858b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-vvc2c\" (UID: \"9c2042a6-e856-4270-a401-60fae6f8858b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vvc2c" Jul 02 23:14:12.658511 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:14:12.658481 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vvc2c"] Jul 02 23:14:12.658760 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:14:12.658728 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-54mf5], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vvc2c" podUID="9c2042a6-e856-4270-a401-60fae6f8858b" Jul 02 23:14:12.716820 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:14:12.716794 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-54mf5\" (UniqueName: \"kubernetes.io/projected/9c2042a6-e856-4270-a401-60fae6f8858b-kube-api-access-54mf5\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-vvc2c\" (UID: \"9c2042a6-e856-4270-a401-60fae6f8858b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vvc2c" Jul 02 23:14:12.716942 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:14:12.716850 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9c2042a6-e856-4270-a401-60fae6f8858b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-vvc2c\" (UID: \"9c2042a6-e856-4270-a401-60fae6f8858b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vvc2c" Jul 02 23:14:12.717272 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:14:12.717251 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9c2042a6-e856-4270-a401-60fae6f8858b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-vvc2c\" (UID: \"9c2042a6-e856-4270-a401-60fae6f8858b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vvc2c" Jul 02 23:14:12.732997 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:14:12.732974 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-54mf5\" (UniqueName: \"kubernetes.io/projected/9c2042a6-e856-4270-a401-60fae6f8858b-kube-api-access-54mf5\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-vvc2c\" (UID: \"9c2042a6-e856-4270-a401-60fae6f8858b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vvc2c" Jul 02 23:14:13.093516 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:14:13.093489 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vvc2c" Jul 02 23:14:13.100807 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:14:13.100783 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vvc2c" Jul 02 23:14:13.128038 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:14:13.128008 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vvc2c"] Jul 02 23:14:13.139792 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:14:13.139764 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vvc2c"] Jul 02 23:14:13.221443 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:14:13.221415 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9c2042a6-e856-4270-a401-60fae6f8858b-extensions-socket-volume\") pod \"9c2042a6-e856-4270-a401-60fae6f8858b\" (UID: \"9c2042a6-e856-4270-a401-60fae6f8858b\") " Jul 02 23:14:13.221585 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:14:13.221483 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-54mf5\" (UniqueName: \"kubernetes.io/projected/9c2042a6-e856-4270-a401-60fae6f8858b-kube-api-access-54mf5\") pod \"9c2042a6-e856-4270-a401-60fae6f8858b\" (UID: \"9c2042a6-e856-4270-a401-60fae6f8858b\") " Jul 02 23:14:13.221773 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:14:13.221713 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c2042a6-e856-4270-a401-60fae6f8858b-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "9c2042a6-e856-4270-a401-60fae6f8858b" (UID: "9c2042a6-e856-4270-a401-60fae6f8858b"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 23:14:13.224114 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:14:13.224087 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c2042a6-e856-4270-a401-60fae6f8858b-kube-api-access-54mf5" (OuterVolumeSpecName: "kube-api-access-54mf5") pod "9c2042a6-e856-4270-a401-60fae6f8858b" (UID: "9c2042a6-e856-4270-a401-60fae6f8858b"). InnerVolumeSpecName "kube-api-access-54mf5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 23:14:13.323067 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:14:13.323035 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-54mf5\" (UniqueName: \"kubernetes.io/projected/9c2042a6-e856-4270-a401-60fae6f8858b-kube-api-access-54mf5\") on node \"ip-10-0-131-33.ec2.internal\" DevicePath \"\"" Jul 02 23:14:13.323067 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:14:13.323062 2563 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9c2042a6-e856-4270-a401-60fae6f8858b-extensions-socket-volume\") on node \"ip-10-0-131-33.ec2.internal\" DevicePath \"\"" Jul 02 23:14:13.849556 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:14:13.849524 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9c2042a6-e856-4270-a401-60fae6f8858b" path="/var/lib/kubelet/pods/9c2042a6-e856-4270-a401-60fae6f8858b/volumes" Jul 02 23:14:14.098547 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:14:14.098517 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vvc2c" Jul 02 23:15:02.441683 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:15:02.441645 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6vvc9"] Jul 02 23:15:02.444998 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:15:02.444981 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-6vvc9" Jul 02 23:15:02.447185 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:15:02.447168 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 02 23:15:02.447276 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:15:02.447172 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-ccp89\"" Jul 02 23:15:02.447276 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:15:02.447201 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 02 23:15:02.448001 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:15:02.447985 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 02 23:15:02.452597 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:15:02.452347 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6vvc9"] Jul 02 23:15:02.479022 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:15:02.478987 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6vvc9"] Jul 02 23:15:02.546627 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:15:02.546593 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-64mwh\" (UniqueName: \"kubernetes.io/projected/917e9f31-e626-4c3c-9cc9-81bf6c4d66e6-kube-api-access-64mwh\") pod \"limitador-limitador-54d6d988d5-6vvc9\" (UID: \"917e9f31-e626-4c3c-9cc9-81bf6c4d66e6\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-6vvc9" Jul 02 23:15:02.546820 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:15:02.546636 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/917e9f31-e626-4c3c-9cc9-81bf6c4d66e6-config-file\") pod \"limitador-limitador-54d6d988d5-6vvc9\" (UID: \"917e9f31-e626-4c3c-9cc9-81bf6c4d66e6\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-6vvc9" Jul 02 23:15:02.647606 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:15:02.647569 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-64mwh\" (UniqueName: \"kubernetes.io/projected/917e9f31-e626-4c3c-9cc9-81bf6c4d66e6-kube-api-access-64mwh\") pod \"limitador-limitador-54d6d988d5-6vvc9\" (UID: \"917e9f31-e626-4c3c-9cc9-81bf6c4d66e6\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-6vvc9" Jul 02 23:15:02.647606 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:15:02.647616 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/917e9f31-e626-4c3c-9cc9-81bf6c4d66e6-config-file\") pod \"limitador-limitador-54d6d988d5-6vvc9\" (UID: \"917e9f31-e626-4c3c-9cc9-81bf6c4d66e6\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-6vvc9" Jul 02 23:15:02.648287 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:15:02.648268 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/917e9f31-e626-4c3c-9cc9-81bf6c4d66e6-config-file\") pod \"limitador-limitador-54d6d988d5-6vvc9\" (UID: \"917e9f31-e626-4c3c-9cc9-81bf6c4d66e6\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-6vvc9" Jul 02 23:15:02.655425 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:15:02.655406 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-64mwh\" (UniqueName: \"kubernetes.io/projected/917e9f31-e626-4c3c-9cc9-81bf6c4d66e6-kube-api-access-64mwh\") pod \"limitador-limitador-54d6d988d5-6vvc9\" (UID: \"917e9f31-e626-4c3c-9cc9-81bf6c4d66e6\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-6vvc9" Jul 02 23:15:02.756828 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:15:02.756719 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-6vvc9" Jul 02 23:15:02.891773 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:15:02.891730 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6vvc9"] Jul 02 23:15:02.893629 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:15:02.893604 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod917e9f31_e626_4c3c_9cc9_81bf6c4d66e6.slice/crio-e88513e7e731971708c7315cd5ecca12c9ffcf8ba117e75e8239aeeebd446d87 WatchSource:0}: Error finding container e88513e7e731971708c7315cd5ecca12c9ffcf8ba117e75e8239aeeebd446d87: Status 404 returned error can't find the container with id e88513e7e731971708c7315cd5ecca12c9ffcf8ba117e75e8239aeeebd446d87 Jul 02 23:15:03.358223 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:15:03.358185 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-6vvc9" event={"ID":"917e9f31-e626-4c3c-9cc9-81bf6c4d66e6","Type":"ContainerStarted","Data":"e88513e7e731971708c7315cd5ecca12c9ffcf8ba117e75e8239aeeebd446d87"} Jul 02 23:15:06.377940 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:15:06.377891 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-6vvc9" event={"ID":"917e9f31-e626-4c3c-9cc9-81bf6c4d66e6","Type":"ContainerStarted","Data":"b8f7f64088ab2ac89cd18552525481d6969760c830eecd6ee6b96e7df3c7761b"} Jul 02 23:15:06.378327 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:15:06.378067 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-6vvc9" Jul 02 23:15:06.395371 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:15:06.395327 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-6vvc9" podStartSLOduration=1.8232429460000001 podStartE2EDuration="4.395312035s" totalImagesPullingTime="2.572069089s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:15:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:15:06.394587667 +0000 UTC m=+483.027628836" watchObservedRunningTime="2026-07-02 23:15:06.395312035 +0000 UTC m=+483.028353176" Jul 02 23:15:17.384323 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:15:17.384291 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-6vvc9" Jul 02 23:16:14.405914 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:16:14.405878 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6vvc9"] Jul 02 23:16:35.647874 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:16:35.647834 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6vvc9"] Jul 02 23:16:48.135236 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:16:48.135201 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6vvc9"] Jul 02 23:17:03.752373 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:17:03.752345 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-wljkx_5d4e781e-d925-477e-98c6-cb41099c6cb0/console-operator/1.log" Jul 02 23:17:03.757480 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:17:03.757457 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hhc6h_f946205c-023a-4a7d-9a6c-c40b23c3b771/ovn-acl-logging/0.log" Jul 02 23:17:03.762111 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:17:03.762095 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-wljkx_5d4e781e-d925-477e-98c6-cb41099c6cb0/console-operator/1.log" Jul 02 23:17:03.767148 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:17:03.767130 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hhc6h_f946205c-023a-4a7d-9a6c-c40b23c3b771/ovn-acl-logging/0.log" Jul 02 23:17:09.734606 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:17:09.734570 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6vvc9"] Jul 02 23:17:18.031805 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:17:18.031773 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjxcnc"] Jul 02 23:17:18.034938 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:17:18.034921 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjxcnc" Jul 02 23:17:18.037939 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:17:18.037914 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 02 23:17:18.038060 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:17:18.037923 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 02 23:17:18.038832 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:17:18.038813 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-n58qc\"" Jul 02 23:17:18.038904 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:17:18.038874 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jul 02 23:17:18.044531 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:17:18.044506 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjxcnc"] Jul 02 23:17:18.112713 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:17:18.112674 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6fd4aa5c-b693-4f48-8f3e-b1674282a6e0-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjxcnc\" (UID: \"6fd4aa5c-b693-4f48-8f3e-b1674282a6e0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjxcnc" Jul 02 23:17:18.112892 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:17:18.112719 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ncgln\" (UniqueName: \"kubernetes.io/projected/6fd4aa5c-b693-4f48-8f3e-b1674282a6e0-kube-api-access-ncgln\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjxcnc\" (UID: \"6fd4aa5c-b693-4f48-8f3e-b1674282a6e0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjxcnc" Jul 02 23:17:18.112892 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:17:18.112764 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6fd4aa5c-b693-4f48-8f3e-b1674282a6e0-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjxcnc\" (UID: \"6fd4aa5c-b693-4f48-8f3e-b1674282a6e0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjxcnc" Jul 02 23:17:18.112892 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:17:18.112785 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6fd4aa5c-b693-4f48-8f3e-b1674282a6e0-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjxcnc\" (UID: \"6fd4aa5c-b693-4f48-8f3e-b1674282a6e0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjxcnc" Jul 02 23:17:18.112892 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:17:18.112817 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6fd4aa5c-b693-4f48-8f3e-b1674282a6e0-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjxcnc\" (UID: \"6fd4aa5c-b693-4f48-8f3e-b1674282a6e0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjxcnc" Jul 02 23:17:18.112892 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:17:18.112863 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6fd4aa5c-b693-4f48-8f3e-b1674282a6e0-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjxcnc\" (UID: \"6fd4aa5c-b693-4f48-8f3e-b1674282a6e0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjxcnc" Jul 02 23:17:18.213950 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:17:18.213912 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6fd4aa5c-b693-4f48-8f3e-b1674282a6e0-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjxcnc\" (UID: \"6fd4aa5c-b693-4f48-8f3e-b1674282a6e0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjxcnc" Jul 02 23:17:18.214155 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:17:18.213957 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ncgln\" (UniqueName: \"kubernetes.io/projected/6fd4aa5c-b693-4f48-8f3e-b1674282a6e0-kube-api-access-ncgln\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjxcnc\" (UID: \"6fd4aa5c-b693-4f48-8f3e-b1674282a6e0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjxcnc" Jul 02 23:17:18.214155 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:17:18.213978 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6fd4aa5c-b693-4f48-8f3e-b1674282a6e0-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjxcnc\" (UID: \"6fd4aa5c-b693-4f48-8f3e-b1674282a6e0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjxcnc" Jul 02 23:17:18.214155 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:17:18.213996 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6fd4aa5c-b693-4f48-8f3e-b1674282a6e0-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjxcnc\" (UID: \"6fd4aa5c-b693-4f48-8f3e-b1674282a6e0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjxcnc" Jul 02 23:17:18.214155 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:17:18.214032 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6fd4aa5c-b693-4f48-8f3e-b1674282a6e0-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjxcnc\" (UID: \"6fd4aa5c-b693-4f48-8f3e-b1674282a6e0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjxcnc" Jul 02 23:17:18.214155 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:17:18.214071 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6fd4aa5c-b693-4f48-8f3e-b1674282a6e0-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjxcnc\" (UID: \"6fd4aa5c-b693-4f48-8f3e-b1674282a6e0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjxcnc" Jul 02 23:17:18.214423 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:17:18.214305 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6fd4aa5c-b693-4f48-8f3e-b1674282a6e0-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjxcnc\" (UID: \"6fd4aa5c-b693-4f48-8f3e-b1674282a6e0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjxcnc" Jul 02 23:17:18.214423 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:17:18.214374 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6fd4aa5c-b693-4f48-8f3e-b1674282a6e0-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjxcnc\" (UID: \"6fd4aa5c-b693-4f48-8f3e-b1674282a6e0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjxcnc" Jul 02 23:17:18.214519 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:17:18.214428 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6fd4aa5c-b693-4f48-8f3e-b1674282a6e0-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjxcnc\" (UID: \"6fd4aa5c-b693-4f48-8f3e-b1674282a6e0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjxcnc" Jul 02 23:17:18.216527 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:17:18.216498 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6fd4aa5c-b693-4f48-8f3e-b1674282a6e0-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjxcnc\" (UID: \"6fd4aa5c-b693-4f48-8f3e-b1674282a6e0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjxcnc" Jul 02 23:17:18.216692 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:17:18.216676 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6fd4aa5c-b693-4f48-8f3e-b1674282a6e0-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjxcnc\" (UID: \"6fd4aa5c-b693-4f48-8f3e-b1674282a6e0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjxcnc" Jul 02 23:17:18.221826 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:17:18.221792 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ncgln\" (UniqueName: \"kubernetes.io/projected/6fd4aa5c-b693-4f48-8f3e-b1674282a6e0-kube-api-access-ncgln\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjxcnc\" (UID: \"6fd4aa5c-b693-4f48-8f3e-b1674282a6e0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjxcnc" Jul 02 23:17:18.347308 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:17:18.347204 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjxcnc" Jul 02 23:17:18.484820 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:17:18.484796 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjxcnc"] Jul 02 23:17:18.486387 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:17:18.486357 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6fd4aa5c_b693_4f48_8f3e_b1674282a6e0.slice/crio-e2067814ce4ca246973065c1365e5248bf733e83d3df744ca148f11b62e4bbe9 WatchSource:0}: Error finding container e2067814ce4ca246973065c1365e5248bf733e83d3df744ca148f11b62e4bbe9: Status 404 returned error can't find the container with id e2067814ce4ca246973065c1365e5248bf733e83d3df744ca148f11b62e4bbe9 Jul 02 23:17:18.488140 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:17:18.488121 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 02 23:17:19.067455 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:17:19.067416 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjxcnc" event={"ID":"6fd4aa5c-b693-4f48-8f3e-b1674282a6e0","Type":"ContainerStarted","Data":"e2067814ce4ca246973065c1365e5248bf733e83d3df744ca148f11b62e4bbe9"} Jul 02 23:17:19.630356 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:17:19.630315 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6vvc9"] Jul 02 23:17:20.073806 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:17:20.073771 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjxcnc" event={"ID":"6fd4aa5c-b693-4f48-8f3e-b1674282a6e0","Type":"ContainerStarted","Data":"289a17e42dcaedd84f67824eeb8da92daefb0e1a4ea8d238224c49b377e54ea6"} Jul 02 23:17:20.094051 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:17:20.094002 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjxcnc" podStartSLOduration=1.084177878 podStartE2EDuration="2.093987003s" totalImagesPullingTime="1.009809125s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:17:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:17:20.091321307 +0000 UTC m=+616.724362476" watchObservedRunningTime="2026-07-02 23:17:20.093987003 +0000 UTC m=+616.727028146" Jul 02 23:17:25.039521 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:17:25.039440 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6vvc9"] Jul 02 23:17:28.347802 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:17:28.347759 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjxcnc" Jul 02 23:17:28.348223 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:17:28.347864 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjxcnc" Jul 02 23:17:28.360522 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:17:28.360498 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjxcnc" Jul 02 23:17:29.137951 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:17:29.137919 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjxcnc" Jul 02 23:17:41.734689 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:17:41.734657 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6vvc9"] Jul 02 23:19:19.947227 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:19:19.947196 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6vvc9"] Jul 02 23:19:29.825403 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:19:29.825366 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6vvc9"] Jul 02 23:19:39.242317 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:19:39.242272 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6vvc9"] Jul 02 23:19:49.434340 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:19:49.434301 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6vvc9"] Jul 02 23:19:59.225924 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:19:59.225889 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6vvc9"] Jul 02 23:21:06.531957 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:21:06.531916 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6vvc9"] Jul 02 23:21:15.755877 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:21:15.755803 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6vvc9"] Jul 02 23:21:25.532472 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:21:25.532439 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6vvc9"] Jul 02 23:21:34.841227 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:21:34.841189 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6vvc9"] Jul 02 23:21:45.638720 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:21:45.638676 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6vvc9"] Jul 02 23:21:55.238108 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:21:55.238017 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6vvc9"] Jul 02 23:22:03.789359 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:22:03.789328 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-wljkx_5d4e781e-d925-477e-98c6-cb41099c6cb0/console-operator/1.log" Jul 02 23:22:03.794659 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:22:03.794636 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hhc6h_f946205c-023a-4a7d-9a6c-c40b23c3b771/ovn-acl-logging/0.log" Jul 02 23:22:03.797561 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:22:03.797539 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-wljkx_5d4e781e-d925-477e-98c6-cb41099c6cb0/console-operator/1.log" Jul 02 23:22:03.803000 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:22:03.802983 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hhc6h_f946205c-023a-4a7d-9a6c-c40b23c3b771/ovn-acl-logging/0.log" Jul 02 23:22:06.929861 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:22:06.929821 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6vvc9"] Jul 02 23:22:16.631575 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:22:16.631544 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6vvc9"] Jul 02 23:22:38.834512 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:22:38.834476 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6vvc9"] Jul 02 23:22:51.230046 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:22:51.230007 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6vvc9"] Jul 02 23:23:13.741121 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:23:13.741084 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6vvc9"] Jul 02 23:23:24.739403 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:23:24.739311 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6vvc9"] Jul 02 23:23:40.934688 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:23:40.934653 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6vvc9"] Jul 02 23:23:50.231729 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:23:50.231695 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6vvc9"] Jul 02 23:23:59.639999 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:23:59.639961 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6vvc9"] Jul 02 23:24:09.830408 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:24:09.830370 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6vvc9"] Jul 02 23:24:19.325852 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:24:19.325816 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6vvc9"] Jul 02 23:26:06.104975 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:26:06.104933 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6vvc9"] Jul 02 23:26:14.997827 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:26:14.997793 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6vvc9"] Jul 02 23:26:27.611564 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:26:27.611481 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6vvc9"] Jul 02 23:26:39.108529 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:26:39.108477 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6vvc9"] Jul 02 23:26:50.706898 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:26:50.706860 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6vvc9"] Jul 02 23:27:00.105461 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:27:00.105426 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6vvc9"] Jul 02 23:27:03.827361 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:27:03.827334 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-wljkx_5d4e781e-d925-477e-98c6-cb41099c6cb0/console-operator/1.log" Jul 02 23:27:03.832585 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:27:03.832562 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hhc6h_f946205c-023a-4a7d-9a6c-c40b23c3b771/ovn-acl-logging/0.log" Jul 02 23:27:03.832756 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:27:03.832681 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-wljkx_5d4e781e-d925-477e-98c6-cb41099c6cb0/console-operator/1.log" Jul 02 23:27:03.837982 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:27:03.837963 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hhc6h_f946205c-023a-4a7d-9a6c-c40b23c3b771/ovn-acl-logging/0.log" Jul 02 23:27:10.304612 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:27:10.304578 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6vvc9"] Jul 02 23:27:19.805514 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:27:19.805477 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6vvc9"] Jul 02 23:27:31.808732 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:27:31.808694 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6vvc9"] Jul 02 23:27:40.806192 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:27:40.806154 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6vvc9"] Jul 02 23:27:51.507360 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:27:51.507326 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6vvc9"] Jul 02 23:28:15.419791 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:28:15.419760 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6vvc9"] Jul 02 23:28:23.104230 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:28:23.104195 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6vvc9"] Jul 02 23:28:32.310382 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:28:32.310348 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6vvc9"] Jul 02 23:28:41.806914 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:28:41.806878 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6vvc9"] Jul 02 23:29:00.503726 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:29:00.503691 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6vvc9"] Jul 02 23:29:10.306801 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:29:10.306760 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6vvc9"] Jul 02 23:29:19.702641 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:29:19.702606 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6vvc9"] Jul 02 23:29:30.107878 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:29:30.107797 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6vvc9"] Jul 02 23:29:39.009585 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:29:39.009551 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6vvc9"] Jul 02 23:29:48.603958 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:29:48.603918 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6vvc9"] Jul 02 23:30:01.606320 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:30:01.606276 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6vvc9"] Jul 02 23:30:10.804403 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:30:10.804359 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6vvc9"] Jul 02 23:30:20.005509 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:30:20.005472 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6vvc9"] Jul 02 23:30:32.308093 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:30:32.308055 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6vvc9"] Jul 02 23:30:41.805786 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:30:41.805733 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6vvc9"] Jul 02 23:30:52.305642 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:30:52.305606 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6vvc9"] Jul 02 23:31:04.707787 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:31:04.707688 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6vvc9"] Jul 02 23:31:17.609207 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:31:17.609169 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6vvc9"] Jul 02 23:31:26.808283 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:31:26.808247 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6vvc9"] Jul 02 23:31:40.108101 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:31:40.108066 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6vvc9"] Jul 02 23:31:51.503731 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:31:51.503698 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6vvc9"] Jul 02 23:31:58.385994 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:31:58.385948 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-ait-4f93315a-5ff9bbc75d-88w4s"] Jul 02 23:31:58.389825 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:31:58.389797 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-4f93315a-5ff9bbc75d-88w4s" Jul 02 23:31:58.392025 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:31:58.391989 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-ait-4f93315a-serving-cert\"" Jul 02 23:31:58.392140 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:31:58.392061 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-c9hnp\"" Jul 02 23:31:58.400696 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:31:58.400668 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-4f93315a-5ff9bbc75d-88w4s"] Jul 02 23:31:58.453285 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:31:58.453247 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5ab69ac7-174a-407a-9571-4e25a5366fee-openshift-service-ca\") pod \"maas-api-e2e-ait-4f93315a-5ff9bbc75d-88w4s\" (UID: \"5ab69ac7-174a-407a-9571-4e25a5366fee\") " pod="opendatahub/maas-api-e2e-ait-4f93315a-5ff9bbc75d-88w4s" Jul 02 23:31:58.453440 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:31:58.453303 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5ab69ac7-174a-407a-9571-4e25a5366fee-maas-api-tls\") pod \"maas-api-e2e-ait-4f93315a-5ff9bbc75d-88w4s\" (UID: \"5ab69ac7-174a-407a-9571-4e25a5366fee\") " pod="opendatahub/maas-api-e2e-ait-4f93315a-5ff9bbc75d-88w4s" Jul 02 23:31:58.453440 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:31:58.453331 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58ndz\" (UniqueName: \"kubernetes.io/projected/5ab69ac7-174a-407a-9571-4e25a5366fee-kube-api-access-58ndz\") pod \"maas-api-e2e-ait-4f93315a-5ff9bbc75d-88w4s\" (UID: \"5ab69ac7-174a-407a-9571-4e25a5366fee\") " pod="opendatahub/maas-api-e2e-ait-4f93315a-5ff9bbc75d-88w4s" Jul 02 23:31:58.553785 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:31:58.553728 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5ab69ac7-174a-407a-9571-4e25a5366fee-maas-api-tls\") pod \"maas-api-e2e-ait-4f93315a-5ff9bbc75d-88w4s\" (UID: \"5ab69ac7-174a-407a-9571-4e25a5366fee\") " pod="opendatahub/maas-api-e2e-ait-4f93315a-5ff9bbc75d-88w4s" Jul 02 23:31:58.553785 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:31:58.553787 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58ndz\" (UniqueName: \"kubernetes.io/projected/5ab69ac7-174a-407a-9571-4e25a5366fee-kube-api-access-58ndz\") pod \"maas-api-e2e-ait-4f93315a-5ff9bbc75d-88w4s\" (UID: \"5ab69ac7-174a-407a-9571-4e25a5366fee\") " pod="opendatahub/maas-api-e2e-ait-4f93315a-5ff9bbc75d-88w4s" Jul 02 23:31:58.553985 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:31:58.553871 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5ab69ac7-174a-407a-9571-4e25a5366fee-openshift-service-ca\") pod \"maas-api-e2e-ait-4f93315a-5ff9bbc75d-88w4s\" (UID: \"5ab69ac7-174a-407a-9571-4e25a5366fee\") " pod="opendatahub/maas-api-e2e-ait-4f93315a-5ff9bbc75d-88w4s" Jul 02 23:31:58.554446 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:31:58.554428 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5ab69ac7-174a-407a-9571-4e25a5366fee-openshift-service-ca\") pod \"maas-api-e2e-ait-4f93315a-5ff9bbc75d-88w4s\" (UID: \"5ab69ac7-174a-407a-9571-4e25a5366fee\") " pod="opendatahub/maas-api-e2e-ait-4f93315a-5ff9bbc75d-88w4s" Jul 02 23:31:58.556343 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:31:58.556324 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5ab69ac7-174a-407a-9571-4e25a5366fee-maas-api-tls\") pod \"maas-api-e2e-ait-4f93315a-5ff9bbc75d-88w4s\" (UID: \"5ab69ac7-174a-407a-9571-4e25a5366fee\") " pod="opendatahub/maas-api-e2e-ait-4f93315a-5ff9bbc75d-88w4s" Jul 02 23:31:58.566547 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:31:58.566526 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-58ndz\" (UniqueName: \"kubernetes.io/projected/5ab69ac7-174a-407a-9571-4e25a5366fee-kube-api-access-58ndz\") pod \"maas-api-e2e-ait-4f93315a-5ff9bbc75d-88w4s\" (UID: \"5ab69ac7-174a-407a-9571-4e25a5366fee\") " pod="opendatahub/maas-api-e2e-ait-4f93315a-5ff9bbc75d-88w4s" Jul 02 23:31:58.701907 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:31:58.701867 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-4f93315a-5ff9bbc75d-88w4s" Jul 02 23:31:58.839501 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:31:58.839472 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-4f93315a-5ff9bbc75d-88w4s"] Jul 02 23:31:58.840969 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:31:58.840941 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ab69ac7_174a_407a_9571_4e25a5366fee.slice/crio-0782bddcb31611afa2839933a6150b210ea43d89e65255a15d64a6c9ecdc4333 WatchSource:0}: Error finding container 0782bddcb31611afa2839933a6150b210ea43d89e65255a15d64a6c9ecdc4333: Status 404 returned error can't find the container with id 0782bddcb31611afa2839933a6150b210ea43d89e65255a15d64a6c9ecdc4333 Jul 02 23:31:58.842363 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:31:58.842347 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 02 23:31:59.756409 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:31:59.756367 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-4f93315a-5ff9bbc75d-88w4s" event={"ID":"5ab69ac7-174a-407a-9571-4e25a5366fee","Type":"ContainerStarted","Data":"0782bddcb31611afa2839933a6150b210ea43d89e65255a15d64a6c9ecdc4333"} Jul 02 23:32:00.764052 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:32:00.763961 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-4f93315a-5ff9bbc75d-88w4s" event={"ID":"5ab69ac7-174a-407a-9571-4e25a5366fee","Type":"ContainerStarted","Data":"46bc031c0a77d84562a2a417274aeb30912a990e1392ce3a25a88b1408fa113b"} Jul 02 23:32:00.764431 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:32:00.764060 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-4f93315a-5ff9bbc75d-88w4s" Jul 02 23:32:00.781371 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:32:00.781315 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-ait-4f93315a-5ff9bbc75d-88w4s" podStartSLOduration=1.150639042 podStartE2EDuration="2.781300589s" totalImagesPullingTime="1.630661547s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:31:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:32:00.778137445 +0000 UTC m=+1497.411178599" watchObservedRunningTime="2026-07-02 23:32:00.781300589 +0000 UTC m=+1497.414341710" Jul 02 23:32:01.708116 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:32:01.708078 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6vvc9"] Jul 02 23:32:03.854706 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:32:03.854673 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-4f93315a-5ff9bbc75d-88w4s"] Jul 02 23:32:03.855342 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:32:03.854868 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-ait-4f93315a-5ff9bbc75d-88w4s" podUID="5ab69ac7-174a-407a-9571-4e25a5366fee" containerName="maas-api" containerID="cri-o://46bc031c0a77d84562a2a417274aeb30912a990e1392ce3a25a88b1408fa113b" gracePeriod=30 Jul 02 23:32:03.877962 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:32:03.877936 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-wljkx_5d4e781e-d925-477e-98c6-cb41099c6cb0/console-operator/1.log" Jul 02 23:32:03.879391 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:32:03.879370 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-wljkx_5d4e781e-d925-477e-98c6-cb41099c6cb0/console-operator/1.log" Jul 02 23:32:03.882940 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:32:03.882925 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hhc6h_f946205c-023a-4a7d-9a6c-c40b23c3b771/ovn-acl-logging/0.log" Jul 02 23:32:03.891151 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:32:03.891109 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hhc6h_f946205c-023a-4a7d-9a6c-c40b23c3b771/ovn-acl-logging/0.log" Jul 02 23:32:04.107067 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:32:04.107012 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-4f93315a-5ff9bbc75d-88w4s" Jul 02 23:32:04.204599 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:32:04.204572 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-58ndz\" (UniqueName: \"kubernetes.io/projected/5ab69ac7-174a-407a-9571-4e25a5366fee-kube-api-access-58ndz\") pod \"5ab69ac7-174a-407a-9571-4e25a5366fee\" (UID: \"5ab69ac7-174a-407a-9571-4e25a5366fee\") " Jul 02 23:32:04.204797 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:32:04.204655 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5ab69ac7-174a-407a-9571-4e25a5366fee-openshift-service-ca\") pod \"5ab69ac7-174a-407a-9571-4e25a5366fee\" (UID: \"5ab69ac7-174a-407a-9571-4e25a5366fee\") " Jul 02 23:32:04.204797 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:32:04.204686 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5ab69ac7-174a-407a-9571-4e25a5366fee-maas-api-tls\") pod \"5ab69ac7-174a-407a-9571-4e25a5366fee\" (UID: \"5ab69ac7-174a-407a-9571-4e25a5366fee\") " Jul 02 23:32:04.205087 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:32:04.205060 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ab69ac7-174a-407a-9571-4e25a5366fee-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5ab69ac7-174a-407a-9571-4e25a5366fee" (UID: "5ab69ac7-174a-407a-9571-4e25a5366fee"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 23:32:04.207054 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:32:04.207028 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ab69ac7-174a-407a-9571-4e25a5366fee-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5ab69ac7-174a-407a-9571-4e25a5366fee" (UID: "5ab69ac7-174a-407a-9571-4e25a5366fee"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 23:32:04.207115 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:32:04.207060 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ab69ac7-174a-407a-9571-4e25a5366fee-kube-api-access-58ndz" (OuterVolumeSpecName: "kube-api-access-58ndz") pod "5ab69ac7-174a-407a-9571-4e25a5366fee" (UID: "5ab69ac7-174a-407a-9571-4e25a5366fee"). InnerVolumeSpecName "kube-api-access-58ndz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 23:32:04.306190 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:32:04.306144 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-58ndz\" (UniqueName: \"kubernetes.io/projected/5ab69ac7-174a-407a-9571-4e25a5366fee-kube-api-access-58ndz\") on node \"ip-10-0-131-33.ec2.internal\" DevicePath \"\"" Jul 02 23:32:04.306190 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:32:04.306171 2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5ab69ac7-174a-407a-9571-4e25a5366fee-openshift-service-ca\") on node \"ip-10-0-131-33.ec2.internal\" DevicePath \"\"" Jul 02 23:32:04.306190 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:32:04.306181 2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5ab69ac7-174a-407a-9571-4e25a5366fee-maas-api-tls\") on node \"ip-10-0-131-33.ec2.internal\" DevicePath \"\"" Jul 02 23:32:04.788149 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:32:04.788116 2563 generic.go:356] "Generic (PLEG): container finished" podID="5ab69ac7-174a-407a-9571-4e25a5366fee" containerID="46bc031c0a77d84562a2a417274aeb30912a990e1392ce3a25a88b1408fa113b" exitCode=0 Jul 02 23:32:04.788317 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:32:04.788157 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-4f93315a-5ff9bbc75d-88w4s" Jul 02 23:32:04.788317 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:32:04.788161 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-4f93315a-5ff9bbc75d-88w4s" event={"ID":"5ab69ac7-174a-407a-9571-4e25a5366fee","Type":"ContainerDied","Data":"46bc031c0a77d84562a2a417274aeb30912a990e1392ce3a25a88b1408fa113b"} Jul 02 23:32:04.788317 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:32:04.788240 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-4f93315a-5ff9bbc75d-88w4s" event={"ID":"5ab69ac7-174a-407a-9571-4e25a5366fee","Type":"ContainerDied","Data":"0782bddcb31611afa2839933a6150b210ea43d89e65255a15d64a6c9ecdc4333"} Jul 02 23:32:04.788317 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:32:04.788264 2563 scope.go:117] "RemoveContainer" containerID="46bc031c0a77d84562a2a417274aeb30912a990e1392ce3a25a88b1408fa113b" Jul 02 23:32:04.800622 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:32:04.800599 2563 scope.go:117] "RemoveContainer" containerID="46bc031c0a77d84562a2a417274aeb30912a990e1392ce3a25a88b1408fa113b" Jul 02 23:32:04.800932 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:32:04.800915 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"46bc031c0a77d84562a2a417274aeb30912a990e1392ce3a25a88b1408fa113b\": container with ID starting with 46bc031c0a77d84562a2a417274aeb30912a990e1392ce3a25a88b1408fa113b not found: ID does not exist" containerID="46bc031c0a77d84562a2a417274aeb30912a990e1392ce3a25a88b1408fa113b" Jul 02 23:32:04.800992 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:32:04.800941 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"46bc031c0a77d84562a2a417274aeb30912a990e1392ce3a25a88b1408fa113b"} err="failed to get container status \"46bc031c0a77d84562a2a417274aeb30912a990e1392ce3a25a88b1408fa113b\": rpc error: code = NotFound desc = could not find container \"46bc031c0a77d84562a2a417274aeb30912a990e1392ce3a25a88b1408fa113b\": container with ID starting with 46bc031c0a77d84562a2a417274aeb30912a990e1392ce3a25a88b1408fa113b not found: ID does not exist" Jul 02 23:32:04.809297 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:32:04.809274 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-4f93315a-5ff9bbc75d-88w4s"] Jul 02 23:32:04.812316 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:32:04.812294 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-ait-4f93315a-5ff9bbc75d-88w4s"] Jul 02 23:32:05.850021 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:32:05.849992 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5ab69ac7-174a-407a-9571-4e25a5366fee" path="/var/lib/kubelet/pods/5ab69ac7-174a-407a-9571-4e25a5366fee/volumes" Jul 02 23:32:12.611455 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:32:12.611419 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6vvc9"] Jul 02 23:32:32.207833 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:32:32.207795 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6vvc9"] Jul 02 23:32:43.610675 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:32:43.610636 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6vvc9"] Jul 02 23:34:02.408413 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:34:02.408322 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6vvc9"] Jul 02 23:34:11.411792 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:34:11.411734 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6vvc9"] Jul 02 23:34:17.255148 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:34:17.255104 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-mt-ceefe56c-65c6755cd5-7gqzh"] Jul 02 23:34:17.255774 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:34:17.255672 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ab69ac7-174a-407a-9571-4e25a5366fee" containerName="maas-api" Jul 02 23:34:17.255774 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:34:17.255691 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ab69ac7-174a-407a-9571-4e25a5366fee" containerName="maas-api" Jul 02 23:34:17.255923 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:34:17.255801 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ab69ac7-174a-407a-9571-4e25a5366fee" containerName="maas-api" Jul 02 23:34:17.259221 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:34:17.259200 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-ceefe56c-65c6755cd5-7gqzh" Jul 02 23:34:17.261682 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:34:17.261658 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-mt-ceefe56c-serving-cert\"" Jul 02 23:34:17.261847 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:34:17.261705 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-c9hnp\"" Jul 02 23:34:17.272386 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:34:17.272351 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-ceefe56c-65c6755cd5-7gqzh"] Jul 02 23:34:17.402616 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:34:17.402578 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t2wxp\" (UniqueName: \"kubernetes.io/projected/7d80b4e9-5d93-4298-bae4-4408ba9bba03-kube-api-access-t2wxp\") pod \"maas-api-e2e-mt-ceefe56c-65c6755cd5-7gqzh\" (UID: \"7d80b4e9-5d93-4298-bae4-4408ba9bba03\") " pod="opendatahub/maas-api-e2e-mt-ceefe56c-65c6755cd5-7gqzh" Jul 02 23:34:17.402616 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:34:17.402633 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7d80b4e9-5d93-4298-bae4-4408ba9bba03-openshift-service-ca\") pod \"maas-api-e2e-mt-ceefe56c-65c6755cd5-7gqzh\" (UID: \"7d80b4e9-5d93-4298-bae4-4408ba9bba03\") " pod="opendatahub/maas-api-e2e-mt-ceefe56c-65c6755cd5-7gqzh" Jul 02 23:34:17.402870 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:34:17.402665 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7d80b4e9-5d93-4298-bae4-4408ba9bba03-maas-api-tls\") pod \"maas-api-e2e-mt-ceefe56c-65c6755cd5-7gqzh\" (UID: \"7d80b4e9-5d93-4298-bae4-4408ba9bba03\") " pod="opendatahub/maas-api-e2e-mt-ceefe56c-65c6755cd5-7gqzh" Jul 02 23:34:17.503623 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:34:17.503582 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t2wxp\" (UniqueName: \"kubernetes.io/projected/7d80b4e9-5d93-4298-bae4-4408ba9bba03-kube-api-access-t2wxp\") pod \"maas-api-e2e-mt-ceefe56c-65c6755cd5-7gqzh\" (UID: \"7d80b4e9-5d93-4298-bae4-4408ba9bba03\") " pod="opendatahub/maas-api-e2e-mt-ceefe56c-65c6755cd5-7gqzh" Jul 02 23:34:17.503899 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:34:17.503634 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7d80b4e9-5d93-4298-bae4-4408ba9bba03-openshift-service-ca\") pod \"maas-api-e2e-mt-ceefe56c-65c6755cd5-7gqzh\" (UID: \"7d80b4e9-5d93-4298-bae4-4408ba9bba03\") " pod="opendatahub/maas-api-e2e-mt-ceefe56c-65c6755cd5-7gqzh" Jul 02 23:34:17.503899 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:34:17.503660 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7d80b4e9-5d93-4298-bae4-4408ba9bba03-maas-api-tls\") pod \"maas-api-e2e-mt-ceefe56c-65c6755cd5-7gqzh\" (UID: \"7d80b4e9-5d93-4298-bae4-4408ba9bba03\") " pod="opendatahub/maas-api-e2e-mt-ceefe56c-65c6755cd5-7gqzh" Jul 02 23:34:17.504304 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:34:17.504282 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7d80b4e9-5d93-4298-bae4-4408ba9bba03-openshift-service-ca\") pod \"maas-api-e2e-mt-ceefe56c-65c6755cd5-7gqzh\" (UID: \"7d80b4e9-5d93-4298-bae4-4408ba9bba03\") " pod="opendatahub/maas-api-e2e-mt-ceefe56c-65c6755cd5-7gqzh" Jul 02 23:34:17.506403 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:34:17.506348 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7d80b4e9-5d93-4298-bae4-4408ba9bba03-maas-api-tls\") pod \"maas-api-e2e-mt-ceefe56c-65c6755cd5-7gqzh\" (UID: \"7d80b4e9-5d93-4298-bae4-4408ba9bba03\") " pod="opendatahub/maas-api-e2e-mt-ceefe56c-65c6755cd5-7gqzh" Jul 02 23:34:17.512245 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:34:17.512218 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t2wxp\" (UniqueName: \"kubernetes.io/projected/7d80b4e9-5d93-4298-bae4-4408ba9bba03-kube-api-access-t2wxp\") pod \"maas-api-e2e-mt-ceefe56c-65c6755cd5-7gqzh\" (UID: \"7d80b4e9-5d93-4298-bae4-4408ba9bba03\") " pod="opendatahub/maas-api-e2e-mt-ceefe56c-65c6755cd5-7gqzh" Jul 02 23:34:17.572291 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:34:17.572250 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-ceefe56c-65c6755cd5-7gqzh" Jul 02 23:34:17.720115 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:34:17.720089 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-ceefe56c-65c6755cd5-7gqzh"] Jul 02 23:34:17.721713 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:34:17.721686 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d80b4e9_5d93_4298_bae4_4408ba9bba03.slice/crio-9e06c5e3dda4905331a25fc97d651ac8783fa70f80fcb72848efaaefe1e58da8 WatchSource:0}: Error finding container 9e06c5e3dda4905331a25fc97d651ac8783fa70f80fcb72848efaaefe1e58da8: Status 404 returned error can't find the container with id 9e06c5e3dda4905331a25fc97d651ac8783fa70f80fcb72848efaaefe1e58da8 Jul 02 23:34:18.507800 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:34:18.507690 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-ceefe56c-65c6755cd5-7gqzh" event={"ID":"7d80b4e9-5d93-4298-bae4-4408ba9bba03","Type":"ContainerStarted","Data":"c4b75c70d93d099c5dc6595fee4ecde862d343308298e1df75625aaa7e62ee48"} Jul 02 23:34:18.507800 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:34:18.507764 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-ceefe56c-65c6755cd5-7gqzh" event={"ID":"7d80b4e9-5d93-4298-bae4-4408ba9bba03","Type":"ContainerStarted","Data":"9e06c5e3dda4905331a25fc97d651ac8783fa70f80fcb72848efaaefe1e58da8"} Jul 02 23:34:18.507800 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:34:18.507788 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-mt-ceefe56c-65c6755cd5-7gqzh" Jul 02 23:34:18.528016 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:34:18.527966 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-mt-ceefe56c-65c6755cd5-7gqzh" podStartSLOduration=1.083922843 podStartE2EDuration="1.527951846s" totalImagesPullingTime="444.029003ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:34:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:34:18.525253877 +0000 UTC m=+1635.158295038" watchObservedRunningTime="2026-07-02 23:34:18.527951846 +0000 UTC m=+1635.160993014" Jul 02 23:34:23.110800 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:34:23.110763 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6vvc9"] Jul 02 23:34:24.518609 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:34:24.518575 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-mt-ceefe56c-65c6755cd5-7gqzh" Jul 02 23:34:29.182704 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:34:29.182662 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-ceefe56c-65c6755cd5-7gqzh"] Jul 02 23:34:29.183192 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:34:29.182924 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-mt-ceefe56c-65c6755cd5-7gqzh" podUID="7d80b4e9-5d93-4298-bae4-4408ba9bba03" containerName="maas-api" containerID="cri-o://c4b75c70d93d099c5dc6595fee4ecde862d343308298e1df75625aaa7e62ee48" gracePeriod=30 Jul 02 23:34:29.440321 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:34:29.440257 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-ceefe56c-65c6755cd5-7gqzh" Jul 02 23:34:29.515270 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:34:29.515229 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7d80b4e9-5d93-4298-bae4-4408ba9bba03-openshift-service-ca\") pod \"7d80b4e9-5d93-4298-bae4-4408ba9bba03\" (UID: \"7d80b4e9-5d93-4298-bae4-4408ba9bba03\") " Jul 02 23:34:29.515270 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:34:29.515275 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7d80b4e9-5d93-4298-bae4-4408ba9bba03-maas-api-tls\") pod \"7d80b4e9-5d93-4298-bae4-4408ba9bba03\" (UID: \"7d80b4e9-5d93-4298-bae4-4408ba9bba03\") " Jul 02 23:34:29.515503 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:34:29.515370 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t2wxp\" (UniqueName: \"kubernetes.io/projected/7d80b4e9-5d93-4298-bae4-4408ba9bba03-kube-api-access-t2wxp\") pod \"7d80b4e9-5d93-4298-bae4-4408ba9bba03\" (UID: \"7d80b4e9-5d93-4298-bae4-4408ba9bba03\") " Jul 02 23:34:29.515598 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:34:29.515576 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d80b4e9-5d93-4298-bae4-4408ba9bba03-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "7d80b4e9-5d93-4298-bae4-4408ba9bba03" (UID: "7d80b4e9-5d93-4298-bae4-4408ba9bba03"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 23:34:29.517651 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:34:29.517614 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d80b4e9-5d93-4298-bae4-4408ba9bba03-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "7d80b4e9-5d93-4298-bae4-4408ba9bba03" (UID: "7d80b4e9-5d93-4298-bae4-4408ba9bba03"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 23:34:29.517651 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:34:29.517637 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d80b4e9-5d93-4298-bae4-4408ba9bba03-kube-api-access-t2wxp" (OuterVolumeSpecName: "kube-api-access-t2wxp") pod "7d80b4e9-5d93-4298-bae4-4408ba9bba03" (UID: "7d80b4e9-5d93-4298-bae4-4408ba9bba03"). InnerVolumeSpecName "kube-api-access-t2wxp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 23:34:29.565320 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:34:29.565282 2563 generic.go:356] "Generic (PLEG): container finished" podID="7d80b4e9-5d93-4298-bae4-4408ba9bba03" containerID="c4b75c70d93d099c5dc6595fee4ecde862d343308298e1df75625aaa7e62ee48" exitCode=0 Jul 02 23:34:29.565506 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:34:29.565329 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-ceefe56c-65c6755cd5-7gqzh" Jul 02 23:34:29.565506 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:34:29.565367 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-ceefe56c-65c6755cd5-7gqzh" event={"ID":"7d80b4e9-5d93-4298-bae4-4408ba9bba03","Type":"ContainerDied","Data":"c4b75c70d93d099c5dc6595fee4ecde862d343308298e1df75625aaa7e62ee48"} Jul 02 23:34:29.565506 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:34:29.565423 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-ceefe56c-65c6755cd5-7gqzh" event={"ID":"7d80b4e9-5d93-4298-bae4-4408ba9bba03","Type":"ContainerDied","Data":"9e06c5e3dda4905331a25fc97d651ac8783fa70f80fcb72848efaaefe1e58da8"} Jul 02 23:34:29.565506 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:34:29.565447 2563 scope.go:117] "RemoveContainer" containerID="c4b75c70d93d099c5dc6595fee4ecde862d343308298e1df75625aaa7e62ee48" Jul 02 23:34:29.574850 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:34:29.574828 2563 scope.go:117] "RemoveContainer" containerID="c4b75c70d93d099c5dc6595fee4ecde862d343308298e1df75625aaa7e62ee48" Jul 02 23:34:29.575145 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:34:29.575122 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c4b75c70d93d099c5dc6595fee4ecde862d343308298e1df75625aaa7e62ee48\": container with ID starting with c4b75c70d93d099c5dc6595fee4ecde862d343308298e1df75625aaa7e62ee48 not found: ID does not exist" containerID="c4b75c70d93d099c5dc6595fee4ecde862d343308298e1df75625aaa7e62ee48" Jul 02 23:34:29.575218 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:34:29.575153 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4b75c70d93d099c5dc6595fee4ecde862d343308298e1df75625aaa7e62ee48"} err="failed to get container status \"c4b75c70d93d099c5dc6595fee4ecde862d343308298e1df75625aaa7e62ee48\": rpc error: code = NotFound desc = could not find container \"c4b75c70d93d099c5dc6595fee4ecde862d343308298e1df75625aaa7e62ee48\": container with ID starting with c4b75c70d93d099c5dc6595fee4ecde862d343308298e1df75625aaa7e62ee48 not found: ID does not exist" Jul 02 23:34:29.601002 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:34:29.600965 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-ceefe56c-65c6755cd5-7gqzh"] Jul 02 23:34:29.616225 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:34:29.616195 2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7d80b4e9-5d93-4298-bae4-4408ba9bba03-openshift-service-ca\") on node \"ip-10-0-131-33.ec2.internal\" DevicePath \"\"" Jul 02 23:34:29.616225 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:34:29.616228 2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7d80b4e9-5d93-4298-bae4-4408ba9bba03-maas-api-tls\") on node \"ip-10-0-131-33.ec2.internal\" DevicePath \"\"" Jul 02 23:34:29.616436 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:34:29.616250 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t2wxp\" (UniqueName: \"kubernetes.io/projected/7d80b4e9-5d93-4298-bae4-4408ba9bba03-kube-api-access-t2wxp\") on node \"ip-10-0-131-33.ec2.internal\" DevicePath \"\"" Jul 02 23:34:29.619077 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:34:29.619052 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-mt-ceefe56c-65c6755cd5-7gqzh"] Jul 02 23:34:29.848923 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:34:29.848844 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7d80b4e9-5d93-4298-bae4-4408ba9bba03" path="/var/lib/kubelet/pods/7d80b4e9-5d93-4298-bae4-4408ba9bba03/volumes" Jul 02 23:34:31.207648 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:34:31.207611 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6vvc9"] Jul 02 23:35:02.604190 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:35:02.604151 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6vvc9"] Jul 02 23:35:15.800193 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:35:15.800156 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6vvc9"] Jul 02 23:35:34.207513 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:35:34.207431 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6vvc9"] Jul 02 23:35:45.110671 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:35:45.110629 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6vvc9"] Jul 02 23:35:55.106340 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:35:55.106307 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6vvc9"] Jul 02 23:36:29.611067 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:36:29.611023 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6vvc9"] Jul 02 23:37:03.928811 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:37:03.928787 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-wljkx_5d4e781e-d925-477e-98c6-cb41099c6cb0/console-operator/1.log" Jul 02 23:37:03.929301 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:37:03.929208 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-wljkx_5d4e781e-d925-477e-98c6-cb41099c6cb0/console-operator/1.log" Jul 02 23:37:03.934234 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:37:03.934219 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hhc6h_f946205c-023a-4a7d-9a6c-c40b23c3b771/ovn-acl-logging/0.log" Jul 02 23:37:03.934774 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:37:03.934759 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hhc6h_f946205c-023a-4a7d-9a6c-c40b23c3b771/ovn-acl-logging/0.log" Jul 02 23:37:30.158102 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:37:30.158070 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-inf-a-dbb152-7d679fffc-pq9bk"] Jul 02 23:37:30.158572 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:37:30.158422 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d80b4e9-5d93-4298-bae4-4408ba9bba03" containerName="maas-api" Jul 02 23:37:30.158572 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:37:30.158433 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d80b4e9-5d93-4298-bae4-4408ba9bba03" containerName="maas-api" Jul 02 23:37:30.158572 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:37:30.158509 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d80b4e9-5d93-4298-bae4-4408ba9bba03" containerName="maas-api" Jul 02 23:37:30.161711 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:37:30.161690 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-dbb152-7d679fffc-pq9bk" Jul 02 23:37:30.163930 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:37:30.163903 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-c9hnp\"" Jul 02 23:37:30.164069 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:37:30.163949 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-inf-a-dbb152-serving-cert\"" Jul 02 23:37:30.167895 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:37:30.167869 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5694d66f-5f77-42c1-a544-bd99732ed230-maas-api-tls\") pod \"maas-api-e2e-inf-a-dbb152-7d679fffc-pq9bk\" (UID: \"5694d66f-5f77-42c1-a544-bd99732ed230\") " pod="opendatahub/maas-api-e2e-inf-a-dbb152-7d679fffc-pq9bk" Jul 02 23:37:30.168016 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:37:30.167907 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5bkxm\" (UniqueName: \"kubernetes.io/projected/5694d66f-5f77-42c1-a544-bd99732ed230-kube-api-access-5bkxm\") pod \"maas-api-e2e-inf-a-dbb152-7d679fffc-pq9bk\" (UID: \"5694d66f-5f77-42c1-a544-bd99732ed230\") " pod="opendatahub/maas-api-e2e-inf-a-dbb152-7d679fffc-pq9bk" Jul 02 23:37:30.168016 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:37:30.167991 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5694d66f-5f77-42c1-a544-bd99732ed230-openshift-service-ca\") pod \"maas-api-e2e-inf-a-dbb152-7d679fffc-pq9bk\" (UID: \"5694d66f-5f77-42c1-a544-bd99732ed230\") " pod="opendatahub/maas-api-e2e-inf-a-dbb152-7d679fffc-pq9bk" Jul 02 23:37:30.172359 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:37:30.172336 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-dbb152-7d679fffc-pq9bk"] Jul 02 23:37:30.269003 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:37:30.268972 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5694d66f-5f77-42c1-a544-bd99732ed230-openshift-service-ca\") pod \"maas-api-e2e-inf-a-dbb152-7d679fffc-pq9bk\" (UID: \"5694d66f-5f77-42c1-a544-bd99732ed230\") " pod="opendatahub/maas-api-e2e-inf-a-dbb152-7d679fffc-pq9bk" Jul 02 23:37:30.269169 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:37:30.269058 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5694d66f-5f77-42c1-a544-bd99732ed230-maas-api-tls\") pod \"maas-api-e2e-inf-a-dbb152-7d679fffc-pq9bk\" (UID: \"5694d66f-5f77-42c1-a544-bd99732ed230\") " pod="opendatahub/maas-api-e2e-inf-a-dbb152-7d679fffc-pq9bk" Jul 02 23:37:30.269169 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:37:30.269077 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5bkxm\" (UniqueName: \"kubernetes.io/projected/5694d66f-5f77-42c1-a544-bd99732ed230-kube-api-access-5bkxm\") pod \"maas-api-e2e-inf-a-dbb152-7d679fffc-pq9bk\" (UID: \"5694d66f-5f77-42c1-a544-bd99732ed230\") " pod="opendatahub/maas-api-e2e-inf-a-dbb152-7d679fffc-pq9bk" Jul 02 23:37:30.269276 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:37:30.269256 2563 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-inf-a-dbb152-serving-cert: secret "maas-api-e2e-inf-a-dbb152-serving-cert" not found Jul 02 23:37:30.269334 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:37:30.269325 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5694d66f-5f77-42c1-a544-bd99732ed230-maas-api-tls podName:5694d66f-5f77-42c1-a544-bd99732ed230 nodeName:}" failed. No retries permitted until 2026-07-02 23:37:30.769310183 +0000 UTC m=+1827.402351307 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/5694d66f-5f77-42c1-a544-bd99732ed230-maas-api-tls") pod "maas-api-e2e-inf-a-dbb152-7d679fffc-pq9bk" (UID: "5694d66f-5f77-42c1-a544-bd99732ed230") : secret "maas-api-e2e-inf-a-dbb152-serving-cert" not found Jul 02 23:37:30.269588 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:37:30.269570 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5694d66f-5f77-42c1-a544-bd99732ed230-openshift-service-ca\") pod \"maas-api-e2e-inf-a-dbb152-7d679fffc-pq9bk\" (UID: \"5694d66f-5f77-42c1-a544-bd99732ed230\") " pod="opendatahub/maas-api-e2e-inf-a-dbb152-7d679fffc-pq9bk" Jul 02 23:37:30.281124 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:37:30.281098 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5bkxm\" (UniqueName: \"kubernetes.io/projected/5694d66f-5f77-42c1-a544-bd99732ed230-kube-api-access-5bkxm\") pod \"maas-api-e2e-inf-a-dbb152-7d679fffc-pq9bk\" (UID: \"5694d66f-5f77-42c1-a544-bd99732ed230\") " pod="opendatahub/maas-api-e2e-inf-a-dbb152-7d679fffc-pq9bk" Jul 02 23:37:30.772200 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:37:30.772166 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5694d66f-5f77-42c1-a544-bd99732ed230-maas-api-tls\") pod \"maas-api-e2e-inf-a-dbb152-7d679fffc-pq9bk\" (UID: \"5694d66f-5f77-42c1-a544-bd99732ed230\") " pod="opendatahub/maas-api-e2e-inf-a-dbb152-7d679fffc-pq9bk" Jul 02 23:37:30.775149 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:37:30.775117 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5694d66f-5f77-42c1-a544-bd99732ed230-maas-api-tls\") pod \"maas-api-e2e-inf-a-dbb152-7d679fffc-pq9bk\" (UID: \"5694d66f-5f77-42c1-a544-bd99732ed230\") " pod="opendatahub/maas-api-e2e-inf-a-dbb152-7d679fffc-pq9bk" Jul 02 23:37:31.073967 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:37:31.073888 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-dbb152-7d679fffc-pq9bk" Jul 02 23:37:31.212261 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:37:31.212231 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-dbb152-7d679fffc-pq9bk"] Jul 02 23:37:31.214455 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:37:31.214428 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5694d66f_5f77_42c1_a544_bd99732ed230.slice/crio-b22037977355c40f5719ff07f84360ecc5bf0d6d5f693165f090200d9916d6b3 WatchSource:0}: Error finding container b22037977355c40f5719ff07f84360ecc5bf0d6d5f693165f090200d9916d6b3: Status 404 returned error can't find the container with id b22037977355c40f5719ff07f84360ecc5bf0d6d5f693165f090200d9916d6b3 Jul 02 23:37:31.215822 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:37:31.215805 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 02 23:37:31.520087 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:37:31.520053 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-dbb152-7d679fffc-pq9bk" event={"ID":"5694d66f-5f77-42c1-a544-bd99732ed230","Type":"ContainerStarted","Data":"b22037977355c40f5719ff07f84360ecc5bf0d6d5f693165f090200d9916d6b3"} Jul 02 23:37:32.527078 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:37:32.527045 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-dbb152-7d679fffc-pq9bk" event={"ID":"5694d66f-5f77-42c1-a544-bd99732ed230","Type":"ContainerStarted","Data":"7e4f737debc2867c2ef3db1efa25b7078e1109d4899ea1b3786233182a9eb892"} Jul 02 23:37:32.527570 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:37:32.527109 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-inf-a-dbb152-7d679fffc-pq9bk" Jul 02 23:37:32.544200 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:37:32.544146 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-inf-a-dbb152-7d679fffc-pq9bk" podStartSLOduration=2.165585373 podStartE2EDuration="2.544130725s" totalImagesPullingTime="378.545352ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:37:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:37:32.540937031 +0000 UTC m=+1829.173978187" watchObservedRunningTime="2026-07-02 23:37:32.544130725 +0000 UTC m=+1829.177171867" Jul 02 23:37:37.306632 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:37:37.306598 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6vvc9"] Jul 02 23:37:38.544678 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:37:38.544653 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-inf-a-dbb152-7d679fffc-pq9bk" Jul 02 23:37:47.616100 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:37:47.616064 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6vvc9"] Jul 02 23:38:11.913814 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:38:11.913777 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6vvc9"] Jul 02 23:38:41.110472 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:38:41.110390 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6vvc9"] Jul 02 23:38:54.412438 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:38:54.412402 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6vvc9"] Jul 02 23:39:03.137582 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:39:03.137540 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-dbb152-7d679fffc-pq9bk"] Jul 02 23:39:03.138175 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:39:03.137869 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-inf-a-dbb152-7d679fffc-pq9bk" podUID="5694d66f-5f77-42c1-a544-bd99732ed230" containerName="maas-api" containerID="cri-o://7e4f737debc2867c2ef3db1efa25b7078e1109d4899ea1b3786233182a9eb892" gracePeriod=30 Jul 02 23:39:03.583387 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:39:03.583361 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-dbb152-7d679fffc-pq9bk" Jul 02 23:39:03.673671 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:39:03.673579 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5694d66f-5f77-42c1-a544-bd99732ed230-openshift-service-ca\") pod \"5694d66f-5f77-42c1-a544-bd99732ed230\" (UID: \"5694d66f-5f77-42c1-a544-bd99732ed230\") " Jul 02 23:39:03.673862 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:39:03.673698 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5694d66f-5f77-42c1-a544-bd99732ed230-maas-api-tls\") pod \"5694d66f-5f77-42c1-a544-bd99732ed230\" (UID: \"5694d66f-5f77-42c1-a544-bd99732ed230\") " Jul 02 23:39:03.673862 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:39:03.673791 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5bkxm\" (UniqueName: \"kubernetes.io/projected/5694d66f-5f77-42c1-a544-bd99732ed230-kube-api-access-5bkxm\") pod \"5694d66f-5f77-42c1-a544-bd99732ed230\" (UID: \"5694d66f-5f77-42c1-a544-bd99732ed230\") " Jul 02 23:39:03.674071 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:39:03.674044 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5694d66f-5f77-42c1-a544-bd99732ed230-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5694d66f-5f77-42c1-a544-bd99732ed230" (UID: "5694d66f-5f77-42c1-a544-bd99732ed230"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 23:39:03.675958 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:39:03.675924 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5694d66f-5f77-42c1-a544-bd99732ed230-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5694d66f-5f77-42c1-a544-bd99732ed230" (UID: "5694d66f-5f77-42c1-a544-bd99732ed230"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 23:39:03.676080 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:39:03.676015 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5694d66f-5f77-42c1-a544-bd99732ed230-kube-api-access-5bkxm" (OuterVolumeSpecName: "kube-api-access-5bkxm") pod "5694d66f-5f77-42c1-a544-bd99732ed230" (UID: "5694d66f-5f77-42c1-a544-bd99732ed230"). InnerVolumeSpecName "kube-api-access-5bkxm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 23:39:03.774770 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:39:03.774708 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5bkxm\" (UniqueName: \"kubernetes.io/projected/5694d66f-5f77-42c1-a544-bd99732ed230-kube-api-access-5bkxm\") on node \"ip-10-0-131-33.ec2.internal\" DevicePath \"\"" Jul 02 23:39:03.774770 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:39:03.774768 2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5694d66f-5f77-42c1-a544-bd99732ed230-openshift-service-ca\") on node \"ip-10-0-131-33.ec2.internal\" DevicePath \"\"" Jul 02 23:39:03.774770 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:39:03.774780 2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5694d66f-5f77-42c1-a544-bd99732ed230-maas-api-tls\") on node \"ip-10-0-131-33.ec2.internal\" DevicePath \"\"" Jul 02 23:39:04.024506 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:39:04.024410 2563 generic.go:356] "Generic (PLEG): container finished" podID="5694d66f-5f77-42c1-a544-bd99732ed230" containerID="7e4f737debc2867c2ef3db1efa25b7078e1109d4899ea1b3786233182a9eb892" exitCode=0 Jul 02 23:39:04.024506 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:39:04.024457 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-dbb152-7d679fffc-pq9bk" Jul 02 23:39:04.024506 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:39:04.024497 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-dbb152-7d679fffc-pq9bk" event={"ID":"5694d66f-5f77-42c1-a544-bd99732ed230","Type":"ContainerDied","Data":"7e4f737debc2867c2ef3db1efa25b7078e1109d4899ea1b3786233182a9eb892"} Jul 02 23:39:04.024782 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:39:04.024546 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-dbb152-7d679fffc-pq9bk" event={"ID":"5694d66f-5f77-42c1-a544-bd99732ed230","Type":"ContainerDied","Data":"b22037977355c40f5719ff07f84360ecc5bf0d6d5f693165f090200d9916d6b3"} Jul 02 23:39:04.024782 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:39:04.024570 2563 scope.go:117] "RemoveContainer" containerID="7e4f737debc2867c2ef3db1efa25b7078e1109d4899ea1b3786233182a9eb892" Jul 02 23:39:04.033490 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:39:04.033472 2563 scope.go:117] "RemoveContainer" containerID="7e4f737debc2867c2ef3db1efa25b7078e1109d4899ea1b3786233182a9eb892" Jul 02 23:39:04.033843 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:39:04.033814 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7e4f737debc2867c2ef3db1efa25b7078e1109d4899ea1b3786233182a9eb892\": container with ID starting with 7e4f737debc2867c2ef3db1efa25b7078e1109d4899ea1b3786233182a9eb892 not found: ID does not exist" containerID="7e4f737debc2867c2ef3db1efa25b7078e1109d4899ea1b3786233182a9eb892" Jul 02 23:39:04.033912 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:39:04.033864 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e4f737debc2867c2ef3db1efa25b7078e1109d4899ea1b3786233182a9eb892"} err="failed to get container status \"7e4f737debc2867c2ef3db1efa25b7078e1109d4899ea1b3786233182a9eb892\": rpc error: code = NotFound desc = could not find container \"7e4f737debc2867c2ef3db1efa25b7078e1109d4899ea1b3786233182a9eb892\": container with ID starting with 7e4f737debc2867c2ef3db1efa25b7078e1109d4899ea1b3786233182a9eb892 not found: ID does not exist" Jul 02 23:39:04.041078 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:39:04.041053 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-dbb152-7d679fffc-pq9bk"] Jul 02 23:39:04.044314 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:39:04.044295 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-dbb152-7d679fffc-pq9bk"] Jul 02 23:39:05.848880 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:39:05.848850 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5694d66f-5f77-42c1-a544-bd99732ed230" path="/var/lib/kubelet/pods/5694d66f-5f77-42c1-a544-bd99732ed230/volumes" Jul 02 23:39:06.541222 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:39:06.541167 2563 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-e2e-inf-a-dbb152-7d679fffc-pq9bk" podUID="5694d66f-5f77-42c1-a544-bd99732ed230" containerName="maas-api" probeResult="failure" output="Get \"https://10.132.0.43:8443/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Jul 02 23:39:07.604833 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:39:07.604794 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6vvc9"] Jul 02 23:39:49.163153 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:39:49.163113 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6vvc9"] Jul 02 23:39:55.880626 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:39:55.880526 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-api-a-979f9f-77bdcf8774-jrrrq"] Jul 02 23:39:55.881126 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:39:55.881038 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5694d66f-5f77-42c1-a544-bd99732ed230" containerName="maas-api" Jul 02 23:39:55.881126 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:39:55.881054 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="5694d66f-5f77-42c1-a544-bd99732ed230" containerName="maas-api" Jul 02 23:39:55.881126 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:39:55.881107 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="5694d66f-5f77-42c1-a544-bd99732ed230" containerName="maas-api" Jul 02 23:39:55.888289 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:39:55.888252 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-979f9f-77bdcf8774-jrrrq" Jul 02 23:39:55.890725 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:39:55.890694 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-api-a-979f9f-serving-cert\"" Jul 02 23:39:55.890903 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:39:55.890797 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-c9hnp\"" Jul 02 23:39:55.901093 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:39:55.900994 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-a-979f9f-77bdcf8774-jrrrq"] Jul 02 23:39:55.942045 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:39:55.942012 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c384824e-1d17-4e75-9552-45b85ec5b304-openshift-service-ca\") pod \"maas-api-e2e-api-a-979f9f-77bdcf8774-jrrrq\" (UID: \"c384824e-1d17-4e75-9552-45b85ec5b304\") " pod="opendatahub/maas-api-e2e-api-a-979f9f-77bdcf8774-jrrrq" Jul 02 23:39:55.942045 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:39:55.942055 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xv85\" (UniqueName: \"kubernetes.io/projected/c384824e-1d17-4e75-9552-45b85ec5b304-kube-api-access-9xv85\") pod \"maas-api-e2e-api-a-979f9f-77bdcf8774-jrrrq\" (UID: \"c384824e-1d17-4e75-9552-45b85ec5b304\") " pod="opendatahub/maas-api-e2e-api-a-979f9f-77bdcf8774-jrrrq" Jul 02 23:39:55.942318 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:39:55.942212 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c384824e-1d17-4e75-9552-45b85ec5b304-maas-api-tls\") pod \"maas-api-e2e-api-a-979f9f-77bdcf8774-jrrrq\" (UID: \"c384824e-1d17-4e75-9552-45b85ec5b304\") " pod="opendatahub/maas-api-e2e-api-a-979f9f-77bdcf8774-jrrrq" Jul 02 23:39:56.043486 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:39:56.043444 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9xv85\" (UniqueName: \"kubernetes.io/projected/c384824e-1d17-4e75-9552-45b85ec5b304-kube-api-access-9xv85\") pod \"maas-api-e2e-api-a-979f9f-77bdcf8774-jrrrq\" (UID: \"c384824e-1d17-4e75-9552-45b85ec5b304\") " pod="opendatahub/maas-api-e2e-api-a-979f9f-77bdcf8774-jrrrq" Jul 02 23:39:56.043696 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:39:56.043524 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c384824e-1d17-4e75-9552-45b85ec5b304-maas-api-tls\") pod \"maas-api-e2e-api-a-979f9f-77bdcf8774-jrrrq\" (UID: \"c384824e-1d17-4e75-9552-45b85ec5b304\") " pod="opendatahub/maas-api-e2e-api-a-979f9f-77bdcf8774-jrrrq" Jul 02 23:39:56.043696 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:39:56.043576 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c384824e-1d17-4e75-9552-45b85ec5b304-openshift-service-ca\") pod \"maas-api-e2e-api-a-979f9f-77bdcf8774-jrrrq\" (UID: \"c384824e-1d17-4e75-9552-45b85ec5b304\") " pod="opendatahub/maas-api-e2e-api-a-979f9f-77bdcf8774-jrrrq" Jul 02 23:39:56.044249 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:39:56.044226 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c384824e-1d17-4e75-9552-45b85ec5b304-openshift-service-ca\") pod \"maas-api-e2e-api-a-979f9f-77bdcf8774-jrrrq\" (UID: \"c384824e-1d17-4e75-9552-45b85ec5b304\") " pod="opendatahub/maas-api-e2e-api-a-979f9f-77bdcf8774-jrrrq" Jul 02 23:39:56.046229 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:39:56.046207 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c384824e-1d17-4e75-9552-45b85ec5b304-maas-api-tls\") pod \"maas-api-e2e-api-a-979f9f-77bdcf8774-jrrrq\" (UID: \"c384824e-1d17-4e75-9552-45b85ec5b304\") " pod="opendatahub/maas-api-e2e-api-a-979f9f-77bdcf8774-jrrrq" Jul 02 23:39:56.051284 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:39:56.051262 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xv85\" (UniqueName: \"kubernetes.io/projected/c384824e-1d17-4e75-9552-45b85ec5b304-kube-api-access-9xv85\") pod \"maas-api-e2e-api-a-979f9f-77bdcf8774-jrrrq\" (UID: \"c384824e-1d17-4e75-9552-45b85ec5b304\") " pod="opendatahub/maas-api-e2e-api-a-979f9f-77bdcf8774-jrrrq" Jul 02 23:39:56.207073 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:39:56.207038 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-979f9f-77bdcf8774-jrrrq" Jul 02 23:39:56.368225 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:39:56.368193 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-a-979f9f-77bdcf8774-jrrrq"] Jul 02 23:39:56.369672 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:39:56.369642 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc384824e_1d17_4e75_9552_45b85ec5b304.slice/crio-6782157815f10f2168e13b1c414730e36f7f48f065d816edad566fd7a63a423a WatchSource:0}: Error finding container 6782157815f10f2168e13b1c414730e36f7f48f065d816edad566fd7a63a423a: Status 404 returned error can't find the container with id 6782157815f10f2168e13b1c414730e36f7f48f065d816edad566fd7a63a423a Jul 02 23:39:57.318818 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:39:57.318771 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-979f9f-77bdcf8774-jrrrq" event={"ID":"c384824e-1d17-4e75-9552-45b85ec5b304","Type":"ContainerStarted","Data":"32bae410fb12e0b7157c578052d154a6b7bd4a621068426e6d9246fa01121799"} Jul 02 23:39:57.319227 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:39:57.318835 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-979f9f-77bdcf8774-jrrrq" event={"ID":"c384824e-1d17-4e75-9552-45b85ec5b304","Type":"ContainerStarted","Data":"6782157815f10f2168e13b1c414730e36f7f48f065d816edad566fd7a63a423a"} Jul 02 23:39:57.319227 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:39:57.318908 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-api-a-979f9f-77bdcf8774-jrrrq" Jul 02 23:39:57.338321 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:39:57.338270 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-api-a-979f9f-77bdcf8774-jrrrq" podStartSLOduration=1.9559020139999999 podStartE2EDuration="2.338255892s" totalImagesPullingTime="382.353878ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:39:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:39:57.336310011 +0000 UTC m=+1973.969351155" watchObservedRunningTime="2026-07-02 23:39:57.338255892 +0000 UTC m=+1973.971297035" Jul 02 23:40:03.329407 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:40:03.329378 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-api-a-979f9f-77bdcf8774-jrrrq" Jul 02 23:40:03.509773 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:40:03.509722 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6vvc9"] Jul 02 23:40:17.100221 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:40:17.100186 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-a-979f9f-77bdcf8774-jrrrq"] Jul 02 23:40:17.100638 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:40:17.100414 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-api-a-979f9f-77bdcf8774-jrrrq" podUID="c384824e-1d17-4e75-9552-45b85ec5b304" containerName="maas-api" containerID="cri-o://32bae410fb12e0b7157c578052d154a6b7bd4a621068426e6d9246fa01121799" gracePeriod=30 Jul 02 23:40:17.352482 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:40:17.352424 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-979f9f-77bdcf8774-jrrrq" Jul 02 23:40:17.439329 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:40:17.439290 2563 generic.go:356] "Generic (PLEG): container finished" podID="c384824e-1d17-4e75-9552-45b85ec5b304" containerID="32bae410fb12e0b7157c578052d154a6b7bd4a621068426e6d9246fa01121799" exitCode=0 Jul 02 23:40:17.439529 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:40:17.439342 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-979f9f-77bdcf8774-jrrrq" Jul 02 23:40:17.439529 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:40:17.439380 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-979f9f-77bdcf8774-jrrrq" event={"ID":"c384824e-1d17-4e75-9552-45b85ec5b304","Type":"ContainerDied","Data":"32bae410fb12e0b7157c578052d154a6b7bd4a621068426e6d9246fa01121799"} Jul 02 23:40:17.439529 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:40:17.439438 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-979f9f-77bdcf8774-jrrrq" event={"ID":"c384824e-1d17-4e75-9552-45b85ec5b304","Type":"ContainerDied","Data":"6782157815f10f2168e13b1c414730e36f7f48f065d816edad566fd7a63a423a"} Jul 02 23:40:17.439529 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:40:17.439467 2563 scope.go:117] "RemoveContainer" containerID="32bae410fb12e0b7157c578052d154a6b7bd4a621068426e6d9246fa01121799" Jul 02 23:40:17.449024 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:40:17.449002 2563 scope.go:117] "RemoveContainer" containerID="32bae410fb12e0b7157c578052d154a6b7bd4a621068426e6d9246fa01121799" Jul 02 23:40:17.449322 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:40:17.449299 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"32bae410fb12e0b7157c578052d154a6b7bd4a621068426e6d9246fa01121799\": container with ID starting with 32bae410fb12e0b7157c578052d154a6b7bd4a621068426e6d9246fa01121799 not found: ID does not exist" containerID="32bae410fb12e0b7157c578052d154a6b7bd4a621068426e6d9246fa01121799" Jul 02 23:40:17.449400 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:40:17.449332 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32bae410fb12e0b7157c578052d154a6b7bd4a621068426e6d9246fa01121799"} err="failed to get container status \"32bae410fb12e0b7157c578052d154a6b7bd4a621068426e6d9246fa01121799\": rpc error: code = NotFound desc = could not find container \"32bae410fb12e0b7157c578052d154a6b7bd4a621068426e6d9246fa01121799\": container with ID starting with 32bae410fb12e0b7157c578052d154a6b7bd4a621068426e6d9246fa01121799 not found: ID does not exist" Jul 02 23:40:17.533523 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:40:17.533486 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c384824e-1d17-4e75-9552-45b85ec5b304-openshift-service-ca\") pod \"c384824e-1d17-4e75-9552-45b85ec5b304\" (UID: \"c384824e-1d17-4e75-9552-45b85ec5b304\") " Jul 02 23:40:17.533689 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:40:17.533536 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c384824e-1d17-4e75-9552-45b85ec5b304-maas-api-tls\") pod \"c384824e-1d17-4e75-9552-45b85ec5b304\" (UID: \"c384824e-1d17-4e75-9552-45b85ec5b304\") " Jul 02 23:40:17.533689 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:40:17.533570 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9xv85\" (UniqueName: \"kubernetes.io/projected/c384824e-1d17-4e75-9552-45b85ec5b304-kube-api-access-9xv85\") pod \"c384824e-1d17-4e75-9552-45b85ec5b304\" (UID: \"c384824e-1d17-4e75-9552-45b85ec5b304\") " Jul 02 23:40:17.533913 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:40:17.533890 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c384824e-1d17-4e75-9552-45b85ec5b304-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c384824e-1d17-4e75-9552-45b85ec5b304" (UID: "c384824e-1d17-4e75-9552-45b85ec5b304"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 23:40:17.535966 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:40:17.535942 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c384824e-1d17-4e75-9552-45b85ec5b304-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c384824e-1d17-4e75-9552-45b85ec5b304" (UID: "c384824e-1d17-4e75-9552-45b85ec5b304"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 23:40:17.536094 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:40:17.536074 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c384824e-1d17-4e75-9552-45b85ec5b304-kube-api-access-9xv85" (OuterVolumeSpecName: "kube-api-access-9xv85") pod "c384824e-1d17-4e75-9552-45b85ec5b304" (UID: "c384824e-1d17-4e75-9552-45b85ec5b304"). InnerVolumeSpecName "kube-api-access-9xv85". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 23:40:17.634585 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:40:17.634488 2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c384824e-1d17-4e75-9552-45b85ec5b304-openshift-service-ca\") on node \"ip-10-0-131-33.ec2.internal\" DevicePath \"\"" Jul 02 23:40:17.634585 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:40:17.634522 2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c384824e-1d17-4e75-9552-45b85ec5b304-maas-api-tls\") on node \"ip-10-0-131-33.ec2.internal\" DevicePath \"\"" Jul 02 23:40:17.634585 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:40:17.634532 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9xv85\" (UniqueName: \"kubernetes.io/projected/c384824e-1d17-4e75-9552-45b85ec5b304-kube-api-access-9xv85\") on node \"ip-10-0-131-33.ec2.internal\" DevicePath \"\"" Jul 02 23:40:17.761204 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:40:17.761162 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-a-979f9f-77bdcf8774-jrrrq"] Jul 02 23:40:17.763278 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:40:17.763257 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-api-a-979f9f-77bdcf8774-jrrrq"] Jul 02 23:40:17.849435 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:40:17.849401 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c384824e-1d17-4e75-9552-45b85ec5b304" path="/var/lib/kubelet/pods/c384824e-1d17-4e75-9552-45b85ec5b304/volumes" Jul 02 23:40:19.411262 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:40:19.411219 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6vvc9"] Jul 02 23:40:32.700889 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:40:32.700841 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6vvc9"] Jul 02 23:40:33.105935 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:40:33.105842 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-shared-a-115c59-59d75c4c7-zkvv6"] Jul 02 23:40:33.106398 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:40:33.106372 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c384824e-1d17-4e75-9552-45b85ec5b304" containerName="maas-api" Jul 02 23:40:33.106398 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:40:33.106397 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="c384824e-1d17-4e75-9552-45b85ec5b304" containerName="maas-api" Jul 02 23:40:33.106625 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:40:33.106479 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="c384824e-1d17-4e75-9552-45b85ec5b304" containerName="maas-api" Jul 02 23:40:33.109991 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:40:33.109967 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-115c59-59d75c4c7-zkvv6" Jul 02 23:40:33.112278 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:40:33.112255 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-shared-a-115c59-serving-cert\"" Jul 02 23:40:33.112421 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:40:33.112325 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-c9hnp\"" Jul 02 23:40:33.120995 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:40:33.120965 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-115c59-59d75c4c7-zkvv6"] Jul 02 23:40:33.168250 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:40:33.168210 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/acf3f408-dac8-4e18-b946-950c03c4e4c5-maas-api-tls\") pod \"maas-api-e2e-shared-a-115c59-59d75c4c7-zkvv6\" (UID: \"acf3f408-dac8-4e18-b946-950c03c4e4c5\") " pod="opendatahub/maas-api-e2e-shared-a-115c59-59d75c4c7-zkvv6" Jul 02 23:40:33.168450 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:40:33.168269 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/acf3f408-dac8-4e18-b946-950c03c4e4c5-openshift-service-ca\") pod \"maas-api-e2e-shared-a-115c59-59d75c4c7-zkvv6\" (UID: \"acf3f408-dac8-4e18-b946-950c03c4e4c5\") " pod="opendatahub/maas-api-e2e-shared-a-115c59-59d75c4c7-zkvv6" Jul 02 23:40:33.168450 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:40:33.168324 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2dqm7\" (UniqueName: \"kubernetes.io/projected/acf3f408-dac8-4e18-b946-950c03c4e4c5-kube-api-access-2dqm7\") pod \"maas-api-e2e-shared-a-115c59-59d75c4c7-zkvv6\" (UID: \"acf3f408-dac8-4e18-b946-950c03c4e4c5\") " pod="opendatahub/maas-api-e2e-shared-a-115c59-59d75c4c7-zkvv6" Jul 02 23:40:33.269392 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:40:33.269355 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/acf3f408-dac8-4e18-b946-950c03c4e4c5-maas-api-tls\") pod \"maas-api-e2e-shared-a-115c59-59d75c4c7-zkvv6\" (UID: \"acf3f408-dac8-4e18-b946-950c03c4e4c5\") " pod="opendatahub/maas-api-e2e-shared-a-115c59-59d75c4c7-zkvv6" Jul 02 23:40:33.269604 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:40:33.269408 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/acf3f408-dac8-4e18-b946-950c03c4e4c5-openshift-service-ca\") pod \"maas-api-e2e-shared-a-115c59-59d75c4c7-zkvv6\" (UID: \"acf3f408-dac8-4e18-b946-950c03c4e4c5\") " pod="opendatahub/maas-api-e2e-shared-a-115c59-59d75c4c7-zkvv6" Jul 02 23:40:33.269604 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:40:33.269433 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2dqm7\" (UniqueName: \"kubernetes.io/projected/acf3f408-dac8-4e18-b946-950c03c4e4c5-kube-api-access-2dqm7\") pod \"maas-api-e2e-shared-a-115c59-59d75c4c7-zkvv6\" (UID: \"acf3f408-dac8-4e18-b946-950c03c4e4c5\") " pod="opendatahub/maas-api-e2e-shared-a-115c59-59d75c4c7-zkvv6" Jul 02 23:40:33.270148 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:40:33.270125 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/acf3f408-dac8-4e18-b946-950c03c4e4c5-openshift-service-ca\") pod \"maas-api-e2e-shared-a-115c59-59d75c4c7-zkvv6\" (UID: \"acf3f408-dac8-4e18-b946-950c03c4e4c5\") " pod="opendatahub/maas-api-e2e-shared-a-115c59-59d75c4c7-zkvv6" Jul 02 23:40:33.272081 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:40:33.272057 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/acf3f408-dac8-4e18-b946-950c03c4e4c5-maas-api-tls\") pod \"maas-api-e2e-shared-a-115c59-59d75c4c7-zkvv6\" (UID: \"acf3f408-dac8-4e18-b946-950c03c4e4c5\") " pod="opendatahub/maas-api-e2e-shared-a-115c59-59d75c4c7-zkvv6" Jul 02 23:40:33.276893 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:40:33.276873 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2dqm7\" (UniqueName: \"kubernetes.io/projected/acf3f408-dac8-4e18-b946-950c03c4e4c5-kube-api-access-2dqm7\") pod \"maas-api-e2e-shared-a-115c59-59d75c4c7-zkvv6\" (UID: \"acf3f408-dac8-4e18-b946-950c03c4e4c5\") " pod="opendatahub/maas-api-e2e-shared-a-115c59-59d75c4c7-zkvv6" Jul 02 23:40:33.422465 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:40:33.422429 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-115c59-59d75c4c7-zkvv6" Jul 02 23:40:33.559217 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:40:33.559191 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-115c59-59d75c4c7-zkvv6"] Jul 02 23:40:33.560907 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:40:33.560880 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacf3f408_dac8_4e18_b946_950c03c4e4c5.slice/crio-c165b8059a89ca9c907246dc24f669543ede9a8d8a5db0047895ddd69dd2ec6c WatchSource:0}: Error finding container c165b8059a89ca9c907246dc24f669543ede9a8d8a5db0047895ddd69dd2ec6c: Status 404 returned error can't find the container with id c165b8059a89ca9c907246dc24f669543ede9a8d8a5db0047895ddd69dd2ec6c Jul 02 23:40:34.534109 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:40:34.534061 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-115c59-59d75c4c7-zkvv6" event={"ID":"acf3f408-dac8-4e18-b946-950c03c4e4c5","Type":"ContainerStarted","Data":"622214bc3f37c19b97cfb73e4d0c721eba61ce437cd1da0ea36994f709d84eab"} Jul 02 23:40:34.534497 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:40:34.534158 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-115c59-59d75c4c7-zkvv6" event={"ID":"acf3f408-dac8-4e18-b946-950c03c4e4c5","Type":"ContainerStarted","Data":"c165b8059a89ca9c907246dc24f669543ede9a8d8a5db0047895ddd69dd2ec6c"} Jul 02 23:40:34.534497 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:40:34.534206 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-shared-a-115c59-59d75c4c7-zkvv6" Jul 02 23:40:34.551370 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:40:34.551324 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-shared-a-115c59-59d75c4c7-zkvv6" podStartSLOduration=1.167554658 podStartE2EDuration="1.551310381s" totalImagesPullingTime="383.755723ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:40:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:40:34.550099604 +0000 UTC m=+2011.183140750" watchObservedRunningTime="2026-07-02 23:40:34.551310381 +0000 UTC m=+2011.184351523" Jul 02 23:40:40.546349 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:40:40.546322 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-shared-a-115c59-59d75c4c7-zkvv6" Jul 02 23:40:44.601840 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:40:44.601802 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6vvc9"] Jul 02 23:42:03.965002 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:42:03.964973 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-wljkx_5d4e781e-d925-477e-98c6-cb41099c6cb0/console-operator/1.log" Jul 02 23:42:03.965467 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:42:03.965386 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-wljkx_5d4e781e-d925-477e-98c6-cb41099c6cb0/console-operator/1.log" Jul 02 23:42:03.970011 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:42:03.969987 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hhc6h_f946205c-023a-4a7d-9a6c-c40b23c3b771/ovn-acl-logging/0.log" Jul 02 23:42:03.970211 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:42:03.970195 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hhc6h_f946205c-023a-4a7d-9a6c-c40b23c3b771/ovn-acl-logging/0.log" Jul 02 23:43:51.074639 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:43:51.074601 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-115c59-59d75c4c7-zkvv6"] Jul 02 23:43:51.077244 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:43:51.074871 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-shared-a-115c59-59d75c4c7-zkvv6" podUID="acf3f408-dac8-4e18-b946-950c03c4e4c5" containerName="maas-api" containerID="cri-o://622214bc3f37c19b97cfb73e4d0c721eba61ce437cd1da0ea36994f709d84eab" gracePeriod=30 Jul 02 23:43:51.323538 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:43:51.323515 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-115c59-59d75c4c7-zkvv6" Jul 02 23:43:51.394146 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:43:51.394120 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2dqm7\" (UniqueName: \"kubernetes.io/projected/acf3f408-dac8-4e18-b946-950c03c4e4c5-kube-api-access-2dqm7\") pod \"acf3f408-dac8-4e18-b946-950c03c4e4c5\" (UID: \"acf3f408-dac8-4e18-b946-950c03c4e4c5\") " Jul 02 23:43:51.394286 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:43:51.394166 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/acf3f408-dac8-4e18-b946-950c03c4e4c5-maas-api-tls\") pod \"acf3f408-dac8-4e18-b946-950c03c4e4c5\" (UID: \"acf3f408-dac8-4e18-b946-950c03c4e4c5\") " Jul 02 23:43:51.394286 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:43:51.394199 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/acf3f408-dac8-4e18-b946-950c03c4e4c5-openshift-service-ca\") pod \"acf3f408-dac8-4e18-b946-950c03c4e4c5\" (UID: \"acf3f408-dac8-4e18-b946-950c03c4e4c5\") " Jul 02 23:43:51.394610 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:43:51.394587 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/acf3f408-dac8-4e18-b946-950c03c4e4c5-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "acf3f408-dac8-4e18-b946-950c03c4e4c5" (UID: "acf3f408-dac8-4e18-b946-950c03c4e4c5"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 23:43:51.396492 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:43:51.396467 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/acf3f408-dac8-4e18-b946-950c03c4e4c5-kube-api-access-2dqm7" (OuterVolumeSpecName: "kube-api-access-2dqm7") pod "acf3f408-dac8-4e18-b946-950c03c4e4c5" (UID: "acf3f408-dac8-4e18-b946-950c03c4e4c5"). InnerVolumeSpecName "kube-api-access-2dqm7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 23:43:51.396492 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:43:51.396476 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/acf3f408-dac8-4e18-b946-950c03c4e4c5-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "acf3f408-dac8-4e18-b946-950c03c4e4c5" (UID: "acf3f408-dac8-4e18-b946-950c03c4e4c5"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 23:43:51.495544 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:43:51.495519 2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/acf3f408-dac8-4e18-b946-950c03c4e4c5-maas-api-tls\") on node \"ip-10-0-131-33.ec2.internal\" DevicePath \"\"" Jul 02 23:43:51.495544 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:43:51.495543 2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/acf3f408-dac8-4e18-b946-950c03c4e4c5-openshift-service-ca\") on node \"ip-10-0-131-33.ec2.internal\" DevicePath \"\"" Jul 02 23:43:51.495689 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:43:51.495553 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2dqm7\" (UniqueName: \"kubernetes.io/projected/acf3f408-dac8-4e18-b946-950c03c4e4c5-kube-api-access-2dqm7\") on node \"ip-10-0-131-33.ec2.internal\" DevicePath \"\"" Jul 02 23:43:51.582410 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:43:51.582376 2563 generic.go:356] "Generic (PLEG): container finished" podID="acf3f408-dac8-4e18-b946-950c03c4e4c5" containerID="622214bc3f37c19b97cfb73e4d0c721eba61ce437cd1da0ea36994f709d84eab" exitCode=0 Jul 02 23:43:51.582520 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:43:51.582425 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-115c59-59d75c4c7-zkvv6" Jul 02 23:43:51.582520 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:43:51.582463 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-115c59-59d75c4c7-zkvv6" event={"ID":"acf3f408-dac8-4e18-b946-950c03c4e4c5","Type":"ContainerDied","Data":"622214bc3f37c19b97cfb73e4d0c721eba61ce437cd1da0ea36994f709d84eab"} Jul 02 23:43:51.582520 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:43:51.582516 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-115c59-59d75c4c7-zkvv6" event={"ID":"acf3f408-dac8-4e18-b946-950c03c4e4c5","Type":"ContainerDied","Data":"c165b8059a89ca9c907246dc24f669543ede9a8d8a5db0047895ddd69dd2ec6c"} Jul 02 23:43:51.582640 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:43:51.582538 2563 scope.go:117] "RemoveContainer" containerID="622214bc3f37c19b97cfb73e4d0c721eba61ce437cd1da0ea36994f709d84eab" Jul 02 23:43:51.592569 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:43:51.592549 2563 scope.go:117] "RemoveContainer" containerID="622214bc3f37c19b97cfb73e4d0c721eba61ce437cd1da0ea36994f709d84eab" Jul 02 23:43:51.592868 ip-10-0-131-33 kubenswrapper[2563]: E0702 23:43:51.592849 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"622214bc3f37c19b97cfb73e4d0c721eba61ce437cd1da0ea36994f709d84eab\": container with ID starting with 622214bc3f37c19b97cfb73e4d0c721eba61ce437cd1da0ea36994f709d84eab not found: ID does not exist" containerID="622214bc3f37c19b97cfb73e4d0c721eba61ce437cd1da0ea36994f709d84eab" Jul 02 23:43:51.592942 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:43:51.592879 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"622214bc3f37c19b97cfb73e4d0c721eba61ce437cd1da0ea36994f709d84eab"} err="failed to get container status \"622214bc3f37c19b97cfb73e4d0c721eba61ce437cd1da0ea36994f709d84eab\": rpc error: code = NotFound desc = could not find container \"622214bc3f37c19b97cfb73e4d0c721eba61ce437cd1da0ea36994f709d84eab\": container with ID starting with 622214bc3f37c19b97cfb73e4d0c721eba61ce437cd1da0ea36994f709d84eab not found: ID does not exist" Jul 02 23:43:51.603287 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:43:51.603261 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-115c59-59d75c4c7-zkvv6"] Jul 02 23:43:51.605353 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:43:51.605327 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-115c59-59d75c4c7-zkvv6"] Jul 02 23:43:51.849415 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:43:51.849345 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="acf3f408-dac8-4e18-b946-950c03c4e4c5" path="/var/lib/kubelet/pods/acf3f408-dac8-4e18-b946-950c03c4e4c5/volumes" Jul 02 23:43:54.502319 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:43:54.502283 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6vvc9"] Jul 02 23:44:05.904229 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:44:05.904190 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6vvc9"] Jul 02 23:44:09.312776 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:44:09.312728 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-z79g4_b63d08e3-f29e-44c4-96c5-fe7545e75ee1/manager/0.log" Jul 02 23:44:09.541230 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:44:09.541200 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-fb7747bfc-hzxw5_81ac38f0-bf7c-4459-88f3-1348b39cf316/copy-manifests/0.log" Jul 02 23:44:09.547235 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:44:09.547205 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-fb7747bfc-hzxw5_81ac38f0-bf7c-4459-88f3-1348b39cf316/manager/0.log" Jul 02 23:44:10.546754 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:44:10.546718 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q5ck6_e40e75e1-fb91-4e5d-bc8f-13ebaf3cc542/util/0.log" Jul 02 23:44:10.552653 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:44:10.552633 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q5ck6_e40e75e1-fb91-4e5d-bc8f-13ebaf3cc542/pull/0.log" Jul 02 23:44:10.558183 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:44:10.558162 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q5ck6_e40e75e1-fb91-4e5d-bc8f-13ebaf3cc542/extract/0.log" Jul 02 23:44:10.666315 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:44:10.666287 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0szjt2_820763c7-08fd-4de9-b8ef-aed0951ccc0e/util/0.log" Jul 02 23:44:10.678583 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:44:10.672637 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0szjt2_820763c7-08fd-4de9-b8ef-aed0951ccc0e/pull/0.log" Jul 02 23:44:10.679398 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:44:10.679372 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0szjt2_820763c7-08fd-4de9-b8ef-aed0951ccc0e/extract/0.log" Jul 02 23:44:10.789284 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:44:10.789251 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739kp9p_7c532bce-e740-4a27-b5b8-bd29733b712e/extract/0.log" Jul 02 23:44:10.800707 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:44:10.800647 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739kp9p_7c532bce-e740-4a27-b5b8-bd29733b712e/util/0.log" Jul 02 23:44:10.806682 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:44:10.806663 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739kp9p_7c532bce-e740-4a27-b5b8-bd29733b712e/pull/0.log" Jul 02 23:44:10.912221 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:44:10.912190 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fsqlp_77bb6a70-49ae-48ed-aba5-abf6fba6243a/util/0.log" Jul 02 23:44:10.918116 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:44:10.918095 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fsqlp_77bb6a70-49ae-48ed-aba5-abf6fba6243a/pull/0.log" Jul 02 23:44:10.923846 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:44:10.923815 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fsqlp_77bb6a70-49ae-48ed-aba5-abf6fba6243a/extract/0.log" Jul 02 23:44:11.719074 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:44:11.719047 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-6vvc9_917e9f31-e626-4c3c-9cc9-81bf6c4d66e6/limitador/0.log" Jul 02 23:44:12.303953 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:44:12.303927 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-qdw8p_43b74966-ee55-43c7-8313-e353592ca860/discovery/0.log" Jul 02 23:44:12.975228 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:44:12.975199 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6744ddf86c-cr66l_0ca0d12d-9442-4bbb-8c4c-d2e4e513dd18/router/0.log" Jul 02 23:44:13.634825 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:44:13.634793 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjxcnc_6fd4aa5c-b693-4f48-8f3e-b1674282a6e0/main/0.log" Jul 02 23:44:18.235071 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:44:18.235031 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-rbq7r/must-gather-btjlf"] Jul 02 23:44:18.235543 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:44:18.235520 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="acf3f408-dac8-4e18-b946-950c03c4e4c5" containerName="maas-api" Jul 02 23:44:18.235543 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:44:18.235540 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="acf3f408-dac8-4e18-b946-950c03c4e4c5" containerName="maas-api" Jul 02 23:44:18.235683 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:44:18.235668 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="acf3f408-dac8-4e18-b946-950c03c4e4c5" containerName="maas-api" Jul 02 23:44:18.239092 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:44:18.239075 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rbq7r/must-gather-btjlf" Jul 02 23:44:18.241306 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:44:18.241287 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-rbq7r\"/\"openshift-service-ca.crt\"" Jul 02 23:44:18.242099 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:44:18.242080 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-rbq7r\"/\"kube-root-ca.crt\"" Jul 02 23:44:18.242211 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:44:18.242084 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-rbq7r\"/\"default-dockercfg-jhnrh\"" Jul 02 23:44:18.245988 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:44:18.245955 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rbq7r/must-gather-btjlf"] Jul 02 23:44:18.318496 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:44:18.318464 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/0fae6618-9500-4ef3-8027-a392735571c1-must-gather-output\") pod \"must-gather-btjlf\" (UID: \"0fae6618-9500-4ef3-8027-a392735571c1\") " pod="openshift-must-gather-rbq7r/must-gather-btjlf" Jul 02 23:44:18.318648 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:44:18.318549 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xttbd\" (UniqueName: \"kubernetes.io/projected/0fae6618-9500-4ef3-8027-a392735571c1-kube-api-access-xttbd\") pod \"must-gather-btjlf\" (UID: \"0fae6618-9500-4ef3-8027-a392735571c1\") " pod="openshift-must-gather-rbq7r/must-gather-btjlf" Jul 02 23:44:18.419493 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:44:18.419465 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xttbd\" (UniqueName: \"kubernetes.io/projected/0fae6618-9500-4ef3-8027-a392735571c1-kube-api-access-xttbd\") pod \"must-gather-btjlf\" (UID: \"0fae6618-9500-4ef3-8027-a392735571c1\") " pod="openshift-must-gather-rbq7r/must-gather-btjlf" Jul 02 23:44:18.419655 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:44:18.419515 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/0fae6618-9500-4ef3-8027-a392735571c1-must-gather-output\") pod \"must-gather-btjlf\" (UID: \"0fae6618-9500-4ef3-8027-a392735571c1\") " pod="openshift-must-gather-rbq7r/must-gather-btjlf" Jul 02 23:44:18.419878 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:44:18.419860 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/0fae6618-9500-4ef3-8027-a392735571c1-must-gather-output\") pod \"must-gather-btjlf\" (UID: \"0fae6618-9500-4ef3-8027-a392735571c1\") " pod="openshift-must-gather-rbq7r/must-gather-btjlf" Jul 02 23:44:18.427240 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:44:18.427216 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xttbd\" (UniqueName: \"kubernetes.io/projected/0fae6618-9500-4ef3-8027-a392735571c1-kube-api-access-xttbd\") pod \"must-gather-btjlf\" (UID: \"0fae6618-9500-4ef3-8027-a392735571c1\") " pod="openshift-must-gather-rbq7r/must-gather-btjlf" Jul 02 23:44:18.549513 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:44:18.549433 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rbq7r/must-gather-btjlf" Jul 02 23:44:18.687163 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:44:18.687137 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rbq7r/must-gather-btjlf"] Jul 02 23:44:18.689322 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:44:18.689299 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0fae6618_9500_4ef3_8027_a392735571c1.slice/crio-78015a4674b836b87547d58f338cd27902d60bb85a8e67261f75e47871d02a7d WatchSource:0}: Error finding container 78015a4674b836b87547d58f338cd27902d60bb85a8e67261f75e47871d02a7d: Status 404 returned error can't find the container with id 78015a4674b836b87547d58f338cd27902d60bb85a8e67261f75e47871d02a7d Jul 02 23:44:18.691337 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:44:18.691316 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 02 23:44:18.724899 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:44:18.724871 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rbq7r/must-gather-btjlf" event={"ID":"0fae6618-9500-4ef3-8027-a392735571c1","Type":"ContainerStarted","Data":"78015a4674b836b87547d58f338cd27902d60bb85a8e67261f75e47871d02a7d"} Jul 02 23:44:19.733319 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:44:19.733231 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rbq7r/must-gather-btjlf" event={"ID":"0fae6618-9500-4ef3-8027-a392735571c1","Type":"ContainerStarted","Data":"1810860e56271e1561c16c101a0b994b401ffe0e35f0a6eaf5d8e133c9a735ba"} Jul 02 23:44:19.733319 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:44:19.733279 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rbq7r/must-gather-btjlf" event={"ID":"0fae6618-9500-4ef3-8027-a392735571c1","Type":"ContainerStarted","Data":"77c3e922f75e6d44f071efab3ce6a47e6758538575030a63502eabeebf32d895"} Jul 02 23:44:19.748830 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:44:19.748726 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-rbq7r/must-gather-btjlf" podStartSLOduration=1.010651938 podStartE2EDuration="1.748706504s" totalImagesPullingTime="738.054566ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:44:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:44:19.746937056 +0000 UTC m=+2236.379978200" watchObservedRunningTime="2026-07-02 23:44:19.748706504 +0000 UTC m=+2236.381747648" Jul 02 23:44:20.935923 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:44:20.935896 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-r7d5c_b17963a2-4797-4722-ae65-4ac1801913a5/global-pull-secret-syncer/0.log" Jul 02 23:44:21.075787 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:44:21.075725 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-z6p55_b08f4b68-d33f-48a2-90d0-0c6511ba679a/konnectivity-agent/0.log" Jul 02 23:44:21.093955 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:44:21.093910 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-131-33.ec2.internal_398da86d6561510d06f9aff443828ae1/haproxy/0.log" Jul 02 23:44:25.572344 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:44:25.572279 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q5ck6_e40e75e1-fb91-4e5d-bc8f-13ebaf3cc542/extract/0.log" Jul 02 23:44:25.599353 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:44:25.599325 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q5ck6_e40e75e1-fb91-4e5d-bc8f-13ebaf3cc542/util/0.log" Jul 02 23:44:25.619952 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:44:25.619911 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q5ck6_e40e75e1-fb91-4e5d-bc8f-13ebaf3cc542/pull/0.log" Jul 02 23:44:25.646158 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:44:25.646091 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0szjt2_820763c7-08fd-4de9-b8ef-aed0951ccc0e/extract/0.log" Jul 02 23:44:25.679338 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:44:25.679291 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0szjt2_820763c7-08fd-4de9-b8ef-aed0951ccc0e/util/0.log" Jul 02 23:44:25.701301 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:44:25.701263 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0szjt2_820763c7-08fd-4de9-b8ef-aed0951ccc0e/pull/0.log" Jul 02 23:44:25.733615 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:44:25.733558 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739kp9p_7c532bce-e740-4a27-b5b8-bd29733b712e/extract/0.log" Jul 02 23:44:25.754680 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:44:25.754655 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739kp9p_7c532bce-e740-4a27-b5b8-bd29733b712e/util/0.log" Jul 02 23:44:25.779609 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:44:25.779554 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739kp9p_7c532bce-e740-4a27-b5b8-bd29733b712e/pull/0.log" Jul 02 23:44:25.823951 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:44:25.823830 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fsqlp_77bb6a70-49ae-48ed-aba5-abf6fba6243a/extract/0.log" Jul 02 23:44:25.845283 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:44:25.845253 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fsqlp_77bb6a70-49ae-48ed-aba5-abf6fba6243a/util/0.log" Jul 02 23:44:25.864713 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:44:25.864668 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fsqlp_77bb6a70-49ae-48ed-aba5-abf6fba6243a/pull/0.log" Jul 02 23:44:26.375143 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:44:26.375116 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-6vvc9_917e9f31-e626-4c3c-9cc9-81bf6c4d66e6/limitador/0.log" Jul 02 23:44:27.842175 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:44:27.842147 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_238ac15d-89c2-4729-8c1b-5ab92f49cbe0/alertmanager/0.log" Jul 02 23:44:27.869360 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:44:27.869325 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_238ac15d-89c2-4729-8c1b-5ab92f49cbe0/config-reloader/0.log" Jul 02 23:44:27.891054 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:44:27.891027 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_238ac15d-89c2-4729-8c1b-5ab92f49cbe0/kube-rbac-proxy-web/0.log" Jul 02 23:44:27.912160 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:44:27.912137 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_238ac15d-89c2-4729-8c1b-5ab92f49cbe0/kube-rbac-proxy/0.log" Jul 02 23:44:27.935720 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:44:27.935695 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_238ac15d-89c2-4729-8c1b-5ab92f49cbe0/kube-rbac-proxy-metric/0.log" Jul 02 23:44:27.955260 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:44:27.955222 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_238ac15d-89c2-4729-8c1b-5ab92f49cbe0/prom-label-proxy/0.log" Jul 02 23:44:27.977427 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:44:27.977403 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_238ac15d-89c2-4729-8c1b-5ab92f49cbe0/init-config-reloader/0.log" Jul 02 23:44:28.018518 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:44:28.018482 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-frm7j_2690f25f-010b-41df-9514-f57323b17283/cluster-monitoring-operator/0.log" Jul 02 23:44:28.045477 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:44:28.045444 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-kgdl8_e35b0672-54b5-46cf-b747-b56fa8158d9e/kube-state-metrics/0.log" Jul 02 23:44:28.060646 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:44:28.060613 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-kgdl8_e35b0672-54b5-46cf-b747-b56fa8158d9e/kube-rbac-proxy-main/0.log" Jul 02 23:44:28.087287 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:44:28.087260 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-kgdl8_e35b0672-54b5-46cf-b747-b56fa8158d9e/kube-rbac-proxy-self/0.log" Jul 02 23:44:28.367357 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:44:28.367321 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fcjj9_cfa039cb-5d08-4fb1-87e6-7b0b5bf90947/node-exporter/0.log" Jul 02 23:44:28.386274 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:44:28.386246 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fcjj9_cfa039cb-5d08-4fb1-87e6-7b0b5bf90947/kube-rbac-proxy/0.log" Jul 02 23:44:28.405551 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:44:28.405526 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fcjj9_cfa039cb-5d08-4fb1-87e6-7b0b5bf90947/init-textfile/0.log" Jul 02 23:44:28.762380 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:44:28.762267 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6744645b9d-jldvn_98b45909-a769-47b6-91d9-59b8be86f421/telemeter-client/0.log" Jul 02 23:44:28.783877 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:44:28.783837 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6744645b9d-jldvn_98b45909-a769-47b6-91d9-59b8be86f421/reload/0.log" Jul 02 23:44:28.805046 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:44:28.805019 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6744645b9d-jldvn_98b45909-a769-47b6-91d9-59b8be86f421/kube-rbac-proxy/0.log" Jul 02 23:44:30.232255 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:44:30.232212 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6bffdf9778-297wc_cd1134b6-429c-4008-8b58-5da7f4e9fc3f/networking-console-plugin/0.log" Jul 02 23:44:30.809031 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:44:30.808998 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-wljkx_5d4e781e-d925-477e-98c6-cb41099c6cb0/console-operator/1.log" Jul 02 23:44:30.815832 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:44:30.815809 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-wljkx_5d4e781e-d925-477e-98c6-cb41099c6cb0/console-operator/2.log" Jul 02 23:44:31.358757 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:44:31.358694 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-rbq7r/perf-node-gather-daemonset-g2m4j"] Jul 02 23:44:31.366558 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:44:31.366528 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rbq7r/perf-node-gather-daemonset-g2m4j" Jul 02 23:44:31.371013 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:44:31.370929 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rbq7r/perf-node-gather-daemonset-g2m4j"] Jul 02 23:44:31.467940 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:44:31.467902 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2bb9dd0a-7bcd-4778-9e82-03c0eea12625-proc\") pod \"perf-node-gather-daemonset-g2m4j\" (UID: \"2bb9dd0a-7bcd-4778-9e82-03c0eea12625\") " pod="openshift-must-gather-rbq7r/perf-node-gather-daemonset-g2m4j" Jul 02 23:44:31.468145 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:44:31.467959 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4gc2x\" (UniqueName: \"kubernetes.io/projected/2bb9dd0a-7bcd-4778-9e82-03c0eea12625-kube-api-access-4gc2x\") pod \"perf-node-gather-daemonset-g2m4j\" (UID: \"2bb9dd0a-7bcd-4778-9e82-03c0eea12625\") " pod="openshift-must-gather-rbq7r/perf-node-gather-daemonset-g2m4j" Jul 02 23:44:31.468145 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:44:31.468084 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2bb9dd0a-7bcd-4778-9e82-03c0eea12625-podres\") pod \"perf-node-gather-daemonset-g2m4j\" (UID: \"2bb9dd0a-7bcd-4778-9e82-03c0eea12625\") " pod="openshift-must-gather-rbq7r/perf-node-gather-daemonset-g2m4j" Jul 02 23:44:31.468145 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:44:31.468125 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2bb9dd0a-7bcd-4778-9e82-03c0eea12625-sys\") pod \"perf-node-gather-daemonset-g2m4j\" (UID: \"2bb9dd0a-7bcd-4778-9e82-03c0eea12625\") " pod="openshift-must-gather-rbq7r/perf-node-gather-daemonset-g2m4j" Jul 02 23:44:31.468324 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:44:31.468211 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2bb9dd0a-7bcd-4778-9e82-03c0eea12625-lib-modules\") pod \"perf-node-gather-daemonset-g2m4j\" (UID: \"2bb9dd0a-7bcd-4778-9e82-03c0eea12625\") " pod="openshift-must-gather-rbq7r/perf-node-gather-daemonset-g2m4j" Jul 02 23:44:31.568865 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:44:31.568828 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2bb9dd0a-7bcd-4778-9e82-03c0eea12625-proc\") pod \"perf-node-gather-daemonset-g2m4j\" (UID: \"2bb9dd0a-7bcd-4778-9e82-03c0eea12625\") " pod="openshift-must-gather-rbq7r/perf-node-gather-daemonset-g2m4j" Jul 02 23:44:31.569042 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:44:31.568902 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4gc2x\" (UniqueName: \"kubernetes.io/projected/2bb9dd0a-7bcd-4778-9e82-03c0eea12625-kube-api-access-4gc2x\") pod \"perf-node-gather-daemonset-g2m4j\" (UID: \"2bb9dd0a-7bcd-4778-9e82-03c0eea12625\") " pod="openshift-must-gather-rbq7r/perf-node-gather-daemonset-g2m4j" Jul 02 23:44:31.569042 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:44:31.568962 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2bb9dd0a-7bcd-4778-9e82-03c0eea12625-podres\") pod \"perf-node-gather-daemonset-g2m4j\" (UID: \"2bb9dd0a-7bcd-4778-9e82-03c0eea12625\") " pod="openshift-must-gather-rbq7r/perf-node-gather-daemonset-g2m4j" Jul 02 23:44:31.569042 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:44:31.568963 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2bb9dd0a-7bcd-4778-9e82-03c0eea12625-proc\") pod \"perf-node-gather-daemonset-g2m4j\" (UID: \"2bb9dd0a-7bcd-4778-9e82-03c0eea12625\") " pod="openshift-must-gather-rbq7r/perf-node-gather-daemonset-g2m4j" Jul 02 23:44:31.569042 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:44:31.568988 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2bb9dd0a-7bcd-4778-9e82-03c0eea12625-sys\") pod \"perf-node-gather-daemonset-g2m4j\" (UID: \"2bb9dd0a-7bcd-4778-9e82-03c0eea12625\") " pod="openshift-must-gather-rbq7r/perf-node-gather-daemonset-g2m4j" Jul 02 23:44:31.569279 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:44:31.569047 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2bb9dd0a-7bcd-4778-9e82-03c0eea12625-sys\") pod \"perf-node-gather-daemonset-g2m4j\" (UID: \"2bb9dd0a-7bcd-4778-9e82-03c0eea12625\") " pod="openshift-must-gather-rbq7r/perf-node-gather-daemonset-g2m4j" Jul 02 23:44:31.569279 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:44:31.569091 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2bb9dd0a-7bcd-4778-9e82-03c0eea12625-lib-modules\") pod \"perf-node-gather-daemonset-g2m4j\" (UID: \"2bb9dd0a-7bcd-4778-9e82-03c0eea12625\") " pod="openshift-must-gather-rbq7r/perf-node-gather-daemonset-g2m4j" Jul 02 23:44:31.569279 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:44:31.569115 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2bb9dd0a-7bcd-4778-9e82-03c0eea12625-podres\") pod \"perf-node-gather-daemonset-g2m4j\" (UID: \"2bb9dd0a-7bcd-4778-9e82-03c0eea12625\") " pod="openshift-must-gather-rbq7r/perf-node-gather-daemonset-g2m4j" Jul 02 23:44:31.569279 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:44:31.569223 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2bb9dd0a-7bcd-4778-9e82-03c0eea12625-lib-modules\") pod \"perf-node-gather-daemonset-g2m4j\" (UID: \"2bb9dd0a-7bcd-4778-9e82-03c0eea12625\") " pod="openshift-must-gather-rbq7r/perf-node-gather-daemonset-g2m4j" Jul 02 23:44:31.581004 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:44:31.580973 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4gc2x\" (UniqueName: \"kubernetes.io/projected/2bb9dd0a-7bcd-4778-9e82-03c0eea12625-kube-api-access-4gc2x\") pod \"perf-node-gather-daemonset-g2m4j\" (UID: \"2bb9dd0a-7bcd-4778-9e82-03c0eea12625\") " pod="openshift-must-gather-rbq7r/perf-node-gather-daemonset-g2m4j" Jul 02 23:44:31.683339 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:44:31.683315 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rbq7r/perf-node-gather-daemonset-g2m4j" Jul 02 23:44:31.855365 ip-10-0-131-33 kubenswrapper[2563]: W0702 23:44:31.855329 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod2bb9dd0a_7bcd_4778_9e82_03c0eea12625.slice/crio-01ca679e85b3476ada2efbe31ab72da16d3f0324da88fef3d9662f219463570b WatchSource:0}: Error finding container 01ca679e85b3476ada2efbe31ab72da16d3f0324da88fef3d9662f219463570b: Status 404 returned error can't find the container with id 01ca679e85b3476ada2efbe31ab72da16d3f0324da88fef3d9662f219463570b Jul 02 23:44:31.856127 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:44:31.855967 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rbq7r/perf-node-gather-daemonset-g2m4j"] Jul 02 23:44:32.112442 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:44:32.112408 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5d456fdbcd-dkbs8_746b57b7-42ad-4c35-b0e4-778b0732ea77/volume-data-source-validator/0.log" Jul 02 23:44:32.868330 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:44:32.868293 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rbq7r/perf-node-gather-daemonset-g2m4j" event={"ID":"2bb9dd0a-7bcd-4778-9e82-03c0eea12625","Type":"ContainerStarted","Data":"e631499c2942daa268f0c9a4042309be0a3d5bbcd9e6a56feea2b8bb1d0b5c9e"} Jul 02 23:44:32.868732 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:44:32.868376 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rbq7r/perf-node-gather-daemonset-g2m4j" event={"ID":"2bb9dd0a-7bcd-4778-9e82-03c0eea12625","Type":"ContainerStarted","Data":"01ca679e85b3476ada2efbe31ab72da16d3f0324da88fef3d9662f219463570b"} Jul 02 23:44:32.868732 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:44:32.868419 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-rbq7r/perf-node-gather-daemonset-g2m4j" Jul 02 23:44:32.883954 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:44:32.883908 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-rbq7r/perf-node-gather-daemonset-g2m4j" podStartSLOduration=1.8838928579999998 podStartE2EDuration="1.883892858s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 23:44:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:44:32.883216707 +0000 UTC m=+2249.516257850" watchObservedRunningTime="2026-07-02 23:44:32.883892858 +0000 UTC m=+2249.516933979" Jul 02 23:44:33.144892 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:44:33.144868 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-9m5nh_758d5a7d-658b-40b4-ac5d-7629e8172325/dns/0.log" Jul 02 23:44:33.163868 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:44:33.163847 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-9m5nh_758d5a7d-658b-40b4-ac5d-7629e8172325/kube-rbac-proxy/0.log" Jul 02 23:44:33.268984 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:44:33.268952 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-q5c49_a6eddff0-475c-41b7-b072-e1cdd661392f/dns-node-resolver/0.log" Jul 02 23:44:33.833635 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:44:33.833606 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-m5zq4_4c2848a5-a93f-4b79-be6e-31d430c7839d/node-ca/0.log" Jul 02 23:44:34.812890 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:44:34.812842 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-qdw8p_43b74966-ee55-43c7-8313-e353592ca860/discovery/0.log" Jul 02 23:44:35.017493 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:44:35.017465 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6744ddf86c-cr66l_0ca0d12d-9442-4bbb-8c4c-d2e4e513dd18/router/0.log" Jul 02 23:44:35.701681 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:44:35.701626 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-qt5c9_54034b49-3b9e-4f1c-bf13-fd5e97aa8f72/serve-healthcheck-canary/0.log" Jul 02 23:44:36.185590 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:44:36.185558 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-gz8jl_e5ac3fd0-32b9-4947-a0a7-ed6d6cd3c8f0/insights-operator/0.log" Jul 02 23:44:36.186643 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:44:36.186618 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-gz8jl_e5ac3fd0-32b9-4947-a0a7-ed6d6cd3c8f0/insights-operator/1.log" Jul 02 23:44:36.391670 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:44:36.391644 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-n5tqq_e37e66ff-54f9-4531-bd63-b1b491e8408b/kube-rbac-proxy/0.log" Jul 02 23:44:36.417373 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:44:36.417339 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-n5tqq_e37e66ff-54f9-4531-bd63-b1b491e8408b/exporter/0.log" Jul 02 23:44:36.440527 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:44:36.440460 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-n5tqq_e37e66ff-54f9-4531-bd63-b1b491e8408b/extractor/0.log" Jul 02 23:44:38.774232 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:44:38.774193 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-z79g4_b63d08e3-f29e-44c4-96c5-fe7545e75ee1/manager/0.log" Jul 02 23:44:38.841102 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:44:38.841072 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-fb7747bfc-hzxw5_81ac38f0-bf7c-4459-88f3-1348b39cf316/manager/0.log" Jul 02 23:44:38.858775 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:44:38.858719 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-fb7747bfc-hzxw5_81ac38f0-bf7c-4459-88f3-1348b39cf316/copy-manifests/0.log" Jul 02 23:44:38.891322 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:44:38.891282 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-rbq7r/perf-node-gather-daemonset-g2m4j" Jul 02 23:44:40.309401 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:44:40.309372 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-675f46f85c-554sp_6d73b4a9-a1fb-4f54-bd70-413713f8cb7e/manager/0.log" Jul 02 23:44:41.596229 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:44:41.596194 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-qdw8p_43b74966-ee55-43c7-8313-e353592ca860/discovery/0.log" Jul 02 23:44:41.744211 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:44:41.744136 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6744ddf86c-cr66l_0ca0d12d-9442-4bbb-8c4c-d2e4e513dd18/router/0.log" Jul 02 23:44:43.077074 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:44:43.077036 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-qdw8p_43b74966-ee55-43c7-8313-e353592ca860/discovery/0.log" Jul 02 23:44:43.235335 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:44:43.235244 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6744ddf86c-cr66l_0ca0d12d-9442-4bbb-8c4c-d2e4e513dd18/router/0.log" Jul 02 23:44:45.471948 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:44:45.471921 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-k46vb_f4797aab-f33c-4f95-93e2-131366537ad5/migrator/0.log" Jul 02 23:44:45.490264 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:44:45.490235 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-k46vb_f4797aab-f33c-4f95-93e2-131366537ad5/graceful-termination/0.log" Jul 02 23:44:45.810681 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:44:45.810614 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-8nlmv_d7c5d79d-d705-4d68-8e46-a31b1603915e/kube-storage-version-migrator-operator/1.log" Jul 02 23:44:45.811446 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:44:45.811417 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-8nlmv_d7c5d79d-d705-4d68-8e46-a31b1603915e/kube-storage-version-migrator-operator/0.log" Jul 02 23:44:46.782809 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:44:46.782781 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-2jt79_74fc0401-b598-40fc-acca-508ba1a1c001/kube-multus/0.log" Jul 02 23:44:46.804237 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:44:46.804214 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-97j6n_2d6bdb50-bc8b-4f01-b13c-8ff9cd87740f/kube-multus-additional-cni-plugins/0.log" Jul 02 23:44:46.822216 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:44:46.822195 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-97j6n_2d6bdb50-bc8b-4f01-b13c-8ff9cd87740f/egress-router-binary-copy/0.log" Jul 02 23:44:46.841507 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:44:46.841483 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-97j6n_2d6bdb50-bc8b-4f01-b13c-8ff9cd87740f/cni-plugins/0.log" Jul 02 23:44:46.860262 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:44:46.860244 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-97j6n_2d6bdb50-bc8b-4f01-b13c-8ff9cd87740f/bond-cni-plugin/0.log" Jul 02 23:44:46.881300 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:44:46.881271 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-97j6n_2d6bdb50-bc8b-4f01-b13c-8ff9cd87740f/routeoverride-cni/0.log" Jul 02 23:44:46.900494 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:44:46.900468 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-97j6n_2d6bdb50-bc8b-4f01-b13c-8ff9cd87740f/whereabouts-cni-bincopy/0.log" Jul 02 23:44:46.918361 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:44:46.918332 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-97j6n_2d6bdb50-bc8b-4f01-b13c-8ff9cd87740f/whereabouts-cni/0.log" Jul 02 23:44:47.320133 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:44:47.320100 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-tzfzk_fad8c2d0-090a-4bac-8774-26cac496f9f7/network-metrics-daemon/0.log" Jul 02 23:44:47.337116 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:44:47.337084 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-tzfzk_fad8c2d0-090a-4bac-8774-26cac496f9f7/kube-rbac-proxy/0.log" Jul 02 23:44:48.330282 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:44:48.330249 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hhc6h_f946205c-023a-4a7d-9a6c-c40b23c3b771/ovn-controller/0.log" Jul 02 23:44:48.344110 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:44:48.344078 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hhc6h_f946205c-023a-4a7d-9a6c-c40b23c3b771/ovn-acl-logging/0.log" Jul 02 23:44:48.344233 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:44:48.344079 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hhc6h_f946205c-023a-4a7d-9a6c-c40b23c3b771/ovn-acl-logging/1.log" Jul 02 23:44:48.360350 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:44:48.360327 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hhc6h_f946205c-023a-4a7d-9a6c-c40b23c3b771/kube-rbac-proxy-node/0.log" Jul 02 23:44:48.378452 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:44:48.378428 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hhc6h_f946205c-023a-4a7d-9a6c-c40b23c3b771/kube-rbac-proxy-ovn-metrics/0.log" Jul 02 23:44:48.394528 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:44:48.394505 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hhc6h_f946205c-023a-4a7d-9a6c-c40b23c3b771/northd/0.log" Jul 02 23:44:48.412416 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:44:48.412397 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hhc6h_f946205c-023a-4a7d-9a6c-c40b23c3b771/nbdb/0.log" Jul 02 23:44:48.430244 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:44:48.430226 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hhc6h_f946205c-023a-4a7d-9a6c-c40b23c3b771/sbdb/0.log" Jul 02 23:44:48.480494 ip-10-0-131-33 kubenswrapper[2563]: I0702 23:44:48.480433 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hhc6h_f946205c-023a-4a7d-9a6c-c40b23c3b771/ovnkube-controller/0.log"