Jul 07 16:20:42.765063 ip-10-0-138-189 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 07 16:20:42.765074 ip-10-0-138-189 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 07 16:20:42.765081 ip-10-0-138-189 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 07 16:20:42.765396 ip-10-0-138-189 systemd[1]: Failed to start Kubernetes Kubelet. Jul 07 16:20:53.014358 ip-10-0-138-189 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 07 16:20:53.014374 ip-10-0-138-189 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 2661311b78a849b69c5cd5d389b59be7 -- Jul 07 16:22:36.738497 ip-10-0-138-189 systemd[1]: Starting Kubernetes Kubelet... Jul 07 16:22:37.190879 ip-10-0-138-189 kubenswrapper[2552]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 07 16:22:37.190879 ip-10-0-138-189 kubenswrapper[2552]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 07 16:22:37.190879 ip-10-0-138-189 kubenswrapper[2552]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 07 16:22:37.190879 ip-10-0-138-189 kubenswrapper[2552]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 07 16:22:37.190879 ip-10-0-138-189 kubenswrapper[2552]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 07 16:22:37.254777 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.191525 2552 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 07 16:22:37.254777 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.195348 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 16:22:37.254777 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.195361 2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 16:22:37.254777 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.195364 2552 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 16:22:37.254777 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.195367 2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 16:22:37.254777 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.195370 2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 16:22:37.254777 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.195373 2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 16:22:37.254777 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.195376 2552 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 16:22:37.254777 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.195378 2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 16:22:37.254777 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.195381 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 16:22:37.254777 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.195383 2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 16:22:37.254777 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.195386 2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 16:22:37.254777 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.195389 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 16:22:37.254777 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.195391 2552 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 16:22:37.254777 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.195394 2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 16:22:37.254777 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.195398 2552 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 16:22:37.254777 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.195400 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 16:22:37.254777 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.195403 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 16:22:37.254777 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.195406 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 16:22:37.275294 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.195408 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 16:22:37.275294 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.195419 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 16:22:37.275294 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.195424 2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 16:22:37.275294 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.195428 2552 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 16:22:37.275294 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.195431 2552 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 16:22:37.275294 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.195435 2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 16:22:37.275294 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.195438 2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 16:22:37.275294 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.195441 2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 16:22:37.275294 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.195444 2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 16:22:37.275294 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.195446 2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 16:22:37.275294 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.195449 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 16:22:37.275294 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.195451 2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 16:22:37.275294 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.195454 2552 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 16:22:37.275294 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.195456 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 16:22:37.275294 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.195460 2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 16:22:37.275294 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.195462 2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 16:22:37.275294 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.195465 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 16:22:37.275294 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.195468 2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 16:22:37.275294 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.195470 2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 16:22:37.275294 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.195473 2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 16:22:37.525170 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.195476 2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 16:22:37.525170 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.195478 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 16:22:37.525170 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.195481 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 16:22:37.525170 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.195483 2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 16:22:37.525170 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.195486 2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 16:22:37.525170 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.195488 2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 16:22:37.525170 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.195491 2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 16:22:37.525170 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.195493 2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 16:22:37.525170 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.195497 2552 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 16:22:37.525170 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.195500 2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 16:22:37.525170 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.195502 2552 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 16:22:37.525170 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.195504 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 16:22:37.525170 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.195507 2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 16:22:37.525170 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.195510 2552 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 16:22:37.525170 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.195513 2552 feature_gate.go:328] unrecognized feature gate: Example Jul 07 16:22:37.525170 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.195515 2552 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 16:22:37.525170 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.195518 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 16:22:37.525170 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.195521 2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 16:22:37.525170 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.195523 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 16:22:37.525170 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.195528 2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 16:22:37.277513 ip-10-0-138-189 systemd[1]: Started Kubernetes Kubelet. Jul 07 16:22:37.535963 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.195531 2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 16:22:37.535963 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.195533 2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 16:22:37.535963 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.195536 2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 16:22:37.535963 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.195538 2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 16:22:37.535963 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.195541 2552 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 16:22:37.535963 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.195543 2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 16:22:37.535963 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.195546 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 16:22:37.535963 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.195548 2552 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 16:22:37.535963 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.195551 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 16:22:37.535963 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.195553 2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 16:22:37.535963 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.195556 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 16:22:37.535963 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.195558 2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 16:22:37.535963 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.195561 2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 16:22:37.535963 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.195563 2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 16:22:37.535963 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.195567 2552 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 16:22:37.535963 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.195570 2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 16:22:37.535963 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.195574 2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 16:22:37.535963 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.195578 2552 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 16:22:37.535963 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.195581 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 16:22:37.536901 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.195583 2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 16:22:37.536901 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.195586 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 16:22:37.536901 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.195589 2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 16:22:37.536901 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.195591 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 16:22:37.536901 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.195594 2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 16:22:37.536901 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.195597 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 16:22:37.536901 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.195599 2552 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 16:22:37.536901 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.195602 2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 16:22:37.536901 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.195606 2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 16:22:37.536901 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.195610 2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 16:22:37.536901 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.195613 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 16:22:37.536901 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.195615 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 16:22:37.536901 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.195618 2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 16:22:37.536901 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.195621 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 16:22:37.536901 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.195624 2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 16:22:37.536901 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.195626 2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 16:22:37.536901 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.195629 2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 16:22:37.536901 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.195632 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 16:22:37.536901 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.195634 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 16:22:37.536901 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.195636 2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 16:22:37.537975 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.195639 2552 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 16:22:37.537975 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.195642 2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 16:22:37.537975 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.199431 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 16:22:37.537975 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.199443 2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 16:22:37.537975 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.199447 2552 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 16:22:37.537975 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.199450 2552 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 16:22:37.537975 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.199452 2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 16:22:37.537975 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.199455 2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 16:22:37.537975 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.199458 2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 16:22:37.537975 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.199460 2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 16:22:37.537975 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.199463 2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 16:22:37.537975 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.199466 2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 16:22:37.537975 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.199468 2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 16:22:37.537975 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.199471 2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 16:22:37.537975 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.199474 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 16:22:37.537975 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.199477 2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 16:22:37.537975 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.199479 2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 16:22:37.537975 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.199481 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 16:22:37.537975 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.199484 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 16:22:37.537975 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.199487 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 16:22:37.538818 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.199490 2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 16:22:37.538818 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.199493 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 16:22:37.538818 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.199496 2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 16:22:37.538818 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.199499 2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 16:22:37.538818 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.199501 2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 16:22:37.538818 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.199504 2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 16:22:37.538818 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.199507 2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 16:22:37.538818 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.199509 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 16:22:37.538818 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.199513 2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 16:22:37.538818 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.199516 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 16:22:37.538818 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.199519 2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 16:22:37.538818 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.199521 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 16:22:37.538818 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.199524 2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 16:22:37.538818 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.199526 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 16:22:37.538818 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.199529 2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 16:22:37.538818 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.199531 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 16:22:37.538818 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.199534 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 16:22:37.538818 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.199536 2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 16:22:37.538818 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.199540 2552 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 16:22:37.539676 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.199544 2552 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 16:22:37.539676 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.199547 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 16:22:37.539676 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.199549 2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 16:22:37.539676 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.199553 2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 16:22:37.539676 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.199556 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 16:22:37.539676 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.199560 2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 16:22:37.539676 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.199562 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 16:22:37.539676 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.199565 2552 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 16:22:37.539676 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.199567 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 16:22:37.539676 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.199570 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 16:22:37.539676 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.199572 2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 16:22:37.539676 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.199575 2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 16:22:37.539676 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.199578 2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 16:22:37.539676 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.199580 2552 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 16:22:37.539676 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.199583 2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 16:22:37.539676 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.199586 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 16:22:37.539676 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.199589 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 16:22:37.539676 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.199592 2552 feature_gate.go:328] unrecognized feature gate: Example Jul 07 16:22:37.539676 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.199595 2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 16:22:37.539676 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.199597 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 16:22:37.540565 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.199599 2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 16:22:37.540565 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.199602 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 16:22:37.540565 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.199604 2552 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 16:22:37.540565 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.199607 2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 16:22:37.540565 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.199609 2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 16:22:37.540565 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.199612 2552 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 16:22:37.540565 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.199614 2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 16:22:37.540565 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.199617 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 16:22:37.540565 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.199619 2552 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 16:22:37.540565 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.199622 2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 16:22:37.540565 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.199626 2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 16:22:37.540565 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.199629 2552 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 16:22:37.540565 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.199632 2552 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 16:22:37.540565 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.199635 2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 16:22:37.540565 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.199638 2552 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 16:22:37.540565 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.199641 2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 16:22:37.540565 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.199644 2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 16:22:37.540565 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.199648 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 16:22:37.540565 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.199651 2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 16:22:37.541612 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.199654 2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 16:22:37.541612 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.199656 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 16:22:37.541612 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.199659 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 16:22:37.541612 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.199663 2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 16:22:37.541612 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.199667 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 16:22:37.541612 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.199670 2552 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 16:22:37.541612 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.199673 2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 16:22:37.541612 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.199676 2552 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 16:22:37.541612 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.199679 2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 16:22:37.541612 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.199681 2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 16:22:37.541612 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.199684 2552 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 16:22:37.541612 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.199687 2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 16:22:37.541612 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.199690 2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 16:22:37.541612 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.199692 2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 16:22:37.541612 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.199695 2552 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 16:22:37.541612 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.199698 2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 16:22:37.541612 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.199700 2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 16:22:37.541612 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.199703 2552 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 16:22:37.541612 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.199705 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 16:22:37.541612 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.199708 2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 16:22:37.542671 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.199710 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 16:22:37.542671 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.199713 2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 16:22:37.542671 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.199715 2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 16:22:37.542671 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.200099 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 16:22:37.542671 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.200104 2552 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 16:22:37.542671 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.200106 2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 16:22:37.542671 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.200109 2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 16:22:37.542671 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.200112 2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 16:22:37.542671 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.200114 2552 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 16:22:37.542671 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.200117 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 16:22:37.542671 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.200120 2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 16:22:37.542671 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.200123 2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 16:22:37.542671 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.200125 2552 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 16:22:37.542671 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.200128 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 16:22:37.542671 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.200131 2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 16:22:37.542671 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.200133 2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 16:22:37.542671 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.200136 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 16:22:37.542671 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.200139 2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 16:22:37.542671 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.200141 2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 16:22:37.542671 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.200144 2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 16:22:37.543498 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.200147 2552 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 16:22:37.543498 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.200150 2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 16:22:37.543498 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.200152 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 16:22:37.543498 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.200155 2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 16:22:37.543498 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.200157 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 16:22:37.543498 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.200160 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 16:22:37.543498 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.200162 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 16:22:37.543498 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.200165 2552 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 16:22:37.543498 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.200167 2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 16:22:37.543498 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.200169 2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 16:22:37.543498 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.200172 2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 16:22:37.543498 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.200174 2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 16:22:37.543498 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.200177 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 16:22:37.543498 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.200179 2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 16:22:37.543498 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.200182 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 16:22:37.543498 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.200184 2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 16:22:37.543498 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.200187 2552 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 16:22:37.543498 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.200189 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 16:22:37.543498 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.200192 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 16:22:37.543498 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.200195 2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 16:22:37.544116 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.200198 2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 16:22:37.544116 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.200217 2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 16:22:37.544116 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.200220 2552 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 16:22:37.544116 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.200222 2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 16:22:37.544116 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.200225 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 16:22:37.544116 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.200228 2552 feature_gate.go:328] unrecognized feature gate: Example Jul 07 16:22:37.544116 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.200230 2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 16:22:37.544116 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.200233 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 16:22:37.544116 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.200236 2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 16:22:37.544116 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.200238 2552 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 16:22:37.544116 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.200241 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 16:22:37.544116 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.200243 2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 16:22:37.544116 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.200247 2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 16:22:37.544116 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.200250 2552 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 16:22:37.544116 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.200254 2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 16:22:37.544116 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.200256 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 16:22:37.544116 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.200258 2552 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 16:22:37.544116 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.200261 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 16:22:37.544116 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.200263 2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 16:22:37.544116 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.200266 2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 16:22:37.545023 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.200268 2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 16:22:37.545023 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.200271 2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 16:22:37.545023 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.200275 2552 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 16:22:37.545023 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.200282 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 16:22:37.545023 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.200285 2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 16:22:37.545023 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.200288 2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 16:22:37.545023 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.200291 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 16:22:37.545023 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.200294 2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 16:22:37.545023 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.200296 2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 16:22:37.545023 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.200299 2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 16:22:37.545023 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.200302 2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 16:22:37.545023 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.200305 2552 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 16:22:37.545023 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.200307 2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 16:22:37.545023 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.200310 2552 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 16:22:37.545023 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.200312 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 16:22:37.545023 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.200315 2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 16:22:37.545023 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.200317 2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 16:22:37.545023 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.200322 2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 16:22:37.545023 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.200325 2552 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 16:22:37.545709 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.200328 2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 16:22:37.545709 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.200331 2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 16:22:37.545709 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.200333 2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 16:22:37.545709 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.200336 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 16:22:37.545709 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.200338 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 16:22:37.545709 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.200341 2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 16:22:37.545709 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.200344 2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 16:22:37.545709 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.200346 2552 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 16:22:37.545709 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.200349 2552 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 16:22:37.545709 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.200352 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 16:22:37.545709 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.200354 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 16:22:37.545709 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.200359 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 16:22:37.545709 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.200361 2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 16:22:37.545709 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.200364 2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 16:22:37.545709 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.200366 2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 16:22:37.545709 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.200368 2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 16:22:37.545709 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.200373 2552 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 16:22:37.545709 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.200375 2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 16:22:37.545709 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.200378 2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 16:22:37.545709 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.200380 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 16:22:37.546568 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.200383 2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 16:22:37.546568 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.200386 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 16:22:37.546568 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.200388 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 16:22:37.546568 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200458 2552 flags.go:64] FLAG: --address="0.0.0.0" Jul 07 16:22:37.546568 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200465 2552 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 07 16:22:37.546568 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200472 2552 flags.go:64] FLAG: --anonymous-auth="true" Jul 07 16:22:37.546568 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200484 2552 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 07 16:22:37.546568 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200488 2552 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 07 16:22:37.546568 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200491 2552 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 07 16:22:37.546568 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200495 2552 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 07 16:22:37.546568 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200500 2552 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 07 16:22:37.546568 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200503 2552 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 07 16:22:37.546568 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200505 2552 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 07 16:22:37.546568 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200509 2552 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 07 16:22:37.546568 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200512 2552 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 07 16:22:37.546568 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200515 2552 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 07 16:22:37.546568 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200518 2552 flags.go:64] FLAG: --cgroup-root="" Jul 07 16:22:37.546568 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200521 2552 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 07 16:22:37.546568 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200524 2552 flags.go:64] FLAG: --client-ca-file="" Jul 07 16:22:37.546568 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200527 2552 flags.go:64] FLAG: --cloud-provider="external" Jul 07 16:22:37.546568 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200530 2552 flags.go:64] FLAG: --cluster-dns="[]" Jul 07 16:22:37.546568 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200535 2552 flags.go:64] FLAG: --cluster-domain="" Jul 07 16:22:37.546568 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200538 2552 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 07 16:22:37.546568 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200542 2552 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 07 16:22:37.547615 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200545 2552 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 07 16:22:37.547615 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200548 2552 flags.go:64] FLAG: --container-log-max-files="5" Jul 07 16:22:37.547615 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200552 2552 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 07 16:22:37.547615 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200555 2552 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 07 16:22:37.547615 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200559 2552 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 07 16:22:37.547615 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200562 2552 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 07 16:22:37.547615 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200565 2552 flags.go:64] FLAG: --contention-profiling="false" Jul 07 16:22:37.547615 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200569 2552 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 07 16:22:37.547615 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200571 2552 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 07 16:22:37.547615 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200574 2552 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 07 16:22:37.547615 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200577 2552 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 07 16:22:37.547615 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200581 2552 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 07 16:22:37.547615 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200584 2552 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 07 16:22:37.547615 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200587 2552 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 07 16:22:37.547615 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200590 2552 flags.go:64] FLAG: --enable-load-reader="false" Jul 07 16:22:37.547615 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200592 2552 flags.go:64] FLAG: --enable-server="true" Jul 07 16:22:37.547615 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200595 2552 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 07 16:22:37.547615 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200599 2552 flags.go:64] FLAG: --event-burst="100" Jul 07 16:22:37.547615 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200603 2552 flags.go:64] FLAG: --event-qps="50" Jul 07 16:22:37.547615 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200605 2552 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 07 16:22:37.547615 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200608 2552 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 07 16:22:37.547615 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200611 2552 flags.go:64] FLAG: --eviction-hard="" Jul 07 16:22:37.547615 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200615 2552 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 07 16:22:37.547615 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200618 2552 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 07 16:22:37.548406 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200621 2552 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 07 16:22:37.548406 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200623 2552 flags.go:64] FLAG: --eviction-soft="" Jul 07 16:22:37.548406 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200626 2552 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 07 16:22:37.548406 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200629 2552 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 07 16:22:37.548406 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200633 2552 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 07 16:22:37.548406 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200636 2552 flags.go:64] FLAG: --experimental-mounter-path="" Jul 07 16:22:37.548406 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200638 2552 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 07 16:22:37.548406 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200642 2552 flags.go:64] FLAG: --fail-swap-on="true" Jul 07 16:22:37.548406 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200645 2552 flags.go:64] FLAG: --feature-gates="" Jul 07 16:22:37.548406 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200648 2552 flags.go:64] FLAG: --file-check-frequency="20s" Jul 07 16:22:37.548406 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200651 2552 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 07 16:22:37.548406 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200654 2552 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 07 16:22:37.548406 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200658 2552 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 07 16:22:37.548406 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200661 2552 flags.go:64] FLAG: --healthz-port="10248" Jul 07 16:22:37.548406 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200664 2552 flags.go:64] FLAG: --help="false" Jul 07 16:22:37.548406 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200667 2552 flags.go:64] FLAG: --hostname-override="ip-10-0-138-189.ec2.internal" Jul 07 16:22:37.548406 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200670 2552 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 07 16:22:37.548406 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200673 2552 flags.go:64] FLAG: --http-check-frequency="20s" Jul 07 16:22:37.548406 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200675 2552 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 07 16:22:37.548406 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200679 2552 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 07 16:22:37.548406 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200682 2552 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 07 16:22:37.548406 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200685 2552 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 07 16:22:37.548406 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200688 2552 flags.go:64] FLAG: --image-service-endpoint="" Jul 07 16:22:37.549040 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200690 2552 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 07 16:22:37.549040 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200693 2552 flags.go:64] FLAG: --kube-api-burst="100" Jul 07 16:22:37.549040 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200696 2552 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 07 16:22:37.549040 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200699 2552 flags.go:64] FLAG: --kube-api-qps="50" Jul 07 16:22:37.549040 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200702 2552 flags.go:64] FLAG: --kube-reserved="" Jul 07 16:22:37.549040 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200705 2552 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 07 16:22:37.549040 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200707 2552 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 07 16:22:37.549040 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200710 2552 flags.go:64] FLAG: --kubelet-cgroups="" Jul 07 16:22:37.549040 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200714 2552 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 07 16:22:37.549040 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200717 2552 flags.go:64] FLAG: --lock-file="" Jul 07 16:22:37.549040 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200719 2552 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 07 16:22:37.549040 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200722 2552 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 07 16:22:37.549040 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200725 2552 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 07 16:22:37.549040 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200730 2552 flags.go:64] FLAG: --log-json-split-stream="false" Jul 07 16:22:37.549040 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200733 2552 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 07 16:22:37.549040 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200736 2552 flags.go:64] FLAG: --log-text-split-stream="false" Jul 07 16:22:37.549040 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200740 2552 flags.go:64] FLAG: --logging-format="text" Jul 07 16:22:37.549040 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200743 2552 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 07 16:22:37.549040 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200746 2552 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 07 16:22:37.549040 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200749 2552 flags.go:64] FLAG: --manifest-url="" Jul 07 16:22:37.549040 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200752 2552 flags.go:64] FLAG: --manifest-url-header="" Jul 07 16:22:37.549040 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200758 2552 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 07 16:22:37.549040 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200761 2552 flags.go:64] FLAG: --max-open-files="1000000" Jul 07 16:22:37.549040 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200765 2552 flags.go:64] FLAG: --max-pods="110" Jul 07 16:22:37.549040 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200768 2552 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 07 16:22:37.549891 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200771 2552 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 07 16:22:37.549891 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200774 2552 flags.go:64] FLAG: --memory-manager-policy="None" Jul 07 16:22:37.549891 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200776 2552 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 07 16:22:37.549891 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200779 2552 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 07 16:22:37.549891 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200782 2552 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 07 16:22:37.549891 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200785 2552 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 07 16:22:37.549891 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200792 2552 flags.go:64] FLAG: --node-status-max-images="50" Jul 07 16:22:37.549891 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200795 2552 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 07 16:22:37.549891 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200798 2552 flags.go:64] FLAG: --oom-score-adj="-999" Jul 07 16:22:37.549891 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200802 2552 flags.go:64] FLAG: --pod-cidr="" Jul 07 16:22:37.549891 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200804 2552 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 07 16:22:37.549891 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200811 2552 flags.go:64] FLAG: --pod-manifest-path="" Jul 07 16:22:37.549891 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200814 2552 flags.go:64] FLAG: --pod-max-pids="-1" Jul 07 16:22:37.549891 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200817 2552 flags.go:64] FLAG: --pods-per-core="0" Jul 07 16:22:37.549891 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200820 2552 flags.go:64] FLAG: --port="10250" Jul 07 16:22:37.549891 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200823 2552 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 07 16:22:37.549891 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200826 2552 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-088862b12493978aa" Jul 07 16:22:37.549891 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200829 2552 flags.go:64] FLAG: --qos-reserved="" Jul 07 16:22:37.549891 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200832 2552 flags.go:64] FLAG: --read-only-port="10255" Jul 07 16:22:37.549891 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200835 2552 flags.go:64] FLAG: --register-node="true" Jul 07 16:22:37.549891 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200838 2552 flags.go:64] FLAG: --register-with-taints="" Jul 07 16:22:37.549891 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200842 2552 flags.go:64] FLAG: --registry-burst="10" Jul 07 16:22:37.549891 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200845 2552 flags.go:64] FLAG: --registry-qps="5" Jul 07 16:22:37.549891 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200849 2552 flags.go:64] FLAG: --reserved-cpus="" Jul 07 16:22:37.550745 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200852 2552 flags.go:64] FLAG: --reserved-memory="" Jul 07 16:22:37.550745 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200856 2552 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 07 16:22:37.550745 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200859 2552 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 07 16:22:37.550745 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200862 2552 flags.go:64] FLAG: --rotate-certificates="false" Jul 07 16:22:37.550745 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200865 2552 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 07 16:22:37.550745 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200869 2552 flags.go:64] FLAG: --runonce="false" Jul 07 16:22:37.550745 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200871 2552 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 07 16:22:37.550745 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200874 2552 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 07 16:22:37.550745 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200877 2552 flags.go:64] FLAG: --seccomp-default="false" Jul 07 16:22:37.550745 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200880 2552 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 07 16:22:37.550745 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200883 2552 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 07 16:22:37.550745 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200886 2552 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 07 16:22:37.550745 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200889 2552 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 07 16:22:37.550745 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200892 2552 flags.go:64] FLAG: --storage-driver-password="root" Jul 07 16:22:37.550745 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200895 2552 flags.go:64] FLAG: --storage-driver-secure="false" Jul 07 16:22:37.550745 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200898 2552 flags.go:64] FLAG: --storage-driver-table="stats" Jul 07 16:22:37.550745 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200900 2552 flags.go:64] FLAG: --storage-driver-user="root" Jul 07 16:22:37.550745 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200903 2552 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 07 16:22:37.550745 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200906 2552 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 07 16:22:37.550745 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200909 2552 flags.go:64] FLAG: --system-cgroups="" Jul 07 16:22:37.550745 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200912 2552 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 07 16:22:37.550745 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200917 2552 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 07 16:22:37.550745 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200920 2552 flags.go:64] FLAG: --tls-cert-file="" Jul 07 16:22:37.550745 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200922 2552 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 07 16:22:37.550745 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200929 2552 flags.go:64] FLAG: --tls-min-version="" Jul 07 16:22:37.551640 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200932 2552 flags.go:64] FLAG: --tls-private-key-file="" Jul 07 16:22:37.551640 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200935 2552 flags.go:64] FLAG: --topology-manager-policy="none" Jul 07 16:22:37.551640 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200937 2552 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 07 16:22:37.551640 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200940 2552 flags.go:64] FLAG: --topology-manager-scope="container" Jul 07 16:22:37.551640 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200943 2552 flags.go:64] FLAG: --v="2" Jul 07 16:22:37.551640 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200947 2552 flags.go:64] FLAG: --version="false" Jul 07 16:22:37.551640 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200953 2552 flags.go:64] FLAG: --vmodule="" Jul 07 16:22:37.551640 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200957 2552 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 07 16:22:37.551640 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.200960 2552 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 07 16:22:37.551640 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.201077 2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 16:22:37.551640 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.201080 2552 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 16:22:37.551640 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.201083 2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 16:22:37.551640 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.201089 2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 16:22:37.551640 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.201091 2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 16:22:37.551640 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.201094 2552 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 16:22:37.551640 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.201097 2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 16:22:37.551640 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.201101 2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 16:22:37.551640 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.201104 2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 16:22:37.551640 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.201107 2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 16:22:37.551640 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.201110 2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 16:22:37.551640 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.201112 2552 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 16:22:37.554834 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.201115 2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 16:22:37.554834 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.201117 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 16:22:37.554834 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.201120 2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 16:22:37.554834 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.201122 2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 16:22:37.554834 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.201125 2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 16:22:37.554834 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.201127 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 16:22:37.554834 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.201130 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 16:22:37.554834 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.201132 2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 16:22:37.554834 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.201135 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 16:22:37.554834 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.201137 2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 16:22:37.554834 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.201140 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 16:22:37.554834 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.201142 2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 16:22:37.554834 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.201145 2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 16:22:37.554834 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.201147 2552 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 16:22:37.554834 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.201149 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 16:22:37.554834 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.201152 2552 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 16:22:37.554834 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.201154 2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 16:22:37.554834 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.201158 2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 16:22:37.554834 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.201161 2552 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 16:22:37.555476 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.201164 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 16:22:37.555476 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.201166 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 16:22:37.555476 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.201169 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 16:22:37.555476 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.201171 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 16:22:37.555476 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.201175 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 16:22:37.555476 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.201178 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 16:22:37.555476 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.201180 2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 16:22:37.555476 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.201183 2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 16:22:37.555476 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.201185 2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 16:22:37.555476 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.201188 2552 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 16:22:37.555476 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.201191 2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 16:22:37.555476 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.201193 2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 16:22:37.555476 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.201195 2552 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 16:22:37.555476 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.201198 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 16:22:37.555476 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.201216 2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 16:22:37.555476 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.201220 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 16:22:37.555476 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.201223 2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 16:22:37.555476 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.201226 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 16:22:37.555476 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.201229 2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 16:22:37.555476 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.201231 2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 16:22:37.562054 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.201234 2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 16:22:37.562054 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.201236 2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 16:22:37.562054 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.201239 2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 16:22:37.562054 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.201241 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 16:22:37.562054 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.201244 2552 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 16:22:37.562054 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.201246 2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 16:22:37.562054 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.201249 2552 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 16:22:37.562054 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.201251 2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 16:22:37.562054 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.201254 2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 16:22:37.562054 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.201256 2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 16:22:37.562054 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.201261 2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 16:22:37.562054 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.201264 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 16:22:37.562054 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.201268 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 16:22:37.562054 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.201270 2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 16:22:37.562054 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.201273 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 16:22:37.562054 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.201275 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 16:22:37.562054 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.201279 2552 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 16:22:37.562054 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.201282 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 16:22:37.562054 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.201284 2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 16:22:37.562698 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.201287 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 16:22:37.562698 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.201289 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 16:22:37.562698 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.201293 2552 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 16:22:37.562698 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.201296 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 16:22:37.562698 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.201299 2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 16:22:37.562698 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.201302 2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 16:22:37.562698 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.201305 2552 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 16:22:37.562698 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.201308 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 16:22:37.562698 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.201310 2552 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 16:22:37.562698 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.201313 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 16:22:37.562698 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.201315 2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 16:22:37.562698 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.201318 2552 feature_gate.go:328] unrecognized feature gate: Example Jul 07 16:22:37.562698 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.201320 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 16:22:37.562698 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.201323 2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 16:22:37.562698 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.201326 2552 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 16:22:37.562698 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.201328 2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 16:22:37.562698 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.201332 2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 16:22:37.562698 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.201335 2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 16:22:37.562698 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.201337 2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 16:22:37.563538 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.201340 2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 16:22:37.563538 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.201342 2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 16:22:37.563538 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.201345 2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 16:22:37.563538 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.201348 2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 16:22:37.563538 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.201351 2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 16:22:37.563538 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.201353 2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 16:22:37.563538 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.201356 2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 16:22:37.563538 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.201379 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 16:22:37.563538 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.201382 2552 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 16:22:37.563538 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.201385 2552 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 16:22:37.563538 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.202128 2552 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 07 16:22:37.563538 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.210451 2552 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 07 16:22:37.563538 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.210466 2552 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 07 16:22:37.563538 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.210485 2552 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 07 16:22:37.563538 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.210491 2552 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 07 16:22:37.564176 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.210560 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 16:22:37.564176 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.210565 2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 16:22:37.564176 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.210569 2552 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 16:22:37.564176 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.210573 2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 16:22:37.564176 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.210576 2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 16:22:37.564176 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.210579 2552 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 16:22:37.564176 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.210582 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 16:22:37.564176 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.210585 2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 16:22:37.564176 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.210588 2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 16:22:37.564176 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.210591 2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 16:22:37.564176 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.210594 2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 16:22:37.564176 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.210596 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 16:22:37.564176 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.210599 2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 16:22:37.564176 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.210602 2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 16:22:37.564176 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.210605 2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 16:22:37.564176 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.210607 2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 16:22:37.564176 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.210610 2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 16:22:37.564176 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.210612 2552 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 16:22:37.564176 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.210615 2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 16:22:37.564176 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.210618 2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 16:22:37.564813 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.210621 2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 16:22:37.564813 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.210623 2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 16:22:37.564813 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.210626 2552 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 16:22:37.564813 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.210628 2552 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 16:22:37.564813 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.210632 2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 16:22:37.564813 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.210635 2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 16:22:37.564813 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.210638 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 16:22:37.564813 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.210641 2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 16:22:37.564813 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.210643 2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 16:22:37.564813 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.210646 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 16:22:37.564813 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.210649 2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 16:22:37.564813 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.210651 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 16:22:37.564813 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.210654 2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 16:22:37.564813 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.210656 2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 16:22:37.564813 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.210660 2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 16:22:37.564813 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.210667 2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 16:22:37.564813 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.210670 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 16:22:37.564813 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.210673 2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 16:22:37.564813 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.210675 2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 16:22:37.564813 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.210680 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 16:22:37.565449 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.210682 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 16:22:37.565449 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.210685 2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 16:22:37.565449 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.210688 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 16:22:37.565449 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.210691 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 16:22:37.565449 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.210694 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 16:22:37.565449 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.210698 2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 16:22:37.565449 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.210701 2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 16:22:37.565449 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.210704 2552 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 16:22:37.565449 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.210707 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 16:22:37.565449 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.210710 2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 16:22:37.565449 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.210713 2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 16:22:37.565449 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.210716 2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 16:22:37.565449 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.210719 2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 16:22:37.565449 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.210721 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 16:22:37.565449 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.210724 2552 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 16:22:37.565449 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.210727 2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 16:22:37.565449 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.210730 2552 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 16:22:37.565449 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.210733 2552 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 16:22:37.565449 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.210736 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 16:22:37.633426 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.210738 2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 16:22:37.633426 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.210741 2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 16:22:37.633426 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.210744 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 16:22:37.633426 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.210746 2552 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 16:22:37.633426 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.210749 2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 16:22:37.633426 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.210751 2552 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 16:22:37.633426 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.210754 2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 16:22:37.633426 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.210756 2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 16:22:37.633426 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.210763 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 16:22:37.633426 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.210766 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 16:22:37.633426 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.210769 2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 16:22:37.633426 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.210771 2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 16:22:37.633426 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.210775 2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 16:22:37.633426 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.210777 2552 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 16:22:37.633426 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.210780 2552 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 16:22:37.633426 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.210783 2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 16:22:37.633426 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.210786 2552 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 16:22:37.633426 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.210788 2552 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 16:22:37.633426 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.210790 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 16:22:37.633426 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.210793 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 16:22:37.634174 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.210795 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 16:22:37.634174 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.210798 2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 16:22:37.634174 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.210801 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 16:22:37.634174 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.210803 2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 16:22:37.634174 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.210805 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 16:22:37.634174 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.210808 2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 16:22:37.634174 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.210810 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 16:22:37.634174 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.210813 2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 16:22:37.634174 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.210816 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 16:22:37.634174 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.210819 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 16:22:37.634174 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.210821 2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 16:22:37.634174 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.210827 2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 16:22:37.634174 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.210830 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 16:22:37.634174 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.210833 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 16:22:37.634174 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.210835 2552 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 16:22:37.634174 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.210838 2552 feature_gate.go:328] unrecognized feature gate: Example Jul 07 16:22:37.634174 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.210842 2552 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 16:22:37.634174 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.210845 2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 16:22:37.634174 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.210848 2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 16:22:37.634812 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.210851 2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 16:22:37.634812 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.210857 2552 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 07 16:22:37.634812 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.210996 2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 16:22:37.634812 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.211001 2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 16:22:37.634812 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.211004 2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 16:22:37.634812 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.211007 2552 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 16:22:37.634812 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.211011 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 16:22:37.634812 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.211013 2552 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 16:22:37.634812 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.211016 2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 16:22:37.634812 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.211019 2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 16:22:37.634812 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.211021 2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 16:22:37.634812 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.211024 2552 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 16:22:37.634812 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.211027 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 16:22:37.634812 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.211029 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 16:22:37.634812 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.211032 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 16:22:37.635461 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.211035 2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 16:22:37.635461 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.211037 2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 16:22:37.635461 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.211040 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 16:22:37.635461 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.211042 2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 16:22:37.635461 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.211045 2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 16:22:37.635461 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.211047 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 16:22:37.635461 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.211050 2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 16:22:37.635461 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.211053 2552 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 16:22:37.635461 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.211055 2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 16:22:37.635461 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.211058 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 16:22:37.635461 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.211061 2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 16:22:37.635461 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.211063 2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 16:22:37.635461 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.211066 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 16:22:37.635461 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.211068 2552 feature_gate.go:328] unrecognized feature gate: Example Jul 07 16:22:37.635461 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.211071 2552 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 16:22:37.635461 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.211073 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 16:22:37.635461 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.211076 2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 16:22:37.635461 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.211078 2552 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 16:22:37.635461 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.211082 2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 16:22:37.635461 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.211085 2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 16:22:37.636085 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.211088 2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 16:22:37.636085 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.211092 2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 16:22:37.636085 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.211094 2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 16:22:37.636085 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.211098 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 16:22:37.636085 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.211102 2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 16:22:37.636085 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.211105 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 16:22:37.636085 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.211108 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 16:22:37.636085 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.211111 2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 16:22:37.636085 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.211114 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 16:22:37.636085 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.211117 2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 16:22:37.636085 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.211120 2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 16:22:37.636085 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.211122 2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 16:22:37.636085 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.211125 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 16:22:37.636085 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.211127 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 16:22:37.636085 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.211130 2552 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 16:22:37.636085 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.211132 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 16:22:37.636085 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.211135 2552 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 16:22:37.636085 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.211137 2552 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 16:22:37.636085 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.211140 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 16:22:37.636716 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.211142 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 16:22:37.636716 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.211145 2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 16:22:37.636716 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.211147 2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 16:22:37.636716 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.211150 2552 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 16:22:37.636716 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.211153 2552 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 16:22:37.636716 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.211156 2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 16:22:37.636716 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.211158 2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 16:22:37.636716 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.211161 2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 16:22:37.636716 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.211163 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 16:22:37.636716 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.211166 2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 16:22:37.636716 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.211168 2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 16:22:37.636716 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.211172 2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 16:22:37.636716 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.211175 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 16:22:37.636716 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.211177 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 16:22:37.636716 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.211180 2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 16:22:37.636716 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.211182 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 16:22:37.636716 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.211186 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 16:22:37.636716 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.211188 2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 16:22:37.636716 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.211191 2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 16:22:37.636716 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.211193 2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 16:22:37.637349 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.211196 2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 16:22:37.637349 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.211198 2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 16:22:37.637349 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.211216 2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 16:22:37.637349 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.211219 2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 16:22:37.637349 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.211222 2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 16:22:37.637349 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.211225 2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 16:22:37.637349 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.211227 2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 16:22:37.637349 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.211229 2552 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 16:22:37.637349 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.211232 2552 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 16:22:37.637349 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.211236 2552 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 16:22:37.637349 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.211239 2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 16:22:37.637349 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.211242 2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 16:22:37.637349 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.211245 2552 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 16:22:37.637349 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.211248 2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 16:22:37.637349 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.211251 2552 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 16:22:37.637349 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.211253 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 16:22:37.637349 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.211256 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 16:22:37.637349 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.211259 2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 16:22:37.637349 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.211261 2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 16:22:37.637349 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.211264 2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 16:22:37.637987 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.211266 2552 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 16:22:37.637987 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.211269 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 16:22:37.637987 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.211271 2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 16:22:37.637987 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.211275 2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 16:22:37.637987 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.211277 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 16:22:37.637987 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.211280 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 16:22:37.637987 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:37.211282 2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 16:22:37.637987 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.211287 2552 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 07 16:22:37.637987 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.211398 2552 server.go:962] "Client rotation is on, will bootstrap in background" Jul 07 16:22:37.637987 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.213646 2552 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 07 16:22:37.637987 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.215479 2552 server.go:1019] "Starting client certificate rotation" Jul 07 16:22:37.637987 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.215583 2552 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 07 16:22:37.637987 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.215619 2552 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 07 16:22:37.638430 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.218337 2552 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 07 16:22:37.638430 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.220457 2552 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 07 16:22:37.638430 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.232422 2552 log.go:25] "Validated CRI v1 runtime API" Jul 07 16:22:37.638430 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.234650 2552 log.go:25] "Validated CRI v1 image API" Jul 07 16:22:37.638430 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.238761 2552 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 07 16:22:37.638430 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.245149 2552 fs.go:135] Filesystem UUIDs: map[11bcd3d4-95d5-49b4-8fe6-8a032425bb6a:/dev/nvme0n1p4 2b40db24-d8ce-4a6b-8d36-dce94130e5dc:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] Jul 07 16:22:37.638430 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.245167 2552 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 07 16:22:37.639074 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.250879 2552 manager.go:216] Machine: {Timestamp:2026-07-07 16:22:37.249480911 +0000 UTC m=+0.382446361 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3109890 MemoryCapacity:33164505088 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2e3891894b3d2354cc1a6a30b999b8 SystemUUID:ec2e3891-894b-3d23-54cc-1a6a30b999b8 BootID:2661311b-78a8-49b6-9c5c-d5d389b59be7 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582254592 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:41:bb:89:c9:6d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:41:bb:89:c9:6d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:da:d5:8f:55:eb:f7 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164505088 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 07 16:22:37.639074 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.251025 2552 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 07 16:22:37.639074 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.251145 2552 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 07 16:22:37.639074 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.255276 2552 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 07 16:22:37.639074 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.255326 2552 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-189.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 07 16:22:37.639074 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.255545 2552 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 07 16:22:37.639074 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.256127 2552 topology_manager.go:138] "Creating topology manager with none policy" Jul 07 16:22:37.639074 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.256142 2552 container_manager_linux.go:309] "Creating device plugin manager" Jul 07 16:22:37.639074 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.256151 2552 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 07 16:22:37.639074 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.256163 2552 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 07 16:22:37.639074 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.257472 2552 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 07 16:22:37.639074 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.260866 2552 state_mem.go:36] "Initialized new in-memory state store" Jul 07 16:22:37.639074 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.261006 2552 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 07 16:22:37.639074 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.261036 2552 kubelet.go:486] "Attempting to sync node with API server" Jul 07 16:22:37.639074 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.261046 2552 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 07 16:22:37.639074 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.261058 2552 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 07 16:22:37.639074 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.261069 2552 kubelet.go:398] "Adding apiserver pod source" Jul 07 16:22:37.639729 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.261079 2552 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 07 16:22:37.639729 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.261521 2552 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 07 16:22:37.639729 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.261536 2552 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 07 16:22:37.639729 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.264483 2552 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 07 16:22:37.639729 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.266887 2552 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 07 16:22:37.639729 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.266978 2552 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 07 16:22:37.639729 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.268905 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 07 16:22:37.639729 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.268920 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 07 16:22:37.639729 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.268928 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 07 16:22:37.639729 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.268933 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 07 16:22:37.639729 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.268945 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 07 16:22:37.639729 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.268953 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 07 16:22:37.639729 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.268964 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 07 16:22:37.639729 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.268971 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 07 16:22:37.639729 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.268978 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 07 16:22:37.639729 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.268985 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 07 16:22:37.639729 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.269003 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 07 16:22:37.639729 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.269010 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 07 16:22:37.639729 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.269794 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 07 16:22:37.639729 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.269809 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 07 16:22:37.639729 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.276232 2552 server.go:1268] "Started kubelet" Jul 07 16:22:37.639729 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.276853 2552 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 07 16:22:37.639729 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.277238 2552 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 07 16:22:37.639729 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.277382 2552 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 07 16:22:37.639729 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.278239 2552 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-189.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 07 16:22:37.639729 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:22:37.278259 2552 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-189.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 07 16:22:37.639729 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:22:37.278268 2552 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 07 16:22:37.639729 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.279292 2552 server.go:310] "Adding debug handlers to kubelet server" Jul 07 16:22:37.639729 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.281423 2552 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 07 16:22:37.639729 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:22:37.285061 2552 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 07 16:22:37.639729 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.288671 2552 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 07 16:22:37.639729 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.288691 2552 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 07 16:22:37.639729 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:22:37.288764 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-189.ec2.internal\" not found" Jul 07 16:22:37.639729 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.289479 2552 factory.go:55] Registering systemd factory Jul 07 16:22:37.639729 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.289513 2552 factory.go:223] Registration of the systemd container factory successfully Jul 07 16:22:37.639729 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.289604 2552 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 07 16:22:37.639729 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.289600 2552 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 07 16:22:37.639729 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.289625 2552 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 07 16:22:37.639729 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.289713 2552 reconstruct.go:97] "Volume reconstruction finished" Jul 07 16:22:37.639729 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.289720 2552 factory.go:153] Registering CRI-O factory Jul 07 16:22:37.639729 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.289733 2552 factory.go:223] Registration of the crio container factory successfully Jul 07 16:22:37.639729 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.289724 2552 reconciler.go:29] "Reconciler: start to sync state" Jul 07 16:22:37.639729 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.289783 2552 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 07 16:22:37.639729 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.289808 2552 factory.go:103] Registering Raw factory Jul 07 16:22:37.639729 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.289827 2552 manager.go:1196] Started watching for new ooms in manager Jul 07 16:22:37.639729 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.290274 2552 manager.go:349] Starting recovery of all containers Jul 07 16:22:37.639729 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:22:37.294298 2552 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-138-189.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 07 16:22:37.641504 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:22:37.294719 2552 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 07 16:22:37.641504 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:22:37.294726 2552 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-189.ec2.internal.18c00e77222ba86b default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-189.ec2.internal,UID:ip-10-0-138-189.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-189.ec2.internal,},FirstTimestamp:2026-07-07 16:22:37.275900011 +0000 UTC m=+0.408865462,LastTimestamp:2026-07-07 16:22:37.275900011 +0000 UTC m=+0.408865462,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-189.ec2.internal,}" Jul 07 16:22:37.641504 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.302591 2552 manager.go:354] Recovery completed Jul 07 16:22:37.641504 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.306919 2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 16:22:37.641504 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.308980 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-189.ec2.internal" event="NodeHasSufficientMemory" Jul 07 16:22:37.641504 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.309022 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-189.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 16:22:37.641504 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.309035 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-189.ec2.internal" event="NodeHasSufficientPID" Jul 07 16:22:37.641504 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.309538 2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 16:22:37.641504 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.309537 2552 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 07 16:22:37.641504 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.309601 2552 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 07 16:22:37.641504 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.309622 2552 state_mem.go:36] "Initialized new in-memory state store" Jul 07 16:22:37.641504 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.310183 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-189.ec2.internal" event="NodeHasSufficientMemory" Jul 07 16:22:37.641504 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.310217 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-189.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 16:22:37.641504 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.310230 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-189.ec2.internal" event="NodeHasSufficientPID" Jul 07 16:22:37.641504 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.311030 2552 policy_none.go:49] "None policy: Start" Jul 07 16:22:37.641504 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.311043 2552 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 07 16:22:37.641504 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.311053 2552 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 07 16:22:37.641504 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:22:37.311667 2552 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-189.ec2.internal.18c00e772424c5bb default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-189.ec2.internal,UID:ip-10-0-138-189.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-138-189.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-138-189.ec2.internal,},FirstTimestamp:2026-07-07 16:22:37.309003195 +0000 UTC m=+0.441968649,LastTimestamp:2026-07-07 16:22:37.309003195 +0000 UTC m=+0.441968649,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-189.ec2.internal,}" Jul 07 16:22:37.641504 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.311989 2552 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-8rnwj" Jul 07 16:22:37.641504 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.312233 2552 policy_none.go:47] "Start" Jul 07 16:22:37.641504 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.319997 2552 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-8rnwj" Jul 07 16:22:37.641504 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:22:37.323546 2552 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-189.ec2.internal.18c00e772425282a default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-189.ec2.internal,UID:ip-10-0-138-189.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-138-189.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-138-189.ec2.internal,},FirstTimestamp:2026-07-07 16:22:37.309028394 +0000 UTC m=+0.441993846,LastTimestamp:2026-07-07 16:22:37.309028394 +0000 UTC m=+0.441993846,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-189.ec2.internal,}" Jul 07 16:22:37.641504 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.363951 2552 manager.go:337] "Starting Device Plugin manager" Jul 07 16:22:37.641504 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:22:37.364198 2552 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 07 16:22:37.641504 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.364223 2552 server.go:87] "Starting device plugin registration server" Jul 07 16:22:37.641504 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.364516 2552 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 07 16:22:37.641504 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.364533 2552 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 07 16:22:37.642377 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.364639 2552 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 07 16:22:37.642377 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.364729 2552 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 07 16:22:37.642377 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.364737 2552 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 07 16:22:37.642377 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:22:37.365267 2552 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 07 16:22:37.642377 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:22:37.365306 2552 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-189.ec2.internal\" not found" Jul 07 16:22:37.642377 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.433140 2552 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 07 16:22:37.642377 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.434380 2552 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 07 16:22:37.642377 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.434425 2552 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 07 16:22:37.642377 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.434455 2552 kubelet.go:2448] "Starting kubelet main sync loop" Jul 07 16:22:37.642377 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:22:37.434498 2552 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 07 16:22:37.642377 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.436979 2552 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 16:22:37.642377 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.464764 2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 16:22:37.642377 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.466001 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-189.ec2.internal" event="NodeHasSufficientMemory" Jul 07 16:22:37.642377 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.466029 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-189.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 16:22:37.642377 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.466040 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-189.ec2.internal" event="NodeHasSufficientPID" Jul 07 16:22:37.642377 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.466075 2552 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-189.ec2.internal" Jul 07 16:22:37.642377 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.473151 2552 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-189.ec2.internal" Jul 07 16:22:37.642377 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:22:37.473174 2552 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-189.ec2.internal\": node \"ip-10-0-138-189.ec2.internal\" not found" Jul 07 16:22:37.642377 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:22:37.514620 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-189.ec2.internal\" not found" Jul 07 16:22:37.642377 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.534725 2552 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-189.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-189.ec2.internal"] Jul 07 16:22:37.642377 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.534813 2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 16:22:37.642377 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.535863 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-189.ec2.internal" event="NodeHasSufficientMemory" Jul 07 16:22:37.642377 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.535902 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-189.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 16:22:37.642377 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.535916 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-189.ec2.internal" event="NodeHasSufficientPID" Jul 07 16:22:37.642377 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.537356 2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 16:22:37.642377 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.537458 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-189.ec2.internal" Jul 07 16:22:37.642377 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.537492 2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 16:22:37.642377 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.538424 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-189.ec2.internal" event="NodeHasSufficientMemory" Jul 07 16:22:37.642377 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.538446 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-189.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 16:22:37.642377 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.538455 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-189.ec2.internal" event="NodeHasSufficientPID" Jul 07 16:22:37.642377 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.539118 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-189.ec2.internal" event="NodeHasSufficientMemory" Jul 07 16:22:37.642377 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.539146 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-189.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 16:22:37.642377 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.539158 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-189.ec2.internal" event="NodeHasSufficientPID" Jul 07 16:22:37.642377 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.539719 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-189.ec2.internal" Jul 07 16:22:37.642377 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.539741 2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 16:22:37.642377 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.540391 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-189.ec2.internal" event="NodeHasSufficientMemory" Jul 07 16:22:37.642377 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.540419 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-189.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 16:22:37.642377 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.540432 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-189.ec2.internal" event="NodeHasSufficientPID" Jul 07 16:22:37.642377 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.591568 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/77665ae9de9dad3a92d5a2fadb79fc22-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-189.ec2.internal\" (UID: \"77665ae9de9dad3a92d5a2fadb79fc22\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-189.ec2.internal" Jul 07 16:22:37.645847 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.591593 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/77665ae9de9dad3a92d5a2fadb79fc22-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-189.ec2.internal\" (UID: \"77665ae9de9dad3a92d5a2fadb79fc22\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-189.ec2.internal" Jul 07 16:22:37.645847 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.591612 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/dc5e733733f3672abbc00ed966fa257c-config\") pod \"kube-apiserver-proxy-ip-10-0-138-189.ec2.internal\" (UID: \"dc5e733733f3672abbc00ed966fa257c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-189.ec2.internal" Jul 07 16:22:37.645847 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:22:37.615450 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-189.ec2.internal\" not found" Jul 07 16:22:37.645847 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:22:37.642656 2552 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-189.ec2.internal\" not found" node="ip-10-0-138-189.ec2.internal" Jul 07 16:22:37.647969 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:22:37.647452 2552 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-189.ec2.internal\" not found" node="ip-10-0-138-189.ec2.internal" Jul 07 16:22:37.709513 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.692737 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/77665ae9de9dad3a92d5a2fadb79fc22-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-189.ec2.internal\" (UID: \"77665ae9de9dad3a92d5a2fadb79fc22\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-189.ec2.internal" Jul 07 16:22:37.709513 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.692772 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/dc5e733733f3672abbc00ed966fa257c-config\") pod \"kube-apiserver-proxy-ip-10-0-138-189.ec2.internal\" (UID: \"dc5e733733f3672abbc00ed966fa257c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-189.ec2.internal" Jul 07 16:22:37.709513 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.692850 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/77665ae9de9dad3a92d5a2fadb79fc22-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-189.ec2.internal\" (UID: \"77665ae9de9dad3a92d5a2fadb79fc22\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-189.ec2.internal" Jul 07 16:22:37.709513 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.692910 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/dc5e733733f3672abbc00ed966fa257c-config\") pod \"kube-apiserver-proxy-ip-10-0-138-189.ec2.internal\" (UID: \"dc5e733733f3672abbc00ed966fa257c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-189.ec2.internal" Jul 07 16:22:37.709513 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.692937 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/77665ae9de9dad3a92d5a2fadb79fc22-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-189.ec2.internal\" (UID: \"77665ae9de9dad3a92d5a2fadb79fc22\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-189.ec2.internal" Jul 07 16:22:37.709513 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.692965 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/77665ae9de9dad3a92d5a2fadb79fc22-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-189.ec2.internal\" (UID: \"77665ae9de9dad3a92d5a2fadb79fc22\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-189.ec2.internal" Jul 07 16:22:37.716884 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:22:37.715854 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-189.ec2.internal\" not found" Jul 07 16:22:37.856595 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:22:37.816690 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-189.ec2.internal\" not found" Jul 07 16:22:37.923479 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:22:37.918013 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-189.ec2.internal\" not found" Jul 07 16:22:37.995729 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.947323 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-189.ec2.internal" Jul 07 16:22:37.995729 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:37.952895 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-189.ec2.internal" Jul 07 16:22:38.076799 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:22:38.019078 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-189.ec2.internal\" not found" Jul 07 16:22:38.157732 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:22:38.120156 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-189.ec2.internal\" not found" Jul 07 16:22:38.236657 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.214357 2552 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 07 16:22:38.236657 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.214515 2552 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 07 16:22:38.236657 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:22:38.221139 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-189.ec2.internal\" not found" Jul 07 16:22:38.310143 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.244415 2552 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 16:22:38.310143 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.262147 2552 apiserver.go:52] "Watching apiserver" Jul 07 16:22:38.310143 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.276847 2552 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 07 16:22:38.310143 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.277782 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-8qbxw","kube-system/konnectivity-agent-q798q","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zmxwh","openshift-cluster-node-tuning-operator/tuned-r5krk","openshift-image-registry/node-ca-dbg2n","openshift-multus/multus-additional-cni-plugins-mpbtm","openshift-multus/multus-bd7wg","openshift-multus/network-metrics-daemon-kngnh","openshift-dns/node-resolver-59lsn","openshift-network-diagnostics/network-check-target-8br2k","openshift-network-operator/iptables-alerter-84scn","openshift-ovn-kubernetes/ovnkube-node-dbbfb"] Jul 07 16:22:38.310143 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.279638 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8qbxw" Jul 07 16:22:38.310143 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:22:38.279711 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8qbxw" podUID="f5d16211-b5e0-4042-aeba-ba5d273ccd96" Jul 07 16:22:38.310143 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.280771 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-q798q" Jul 07 16:22:38.310143 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.282121 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zmxwh" Jul 07 16:22:38.310143 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.283459 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-cnsb9\"" Jul 07 16:22:38.310143 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.283475 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 07 16:22:38.310143 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.283679 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-r5krk" Jul 07 16:22:38.310143 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.283921 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 07 16:22:38.310143 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.284680 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 07 16:22:38.310143 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.285019 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 07 16:22:38.310143 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.285049 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 07 16:22:38.310143 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.285078 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-dbg2n" Jul 07 16:22:38.310143 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.285053 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-9qkpw\"" Jul 07 16:22:38.310143 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.286588 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-56r5l\"" Jul 07 16:22:38.310143 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.286618 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 07 16:22:38.310143 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.286626 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-mpbtm" Jul 07 16:22:38.310143 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.286902 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 07 16:22:38.310143 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.287890 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 07 16:22:38.310143 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.287937 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 07 16:22:38.310143 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.288182 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 07 16:22:38.310143 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.288222 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-gf4wd\"" Jul 07 16:22:38.310143 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.288343 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-bd7wg" Jul 07 16:22:38.310143 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.288788 2552 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 07 16:22:38.310143 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.288837 2552 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-189.ec2.internal" Jul 07 16:22:38.310143 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.289871 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 07 16:22:38.310143 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.289936 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kngnh" Jul 07 16:22:38.310143 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:22:38.290048 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kngnh" podUID="592ceff6-55ee-4890-8b40-5aa74cd26a35" Jul 07 16:22:38.310143 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.290067 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 07 16:22:38.310143 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.290097 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 07 16:22:38.311569 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.290067 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-49ccj\"" Jul 07 16:22:38.311569 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.290399 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 07 16:22:38.311569 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.290704 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 07 16:22:38.311569 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.291252 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 07 16:22:38.311569 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.291395 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-8s7hp\"" Jul 07 16:22:38.311569 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.291713 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-59lsn" Jul 07 16:22:38.311569 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.293205 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8br2k" Jul 07 16:22:38.311569 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:22:38.293304 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8br2k" podUID="53ce531f-ee40-476c-b275-915d9206d4d8" Jul 07 16:22:38.311569 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.294732 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-84scn" Jul 07 16:22:38.311569 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.294936 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-v6dc2\"" Jul 07 16:22:38.311569 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.295303 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 07 16:22:38.311569 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.295705 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 07 16:22:38.311569 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.296241 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f3614425-8241-4f22-be37-00b93b9d4d76-etc-sysctl-conf\") pod \"tuned-r5krk\" (UID: \"f3614425-8241-4f22-be37-00b93b9d4d76\") " pod="openshift-cluster-node-tuning-operator/tuned-r5krk" Jul 07 16:22:38.311569 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.296298 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/55b2059a-e73e-4aa1-a218-e8a3b61c4978-host-var-lib-kubelet\") pod \"multus-bd7wg\" (UID: \"55b2059a-e73e-4aa1-a218-e8a3b61c4978\") " pod="openshift-multus/multus-bd7wg" Jul 07 16:22:38.311569 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.296334 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/dbfa7ead-a6a8-4536-8a8d-cbe2e2b33011-agent-certs\") pod \"konnectivity-agent-q798q\" (UID: \"dbfa7ead-a6a8-4536-8a8d-cbe2e2b33011\") " pod="kube-system/konnectivity-agent-q798q" Jul 07 16:22:38.311569 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.296358 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/592ceff6-55ee-4890-8b40-5aa74cd26a35-metrics-certs\") pod \"network-metrics-daemon-kngnh\" (UID: \"592ceff6-55ee-4890-8b40-5aa74cd26a35\") " pod="openshift-multus/network-metrics-daemon-kngnh" Jul 07 16:22:38.311569 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.296391 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f3614425-8241-4f22-be37-00b93b9d4d76-etc-sysconfig\") pod \"tuned-r5krk\" (UID: \"f3614425-8241-4f22-be37-00b93b9d4d76\") " pod="openshift-cluster-node-tuning-operator/tuned-r5krk" Jul 07 16:22:38.311569 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.296422 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/55b2059a-e73e-4aa1-a218-e8a3b61c4978-host-run-netns\") pod \"multus-bd7wg\" (UID: \"55b2059a-e73e-4aa1-a218-e8a3b61c4978\") " pod="openshift-multus/multus-bd7wg" Jul 07 16:22:38.311569 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.296454 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/34e24cef-97a7-4b77-9397-7ecdcca92721-etc-selinux\") pod \"aws-ebs-csi-driver-node-zmxwh\" (UID: \"34e24cef-97a7-4b77-9397-7ecdcca92721\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zmxwh" Jul 07 16:22:38.311569 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.296488 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dcc8336f-7d16-417d-aa68-e1c790939e7d-cnibin\") pod \"multus-additional-cni-plugins-mpbtm\" (UID: \"dcc8336f-7d16-417d-aa68-e1c790939e7d\") " pod="openshift-multus/multus-additional-cni-plugins-mpbtm" Jul 07 16:22:38.311569 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.296521 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/55b2059a-e73e-4aa1-a218-e8a3b61c4978-cnibin\") pod \"multus-bd7wg\" (UID: \"55b2059a-e73e-4aa1-a218-e8a3b61c4978\") " pod="openshift-multus/multus-bd7wg" Jul 07 16:22:38.311569 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.296579 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f5d16211-b5e0-4042-aeba-ba5d273ccd96-dbus\") pod \"global-pull-secret-syncer-8qbxw\" (UID: \"f5d16211-b5e0-4042-aeba-ba5d273ccd96\") " pod="kube-system/global-pull-secret-syncer-8qbxw" Jul 07 16:22:38.311569 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.296607 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zh4gx\" (UniqueName: \"kubernetes.io/projected/f3614425-8241-4f22-be37-00b93b9d4d76-kube-api-access-zh4gx\") pod \"tuned-r5krk\" (UID: \"f3614425-8241-4f22-be37-00b93b9d4d76\") " pod="openshift-cluster-node-tuning-operator/tuned-r5krk" Jul 07 16:22:38.312939 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.296631 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/55b2059a-e73e-4aa1-a218-e8a3b61c4978-host-run-k8s-cni-cncf-io\") pod \"multus-bd7wg\" (UID: \"55b2059a-e73e-4aa1-a218-e8a3b61c4978\") " pod="openshift-multus/multus-bd7wg" Jul 07 16:22:38.312939 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.296655 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f3614425-8241-4f22-be37-00b93b9d4d76-etc-systemd\") pod \"tuned-r5krk\" (UID: \"f3614425-8241-4f22-be37-00b93b9d4d76\") " pod="openshift-cluster-node-tuning-operator/tuned-r5krk" Jul 07 16:22:38.312939 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.296675 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f3614425-8241-4f22-be37-00b93b9d4d76-var-lib-kubelet\") pod \"tuned-r5krk\" (UID: \"f3614425-8241-4f22-be37-00b93b9d4d76\") " pod="openshift-cluster-node-tuning-operator/tuned-r5krk" Jul 07 16:22:38.312939 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.296704 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wpqvd\" (UniqueName: \"kubernetes.io/projected/dcc8336f-7d16-417d-aa68-e1c790939e7d-kube-api-access-wpqvd\") pod \"multus-additional-cni-plugins-mpbtm\" (UID: \"dcc8336f-7d16-417d-aa68-e1c790939e7d\") " pod="openshift-multus/multus-additional-cni-plugins-mpbtm" Jul 07 16:22:38.312939 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.296729 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f3614425-8241-4f22-be37-00b93b9d4d76-sys\") pod \"tuned-r5krk\" (UID: \"f3614425-8241-4f22-be37-00b93b9d4d76\") " pod="openshift-cluster-node-tuning-operator/tuned-r5krk" Jul 07 16:22:38.312939 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.297018 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f3614425-8241-4f22-be37-00b93b9d4d76-etc-tuned\") pod \"tuned-r5krk\" (UID: \"f3614425-8241-4f22-be37-00b93b9d4d76\") " pod="openshift-cluster-node-tuning-operator/tuned-r5krk" Jul 07 16:22:38.312939 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.297062 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9v86\" (UniqueName: \"kubernetes.io/projected/c4403f38-090d-4ad3-b880-fad3c7b44627-kube-api-access-b9v86\") pod \"node-ca-dbg2n\" (UID: \"c4403f38-090d-4ad3-b880-fad3c7b44627\") " pod="openshift-image-registry/node-ca-dbg2n" Jul 07 16:22:38.312939 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.297120 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dcc8336f-7d16-417d-aa68-e1c790939e7d-cni-binary-copy\") pod \"multus-additional-cni-plugins-mpbtm\" (UID: \"dcc8336f-7d16-417d-aa68-e1c790939e7d\") " pod="openshift-multus/multus-additional-cni-plugins-mpbtm" Jul 07 16:22:38.312939 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.297153 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/dcc8336f-7d16-417d-aa68-e1c790939e7d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mpbtm\" (UID: \"dcc8336f-7d16-417d-aa68-e1c790939e7d\") " pod="openshift-multus/multus-additional-cni-plugins-mpbtm" Jul 07 16:22:38.312939 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.297183 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/55b2059a-e73e-4aa1-a218-e8a3b61c4978-os-release\") pod \"multus-bd7wg\" (UID: \"55b2059a-e73e-4aa1-a218-e8a3b61c4978\") " pod="openshift-multus/multus-bd7wg" Jul 07 16:22:38.312939 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.297268 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/55b2059a-e73e-4aa1-a218-e8a3b61c4978-cni-binary-copy\") pod \"multus-bd7wg\" (UID: \"55b2059a-e73e-4aa1-a218-e8a3b61c4978\") " pod="openshift-multus/multus-bd7wg" Jul 07 16:22:38.312939 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.297346 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/55b2059a-e73e-4aa1-a218-e8a3b61c4978-host-run-multus-certs\") pod \"multus-bd7wg\" (UID: \"55b2059a-e73e-4aa1-a218-e8a3b61c4978\") " pod="openshift-multus/multus-bd7wg" Jul 07 16:22:38.312939 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.297401 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/55b2059a-e73e-4aa1-a218-e8a3b61c4978-multus-socket-dir-parent\") pod \"multus-bd7wg\" (UID: \"55b2059a-e73e-4aa1-a218-e8a3b61c4978\") " pod="openshift-multus/multus-bd7wg" Jul 07 16:22:38.312939 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.297459 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/55b2059a-e73e-4aa1-a218-e8a3b61c4978-etc-kubernetes\") pod \"multus-bd7wg\" (UID: \"55b2059a-e73e-4aa1-a218-e8a3b61c4978\") " pod="openshift-multus/multus-bd7wg" Jul 07 16:22:38.312939 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.297490 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f5d16211-b5e0-4042-aeba-ba5d273ccd96-kubelet-config\") pod \"global-pull-secret-syncer-8qbxw\" (UID: \"f5d16211-b5e0-4042-aeba-ba5d273ccd96\") " pod="kube-system/global-pull-secret-syncer-8qbxw" Jul 07 16:22:38.312939 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.297521 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f3614425-8241-4f22-be37-00b93b9d4d76-etc-kubernetes\") pod \"tuned-r5krk\" (UID: \"f3614425-8241-4f22-be37-00b93b9d4d76\") " pod="openshift-cluster-node-tuning-operator/tuned-r5krk" Jul 07 16:22:38.313664 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.297551 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f3614425-8241-4f22-be37-00b93b9d4d76-etc-modprobe-d\") pod \"tuned-r5krk\" (UID: \"f3614425-8241-4f22-be37-00b93b9d4d76\") " pod="openshift-cluster-node-tuning-operator/tuned-r5krk" Jul 07 16:22:38.313664 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.297601 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c4403f38-090d-4ad3-b880-fad3c7b44627-host\") pod \"node-ca-dbg2n\" (UID: \"c4403f38-090d-4ad3-b880-fad3c7b44627\") " pod="openshift-image-registry/node-ca-dbg2n" Jul 07 16:22:38.313664 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.297690 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/55b2059a-e73e-4aa1-a218-e8a3b61c4978-multus-cni-dir\") pod \"multus-bd7wg\" (UID: \"55b2059a-e73e-4aa1-a218-e8a3b61c4978\") " pod="openshift-multus/multus-bd7wg" Jul 07 16:22:38.313664 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.299140 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/34e24cef-97a7-4b77-9397-7ecdcca92721-socket-dir\") pod \"aws-ebs-csi-driver-node-zmxwh\" (UID: \"34e24cef-97a7-4b77-9397-7ecdcca92721\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zmxwh" Jul 07 16:22:38.313664 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.299929 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/34e24cef-97a7-4b77-9397-7ecdcca92721-registration-dir\") pod \"aws-ebs-csi-driver-node-zmxwh\" (UID: \"34e24cef-97a7-4b77-9397-7ecdcca92721\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zmxwh" Jul 07 16:22:38.313664 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.300026 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 07 16:22:38.313664 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.300106 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-dbbfb" Jul 07 16:22:38.313664 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.300132 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-hdb49\"" Jul 07 16:22:38.313664 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.300113 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 07 16:22:38.313664 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.300502 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 07 16:22:38.313664 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.300468 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f3614425-8241-4f22-be37-00b93b9d4d76-tmp\") pod \"tuned-r5krk\" (UID: \"f3614425-8241-4f22-be37-00b93b9d4d76\") " pod="openshift-cluster-node-tuning-operator/tuned-r5krk" Jul 07 16:22:38.313664 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.300737 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c4403f38-090d-4ad3-b880-fad3c7b44627-serviceca\") pod \"node-ca-dbg2n\" (UID: \"c4403f38-090d-4ad3-b880-fad3c7b44627\") " pod="openshift-image-registry/node-ca-dbg2n" Jul 07 16:22:38.313664 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.300769 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/dcc8336f-7d16-417d-aa68-e1c790939e7d-os-release\") pod \"multus-additional-cni-plugins-mpbtm\" (UID: \"dcc8336f-7d16-417d-aa68-e1c790939e7d\") " pod="openshift-multus/multus-additional-cni-plugins-mpbtm" Jul 07 16:22:38.313664 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.300797 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/55b2059a-e73e-4aa1-a218-e8a3b61c4978-host-var-lib-cni-multus\") pod \"multus-bd7wg\" (UID: \"55b2059a-e73e-4aa1-a218-e8a3b61c4978\") " pod="openshift-multus/multus-bd7wg" Jul 07 16:22:38.313664 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.300836 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/34e24cef-97a7-4b77-9397-7ecdcca92721-sys-fs\") pod \"aws-ebs-csi-driver-node-zmxwh\" (UID: \"34e24cef-97a7-4b77-9397-7ecdcca92721\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zmxwh" Jul 07 16:22:38.313664 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.300860 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dcc8336f-7d16-417d-aa68-e1c790939e7d-system-cni-dir\") pod \"multus-additional-cni-plugins-mpbtm\" (UID: \"dcc8336f-7d16-417d-aa68-e1c790939e7d\") " pod="openshift-multus/multus-additional-cni-plugins-mpbtm" Jul 07 16:22:38.313664 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.300876 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/55b2059a-e73e-4aa1-a218-e8a3b61c4978-system-cni-dir\") pod \"multus-bd7wg\" (UID: \"55b2059a-e73e-4aa1-a218-e8a3b61c4978\") " pod="openshift-multus/multus-bd7wg" Jul 07 16:22:38.313664 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.300898 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/dbfa7ead-a6a8-4536-8a8d-cbe2e2b33011-konnectivity-ca\") pod \"konnectivity-agent-q798q\" (UID: \"dbfa7ead-a6a8-4536-8a8d-cbe2e2b33011\") " pod="kube-system/konnectivity-agent-q798q" Jul 07 16:22:38.313664 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.300943 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/34e24cef-97a7-4b77-9397-7ecdcca92721-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zmxwh\" (UID: \"34e24cef-97a7-4b77-9397-7ecdcca92721\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zmxwh" Jul 07 16:22:38.314803 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.300996 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f3614425-8241-4f22-be37-00b93b9d4d76-run\") pod \"tuned-r5krk\" (UID: \"f3614425-8241-4f22-be37-00b93b9d4d76\") " pod="openshift-cluster-node-tuning-operator/tuned-r5krk" Jul 07 16:22:38.314803 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.301027 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f3614425-8241-4f22-be37-00b93b9d4d76-lib-modules\") pod \"tuned-r5krk\" (UID: \"f3614425-8241-4f22-be37-00b93b9d4d76\") " pod="openshift-cluster-node-tuning-operator/tuned-r5krk" Jul 07 16:22:38.314803 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.301045 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dcc8336f-7d16-417d-aa68-e1c790939e7d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mpbtm\" (UID: \"dcc8336f-7d16-417d-aa68-e1c790939e7d\") " pod="openshift-multus/multus-additional-cni-plugins-mpbtm" Jul 07 16:22:38.314803 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.301063 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvdwb\" (UniqueName: \"kubernetes.io/projected/55b2059a-e73e-4aa1-a218-e8a3b61c4978-kube-api-access-fvdwb\") pod \"multus-bd7wg\" (UID: \"55b2059a-e73e-4aa1-a218-e8a3b61c4978\") " pod="openshift-multus/multus-bd7wg" Jul 07 16:22:38.314803 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.301086 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8jnk\" (UniqueName: \"kubernetes.io/projected/592ceff6-55ee-4890-8b40-5aa74cd26a35-kube-api-access-r8jnk\") pod \"network-metrics-daemon-kngnh\" (UID: \"592ceff6-55ee-4890-8b40-5aa74cd26a35\") " pod="openshift-multus/network-metrics-daemon-kngnh" Jul 07 16:22:38.314803 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.301101 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qkvh\" (UniqueName: \"kubernetes.io/projected/34e24cef-97a7-4b77-9397-7ecdcca92721-kube-api-access-7qkvh\") pod \"aws-ebs-csi-driver-node-zmxwh\" (UID: \"34e24cef-97a7-4b77-9397-7ecdcca92721\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zmxwh" Jul 07 16:22:38.314803 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.301116 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f3614425-8241-4f22-be37-00b93b9d4d76-etc-sysctl-d\") pod \"tuned-r5krk\" (UID: \"f3614425-8241-4f22-be37-00b93b9d4d76\") " pod="openshift-cluster-node-tuning-operator/tuned-r5krk" Jul 07 16:22:38.314803 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.301131 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/55b2059a-e73e-4aa1-a218-e8a3b61c4978-hostroot\") pod \"multus-bd7wg\" (UID: \"55b2059a-e73e-4aa1-a218-e8a3b61c4978\") " pod="openshift-multus/multus-bd7wg" Jul 07 16:22:38.314803 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.301145 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/55b2059a-e73e-4aa1-a218-e8a3b61c4978-multus-daemon-config\") pod \"multus-bd7wg\" (UID: \"55b2059a-e73e-4aa1-a218-e8a3b61c4978\") " pod="openshift-multus/multus-bd7wg" Jul 07 16:22:38.314803 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.301172 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/55b2059a-e73e-4aa1-a218-e8a3b61c4978-host-var-lib-cni-bin\") pod \"multus-bd7wg\" (UID: \"55b2059a-e73e-4aa1-a218-e8a3b61c4978\") " pod="openshift-multus/multus-bd7wg" Jul 07 16:22:38.314803 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.301194 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/55b2059a-e73e-4aa1-a218-e8a3b61c4978-multus-conf-dir\") pod \"multus-bd7wg\" (UID: \"55b2059a-e73e-4aa1-a218-e8a3b61c4978\") " pod="openshift-multus/multus-bd7wg" Jul 07 16:22:38.314803 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.301225 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f5d16211-b5e0-4042-aeba-ba5d273ccd96-original-pull-secret\") pod \"global-pull-secret-syncer-8qbxw\" (UID: \"f5d16211-b5e0-4042-aeba-ba5d273ccd96\") " pod="kube-system/global-pull-secret-syncer-8qbxw" Jul 07 16:22:38.314803 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.301266 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/34e24cef-97a7-4b77-9397-7ecdcca92721-device-dir\") pod \"aws-ebs-csi-driver-node-zmxwh\" (UID: \"34e24cef-97a7-4b77-9397-7ecdcca92721\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zmxwh" Jul 07 16:22:38.314803 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.301288 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f3614425-8241-4f22-be37-00b93b9d4d76-host\") pod \"tuned-r5krk\" (UID: \"f3614425-8241-4f22-be37-00b93b9d4d76\") " pod="openshift-cluster-node-tuning-operator/tuned-r5krk" Jul 07 16:22:38.314803 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.301314 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/dcc8336f-7d16-417d-aa68-e1c790939e7d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mpbtm\" (UID: \"dcc8336f-7d16-417d-aa68-e1c790939e7d\") " pod="openshift-multus/multus-additional-cni-plugins-mpbtm" Jul 07 16:22:38.314803 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.303425 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 07 16:22:38.314803 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.303588 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-psp69\"" Jul 07 16:22:38.314803 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.303594 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 07 16:22:38.315528 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.303596 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 07 16:22:38.315528 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.303757 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 07 16:22:38.315528 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.304002 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 07 16:22:38.315528 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.304316 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 07 16:22:38.315528 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.305381 2552 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 07 16:22:38.315528 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.305465 2552 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-189.ec2.internal" Jul 07 16:22:38.315528 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.305789 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-189.ec2.internal"] Jul 07 16:22:38.315528 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.309412 2552 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 07 16:22:38.315528 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.313837 2552 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 07 16:22:38.315528 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.313963 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-138-189.ec2.internal"] Jul 07 16:22:38.321835 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.321791 2552 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-06 16:17:38 +0000 UTC" deadline="2028-01-20 18:58:17.893818217 +0000 UTC" Jul 07 16:22:38.321835 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.321833 2552 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13490h35m39.571988531s" Jul 07 16:22:38.335414 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.335392 2552 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-2whdr" Jul 07 16:22:38.347835 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.347812 2552 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-2whdr" Jul 07 16:22:38.390294 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.390262 2552 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 07 16:22:38.402428 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.402402 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/55b2059a-e73e-4aa1-a218-e8a3b61c4978-host-var-lib-cni-bin\") pod \"multus-bd7wg\" (UID: \"55b2059a-e73e-4aa1-a218-e8a3b61c4978\") " pod="openshift-multus/multus-bd7wg" Jul 07 16:22:38.402529 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.402433 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/55b2059a-e73e-4aa1-a218-e8a3b61c4978-multus-conf-dir\") pod \"multus-bd7wg\" (UID: \"55b2059a-e73e-4aa1-a218-e8a3b61c4978\") " pod="openshift-multus/multus-bd7wg" Jul 07 16:22:38.402529 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.402453 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f5d16211-b5e0-4042-aeba-ba5d273ccd96-original-pull-secret\") pod \"global-pull-secret-syncer-8qbxw\" (UID: \"f5d16211-b5e0-4042-aeba-ba5d273ccd96\") " pod="kube-system/global-pull-secret-syncer-8qbxw" Jul 07 16:22:38.402529 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.402474 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b3bfeb23-15e6-4f35-8f71-9d1f906ca7e2-host-slash\") pod \"iptables-alerter-84scn\" (UID: \"b3bfeb23-15e6-4f35-8f71-9d1f906ca7e2\") " pod="openshift-network-operator/iptables-alerter-84scn" Jul 07 16:22:38.402529 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.402489 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a1abd5d4-cd31-4b5b-9011-9dd0f248ce19-host-run-ovn-kubernetes\") pod \"ovnkube-node-dbbfb\" (UID: \"a1abd5d4-cd31-4b5b-9011-9dd0f248ce19\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbbfb" Jul 07 16:22:38.402685 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.402527 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/55b2059a-e73e-4aa1-a218-e8a3b61c4978-host-var-lib-cni-bin\") pod \"multus-bd7wg\" (UID: \"55b2059a-e73e-4aa1-a218-e8a3b61c4978\") " pod="openshift-multus/multus-bd7wg" Jul 07 16:22:38.402685 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.402540 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/55b2059a-e73e-4aa1-a218-e8a3b61c4978-multus-conf-dir\") pod \"multus-bd7wg\" (UID: \"55b2059a-e73e-4aa1-a218-e8a3b61c4978\") " pod="openshift-multus/multus-bd7wg" Jul 07 16:22:38.402685 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.402542 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dcab04ec-d173-4c57-b7a9-fa4d1c73a7bf-tmp-dir\") pod \"node-resolver-59lsn\" (UID: \"dcab04ec-d173-4c57-b7a9-fa4d1c73a7bf\") " pod="openshift-dns/node-resolver-59lsn" Jul 07 16:22:38.402685 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.402614 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/34e24cef-97a7-4b77-9397-7ecdcca92721-device-dir\") pod \"aws-ebs-csi-driver-node-zmxwh\" (UID: \"34e24cef-97a7-4b77-9397-7ecdcca92721\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zmxwh" Jul 07 16:22:38.402685 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.402648 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f3614425-8241-4f22-be37-00b93b9d4d76-host\") pod \"tuned-r5krk\" (UID: \"f3614425-8241-4f22-be37-00b93b9d4d76\") " pod="openshift-cluster-node-tuning-operator/tuned-r5krk" Jul 07 16:22:38.402685 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:22:38.402661 2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 16:22:38.402685 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.402677 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/dcc8336f-7d16-417d-aa68-e1c790939e7d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mpbtm\" (UID: \"dcc8336f-7d16-417d-aa68-e1c790939e7d\") " pod="openshift-multus/multus-additional-cni-plugins-mpbtm" Jul 07 16:22:38.403009 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.402681 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/34e24cef-97a7-4b77-9397-7ecdcca92721-device-dir\") pod \"aws-ebs-csi-driver-node-zmxwh\" (UID: \"34e24cef-97a7-4b77-9397-7ecdcca92721\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zmxwh" Jul 07 16:22:38.403009 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:22:38.402740 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5d16211-b5e0-4042-aeba-ba5d273ccd96-original-pull-secret podName:f5d16211-b5e0-4042-aeba-ba5d273ccd96 nodeName:}" failed. No retries permitted until 2026-07-07 16:22:38.902707398 +0000 UTC m=+2.035672860 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f5d16211-b5e0-4042-aeba-ba5d273ccd96-original-pull-secret") pod "global-pull-secret-syncer-8qbxw" (UID: "f5d16211-b5e0-4042-aeba-ba5d273ccd96") : object "kube-system"/"original-pull-secret" not registered Jul 07 16:22:38.403009 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.402737 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f3614425-8241-4f22-be37-00b93b9d4d76-host\") pod \"tuned-r5krk\" (UID: \"f3614425-8241-4f22-be37-00b93b9d4d76\") " pod="openshift-cluster-node-tuning-operator/tuned-r5krk" Jul 07 16:22:38.403009 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.402755 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a1abd5d4-cd31-4b5b-9011-9dd0f248ce19-host-cni-netd\") pod \"ovnkube-node-dbbfb\" (UID: \"a1abd5d4-cd31-4b5b-9011-9dd0f248ce19\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbbfb" Jul 07 16:22:38.403009 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.402779 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f3614425-8241-4f22-be37-00b93b9d4d76-etc-sysctl-conf\") pod \"tuned-r5krk\" (UID: \"f3614425-8241-4f22-be37-00b93b9d4d76\") " pod="openshift-cluster-node-tuning-operator/tuned-r5krk" Jul 07 16:22:38.403009 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.402811 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/55b2059a-e73e-4aa1-a218-e8a3b61c4978-host-var-lib-kubelet\") pod \"multus-bd7wg\" (UID: \"55b2059a-e73e-4aa1-a218-e8a3b61c4978\") " pod="openshift-multus/multus-bd7wg" Jul 07 16:22:38.403009 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.402832 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/dbfa7ead-a6a8-4536-8a8d-cbe2e2b33011-agent-certs\") pod \"konnectivity-agent-q798q\" (UID: \"dbfa7ead-a6a8-4536-8a8d-cbe2e2b33011\") " pod="kube-system/konnectivity-agent-q798q" Jul 07 16:22:38.403009 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.402852 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/592ceff6-55ee-4890-8b40-5aa74cd26a35-metrics-certs\") pod \"network-metrics-daemon-kngnh\" (UID: \"592ceff6-55ee-4890-8b40-5aa74cd26a35\") " pod="openshift-multus/network-metrics-daemon-kngnh" Jul 07 16:22:38.403009 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.402875 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a1abd5d4-cd31-4b5b-9011-9dd0f248ce19-run-ovn\") pod \"ovnkube-node-dbbfb\" (UID: \"a1abd5d4-cd31-4b5b-9011-9dd0f248ce19\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbbfb" Jul 07 16:22:38.403009 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.402899 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f3614425-8241-4f22-be37-00b93b9d4d76-etc-sysconfig\") pod \"tuned-r5krk\" (UID: \"f3614425-8241-4f22-be37-00b93b9d4d76\") " pod="openshift-cluster-node-tuning-operator/tuned-r5krk" Jul 07 16:22:38.403009 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.402873 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/55b2059a-e73e-4aa1-a218-e8a3b61c4978-host-var-lib-kubelet\") pod \"multus-bd7wg\" (UID: \"55b2059a-e73e-4aa1-a218-e8a3b61c4978\") " pod="openshift-multus/multus-bd7wg" Jul 07 16:22:38.403009 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.402919 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f3614425-8241-4f22-be37-00b93b9d4d76-etc-sysctl-conf\") pod \"tuned-r5krk\" (UID: \"f3614425-8241-4f22-be37-00b93b9d4d76\") " pod="openshift-cluster-node-tuning-operator/tuned-r5krk" Jul 07 16:22:38.403009 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.402952 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/55b2059a-e73e-4aa1-a218-e8a3b61c4978-host-run-netns\") pod \"multus-bd7wg\" (UID: \"55b2059a-e73e-4aa1-a218-e8a3b61c4978\") " pod="openshift-multus/multus-bd7wg" Jul 07 16:22:38.403009 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.402992 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a1abd5d4-cd31-4b5b-9011-9dd0f248ce19-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dbbfb\" (UID: \"a1abd5d4-cd31-4b5b-9011-9dd0f248ce19\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbbfb" Jul 07 16:22:38.403009 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.402994 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f3614425-8241-4f22-be37-00b93b9d4d76-etc-sysconfig\") pod \"tuned-r5krk\" (UID: \"f3614425-8241-4f22-be37-00b93b9d4d76\") " pod="openshift-cluster-node-tuning-operator/tuned-r5krk" Jul 07 16:22:38.403009 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.403015 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/34e24cef-97a7-4b77-9397-7ecdcca92721-etc-selinux\") pod \"aws-ebs-csi-driver-node-zmxwh\" (UID: \"34e24cef-97a7-4b77-9397-7ecdcca92721\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zmxwh" Jul 07 16:22:38.403569 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.403025 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/55b2059a-e73e-4aa1-a218-e8a3b61c4978-host-run-netns\") pod \"multus-bd7wg\" (UID: \"55b2059a-e73e-4aa1-a218-e8a3b61c4978\") " pod="openshift-multus/multus-bd7wg" Jul 07 16:22:38.403569 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.403034 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dcc8336f-7d16-417d-aa68-e1c790939e7d-cnibin\") pod \"multus-additional-cni-plugins-mpbtm\" (UID: \"dcc8336f-7d16-417d-aa68-e1c790939e7d\") " pod="openshift-multus/multus-additional-cni-plugins-mpbtm" Jul 07 16:22:38.403569 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:22:38.403049 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 16:22:38.403569 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.403056 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/55b2059a-e73e-4aa1-a218-e8a3b61c4978-cnibin\") pod \"multus-bd7wg\" (UID: \"55b2059a-e73e-4aa1-a218-e8a3b61c4978\") " pod="openshift-multus/multus-bd7wg" Jul 07 16:22:38.403569 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.403065 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dcc8336f-7d16-417d-aa68-e1c790939e7d-cnibin\") pod \"multus-additional-cni-plugins-mpbtm\" (UID: \"dcc8336f-7d16-417d-aa68-e1c790939e7d\") " pod="openshift-multus/multus-additional-cni-plugins-mpbtm" Jul 07 16:22:38.403569 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.403073 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f5d16211-b5e0-4042-aeba-ba5d273ccd96-dbus\") pod \"global-pull-secret-syncer-8qbxw\" (UID: \"f5d16211-b5e0-4042-aeba-ba5d273ccd96\") " pod="kube-system/global-pull-secret-syncer-8qbxw" Jul 07 16:22:38.403569 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:22:38.403096 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/592ceff6-55ee-4890-8b40-5aa74cd26a35-metrics-certs podName:592ceff6-55ee-4890-8b40-5aa74cd26a35 nodeName:}" failed. No retries permitted until 2026-07-07 16:22:38.903078454 +0000 UTC m=+2.036043892 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/592ceff6-55ee-4890-8b40-5aa74cd26a35-metrics-certs") pod "network-metrics-daemon-kngnh" (UID: "592ceff6-55ee-4890-8b40-5aa74cd26a35") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 16:22:38.403569 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.403125 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zh4gx\" (UniqueName: \"kubernetes.io/projected/f3614425-8241-4f22-be37-00b93b9d4d76-kube-api-access-zh4gx\") pod \"tuned-r5krk\" (UID: \"f3614425-8241-4f22-be37-00b93b9d4d76\") " pod="openshift-cluster-node-tuning-operator/tuned-r5krk" Jul 07 16:22:38.403569 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.403129 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/55b2059a-e73e-4aa1-a218-e8a3b61c4978-cnibin\") pod \"multus-bd7wg\" (UID: \"55b2059a-e73e-4aa1-a218-e8a3b61c4978\") " pod="openshift-multus/multus-bd7wg" Jul 07 16:22:38.403569 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.403145 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/55b2059a-e73e-4aa1-a218-e8a3b61c4978-host-run-k8s-cni-cncf-io\") pod \"multus-bd7wg\" (UID: \"55b2059a-e73e-4aa1-a218-e8a3b61c4978\") " pod="openshift-multus/multus-bd7wg" Jul 07 16:22:38.403569 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.403150 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/34e24cef-97a7-4b77-9397-7ecdcca92721-etc-selinux\") pod \"aws-ebs-csi-driver-node-zmxwh\" (UID: \"34e24cef-97a7-4b77-9397-7ecdcca92721\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zmxwh" Jul 07 16:22:38.403569 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.403168 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a1abd5d4-cd31-4b5b-9011-9dd0f248ce19-ovnkube-script-lib\") pod \"ovnkube-node-dbbfb\" (UID: \"a1abd5d4-cd31-4b5b-9011-9dd0f248ce19\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbbfb" Jul 07 16:22:38.403569 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.403180 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/55b2059a-e73e-4aa1-a218-e8a3b61c4978-host-run-k8s-cni-cncf-io\") pod \"multus-bd7wg\" (UID: \"55b2059a-e73e-4aa1-a218-e8a3b61c4978\") " pod="openshift-multus/multus-bd7wg" Jul 07 16:22:38.403569 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.403188 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f3614425-8241-4f22-be37-00b93b9d4d76-etc-systemd\") pod \"tuned-r5krk\" (UID: \"f3614425-8241-4f22-be37-00b93b9d4d76\") " pod="openshift-cluster-node-tuning-operator/tuned-r5krk" Jul 07 16:22:38.403569 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.403207 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f3614425-8241-4f22-be37-00b93b9d4d76-var-lib-kubelet\") pod \"tuned-r5krk\" (UID: \"f3614425-8241-4f22-be37-00b93b9d4d76\") " pod="openshift-cluster-node-tuning-operator/tuned-r5krk" Jul 07 16:22:38.403569 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.403234 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wpqvd\" (UniqueName: \"kubernetes.io/projected/dcc8336f-7d16-417d-aa68-e1c790939e7d-kube-api-access-wpqvd\") pod \"multus-additional-cni-plugins-mpbtm\" (UID: \"dcc8336f-7d16-417d-aa68-e1c790939e7d\") " pod="openshift-multus/multus-additional-cni-plugins-mpbtm" Jul 07 16:22:38.403569 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.403267 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f3614425-8241-4f22-be37-00b93b9d4d76-etc-systemd\") pod \"tuned-r5krk\" (UID: \"f3614425-8241-4f22-be37-00b93b9d4d76\") " pod="openshift-cluster-node-tuning-operator/tuned-r5krk" Jul 07 16:22:38.404265 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.403279 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f5d16211-b5e0-4042-aeba-ba5d273ccd96-dbus\") pod \"global-pull-secret-syncer-8qbxw\" (UID: \"f5d16211-b5e0-4042-aeba-ba5d273ccd96\") " pod="kube-system/global-pull-secret-syncer-8qbxw" Jul 07 16:22:38.404265 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.403295 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f3614425-8241-4f22-be37-00b93b9d4d76-sys\") pod \"tuned-r5krk\" (UID: \"f3614425-8241-4f22-be37-00b93b9d4d76\") " pod="openshift-cluster-node-tuning-operator/tuned-r5krk" Jul 07 16:22:38.404265 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.403347 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f3614425-8241-4f22-be37-00b93b9d4d76-var-lib-kubelet\") pod \"tuned-r5krk\" (UID: \"f3614425-8241-4f22-be37-00b93b9d4d76\") " pod="openshift-cluster-node-tuning-operator/tuned-r5krk" Jul 07 16:22:38.404265 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.403363 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f3614425-8241-4f22-be37-00b93b9d4d76-sys\") pod \"tuned-r5krk\" (UID: \"f3614425-8241-4f22-be37-00b93b9d4d76\") " pod="openshift-cluster-node-tuning-operator/tuned-r5krk" Jul 07 16:22:38.404265 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.403402 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f3614425-8241-4f22-be37-00b93b9d4d76-etc-tuned\") pod \"tuned-r5krk\" (UID: \"f3614425-8241-4f22-be37-00b93b9d4d76\") " pod="openshift-cluster-node-tuning-operator/tuned-r5krk" Jul 07 16:22:38.404265 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.403428 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9v86\" (UniqueName: \"kubernetes.io/projected/c4403f38-090d-4ad3-b880-fad3c7b44627-kube-api-access-b9v86\") pod \"node-ca-dbg2n\" (UID: \"c4403f38-090d-4ad3-b880-fad3c7b44627\") " pod="openshift-image-registry/node-ca-dbg2n" Jul 07 16:22:38.404265 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.403450 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dcc8336f-7d16-417d-aa68-e1c790939e7d-cni-binary-copy\") pod \"multus-additional-cni-plugins-mpbtm\" (UID: \"dcc8336f-7d16-417d-aa68-e1c790939e7d\") " pod="openshift-multus/multus-additional-cni-plugins-mpbtm" Jul 07 16:22:38.404265 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.403469 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/dcc8336f-7d16-417d-aa68-e1c790939e7d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mpbtm\" (UID: \"dcc8336f-7d16-417d-aa68-e1c790939e7d\") " pod="openshift-multus/multus-additional-cni-plugins-mpbtm" Jul 07 16:22:38.404265 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.403494 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/55b2059a-e73e-4aa1-a218-e8a3b61c4978-os-release\") pod \"multus-bd7wg\" (UID: \"55b2059a-e73e-4aa1-a218-e8a3b61c4978\") " pod="openshift-multus/multus-bd7wg" Jul 07 16:22:38.404265 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.403521 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a1abd5d4-cd31-4b5b-9011-9dd0f248ce19-host-kubelet\") pod \"ovnkube-node-dbbfb\" (UID: \"a1abd5d4-cd31-4b5b-9011-9dd0f248ce19\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbbfb" Jul 07 16:22:38.404265 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.403549 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/55b2059a-e73e-4aa1-a218-e8a3b61c4978-cni-binary-copy\") pod \"multus-bd7wg\" (UID: \"55b2059a-e73e-4aa1-a218-e8a3b61c4978\") " pod="openshift-multus/multus-bd7wg" Jul 07 16:22:38.404265 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.403569 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/55b2059a-e73e-4aa1-a218-e8a3b61c4978-host-run-multus-certs\") pod \"multus-bd7wg\" (UID: \"55b2059a-e73e-4aa1-a218-e8a3b61c4978\") " pod="openshift-multus/multus-bd7wg" Jul 07 16:22:38.404265 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.403585 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a1abd5d4-cd31-4b5b-9011-9dd0f248ce19-systemd-units\") pod \"ovnkube-node-dbbfb\" (UID: \"a1abd5d4-cd31-4b5b-9011-9dd0f248ce19\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbbfb" Jul 07 16:22:38.404265 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.403600 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a1abd5d4-cd31-4b5b-9011-9dd0f248ce19-host-slash\") pod \"ovnkube-node-dbbfb\" (UID: \"a1abd5d4-cd31-4b5b-9011-9dd0f248ce19\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbbfb" Jul 07 16:22:38.404265 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.403614 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a1abd5d4-cd31-4b5b-9011-9dd0f248ce19-host-run-netns\") pod \"ovnkube-node-dbbfb\" (UID: \"a1abd5d4-cd31-4b5b-9011-9dd0f248ce19\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbbfb" Jul 07 16:22:38.404265 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.403634 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a1abd5d4-cd31-4b5b-9011-9dd0f248ce19-run-systemd\") pod \"ovnkube-node-dbbfb\" (UID: \"a1abd5d4-cd31-4b5b-9011-9dd0f248ce19\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbbfb" Jul 07 16:22:38.404265 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.403651 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a1abd5d4-cd31-4b5b-9011-9dd0f248ce19-etc-openvswitch\") pod \"ovnkube-node-dbbfb\" (UID: \"a1abd5d4-cd31-4b5b-9011-9dd0f248ce19\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbbfb" Jul 07 16:22:38.405031 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.403711 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/55b2059a-e73e-4aa1-a218-e8a3b61c4978-host-run-multus-certs\") pod \"multus-bd7wg\" (UID: \"55b2059a-e73e-4aa1-a218-e8a3b61c4978\") " pod="openshift-multus/multus-bd7wg" Jul 07 16:22:38.405031 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.403716 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/55b2059a-e73e-4aa1-a218-e8a3b61c4978-multus-socket-dir-parent\") pod \"multus-bd7wg\" (UID: \"55b2059a-e73e-4aa1-a218-e8a3b61c4978\") " pod="openshift-multus/multus-bd7wg" Jul 07 16:22:38.405031 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.403743 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/55b2059a-e73e-4aa1-a218-e8a3b61c4978-etc-kubernetes\") pod \"multus-bd7wg\" (UID: \"55b2059a-e73e-4aa1-a218-e8a3b61c4978\") " pod="openshift-multus/multus-bd7wg" Jul 07 16:22:38.405031 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.403776 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f5d16211-b5e0-4042-aeba-ba5d273ccd96-kubelet-config\") pod \"global-pull-secret-syncer-8qbxw\" (UID: \"f5d16211-b5e0-4042-aeba-ba5d273ccd96\") " pod="kube-system/global-pull-secret-syncer-8qbxw" Jul 07 16:22:38.405031 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.403790 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/55b2059a-e73e-4aa1-a218-e8a3b61c4978-os-release\") pod \"multus-bd7wg\" (UID: \"55b2059a-e73e-4aa1-a218-e8a3b61c4978\") " pod="openshift-multus/multus-bd7wg" Jul 07 16:22:38.405031 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.403796 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a1abd5d4-cd31-4b5b-9011-9dd0f248ce19-node-log\") pod \"ovnkube-node-dbbfb\" (UID: \"a1abd5d4-cd31-4b5b-9011-9dd0f248ce19\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbbfb" Jul 07 16:22:38.405031 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.403809 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/55b2059a-e73e-4aa1-a218-e8a3b61c4978-multus-socket-dir-parent\") pod \"multus-bd7wg\" (UID: \"55b2059a-e73e-4aa1-a218-e8a3b61c4978\") " pod="openshift-multus/multus-bd7wg" Jul 07 16:22:38.405031 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.403850 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/55b2059a-e73e-4aa1-a218-e8a3b61c4978-etc-kubernetes\") pod \"multus-bd7wg\" (UID: \"55b2059a-e73e-4aa1-a218-e8a3b61c4978\") " pod="openshift-multus/multus-bd7wg" Jul 07 16:22:38.405031 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.403865 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f5d16211-b5e0-4042-aeba-ba5d273ccd96-kubelet-config\") pod \"global-pull-secret-syncer-8qbxw\" (UID: \"f5d16211-b5e0-4042-aeba-ba5d273ccd96\") " pod="kube-system/global-pull-secret-syncer-8qbxw" Jul 07 16:22:38.405031 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.403901 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/dcab04ec-d173-4c57-b7a9-fa4d1c73a7bf-hosts-file\") pod \"node-resolver-59lsn\" (UID: \"dcab04ec-d173-4c57-b7a9-fa4d1c73a7bf\") " pod="openshift-dns/node-resolver-59lsn" Jul 07 16:22:38.405031 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.403943 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f3614425-8241-4f22-be37-00b93b9d4d76-etc-kubernetes\") pod \"tuned-r5krk\" (UID: \"f3614425-8241-4f22-be37-00b93b9d4d76\") " pod="openshift-cluster-node-tuning-operator/tuned-r5krk" Jul 07 16:22:38.405031 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.403978 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a1abd5d4-cd31-4b5b-9011-9dd0f248ce19-host-cni-bin\") pod \"ovnkube-node-dbbfb\" (UID: \"a1abd5d4-cd31-4b5b-9011-9dd0f248ce19\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbbfb" Jul 07 16:22:38.405031 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.404003 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a1abd5d4-cd31-4b5b-9011-9dd0f248ce19-ovnkube-config\") pod \"ovnkube-node-dbbfb\" (UID: \"a1abd5d4-cd31-4b5b-9011-9dd0f248ce19\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbbfb" Jul 07 16:22:38.405031 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.404012 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f3614425-8241-4f22-be37-00b93b9d4d76-etc-kubernetes\") pod \"tuned-r5krk\" (UID: \"f3614425-8241-4f22-be37-00b93b9d4d76\") " pod="openshift-cluster-node-tuning-operator/tuned-r5krk" Jul 07 16:22:38.405031 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.404023 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-msr4v\" (UniqueName: \"kubernetes.io/projected/a1abd5d4-cd31-4b5b-9011-9dd0f248ce19-kube-api-access-msr4v\") pod \"ovnkube-node-dbbfb\" (UID: \"a1abd5d4-cd31-4b5b-9011-9dd0f248ce19\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbbfb" Jul 07 16:22:38.405031 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.404060 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f3614425-8241-4f22-be37-00b93b9d4d76-etc-modprobe-d\") pod \"tuned-r5krk\" (UID: \"f3614425-8241-4f22-be37-00b93b9d4d76\") " pod="openshift-cluster-node-tuning-operator/tuned-r5krk" Jul 07 16:22:38.405031 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.404100 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c4403f38-090d-4ad3-b880-fad3c7b44627-host\") pod \"node-ca-dbg2n\" (UID: \"c4403f38-090d-4ad3-b880-fad3c7b44627\") " pod="openshift-image-registry/node-ca-dbg2n" Jul 07 16:22:38.405031 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.404137 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/55b2059a-e73e-4aa1-a218-e8a3b61c4978-multus-cni-dir\") pod \"multus-bd7wg\" (UID: \"55b2059a-e73e-4aa1-a218-e8a3b61c4978\") " pod="openshift-multus/multus-bd7wg" Jul 07 16:22:38.405941 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.404150 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c4403f38-090d-4ad3-b880-fad3c7b44627-host\") pod \"node-ca-dbg2n\" (UID: \"c4403f38-090d-4ad3-b880-fad3c7b44627\") " pod="openshift-image-registry/node-ca-dbg2n" Jul 07 16:22:38.405941 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.404191 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a1abd5d4-cd31-4b5b-9011-9dd0f248ce19-var-lib-openvswitch\") pod \"ovnkube-node-dbbfb\" (UID: \"a1abd5d4-cd31-4b5b-9011-9dd0f248ce19\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbbfb" Jul 07 16:22:38.405941 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.404210 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a1abd5d4-cd31-4b5b-9011-9dd0f248ce19-log-socket\") pod \"ovnkube-node-dbbfb\" (UID: \"a1abd5d4-cd31-4b5b-9011-9dd0f248ce19\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbbfb" Jul 07 16:22:38.405941 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.404220 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f3614425-8241-4f22-be37-00b93b9d4d76-etc-modprobe-d\") pod \"tuned-r5krk\" (UID: \"f3614425-8241-4f22-be37-00b93b9d4d76\") " pod="openshift-cluster-node-tuning-operator/tuned-r5krk" Jul 07 16:22:38.405941 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.404243 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/34e24cef-97a7-4b77-9397-7ecdcca92721-socket-dir\") pod \"aws-ebs-csi-driver-node-zmxwh\" (UID: \"34e24cef-97a7-4b77-9397-7ecdcca92721\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zmxwh" Jul 07 16:22:38.405941 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.404267 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/55b2059a-e73e-4aa1-a218-e8a3b61c4978-multus-cni-dir\") pod \"multus-bd7wg\" (UID: \"55b2059a-e73e-4aa1-a218-e8a3b61c4978\") " pod="openshift-multus/multus-bd7wg" Jul 07 16:22:38.405941 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.404302 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/34e24cef-97a7-4b77-9397-7ecdcca92721-registration-dir\") pod \"aws-ebs-csi-driver-node-zmxwh\" (UID: \"34e24cef-97a7-4b77-9397-7ecdcca92721\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zmxwh" Jul 07 16:22:38.405941 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.404334 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f3614425-8241-4f22-be37-00b93b9d4d76-tmp\") pod \"tuned-r5krk\" (UID: \"f3614425-8241-4f22-be37-00b93b9d4d76\") " pod="openshift-cluster-node-tuning-operator/tuned-r5krk" Jul 07 16:22:38.405941 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.404359 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c4403f38-090d-4ad3-b880-fad3c7b44627-serviceca\") pod \"node-ca-dbg2n\" (UID: \"c4403f38-090d-4ad3-b880-fad3c7b44627\") " pod="openshift-image-registry/node-ca-dbg2n" Jul 07 16:22:38.405941 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.404408 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/dcc8336f-7d16-417d-aa68-e1c790939e7d-os-release\") pod \"multus-additional-cni-plugins-mpbtm\" (UID: \"dcc8336f-7d16-417d-aa68-e1c790939e7d\") " pod="openshift-multus/multus-additional-cni-plugins-mpbtm" Jul 07 16:22:38.405941 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.404428 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/55b2059a-e73e-4aa1-a218-e8a3b61c4978-host-var-lib-cni-multus\") pod \"multus-bd7wg\" (UID: \"55b2059a-e73e-4aa1-a218-e8a3b61c4978\") " pod="openshift-multus/multus-bd7wg" Jul 07 16:22:38.405941 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.404456 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a1abd5d4-cd31-4b5b-9011-9dd0f248ce19-run-openvswitch\") pod \"ovnkube-node-dbbfb\" (UID: \"a1abd5d4-cd31-4b5b-9011-9dd0f248ce19\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbbfb" Jul 07 16:22:38.405941 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.404481 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rmkjp\" (UniqueName: \"kubernetes.io/projected/dcab04ec-d173-4c57-b7a9-fa4d1c73a7bf-kube-api-access-rmkjp\") pod \"node-resolver-59lsn\" (UID: \"dcab04ec-d173-4c57-b7a9-fa4d1c73a7bf\") " pod="openshift-dns/node-resolver-59lsn" Jul 07 16:22:38.405941 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.404514 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/34e24cef-97a7-4b77-9397-7ecdcca92721-sys-fs\") pod \"aws-ebs-csi-driver-node-zmxwh\" (UID: \"34e24cef-97a7-4b77-9397-7ecdcca92721\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zmxwh" Jul 07 16:22:38.405941 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.404578 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/55b2059a-e73e-4aa1-a218-e8a3b61c4978-host-var-lib-cni-multus\") pod \"multus-bd7wg\" (UID: \"55b2059a-e73e-4aa1-a218-e8a3b61c4978\") " pod="openshift-multus/multus-bd7wg" Jul 07 16:22:38.405941 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.404601 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/dcc8336f-7d16-417d-aa68-e1c790939e7d-os-release\") pod \"multus-additional-cni-plugins-mpbtm\" (UID: \"dcc8336f-7d16-417d-aa68-e1c790939e7d\") " pod="openshift-multus/multus-additional-cni-plugins-mpbtm" Jul 07 16:22:38.405941 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.404628 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/34e24cef-97a7-4b77-9397-7ecdcca92721-registration-dir\") pod \"aws-ebs-csi-driver-node-zmxwh\" (UID: \"34e24cef-97a7-4b77-9397-7ecdcca92721\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zmxwh" Jul 07 16:22:38.406628 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.404670 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dcc8336f-7d16-417d-aa68-e1c790939e7d-system-cni-dir\") pod \"multus-additional-cni-plugins-mpbtm\" (UID: \"dcc8336f-7d16-417d-aa68-e1c790939e7d\") " pod="openshift-multus/multus-additional-cni-plugins-mpbtm" Jul 07 16:22:38.406628 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.404689 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/34e24cef-97a7-4b77-9397-7ecdcca92721-sys-fs\") pod \"aws-ebs-csi-driver-node-zmxwh\" (UID: \"34e24cef-97a7-4b77-9397-7ecdcca92721\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zmxwh" Jul 07 16:22:38.406628 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.404691 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dcc8336f-7d16-417d-aa68-e1c790939e7d-system-cni-dir\") pod \"multus-additional-cni-plugins-mpbtm\" (UID: \"dcc8336f-7d16-417d-aa68-e1c790939e7d\") " pod="openshift-multus/multus-additional-cni-plugins-mpbtm" Jul 07 16:22:38.406628 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.404714 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/55b2059a-e73e-4aa1-a218-e8a3b61c4978-system-cni-dir\") pod \"multus-bd7wg\" (UID: \"55b2059a-e73e-4aa1-a218-e8a3b61c4978\") " pod="openshift-multus/multus-bd7wg" Jul 07 16:22:38.406628 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.404733 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/dbfa7ead-a6a8-4536-8a8d-cbe2e2b33011-konnectivity-ca\") pod \"konnectivity-agent-q798q\" (UID: \"dbfa7ead-a6a8-4536-8a8d-cbe2e2b33011\") " pod="kube-system/konnectivity-agent-q798q" Jul 07 16:22:38.406628 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.404757 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/55b2059a-e73e-4aa1-a218-e8a3b61c4978-system-cni-dir\") pod \"multus-bd7wg\" (UID: \"55b2059a-e73e-4aa1-a218-e8a3b61c4978\") " pod="openshift-multus/multus-bd7wg" Jul 07 16:22:38.406628 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.404760 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m47sh\" (UniqueName: \"kubernetes.io/projected/53ce531f-ee40-476c-b275-915d9206d4d8-kube-api-access-m47sh\") pod \"network-check-target-8br2k\" (UID: \"53ce531f-ee40-476c-b275-915d9206d4d8\") " pod="openshift-network-diagnostics/network-check-target-8br2k" Jul 07 16:22:38.406628 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.404810 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/34e24cef-97a7-4b77-9397-7ecdcca92721-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zmxwh\" (UID: \"34e24cef-97a7-4b77-9397-7ecdcca92721\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zmxwh" Jul 07 16:22:38.406628 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.404828 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f3614425-8241-4f22-be37-00b93b9d4d76-run\") pod \"tuned-r5krk\" (UID: \"f3614425-8241-4f22-be37-00b93b9d4d76\") " pod="openshift-cluster-node-tuning-operator/tuned-r5krk" Jul 07 16:22:38.406628 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.404846 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f3614425-8241-4f22-be37-00b93b9d4d76-lib-modules\") pod \"tuned-r5krk\" (UID: \"f3614425-8241-4f22-be37-00b93b9d4d76\") " pod="openshift-cluster-node-tuning-operator/tuned-r5krk" Jul 07 16:22:38.406628 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.404874 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dcc8336f-7d16-417d-aa68-e1c790939e7d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mpbtm\" (UID: \"dcc8336f-7d16-417d-aa68-e1c790939e7d\") " pod="openshift-multus/multus-additional-cni-plugins-mpbtm" Jul 07 16:22:38.406628 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.404898 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvdwb\" (UniqueName: \"kubernetes.io/projected/55b2059a-e73e-4aa1-a218-e8a3b61c4978-kube-api-access-fvdwb\") pod \"multus-bd7wg\" (UID: \"55b2059a-e73e-4aa1-a218-e8a3b61c4978\") " pod="openshift-multus/multus-bd7wg" Jul 07 16:22:38.406628 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.404919 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8jnk\" (UniqueName: \"kubernetes.io/projected/592ceff6-55ee-4890-8b40-5aa74cd26a35-kube-api-access-r8jnk\") pod \"network-metrics-daemon-kngnh\" (UID: \"592ceff6-55ee-4890-8b40-5aa74cd26a35\") " pod="openshift-multus/network-metrics-daemon-kngnh" Jul 07 16:22:38.406628 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.404956 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/34e24cef-97a7-4b77-9397-7ecdcca92721-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zmxwh\" (UID: \"34e24cef-97a7-4b77-9397-7ecdcca92721\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zmxwh" Jul 07 16:22:38.406628 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.404945 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b3bfeb23-15e6-4f35-8f71-9d1f906ca7e2-iptables-alerter-script\") pod \"iptables-alerter-84scn\" (UID: \"b3bfeb23-15e6-4f35-8f71-9d1f906ca7e2\") " pod="openshift-network-operator/iptables-alerter-84scn" Jul 07 16:22:38.406628 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.405135 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24t42\" (UniqueName: \"kubernetes.io/projected/b3bfeb23-15e6-4f35-8f71-9d1f906ca7e2-kube-api-access-24t42\") pod \"iptables-alerter-84scn\" (UID: \"b3bfeb23-15e6-4f35-8f71-9d1f906ca7e2\") " pod="openshift-network-operator/iptables-alerter-84scn" Jul 07 16:22:38.406628 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.405163 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qkvh\" (UniqueName: \"kubernetes.io/projected/34e24cef-97a7-4b77-9397-7ecdcca92721-kube-api-access-7qkvh\") pod \"aws-ebs-csi-driver-node-zmxwh\" (UID: \"34e24cef-97a7-4b77-9397-7ecdcca92721\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zmxwh" Jul 07 16:22:38.407113 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.405164 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dcc8336f-7d16-417d-aa68-e1c790939e7d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mpbtm\" (UID: \"dcc8336f-7d16-417d-aa68-e1c790939e7d\") " pod="openshift-multus/multus-additional-cni-plugins-mpbtm" Jul 07 16:22:38.407113 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.405333 2552 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 07 16:22:38.407113 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.405400 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f3614425-8241-4f22-be37-00b93b9d4d76-etc-sysctl-d\") pod \"tuned-r5krk\" (UID: \"f3614425-8241-4f22-be37-00b93b9d4d76\") " pod="openshift-cluster-node-tuning-operator/tuned-r5krk" Jul 07 16:22:38.407113 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.405435 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/55b2059a-e73e-4aa1-a218-e8a3b61c4978-hostroot\") pod \"multus-bd7wg\" (UID: \"55b2059a-e73e-4aa1-a218-e8a3b61c4978\") " pod="openshift-multus/multus-bd7wg" Jul 07 16:22:38.407113 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.405497 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/55b2059a-e73e-4aa1-a218-e8a3b61c4978-multus-daemon-config\") pod \"multus-bd7wg\" (UID: \"55b2059a-e73e-4aa1-a218-e8a3b61c4978\") " pod="openshift-multus/multus-bd7wg" Jul 07 16:22:38.407113 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.405494 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/34e24cef-97a7-4b77-9397-7ecdcca92721-socket-dir\") pod \"aws-ebs-csi-driver-node-zmxwh\" (UID: \"34e24cef-97a7-4b77-9397-7ecdcca92721\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zmxwh" Jul 07 16:22:38.407113 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.405530 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a1abd5d4-cd31-4b5b-9011-9dd0f248ce19-env-overrides\") pod \"ovnkube-node-dbbfb\" (UID: \"a1abd5d4-cd31-4b5b-9011-9dd0f248ce19\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbbfb" Jul 07 16:22:38.407113 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.405560 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a1abd5d4-cd31-4b5b-9011-9dd0f248ce19-ovn-node-metrics-cert\") pod \"ovnkube-node-dbbfb\" (UID: \"a1abd5d4-cd31-4b5b-9011-9dd0f248ce19\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbbfb" Jul 07 16:22:38.407113 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.405568 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/dcc8336f-7d16-417d-aa68-e1c790939e7d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mpbtm\" (UID: \"dcc8336f-7d16-417d-aa68-e1c790939e7d\") " pod="openshift-multus/multus-additional-cni-plugins-mpbtm" Jul 07 16:22:38.407113 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.405587 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f3614425-8241-4f22-be37-00b93b9d4d76-run\") pod \"tuned-r5krk\" (UID: \"f3614425-8241-4f22-be37-00b93b9d4d76\") " pod="openshift-cluster-node-tuning-operator/tuned-r5krk" Jul 07 16:22:38.407113 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.405670 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/55b2059a-e73e-4aa1-a218-e8a3b61c4978-hostroot\") pod \"multus-bd7wg\" (UID: \"55b2059a-e73e-4aa1-a218-e8a3b61c4978\") " pod="openshift-multus/multus-bd7wg" Jul 07 16:22:38.407113 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.405691 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f3614425-8241-4f22-be37-00b93b9d4d76-etc-sysctl-d\") pod \"tuned-r5krk\" (UID: \"f3614425-8241-4f22-be37-00b93b9d4d76\") " pod="openshift-cluster-node-tuning-operator/tuned-r5krk" Jul 07 16:22:38.407113 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.405694 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f3614425-8241-4f22-be37-00b93b9d4d76-lib-modules\") pod \"tuned-r5krk\" (UID: \"f3614425-8241-4f22-be37-00b93b9d4d76\") " pod="openshift-cluster-node-tuning-operator/tuned-r5krk" Jul 07 16:22:38.407113 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.405720 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/dcc8336f-7d16-417d-aa68-e1c790939e7d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mpbtm\" (UID: \"dcc8336f-7d16-417d-aa68-e1c790939e7d\") " pod="openshift-multus/multus-additional-cni-plugins-mpbtm" Jul 07 16:22:38.407113 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.405978 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c4403f38-090d-4ad3-b880-fad3c7b44627-serviceca\") pod \"node-ca-dbg2n\" (UID: \"c4403f38-090d-4ad3-b880-fad3c7b44627\") " pod="openshift-image-registry/node-ca-dbg2n" Jul 07 16:22:38.407113 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.406073 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/55b2059a-e73e-4aa1-a218-e8a3b61c4978-cni-binary-copy\") pod \"multus-bd7wg\" (UID: \"55b2059a-e73e-4aa1-a218-e8a3b61c4978\") " pod="openshift-multus/multus-bd7wg" Jul 07 16:22:38.407113 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.406235 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/55b2059a-e73e-4aa1-a218-e8a3b61c4978-multus-daemon-config\") pod \"multus-bd7wg\" (UID: \"55b2059a-e73e-4aa1-a218-e8a3b61c4978\") " pod="openshift-multus/multus-bd7wg" Jul 07 16:22:38.407113 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.406258 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dcc8336f-7d16-417d-aa68-e1c790939e7d-cni-binary-copy\") pod \"multus-additional-cni-plugins-mpbtm\" (UID: \"dcc8336f-7d16-417d-aa68-e1c790939e7d\") " pod="openshift-multus/multus-additional-cni-plugins-mpbtm" Jul 07 16:22:38.407642 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.406345 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/dbfa7ead-a6a8-4536-8a8d-cbe2e2b33011-konnectivity-ca\") pod \"konnectivity-agent-q798q\" (UID: \"dbfa7ead-a6a8-4536-8a8d-cbe2e2b33011\") " pod="kube-system/konnectivity-agent-q798q" Jul 07 16:22:38.408572 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.408547 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f3614425-8241-4f22-be37-00b93b9d4d76-tmp\") pod \"tuned-r5krk\" (UID: \"f3614425-8241-4f22-be37-00b93b9d4d76\") " pod="openshift-cluster-node-tuning-operator/tuned-r5krk" Jul 07 16:22:38.408670 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.408570 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f3614425-8241-4f22-be37-00b93b9d4d76-etc-tuned\") pod \"tuned-r5krk\" (UID: \"f3614425-8241-4f22-be37-00b93b9d4d76\") " pod="openshift-cluster-node-tuning-operator/tuned-r5krk" Jul 07 16:22:38.408795 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.408771 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/dbfa7ead-a6a8-4536-8a8d-cbe2e2b33011-agent-certs\") pod \"konnectivity-agent-q798q\" (UID: \"dbfa7ead-a6a8-4536-8a8d-cbe2e2b33011\") " pod="kube-system/konnectivity-agent-q798q" Jul 07 16:22:38.423147 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.423112 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zh4gx\" (UniqueName: \"kubernetes.io/projected/f3614425-8241-4f22-be37-00b93b9d4d76-kube-api-access-zh4gx\") pod \"tuned-r5krk\" (UID: \"f3614425-8241-4f22-be37-00b93b9d4d76\") " pod="openshift-cluster-node-tuning-operator/tuned-r5krk" Jul 07 16:22:38.424003 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.423976 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvdwb\" (UniqueName: \"kubernetes.io/projected/55b2059a-e73e-4aa1-a218-e8a3b61c4978-kube-api-access-fvdwb\") pod \"multus-bd7wg\" (UID: \"55b2059a-e73e-4aa1-a218-e8a3b61c4978\") " pod="openshift-multus/multus-bd7wg" Jul 07 16:22:38.424090 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.424074 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qkvh\" (UniqueName: \"kubernetes.io/projected/34e24cef-97a7-4b77-9397-7ecdcca92721-kube-api-access-7qkvh\") pod \"aws-ebs-csi-driver-node-zmxwh\" (UID: \"34e24cef-97a7-4b77-9397-7ecdcca92721\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zmxwh" Jul 07 16:22:38.424139 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.424112 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9v86\" (UniqueName: \"kubernetes.io/projected/c4403f38-090d-4ad3-b880-fad3c7b44627-kube-api-access-b9v86\") pod \"node-ca-dbg2n\" (UID: \"c4403f38-090d-4ad3-b880-fad3c7b44627\") " pod="openshift-image-registry/node-ca-dbg2n" Jul 07 16:22:38.424190 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.424111 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wpqvd\" (UniqueName: \"kubernetes.io/projected/dcc8336f-7d16-417d-aa68-e1c790939e7d-kube-api-access-wpqvd\") pod \"multus-additional-cni-plugins-mpbtm\" (UID: \"dcc8336f-7d16-417d-aa68-e1c790939e7d\") " pod="openshift-multus/multus-additional-cni-plugins-mpbtm" Jul 07 16:22:38.424516 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.424494 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8jnk\" (UniqueName: \"kubernetes.io/projected/592ceff6-55ee-4890-8b40-5aa74cd26a35-kube-api-access-r8jnk\") pod \"network-metrics-daemon-kngnh\" (UID: \"592ceff6-55ee-4890-8b40-5aa74cd26a35\") " pod="openshift-multus/network-metrics-daemon-kngnh" Jul 07 16:22:38.433306 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.433273 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-mpbtm" Jul 07 16:22:38.451049 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.451027 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-bd7wg" Jul 07 16:22:38.475142 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.475119 2552 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 16:22:38.478758 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.478739 2552 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 16:22:38.505848 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.505817 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a1abd5d4-cd31-4b5b-9011-9dd0f248ce19-ovnkube-script-lib\") pod \"ovnkube-node-dbbfb\" (UID: \"a1abd5d4-cd31-4b5b-9011-9dd0f248ce19\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbbfb" Jul 07 16:22:38.505978 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.505909 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a1abd5d4-cd31-4b5b-9011-9dd0f248ce19-host-kubelet\") pod \"ovnkube-node-dbbfb\" (UID: \"a1abd5d4-cd31-4b5b-9011-9dd0f248ce19\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbbfb" Jul 07 16:22:38.505978 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.505952 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a1abd5d4-cd31-4b5b-9011-9dd0f248ce19-systemd-units\") pod \"ovnkube-node-dbbfb\" (UID: \"a1abd5d4-cd31-4b5b-9011-9dd0f248ce19\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbbfb" Jul 07 16:22:38.506100 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.505981 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a1abd5d4-cd31-4b5b-9011-9dd0f248ce19-host-slash\") pod \"ovnkube-node-dbbfb\" (UID: \"a1abd5d4-cd31-4b5b-9011-9dd0f248ce19\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbbfb" Jul 07 16:22:38.506100 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.506016 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a1abd5d4-cd31-4b5b-9011-9dd0f248ce19-host-run-netns\") pod \"ovnkube-node-dbbfb\" (UID: \"a1abd5d4-cd31-4b5b-9011-9dd0f248ce19\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbbfb" Jul 07 16:22:38.506100 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.506049 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a1abd5d4-cd31-4b5b-9011-9dd0f248ce19-run-systemd\") pod \"ovnkube-node-dbbfb\" (UID: \"a1abd5d4-cd31-4b5b-9011-9dd0f248ce19\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbbfb" Jul 07 16:22:38.506100 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.506076 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a1abd5d4-cd31-4b5b-9011-9dd0f248ce19-etc-openvswitch\") pod \"ovnkube-node-dbbfb\" (UID: \"a1abd5d4-cd31-4b5b-9011-9dd0f248ce19\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbbfb" Jul 07 16:22:38.506309 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.506133 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a1abd5d4-cd31-4b5b-9011-9dd0f248ce19-node-log\") pod \"ovnkube-node-dbbfb\" (UID: \"a1abd5d4-cd31-4b5b-9011-9dd0f248ce19\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbbfb" Jul 07 16:22:38.506309 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.506166 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/dcab04ec-d173-4c57-b7a9-fa4d1c73a7bf-hosts-file\") pod \"node-resolver-59lsn\" (UID: \"dcab04ec-d173-4c57-b7a9-fa4d1c73a7bf\") " pod="openshift-dns/node-resolver-59lsn" Jul 07 16:22:38.506309 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.506193 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a1abd5d4-cd31-4b5b-9011-9dd0f248ce19-host-cni-bin\") pod \"ovnkube-node-dbbfb\" (UID: \"a1abd5d4-cd31-4b5b-9011-9dd0f248ce19\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbbfb" Jul 07 16:22:38.506309 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.506224 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a1abd5d4-cd31-4b5b-9011-9dd0f248ce19-ovnkube-config\") pod \"ovnkube-node-dbbfb\" (UID: \"a1abd5d4-cd31-4b5b-9011-9dd0f248ce19\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbbfb" Jul 07 16:22:38.506309 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.506267 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-msr4v\" (UniqueName: \"kubernetes.io/projected/a1abd5d4-cd31-4b5b-9011-9dd0f248ce19-kube-api-access-msr4v\") pod \"ovnkube-node-dbbfb\" (UID: \"a1abd5d4-cd31-4b5b-9011-9dd0f248ce19\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbbfb" Jul 07 16:22:38.506309 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.506276 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a1abd5d4-cd31-4b5b-9011-9dd0f248ce19-run-systemd\") pod \"ovnkube-node-dbbfb\" (UID: \"a1abd5d4-cd31-4b5b-9011-9dd0f248ce19\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbbfb" Jul 07 16:22:38.506309 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.506304 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a1abd5d4-cd31-4b5b-9011-9dd0f248ce19-var-lib-openvswitch\") pod \"ovnkube-node-dbbfb\" (UID: \"a1abd5d4-cd31-4b5b-9011-9dd0f248ce19\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbbfb" Jul 07 16:22:38.506698 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.506314 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a1abd5d4-cd31-4b5b-9011-9dd0f248ce19-systemd-units\") pod \"ovnkube-node-dbbfb\" (UID: \"a1abd5d4-cd31-4b5b-9011-9dd0f248ce19\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbbfb" Jul 07 16:22:38.506698 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.506325 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a1abd5d4-cd31-4b5b-9011-9dd0f248ce19-host-run-netns\") pod \"ovnkube-node-dbbfb\" (UID: \"a1abd5d4-cd31-4b5b-9011-9dd0f248ce19\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbbfb" Jul 07 16:22:38.506698 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.506324 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a1abd5d4-cd31-4b5b-9011-9dd0f248ce19-host-slash\") pod \"ovnkube-node-dbbfb\" (UID: \"a1abd5d4-cd31-4b5b-9011-9dd0f248ce19\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbbfb" Jul 07 16:22:38.506698 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.506329 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a1abd5d4-cd31-4b5b-9011-9dd0f248ce19-log-socket\") pod \"ovnkube-node-dbbfb\" (UID: \"a1abd5d4-cd31-4b5b-9011-9dd0f248ce19\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbbfb" Jul 07 16:22:38.506698 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.506370 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a1abd5d4-cd31-4b5b-9011-9dd0f248ce19-host-cni-bin\") pod \"ovnkube-node-dbbfb\" (UID: \"a1abd5d4-cd31-4b5b-9011-9dd0f248ce19\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbbfb" Jul 07 16:22:38.506698 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.506383 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a1abd5d4-cd31-4b5b-9011-9dd0f248ce19-var-lib-openvswitch\") pod \"ovnkube-node-dbbfb\" (UID: \"a1abd5d4-cd31-4b5b-9011-9dd0f248ce19\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbbfb" Jul 07 16:22:38.506698 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.506390 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a1abd5d4-cd31-4b5b-9011-9dd0f248ce19-node-log\") pod \"ovnkube-node-dbbfb\" (UID: \"a1abd5d4-cd31-4b5b-9011-9dd0f248ce19\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbbfb" Jul 07 16:22:38.506698 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.506403 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a1abd5d4-cd31-4b5b-9011-9dd0f248ce19-run-openvswitch\") pod \"ovnkube-node-dbbfb\" (UID: \"a1abd5d4-cd31-4b5b-9011-9dd0f248ce19\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbbfb" Jul 07 16:22:38.506698 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.506441 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a1abd5d4-cd31-4b5b-9011-9dd0f248ce19-etc-openvswitch\") pod \"ovnkube-node-dbbfb\" (UID: \"a1abd5d4-cd31-4b5b-9011-9dd0f248ce19\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbbfb" Jul 07 16:22:38.506698 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.506452 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rmkjp\" (UniqueName: \"kubernetes.io/projected/dcab04ec-d173-4c57-b7a9-fa4d1c73a7bf-kube-api-access-rmkjp\") pod \"node-resolver-59lsn\" (UID: \"dcab04ec-d173-4c57-b7a9-fa4d1c73a7bf\") " pod="openshift-dns/node-resolver-59lsn" Jul 07 16:22:38.506698 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.506487 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m47sh\" (UniqueName: \"kubernetes.io/projected/53ce531f-ee40-476c-b275-915d9206d4d8-kube-api-access-m47sh\") pod \"network-check-target-8br2k\" (UID: \"53ce531f-ee40-476c-b275-915d9206d4d8\") " pod="openshift-network-diagnostics/network-check-target-8br2k" Jul 07 16:22:38.506698 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.506499 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/dcab04ec-d173-4c57-b7a9-fa4d1c73a7bf-hosts-file\") pod \"node-resolver-59lsn\" (UID: \"dcab04ec-d173-4c57-b7a9-fa4d1c73a7bf\") " pod="openshift-dns/node-resolver-59lsn" Jul 07 16:22:38.506698 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.506554 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b3bfeb23-15e6-4f35-8f71-9d1f906ca7e2-iptables-alerter-script\") pod \"iptables-alerter-84scn\" (UID: \"b3bfeb23-15e6-4f35-8f71-9d1f906ca7e2\") " pod="openshift-network-operator/iptables-alerter-84scn" Jul 07 16:22:38.506698 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.506585 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-24t42\" (UniqueName: \"kubernetes.io/projected/b3bfeb23-15e6-4f35-8f71-9d1f906ca7e2-kube-api-access-24t42\") pod \"iptables-alerter-84scn\" (UID: \"b3bfeb23-15e6-4f35-8f71-9d1f906ca7e2\") " pod="openshift-network-operator/iptables-alerter-84scn" Jul 07 16:22:38.506698 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.506644 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a1abd5d4-cd31-4b5b-9011-9dd0f248ce19-ovnkube-script-lib\") pod \"ovnkube-node-dbbfb\" (UID: \"a1abd5d4-cd31-4b5b-9011-9dd0f248ce19\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbbfb" Jul 07 16:22:38.506698 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.506651 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a1abd5d4-cd31-4b5b-9011-9dd0f248ce19-env-overrides\") pod \"ovnkube-node-dbbfb\" (UID: \"a1abd5d4-cd31-4b5b-9011-9dd0f248ce19\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbbfb" Jul 07 16:22:38.506698 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.506704 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a1abd5d4-cd31-4b5b-9011-9dd0f248ce19-ovn-node-metrics-cert\") pod \"ovnkube-node-dbbfb\" (UID: \"a1abd5d4-cd31-4b5b-9011-9dd0f248ce19\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbbfb" Jul 07 16:22:38.507458 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.506714 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a1abd5d4-cd31-4b5b-9011-9dd0f248ce19-run-openvswitch\") pod \"ovnkube-node-dbbfb\" (UID: \"a1abd5d4-cd31-4b5b-9011-9dd0f248ce19\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbbfb" Jul 07 16:22:38.507458 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.506748 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b3bfeb23-15e6-4f35-8f71-9d1f906ca7e2-host-slash\") pod \"iptables-alerter-84scn\" (UID: \"b3bfeb23-15e6-4f35-8f71-9d1f906ca7e2\") " pod="openshift-network-operator/iptables-alerter-84scn" Jul 07 16:22:38.507458 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.506774 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a1abd5d4-cd31-4b5b-9011-9dd0f248ce19-host-run-ovn-kubernetes\") pod \"ovnkube-node-dbbfb\" (UID: \"a1abd5d4-cd31-4b5b-9011-9dd0f248ce19\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbbfb" Jul 07 16:22:38.507458 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.506802 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dcab04ec-d173-4c57-b7a9-fa4d1c73a7bf-tmp-dir\") pod \"node-resolver-59lsn\" (UID: \"dcab04ec-d173-4c57-b7a9-fa4d1c73a7bf\") " pod="openshift-dns/node-resolver-59lsn" Jul 07 16:22:38.507458 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.506852 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a1abd5d4-cd31-4b5b-9011-9dd0f248ce19-host-cni-netd\") pod \"ovnkube-node-dbbfb\" (UID: \"a1abd5d4-cd31-4b5b-9011-9dd0f248ce19\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbbfb" Jul 07 16:22:38.507458 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.506899 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a1abd5d4-cd31-4b5b-9011-9dd0f248ce19-run-ovn\") pod \"ovnkube-node-dbbfb\" (UID: \"a1abd5d4-cd31-4b5b-9011-9dd0f248ce19\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbbfb" Jul 07 16:22:38.507458 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.506910 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b3bfeb23-15e6-4f35-8f71-9d1f906ca7e2-host-slash\") pod \"iptables-alerter-84scn\" (UID: \"b3bfeb23-15e6-4f35-8f71-9d1f906ca7e2\") " pod="openshift-network-operator/iptables-alerter-84scn" Jul 07 16:22:38.507458 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.506932 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a1abd5d4-cd31-4b5b-9011-9dd0f248ce19-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dbbfb\" (UID: \"a1abd5d4-cd31-4b5b-9011-9dd0f248ce19\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbbfb" Jul 07 16:22:38.507458 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.506905 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a1abd5d4-cd31-4b5b-9011-9dd0f248ce19-ovnkube-config\") pod \"ovnkube-node-dbbfb\" (UID: \"a1abd5d4-cd31-4b5b-9011-9dd0f248ce19\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbbfb" Jul 07 16:22:38.507458 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.507006 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a1abd5d4-cd31-4b5b-9011-9dd0f248ce19-log-socket\") pod \"ovnkube-node-dbbfb\" (UID: \"a1abd5d4-cd31-4b5b-9011-9dd0f248ce19\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbbfb" Jul 07 16:22:38.507458 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.507012 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a1abd5d4-cd31-4b5b-9011-9dd0f248ce19-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dbbfb\" (UID: \"a1abd5d4-cd31-4b5b-9011-9dd0f248ce19\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbbfb" Jul 07 16:22:38.507458 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.507022 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a1abd5d4-cd31-4b5b-9011-9dd0f248ce19-host-run-ovn-kubernetes\") pod \"ovnkube-node-dbbfb\" (UID: \"a1abd5d4-cd31-4b5b-9011-9dd0f248ce19\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbbfb" Jul 07 16:22:38.507458 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.507073 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a1abd5d4-cd31-4b5b-9011-9dd0f248ce19-host-cni-netd\") pod \"ovnkube-node-dbbfb\" (UID: \"a1abd5d4-cd31-4b5b-9011-9dd0f248ce19\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbbfb" Jul 07 16:22:38.507458 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.507094 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a1abd5d4-cd31-4b5b-9011-9dd0f248ce19-run-ovn\") pod \"ovnkube-node-dbbfb\" (UID: \"a1abd5d4-cd31-4b5b-9011-9dd0f248ce19\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbbfb" Jul 07 16:22:38.507458 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.507190 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a1abd5d4-cd31-4b5b-9011-9dd0f248ce19-host-kubelet\") pod \"ovnkube-node-dbbfb\" (UID: \"a1abd5d4-cd31-4b5b-9011-9dd0f248ce19\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbbfb" Jul 07 16:22:38.507458 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.507248 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b3bfeb23-15e6-4f35-8f71-9d1f906ca7e2-iptables-alerter-script\") pod \"iptables-alerter-84scn\" (UID: \"b3bfeb23-15e6-4f35-8f71-9d1f906ca7e2\") " pod="openshift-network-operator/iptables-alerter-84scn" Jul 07 16:22:38.507458 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.507376 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a1abd5d4-cd31-4b5b-9011-9dd0f248ce19-env-overrides\") pod \"ovnkube-node-dbbfb\" (UID: \"a1abd5d4-cd31-4b5b-9011-9dd0f248ce19\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbbfb" Jul 07 16:22:38.507930 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.507489 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dcab04ec-d173-4c57-b7a9-fa4d1c73a7bf-tmp-dir\") pod \"node-resolver-59lsn\" (UID: \"dcab04ec-d173-4c57-b7a9-fa4d1c73a7bf\") " pod="openshift-dns/node-resolver-59lsn" Jul 07 16:22:38.509425 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.509407 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a1abd5d4-cd31-4b5b-9011-9dd0f248ce19-ovn-node-metrics-cert\") pod \"ovnkube-node-dbbfb\" (UID: \"a1abd5d4-cd31-4b5b-9011-9dd0f248ce19\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbbfb" Jul 07 16:22:38.520959 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:22:38.520933 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 16:22:38.520959 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:22:38.520962 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 16:22:38.521129 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:22:38.520974 2552 projected.go:196] Error preparing data for projected volume kube-api-access-m47sh for pod openshift-network-diagnostics/network-check-target-8br2k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 16:22:38.521129 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:22:38.521053 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/53ce531f-ee40-476c-b275-915d9206d4d8-kube-api-access-m47sh podName:53ce531f-ee40-476c-b275-915d9206d4d8 nodeName:}" failed. No retries permitted until 2026-07-07 16:22:39.021037028 +0000 UTC m=+2.154002467 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-m47sh" (UniqueName: "kubernetes.io/projected/53ce531f-ee40-476c-b275-915d9206d4d8-kube-api-access-m47sh") pod "network-check-target-8br2k" (UID: "53ce531f-ee40-476c-b275-915d9206d4d8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 16:22:38.531540 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.531503 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rmkjp\" (UniqueName: \"kubernetes.io/projected/dcab04ec-d173-4c57-b7a9-fa4d1c73a7bf-kube-api-access-rmkjp\") pod \"node-resolver-59lsn\" (UID: \"dcab04ec-d173-4c57-b7a9-fa4d1c73a7bf\") " pod="openshift-dns/node-resolver-59lsn" Jul 07 16:22:38.531650 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.531626 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-24t42\" (UniqueName: \"kubernetes.io/projected/b3bfeb23-15e6-4f35-8f71-9d1f906ca7e2-kube-api-access-24t42\") pod \"iptables-alerter-84scn\" (UID: \"b3bfeb23-15e6-4f35-8f71-9d1f906ca7e2\") " pod="openshift-network-operator/iptables-alerter-84scn" Jul 07 16:22:38.531689 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.531679 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-msr4v\" (UniqueName: \"kubernetes.io/projected/a1abd5d4-cd31-4b5b-9011-9dd0f248ce19-kube-api-access-msr4v\") pod \"ovnkube-node-dbbfb\" (UID: \"a1abd5d4-cd31-4b5b-9011-9dd0f248ce19\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbbfb" Jul 07 16:22:38.656821 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:38.656779 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77665ae9de9dad3a92d5a2fadb79fc22.slice/crio-e2308e9434329a91149b7a818a01683255fd913541243a9bd8e2f0f4a8ac6a16 WatchSource:0}: Error finding container e2308e9434329a91149b7a818a01683255fd913541243a9bd8e2f0f4a8ac6a16: Status 404 returned error can't find the container with id e2308e9434329a91149b7a818a01683255fd913541243a9bd8e2f0f4a8ac6a16 Jul 07 16:22:38.657040 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:38.657022 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc5e733733f3672abbc00ed966fa257c.slice/crio-559ce6d2979b4aae5e9d32a60ed5a3add534f5993a5722dbce25e8ece1957fa6 WatchSource:0}: Error finding container 559ce6d2979b4aae5e9d32a60ed5a3add534f5993a5722dbce25e8ece1957fa6: Status 404 returned error can't find the container with id 559ce6d2979b4aae5e9d32a60ed5a3add534f5993a5722dbce25e8ece1957fa6 Jul 07 16:22:38.662230 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.662210 2552 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 16:22:38.672712 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.672690 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-q798q" Jul 07 16:22:38.676668 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.676647 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zmxwh" Jul 07 16:22:38.682074 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.682053 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-r5krk" Jul 07 16:22:38.683182 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:38.683158 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbfa7ead_a6a8_4536_8a8d_cbe2e2b33011.slice/crio-95fa9f3e41e3b5feaacfb711bd95f4cdc9c6166da6c5aab8f1f8d90e189dbdca WatchSource:0}: Error finding container 95fa9f3e41e3b5feaacfb711bd95f4cdc9c6166da6c5aab8f1f8d90e189dbdca: Status 404 returned error can't find the container with id 95fa9f3e41e3b5feaacfb711bd95f4cdc9c6166da6c5aab8f1f8d90e189dbdca Jul 07 16:22:38.686887 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:38.686863 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34e24cef_97a7_4b77_9397_7ecdcca92721.slice/crio-fc07c24b029a31ae71187256be99ac9a752e59d2f5ec3463d03805a45cd911fc WatchSource:0}: Error finding container fc07c24b029a31ae71187256be99ac9a752e59d2f5ec3463d03805a45cd911fc: Status 404 returned error can't find the container with id fc07c24b029a31ae71187256be99ac9a752e59d2f5ec3463d03805a45cd911fc Jul 07 16:22:38.691617 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:38.691592 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3614425_8241_4f22_be37_00b93b9d4d76.slice/crio-02423cf19e8f04017cb49c102fab06aa21cf785dde615db4954d273fb8be524d WatchSource:0}: Error finding container 02423cf19e8f04017cb49c102fab06aa21cf785dde615db4954d273fb8be524d: Status 404 returned error can't find the container with id 02423cf19e8f04017cb49c102fab06aa21cf785dde615db4954d273fb8be524d Jul 07 16:22:38.714774 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.714739 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-dbg2n" Jul 07 16:22:38.723344 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:38.723308 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4403f38_090d_4ad3_b880_fad3c7b44627.slice/crio-efae79abac431ecea8ffbd9cdc52f063d8bf426971958918732f7a989c4ab81d WatchSource:0}: Error finding container efae79abac431ecea8ffbd9cdc52f063d8bf426971958918732f7a989c4ab81d: Status 404 returned error can't find the container with id efae79abac431ecea8ffbd9cdc52f063d8bf426971958918732f7a989c4ab81d Jul 07 16:22:38.766262 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.766205 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-59lsn" Jul 07 16:22:38.774110 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:38.774076 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddcab04ec_d173_4c57_b7a9_fa4d1c73a7bf.slice/crio-c62337b403f04fe08e35bd6a0c8f26c758b93146551f5b35d92a5dba22ec00c3 WatchSource:0}: Error finding container c62337b403f04fe08e35bd6a0c8f26c758b93146551f5b35d92a5dba22ec00c3: Status 404 returned error can't find the container with id c62337b403f04fe08e35bd6a0c8f26c758b93146551f5b35d92a5dba22ec00c3 Jul 07 16:22:38.783009 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.782990 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-84scn" Jul 07 16:22:38.788475 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.788433 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-dbbfb" Jul 07 16:22:38.791261 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:38.791235 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3bfeb23_15e6_4f35_8f71_9d1f906ca7e2.slice/crio-7dd1b85678009cb2eb82befd9998b38ec20f9b30906d6ebe3528129ae16b5306 WatchSource:0}: Error finding container 7dd1b85678009cb2eb82befd9998b38ec20f9b30906d6ebe3528129ae16b5306: Status 404 returned error can't find the container with id 7dd1b85678009cb2eb82befd9998b38ec20f9b30906d6ebe3528129ae16b5306 Jul 07 16:22:38.796410 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:38.796384 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1abd5d4_cd31_4b5b_9011_9dd0f248ce19.slice/crio-d292efd6bd622e3f65707133bc72452f7828bbaaa09bb5fd86238c8050115eb1 WatchSource:0}: Error finding container d292efd6bd622e3f65707133bc72452f7828bbaaa09bb5fd86238c8050115eb1: Status 404 returned error can't find the container with id d292efd6bd622e3f65707133bc72452f7828bbaaa09bb5fd86238c8050115eb1 Jul 07 16:22:38.862953 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:38.862917 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddcc8336f_7d16_417d_aa68_e1c790939e7d.slice/crio-e9752934f1075a46d775125e47b6a623f99f3132d360e8f26eb10f9adb691ed9 WatchSource:0}: Error finding container e9752934f1075a46d775125e47b6a623f99f3132d360e8f26eb10f9adb691ed9: Status 404 returned error can't find the container with id e9752934f1075a46d775125e47b6a623f99f3132d360e8f26eb10f9adb691ed9 Jul 07 16:22:38.909999 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.909904 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f5d16211-b5e0-4042-aeba-ba5d273ccd96-original-pull-secret\") pod \"global-pull-secret-syncer-8qbxw\" (UID: \"f5d16211-b5e0-4042-aeba-ba5d273ccd96\") " pod="kube-system/global-pull-secret-syncer-8qbxw" Jul 07 16:22:38.909999 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:38.909950 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/592ceff6-55ee-4890-8b40-5aa74cd26a35-metrics-certs\") pod \"network-metrics-daemon-kngnh\" (UID: \"592ceff6-55ee-4890-8b40-5aa74cd26a35\") " pod="openshift-multus/network-metrics-daemon-kngnh" Jul 07 16:22:38.910191 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:22:38.910055 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 16:22:38.910191 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:22:38.910077 2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 16:22:38.910191 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:22:38.910110 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/592ceff6-55ee-4890-8b40-5aa74cd26a35-metrics-certs podName:592ceff6-55ee-4890-8b40-5aa74cd26a35 nodeName:}" failed. No retries permitted until 2026-07-07 16:22:39.910095527 +0000 UTC m=+3.043060967 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/592ceff6-55ee-4890-8b40-5aa74cd26a35-metrics-certs") pod "network-metrics-daemon-kngnh" (UID: "592ceff6-55ee-4890-8b40-5aa74cd26a35") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 16:22:38.910191 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:22:38.910138 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5d16211-b5e0-4042-aeba-ba5d273ccd96-original-pull-secret podName:f5d16211-b5e0-4042-aeba-ba5d273ccd96 nodeName:}" failed. No retries permitted until 2026-07-07 16:22:39.910123119 +0000 UTC m=+3.043088557 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f5d16211-b5e0-4042-aeba-ba5d273ccd96-original-pull-secret") pod "global-pull-secret-syncer-8qbxw" (UID: "f5d16211-b5e0-4042-aeba-ba5d273ccd96") : object "kube-system"/"original-pull-secret" not registered Jul 07 16:22:39.057184 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:22:39.057159 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55b2059a_e73e_4aa1_a218_e8a3b61c4978.slice/crio-c11a79fb0d8b0590a748c47a107be7a945ee01641d26ad53712bc3c4c50eef4e WatchSource:0}: Error finding container c11a79fb0d8b0590a748c47a107be7a945ee01641d26ad53712bc3c4c50eef4e: Status 404 returned error can't find the container with id c11a79fb0d8b0590a748c47a107be7a945ee01641d26ad53712bc3c4c50eef4e Jul 07 16:22:39.112068 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:39.112031 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m47sh\" (UniqueName: \"kubernetes.io/projected/53ce531f-ee40-476c-b275-915d9206d4d8-kube-api-access-m47sh\") pod \"network-check-target-8br2k\" (UID: \"53ce531f-ee40-476c-b275-915d9206d4d8\") " pod="openshift-network-diagnostics/network-check-target-8br2k" Jul 07 16:22:39.112280 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:22:39.112258 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 16:22:39.112349 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:22:39.112317 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 16:22:39.112390 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:22:39.112371 2552 projected.go:196] Error preparing data for projected volume kube-api-access-m47sh for pod openshift-network-diagnostics/network-check-target-8br2k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 16:22:39.112453 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:22:39.112440 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/53ce531f-ee40-476c-b275-915d9206d4d8-kube-api-access-m47sh podName:53ce531f-ee40-476c-b275-915d9206d4d8 nodeName:}" failed. No retries permitted until 2026-07-07 16:22:40.112419957 +0000 UTC m=+3.245385395 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-m47sh" (UniqueName: "kubernetes.io/projected/53ce531f-ee40-476c-b275-915d9206d4d8-kube-api-access-m47sh") pod "network-check-target-8br2k" (UID: "53ce531f-ee40-476c-b275-915d9206d4d8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 16:22:39.120412 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:39.120362 2552 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 16:22:39.351982 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:39.351804 2552 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 16:17:39 +0000 UTC" deadline="2028-04-17 03:21:54.432683706 +0000 UTC" Jul 07 16:22:39.351982 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:39.351872 2552 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15586h59m15.080815662s" Jul 07 16:22:39.460757 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:39.460364 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-dbg2n" event={"ID":"c4403f38-090d-4ad3-b880-fad3c7b44627","Type":"ContainerStarted","Data":"efae79abac431ecea8ffbd9cdc52f063d8bf426971958918732f7a989c4ab81d"} Jul 07 16:22:39.467296 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:39.467091 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-r5krk" event={"ID":"f3614425-8241-4f22-be37-00b93b9d4d76","Type":"ContainerStarted","Data":"02423cf19e8f04017cb49c102fab06aa21cf785dde615db4954d273fb8be524d"} Jul 07 16:22:39.472482 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:39.472435 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-q798q" event={"ID":"dbfa7ead-a6a8-4536-8a8d-cbe2e2b33011","Type":"ContainerStarted","Data":"95fa9f3e41e3b5feaacfb711bd95f4cdc9c6166da6c5aab8f1f8d90e189dbdca"} Jul 07 16:22:39.479665 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:39.479635 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-189.ec2.internal" event={"ID":"77665ae9de9dad3a92d5a2fadb79fc22","Type":"ContainerStarted","Data":"e2308e9434329a91149b7a818a01683255fd913541243a9bd8e2f0f4a8ac6a16"} Jul 07 16:22:39.481430 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:39.481345 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-bd7wg" event={"ID":"55b2059a-e73e-4aa1-a218-e8a3b61c4978","Type":"ContainerStarted","Data":"c11a79fb0d8b0590a748c47a107be7a945ee01641d26ad53712bc3c4c50eef4e"} Jul 07 16:22:39.485775 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:39.485749 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dbbfb" event={"ID":"a1abd5d4-cd31-4b5b-9011-9dd0f248ce19","Type":"ContainerStarted","Data":"d292efd6bd622e3f65707133bc72452f7828bbaaa09bb5fd86238c8050115eb1"} Jul 07 16:22:39.489059 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:39.489034 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zmxwh" event={"ID":"34e24cef-97a7-4b77-9397-7ecdcca92721","Type":"ContainerStarted","Data":"fc07c24b029a31ae71187256be99ac9a752e59d2f5ec3463d03805a45cd911fc"} Jul 07 16:22:39.495504 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:39.495187 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-189.ec2.internal" event={"ID":"dc5e733733f3672abbc00ed966fa257c","Type":"ContainerStarted","Data":"559ce6d2979b4aae5e9d32a60ed5a3add534f5993a5722dbce25e8ece1957fa6"} Jul 07 16:22:39.498447 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:39.498365 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mpbtm" event={"ID":"dcc8336f-7d16-417d-aa68-e1c790939e7d","Type":"ContainerStarted","Data":"e9752934f1075a46d775125e47b6a623f99f3132d360e8f26eb10f9adb691ed9"} Jul 07 16:22:39.501732 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:39.501707 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-84scn" event={"ID":"b3bfeb23-15e6-4f35-8f71-9d1f906ca7e2","Type":"ContainerStarted","Data":"7dd1b85678009cb2eb82befd9998b38ec20f9b30906d6ebe3528129ae16b5306"} Jul 07 16:22:39.509572 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:39.509439 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-59lsn" event={"ID":"dcab04ec-d173-4c57-b7a9-fa4d1c73a7bf","Type":"ContainerStarted","Data":"c62337b403f04fe08e35bd6a0c8f26c758b93146551f5b35d92a5dba22ec00c3"} Jul 07 16:22:39.920067 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:39.920028 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f5d16211-b5e0-4042-aeba-ba5d273ccd96-original-pull-secret\") pod \"global-pull-secret-syncer-8qbxw\" (UID: \"f5d16211-b5e0-4042-aeba-ba5d273ccd96\") " pod="kube-system/global-pull-secret-syncer-8qbxw" Jul 07 16:22:39.920270 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:39.920087 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/592ceff6-55ee-4890-8b40-5aa74cd26a35-metrics-certs\") pod \"network-metrics-daemon-kngnh\" (UID: \"592ceff6-55ee-4890-8b40-5aa74cd26a35\") " pod="openshift-multus/network-metrics-daemon-kngnh" Jul 07 16:22:39.920270 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:22:39.920263 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 16:22:39.920412 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:22:39.920343 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/592ceff6-55ee-4890-8b40-5aa74cd26a35-metrics-certs podName:592ceff6-55ee-4890-8b40-5aa74cd26a35 nodeName:}" failed. No retries permitted until 2026-07-07 16:22:41.920323308 +0000 UTC m=+5.053288752 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/592ceff6-55ee-4890-8b40-5aa74cd26a35-metrics-certs") pod "network-metrics-daemon-kngnh" (UID: "592ceff6-55ee-4890-8b40-5aa74cd26a35") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 16:22:39.920789 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:22:39.920769 2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 16:22:39.920861 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:22:39.920827 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5d16211-b5e0-4042-aeba-ba5d273ccd96-original-pull-secret podName:f5d16211-b5e0-4042-aeba-ba5d273ccd96 nodeName:}" failed. No retries permitted until 2026-07-07 16:22:41.920810999 +0000 UTC m=+5.053776453 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f5d16211-b5e0-4042-aeba-ba5d273ccd96-original-pull-secret") pod "global-pull-secret-syncer-8qbxw" (UID: "f5d16211-b5e0-4042-aeba-ba5d273ccd96") : object "kube-system"/"original-pull-secret" not registered Jul 07 16:22:40.122398 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:40.121512 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m47sh\" (UniqueName: \"kubernetes.io/projected/53ce531f-ee40-476c-b275-915d9206d4d8-kube-api-access-m47sh\") pod \"network-check-target-8br2k\" (UID: \"53ce531f-ee40-476c-b275-915d9206d4d8\") " pod="openshift-network-diagnostics/network-check-target-8br2k" Jul 07 16:22:40.122398 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:22:40.121827 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 16:22:40.122398 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:22:40.121864 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 16:22:40.122398 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:22:40.121877 2552 projected.go:196] Error preparing data for projected volume kube-api-access-m47sh for pod openshift-network-diagnostics/network-check-target-8br2k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 16:22:40.122398 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:22:40.121956 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/53ce531f-ee40-476c-b275-915d9206d4d8-kube-api-access-m47sh podName:53ce531f-ee40-476c-b275-915d9206d4d8 nodeName:}" failed. No retries permitted until 2026-07-07 16:22:42.121937313 +0000 UTC m=+5.254902759 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-m47sh" (UniqueName: "kubernetes.io/projected/53ce531f-ee40-476c-b275-915d9206d4d8-kube-api-access-m47sh") pod "network-check-target-8br2k" (UID: "53ce531f-ee40-476c-b275-915d9206d4d8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 16:22:40.352440 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:40.352318 2552 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 16:17:39 +0000 UTC" deadline="2028-03-01 17:10:43.107294253 +0000 UTC" Jul 07 16:22:40.352440 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:40.352364 2552 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14472h48m2.754935565s" Jul 07 16:22:40.435035 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:40.435005 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8br2k" Jul 07 16:22:40.435035 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:40.435031 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kngnh" Jul 07 16:22:40.435272 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:22:40.435132 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8br2k" podUID="53ce531f-ee40-476c-b275-915d9206d4d8" Jul 07 16:22:40.435272 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:40.435031 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8qbxw" Jul 07 16:22:40.435272 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:22:40.435211 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kngnh" podUID="592ceff6-55ee-4890-8b40-5aa74cd26a35" Jul 07 16:22:40.435464 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:22:40.435337 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8qbxw" podUID="f5d16211-b5e0-4042-aeba-ba5d273ccd96" Jul 07 16:22:41.937907 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:41.937810 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f5d16211-b5e0-4042-aeba-ba5d273ccd96-original-pull-secret\") pod \"global-pull-secret-syncer-8qbxw\" (UID: \"f5d16211-b5e0-4042-aeba-ba5d273ccd96\") " pod="kube-system/global-pull-secret-syncer-8qbxw" Jul 07 16:22:41.937907 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:41.937874 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/592ceff6-55ee-4890-8b40-5aa74cd26a35-metrics-certs\") pod \"network-metrics-daemon-kngnh\" (UID: \"592ceff6-55ee-4890-8b40-5aa74cd26a35\") " pod="openshift-multus/network-metrics-daemon-kngnh" Jul 07 16:22:41.938482 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:22:41.938004 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 16:22:41.938482 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:22:41.938071 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/592ceff6-55ee-4890-8b40-5aa74cd26a35-metrics-certs podName:592ceff6-55ee-4890-8b40-5aa74cd26a35 nodeName:}" failed. No retries permitted until 2026-07-07 16:22:45.938049722 +0000 UTC m=+9.071015174 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/592ceff6-55ee-4890-8b40-5aa74cd26a35-metrics-certs") pod "network-metrics-daemon-kngnh" (UID: "592ceff6-55ee-4890-8b40-5aa74cd26a35") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 16:22:41.938606 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:22:41.938540 2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 16:22:41.938606 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:22:41.938594 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5d16211-b5e0-4042-aeba-ba5d273ccd96-original-pull-secret podName:f5d16211-b5e0-4042-aeba-ba5d273ccd96 nodeName:}" failed. No retries permitted until 2026-07-07 16:22:45.938578647 +0000 UTC m=+9.071544090 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f5d16211-b5e0-4042-aeba-ba5d273ccd96-original-pull-secret") pod "global-pull-secret-syncer-8qbxw" (UID: "f5d16211-b5e0-4042-aeba-ba5d273ccd96") : object "kube-system"/"original-pull-secret" not registered Jul 07 16:22:42.139899 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:42.139854 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m47sh\" (UniqueName: \"kubernetes.io/projected/53ce531f-ee40-476c-b275-915d9206d4d8-kube-api-access-m47sh\") pod \"network-check-target-8br2k\" (UID: \"53ce531f-ee40-476c-b275-915d9206d4d8\") " pod="openshift-network-diagnostics/network-check-target-8br2k" Jul 07 16:22:42.140087 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:22:42.140065 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 16:22:42.140156 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:22:42.140095 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 16:22:42.140156 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:22:42.140110 2552 projected.go:196] Error preparing data for projected volume kube-api-access-m47sh for pod openshift-network-diagnostics/network-check-target-8br2k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 16:22:42.140262 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:22:42.140175 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/53ce531f-ee40-476c-b275-915d9206d4d8-kube-api-access-m47sh podName:53ce531f-ee40-476c-b275-915d9206d4d8 nodeName:}" failed. No retries permitted until 2026-07-07 16:22:46.140154538 +0000 UTC m=+9.273119977 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-m47sh" (UniqueName: "kubernetes.io/projected/53ce531f-ee40-476c-b275-915d9206d4d8-kube-api-access-m47sh") pod "network-check-target-8br2k" (UID: "53ce531f-ee40-476c-b275-915d9206d4d8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 16:22:42.436343 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:42.435897 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8br2k" Jul 07 16:22:42.436343 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:22:42.436044 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8br2k" podUID="53ce531f-ee40-476c-b275-915d9206d4d8" Jul 07 16:22:42.436343 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:42.436123 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8qbxw" Jul 07 16:22:42.436343 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:22:42.436196 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8qbxw" podUID="f5d16211-b5e0-4042-aeba-ba5d273ccd96" Jul 07 16:22:42.436343 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:42.436279 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kngnh" Jul 07 16:22:42.436749 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:22:42.436362 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kngnh" podUID="592ceff6-55ee-4890-8b40-5aa74cd26a35" Jul 07 16:22:44.435571 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:44.435533 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8qbxw" Jul 07 16:22:44.436112 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:22:44.435693 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8qbxw" podUID="f5d16211-b5e0-4042-aeba-ba5d273ccd96" Jul 07 16:22:44.436112 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:44.436102 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kngnh" Jul 07 16:22:44.436238 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:22:44.436214 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kngnh" podUID="592ceff6-55ee-4890-8b40-5aa74cd26a35" Jul 07 16:22:44.436324 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:44.436288 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8br2k" Jul 07 16:22:44.436383 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:22:44.436364 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8br2k" podUID="53ce531f-ee40-476c-b275-915d9206d4d8" Jul 07 16:22:45.972896 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:45.972857 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f5d16211-b5e0-4042-aeba-ba5d273ccd96-original-pull-secret\") pod \"global-pull-secret-syncer-8qbxw\" (UID: \"f5d16211-b5e0-4042-aeba-ba5d273ccd96\") " pod="kube-system/global-pull-secret-syncer-8qbxw" Jul 07 16:22:45.973397 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:45.972919 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/592ceff6-55ee-4890-8b40-5aa74cd26a35-metrics-certs\") pod \"network-metrics-daemon-kngnh\" (UID: \"592ceff6-55ee-4890-8b40-5aa74cd26a35\") " pod="openshift-multus/network-metrics-daemon-kngnh" Jul 07 16:22:45.973397 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:22:45.973043 2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 16:22:45.973397 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:22:45.973106 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 16:22:45.973397 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:22:45.973125 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5d16211-b5e0-4042-aeba-ba5d273ccd96-original-pull-secret podName:f5d16211-b5e0-4042-aeba-ba5d273ccd96 nodeName:}" failed. No retries permitted until 2026-07-07 16:22:53.973104474 +0000 UTC m=+17.106069917 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f5d16211-b5e0-4042-aeba-ba5d273ccd96-original-pull-secret") pod "global-pull-secret-syncer-8qbxw" (UID: "f5d16211-b5e0-4042-aeba-ba5d273ccd96") : object "kube-system"/"original-pull-secret" not registered Jul 07 16:22:45.973397 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:22:45.973168 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/592ceff6-55ee-4890-8b40-5aa74cd26a35-metrics-certs podName:592ceff6-55ee-4890-8b40-5aa74cd26a35 nodeName:}" failed. No retries permitted until 2026-07-07 16:22:53.973149893 +0000 UTC m=+17.106115352 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/592ceff6-55ee-4890-8b40-5aa74cd26a35-metrics-certs") pod "network-metrics-daemon-kngnh" (UID: "592ceff6-55ee-4890-8b40-5aa74cd26a35") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 16:22:46.174913 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:46.174828 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m47sh\" (UniqueName: \"kubernetes.io/projected/53ce531f-ee40-476c-b275-915d9206d4d8-kube-api-access-m47sh\") pod \"network-check-target-8br2k\" (UID: \"53ce531f-ee40-476c-b275-915d9206d4d8\") " pod="openshift-network-diagnostics/network-check-target-8br2k" Jul 07 16:22:46.175079 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:22:46.175038 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 16:22:46.175079 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:22:46.175064 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 16:22:46.175079 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:22:46.175075 2552 projected.go:196] Error preparing data for projected volume kube-api-access-m47sh for pod openshift-network-diagnostics/network-check-target-8br2k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 16:22:46.175245 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:22:46.175136 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/53ce531f-ee40-476c-b275-915d9206d4d8-kube-api-access-m47sh podName:53ce531f-ee40-476c-b275-915d9206d4d8 nodeName:}" failed. No retries permitted until 2026-07-07 16:22:54.175116595 +0000 UTC m=+17.308082035 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-m47sh" (UniqueName: "kubernetes.io/projected/53ce531f-ee40-476c-b275-915d9206d4d8-kube-api-access-m47sh") pod "network-check-target-8br2k" (UID: "53ce531f-ee40-476c-b275-915d9206d4d8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 16:22:46.436302 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:46.435389 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8br2k" Jul 07 16:22:46.436302 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:22:46.435526 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8br2k" podUID="53ce531f-ee40-476c-b275-915d9206d4d8" Jul 07 16:22:46.436302 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:46.435943 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8qbxw" Jul 07 16:22:46.436302 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:22:46.436041 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8qbxw" podUID="f5d16211-b5e0-4042-aeba-ba5d273ccd96" Jul 07 16:22:46.436302 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:46.436092 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kngnh" Jul 07 16:22:46.436302 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:22:46.436174 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kngnh" podUID="592ceff6-55ee-4890-8b40-5aa74cd26a35" Jul 07 16:22:48.435668 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:48.435123 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kngnh" Jul 07 16:22:48.435668 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:48.435124 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8br2k" Jul 07 16:22:48.435668 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:48.435141 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8qbxw" Jul 07 16:22:48.435668 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:22:48.435297 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kngnh" podUID="592ceff6-55ee-4890-8b40-5aa74cd26a35" Jul 07 16:22:48.435668 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:22:48.435403 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8qbxw" podUID="f5d16211-b5e0-4042-aeba-ba5d273ccd96" Jul 07 16:22:48.435668 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:22:48.435499 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8br2k" podUID="53ce531f-ee40-476c-b275-915d9206d4d8" Jul 07 16:22:50.435307 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:50.434771 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8qbxw" Jul 07 16:22:50.435307 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:50.434793 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kngnh" Jul 07 16:22:50.435307 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:22:50.434927 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8qbxw" podUID="f5d16211-b5e0-4042-aeba-ba5d273ccd96" Jul 07 16:22:50.435307 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:50.435274 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8br2k" Jul 07 16:22:50.436006 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:22:50.435364 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8br2k" podUID="53ce531f-ee40-476c-b275-915d9206d4d8" Jul 07 16:22:50.436006 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:22:50.435443 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kngnh" podUID="592ceff6-55ee-4890-8b40-5aa74cd26a35" Jul 07 16:22:52.435352 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:52.435308 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8br2k" Jul 07 16:22:52.435852 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:52.435366 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kngnh" Jul 07 16:22:52.435852 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:52.435423 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8qbxw" Jul 07 16:22:52.435852 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:22:52.435443 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8br2k" podUID="53ce531f-ee40-476c-b275-915d9206d4d8" Jul 07 16:22:52.435852 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:22:52.435513 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8qbxw" podUID="f5d16211-b5e0-4042-aeba-ba5d273ccd96" Jul 07 16:22:52.435852 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:22:52.435582 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kngnh" podUID="592ceff6-55ee-4890-8b40-5aa74cd26a35" Jul 07 16:22:54.032850 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:54.032811 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f5d16211-b5e0-4042-aeba-ba5d273ccd96-original-pull-secret\") pod \"global-pull-secret-syncer-8qbxw\" (UID: \"f5d16211-b5e0-4042-aeba-ba5d273ccd96\") " pod="kube-system/global-pull-secret-syncer-8qbxw" Jul 07 16:22:54.033299 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:54.032861 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/592ceff6-55ee-4890-8b40-5aa74cd26a35-metrics-certs\") pod \"network-metrics-daemon-kngnh\" (UID: \"592ceff6-55ee-4890-8b40-5aa74cd26a35\") " pod="openshift-multus/network-metrics-daemon-kngnh" Jul 07 16:22:54.033299 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:22:54.032979 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 16:22:54.033299 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:22:54.032986 2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 16:22:54.033299 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:22:54.033040 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/592ceff6-55ee-4890-8b40-5aa74cd26a35-metrics-certs podName:592ceff6-55ee-4890-8b40-5aa74cd26a35 nodeName:}" failed. No retries permitted until 2026-07-07 16:23:10.033020334 +0000 UTC m=+33.165985772 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/592ceff6-55ee-4890-8b40-5aa74cd26a35-metrics-certs") pod "network-metrics-daemon-kngnh" (UID: "592ceff6-55ee-4890-8b40-5aa74cd26a35") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 16:22:54.033299 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:22:54.033058 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5d16211-b5e0-4042-aeba-ba5d273ccd96-original-pull-secret podName:f5d16211-b5e0-4042-aeba-ba5d273ccd96 nodeName:}" failed. No retries permitted until 2026-07-07 16:23:10.033049175 +0000 UTC m=+33.166014616 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f5d16211-b5e0-4042-aeba-ba5d273ccd96-original-pull-secret") pod "global-pull-secret-syncer-8qbxw" (UID: "f5d16211-b5e0-4042-aeba-ba5d273ccd96") : object "kube-system"/"original-pull-secret" not registered Jul 07 16:22:54.234076 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:54.234029 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m47sh\" (UniqueName: \"kubernetes.io/projected/53ce531f-ee40-476c-b275-915d9206d4d8-kube-api-access-m47sh\") pod \"network-check-target-8br2k\" (UID: \"53ce531f-ee40-476c-b275-915d9206d4d8\") " pod="openshift-network-diagnostics/network-check-target-8br2k" Jul 07 16:22:54.234269 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:22:54.234230 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 16:22:54.234269 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:22:54.234257 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 16:22:54.234356 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:22:54.234273 2552 projected.go:196] Error preparing data for projected volume kube-api-access-m47sh for pod openshift-network-diagnostics/network-check-target-8br2k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 16:22:54.234356 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:22:54.234343 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/53ce531f-ee40-476c-b275-915d9206d4d8-kube-api-access-m47sh podName:53ce531f-ee40-476c-b275-915d9206d4d8 nodeName:}" failed. No retries permitted until 2026-07-07 16:23:10.234324226 +0000 UTC m=+33.367289684 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-m47sh" (UniqueName: "kubernetes.io/projected/53ce531f-ee40-476c-b275-915d9206d4d8-kube-api-access-m47sh") pod "network-check-target-8br2k" (UID: "53ce531f-ee40-476c-b275-915d9206d4d8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 16:22:54.435074 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:54.434996 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8br2k" Jul 07 16:22:54.435074 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:54.435019 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kngnh" Jul 07 16:22:54.435074 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:54.435035 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8qbxw" Jul 07 16:22:54.435377 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:22:54.435112 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8br2k" podUID="53ce531f-ee40-476c-b275-915d9206d4d8" Jul 07 16:22:54.435377 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:22:54.435170 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8qbxw" podUID="f5d16211-b5e0-4042-aeba-ba5d273ccd96" Jul 07 16:22:54.435377 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:22:54.435274 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kngnh" podUID="592ceff6-55ee-4890-8b40-5aa74cd26a35" Jul 07 16:22:56.435472 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:56.435433 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8br2k" Jul 07 16:22:56.435878 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:56.435454 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kngnh" Jul 07 16:22:56.435878 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:22:56.435557 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8br2k" podUID="53ce531f-ee40-476c-b275-915d9206d4d8" Jul 07 16:22:56.435878 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:56.435562 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8qbxw" Jul 07 16:22:56.435878 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:22:56.435653 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kngnh" podUID="592ceff6-55ee-4890-8b40-5aa74cd26a35" Jul 07 16:22:56.435878 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:22:56.435764 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8qbxw" podUID="f5d16211-b5e0-4042-aeba-ba5d273ccd96" Jul 07 16:22:58.435363 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:58.435327 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8br2k" Jul 07 16:22:58.435820 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:58.435327 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kngnh" Jul 07 16:22:58.435820 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:22:58.435459 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8br2k" podUID="53ce531f-ee40-476c-b275-915d9206d4d8" Jul 07 16:22:58.435820 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:22:58.435327 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8qbxw" Jul 07 16:22:58.435820 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:22:58.435643 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8qbxw" podUID="f5d16211-b5e0-4042-aeba-ba5d273ccd96" Jul 07 16:22:58.435820 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:22:58.435521 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kngnh" podUID="592ceff6-55ee-4890-8b40-5aa74cd26a35" Jul 07 16:23:00.435019 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:00.434689 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8br2k" Jul 07 16:23:00.435647 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:00.434719 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kngnh" Jul 07 16:23:00.435647 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:23:00.435112 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8br2k" podUID="53ce531f-ee40-476c-b275-915d9206d4d8" Jul 07 16:23:00.435647 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:00.434724 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8qbxw" Jul 07 16:23:00.435647 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:23:00.435223 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kngnh" podUID="592ceff6-55ee-4890-8b40-5aa74cd26a35" Jul 07 16:23:00.435647 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:23:00.435258 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8qbxw" podUID="f5d16211-b5e0-4042-aeba-ba5d273ccd96" Jul 07 16:23:00.577374 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:00.577341 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-dbg2n" event={"ID":"c4403f38-090d-4ad3-b880-fad3c7b44627","Type":"ContainerStarted","Data":"657528ee86fd16b70419ec3c22d292ff0978f55414d412ed1c673dc82c1d8298"} Jul 07 16:23:00.579587 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:00.579539 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-r5krk" event={"ID":"f3614425-8241-4f22-be37-00b93b9d4d76","Type":"ContainerStarted","Data":"2dc2be5291811413297306669c10fa25a846b78fca1a175c69fc361f8978585c"} Jul 07 16:23:00.581684 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:00.581658 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-q798q" event={"ID":"dbfa7ead-a6a8-4536-8a8d-cbe2e2b33011","Type":"ContainerStarted","Data":"c84a8077d464c37272325f125b3f0587039315a4edfbabf9398ca53dbaeb534b"} Jul 07 16:23:00.583116 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:00.583091 2552 generic.go:356] "Generic (PLEG): container finished" podID="77665ae9de9dad3a92d5a2fadb79fc22" containerID="7d6a7e365efa2bffc1986e933db278713b04861cced3f8fa59b00868102abae6" exitCode=0 Jul 07 16:23:00.583234 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:00.583142 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-189.ec2.internal" event={"ID":"77665ae9de9dad3a92d5a2fadb79fc22","Type":"ContainerDied","Data":"7d6a7e365efa2bffc1986e933db278713b04861cced3f8fa59b00868102abae6"} Jul 07 16:23:00.584588 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:00.584561 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-bd7wg" event={"ID":"55b2059a-e73e-4aa1-a218-e8a3b61c4978","Type":"ContainerStarted","Data":"b0c419e67afad9dc336f6af1a32ace4bd41141ea0172f4f6d05c16e6bfd57189"} Jul 07 16:23:00.587141 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:00.587126 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dbbfb_a1abd5d4-cd31-4b5b-9011-9dd0f248ce19/ovn-acl-logging/0.log" Jul 07 16:23:00.587447 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:00.587430 2552 generic.go:356] "Generic (PLEG): container finished" podID="a1abd5d4-cd31-4b5b-9011-9dd0f248ce19" containerID="fe43762b086901bffb3509d67a865ca0d680a3af9e392a4e9c9dbce23cdc37a6" exitCode=1 Jul 07 16:23:00.587515 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:00.587490 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dbbfb" event={"ID":"a1abd5d4-cd31-4b5b-9011-9dd0f248ce19","Type":"ContainerStarted","Data":"449da3e2c2c54be467b319c80e3f663ab271599672e78db276a1fb2acdad5873"} Jul 07 16:23:00.587555 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:00.587545 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dbbfb" event={"ID":"a1abd5d4-cd31-4b5b-9011-9dd0f248ce19","Type":"ContainerStarted","Data":"109933a67e1ec5ae7518ac580e5519759cb237b2bb140efcb2ad65086dd24f34"} Jul 07 16:23:00.587592 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:00.587583 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dbbfb" event={"ID":"a1abd5d4-cd31-4b5b-9011-9dd0f248ce19","Type":"ContainerStarted","Data":"9cd0dc194d2b332dd76c4e15ac23cacc20d3dc939e7524ab459311df8f79cdc7"} Jul 07 16:23:00.587633 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:00.587619 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dbbfb" event={"ID":"a1abd5d4-cd31-4b5b-9011-9dd0f248ce19","Type":"ContainerStarted","Data":"069a0872a9118c9a1c36b7ff806d30c84b3f3a34bccbca0dc788bd73077c0f01"} Jul 07 16:23:00.587671 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:00.587646 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dbbfb" event={"ID":"a1abd5d4-cd31-4b5b-9011-9dd0f248ce19","Type":"ContainerDied","Data":"fe43762b086901bffb3509d67a865ca0d680a3af9e392a4e9c9dbce23cdc37a6"} Jul 07 16:23:00.587713 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:00.587684 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dbbfb" event={"ID":"a1abd5d4-cd31-4b5b-9011-9dd0f248ce19","Type":"ContainerStarted","Data":"bcb7793c02091332693b595c3949e51bbb6943ae9c7b5104f4663c12999876eb"} Jul 07 16:23:00.588742 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:00.588725 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zmxwh" event={"ID":"34e24cef-97a7-4b77-9397-7ecdcca92721","Type":"ContainerStarted","Data":"12b577663757ae3312f669f85ffe7d0d238962f7ebb116946223815e71306bf5"} Jul 07 16:23:00.589925 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:00.589908 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-189.ec2.internal" event={"ID":"dc5e733733f3672abbc00ed966fa257c","Type":"ContainerStarted","Data":"fca5024f80d8c7fabf6a16da15826a2b83296a9c3979a729211b99d4e0a94993"} Jul 07 16:23:00.591262 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:00.591241 2552 generic.go:356] "Generic (PLEG): container finished" podID="dcc8336f-7d16-417d-aa68-e1c790939e7d" containerID="cc91af0374f8aeead51fabb2246e38cb4d96f76249b121a31a4b9e0b85ee7df9" exitCode=0 Jul 07 16:23:00.591333 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:00.591304 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mpbtm" event={"ID":"dcc8336f-7d16-417d-aa68-e1c790939e7d","Type":"ContainerDied","Data":"cc91af0374f8aeead51fabb2246e38cb4d96f76249b121a31a4b9e0b85ee7df9"} Jul 07 16:23:00.592673 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:00.592600 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-59lsn" event={"ID":"dcab04ec-d173-4c57-b7a9-fa4d1c73a7bf","Type":"ContainerStarted","Data":"d5c7f08cdd1cd93246c85b675fd37cf5b1a239f5b2a8032955b076bfa245bd84"} Jul 07 16:23:00.600995 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:00.600955 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-dbg2n" podStartSLOduration=1.716291993 podStartE2EDuration="22.600943081s" totalImagesPullingTime="20.884651088s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:22:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:23:00.60084586 +0000 UTC m=+23.733811318" watchObservedRunningTime="2026-07-07 16:23:00.600943081 +0000 UTC m=+23.733908541" Jul 07 16:23:00.627492 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:00.627446 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-59lsn" podStartSLOduration=1.8080209969999999 podStartE2EDuration="22.627431174s" totalImagesPullingTime="20.819410177s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:22:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:23:00.62716547 +0000 UTC m=+23.760130936" watchObservedRunningTime="2026-07-07 16:23:00.627431174 +0000 UTC m=+23.760396633" Jul 07 16:23:00.698235 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:00.698180 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-bd7wg" podStartSLOduration=1.685753995 podStartE2EDuration="22.698163884s" totalImagesPullingTime="21.012409889s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:22:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:23:00.697881867 +0000 UTC m=+23.830847327" watchObservedRunningTime="2026-07-07 16:23:00.698163884 +0000 UTC m=+23.831129343" Jul 07 16:23:00.739267 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:00.739192 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-189.ec2.internal" podStartSLOduration=21.739175775 podStartE2EDuration="21.739175775s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:22:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:23:00.720058699 +0000 UTC m=+23.853024158" watchObservedRunningTime="2026-07-07 16:23:00.739175775 +0000 UTC m=+23.872141290" Jul 07 16:23:00.739425 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:00.739305 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-q798q" podStartSLOduration=1.829534582 podStartE2EDuration="22.739300474s" totalImagesPullingTime="20.909765892s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:22:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:23:00.739032258 +0000 UTC m=+23.871997717" watchObservedRunningTime="2026-07-07 16:23:00.739300474 +0000 UTC m=+23.872265933" Jul 07 16:23:00.758964 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:00.758909 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-r5krk" podStartSLOduration=1.829411833 podStartE2EDuration="22.758894234s" totalImagesPullingTime="20.929482401s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:22:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:23:00.758228515 +0000 UTC m=+23.891193973" watchObservedRunningTime="2026-07-07 16:23:00.758894234 +0000 UTC m=+23.891859694" Jul 07 16:23:01.595909 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:01.595870 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-84scn" event={"ID":"b3bfeb23-15e6-4f35-8f71-9d1f906ca7e2","Type":"ContainerStarted","Data":"373df9a5f44400a6feafa8ac75f91774797e3cdd178999d99266b9ff2750e148"} Jul 07 16:23:01.597709 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:01.597683 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-189.ec2.internal" event={"ID":"77665ae9de9dad3a92d5a2fadb79fc22","Type":"ContainerStarted","Data":"bef52508c8e11ad04ebd908d905e90872ee7f5f50a148d4f801fc9a9a42528d5"} Jul 07 16:23:01.658725 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:01.658669 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-84scn" podStartSLOduration=2.842144558 podStartE2EDuration="23.658652475s" totalImagesPullingTime="20.816507917s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:22:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:23:01.617024551 +0000 UTC m=+24.749990010" watchObservedRunningTime="2026-07-07 16:23:01.658652475 +0000 UTC m=+24.791617934" Jul 07 16:23:01.658911 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:01.658883 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-189.ec2.internal" podStartSLOduration=22.658876708 podStartE2EDuration="22.658876708s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:22:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:23:01.658801625 +0000 UTC m=+24.791767084" watchObservedRunningTime="2026-07-07 16:23:01.658876708 +0000 UTC m=+24.791842166" Jul 07 16:23:02.136093 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:02.136067 2552 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 07 16:23:02.374831 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:02.374714 2552 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-07T16:23:02.136086052Z","UUID":"4515a22f-723f-47e4-b96d-032fa7a4e373","Handler":null,"Name":"","Endpoint":""} Jul 07 16:23:02.376476 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:02.376453 2552 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 07 16:23:02.376592 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:02.376501 2552 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 07 16:23:02.434944 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:02.434913 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8qbxw" Jul 07 16:23:02.434944 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:02.434944 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kngnh" Jul 07 16:23:02.435153 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:23:02.435028 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8qbxw" podUID="f5d16211-b5e0-4042-aeba-ba5d273ccd96" Jul 07 16:23:02.435153 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:02.435081 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8br2k" Jul 07 16:23:02.435230 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:23:02.435161 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kngnh" podUID="592ceff6-55ee-4890-8b40-5aa74cd26a35" Jul 07 16:23:02.435267 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:23:02.435247 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8br2k" podUID="53ce531f-ee40-476c-b275-915d9206d4d8" Jul 07 16:23:02.603247 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:02.603160 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dbbfb_a1abd5d4-cd31-4b5b-9011-9dd0f248ce19/ovn-acl-logging/0.log" Jul 07 16:23:02.603711 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:02.603586 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dbbfb" event={"ID":"a1abd5d4-cd31-4b5b-9011-9dd0f248ce19","Type":"ContainerStarted","Data":"cd252f89771be0e122ed7e899779d1e502528a94afcd452b7a590675a194ae60"} Jul 07 16:23:02.605598 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:02.605573 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zmxwh" event={"ID":"34e24cef-97a7-4b77-9397-7ecdcca92721","Type":"ContainerStarted","Data":"45c35656b9d3383fceebb6bfc0912435ac10af87af9e9d5679e25ecbf143cd27"} Jul 07 16:23:04.435096 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:04.434913 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8br2k" Jul 07 16:23:04.435518 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:04.434931 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8qbxw" Jul 07 16:23:04.435518 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:23:04.435174 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8br2k" podUID="53ce531f-ee40-476c-b275-915d9206d4d8" Jul 07 16:23:04.435518 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:23:04.435287 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8qbxw" podUID="f5d16211-b5e0-4042-aeba-ba5d273ccd96" Jul 07 16:23:04.435518 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:04.434969 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kngnh" Jul 07 16:23:04.435518 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:23:04.435376 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kngnh" podUID="592ceff6-55ee-4890-8b40-5aa74cd26a35" Jul 07 16:23:04.505154 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:04.505125 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-q798q" Jul 07 16:23:04.505646 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:04.505631 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-q798q" Jul 07 16:23:04.612959 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:04.612916 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zmxwh" event={"ID":"34e24cef-97a7-4b77-9397-7ecdcca92721","Type":"ContainerStarted","Data":"084d68a5c0a8595620125930a98d8fb29d19846890a843ff3a11a0d298973891"} Jul 07 16:23:04.613136 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:04.613003 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-q798q" Jul 07 16:23:04.613500 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:04.613479 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-q798q" Jul 07 16:23:04.639826 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:04.639732 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zmxwh" podStartSLOduration=2.547558232 podStartE2EDuration="26.639711272s" totalImagesPullingTime="24.09215304s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:22:38 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:23:04.639334076 +0000 UTC m=+27.772299535" watchObservedRunningTime="2026-07-07 16:23:04.639711272 +0000 UTC m=+27.772676733" Jul 07 16:23:05.618414 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:05.618386 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dbbfb_a1abd5d4-cd31-4b5b-9011-9dd0f248ce19/ovn-acl-logging/0.log" Jul 07 16:23:05.619107 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:05.618805 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dbbfb" event={"ID":"a1abd5d4-cd31-4b5b-9011-9dd0f248ce19","Type":"ContainerStarted","Data":"8e0775604965fd4fddf5d2db1129f12572df01b0d7d6d9748b7db9656c8f2e4e"} Jul 07 16:23:05.619298 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:05.619281 2552 scope.go:117] "RemoveContainer" containerID="fe43762b086901bffb3509d67a865ca0d680a3af9e392a4e9c9dbce23cdc37a6" Jul 07 16:23:06.435070 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:06.434868 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kngnh" Jul 07 16:23:06.435261 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:06.434874 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8br2k" Jul 07 16:23:06.435261 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:23:06.435157 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kngnh" podUID="592ceff6-55ee-4890-8b40-5aa74cd26a35" Jul 07 16:23:06.435261 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:06.434889 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8qbxw" Jul 07 16:23:06.435395 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:23:06.435264 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8br2k" podUID="53ce531f-ee40-476c-b275-915d9206d4d8" Jul 07 16:23:06.435395 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:23:06.435371 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8qbxw" podUID="f5d16211-b5e0-4042-aeba-ba5d273ccd96" Jul 07 16:23:06.624150 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:06.624118 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dbbfb_a1abd5d4-cd31-4b5b-9011-9dd0f248ce19/ovn-acl-logging/0.log" Jul 07 16:23:06.624607 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:06.624532 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dbbfb" event={"ID":"a1abd5d4-cd31-4b5b-9011-9dd0f248ce19","Type":"ContainerStarted","Data":"29ff6215d0a2a7bfa55fee8ce32560359f38331d70ac8a30b061359eb45f35e5"} Jul 07 16:23:06.624869 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:06.624844 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dbbfb" Jul 07 16:23:06.624986 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:06.624920 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dbbfb" Jul 07 16:23:06.624986 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:06.624973 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dbbfb" Jul 07 16:23:06.642332 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:06.642301 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dbbfb" Jul 07 16:23:06.642542 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:06.642525 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dbbfb" Jul 07 16:23:06.677245 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:06.677180 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-dbbfb" podStartSLOduration=7.824983962 podStartE2EDuration="28.677161914s" totalImagesPullingTime="20.852177952s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:22:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:23:06.674981958 +0000 UTC m=+29.807947420" watchObservedRunningTime="2026-07-07 16:23:06.677161914 +0000 UTC m=+29.810127375" Jul 07 16:23:07.185562 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:07.185524 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-kngnh"] Jul 07 16:23:07.185722 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:07.185689 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kngnh" Jul 07 16:23:07.185832 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:23:07.185808 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kngnh" podUID="592ceff6-55ee-4890-8b40-5aa74cd26a35" Jul 07 16:23:07.196649 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:07.196619 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-8br2k"] Jul 07 16:23:07.196808 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:07.196736 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8br2k" Jul 07 16:23:07.196868 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:23:07.196831 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8br2k" podUID="53ce531f-ee40-476c-b275-915d9206d4d8" Jul 07 16:23:07.200923 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:07.200886 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-8qbxw"] Jul 07 16:23:07.201049 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:07.200992 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8qbxw" Jul 07 16:23:07.201122 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:23:07.201066 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8qbxw" podUID="f5d16211-b5e0-4042-aeba-ba5d273ccd96" Jul 07 16:23:08.435508 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:08.435474 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8br2k" Jul 07 16:23:08.435967 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:23:08.435600 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8br2k" podUID="53ce531f-ee40-476c-b275-915d9206d4d8" Jul 07 16:23:08.435967 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:08.435655 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kngnh" Jul 07 16:23:08.435967 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:23:08.435764 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kngnh" podUID="592ceff6-55ee-4890-8b40-5aa74cd26a35" Jul 07 16:23:09.435487 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:09.435400 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8qbxw" Jul 07 16:23:09.435636 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:23:09.435553 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8qbxw" podUID="f5d16211-b5e0-4042-aeba-ba5d273ccd96" Jul 07 16:23:09.633059 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:09.633023 2552 generic.go:356] "Generic (PLEG): container finished" podID="dcc8336f-7d16-417d-aa68-e1c790939e7d" containerID="2057824c347abb573686f342bcbc7b0ca9e2a2b737dfb74064a7831db3f3cc7b" exitCode=0 Jul 07 16:23:09.633228 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:09.633083 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mpbtm" event={"ID":"dcc8336f-7d16-417d-aa68-e1c790939e7d","Type":"ContainerDied","Data":"2057824c347abb573686f342bcbc7b0ca9e2a2b737dfb74064a7831db3f3cc7b"} Jul 07 16:23:10.047173 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:10.046957 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f5d16211-b5e0-4042-aeba-ba5d273ccd96-original-pull-secret\") pod \"global-pull-secret-syncer-8qbxw\" (UID: \"f5d16211-b5e0-4042-aeba-ba5d273ccd96\") " pod="kube-system/global-pull-secret-syncer-8qbxw" Jul 07 16:23:10.047391 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:10.047197 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/592ceff6-55ee-4890-8b40-5aa74cd26a35-metrics-certs\") pod \"network-metrics-daemon-kngnh\" (UID: \"592ceff6-55ee-4890-8b40-5aa74cd26a35\") " pod="openshift-multus/network-metrics-daemon-kngnh" Jul 07 16:23:10.047391 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:23:10.047092 2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 16:23:10.047391 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:23:10.047298 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5d16211-b5e0-4042-aeba-ba5d273ccd96-original-pull-secret podName:f5d16211-b5e0-4042-aeba-ba5d273ccd96 nodeName:}" failed. No retries permitted until 2026-07-07 16:23:42.047278414 +0000 UTC m=+65.180243851 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f5d16211-b5e0-4042-aeba-ba5d273ccd96-original-pull-secret") pod "global-pull-secret-syncer-8qbxw" (UID: "f5d16211-b5e0-4042-aeba-ba5d273ccd96") : object "kube-system"/"original-pull-secret" not registered Jul 07 16:23:10.047391 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:23:10.047325 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 16:23:10.047391 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:23:10.047371 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/592ceff6-55ee-4890-8b40-5aa74cd26a35-metrics-certs podName:592ceff6-55ee-4890-8b40-5aa74cd26a35 nodeName:}" failed. No retries permitted until 2026-07-07 16:23:42.047355653 +0000 UTC m=+65.180321089 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/592ceff6-55ee-4890-8b40-5aa74cd26a35-metrics-certs") pod "network-metrics-daemon-kngnh" (UID: "592ceff6-55ee-4890-8b40-5aa74cd26a35") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 16:23:10.248869 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:10.248837 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m47sh\" (UniqueName: \"kubernetes.io/projected/53ce531f-ee40-476c-b275-915d9206d4d8-kube-api-access-m47sh\") pod \"network-check-target-8br2k\" (UID: \"53ce531f-ee40-476c-b275-915d9206d4d8\") " pod="openshift-network-diagnostics/network-check-target-8br2k" Jul 07 16:23:10.249022 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:23:10.249005 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 16:23:10.249057 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:23:10.249026 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 16:23:10.249057 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:23:10.249038 2552 projected.go:196] Error preparing data for projected volume kube-api-access-m47sh for pod openshift-network-diagnostics/network-check-target-8br2k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 16:23:10.249133 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:23:10.249091 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/53ce531f-ee40-476c-b275-915d9206d4d8-kube-api-access-m47sh podName:53ce531f-ee40-476c-b275-915d9206d4d8 nodeName:}" failed. No retries permitted until 2026-07-07 16:23:42.249075552 +0000 UTC m=+65.382040988 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-m47sh" (UniqueName: "kubernetes.io/projected/53ce531f-ee40-476c-b275-915d9206d4d8-kube-api-access-m47sh") pod "network-check-target-8br2k" (UID: "53ce531f-ee40-476c-b275-915d9206d4d8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 16:23:10.435146 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:10.435118 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kngnh" Jul 07 16:23:10.435275 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:10.435166 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8br2k" Jul 07 16:23:10.435337 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:23:10.435271 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kngnh" podUID="592ceff6-55ee-4890-8b40-5aa74cd26a35" Jul 07 16:23:10.435429 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:23:10.435402 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8br2k" podUID="53ce531f-ee40-476c-b275-915d9206d4d8" Jul 07 16:23:10.637766 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:10.637734 2552 generic.go:356] "Generic (PLEG): container finished" podID="dcc8336f-7d16-417d-aa68-e1c790939e7d" containerID="acdf93b18014084ad97c459637ed39a783cb147e1bf1d6927ac80844a35f703d" exitCode=0 Jul 07 16:23:10.638112 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:10.637798 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mpbtm" event={"ID":"dcc8336f-7d16-417d-aa68-e1c790939e7d","Type":"ContainerDied","Data":"acdf93b18014084ad97c459637ed39a783cb147e1bf1d6927ac80844a35f703d"} Jul 07 16:23:11.435230 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:11.435136 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8qbxw" Jul 07 16:23:11.435367 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:23:11.435299 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8qbxw" podUID="f5d16211-b5e0-4042-aeba-ba5d273ccd96" Jul 07 16:23:11.642495 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:11.642460 2552 generic.go:356] "Generic (PLEG): container finished" podID="dcc8336f-7d16-417d-aa68-e1c790939e7d" containerID="0e3e19aaa25a4e0c9fbbf3bf815b256af0fd0511e26b506b484feb322245dc2e" exitCode=0 Jul 07 16:23:11.642843 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:11.642500 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mpbtm" event={"ID":"dcc8336f-7d16-417d-aa68-e1c790939e7d","Type":"ContainerDied","Data":"0e3e19aaa25a4e0c9fbbf3bf815b256af0fd0511e26b506b484feb322245dc2e"} Jul 07 16:23:12.434726 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:12.434694 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8br2k" Jul 07 16:23:12.434872 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:12.434694 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kngnh" Jul 07 16:23:12.434872 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:23:12.434792 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8br2k" podUID="53ce531f-ee40-476c-b275-915d9206d4d8" Jul 07 16:23:12.434951 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:23:12.434870 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kngnh" podUID="592ceff6-55ee-4890-8b40-5aa74cd26a35" Jul 07 16:23:12.683521 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:12.683494 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-189.ec2.internal" event="NodeReady" Jul 07 16:23:12.683930 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:12.683619 2552 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 07 16:23:12.750988 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:12.750903 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-wwrsk"] Jul 07 16:23:12.776308 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:12.775523 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-8kqd8"] Jul 07 16:23:12.776308 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:12.775872 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-wwrsk" Jul 07 16:23:12.779572 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:12.779547 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 07 16:23:12.779898 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:12.779870 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 07 16:23:12.780293 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:12.780189 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 07 16:23:12.781003 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:12.780689 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 07 16:23:12.782510 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:12.782462 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-fvdjx\"" Jul 07 16:23:12.787943 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:12.787926 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 07 16:23:12.789156 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:12.789134 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-675d4b7575-sgxn7"] Jul 07 16:23:12.789340 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:12.789322 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-8kqd8" Jul 07 16:23:12.793892 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:12.793768 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 07 16:23:12.794641 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:12.794179 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 07 16:23:12.794641 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:12.794270 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 07 16:23:12.800094 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:12.800071 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 07 16:23:12.800969 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:12.800141 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-b9kzw\"" Jul 07 16:23:12.810367 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:12.810346 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-qf5bh"] Jul 07 16:23:12.810577 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:12.810563 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-675d4b7575-sgxn7" Jul 07 16:23:12.813645 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:12.813625 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 07 16:23:12.813809 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:12.813789 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 07 16:23:12.814025 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:12.814007 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 07 16:23:12.814131 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:12.814060 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 07 16:23:12.814186 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:12.814160 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 07 16:23:12.814887 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:12.814871 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-xnsw5\"" Jul 07 16:23:12.815004 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:12.814877 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 07 16:23:12.830212 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:12.830171 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-w6fqx"] Jul 07 16:23:12.830343 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:12.830293 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-qf5bh" Jul 07 16:23:12.833180 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:12.833162 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 07 16:23:12.833317 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:12.833162 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 07 16:23:12.833317 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:12.833302 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 07 16:23:12.833432 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:12.833368 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 07 16:23:12.833495 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:12.833476 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-wgf2r\"" Jul 07 16:23:12.852536 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:12.852516 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-b65f8"] Jul 07 16:23:12.852645 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:12.852633 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-w6fqx" Jul 07 16:23:12.855297 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:12.855283 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 07 16:23:12.855390 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:12.855298 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 07 16:23:12.855444 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:12.855427 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-j7tz2\"" Jul 07 16:23:12.855823 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:12.855809 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 07 16:23:12.855895 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:12.855862 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 07 16:23:12.868843 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:12.868818 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/db1a7c4e-7b26-4e89-b989-7329dca3dfcf-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-8kqd8\" (UID: \"db1a7c4e-7b26-4e89-b989-7329dca3dfcf\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-8kqd8" Jul 07 16:23:12.868939 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:12.868860 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ab9458b7-cc16-493e-90f5-ff72d3b10ac7-config\") pod \"console-operator-68b757fb67-wwrsk\" (UID: \"ab9458b7-cc16-493e-90f5-ff72d3b10ac7\") " pod="openshift-console-operator/console-operator-68b757fb67-wwrsk" Jul 07 16:23:12.868939 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:12.868886 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ab9458b7-cc16-493e-90f5-ff72d3b10ac7-serving-cert\") pod \"console-operator-68b757fb67-wwrsk\" (UID: \"ab9458b7-cc16-493e-90f5-ff72d3b10ac7\") " pod="openshift-console-operator/console-operator-68b757fb67-wwrsk" Jul 07 16:23:12.869032 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:12.868951 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/db1a7c4e-7b26-4e89-b989-7329dca3dfcf-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-8kqd8\" (UID: \"db1a7c4e-7b26-4e89-b989-7329dca3dfcf\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-8kqd8" Jul 07 16:23:12.869032 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:12.869022 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ab9458b7-cc16-493e-90f5-ff72d3b10ac7-trusted-ca\") pod \"console-operator-68b757fb67-wwrsk\" (UID: \"ab9458b7-cc16-493e-90f5-ff72d3b10ac7\") " pod="openshift-console-operator/console-operator-68b757fb67-wwrsk" Jul 07 16:23:12.869104 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:12.869048 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tdnhv\" (UniqueName: \"kubernetes.io/projected/ab9458b7-cc16-493e-90f5-ff72d3b10ac7-kube-api-access-tdnhv\") pod \"console-operator-68b757fb67-wwrsk\" (UID: \"ab9458b7-cc16-493e-90f5-ff72d3b10ac7\") " pod="openshift-console-operator/console-operator-68b757fb67-wwrsk" Jul 07 16:23:12.869104 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:12.869070 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2trp\" (UniqueName: \"kubernetes.io/projected/db1a7c4e-7b26-4e89-b989-7329dca3dfcf-kube-api-access-w2trp\") pod \"cluster-monitoring-operator-64786d9cbb-8kqd8\" (UID: \"db1a7c4e-7b26-4e89-b989-7329dca3dfcf\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-8kqd8" Jul 07 16:23:12.874626 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:12.874612 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-xbz57"] Jul 07 16:23:12.874737 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:12.874724 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-b65f8" Jul 07 16:23:12.877757 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:12.877735 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-prjjq\"" Jul 07 16:23:12.877847 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:12.877737 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 07 16:23:12.877847 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:12.877782 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 07 16:23:12.878193 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:12.878173 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 07 16:23:12.878325 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:12.878289 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 07 16:23:12.883619 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:12.883602 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 07 16:23:12.884691 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:12.884677 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-647ccd66c4-52n8x"] Jul 07 16:23:12.884797 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:12.884785 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-xbz57" Jul 07 16:23:12.887309 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:12.887292 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-bjr7z\"" Jul 07 16:23:12.887453 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:12.887426 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 07 16:23:12.887678 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:12.887657 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 07 16:23:12.888343 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:12.888330 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 07 16:23:12.911773 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:12.911743 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-wwrsk"] Jul 07 16:23:12.911773 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:12.911776 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-w6fqx"] Jul 07 16:23:12.911955 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:12.911792 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-qf5bh"] Jul 07 16:23:12.911955 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:12.911805 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-675d4b7575-sgxn7"] Jul 07 16:23:12.911955 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:12.911819 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-647ccd66c4-52n8x"] Jul 07 16:23:12.911955 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:12.911833 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-m7r46"] Jul 07 16:23:12.911955 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:12.911863 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-647ccd66c4-52n8x" Jul 07 16:23:12.915607 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:12.915583 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 07 16:23:12.915736 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:12.915694 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 07 16:23:12.915929 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:12.915908 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 07 16:23:12.916089 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:12.915908 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-g8vwq\"" Jul 07 16:23:12.921533 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:12.921509 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 07 16:23:12.924733 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:12.924715 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-8dmps"] Jul 07 16:23:12.924845 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:12.924830 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-m7r46" Jul 07 16:23:12.927857 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:12.927815 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 07 16:23:12.928058 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:12.928037 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 07 16:23:12.928161 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:12.928110 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-jgc6k\"" Jul 07 16:23:12.946802 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:12.946776 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-h89k9"] Jul 07 16:23:12.946928 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:12.946861 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-8dmps" Jul 07 16:23:12.949952 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:12.949921 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-4wgvx\"" Jul 07 16:23:12.950093 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:12.949960 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 07 16:23:12.950192 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:12.950178 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 07 16:23:12.968909 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:12.968880 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-dbdhv"] Jul 07 16:23:12.969058 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:12.969005 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-h89k9" Jul 07 16:23:12.969497 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:12.969477 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/08d889ae-b463-46fb-a51d-8a4b59146f6c-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-b65f8\" (UID: \"08d889ae-b463-46fb-a51d-8a4b59146f6c\") " pod="openshift-insights/insights-operator-5c847dcfc4-b65f8" Jul 07 16:23:12.969609 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:12.969524 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/71da8590-3ed3-475d-8d66-fee560bb7abc-stats-auth\") pod \"router-default-675d4b7575-sgxn7\" (UID: \"71da8590-3ed3-475d-8d66-fee560bb7abc\") " pod="openshift-ingress/router-default-675d4b7575-sgxn7" Jul 07 16:23:12.969609 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:12.969551 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/08d889ae-b463-46fb-a51d-8a4b59146f6c-serving-cert\") pod \"insights-operator-5c847dcfc4-b65f8\" (UID: \"08d889ae-b463-46fb-a51d-8a4b59146f6c\") " pod="openshift-insights/insights-operator-5c847dcfc4-b65f8" Jul 07 16:23:12.969609 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:12.969580 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s6cjd\" (UniqueName: \"kubernetes.io/projected/c82dfb11-b16f-4ed1-96b2-d4ab90984286-kube-api-access-s6cjd\") pod \"kube-storage-version-migrator-operator-846bf668f7-w6fqx\" (UID: \"c82dfb11-b16f-4ed1-96b2-d4ab90984286\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-w6fqx" Jul 07 16:23:12.969770 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:12.969635 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/db1a7c4e-7b26-4e89-b989-7329dca3dfcf-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-8kqd8\" (UID: \"db1a7c4e-7b26-4e89-b989-7329dca3dfcf\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-8kqd8" Jul 07 16:23:12.969770 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:12.969663 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/08d889ae-b463-46fb-a51d-8a4b59146f6c-snapshots\") pod \"insights-operator-5c847dcfc4-b65f8\" (UID: \"08d889ae-b463-46fb-a51d-8a4b59146f6c\") " pod="openshift-insights/insights-operator-5c847dcfc4-b65f8" Jul 07 16:23:12.969863 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:12.969768 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ab9458b7-cc16-493e-90f5-ff72d3b10ac7-config\") pod \"console-operator-68b757fb67-wwrsk\" (UID: \"ab9458b7-cc16-493e-90f5-ff72d3b10ac7\") " pod="openshift-console-operator/console-operator-68b757fb67-wwrsk" Jul 07 16:23:12.969863 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:23:12.969788 2552 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 07 16:23:12.969863 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:12.969794 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ab9458b7-cc16-493e-90f5-ff72d3b10ac7-serving-cert\") pod \"console-operator-68b757fb67-wwrsk\" (UID: \"ab9458b7-cc16-493e-90f5-ff72d3b10ac7\") " pod="openshift-console-operator/console-operator-68b757fb67-wwrsk" Jul 07 16:23:12.969863 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:12.969836 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/db1a7c4e-7b26-4e89-b989-7329dca3dfcf-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-8kqd8\" (UID: \"db1a7c4e-7b26-4e89-b989-7329dca3dfcf\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-8kqd8" Jul 07 16:23:12.970046 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:12.969862 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/71da8590-3ed3-475d-8d66-fee560bb7abc-default-certificate\") pod \"router-default-675d4b7575-sgxn7\" (UID: \"71da8590-3ed3-475d-8d66-fee560bb7abc\") " pod="openshift-ingress/router-default-675d4b7575-sgxn7" Jul 07 16:23:12.970046 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:12.969890 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/71da8590-3ed3-475d-8d66-fee560bb7abc-metrics-certs\") pod \"router-default-675d4b7575-sgxn7\" (UID: \"71da8590-3ed3-475d-8d66-fee560bb7abc\") " pod="openshift-ingress/router-default-675d4b7575-sgxn7" Jul 07 16:23:12.970046 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:12.969913 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/08d889ae-b463-46fb-a51d-8a4b59146f6c-tmp\") pod \"insights-operator-5c847dcfc4-b65f8\" (UID: \"08d889ae-b463-46fb-a51d-8a4b59146f6c\") " pod="openshift-insights/insights-operator-5c847dcfc4-b65f8" Jul 07 16:23:12.970046 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:12.969936 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c82dfb11-b16f-4ed1-96b2-d4ab90984286-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-w6fqx\" (UID: \"c82dfb11-b16f-4ed1-96b2-d4ab90984286\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-w6fqx" Jul 07 16:23:12.970046 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:12.969961 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mfkvp\" (UniqueName: \"kubernetes.io/projected/31bd1f2b-6f2c-47cd-a0b5-0f5e1daf3038-kube-api-access-mfkvp\") pod \"cluster-samples-operator-56fcf86bf-xbz57\" (UID: \"31bd1f2b-6f2c-47cd-a0b5-0f5e1daf3038\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-xbz57" Jul 07 16:23:12.970046 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:12.970005 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7rn7n\" (UniqueName: \"kubernetes.io/projected/08d889ae-b463-46fb-a51d-8a4b59146f6c-kube-api-access-7rn7n\") pod \"insights-operator-5c847dcfc4-b65f8\" (UID: \"08d889ae-b463-46fb-a51d-8a4b59146f6c\") " pod="openshift-insights/insights-operator-5c847dcfc4-b65f8" Jul 07 16:23:12.970046 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:12.970033 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c82dfb11-b16f-4ed1-96b2-d4ab90984286-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-w6fqx\" (UID: \"c82dfb11-b16f-4ed1-96b2-d4ab90984286\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-w6fqx" Jul 07 16:23:12.970395 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:12.970070 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/31bd1f2b-6f2c-47cd-a0b5-0f5e1daf3038-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-xbz57\" (UID: \"31bd1f2b-6f2c-47cd-a0b5-0f5e1daf3038\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-xbz57" Jul 07 16:23:12.970395 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:12.970099 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ab9458b7-cc16-493e-90f5-ff72d3b10ac7-trusted-ca\") pod \"console-operator-68b757fb67-wwrsk\" (UID: \"ab9458b7-cc16-493e-90f5-ff72d3b10ac7\") " pod="openshift-console-operator/console-operator-68b757fb67-wwrsk" Jul 07 16:23:12.970395 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:12.970124 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/08d889ae-b463-46fb-a51d-8a4b59146f6c-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-b65f8\" (UID: \"08d889ae-b463-46fb-a51d-8a4b59146f6c\") " pod="openshift-insights/insights-operator-5c847dcfc4-b65f8" Jul 07 16:23:12.970395 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:12.970147 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c9428da5-4b2b-4c6a-bae9-0f0197fc5f78-config\") pod \"service-ca-operator-5d46d9ffd4-qf5bh\" (UID: \"c9428da5-4b2b-4c6a-bae9-0f0197fc5f78\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-qf5bh" Jul 07 16:23:12.970395 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:12.970172 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fhvnr\" (UniqueName: \"kubernetes.io/projected/c9428da5-4b2b-4c6a-bae9-0f0197fc5f78-kube-api-access-fhvnr\") pod \"service-ca-operator-5d46d9ffd4-qf5bh\" (UID: \"c9428da5-4b2b-4c6a-bae9-0f0197fc5f78\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-qf5bh" Jul 07 16:23:12.970395 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:12.970222 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tdnhv\" (UniqueName: \"kubernetes.io/projected/ab9458b7-cc16-493e-90f5-ff72d3b10ac7-kube-api-access-tdnhv\") pod \"console-operator-68b757fb67-wwrsk\" (UID: \"ab9458b7-cc16-493e-90f5-ff72d3b10ac7\") " pod="openshift-console-operator/console-operator-68b757fb67-wwrsk" Jul 07 16:23:12.970395 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:12.970247 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71da8590-3ed3-475d-8d66-fee560bb7abc-service-ca-bundle\") pod \"router-default-675d4b7575-sgxn7\" (UID: \"71da8590-3ed3-475d-8d66-fee560bb7abc\") " pod="openshift-ingress/router-default-675d4b7575-sgxn7" Jul 07 16:23:12.970395 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:12.970274 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c9428da5-4b2b-4c6a-bae9-0f0197fc5f78-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-qf5bh\" (UID: \"c9428da5-4b2b-4c6a-bae9-0f0197fc5f78\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-qf5bh" Jul 07 16:23:12.970395 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:12.970304 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2trp\" (UniqueName: \"kubernetes.io/projected/db1a7c4e-7b26-4e89-b989-7329dca3dfcf-kube-api-access-w2trp\") pod \"cluster-monitoring-operator-64786d9cbb-8kqd8\" (UID: \"db1a7c4e-7b26-4e89-b989-7329dca3dfcf\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-8kqd8" Jul 07 16:23:12.970395 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:12.970330 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tl8ld\" (UniqueName: \"kubernetes.io/projected/71da8590-3ed3-475d-8d66-fee560bb7abc-kube-api-access-tl8ld\") pod \"router-default-675d4b7575-sgxn7\" (UID: \"71da8590-3ed3-475d-8d66-fee560bb7abc\") " pod="openshift-ingress/router-default-675d4b7575-sgxn7" Jul 07 16:23:12.970829 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:23:12.970484 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db1a7c4e-7b26-4e89-b989-7329dca3dfcf-cluster-monitoring-operator-tls podName:db1a7c4e-7b26-4e89-b989-7329dca3dfcf nodeName:}" failed. No retries permitted until 2026-07-07 16:23:13.470456842 +0000 UTC m=+36.603422285 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/db1a7c4e-7b26-4e89-b989-7329dca3dfcf-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-8kqd8" (UID: "db1a7c4e-7b26-4e89-b989-7329dca3dfcf") : secret "cluster-monitoring-operator-tls" not found Jul 07 16:23:12.970829 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:12.970703 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q798q_dbfa7ead-a6a8-4536-8a8d-cbe2e2b33011/konnectivity-agent/0.log" limit=1024 Jul 07 16:23:12.971193 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:12.971146 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ab9458b7-cc16-493e-90f5-ff72d3b10ac7-config\") pod \"console-operator-68b757fb67-wwrsk\" (UID: \"ab9458b7-cc16-493e-90f5-ff72d3b10ac7\") " pod="openshift-console-operator/console-operator-68b757fb67-wwrsk" Jul 07 16:23:12.971364 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:12.971338 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ab9458b7-cc16-493e-90f5-ff72d3b10ac7-trusted-ca\") pod \"console-operator-68b757fb67-wwrsk\" (UID: \"ab9458b7-cc16-493e-90f5-ff72d3b10ac7\") " pod="openshift-console-operator/console-operator-68b757fb67-wwrsk" Jul 07 16:23:12.971475 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:12.971454 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/db1a7c4e-7b26-4e89-b989-7329dca3dfcf-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-8kqd8\" (UID: \"db1a7c4e-7b26-4e89-b989-7329dca3dfcf\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-8kqd8" Jul 07 16:23:12.971965 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:12.971945 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 07 16:23:12.972054 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:12.971986 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-j5hm5\"" Jul 07 16:23:12.972510 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:12.972491 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 07 16:23:12.983665 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:12.983608 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ab9458b7-cc16-493e-90f5-ff72d3b10ac7-serving-cert\") pod \"console-operator-68b757fb67-wwrsk\" (UID: \"ab9458b7-cc16-493e-90f5-ff72d3b10ac7\") " pod="openshift-console-operator/console-operator-68b757fb67-wwrsk" Jul 07 16:23:12.987643 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:12.987619 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tdnhv\" (UniqueName: \"kubernetes.io/projected/ab9458b7-cc16-493e-90f5-ff72d3b10ac7-kube-api-access-tdnhv\") pod \"console-operator-68b757fb67-wwrsk\" (UID: \"ab9458b7-cc16-493e-90f5-ff72d3b10ac7\") " pod="openshift-console-operator/console-operator-68b757fb67-wwrsk" Jul 07 16:23:12.988259 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:12.988235 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-8kqd8"] Jul 07 16:23:12.988355 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:12.988277 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-b65f8"] Jul 07 16:23:12.988355 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:12.988302 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-ldxhd"] Jul 07 16:23:12.988355 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:12.988317 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-dbdhv" Jul 07 16:23:12.988497 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:12.988389 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2trp\" (UniqueName: \"kubernetes.io/projected/db1a7c4e-7b26-4e89-b989-7329dca3dfcf-kube-api-access-w2trp\") pod \"cluster-monitoring-operator-64786d9cbb-8kqd8\" (UID: \"db1a7c4e-7b26-4e89-b989-7329dca3dfcf\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-8kqd8" Jul 07 16:23:12.991102 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:12.991083 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 07 16:23:12.991187 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:12.991102 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-rht7k\"" Jul 07 16:23:12.991355 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:12.991339 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 07 16:23:13.010550 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:13.010529 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-xbz57"] Jul 07 16:23:13.010670 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:13.010569 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-8dmps"] Jul 07 16:23:13.010670 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:13.010592 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-m7r46"] Jul 07 16:23:13.010670 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:13.010617 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-dbdhv"] Jul 07 16:23:13.010670 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:13.010641 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-h89k9"] Jul 07 16:23:13.010670 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:13.010658 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ldxhd"] Jul 07 16:23:13.010670 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:13.010659 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ldxhd" Jul 07 16:23:13.013735 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:13.013713 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 07 16:23:13.013841 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:13.013788 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 07 16:23:13.013949 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:13.013863 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 07 16:23:13.013949 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:13.013931 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-mlgdt\"" Jul 07 16:23:13.069486 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:13.069450 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q798q_dbfa7ead-a6a8-4536-8a8d-cbe2e2b33011/konnectivity-agent/0.log" limit=1024 Jul 07 16:23:13.071443 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:13.071425 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/71da8590-3ed3-475d-8d66-fee560bb7abc-stats-auth\") pod \"router-default-675d4b7575-sgxn7\" (UID: \"71da8590-3ed3-475d-8d66-fee560bb7abc\") " pod="openshift-ingress/router-default-675d4b7575-sgxn7" Jul 07 16:23:13.071495 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:13.071456 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7d398452-8b59-4802-b9dc-3332d2ddb17e-registry-certificates\") pod \"image-registry-647ccd66c4-52n8x\" (UID: \"7d398452-8b59-4802-b9dc-3332d2ddb17e\") " pod="openshift-image-registry/image-registry-647ccd66c4-52n8x" Jul 07 16:23:13.071495 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:13.071475 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/08d889ae-b463-46fb-a51d-8a4b59146f6c-serving-cert\") pod \"insights-operator-5c847dcfc4-b65f8\" (UID: \"08d889ae-b463-46fb-a51d-8a4b59146f6c\") " pod="openshift-insights/insights-operator-5c847dcfc4-b65f8" Jul 07 16:23:13.071620 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:13.071601 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s6cjd\" (UniqueName: \"kubernetes.io/projected/c82dfb11-b16f-4ed1-96b2-d4ab90984286-kube-api-access-s6cjd\") pod \"kube-storage-version-migrator-operator-846bf668f7-w6fqx\" (UID: \"c82dfb11-b16f-4ed1-96b2-d4ab90984286\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-w6fqx" Jul 07 16:23:13.071652 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:13.071639 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/31bd1f2b-6f2c-47cd-a0b5-0f5e1daf3038-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-xbz57\" (UID: \"31bd1f2b-6f2c-47cd-a0b5-0f5e1daf3038\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-xbz57" Jul 07 16:23:13.071729 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:13.071674 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/08d889ae-b463-46fb-a51d-8a4b59146f6c-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-b65f8\" (UID: \"08d889ae-b463-46fb-a51d-8a4b59146f6c\") " pod="openshift-insights/insights-operator-5c847dcfc4-b65f8" Jul 07 16:23:13.071771 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:23:13.071755 2552 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 07 16:23:13.071846 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:23:13.071827 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31bd1f2b-6f2c-47cd-a0b5-0f5e1daf3038-samples-operator-tls podName:31bd1f2b-6f2c-47cd-a0b5-0f5e1daf3038 nodeName:}" failed. No retries permitted until 2026-07-07 16:23:13.571807692 +0000 UTC m=+36.704773152 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/31bd1f2b-6f2c-47cd-a0b5-0f5e1daf3038-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-xbz57" (UID: "31bd1f2b-6f2c-47cd-a0b5-0f5e1daf3038") : secret "samples-operator-tls" not found Jul 07 16:23:13.071980 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:13.071856 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mfkvp\" (UniqueName: \"kubernetes.io/projected/31bd1f2b-6f2c-47cd-a0b5-0f5e1daf3038-kube-api-access-mfkvp\") pod \"cluster-samples-operator-56fcf86bf-xbz57\" (UID: \"31bd1f2b-6f2c-47cd-a0b5-0f5e1daf3038\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-xbz57" Jul 07 16:23:13.071980 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:13.071884 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c82dfb11-b16f-4ed1-96b2-d4ab90984286-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-w6fqx\" (UID: \"c82dfb11-b16f-4ed1-96b2-d4ab90984286\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-w6fqx" Jul 07 16:23:13.071980 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:13.071914 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7d398452-8b59-4802-b9dc-3332d2ddb17e-ca-trust-extracted\") pod \"image-registry-647ccd66c4-52n8x\" (UID: \"7d398452-8b59-4802-b9dc-3332d2ddb17e\") " pod="openshift-image-registry/image-registry-647ccd66c4-52n8x" Jul 07 16:23:13.072128 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:13.072064 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5098470b-c5d3-46b1-9098-8fa69aeac854-tmp-dir\") pod \"dns-default-m7r46\" (UID: \"5098470b-c5d3-46b1-9098-8fa69aeac854\") " pod="openshift-dns/dns-default-m7r46" Jul 07 16:23:13.072128 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:13.072115 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/08d889ae-b463-46fb-a51d-8a4b59146f6c-tmp\") pod \"insights-operator-5c847dcfc4-b65f8\" (UID: \"08d889ae-b463-46fb-a51d-8a4b59146f6c\") " pod="openshift-insights/insights-operator-5c847dcfc4-b65f8" Jul 07 16:23:13.072248 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:13.072161 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7d398452-8b59-4802-b9dc-3332d2ddb17e-image-registry-private-configuration\") pod \"image-registry-647ccd66c4-52n8x\" (UID: \"7d398452-8b59-4802-b9dc-3332d2ddb17e\") " pod="openshift-image-registry/image-registry-647ccd66c4-52n8x" Jul 07 16:23:13.072248 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:13.072190 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7wls2\" (UniqueName: \"kubernetes.io/projected/5098470b-c5d3-46b1-9098-8fa69aeac854-kube-api-access-7wls2\") pod \"dns-default-m7r46\" (UID: \"5098470b-c5d3-46b1-9098-8fa69aeac854\") " pod="openshift-dns/dns-default-m7r46" Jul 07 16:23:13.072358 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:13.072268 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/08d889ae-b463-46fb-a51d-8a4b59146f6c-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-b65f8\" (UID: \"08d889ae-b463-46fb-a51d-8a4b59146f6c\") " pod="openshift-insights/insights-operator-5c847dcfc4-b65f8" Jul 07 16:23:13.072358 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:13.072263 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c9428da5-4b2b-4c6a-bae9-0f0197fc5f78-config\") pod \"service-ca-operator-5d46d9ffd4-qf5bh\" (UID: \"c9428da5-4b2b-4c6a-bae9-0f0197fc5f78\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-qf5bh" Jul 07 16:23:13.072358 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:13.072323 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5098470b-c5d3-46b1-9098-8fa69aeac854-config-volume\") pod \"dns-default-m7r46\" (UID: \"5098470b-c5d3-46b1-9098-8fa69aeac854\") " pod="openshift-dns/dns-default-m7r46" Jul 07 16:23:13.072493 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:13.072384 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71da8590-3ed3-475d-8d66-fee560bb7abc-service-ca-bundle\") pod \"router-default-675d4b7575-sgxn7\" (UID: \"71da8590-3ed3-475d-8d66-fee560bb7abc\") " pod="openshift-ingress/router-default-675d4b7575-sgxn7" Jul 07 16:23:13.072493 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:13.072414 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/22ef84ce-8d9a-48e7-bfbc-36e88476ce7d-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-dbdhv\" (UID: \"22ef84ce-8d9a-48e7-bfbc-36e88476ce7d\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-dbdhv" Jul 07 16:23:13.072493 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:13.072446 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7d398452-8b59-4802-b9dc-3332d2ddb17e-bound-sa-token\") pod \"image-registry-647ccd66c4-52n8x\" (UID: \"7d398452-8b59-4802-b9dc-3332d2ddb17e\") " pod="openshift-image-registry/image-registry-647ccd66c4-52n8x" Jul 07 16:23:13.072493 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:13.072472 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txcr7\" (UniqueName: \"kubernetes.io/projected/7d398452-8b59-4802-b9dc-3332d2ddb17e-kube-api-access-txcr7\") pod \"image-registry-647ccd66c4-52n8x\" (UID: \"7d398452-8b59-4802-b9dc-3332d2ddb17e\") " pod="openshift-image-registry/image-registry-647ccd66c4-52n8x" Jul 07 16:23:13.072698 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:23:13.072532 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/71da8590-3ed3-475d-8d66-fee560bb7abc-service-ca-bundle podName:71da8590-3ed3-475d-8d66-fee560bb7abc nodeName:}" failed. No retries permitted until 2026-07-07 16:23:13.572515225 +0000 UTC m=+36.705480683 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/71da8590-3ed3-475d-8d66-fee560bb7abc-service-ca-bundle") pod "router-default-675d4b7575-sgxn7" (UID: "71da8590-3ed3-475d-8d66-fee560bb7abc") : configmap references non-existent config key: service-ca.crt Jul 07 16:23:13.072698 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:13.072598 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/08d889ae-b463-46fb-a51d-8a4b59146f6c-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-b65f8\" (UID: \"08d889ae-b463-46fb-a51d-8a4b59146f6c\") " pod="openshift-insights/insights-operator-5c847dcfc4-b65f8" Jul 07 16:23:13.072698 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:13.072629 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tpjhr\" (UniqueName: \"kubernetes.io/projected/0f883f61-9d94-4285-9727-6da359ad2938-kube-api-access-tpjhr\") pod \"network-check-source-989f8b8dc-8dmps\" (UID: \"0f883f61-9d94-4285-9727-6da359ad2938\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-8dmps" Jul 07 16:23:13.072698 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:13.072671 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/08d889ae-b463-46fb-a51d-8a4b59146f6c-snapshots\") pod \"insights-operator-5c847dcfc4-b65f8\" (UID: \"08d889ae-b463-46fb-a51d-8a4b59146f6c\") " pod="openshift-insights/insights-operator-5c847dcfc4-b65f8" Jul 07 16:23:13.072889 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:13.072701 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7rn7n\" (UniqueName: \"kubernetes.io/projected/08d889ae-b463-46fb-a51d-8a4b59146f6c-kube-api-access-7rn7n\") pod \"insights-operator-5c847dcfc4-b65f8\" (UID: \"08d889ae-b463-46fb-a51d-8a4b59146f6c\") " pod="openshift-insights/insights-operator-5c847dcfc4-b65f8" Jul 07 16:23:13.072889 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:13.072730 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7d398452-8b59-4802-b9dc-3332d2ddb17e-registry-tls\") pod \"image-registry-647ccd66c4-52n8x\" (UID: \"7d398452-8b59-4802-b9dc-3332d2ddb17e\") " pod="openshift-image-registry/image-registry-647ccd66c4-52n8x" Jul 07 16:23:13.072889 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:13.072754 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5098470b-c5d3-46b1-9098-8fa69aeac854-metrics-tls\") pod \"dns-default-m7r46\" (UID: \"5098470b-c5d3-46b1-9098-8fa69aeac854\") " pod="openshift-dns/dns-default-m7r46" Jul 07 16:23:13.072889 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:13.072789 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/22ef84ce-8d9a-48e7-bfbc-36e88476ce7d-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-dbdhv\" (UID: \"22ef84ce-8d9a-48e7-bfbc-36e88476ce7d\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-dbdhv" Jul 07 16:23:13.072889 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:13.072810 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c9428da5-4b2b-4c6a-bae9-0f0197fc5f78-config\") pod \"service-ca-operator-5d46d9ffd4-qf5bh\" (UID: \"c9428da5-4b2b-4c6a-bae9-0f0197fc5f78\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-qf5bh" Jul 07 16:23:13.072889 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:13.072832 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/71da8590-3ed3-475d-8d66-fee560bb7abc-default-certificate\") pod \"router-default-675d4b7575-sgxn7\" (UID: \"71da8590-3ed3-475d-8d66-fee560bb7abc\") " pod="openshift-ingress/router-default-675d4b7575-sgxn7" Jul 07 16:23:13.072889 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:13.072858 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c82dfb11-b16f-4ed1-96b2-d4ab90984286-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-w6fqx\" (UID: \"c82dfb11-b16f-4ed1-96b2-d4ab90984286\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-w6fqx" Jul 07 16:23:13.072889 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:13.072883 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7d398452-8b59-4802-b9dc-3332d2ddb17e-trusted-ca\") pod \"image-registry-647ccd66c4-52n8x\" (UID: \"7d398452-8b59-4802-b9dc-3332d2ddb17e\") " pod="openshift-image-registry/image-registry-647ccd66c4-52n8x" Jul 07 16:23:13.073299 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:13.073238 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/71da8590-3ed3-475d-8d66-fee560bb7abc-metrics-certs\") pod \"router-default-675d4b7575-sgxn7\" (UID: \"71da8590-3ed3-475d-8d66-fee560bb7abc\") " pod="openshift-ingress/router-default-675d4b7575-sgxn7" Jul 07 16:23:13.073299 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:13.073275 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7d398452-8b59-4802-b9dc-3332d2ddb17e-installation-pull-secrets\") pod \"image-registry-647ccd66c4-52n8x\" (UID: \"7d398452-8b59-4802-b9dc-3332d2ddb17e\") " pod="openshift-image-registry/image-registry-647ccd66c4-52n8x" Jul 07 16:23:13.073394 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:13.073299 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/08d889ae-b463-46fb-a51d-8a4b59146f6c-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-b65f8\" (UID: \"08d889ae-b463-46fb-a51d-8a4b59146f6c\") " pod="openshift-insights/insights-operator-5c847dcfc4-b65f8" Jul 07 16:23:13.073394 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:13.073307 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fhvnr\" (UniqueName: \"kubernetes.io/projected/c9428da5-4b2b-4c6a-bae9-0f0197fc5f78-kube-api-access-fhvnr\") pod \"service-ca-operator-5d46d9ffd4-qf5bh\" (UID: \"c9428da5-4b2b-4c6a-bae9-0f0197fc5f78\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-qf5bh" Jul 07 16:23:13.073394 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:13.073337 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jksxj\" (UniqueName: \"kubernetes.io/projected/814d6546-b617-485a-aa09-7c0ce8a65af0-kube-api-access-jksxj\") pod \"volume-data-source-validator-5d456fdbcd-h89k9\" (UID: \"814d6546-b617-485a-aa09-7c0ce8a65af0\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-h89k9" Jul 07 16:23:13.073538 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:13.073398 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c9428da5-4b2b-4c6a-bae9-0f0197fc5f78-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-qf5bh\" (UID: \"c9428da5-4b2b-4c6a-bae9-0f0197fc5f78\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-qf5bh" Jul 07 16:23:13.073538 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:23:13.073419 2552 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 07 16:23:13.073538 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:13.073431 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tl8ld\" (UniqueName: \"kubernetes.io/projected/71da8590-3ed3-475d-8d66-fee560bb7abc-kube-api-access-tl8ld\") pod \"router-default-675d4b7575-sgxn7\" (UID: \"71da8590-3ed3-475d-8d66-fee560bb7abc\") " pod="openshift-ingress/router-default-675d4b7575-sgxn7" Jul 07 16:23:13.073538 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:23:13.073492 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71da8590-3ed3-475d-8d66-fee560bb7abc-metrics-certs podName:71da8590-3ed3-475d-8d66-fee560bb7abc nodeName:}" failed. No retries permitted until 2026-07-07 16:23:13.573476239 +0000 UTC m=+36.706441694 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/71da8590-3ed3-475d-8d66-fee560bb7abc-metrics-certs") pod "router-default-675d4b7575-sgxn7" (UID: "71da8590-3ed3-475d-8d66-fee560bb7abc") : secret "router-metrics-certs-default" not found Jul 07 16:23:13.073720 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:13.073540 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c82dfb11-b16f-4ed1-96b2-d4ab90984286-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-w6fqx\" (UID: \"c82dfb11-b16f-4ed1-96b2-d4ab90984286\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-w6fqx" Jul 07 16:23:13.074494 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:13.074466 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/08d889ae-b463-46fb-a51d-8a4b59146f6c-serving-cert\") pod \"insights-operator-5c847dcfc4-b65f8\" (UID: \"08d889ae-b463-46fb-a51d-8a4b59146f6c\") " pod="openshift-insights/insights-operator-5c847dcfc4-b65f8" Jul 07 16:23:13.074584 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:13.074565 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/71da8590-3ed3-475d-8d66-fee560bb7abc-stats-auth\") pod \"router-default-675d4b7575-sgxn7\" (UID: \"71da8590-3ed3-475d-8d66-fee560bb7abc\") " pod="openshift-ingress/router-default-675d4b7575-sgxn7" Jul 07 16:23:13.074658 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:13.074638 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c82dfb11-b16f-4ed1-96b2-d4ab90984286-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-w6fqx\" (UID: \"c82dfb11-b16f-4ed1-96b2-d4ab90984286\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-w6fqx" Jul 07 16:23:13.075575 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:13.075554 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c9428da5-4b2b-4c6a-bae9-0f0197fc5f78-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-qf5bh\" (UID: \"c9428da5-4b2b-4c6a-bae9-0f0197fc5f78\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-qf5bh" Jul 07 16:23:13.075651 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:13.075599 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/71da8590-3ed3-475d-8d66-fee560bb7abc-default-certificate\") pod \"router-default-675d4b7575-sgxn7\" (UID: \"71da8590-3ed3-475d-8d66-fee560bb7abc\") " pod="openshift-ingress/router-default-675d4b7575-sgxn7" Jul 07 16:23:13.078075 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:13.078044 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/08d889ae-b463-46fb-a51d-8a4b59146f6c-tmp\") pod \"insights-operator-5c847dcfc4-b65f8\" (UID: \"08d889ae-b463-46fb-a51d-8a4b59146f6c\") " pod="openshift-insights/insights-operator-5c847dcfc4-b65f8" Jul 07 16:23:13.078306 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:13.078292 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/08d889ae-b463-46fb-a51d-8a4b59146f6c-snapshots\") pod \"insights-operator-5c847dcfc4-b65f8\" (UID: \"08d889ae-b463-46fb-a51d-8a4b59146f6c\") " pod="openshift-insights/insights-operator-5c847dcfc4-b65f8" Jul 07 16:23:13.082851 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:13.082797 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s6cjd\" (UniqueName: \"kubernetes.io/projected/c82dfb11-b16f-4ed1-96b2-d4ab90984286-kube-api-access-s6cjd\") pod \"kube-storage-version-migrator-operator-846bf668f7-w6fqx\" (UID: \"c82dfb11-b16f-4ed1-96b2-d4ab90984286\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-w6fqx" Jul 07 16:23:13.083504 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:13.083451 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mfkvp\" (UniqueName: \"kubernetes.io/projected/31bd1f2b-6f2c-47cd-a0b5-0f5e1daf3038-kube-api-access-mfkvp\") pod \"cluster-samples-operator-56fcf86bf-xbz57\" (UID: \"31bd1f2b-6f2c-47cd-a0b5-0f5e1daf3038\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-xbz57" Jul 07 16:23:13.083883 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:13.083861 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fhvnr\" (UniqueName: \"kubernetes.io/projected/c9428da5-4b2b-4c6a-bae9-0f0197fc5f78-kube-api-access-fhvnr\") pod \"service-ca-operator-5d46d9ffd4-qf5bh\" (UID: \"c9428da5-4b2b-4c6a-bae9-0f0197fc5f78\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-qf5bh" Jul 07 16:23:13.084934 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:13.084913 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tl8ld\" (UniqueName: \"kubernetes.io/projected/71da8590-3ed3-475d-8d66-fee560bb7abc-kube-api-access-tl8ld\") pod \"router-default-675d4b7575-sgxn7\" (UID: \"71da8590-3ed3-475d-8d66-fee560bb7abc\") " pod="openshift-ingress/router-default-675d4b7575-sgxn7" Jul 07 16:23:13.085479 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:13.085460 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7rn7n\" (UniqueName: \"kubernetes.io/projected/08d889ae-b463-46fb-a51d-8a4b59146f6c-kube-api-access-7rn7n\") pod \"insights-operator-5c847dcfc4-b65f8\" (UID: \"08d889ae-b463-46fb-a51d-8a4b59146f6c\") " pod="openshift-insights/insights-operator-5c847dcfc4-b65f8" Jul 07 16:23:13.090267 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:13.090247 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-wwrsk" Jul 07 16:23:13.140170 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:13.140136 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-qf5bh" Jul 07 16:23:13.161264 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:13.161212 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-w6fqx" Jul 07 16:23:13.174470 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:13.174367 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7d398452-8b59-4802-b9dc-3332d2ddb17e-image-registry-private-configuration\") pod \"image-registry-647ccd66c4-52n8x\" (UID: \"7d398452-8b59-4802-b9dc-3332d2ddb17e\") " pod="openshift-image-registry/image-registry-647ccd66c4-52n8x" Jul 07 16:23:13.174470 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:13.174423 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7wls2\" (UniqueName: \"kubernetes.io/projected/5098470b-c5d3-46b1-9098-8fa69aeac854-kube-api-access-7wls2\") pod \"dns-default-m7r46\" (UID: \"5098470b-c5d3-46b1-9098-8fa69aeac854\") " pod="openshift-dns/dns-default-m7r46" Jul 07 16:23:13.174685 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:13.174514 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5098470b-c5d3-46b1-9098-8fa69aeac854-config-volume\") pod \"dns-default-m7r46\" (UID: \"5098470b-c5d3-46b1-9098-8fa69aeac854\") " pod="openshift-dns/dns-default-m7r46" Jul 07 16:23:13.174685 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:13.174557 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/22ef84ce-8d9a-48e7-bfbc-36e88476ce7d-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-dbdhv\" (UID: \"22ef84ce-8d9a-48e7-bfbc-36e88476ce7d\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-dbdhv" Jul 07 16:23:13.174685 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:13.174583 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7d398452-8b59-4802-b9dc-3332d2ddb17e-bound-sa-token\") pod \"image-registry-647ccd66c4-52n8x\" (UID: \"7d398452-8b59-4802-b9dc-3332d2ddb17e\") " pod="openshift-image-registry/image-registry-647ccd66c4-52n8x" Jul 07 16:23:13.174685 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:13.174606 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txcr7\" (UniqueName: \"kubernetes.io/projected/7d398452-8b59-4802-b9dc-3332d2ddb17e-kube-api-access-txcr7\") pod \"image-registry-647ccd66c4-52n8x\" (UID: \"7d398452-8b59-4802-b9dc-3332d2ddb17e\") " pod="openshift-image-registry/image-registry-647ccd66c4-52n8x" Jul 07 16:23:13.174685 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:13.174633 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqm48\" (UniqueName: \"kubernetes.io/projected/e7cc3519-81dc-49db-b07a-9f26d9b1dd36-kube-api-access-vqm48\") pod \"ingress-canary-ldxhd\" (UID: \"e7cc3519-81dc-49db-b07a-9f26d9b1dd36\") " pod="openshift-ingress-canary/ingress-canary-ldxhd" Jul 07 16:23:13.174685 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:13.174676 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tpjhr\" (UniqueName: \"kubernetes.io/projected/0f883f61-9d94-4285-9727-6da359ad2938-kube-api-access-tpjhr\") pod \"network-check-source-989f8b8dc-8dmps\" (UID: \"0f883f61-9d94-4285-9727-6da359ad2938\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-8dmps" Jul 07 16:23:13.174978 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:13.174727 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7d398452-8b59-4802-b9dc-3332d2ddb17e-registry-tls\") pod \"image-registry-647ccd66c4-52n8x\" (UID: \"7d398452-8b59-4802-b9dc-3332d2ddb17e\") " pod="openshift-image-registry/image-registry-647ccd66c4-52n8x" Jul 07 16:23:13.174978 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:13.174768 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5098470b-c5d3-46b1-9098-8fa69aeac854-metrics-tls\") pod \"dns-default-m7r46\" (UID: \"5098470b-c5d3-46b1-9098-8fa69aeac854\") " pod="openshift-dns/dns-default-m7r46" Jul 07 16:23:13.174978 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:13.174800 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/22ef84ce-8d9a-48e7-bfbc-36e88476ce7d-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-dbdhv\" (UID: \"22ef84ce-8d9a-48e7-bfbc-36e88476ce7d\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-dbdhv" Jul 07 16:23:13.174978 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:13.174845 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7d398452-8b59-4802-b9dc-3332d2ddb17e-trusted-ca\") pod \"image-registry-647ccd66c4-52n8x\" (UID: \"7d398452-8b59-4802-b9dc-3332d2ddb17e\") " pod="openshift-image-registry/image-registry-647ccd66c4-52n8x" Jul 07 16:23:13.174978 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:13.174883 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7d398452-8b59-4802-b9dc-3332d2ddb17e-installation-pull-secrets\") pod \"image-registry-647ccd66c4-52n8x\" (UID: \"7d398452-8b59-4802-b9dc-3332d2ddb17e\") " pod="openshift-image-registry/image-registry-647ccd66c4-52n8x" Jul 07 16:23:13.174978 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:13.174974 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jksxj\" (UniqueName: \"kubernetes.io/projected/814d6546-b617-485a-aa09-7c0ce8a65af0-kube-api-access-jksxj\") pod \"volume-data-source-validator-5d456fdbcd-h89k9\" (UID: \"814d6546-b617-485a-aa09-7c0ce8a65af0\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-h89k9" Jul 07 16:23:13.175264 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:23:13.175141 2552 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 16:23:13.175921 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:23:13.175673 2552 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-647ccd66c4-52n8x: secret "image-registry-tls" not found Jul 07 16:23:13.178002 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:13.176607 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/22ef84ce-8d9a-48e7-bfbc-36e88476ce7d-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-dbdhv\" (UID: \"22ef84ce-8d9a-48e7-bfbc-36e88476ce7d\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-dbdhv" Jul 07 16:23:13.178002 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:13.176864 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5098470b-c5d3-46b1-9098-8fa69aeac854-config-volume\") pod \"dns-default-m7r46\" (UID: \"5098470b-c5d3-46b1-9098-8fa69aeac854\") " pod="openshift-dns/dns-default-m7r46" Jul 07 16:23:13.178002 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:23:13.176934 2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 16:23:13.178002 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:13.177006 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e7cc3519-81dc-49db-b07a-9f26d9b1dd36-cert\") pod \"ingress-canary-ldxhd\" (UID: \"e7cc3519-81dc-49db-b07a-9f26d9b1dd36\") " pod="openshift-ingress-canary/ingress-canary-ldxhd" Jul 07 16:23:13.178002 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:13.177078 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7d398452-8b59-4802-b9dc-3332d2ddb17e-registry-certificates\") pod \"image-registry-647ccd66c4-52n8x\" (UID: \"7d398452-8b59-4802-b9dc-3332d2ddb17e\") " pod="openshift-image-registry/image-registry-647ccd66c4-52n8x" Jul 07 16:23:13.178002 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:13.177188 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7d398452-8b59-4802-b9dc-3332d2ddb17e-ca-trust-extracted\") pod \"image-registry-647ccd66c4-52n8x\" (UID: \"7d398452-8b59-4802-b9dc-3332d2ddb17e\") " pod="openshift-image-registry/image-registry-647ccd66c4-52n8x" Jul 07 16:23:13.178002 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:13.177242 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5098470b-c5d3-46b1-9098-8fa69aeac854-tmp-dir\") pod \"dns-default-m7r46\" (UID: \"5098470b-c5d3-46b1-9098-8fa69aeac854\") " pod="openshift-dns/dns-default-m7r46" Jul 07 16:23:13.178002 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:13.177565 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5098470b-c5d3-46b1-9098-8fa69aeac854-tmp-dir\") pod \"dns-default-m7r46\" (UID: \"5098470b-c5d3-46b1-9098-8fa69aeac854\") " pod="openshift-dns/dns-default-m7r46" Jul 07 16:23:13.178002 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:13.177872 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7d398452-8b59-4802-b9dc-3332d2ddb17e-ca-trust-extracted\") pod \"image-registry-647ccd66c4-52n8x\" (UID: \"7d398452-8b59-4802-b9dc-3332d2ddb17e\") " pod="openshift-image-registry/image-registry-647ccd66c4-52n8x" Jul 07 16:23:13.178002 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:23:13.177924 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7d398452-8b59-4802-b9dc-3332d2ddb17e-registry-tls podName:7d398452-8b59-4802-b9dc-3332d2ddb17e nodeName:}" failed. No retries permitted until 2026-07-07 16:23:13.677902793 +0000 UTC m=+36.810868237 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7d398452-8b59-4802-b9dc-3332d2ddb17e-registry-tls") pod "image-registry-647ccd66c4-52n8x" (UID: "7d398452-8b59-4802-b9dc-3332d2ddb17e") : secret "image-registry-tls" not found Jul 07 16:23:13.178002 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:23:13.177955 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5098470b-c5d3-46b1-9098-8fa69aeac854-metrics-tls podName:5098470b-c5d3-46b1-9098-8fa69aeac854 nodeName:}" failed. No retries permitted until 2026-07-07 16:23:13.677944604 +0000 UTC m=+36.810910052 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5098470b-c5d3-46b1-9098-8fa69aeac854-metrics-tls") pod "dns-default-m7r46" (UID: "5098470b-c5d3-46b1-9098-8fa69aeac854") : secret "dns-default-metrics-tls" not found Jul 07 16:23:13.178712 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:13.177847 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7d398452-8b59-4802-b9dc-3332d2ddb17e-registry-certificates\") pod \"image-registry-647ccd66c4-52n8x\" (UID: \"7d398452-8b59-4802-b9dc-3332d2ddb17e\") " pod="openshift-image-registry/image-registry-647ccd66c4-52n8x" Jul 07 16:23:13.179020 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:13.178969 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7d398452-8b59-4802-b9dc-3332d2ddb17e-image-registry-private-configuration\") pod \"image-registry-647ccd66c4-52n8x\" (UID: \"7d398452-8b59-4802-b9dc-3332d2ddb17e\") " pod="openshift-image-registry/image-registry-647ccd66c4-52n8x" Jul 07 16:23:13.179020 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:23:13.179017 2552 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 07 16:23:13.179184 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:23:13.179086 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/22ef84ce-8d9a-48e7-bfbc-36e88476ce7d-networking-console-plugin-cert podName:22ef84ce-8d9a-48e7-bfbc-36e88476ce7d nodeName:}" failed. No retries permitted until 2026-07-07 16:23:13.679069064 +0000 UTC m=+36.812034504 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/22ef84ce-8d9a-48e7-bfbc-36e88476ce7d-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-dbdhv" (UID: "22ef84ce-8d9a-48e7-bfbc-36e88476ce7d") : secret "networking-console-plugin-cert" not found Jul 07 16:23:13.185072 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:13.183828 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-b65f8" Jul 07 16:23:13.185072 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:13.184259 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7d398452-8b59-4802-b9dc-3332d2ddb17e-trusted-ca\") pod \"image-registry-647ccd66c4-52n8x\" (UID: \"7d398452-8b59-4802-b9dc-3332d2ddb17e\") " pod="openshift-image-registry/image-registry-647ccd66c4-52n8x" Jul 07 16:23:13.190757 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:13.190697 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7d398452-8b59-4802-b9dc-3332d2ddb17e-bound-sa-token\") pod \"image-registry-647ccd66c4-52n8x\" (UID: \"7d398452-8b59-4802-b9dc-3332d2ddb17e\") " pod="openshift-image-registry/image-registry-647ccd66c4-52n8x" Jul 07 16:23:13.191149 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:13.191122 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7d398452-8b59-4802-b9dc-3332d2ddb17e-installation-pull-secrets\") pod \"image-registry-647ccd66c4-52n8x\" (UID: \"7d398452-8b59-4802-b9dc-3332d2ddb17e\") " pod="openshift-image-registry/image-registry-647ccd66c4-52n8x" Jul 07 16:23:13.191464 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:13.191421 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7wls2\" (UniqueName: \"kubernetes.io/projected/5098470b-c5d3-46b1-9098-8fa69aeac854-kube-api-access-7wls2\") pod \"dns-default-m7r46\" (UID: \"5098470b-c5d3-46b1-9098-8fa69aeac854\") " pod="openshift-dns/dns-default-m7r46" Jul 07 16:23:13.192255 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:13.192229 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tpjhr\" (UniqueName: \"kubernetes.io/projected/0f883f61-9d94-4285-9727-6da359ad2938-kube-api-access-tpjhr\") pod \"network-check-source-989f8b8dc-8dmps\" (UID: \"0f883f61-9d94-4285-9727-6da359ad2938\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-8dmps" Jul 07 16:23:13.192940 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:13.192899 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-txcr7\" (UniqueName: \"kubernetes.io/projected/7d398452-8b59-4802-b9dc-3332d2ddb17e-kube-api-access-txcr7\") pod \"image-registry-647ccd66c4-52n8x\" (UID: \"7d398452-8b59-4802-b9dc-3332d2ddb17e\") " pod="openshift-image-registry/image-registry-647ccd66c4-52n8x" Jul 07 16:23:13.195155 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:13.194571 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jksxj\" (UniqueName: \"kubernetes.io/projected/814d6546-b617-485a-aa09-7c0ce8a65af0-kube-api-access-jksxj\") pod \"volume-data-source-validator-5d456fdbcd-h89k9\" (UID: \"814d6546-b617-485a-aa09-7c0ce8a65af0\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-h89k9" Jul 07 16:23:13.256177 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:13.255712 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-8dmps" Jul 07 16:23:13.280736 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:13.279770 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e7cc3519-81dc-49db-b07a-9f26d9b1dd36-cert\") pod \"ingress-canary-ldxhd\" (UID: \"e7cc3519-81dc-49db-b07a-9f26d9b1dd36\") " pod="openshift-ingress-canary/ingress-canary-ldxhd" Jul 07 16:23:13.280736 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:13.279901 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqm48\" (UniqueName: \"kubernetes.io/projected/e7cc3519-81dc-49db-b07a-9f26d9b1dd36-kube-api-access-vqm48\") pod \"ingress-canary-ldxhd\" (UID: \"e7cc3519-81dc-49db-b07a-9f26d9b1dd36\") " pod="openshift-ingress-canary/ingress-canary-ldxhd" Jul 07 16:23:13.288721 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:13.284365 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e7cc3519-81dc-49db-b07a-9f26d9b1dd36-cert\") pod \"ingress-canary-ldxhd\" (UID: \"e7cc3519-81dc-49db-b07a-9f26d9b1dd36\") " pod="openshift-ingress-canary/ingress-canary-ldxhd" Jul 07 16:23:13.288721 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:13.284455 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-h89k9" Jul 07 16:23:13.293550 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:13.292816 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqm48\" (UniqueName: \"kubernetes.io/projected/e7cc3519-81dc-49db-b07a-9f26d9b1dd36-kube-api-access-vqm48\") pod \"ingress-canary-ldxhd\" (UID: \"e7cc3519-81dc-49db-b07a-9f26d9b1dd36\") " pod="openshift-ingress-canary/ingress-canary-ldxhd" Jul 07 16:23:13.303705 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:13.300457 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-wwrsk"] Jul 07 16:23:13.310894 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:23:13.310861 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab9458b7_cc16_493e_90f5_ff72d3b10ac7.slice/crio-66c3075a9fc63052751c76801c8cc79fb63068b9c2c6fee6ec011ab803763ba9 WatchSource:0}: Error finding container 66c3075a9fc63052751c76801c8cc79fb63068b9c2c6fee6ec011ab803763ba9: Status 404 returned error can't find the container with id 66c3075a9fc63052751c76801c8cc79fb63068b9c2c6fee6ec011ab803763ba9 Jul 07 16:23:13.321660 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:13.321602 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ldxhd" Jul 07 16:23:13.360740 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:13.360702 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-qf5bh"] Jul 07 16:23:13.364955 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:23:13.364925 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9428da5_4b2b_4c6a_bae9_0f0197fc5f78.slice/crio-e44fc97d11797c51de1ebe900a789ef08462d7d0dbb8e7c79329022505f97705 WatchSource:0}: Error finding container e44fc97d11797c51de1ebe900a789ef08462d7d0dbb8e7c79329022505f97705: Status 404 returned error can't find the container with id e44fc97d11797c51de1ebe900a789ef08462d7d0dbb8e7c79329022505f97705 Jul 07 16:23:13.369111 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:13.368529 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-w6fqx"] Jul 07 16:23:13.376076 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:23:13.376042 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc82dfb11_b16f_4ed1_96b2_d4ab90984286.slice/crio-131595a35fecd616a4d078c9287f4e76f03ed0c6894d507ce7dd21a153bd766d WatchSource:0}: Error finding container 131595a35fecd616a4d078c9287f4e76f03ed0c6894d507ce7dd21a153bd766d: Status 404 returned error can't find the container with id 131595a35fecd616a4d078c9287f4e76f03ed0c6894d507ce7dd21a153bd766d Jul 07 16:23:13.400458 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:13.399433 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-b65f8"] Jul 07 16:23:13.406305 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:23:13.406103 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08d889ae_b463_46fb_a51d_8a4b59146f6c.slice/crio-32efc05cbdfd2d653f216575e9379e95eab8774c13d6525e48bc5761c19ac80b WatchSource:0}: Error finding container 32efc05cbdfd2d653f216575e9379e95eab8774c13d6525e48bc5761c19ac80b: Status 404 returned error can't find the container with id 32efc05cbdfd2d653f216575e9379e95eab8774c13d6525e48bc5761c19ac80b Jul 07 16:23:13.435597 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:13.435121 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8qbxw" Jul 07 16:23:13.439331 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:13.439307 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 07 16:23:13.480399 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:13.480233 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-8dmps"] Jul 07 16:23:13.482251 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:13.482220 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/db1a7c4e-7b26-4e89-b989-7329dca3dfcf-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-8kqd8\" (UID: \"db1a7c4e-7b26-4e89-b989-7329dca3dfcf\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-8kqd8" Jul 07 16:23:13.482362 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:23:13.482340 2552 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 07 16:23:13.482437 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:23:13.482424 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db1a7c4e-7b26-4e89-b989-7329dca3dfcf-cluster-monitoring-operator-tls podName:db1a7c4e-7b26-4e89-b989-7329dca3dfcf nodeName:}" failed. No retries permitted until 2026-07-07 16:23:14.482404172 +0000 UTC m=+37.615369626 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/db1a7c4e-7b26-4e89-b989-7329dca3dfcf-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-8kqd8" (UID: "db1a7c4e-7b26-4e89-b989-7329dca3dfcf") : secret "cluster-monitoring-operator-tls" not found Jul 07 16:23:13.483908 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:23:13.483875 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f883f61_9d94_4285_9727_6da359ad2938.slice/crio-d5643dcee7799b591358f42e9d4bcf24a0c58a3282d26f62fdfc545a659abd57 WatchSource:0}: Error finding container d5643dcee7799b591358f42e9d4bcf24a0c58a3282d26f62fdfc545a659abd57: Status 404 returned error can't find the container with id d5643dcee7799b591358f42e9d4bcf24a0c58a3282d26f62fdfc545a659abd57 Jul 07 16:23:13.485551 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:13.485530 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-h89k9"] Jul 07 16:23:13.487954 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:23:13.487919 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod814d6546_b617_485a_aa09_7c0ce8a65af0.slice/crio-830c78acb91c3687e9f485581276b0ce7d99b04cfc1186e992e71764c0860eec WatchSource:0}: Error finding container 830c78acb91c3687e9f485581276b0ce7d99b04cfc1186e992e71764c0860eec: Status 404 returned error can't find the container with id 830c78acb91c3687e9f485581276b0ce7d99b04cfc1186e992e71764c0860eec Jul 07 16:23:13.511672 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:13.511650 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ldxhd"] Jul 07 16:23:13.513783 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:23:13.513762 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7cc3519_81dc_49db_b07a_9f26d9b1dd36.slice/crio-b951738cd80f216bdb783b400eeae06bcaf247ec4b3d9c37071fe89fc375914e WatchSource:0}: Error finding container b951738cd80f216bdb783b400eeae06bcaf247ec4b3d9c37071fe89fc375914e: Status 404 returned error can't find the container with id b951738cd80f216bdb783b400eeae06bcaf247ec4b3d9c37071fe89fc375914e Jul 07 16:23:13.583695 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:13.583633 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71da8590-3ed3-475d-8d66-fee560bb7abc-service-ca-bundle\") pod \"router-default-675d4b7575-sgxn7\" (UID: \"71da8590-3ed3-475d-8d66-fee560bb7abc\") " pod="openshift-ingress/router-default-675d4b7575-sgxn7" Jul 07 16:23:13.583930 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:23:13.583833 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/71da8590-3ed3-475d-8d66-fee560bb7abc-service-ca-bundle podName:71da8590-3ed3-475d-8d66-fee560bb7abc nodeName:}" failed. No retries permitted until 2026-07-07 16:23:14.583813014 +0000 UTC m=+37.716778475 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/71da8590-3ed3-475d-8d66-fee560bb7abc-service-ca-bundle") pod "router-default-675d4b7575-sgxn7" (UID: "71da8590-3ed3-475d-8d66-fee560bb7abc") : configmap references non-existent config key: service-ca.crt Jul 07 16:23:13.583930 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:13.583900 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/71da8590-3ed3-475d-8d66-fee560bb7abc-metrics-certs\") pod \"router-default-675d4b7575-sgxn7\" (UID: \"71da8590-3ed3-475d-8d66-fee560bb7abc\") " pod="openshift-ingress/router-default-675d4b7575-sgxn7" Jul 07 16:23:13.584057 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:13.583959 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/31bd1f2b-6f2c-47cd-a0b5-0f5e1daf3038-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-xbz57\" (UID: \"31bd1f2b-6f2c-47cd-a0b5-0f5e1daf3038\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-xbz57" Jul 07 16:23:13.584107 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:23:13.584078 2552 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 07 16:23:13.584151 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:23:13.584119 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31bd1f2b-6f2c-47cd-a0b5-0f5e1daf3038-samples-operator-tls podName:31bd1f2b-6f2c-47cd-a0b5-0f5e1daf3038 nodeName:}" failed. No retries permitted until 2026-07-07 16:23:14.584105492 +0000 UTC m=+37.717070930 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/31bd1f2b-6f2c-47cd-a0b5-0f5e1daf3038-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-xbz57" (UID: "31bd1f2b-6f2c-47cd-a0b5-0f5e1daf3038") : secret "samples-operator-tls" not found Jul 07 16:23:13.584290 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:23:13.584171 2552 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 07 16:23:13.584290 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:23:13.584233 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71da8590-3ed3-475d-8d66-fee560bb7abc-metrics-certs podName:71da8590-3ed3-475d-8d66-fee560bb7abc nodeName:}" failed. No retries permitted until 2026-07-07 16:23:14.584219977 +0000 UTC m=+37.717185414 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/71da8590-3ed3-475d-8d66-fee560bb7abc-metrics-certs") pod "router-default-675d4b7575-sgxn7" (UID: "71da8590-3ed3-475d-8d66-fee560bb7abc") : secret "router-metrics-certs-default" not found Jul 07 16:23:13.649399 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:13.649359 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-w6fqx" event={"ID":"c82dfb11-b16f-4ed1-96b2-d4ab90984286","Type":"ContainerStarted","Data":"131595a35fecd616a4d078c9287f4e76f03ed0c6894d507ce7dd21a153bd766d"} Jul 07 16:23:13.650624 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:13.650598 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-qf5bh" event={"ID":"c9428da5-4b2b-4c6a-bae9-0f0197fc5f78","Type":"ContainerStarted","Data":"e44fc97d11797c51de1ebe900a789ef08462d7d0dbb8e7c79329022505f97705"} Jul 07 16:23:13.651880 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:13.651821 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-8dmps" event={"ID":"0f883f61-9d94-4285-9727-6da359ad2938","Type":"ContainerStarted","Data":"d5643dcee7799b591358f42e9d4bcf24a0c58a3282d26f62fdfc545a659abd57"} Jul 07 16:23:13.653016 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:13.652994 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-b65f8" event={"ID":"08d889ae-b463-46fb-a51d-8a4b59146f6c","Type":"ContainerStarted","Data":"32efc05cbdfd2d653f216575e9379e95eab8774c13d6525e48bc5761c19ac80b"} Jul 07 16:23:13.654191 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:13.654169 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-h89k9" event={"ID":"814d6546-b617-485a-aa09-7c0ce8a65af0","Type":"ContainerStarted","Data":"830c78acb91c3687e9f485581276b0ce7d99b04cfc1186e992e71764c0860eec"} Jul 07 16:23:13.655395 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:13.655372 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ldxhd" event={"ID":"e7cc3519-81dc-49db-b07a-9f26d9b1dd36","Type":"ContainerStarted","Data":"b951738cd80f216bdb783b400eeae06bcaf247ec4b3d9c37071fe89fc375914e"} Jul 07 16:23:13.656418 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:13.656401 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-wwrsk" event={"ID":"ab9458b7-cc16-493e-90f5-ff72d3b10ac7","Type":"ContainerStarted","Data":"66c3075a9fc63052751c76801c8cc79fb63068b9c2c6fee6ec011ab803763ba9"} Jul 07 16:23:13.684939 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:13.684919 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7d398452-8b59-4802-b9dc-3332d2ddb17e-registry-tls\") pod \"image-registry-647ccd66c4-52n8x\" (UID: \"7d398452-8b59-4802-b9dc-3332d2ddb17e\") " pod="openshift-image-registry/image-registry-647ccd66c4-52n8x" Jul 07 16:23:13.685482 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:13.684944 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5098470b-c5d3-46b1-9098-8fa69aeac854-metrics-tls\") pod \"dns-default-m7r46\" (UID: \"5098470b-c5d3-46b1-9098-8fa69aeac854\") " pod="openshift-dns/dns-default-m7r46" Jul 07 16:23:13.685482 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:13.684963 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/22ef84ce-8d9a-48e7-bfbc-36e88476ce7d-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-dbdhv\" (UID: \"22ef84ce-8d9a-48e7-bfbc-36e88476ce7d\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-dbdhv" Jul 07 16:23:13.685482 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:23:13.685067 2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 16:23:13.685482 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:23:13.685118 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5098470b-c5d3-46b1-9098-8fa69aeac854-metrics-tls podName:5098470b-c5d3-46b1-9098-8fa69aeac854 nodeName:}" failed. No retries permitted until 2026-07-07 16:23:14.685104739 +0000 UTC m=+37.818070179 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5098470b-c5d3-46b1-9098-8fa69aeac854-metrics-tls") pod "dns-default-m7r46" (UID: "5098470b-c5d3-46b1-9098-8fa69aeac854") : secret "dns-default-metrics-tls" not found Jul 07 16:23:13.685482 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:23:13.685069 2552 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 16:23:13.685482 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:23:13.685164 2552 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-647ccd66c4-52n8x: secret "image-registry-tls" not found Jul 07 16:23:13.685482 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:23:13.685219 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7d398452-8b59-4802-b9dc-3332d2ddb17e-registry-tls podName:7d398452-8b59-4802-b9dc-3332d2ddb17e nodeName:}" failed. No retries permitted until 2026-07-07 16:23:14.685190318 +0000 UTC m=+37.818155770 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7d398452-8b59-4802-b9dc-3332d2ddb17e-registry-tls") pod "image-registry-647ccd66c4-52n8x" (UID: "7d398452-8b59-4802-b9dc-3332d2ddb17e") : secret "image-registry-tls" not found Jul 07 16:23:13.685482 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:23:13.685073 2552 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 07 16:23:13.685482 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:23:13.685273 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/22ef84ce-8d9a-48e7-bfbc-36e88476ce7d-networking-console-plugin-cert podName:22ef84ce-8d9a-48e7-bfbc-36e88476ce7d nodeName:}" failed. No retries permitted until 2026-07-07 16:23:14.685261211 +0000 UTC m=+37.818226649 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/22ef84ce-8d9a-48e7-bfbc-36e88476ce7d-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-dbdhv" (UID: "22ef84ce-8d9a-48e7-bfbc-36e88476ce7d") : secret "networking-console-plugin-cert" not found Jul 07 16:23:14.436477 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:14.435092 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8br2k" Jul 07 16:23:14.436477 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:14.435599 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kngnh" Jul 07 16:23:14.440446 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:14.440001 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 07 16:23:14.440446 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:14.440270 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-xxp9t\"" Jul 07 16:23:14.442104 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:14.441811 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-vjw6s\"" Jul 07 16:23:14.493898 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:14.493858 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/db1a7c4e-7b26-4e89-b989-7329dca3dfcf-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-8kqd8\" (UID: \"db1a7c4e-7b26-4e89-b989-7329dca3dfcf\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-8kqd8" Jul 07 16:23:14.494168 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:23:14.494145 2552 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 07 16:23:14.494273 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:23:14.494236 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db1a7c4e-7b26-4e89-b989-7329dca3dfcf-cluster-monitoring-operator-tls podName:db1a7c4e-7b26-4e89-b989-7329dca3dfcf nodeName:}" failed. No retries permitted until 2026-07-07 16:23:16.494199467 +0000 UTC m=+39.627164904 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/db1a7c4e-7b26-4e89-b989-7329dca3dfcf-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-8kqd8" (UID: "db1a7c4e-7b26-4e89-b989-7329dca3dfcf") : secret "cluster-monitoring-operator-tls" not found Jul 07 16:23:14.594829 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:14.594791 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/71da8590-3ed3-475d-8d66-fee560bb7abc-metrics-certs\") pod \"router-default-675d4b7575-sgxn7\" (UID: \"71da8590-3ed3-475d-8d66-fee560bb7abc\") " pod="openshift-ingress/router-default-675d4b7575-sgxn7" Jul 07 16:23:14.595010 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:14.594873 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/31bd1f2b-6f2c-47cd-a0b5-0f5e1daf3038-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-xbz57\" (UID: \"31bd1f2b-6f2c-47cd-a0b5-0f5e1daf3038\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-xbz57" Jul 07 16:23:14.595010 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:23:14.594949 2552 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 07 16:23:14.595125 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:14.595008 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71da8590-3ed3-475d-8d66-fee560bb7abc-service-ca-bundle\") pod \"router-default-675d4b7575-sgxn7\" (UID: \"71da8590-3ed3-475d-8d66-fee560bb7abc\") " pod="openshift-ingress/router-default-675d4b7575-sgxn7" Jul 07 16:23:14.595125 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:23:14.595085 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71da8590-3ed3-475d-8d66-fee560bb7abc-metrics-certs podName:71da8590-3ed3-475d-8d66-fee560bb7abc nodeName:}" failed. No retries permitted until 2026-07-07 16:23:16.595066291 +0000 UTC m=+39.728031734 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/71da8590-3ed3-475d-8d66-fee560bb7abc-metrics-certs") pod "router-default-675d4b7575-sgxn7" (UID: "71da8590-3ed3-475d-8d66-fee560bb7abc") : secret "router-metrics-certs-default" not found Jul 07 16:23:14.595250 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:23:14.595169 2552 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 07 16:23:14.595250 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:23:14.595234 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31bd1f2b-6f2c-47cd-a0b5-0f5e1daf3038-samples-operator-tls podName:31bd1f2b-6f2c-47cd-a0b5-0f5e1daf3038 nodeName:}" failed. No retries permitted until 2026-07-07 16:23:16.595220498 +0000 UTC m=+39.728185942 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/31bd1f2b-6f2c-47cd-a0b5-0f5e1daf3038-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-xbz57" (UID: "31bd1f2b-6f2c-47cd-a0b5-0f5e1daf3038") : secret "samples-operator-tls" not found Jul 07 16:23:14.595458 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:23:14.595439 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/71da8590-3ed3-475d-8d66-fee560bb7abc-service-ca-bundle podName:71da8590-3ed3-475d-8d66-fee560bb7abc nodeName:}" failed. No retries permitted until 2026-07-07 16:23:16.595420763 +0000 UTC m=+39.728386202 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/71da8590-3ed3-475d-8d66-fee560bb7abc-service-ca-bundle") pod "router-default-675d4b7575-sgxn7" (UID: "71da8590-3ed3-475d-8d66-fee560bb7abc") : configmap references non-existent config key: service-ca.crt Jul 07 16:23:14.696326 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:14.696241 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7d398452-8b59-4802-b9dc-3332d2ddb17e-registry-tls\") pod \"image-registry-647ccd66c4-52n8x\" (UID: \"7d398452-8b59-4802-b9dc-3332d2ddb17e\") " pod="openshift-image-registry/image-registry-647ccd66c4-52n8x" Jul 07 16:23:14.696326 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:14.696289 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5098470b-c5d3-46b1-9098-8fa69aeac854-metrics-tls\") pod \"dns-default-m7r46\" (UID: \"5098470b-c5d3-46b1-9098-8fa69aeac854\") " pod="openshift-dns/dns-default-m7r46" Jul 07 16:23:14.696326 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:14.696313 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/22ef84ce-8d9a-48e7-bfbc-36e88476ce7d-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-dbdhv\" (UID: \"22ef84ce-8d9a-48e7-bfbc-36e88476ce7d\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-dbdhv" Jul 07 16:23:14.696887 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:23:14.696535 2552 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 07 16:23:14.696887 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:23:14.696604 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/22ef84ce-8d9a-48e7-bfbc-36e88476ce7d-networking-console-plugin-cert podName:22ef84ce-8d9a-48e7-bfbc-36e88476ce7d nodeName:}" failed. No retries permitted until 2026-07-07 16:23:16.696583037 +0000 UTC m=+39.829548476 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/22ef84ce-8d9a-48e7-bfbc-36e88476ce7d-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-dbdhv" (UID: "22ef84ce-8d9a-48e7-bfbc-36e88476ce7d") : secret "networking-console-plugin-cert" not found Jul 07 16:23:14.697109 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:23:14.697088 2552 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 16:23:14.697193 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:23:14.697111 2552 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-647ccd66c4-52n8x: secret "image-registry-tls" not found Jul 07 16:23:14.697193 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:23:14.697159 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7d398452-8b59-4802-b9dc-3332d2ddb17e-registry-tls podName:7d398452-8b59-4802-b9dc-3332d2ddb17e nodeName:}" failed. No retries permitted until 2026-07-07 16:23:16.697142282 +0000 UTC m=+39.830107720 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7d398452-8b59-4802-b9dc-3332d2ddb17e-registry-tls") pod "image-registry-647ccd66c4-52n8x" (UID: "7d398452-8b59-4802-b9dc-3332d2ddb17e") : secret "image-registry-tls" not found Jul 07 16:23:14.697344 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:23:14.697276 2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 16:23:14.697344 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:23:14.697331 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5098470b-c5d3-46b1-9098-8fa69aeac854-metrics-tls podName:5098470b-c5d3-46b1-9098-8fa69aeac854 nodeName:}" failed. No retries permitted until 2026-07-07 16:23:16.697303696 +0000 UTC m=+39.830269133 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5098470b-c5d3-46b1-9098-8fa69aeac854-metrics-tls") pod "dns-default-m7r46" (UID: "5098470b-c5d3-46b1-9098-8fa69aeac854") : secret "dns-default-metrics-tls" not found Jul 07 16:23:16.517576 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:16.517540 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/db1a7c4e-7b26-4e89-b989-7329dca3dfcf-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-8kqd8\" (UID: \"db1a7c4e-7b26-4e89-b989-7329dca3dfcf\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-8kqd8" Jul 07 16:23:16.517999 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:23:16.517699 2552 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 07 16:23:16.517999 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:23:16.517779 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db1a7c4e-7b26-4e89-b989-7329dca3dfcf-cluster-monitoring-operator-tls podName:db1a7c4e-7b26-4e89-b989-7329dca3dfcf nodeName:}" failed. No retries permitted until 2026-07-07 16:23:20.517757152 +0000 UTC m=+43.650722595 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/db1a7c4e-7b26-4e89-b989-7329dca3dfcf-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-8kqd8" (UID: "db1a7c4e-7b26-4e89-b989-7329dca3dfcf") : secret "cluster-monitoring-operator-tls" not found Jul 07 16:23:16.619289 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:16.619165 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/71da8590-3ed3-475d-8d66-fee560bb7abc-metrics-certs\") pod \"router-default-675d4b7575-sgxn7\" (UID: \"71da8590-3ed3-475d-8d66-fee560bb7abc\") " pod="openshift-ingress/router-default-675d4b7575-sgxn7" Jul 07 16:23:16.619289 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:16.619245 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/31bd1f2b-6f2c-47cd-a0b5-0f5e1daf3038-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-xbz57\" (UID: \"31bd1f2b-6f2c-47cd-a0b5-0f5e1daf3038\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-xbz57" Jul 07 16:23:16.619552 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:16.619343 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71da8590-3ed3-475d-8d66-fee560bb7abc-service-ca-bundle\") pod \"router-default-675d4b7575-sgxn7\" (UID: \"71da8590-3ed3-475d-8d66-fee560bb7abc\") " pod="openshift-ingress/router-default-675d4b7575-sgxn7" Jul 07 16:23:16.619552 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:23:16.619400 2552 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 07 16:23:16.619552 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:23:16.619448 2552 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 07 16:23:16.619552 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:23:16.619471 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/71da8590-3ed3-475d-8d66-fee560bb7abc-service-ca-bundle podName:71da8590-3ed3-475d-8d66-fee560bb7abc nodeName:}" failed. No retries permitted until 2026-07-07 16:23:20.619454539 +0000 UTC m=+43.752419999 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/71da8590-3ed3-475d-8d66-fee560bb7abc-service-ca-bundle") pod "router-default-675d4b7575-sgxn7" (UID: "71da8590-3ed3-475d-8d66-fee560bb7abc") : configmap references non-existent config key: service-ca.crt Jul 07 16:23:16.619552 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:23:16.619491 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71da8590-3ed3-475d-8d66-fee560bb7abc-metrics-certs podName:71da8590-3ed3-475d-8d66-fee560bb7abc nodeName:}" failed. No retries permitted until 2026-07-07 16:23:20.619481081 +0000 UTC m=+43.752446518 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/71da8590-3ed3-475d-8d66-fee560bb7abc-metrics-certs") pod "router-default-675d4b7575-sgxn7" (UID: "71da8590-3ed3-475d-8d66-fee560bb7abc") : secret "router-metrics-certs-default" not found Jul 07 16:23:16.619552 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:23:16.619503 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31bd1f2b-6f2c-47cd-a0b5-0f5e1daf3038-samples-operator-tls podName:31bd1f2b-6f2c-47cd-a0b5-0f5e1daf3038 nodeName:}" failed. No retries permitted until 2026-07-07 16:23:20.619497114 +0000 UTC m=+43.752462553 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/31bd1f2b-6f2c-47cd-a0b5-0f5e1daf3038-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-xbz57" (UID: "31bd1f2b-6f2c-47cd-a0b5-0f5e1daf3038") : secret "samples-operator-tls" not found Jul 07 16:23:16.720331 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:16.720293 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7d398452-8b59-4802-b9dc-3332d2ddb17e-registry-tls\") pod \"image-registry-647ccd66c4-52n8x\" (UID: \"7d398452-8b59-4802-b9dc-3332d2ddb17e\") " pod="openshift-image-registry/image-registry-647ccd66c4-52n8x" Jul 07 16:23:16.720331 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:16.720332 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5098470b-c5d3-46b1-9098-8fa69aeac854-metrics-tls\") pod \"dns-default-m7r46\" (UID: \"5098470b-c5d3-46b1-9098-8fa69aeac854\") " pod="openshift-dns/dns-default-m7r46" Jul 07 16:23:16.720544 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:16.720350 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/22ef84ce-8d9a-48e7-bfbc-36e88476ce7d-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-dbdhv\" (UID: \"22ef84ce-8d9a-48e7-bfbc-36e88476ce7d\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-dbdhv" Jul 07 16:23:16.720544 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:23:16.720439 2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 16:23:16.720544 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:23:16.720468 2552 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 07 16:23:16.720544 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:23:16.720442 2552 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 16:23:16.720544 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:23:16.720503 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5098470b-c5d3-46b1-9098-8fa69aeac854-metrics-tls podName:5098470b-c5d3-46b1-9098-8fa69aeac854 nodeName:}" failed. No retries permitted until 2026-07-07 16:23:20.720488173 +0000 UTC m=+43.853453610 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5098470b-c5d3-46b1-9098-8fa69aeac854-metrics-tls") pod "dns-default-m7r46" (UID: "5098470b-c5d3-46b1-9098-8fa69aeac854") : secret "dns-default-metrics-tls" not found Jul 07 16:23:16.720544 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:23:16.720508 2552 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-647ccd66c4-52n8x: secret "image-registry-tls" not found Jul 07 16:23:16.720544 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:23:16.720517 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/22ef84ce-8d9a-48e7-bfbc-36e88476ce7d-networking-console-plugin-cert podName:22ef84ce-8d9a-48e7-bfbc-36e88476ce7d nodeName:}" failed. No retries permitted until 2026-07-07 16:23:20.720510903 +0000 UTC m=+43.853476340 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/22ef84ce-8d9a-48e7-bfbc-36e88476ce7d-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-dbdhv" (UID: "22ef84ce-8d9a-48e7-bfbc-36e88476ce7d") : secret "networking-console-plugin-cert" not found Jul 07 16:23:16.720544 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:23:16.720535 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7d398452-8b59-4802-b9dc-3332d2ddb17e-registry-tls podName:7d398452-8b59-4802-b9dc-3332d2ddb17e nodeName:}" failed. No retries permitted until 2026-07-07 16:23:20.720522435 +0000 UTC m=+43.853487873 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7d398452-8b59-4802-b9dc-3332d2ddb17e-registry-tls") pod "image-registry-647ccd66c4-52n8x" (UID: "7d398452-8b59-4802-b9dc-3332d2ddb17e") : secret "image-registry-tls" not found Jul 07 16:23:17.745276 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:17.745233 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q798q_dbfa7ead-a6a8-4536-8a8d-cbe2e2b33011/konnectivity-agent/0.log" limit=1024 Jul 07 16:23:17.841604 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:17.841573 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q798q_dbfa7ead-a6a8-4536-8a8d-cbe2e2b33011/konnectivity-agent/0.log" limit=1024 Jul 07 16:23:17.941992 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:17.941953 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q798q_dbfa7ead-a6a8-4536-8a8d-cbe2e2b33011/konnectivity-agent/0.log" limit=1024 Jul 07 16:23:20.558192 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:20.558150 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/db1a7c4e-7b26-4e89-b989-7329dca3dfcf-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-8kqd8\" (UID: \"db1a7c4e-7b26-4e89-b989-7329dca3dfcf\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-8kqd8" Jul 07 16:23:20.558698 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:23:20.558285 2552 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 07 16:23:20.558698 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:23:20.558362 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db1a7c4e-7b26-4e89-b989-7329dca3dfcf-cluster-monitoring-operator-tls podName:db1a7c4e-7b26-4e89-b989-7329dca3dfcf nodeName:}" failed. No retries permitted until 2026-07-07 16:23:28.558341907 +0000 UTC m=+51.691307367 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/db1a7c4e-7b26-4e89-b989-7329dca3dfcf-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-8kqd8" (UID: "db1a7c4e-7b26-4e89-b989-7329dca3dfcf") : secret "cluster-monitoring-operator-tls" not found Jul 07 16:23:20.659320 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:20.659279 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/31bd1f2b-6f2c-47cd-a0b5-0f5e1daf3038-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-xbz57\" (UID: \"31bd1f2b-6f2c-47cd-a0b5-0f5e1daf3038\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-xbz57" Jul 07 16:23:20.659496 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:20.659387 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71da8590-3ed3-475d-8d66-fee560bb7abc-service-ca-bundle\") pod \"router-default-675d4b7575-sgxn7\" (UID: \"71da8590-3ed3-475d-8d66-fee560bb7abc\") " pod="openshift-ingress/router-default-675d4b7575-sgxn7" Jul 07 16:23:20.659496 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:23:20.659446 2552 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 07 16:23:20.659606 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:20.659500 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/71da8590-3ed3-475d-8d66-fee560bb7abc-metrics-certs\") pod \"router-default-675d4b7575-sgxn7\" (UID: \"71da8590-3ed3-475d-8d66-fee560bb7abc\") " pod="openshift-ingress/router-default-675d4b7575-sgxn7" Jul 07 16:23:20.659606 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:23:20.659517 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31bd1f2b-6f2c-47cd-a0b5-0f5e1daf3038-samples-operator-tls podName:31bd1f2b-6f2c-47cd-a0b5-0f5e1daf3038 nodeName:}" failed. No retries permitted until 2026-07-07 16:23:28.659496973 +0000 UTC m=+51.792462426 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/31bd1f2b-6f2c-47cd-a0b5-0f5e1daf3038-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-xbz57" (UID: "31bd1f2b-6f2c-47cd-a0b5-0f5e1daf3038") : secret "samples-operator-tls" not found Jul 07 16:23:20.659606 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:23:20.659563 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/71da8590-3ed3-475d-8d66-fee560bb7abc-service-ca-bundle podName:71da8590-3ed3-475d-8d66-fee560bb7abc nodeName:}" failed. No retries permitted until 2026-07-07 16:23:28.659543192 +0000 UTC m=+51.792508628 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/71da8590-3ed3-475d-8d66-fee560bb7abc-service-ca-bundle") pod "router-default-675d4b7575-sgxn7" (UID: "71da8590-3ed3-475d-8d66-fee560bb7abc") : configmap references non-existent config key: service-ca.crt Jul 07 16:23:20.659606 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:23:20.659578 2552 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 07 16:23:20.659798 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:23:20.659628 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71da8590-3ed3-475d-8d66-fee560bb7abc-metrics-certs podName:71da8590-3ed3-475d-8d66-fee560bb7abc nodeName:}" failed. No retries permitted until 2026-07-07 16:23:28.65961314 +0000 UTC m=+51.792578583 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/71da8590-3ed3-475d-8d66-fee560bb7abc-metrics-certs") pod "router-default-675d4b7575-sgxn7" (UID: "71da8590-3ed3-475d-8d66-fee560bb7abc") : secret "router-metrics-certs-default" not found Jul 07 16:23:20.760112 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:20.760071 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7d398452-8b59-4802-b9dc-3332d2ddb17e-registry-tls\") pod \"image-registry-647ccd66c4-52n8x\" (UID: \"7d398452-8b59-4802-b9dc-3332d2ddb17e\") " pod="openshift-image-registry/image-registry-647ccd66c4-52n8x" Jul 07 16:23:20.760325 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:20.760120 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5098470b-c5d3-46b1-9098-8fa69aeac854-metrics-tls\") pod \"dns-default-m7r46\" (UID: \"5098470b-c5d3-46b1-9098-8fa69aeac854\") " pod="openshift-dns/dns-default-m7r46" Jul 07 16:23:20.760325 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:20.760150 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/22ef84ce-8d9a-48e7-bfbc-36e88476ce7d-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-dbdhv\" (UID: \"22ef84ce-8d9a-48e7-bfbc-36e88476ce7d\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-dbdhv" Jul 07 16:23:20.760325 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:23:20.760230 2552 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 16:23:20.760325 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:23:20.760254 2552 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-647ccd66c4-52n8x: secret "image-registry-tls" not found Jul 07 16:23:20.760325 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:23:20.760300 2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 16:23:20.760325 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:23:20.760317 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7d398452-8b59-4802-b9dc-3332d2ddb17e-registry-tls podName:7d398452-8b59-4802-b9dc-3332d2ddb17e nodeName:}" failed. No retries permitted until 2026-07-07 16:23:28.760298215 +0000 UTC m=+51.893263655 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7d398452-8b59-4802-b9dc-3332d2ddb17e-registry-tls") pod "image-registry-647ccd66c4-52n8x" (UID: "7d398452-8b59-4802-b9dc-3332d2ddb17e") : secret "image-registry-tls" not found Jul 07 16:23:20.760590 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:23:20.760355 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5098470b-c5d3-46b1-9098-8fa69aeac854-metrics-tls podName:5098470b-c5d3-46b1-9098-8fa69aeac854 nodeName:}" failed. No retries permitted until 2026-07-07 16:23:28.760338208 +0000 UTC m=+51.893303662 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5098470b-c5d3-46b1-9098-8fa69aeac854-metrics-tls") pod "dns-default-m7r46" (UID: "5098470b-c5d3-46b1-9098-8fa69aeac854") : secret "dns-default-metrics-tls" not found Jul 07 16:23:20.760590 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:23:20.760361 2552 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 07 16:23:20.760590 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:23:20.760413 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/22ef84ce-8d9a-48e7-bfbc-36e88476ce7d-networking-console-plugin-cert podName:22ef84ce-8d9a-48e7-bfbc-36e88476ce7d nodeName:}" failed. No retries permitted until 2026-07-07 16:23:28.760399729 +0000 UTC m=+51.893365184 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/22ef84ce-8d9a-48e7-bfbc-36e88476ce7d-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-dbdhv" (UID: "22ef84ce-8d9a-48e7-bfbc-36e88476ce7d") : secret "networking-console-plugin-cert" not found Jul 07 16:23:23.688854 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:23.688811 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-w6fqx" event={"ID":"c82dfb11-b16f-4ed1-96b2-d4ab90984286","Type":"ContainerStarted","Data":"8feed2ee0d8feb9b0ae31b460d2b2a493e979843942abcd5c8a2eb4c41fcd66e"} Jul 07 16:23:23.690751 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:23.690689 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-qf5bh" event={"ID":"c9428da5-4b2b-4c6a-bae9-0f0197fc5f78","Type":"ContainerStarted","Data":"3f8dd0715189fc05c77185e77522634b713724b625da93aef4e59b166f216e2d"} Jul 07 16:23:23.693655 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:23.693630 2552 generic.go:356] "Generic (PLEG): container finished" podID="dcc8336f-7d16-417d-aa68-e1c790939e7d" containerID="7c15ad81d92ce32aff78b3d19970c7b97fe15c002997a762a51a3e9fd9822935" exitCode=0 Jul 07 16:23:23.693778 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:23.693664 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mpbtm" event={"ID":"dcc8336f-7d16-417d-aa68-e1c790939e7d","Type":"ContainerDied","Data":"7c15ad81d92ce32aff78b3d19970c7b97fe15c002997a762a51a3e9fd9822935"} Jul 07 16:23:23.695411 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:23.695387 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-8dmps" event={"ID":"0f883f61-9d94-4285-9727-6da359ad2938","Type":"ContainerStarted","Data":"db5395811458c7bd915ca25119cd423d91d627534b0a1a36895374fd512e23af"} Jul 07 16:23:23.696999 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:23.696975 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-b65f8" event={"ID":"08d889ae-b463-46fb-a51d-8a4b59146f6c","Type":"ContainerStarted","Data":"119ceaf9584b0753134146275499195a07a62a5c0b926386fcd16993270e7687"} Jul 07 16:23:23.698859 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:23.698816 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-h89k9" event={"ID":"814d6546-b617-485a-aa09-7c0ce8a65af0","Type":"ContainerStarted","Data":"926485a80134852fec0351cddeda5b9fa5c264185e9cea5a88463003569f42f6"} Jul 07 16:23:23.700417 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:23.700398 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ldxhd" event={"ID":"e7cc3519-81dc-49db-b07a-9f26d9b1dd36","Type":"ContainerStarted","Data":"1a78bfc82ee936603656ab9de6e202553dac106c62b42ba16d7008a247ae386d"} Jul 07 16:23:23.701947 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:23.701928 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-wwrsk_ab9458b7-cc16-493e-90f5-ff72d3b10ac7/console-operator/0.log" Jul 07 16:23:23.702039 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:23.701965 2552 generic.go:356] "Generic (PLEG): container finished" podID="ab9458b7-cc16-493e-90f5-ff72d3b10ac7" containerID="db1f3d9e632d401b484f0a75555833c5cc7dd5160451d3cc6cea9a3db96fe961" exitCode=255 Jul 07 16:23:23.702039 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:23.701993 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-wwrsk" event={"ID":"ab9458b7-cc16-493e-90f5-ff72d3b10ac7","Type":"ContainerDied","Data":"db1f3d9e632d401b484f0a75555833c5cc7dd5160451d3cc6cea9a3db96fe961"} Jul 07 16:23:23.702225 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:23.702191 2552 scope.go:117] "RemoveContainer" containerID="db1f3d9e632d401b484f0a75555833c5cc7dd5160451d3cc6cea9a3db96fe961" Jul 07 16:23:23.709049 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:23.709006 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-w6fqx" podStartSLOduration=11.982276240000001 podStartE2EDuration="21.708990143s" totalImagesPullingTime="9.726713903s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:23:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:23:23.708427474 +0000 UTC m=+46.841392944" watchObservedRunningTime="2026-07-07 16:23:23.708990143 +0000 UTC m=+46.841955600" Jul 07 16:23:23.769182 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:23.769132 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-8dmps" podStartSLOduration=12.138783164 podStartE2EDuration="21.769110047s" totalImagesPullingTime="9.630326883s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:23:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:23:23.767666994 +0000 UTC m=+46.900632455" watchObservedRunningTime="2026-07-07 16:23:23.769110047 +0000 UTC m=+46.902075508" Jul 07 16:23:23.803700 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:23.803645 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-h89k9" podStartSLOduration=11.276781743 podStartE2EDuration="20.803624375s" totalImagesPullingTime="9.526842632s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:23:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:23:23.802563153 +0000 UTC m=+46.935528612" watchObservedRunningTime="2026-07-07 16:23:23.803624375 +0000 UTC m=+46.936589832" Jul 07 16:23:23.871048 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:23.870946 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-qf5bh" podStartSLOduration=12.133377598 podStartE2EDuration="21.870923002s" totalImagesPullingTime="9.737545404s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:23:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:23:23.835190642 +0000 UTC m=+46.968156102" watchObservedRunningTime="2026-07-07 16:23:23.870923002 +0000 UTC m=+47.003888462" Jul 07 16:23:23.915636 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:23.915285 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5c847dcfc4-b65f8" podStartSLOduration=12.259406093 podStartE2EDuration="21.915264915s" totalImagesPullingTime="9.655858822s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:23:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:23:23.871706525 +0000 UTC m=+47.004671986" watchObservedRunningTime="2026-07-07 16:23:23.915264915 +0000 UTC m=+47.048230372" Jul 07 16:23:23.950993 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:23.950905 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-ldxhd" podStartSLOduration=2.358633583 podStartE2EDuration="11.95088952s" totalImagesPullingTime="9.592255937s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:23:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:23:23.949444391 +0000 UTC m=+47.082409850" watchObservedRunningTime="2026-07-07 16:23:23.95088952 +0000 UTC m=+47.083854979" Jul 07 16:23:24.706761 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:24.706735 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-wwrsk_ab9458b7-cc16-493e-90f5-ff72d3b10ac7/console-operator/1.log" Jul 07 16:23:24.707224 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:24.707191 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-wwrsk_ab9458b7-cc16-493e-90f5-ff72d3b10ac7/console-operator/0.log" Jul 07 16:23:24.707267 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:24.707249 2552 generic.go:356] "Generic (PLEG): container finished" podID="ab9458b7-cc16-493e-90f5-ff72d3b10ac7" containerID="dd4b7db49a076ff81137fd072bdf00ef8ce102916040a9688806713b7745bd63" exitCode=255 Jul 07 16:23:24.707343 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:24.707317 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-wwrsk" event={"ID":"ab9458b7-cc16-493e-90f5-ff72d3b10ac7","Type":"ContainerDied","Data":"dd4b7db49a076ff81137fd072bdf00ef8ce102916040a9688806713b7745bd63"} Jul 07 16:23:24.707429 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:24.707416 2552 scope.go:117] "RemoveContainer" containerID="db1f3d9e632d401b484f0a75555833c5cc7dd5160451d3cc6cea9a3db96fe961" Jul 07 16:23:24.707672 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:24.707652 2552 scope.go:117] "RemoveContainer" containerID="dd4b7db49a076ff81137fd072bdf00ef8ce102916040a9688806713b7745bd63" Jul 07 16:23:24.707867 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:23:24.707842 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-wwrsk_openshift-console-operator(ab9458b7-cc16-493e-90f5-ff72d3b10ac7)\"" pod="openshift-console-operator/console-operator-68b757fb67-wwrsk" podUID="ab9458b7-cc16-493e-90f5-ff72d3b10ac7" Jul 07 16:23:24.710467 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:24.710444 2552 generic.go:356] "Generic (PLEG): container finished" podID="dcc8336f-7d16-417d-aa68-e1c790939e7d" containerID="99378412ad09bdbbb2cb4b7f76283800756a6a2da691ba1550c07d7f1d1c93e0" exitCode=0 Jul 07 16:23:24.710620 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:24.710591 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mpbtm" event={"ID":"dcc8336f-7d16-417d-aa68-e1c790939e7d","Type":"ContainerDied","Data":"99378412ad09bdbbb2cb4b7f76283800756a6a2da691ba1550c07d7f1d1c93e0"} Jul 07 16:23:24.756477 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:24.756370 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-w9n77"] Jul 07 16:23:24.787761 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:24.787031 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-w9n77"] Jul 07 16:23:24.787761 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:24.787181 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-w9n77" Jul 07 16:23:24.790381 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:24.790355 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 07 16:23:24.790508 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:24.790387 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 07 16:23:24.790508 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:24.790355 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-8qgfn\"" Jul 07 16:23:24.805749 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:24.803792 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5edb37e4-3383-438d-89dd-37841ca30b87-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w9n77\" (UID: \"5edb37e4-3383-438d-89dd-37841ca30b87\") " pod="openshift-insights/insights-runtime-extractor-w9n77" Jul 07 16:23:24.805749 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:24.803881 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lxnqd\" (UniqueName: \"kubernetes.io/projected/5edb37e4-3383-438d-89dd-37841ca30b87-kube-api-access-lxnqd\") pod \"insights-runtime-extractor-w9n77\" (UID: \"5edb37e4-3383-438d-89dd-37841ca30b87\") " pod="openshift-insights/insights-runtime-extractor-w9n77" Jul 07 16:23:24.805749 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:24.803986 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5edb37e4-3383-438d-89dd-37841ca30b87-crio-socket\") pod \"insights-runtime-extractor-w9n77\" (UID: \"5edb37e4-3383-438d-89dd-37841ca30b87\") " pod="openshift-insights/insights-runtime-extractor-w9n77" Jul 07 16:23:24.805749 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:24.804044 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5edb37e4-3383-438d-89dd-37841ca30b87-data-volume\") pod \"insights-runtime-extractor-w9n77\" (UID: \"5edb37e4-3383-438d-89dd-37841ca30b87\") " pod="openshift-insights/insights-runtime-extractor-w9n77" Jul 07 16:23:24.805749 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:24.804321 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5edb37e4-3383-438d-89dd-37841ca30b87-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w9n77\" (UID: \"5edb37e4-3383-438d-89dd-37841ca30b87\") " pod="openshift-insights/insights-runtime-extractor-w9n77" Jul 07 16:23:24.905467 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:24.905438 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5edb37e4-3383-438d-89dd-37841ca30b87-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w9n77\" (UID: \"5edb37e4-3383-438d-89dd-37841ca30b87\") " pod="openshift-insights/insights-runtime-extractor-w9n77" Jul 07 16:23:24.905644 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:24.905481 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5edb37e4-3383-438d-89dd-37841ca30b87-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w9n77\" (UID: \"5edb37e4-3383-438d-89dd-37841ca30b87\") " pod="openshift-insights/insights-runtime-extractor-w9n77" Jul 07 16:23:24.905644 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:24.905525 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lxnqd\" (UniqueName: \"kubernetes.io/projected/5edb37e4-3383-438d-89dd-37841ca30b87-kube-api-access-lxnqd\") pod \"insights-runtime-extractor-w9n77\" (UID: \"5edb37e4-3383-438d-89dd-37841ca30b87\") " pod="openshift-insights/insights-runtime-extractor-w9n77" Jul 07 16:23:24.905644 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:24.905572 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5edb37e4-3383-438d-89dd-37841ca30b87-crio-socket\") pod \"insights-runtime-extractor-w9n77\" (UID: \"5edb37e4-3383-438d-89dd-37841ca30b87\") " pod="openshift-insights/insights-runtime-extractor-w9n77" Jul 07 16:23:24.905644 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:23:24.905600 2552 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 16:23:24.905644 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:24.905612 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5edb37e4-3383-438d-89dd-37841ca30b87-data-volume\") pod \"insights-runtime-extractor-w9n77\" (UID: \"5edb37e4-3383-438d-89dd-37841ca30b87\") " pod="openshift-insights/insights-runtime-extractor-w9n77" Jul 07 16:23:24.905884 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:23:24.905651 2552 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 16:23:24.905884 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:23:24.905665 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5edb37e4-3383-438d-89dd-37841ca30b87-insights-runtime-extractor-tls podName:5edb37e4-3383-438d-89dd-37841ca30b87 nodeName:}" failed. No retries permitted until 2026-07-07 16:23:25.405645784 +0000 UTC m=+48.538611248 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5edb37e4-3383-438d-89dd-37841ca30b87-insights-runtime-extractor-tls") pod "insights-runtime-extractor-w9n77" (UID: "5edb37e4-3383-438d-89dd-37841ca30b87") : secret "insights-runtime-extractor-tls" not found Jul 07 16:23:24.905884 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:23:24.905714 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5edb37e4-3383-438d-89dd-37841ca30b87-kube-rbac-proxy-cm podName:5edb37e4-3383-438d-89dd-37841ca30b87 nodeName:}" failed. No retries permitted until 2026-07-07 16:23:25.405694597 +0000 UTC m=+48.538660038 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5edb37e4-3383-438d-89dd-37841ca30b87-kube-rbac-proxy-cm") pod "insights-runtime-extractor-w9n77" (UID: "5edb37e4-3383-438d-89dd-37841ca30b87") : configmap "kube-rbac-proxy" not found Jul 07 16:23:24.906015 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:24.905897 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5edb37e4-3383-438d-89dd-37841ca30b87-crio-socket\") pod \"insights-runtime-extractor-w9n77\" (UID: \"5edb37e4-3383-438d-89dd-37841ca30b87\") " pod="openshift-insights/insights-runtime-extractor-w9n77" Jul 07 16:23:24.906015 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:24.905923 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5edb37e4-3383-438d-89dd-37841ca30b87-data-volume\") pod \"insights-runtime-extractor-w9n77\" (UID: \"5edb37e4-3383-438d-89dd-37841ca30b87\") " pod="openshift-insights/insights-runtime-extractor-w9n77" Jul 07 16:23:24.925663 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:24.925627 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lxnqd\" (UniqueName: \"kubernetes.io/projected/5edb37e4-3383-438d-89dd-37841ca30b87-kube-api-access-lxnqd\") pod \"insights-runtime-extractor-w9n77\" (UID: \"5edb37e4-3383-438d-89dd-37841ca30b87\") " pod="openshift-insights/insights-runtime-extractor-w9n77" Jul 07 16:23:24.961619 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:24.961531 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-szbk5"] Jul 07 16:23:24.984773 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:24.984741 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-szbk5"] Jul 07 16:23:24.984917 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:24.984859 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-szbk5" Jul 07 16:23:24.988089 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:24.988061 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 07 16:23:24.988271 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:24.988243 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 07 16:23:24.988645 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:24.988628 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-7ccg6\"" Jul 07 16:23:25.006726 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:25.006688 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7pdwn\" (UniqueName: \"kubernetes.io/projected/ea884014-f1e0-4353-99e8-0d08f5bbdf5a-kube-api-access-7pdwn\") pod \"migrator-d57d58cc9-szbk5\" (UID: \"ea884014-f1e0-4353-99e8-0d08f5bbdf5a\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-szbk5" Jul 07 16:23:25.108199 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:25.108160 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7pdwn\" (UniqueName: \"kubernetes.io/projected/ea884014-f1e0-4353-99e8-0d08f5bbdf5a-kube-api-access-7pdwn\") pod \"migrator-d57d58cc9-szbk5\" (UID: \"ea884014-f1e0-4353-99e8-0d08f5bbdf5a\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-szbk5" Jul 07 16:23:25.122766 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:25.122730 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7pdwn\" (UniqueName: \"kubernetes.io/projected/ea884014-f1e0-4353-99e8-0d08f5bbdf5a-kube-api-access-7pdwn\") pod \"migrator-d57d58cc9-szbk5\" (UID: \"ea884014-f1e0-4353-99e8-0d08f5bbdf5a\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-szbk5" Jul 07 16:23:25.295840 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:25.295769 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-szbk5" Jul 07 16:23:25.410484 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:25.410456 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5edb37e4-3383-438d-89dd-37841ca30b87-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w9n77\" (UID: \"5edb37e4-3383-438d-89dd-37841ca30b87\") " pod="openshift-insights/insights-runtime-extractor-w9n77" Jul 07 16:23:25.410639 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:25.410501 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5edb37e4-3383-438d-89dd-37841ca30b87-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w9n77\" (UID: \"5edb37e4-3383-438d-89dd-37841ca30b87\") " pod="openshift-insights/insights-runtime-extractor-w9n77" Jul 07 16:23:25.410639 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:23:25.410596 2552 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 16:23:25.410720 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:23:25.410651 2552 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 16:23:25.410720 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:23:25.410660 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5edb37e4-3383-438d-89dd-37841ca30b87-kube-rbac-proxy-cm podName:5edb37e4-3383-438d-89dd-37841ca30b87 nodeName:}" failed. No retries permitted until 2026-07-07 16:23:26.41064155 +0000 UTC m=+49.543606992 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5edb37e4-3383-438d-89dd-37841ca30b87-kube-rbac-proxy-cm") pod "insights-runtime-extractor-w9n77" (UID: "5edb37e4-3383-438d-89dd-37841ca30b87") : configmap "kube-rbac-proxy" not found Jul 07 16:23:25.410798 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:23:25.410732 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5edb37e4-3383-438d-89dd-37841ca30b87-insights-runtime-extractor-tls podName:5edb37e4-3383-438d-89dd-37841ca30b87 nodeName:}" failed. No retries permitted until 2026-07-07 16:23:26.410712665 +0000 UTC m=+49.543678118 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5edb37e4-3383-438d-89dd-37841ca30b87-insights-runtime-extractor-tls") pod "insights-runtime-extractor-w9n77" (UID: "5edb37e4-3383-438d-89dd-37841ca30b87") : secret "insights-runtime-extractor-tls" not found Jul 07 16:23:25.434543 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:25.433653 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-szbk5"] Jul 07 16:23:25.438029 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:23:25.437999 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea884014_f1e0_4353_99e8_0d08f5bbdf5a.slice/crio-2603a5d29cd6bbc61d696f6932cc45a102ddd63b1489d5e1bb60225ea591205c WatchSource:0}: Error finding container 2603a5d29cd6bbc61d696f6932cc45a102ddd63b1489d5e1bb60225ea591205c: Status 404 returned error can't find the container with id 2603a5d29cd6bbc61d696f6932cc45a102ddd63b1489d5e1bb60225ea591205c Jul 07 16:23:25.718069 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:25.718024 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mpbtm" event={"ID":"dcc8336f-7d16-417d-aa68-e1c790939e7d","Type":"ContainerStarted","Data":"7550abb036c028ff09de82a56ce7f3d28ef353a8eaa9ba7872b2eb7238bef950"} Jul 07 16:23:25.719215 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:25.719182 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-szbk5" event={"ID":"ea884014-f1e0-4353-99e8-0d08f5bbdf5a","Type":"ContainerStarted","Data":"2603a5d29cd6bbc61d696f6932cc45a102ddd63b1489d5e1bb60225ea591205c"} Jul 07 16:23:25.720533 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:25.720516 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-wwrsk_ab9458b7-cc16-493e-90f5-ff72d3b10ac7/console-operator/1.log" Jul 07 16:23:25.720784 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:25.720769 2552 scope.go:117] "RemoveContainer" containerID="dd4b7db49a076ff81137fd072bdf00ef8ce102916040a9688806713b7745bd63" Jul 07 16:23:25.720915 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:23:25.720898 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-wwrsk_openshift-console-operator(ab9458b7-cc16-493e-90f5-ff72d3b10ac7)\"" pod="openshift-console-operator/console-operator-68b757fb67-wwrsk" podUID="ab9458b7-cc16-493e-90f5-ff72d3b10ac7" Jul 07 16:23:25.759780 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:25.759749 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-59lsn_dcab04ec-d173-4c57-b7a9-fa4d1c73a7bf/dns-node-resolver/0.log" Jul 07 16:23:25.760033 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:25.759993 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-mpbtm" podStartSLOduration=5.756170296 podStartE2EDuration="47.759978434s" totalImagesPullingTime="42.003808138s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:22:38 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:23:25.758271191 +0000 UTC m=+48.891236649" watchObservedRunningTime="2026-07-07 16:23:25.759978434 +0000 UTC m=+48.892943893" Jul 07 16:23:26.419891 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:26.419859 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5edb37e4-3383-438d-89dd-37841ca30b87-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w9n77\" (UID: \"5edb37e4-3383-438d-89dd-37841ca30b87\") " pod="openshift-insights/insights-runtime-extractor-w9n77" Jul 07 16:23:26.420043 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:26.419910 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5edb37e4-3383-438d-89dd-37841ca30b87-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w9n77\" (UID: \"5edb37e4-3383-438d-89dd-37841ca30b87\") " pod="openshift-insights/insights-runtime-extractor-w9n77" Jul 07 16:23:26.420043 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:23:26.420004 2552 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 16:23:26.420106 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:23:26.420068 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5edb37e4-3383-438d-89dd-37841ca30b87-insights-runtime-extractor-tls podName:5edb37e4-3383-438d-89dd-37841ca30b87 nodeName:}" failed. No retries permitted until 2026-07-07 16:23:28.420052955 +0000 UTC m=+51.553018391 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5edb37e4-3383-438d-89dd-37841ca30b87-insights-runtime-extractor-tls") pod "insights-runtime-extractor-w9n77" (UID: "5edb37e4-3383-438d-89dd-37841ca30b87") : secret "insights-runtime-extractor-tls" not found Jul 07 16:23:26.420453 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:26.420437 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5edb37e4-3383-438d-89dd-37841ca30b87-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w9n77\" (UID: \"5edb37e4-3383-438d-89dd-37841ca30b87\") " pod="openshift-insights/insights-runtime-extractor-w9n77" Jul 07 16:23:26.966082 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:26.966042 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-dbg2n_c4403f38-090d-4ad3-b880-fad3c7b44627/node-ca/0.log" Jul 07 16:23:26.966546 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:26.966525 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-758f599c5-fd5tp"] Jul 07 16:23:26.994666 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:26.994636 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-fd5tp"] Jul 07 16:23:26.994789 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:26.994736 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-fd5tp" Jul 07 16:23:26.998962 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:26.998938 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 07 16:23:26.999088 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:26.998941 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 07 16:23:26.999088 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:26.999046 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 07 16:23:27.000306 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:27.000289 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 07 16:23:27.000404 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:27.000338 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-mgcnk\"" Jul 07 16:23:27.025293 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:27.025263 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kfd5f\" (UniqueName: \"kubernetes.io/projected/2bd813f0-77ed-4461-b61f-2dd2448b3ed4-kube-api-access-kfd5f\") pod \"service-ca-758f599c5-fd5tp\" (UID: \"2bd813f0-77ed-4461-b61f-2dd2448b3ed4\") " pod="openshift-service-ca/service-ca-758f599c5-fd5tp" Jul 07 16:23:27.025441 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:27.025374 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/2bd813f0-77ed-4461-b61f-2dd2448b3ed4-signing-key\") pod \"service-ca-758f599c5-fd5tp\" (UID: \"2bd813f0-77ed-4461-b61f-2dd2448b3ed4\") " pod="openshift-service-ca/service-ca-758f599c5-fd5tp" Jul 07 16:23:27.025482 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:27.025472 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/2bd813f0-77ed-4461-b61f-2dd2448b3ed4-signing-cabundle\") pod \"service-ca-758f599c5-fd5tp\" (UID: \"2bd813f0-77ed-4461-b61f-2dd2448b3ed4\") " pod="openshift-service-ca/service-ca-758f599c5-fd5tp" Jul 07 16:23:27.126563 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:27.126530 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kfd5f\" (UniqueName: \"kubernetes.io/projected/2bd813f0-77ed-4461-b61f-2dd2448b3ed4-kube-api-access-kfd5f\") pod \"service-ca-758f599c5-fd5tp\" (UID: \"2bd813f0-77ed-4461-b61f-2dd2448b3ed4\") " pod="openshift-service-ca/service-ca-758f599c5-fd5tp" Jul 07 16:23:27.126714 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:27.126613 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/2bd813f0-77ed-4461-b61f-2dd2448b3ed4-signing-key\") pod \"service-ca-758f599c5-fd5tp\" (UID: \"2bd813f0-77ed-4461-b61f-2dd2448b3ed4\") " pod="openshift-service-ca/service-ca-758f599c5-fd5tp" Jul 07 16:23:27.126755 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:27.126729 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/2bd813f0-77ed-4461-b61f-2dd2448b3ed4-signing-cabundle\") pod \"service-ca-758f599c5-fd5tp\" (UID: \"2bd813f0-77ed-4461-b61f-2dd2448b3ed4\") " pod="openshift-service-ca/service-ca-758f599c5-fd5tp" Jul 07 16:23:27.127339 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:27.127310 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/2bd813f0-77ed-4461-b61f-2dd2448b3ed4-signing-cabundle\") pod \"service-ca-758f599c5-fd5tp\" (UID: \"2bd813f0-77ed-4461-b61f-2dd2448b3ed4\") " pod="openshift-service-ca/service-ca-758f599c5-fd5tp" Jul 07 16:23:27.128924 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:27.128903 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/2bd813f0-77ed-4461-b61f-2dd2448b3ed4-signing-key\") pod \"service-ca-758f599c5-fd5tp\" (UID: \"2bd813f0-77ed-4461-b61f-2dd2448b3ed4\") " pod="openshift-service-ca/service-ca-758f599c5-fd5tp" Jul 07 16:23:27.140834 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:27.140810 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kfd5f\" (UniqueName: \"kubernetes.io/projected/2bd813f0-77ed-4461-b61f-2dd2448b3ed4-kube-api-access-kfd5f\") pod \"service-ca-758f599c5-fd5tp\" (UID: \"2bd813f0-77ed-4461-b61f-2dd2448b3ed4\") " pod="openshift-service-ca/service-ca-758f599c5-fd5tp" Jul 07 16:23:27.304235 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:27.304133 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-fd5tp" Jul 07 16:23:27.480592 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:27.480569 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-fd5tp"] Jul 07 16:23:27.483639 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:23:27.483612 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2bd813f0_77ed_4461_b61f_2dd2448b3ed4.slice/crio-95a6fd77e36122a3303c0fc1deab7e02e849fa141a4e35cccbe784d3213fd3be WatchSource:0}: Error finding container 95a6fd77e36122a3303c0fc1deab7e02e849fa141a4e35cccbe784d3213fd3be: Status 404 returned error can't find the container with id 95a6fd77e36122a3303c0fc1deab7e02e849fa141a4e35cccbe784d3213fd3be Jul 07 16:23:27.558832 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:27.558772 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-ldxhd_e7cc3519-81dc-49db-b07a-9f26d9b1dd36/serve-healthcheck-canary/0.log" Jul 07 16:23:27.731982 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:27.731946 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-fd5tp" event={"ID":"2bd813f0-77ed-4461-b61f-2dd2448b3ed4","Type":"ContainerStarted","Data":"5dafdda3eb553f7b3cebd5f926bd17d01642343dbd5aaff7d7c14f8fa878c326"} Jul 07 16:23:27.732175 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:27.732006 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-fd5tp" event={"ID":"2bd813f0-77ed-4461-b61f-2dd2448b3ed4","Type":"ContainerStarted","Data":"95a6fd77e36122a3303c0fc1deab7e02e849fa141a4e35cccbe784d3213fd3be"} Jul 07 16:23:27.733619 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:27.733593 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-szbk5" event={"ID":"ea884014-f1e0-4353-99e8-0d08f5bbdf5a","Type":"ContainerStarted","Data":"544a1acc260e768bfb43b8d271d1b498788c5c20d1afbe99fc01eeacf11bf7fc"} Jul 07 16:23:27.733719 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:27.733637 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-szbk5" event={"ID":"ea884014-f1e0-4353-99e8-0d08f5bbdf5a","Type":"ContainerStarted","Data":"f12874352affa7038b02cb53d3e84bdf044365c1841ddf40b2efb2fbf19086ec"} Jul 07 16:23:27.754701 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:27.754550 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-758f599c5-fd5tp" podStartSLOduration=1.7545307879999998 podStartE2EDuration="1.754530788s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:23:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:23:27.753189548 +0000 UTC m=+50.886155008" watchObservedRunningTime="2026-07-07 16:23:27.754530788 +0000 UTC m=+50.887496246" Jul 07 16:23:27.774271 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:27.774218 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-szbk5" podStartSLOduration=1.858124036 podStartE2EDuration="3.774187841s" totalImagesPullingTime="1.916063805s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:23:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:23:27.773716283 +0000 UTC m=+50.906681742" watchObservedRunningTime="2026-07-07 16:23:27.774187841 +0000 UTC m=+50.907153301" Jul 07 16:23:28.436624 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:28.436587 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5edb37e4-3383-438d-89dd-37841ca30b87-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w9n77\" (UID: \"5edb37e4-3383-438d-89dd-37841ca30b87\") " pod="openshift-insights/insights-runtime-extractor-w9n77" Jul 07 16:23:28.437098 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:23:28.436756 2552 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 16:23:28.437098 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:23:28.436837 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5edb37e4-3383-438d-89dd-37841ca30b87-insights-runtime-extractor-tls podName:5edb37e4-3383-438d-89dd-37841ca30b87 nodeName:}" failed. No retries permitted until 2026-07-07 16:23:32.43681732 +0000 UTC m=+55.569782760 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5edb37e4-3383-438d-89dd-37841ca30b87-insights-runtime-extractor-tls") pod "insights-runtime-extractor-w9n77" (UID: "5edb37e4-3383-438d-89dd-37841ca30b87") : secret "insights-runtime-extractor-tls" not found Jul 07 16:23:28.638814 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:28.638774 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/db1a7c4e-7b26-4e89-b989-7329dca3dfcf-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-8kqd8\" (UID: \"db1a7c4e-7b26-4e89-b989-7329dca3dfcf\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-8kqd8" Jul 07 16:23:28.639004 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:23:28.638904 2552 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 07 16:23:28.639004 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:23:28.638971 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db1a7c4e-7b26-4e89-b989-7329dca3dfcf-cluster-monitoring-operator-tls podName:db1a7c4e-7b26-4e89-b989-7329dca3dfcf nodeName:}" failed. No retries permitted until 2026-07-07 16:23:44.63895192 +0000 UTC m=+67.771917357 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/db1a7c4e-7b26-4e89-b989-7329dca3dfcf-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-8kqd8" (UID: "db1a7c4e-7b26-4e89-b989-7329dca3dfcf") : secret "cluster-monitoring-operator-tls" not found Jul 07 16:23:28.739583 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:28.739505 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71da8590-3ed3-475d-8d66-fee560bb7abc-service-ca-bundle\") pod \"router-default-675d4b7575-sgxn7\" (UID: \"71da8590-3ed3-475d-8d66-fee560bb7abc\") " pod="openshift-ingress/router-default-675d4b7575-sgxn7" Jul 07 16:23:28.739707 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:28.739632 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/71da8590-3ed3-475d-8d66-fee560bb7abc-metrics-certs\") pod \"router-default-675d4b7575-sgxn7\" (UID: \"71da8590-3ed3-475d-8d66-fee560bb7abc\") " pod="openshift-ingress/router-default-675d4b7575-sgxn7" Jul 07 16:23:28.739707 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:23:28.739648 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/71da8590-3ed3-475d-8d66-fee560bb7abc-service-ca-bundle podName:71da8590-3ed3-475d-8d66-fee560bb7abc nodeName:}" failed. No retries permitted until 2026-07-07 16:23:44.739630731 +0000 UTC m=+67.872596171 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/71da8590-3ed3-475d-8d66-fee560bb7abc-service-ca-bundle") pod "router-default-675d4b7575-sgxn7" (UID: "71da8590-3ed3-475d-8d66-fee560bb7abc") : configmap references non-existent config key: service-ca.crt Jul 07 16:23:28.739831 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:28.739713 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/31bd1f2b-6f2c-47cd-a0b5-0f5e1daf3038-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-xbz57\" (UID: \"31bd1f2b-6f2c-47cd-a0b5-0f5e1daf3038\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-xbz57" Jul 07 16:23:28.739831 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:23:28.739715 2552 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 07 16:23:28.739831 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:23:28.739777 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71da8590-3ed3-475d-8d66-fee560bb7abc-metrics-certs podName:71da8590-3ed3-475d-8d66-fee560bb7abc nodeName:}" failed. No retries permitted until 2026-07-07 16:23:44.73976927 +0000 UTC m=+67.872734711 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/71da8590-3ed3-475d-8d66-fee560bb7abc-metrics-certs") pod "router-default-675d4b7575-sgxn7" (UID: "71da8590-3ed3-475d-8d66-fee560bb7abc") : secret "router-metrics-certs-default" not found Jul 07 16:23:28.739831 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:23:28.739799 2552 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 07 16:23:28.739996 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:23:28.739863 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31bd1f2b-6f2c-47cd-a0b5-0f5e1daf3038-samples-operator-tls podName:31bd1f2b-6f2c-47cd-a0b5-0f5e1daf3038 nodeName:}" failed. No retries permitted until 2026-07-07 16:23:44.739843828 +0000 UTC m=+67.872809265 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/31bd1f2b-6f2c-47cd-a0b5-0f5e1daf3038-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-xbz57" (UID: "31bd1f2b-6f2c-47cd-a0b5-0f5e1daf3038") : secret "samples-operator-tls" not found Jul 07 16:23:28.841142 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:28.841104 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7d398452-8b59-4802-b9dc-3332d2ddb17e-registry-tls\") pod \"image-registry-647ccd66c4-52n8x\" (UID: \"7d398452-8b59-4802-b9dc-3332d2ddb17e\") " pod="openshift-image-registry/image-registry-647ccd66c4-52n8x" Jul 07 16:23:28.841357 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:28.841150 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5098470b-c5d3-46b1-9098-8fa69aeac854-metrics-tls\") pod \"dns-default-m7r46\" (UID: \"5098470b-c5d3-46b1-9098-8fa69aeac854\") " pod="openshift-dns/dns-default-m7r46" Jul 07 16:23:28.841357 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:23:28.841249 2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 16:23:28.841357 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:23:28.841282 2552 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 16:23:28.841357 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:23:28.841302 2552 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-647ccd66c4-52n8x: secret "image-registry-tls" not found Jul 07 16:23:28.841357 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:23:28.841312 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5098470b-c5d3-46b1-9098-8fa69aeac854-metrics-tls podName:5098470b-c5d3-46b1-9098-8fa69aeac854 nodeName:}" failed. No retries permitted until 2026-07-07 16:23:44.841294179 +0000 UTC m=+67.974259637 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5098470b-c5d3-46b1-9098-8fa69aeac854-metrics-tls") pod "dns-default-m7r46" (UID: "5098470b-c5d3-46b1-9098-8fa69aeac854") : secret "dns-default-metrics-tls" not found Jul 07 16:23:28.841604 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:23:28.841363 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7d398452-8b59-4802-b9dc-3332d2ddb17e-registry-tls podName:7d398452-8b59-4802-b9dc-3332d2ddb17e nodeName:}" failed. No retries permitted until 2026-07-07 16:23:44.841346728 +0000 UTC m=+67.974312168 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7d398452-8b59-4802-b9dc-3332d2ddb17e-registry-tls") pod "image-registry-647ccd66c4-52n8x" (UID: "7d398452-8b59-4802-b9dc-3332d2ddb17e") : secret "image-registry-tls" not found Jul 07 16:23:28.841604 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:28.841396 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/22ef84ce-8d9a-48e7-bfbc-36e88476ce7d-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-dbdhv\" (UID: \"22ef84ce-8d9a-48e7-bfbc-36e88476ce7d\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-dbdhv" Jul 07 16:23:28.841604 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:23:28.841432 2552 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 07 16:23:28.841604 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:23:28.841472 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/22ef84ce-8d9a-48e7-bfbc-36e88476ce7d-networking-console-plugin-cert podName:22ef84ce-8d9a-48e7-bfbc-36e88476ce7d nodeName:}" failed. No retries permitted until 2026-07-07 16:23:44.841461549 +0000 UTC m=+67.974427004 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/22ef84ce-8d9a-48e7-bfbc-36e88476ce7d-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-dbdhv" (UID: "22ef84ce-8d9a-48e7-bfbc-36e88476ce7d") : secret "networking-console-plugin-cert" not found Jul 07 16:23:32.475787 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:32.475739 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5edb37e4-3383-438d-89dd-37841ca30b87-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w9n77\" (UID: \"5edb37e4-3383-438d-89dd-37841ca30b87\") " pod="openshift-insights/insights-runtime-extractor-w9n77" Jul 07 16:23:32.476341 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:23:32.475871 2552 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 16:23:32.476341 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:23:32.475932 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5edb37e4-3383-438d-89dd-37841ca30b87-insights-runtime-extractor-tls podName:5edb37e4-3383-438d-89dd-37841ca30b87 nodeName:}" failed. No retries permitted until 2026-07-07 16:23:40.475915232 +0000 UTC m=+63.608880671 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5edb37e4-3383-438d-89dd-37841ca30b87-insights-runtime-extractor-tls") pod "insights-runtime-extractor-w9n77" (UID: "5edb37e4-3383-438d-89dd-37841ca30b87") : secret "insights-runtime-extractor-tls" not found Jul 07 16:23:33.090934 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:33.090902 2552 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-wwrsk" Jul 07 16:23:33.091109 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:33.090977 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-wwrsk" Jul 07 16:23:33.091328 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:33.091315 2552 scope.go:117] "RemoveContainer" containerID="dd4b7db49a076ff81137fd072bdf00ef8ce102916040a9688806713b7745bd63" Jul 07 16:23:33.091477 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:23:33.091458 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-wwrsk_openshift-console-operator(ab9458b7-cc16-493e-90f5-ff72d3b10ac7)\"" pod="openshift-console-operator/console-operator-68b757fb67-wwrsk" podUID="ab9458b7-cc16-493e-90f5-ff72d3b10ac7" Jul 07 16:23:38.639172 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:38.639141 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dbbfb" Jul 07 16:23:40.552329 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:40.549118 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5edb37e4-3383-438d-89dd-37841ca30b87-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w9n77\" (UID: \"5edb37e4-3383-438d-89dd-37841ca30b87\") " pod="openshift-insights/insights-runtime-extractor-w9n77" Jul 07 16:23:40.552777 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:40.552464 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5edb37e4-3383-438d-89dd-37841ca30b87-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w9n77\" (UID: \"5edb37e4-3383-438d-89dd-37841ca30b87\") " pod="openshift-insights/insights-runtime-extractor-w9n77" Jul 07 16:23:40.703148 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:40.703116 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-8qgfn\"" Jul 07 16:23:40.710889 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:40.710871 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-w9n77" Jul 07 16:23:40.836694 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:40.836671 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-w9n77"] Jul 07 16:23:40.839694 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:23:40.839665 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5edb37e4_3383_438d_89dd_37841ca30b87.slice/crio-ceef5929b592b606e8373770ca6c678fb087d9d619d26f89360653fc6808095e WatchSource:0}: Error finding container ceef5929b592b606e8373770ca6c678fb087d9d619d26f89360653fc6808095e: Status 404 returned error can't find the container with id ceef5929b592b606e8373770ca6c678fb087d9d619d26f89360653fc6808095e Jul 07 16:23:41.784031 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:41.783945 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-w9n77" event={"ID":"5edb37e4-3383-438d-89dd-37841ca30b87","Type":"ContainerStarted","Data":"ceef5929b592b606e8373770ca6c678fb087d9d619d26f89360653fc6808095e"} Jul 07 16:23:42.065301 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:42.065196 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f5d16211-b5e0-4042-aeba-ba5d273ccd96-original-pull-secret\") pod \"global-pull-secret-syncer-8qbxw\" (UID: \"f5d16211-b5e0-4042-aeba-ba5d273ccd96\") " pod="kube-system/global-pull-secret-syncer-8qbxw" Jul 07 16:23:42.065455 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:42.065353 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/592ceff6-55ee-4890-8b40-5aa74cd26a35-metrics-certs\") pod \"network-metrics-daemon-kngnh\" (UID: \"592ceff6-55ee-4890-8b40-5aa74cd26a35\") " pod="openshift-multus/network-metrics-daemon-kngnh" Jul 07 16:23:42.068179 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:42.068157 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 07 16:23:42.069316 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:42.069298 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 07 16:23:42.077908 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:42.077889 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f5d16211-b5e0-4042-aeba-ba5d273ccd96-original-pull-secret\") pod \"global-pull-secret-syncer-8qbxw\" (UID: \"f5d16211-b5e0-4042-aeba-ba5d273ccd96\") " pod="kube-system/global-pull-secret-syncer-8qbxw" Jul 07 16:23:42.078164 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:42.078141 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/592ceff6-55ee-4890-8b40-5aa74cd26a35-metrics-certs\") pod \"network-metrics-daemon-kngnh\" (UID: \"592ceff6-55ee-4890-8b40-5aa74cd26a35\") " pod="openshift-multus/network-metrics-daemon-kngnh" Jul 07 16:23:42.247784 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:42.247753 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8qbxw" Jul 07 16:23:42.267574 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:42.267539 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m47sh\" (UniqueName: \"kubernetes.io/projected/53ce531f-ee40-476c-b275-915d9206d4d8-kube-api-access-m47sh\") pod \"network-check-target-8br2k\" (UID: \"53ce531f-ee40-476c-b275-915d9206d4d8\") " pod="openshift-network-diagnostics/network-check-target-8br2k" Jul 07 16:23:42.270412 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:42.270392 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m47sh\" (UniqueName: \"kubernetes.io/projected/53ce531f-ee40-476c-b275-915d9206d4d8-kube-api-access-m47sh\") pod \"network-check-target-8br2k\" (UID: \"53ce531f-ee40-476c-b275-915d9206d4d8\") " pod="openshift-network-diagnostics/network-check-target-8br2k" Jul 07 16:23:42.359405 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:42.359375 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-vjw6s\"" Jul 07 16:23:42.364566 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:42.364542 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8br2k" Jul 07 16:23:42.364703 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:42.364583 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-xxp9t\"" Jul 07 16:23:42.371965 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:42.371944 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kngnh" Jul 07 16:23:42.386963 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:42.386944 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-8qbxw"] Jul 07 16:23:42.388913 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:23:42.388893 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5d16211_b5e0_4042_aeba_ba5d273ccd96.slice/crio-a799831b5fd091dc453514d159e9e86d7adb3ea205a3360ca25e61674b7ff22a WatchSource:0}: Error finding container a799831b5fd091dc453514d159e9e86d7adb3ea205a3360ca25e61674b7ff22a: Status 404 returned error can't find the container with id a799831b5fd091dc453514d159e9e86d7adb3ea205a3360ca25e61674b7ff22a Jul 07 16:23:42.535140 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:42.535043 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-8br2k"] Jul 07 16:23:42.567846 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:42.567821 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-kngnh"] Jul 07 16:23:42.788451 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:42.788420 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-8qbxw" event={"ID":"f5d16211-b5e0-4042-aeba-ba5d273ccd96","Type":"ContainerStarted","Data":"a799831b5fd091dc453514d159e9e86d7adb3ea205a3360ca25e61674b7ff22a"} Jul 07 16:23:43.747529 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:23:43.747497 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53ce531f_ee40_476c_b275_915d9206d4d8.slice/crio-6d176e7a76aa4138808bb0cb735f51a56e4a67da48b6eb10849f3fbe8ab29763 WatchSource:0}: Error finding container 6d176e7a76aa4138808bb0cb735f51a56e4a67da48b6eb10849f3fbe8ab29763: Status 404 returned error can't find the container with id 6d176e7a76aa4138808bb0cb735f51a56e4a67da48b6eb10849f3fbe8ab29763 Jul 07 16:23:43.783579 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:23:43.783559 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod592ceff6_55ee_4890_8b40_5aa74cd26a35.slice/crio-b9b0126ad7061b8b88b6aaba55f2ad3c43e5419b1a06e3e7ca71e0a97d0fd7d8 WatchSource:0}: Error finding container b9b0126ad7061b8b88b6aaba55f2ad3c43e5419b1a06e3e7ca71e0a97d0fd7d8: Status 404 returned error can't find the container with id b9b0126ad7061b8b88b6aaba55f2ad3c43e5419b1a06e3e7ca71e0a97d0fd7d8 Jul 07 16:23:43.793062 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:43.793033 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-kngnh" event={"ID":"592ceff6-55ee-4890-8b40-5aa74cd26a35","Type":"ContainerStarted","Data":"b9b0126ad7061b8b88b6aaba55f2ad3c43e5419b1a06e3e7ca71e0a97d0fd7d8"} Jul 07 16:23:43.794148 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:43.794122 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-8br2k" event={"ID":"53ce531f-ee40-476c-b275-915d9206d4d8","Type":"ContainerStarted","Data":"6d176e7a76aa4138808bb0cb735f51a56e4a67da48b6eb10849f3fbe8ab29763"} Jul 07 16:23:44.690873 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:44.690832 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/db1a7c4e-7b26-4e89-b989-7329dca3dfcf-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-8kqd8\" (UID: \"db1a7c4e-7b26-4e89-b989-7329dca3dfcf\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-8kqd8" Jul 07 16:23:44.693870 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:44.693837 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/db1a7c4e-7b26-4e89-b989-7329dca3dfcf-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-8kqd8\" (UID: \"db1a7c4e-7b26-4e89-b989-7329dca3dfcf\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-8kqd8" Jul 07 16:23:44.791941 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:44.791909 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/31bd1f2b-6f2c-47cd-a0b5-0f5e1daf3038-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-xbz57\" (UID: \"31bd1f2b-6f2c-47cd-a0b5-0f5e1daf3038\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-xbz57" Jul 07 16:23:44.792099 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:44.791974 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71da8590-3ed3-475d-8d66-fee560bb7abc-service-ca-bundle\") pod \"router-default-675d4b7575-sgxn7\" (UID: \"71da8590-3ed3-475d-8d66-fee560bb7abc\") " pod="openshift-ingress/router-default-675d4b7575-sgxn7" Jul 07 16:23:44.792099 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:44.792064 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/71da8590-3ed3-475d-8d66-fee560bb7abc-metrics-certs\") pod \"router-default-675d4b7575-sgxn7\" (UID: \"71da8590-3ed3-475d-8d66-fee560bb7abc\") " pod="openshift-ingress/router-default-675d4b7575-sgxn7" Jul 07 16:23:44.792908 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:44.792650 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71da8590-3ed3-475d-8d66-fee560bb7abc-service-ca-bundle\") pod \"router-default-675d4b7575-sgxn7\" (UID: \"71da8590-3ed3-475d-8d66-fee560bb7abc\") " pod="openshift-ingress/router-default-675d4b7575-sgxn7" Jul 07 16:23:44.795794 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:44.795775 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/31bd1f2b-6f2c-47cd-a0b5-0f5e1daf3038-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-xbz57\" (UID: \"31bd1f2b-6f2c-47cd-a0b5-0f5e1daf3038\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-xbz57" Jul 07 16:23:44.796146 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:44.795800 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/71da8590-3ed3-475d-8d66-fee560bb7abc-metrics-certs\") pod \"router-default-675d4b7575-sgxn7\" (UID: \"71da8590-3ed3-475d-8d66-fee560bb7abc\") " pod="openshift-ingress/router-default-675d4b7575-sgxn7" Jul 07 16:23:44.892598 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:44.892527 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7d398452-8b59-4802-b9dc-3332d2ddb17e-registry-tls\") pod \"image-registry-647ccd66c4-52n8x\" (UID: \"7d398452-8b59-4802-b9dc-3332d2ddb17e\") " pod="openshift-image-registry/image-registry-647ccd66c4-52n8x" Jul 07 16:23:44.892598 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:44.892579 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5098470b-c5d3-46b1-9098-8fa69aeac854-metrics-tls\") pod \"dns-default-m7r46\" (UID: \"5098470b-c5d3-46b1-9098-8fa69aeac854\") " pod="openshift-dns/dns-default-m7r46" Jul 07 16:23:44.892833 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:44.892607 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/22ef84ce-8d9a-48e7-bfbc-36e88476ce7d-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-dbdhv\" (UID: \"22ef84ce-8d9a-48e7-bfbc-36e88476ce7d\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-dbdhv" Jul 07 16:23:44.896409 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:44.896359 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/22ef84ce-8d9a-48e7-bfbc-36e88476ce7d-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-dbdhv\" (UID: \"22ef84ce-8d9a-48e7-bfbc-36e88476ce7d\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-dbdhv" Jul 07 16:23:44.896536 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:44.896418 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7d398452-8b59-4802-b9dc-3332d2ddb17e-registry-tls\") pod \"image-registry-647ccd66c4-52n8x\" (UID: \"7d398452-8b59-4802-b9dc-3332d2ddb17e\") " pod="openshift-image-registry/image-registry-647ccd66c4-52n8x" Jul 07 16:23:44.898042 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:44.897998 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5098470b-c5d3-46b1-9098-8fa69aeac854-metrics-tls\") pod \"dns-default-m7r46\" (UID: \"5098470b-c5d3-46b1-9098-8fa69aeac854\") " pod="openshift-dns/dns-default-m7r46" Jul 07 16:23:44.906079 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:44.906024 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-b9kzw\"" Jul 07 16:23:44.913627 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:44.913605 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-8kqd8" Jul 07 16:23:44.925492 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:44.925449 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-xnsw5\"" Jul 07 16:23:44.933086 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:44.932887 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-675d4b7575-sgxn7" Jul 07 16:23:44.995672 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:44.995440 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-bjr7z\"" Jul 07 16:23:45.003529 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:45.003342 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-xbz57" Jul 07 16:23:45.029881 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:45.029648 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-g8vwq\"" Jul 07 16:23:45.036842 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:45.036732 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-647ccd66c4-52n8x" Jul 07 16:23:45.038842 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:45.038650 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-jgc6k\"" Jul 07 16:23:45.046757 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:45.046645 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-m7r46" Jul 07 16:23:45.094450 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:45.094339 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-8kqd8"] Jul 07 16:23:45.099908 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:23:45.099837 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb1a7c4e_7b26_4e89_b989_7329dca3dfcf.slice/crio-4ca61b26f7814313b47e1c15df27467145f448d62bc373076afc03916164eb09 WatchSource:0}: Error finding container 4ca61b26f7814313b47e1c15df27467145f448d62bc373076afc03916164eb09: Status 404 returned error can't find the container with id 4ca61b26f7814313b47e1c15df27467145f448d62bc373076afc03916164eb09 Jul 07 16:23:45.108503 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:45.108095 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-rht7k\"" Jul 07 16:23:45.115959 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:45.115723 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-dbdhv" Jul 07 16:23:45.123294 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:45.123244 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-675d4b7575-sgxn7"] Jul 07 16:23:45.213980 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:45.212977 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-xbz57"] Jul 07 16:23:45.247913 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:45.247868 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-647ccd66c4-52n8x"] Jul 07 16:23:45.250011 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:23:45.249981 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d398452_8b59_4802_b9dc_3332d2ddb17e.slice/crio-2b30f3b7a6174f3e4b143714ccc5305f53b0d4f8048887102a6d9a8b96ef8d74 WatchSource:0}: Error finding container 2b30f3b7a6174f3e4b143714ccc5305f53b0d4f8048887102a6d9a8b96ef8d74: Status 404 returned error can't find the container with id 2b30f3b7a6174f3e4b143714ccc5305f53b0d4f8048887102a6d9a8b96ef8d74 Jul 07 16:23:45.289983 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:45.289889 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-m7r46"] Jul 07 16:23:45.323983 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:45.323951 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-dbdhv"] Jul 07 16:23:45.541340 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:23:45.541253 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5098470b_c5d3_46b1_9098_8fa69aeac854.slice/crio-624a05de928436ccdc056b4ad7762e8960770d684ae4e25d0da264859febe938 WatchSource:0}: Error finding container 624a05de928436ccdc056b4ad7762e8960770d684ae4e25d0da264859febe938: Status 404 returned error can't find the container with id 624a05de928436ccdc056b4ad7762e8960770d684ae4e25d0da264859febe938 Jul 07 16:23:45.541989 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:23:45.541962 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22ef84ce_8d9a_48e7_bfbc_36e88476ce7d.slice/crio-e5e0f532e5b2a7d4b51790862a3078ca715be365c60d212502330948a6fc36d3 WatchSource:0}: Error finding container e5e0f532e5b2a7d4b51790862a3078ca715be365c60d212502330948a6fc36d3: Status 404 returned error can't find the container with id e5e0f532e5b2a7d4b51790862a3078ca715be365c60d212502330948a6fc36d3 Jul 07 16:23:45.807653 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:45.807619 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-647ccd66c4-52n8x" event={"ID":"7d398452-8b59-4802-b9dc-3332d2ddb17e","Type":"ContainerStarted","Data":"7a7426a8ee01ad94e89130f0cfbb270877ae95b9b82df11b14301448d5c81881"} Jul 07 16:23:45.808038 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:45.807664 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-647ccd66c4-52n8x" event={"ID":"7d398452-8b59-4802-b9dc-3332d2ddb17e","Type":"ContainerStarted","Data":"2b30f3b7a6174f3e4b143714ccc5305f53b0d4f8048887102a6d9a8b96ef8d74"} Jul 07 16:23:45.808249 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:45.808232 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-647ccd66c4-52n8x" Jul 07 16:23:45.817237 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:45.817133 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-w9n77" event={"ID":"5edb37e4-3383-438d-89dd-37841ca30b87","Type":"ContainerStarted","Data":"d5ab876beea7fe1fbc56cf931218f07f58f376f7bbec300a3c810bddd5cf6e5d"} Jul 07 16:23:45.817237 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:45.817189 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-w9n77" event={"ID":"5edb37e4-3383-438d-89dd-37841ca30b87","Type":"ContainerStarted","Data":"28d5b518192497cd2a9442bc620547a52df5520322079fa432e6499bbc8afeb4"} Jul 07 16:23:45.820065 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:45.819497 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-8br2k" event={"ID":"53ce531f-ee40-476c-b275-915d9206d4d8","Type":"ContainerStarted","Data":"8db9c9c380d6fac89de260608189797d0713aca05b4192bac57a8d134d2ef4d9"} Jul 07 16:23:45.820065 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:45.820024 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-8br2k" Jul 07 16:23:45.822968 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:45.822923 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-675d4b7575-sgxn7" event={"ID":"71da8590-3ed3-475d-8d66-fee560bb7abc","Type":"ContainerStarted","Data":"3997ed667882bc51a6a784f519c208558f8d7a07a330eee96c9089159461cb93"} Jul 07 16:23:45.822968 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:45.822966 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-675d4b7575-sgxn7" event={"ID":"71da8590-3ed3-475d-8d66-fee560bb7abc","Type":"ContainerStarted","Data":"7096e260e691b329b223d8f8e98776111931b1a903e26d3efadd40640f54ec2f"} Jul 07 16:23:45.824937 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:45.824866 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-kngnh" event={"ID":"592ceff6-55ee-4890-8b40-5aa74cd26a35","Type":"ContainerStarted","Data":"9b4f48d4dc93105a62cf00bb3270744987729b05d67087d9c7d3c5c709347276"} Jul 07 16:23:45.826582 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:45.826555 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-dbdhv" event={"ID":"22ef84ce-8d9a-48e7-bfbc-36e88476ce7d","Type":"ContainerStarted","Data":"e5e0f532e5b2a7d4b51790862a3078ca715be365c60d212502330948a6fc36d3"} Jul 07 16:23:45.828058 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:45.827993 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-xbz57" event={"ID":"31bd1f2b-6f2c-47cd-a0b5-0f5e1daf3038","Type":"ContainerStarted","Data":"4c0dabd7a4c7a443fd6e97112612f903023f80b8385d27405382d30622396ff2"} Jul 07 16:23:45.829526 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:45.829500 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-8kqd8" event={"ID":"db1a7c4e-7b26-4e89-b989-7329dca3dfcf","Type":"ContainerStarted","Data":"4ca61b26f7814313b47e1c15df27467145f448d62bc373076afc03916164eb09"} Jul 07 16:23:45.831183 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:45.831122 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-m7r46" event={"ID":"5098470b-c5d3-46b1-9098-8fa69aeac854","Type":"ContainerStarted","Data":"624a05de928436ccdc056b4ad7762e8960770d684ae4e25d0da264859febe938"} Jul 07 16:23:45.844235 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:45.844046 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-647ccd66c4-52n8x" podStartSLOduration=67.844027154 podStartE2EDuration="1m7.844027154s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:22:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:23:45.843297864 +0000 UTC m=+68.976263324" watchObservedRunningTime="2026-07-07 16:23:45.844027154 +0000 UTC m=+68.976992605" Jul 07 16:23:45.867611 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:45.867565 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-8br2k" podStartSLOduration=67.867548078 podStartE2EDuration="1m7.867548078s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:22:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:23:45.866353273 +0000 UTC m=+68.999318733" watchObservedRunningTime="2026-07-07 16:23:45.867548078 +0000 UTC m=+69.000513539" Jul 07 16:23:45.933665 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:45.933609 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-675d4b7575-sgxn7" Jul 07 16:23:45.938297 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:45.938257 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-675d4b7575-sgxn7" Jul 07 16:23:45.992226 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:45.992082 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-675d4b7575-sgxn7" podStartSLOduration=43.992057692 podStartE2EDuration="43.992057692s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:23:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:23:45.890109497 +0000 UTC m=+69.023074946" watchObservedRunningTime="2026-07-07 16:23:45.992057692 +0000 UTC m=+69.125023152" Jul 07 16:23:46.435429 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:46.435396 2552 scope.go:117] "RemoveContainer" containerID="dd4b7db49a076ff81137fd072bdf00ef8ce102916040a9688806713b7745bd63" Jul 07 16:23:46.843300 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:46.843153 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-kngnh" event={"ID":"592ceff6-55ee-4890-8b40-5aa74cd26a35","Type":"ContainerStarted","Data":"0a676822acd4ea803d56c2f1e29bad1a61f52d54d3d77c5cdd74eac10b233e5f"} Jul 07 16:23:46.848145 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:46.847296 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-wwrsk_ab9458b7-cc16-493e-90f5-ff72d3b10ac7/console-operator/1.log" Jul 07 16:23:46.848145 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:46.847855 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-wwrsk" event={"ID":"ab9458b7-cc16-493e-90f5-ff72d3b10ac7","Type":"ContainerStarted","Data":"7c292b8c84efafcba72dfe2052fdb251bbae7a0a10a37c6989a2cbd8f46a42e1"} Jul 07 16:23:46.849805 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:46.849527 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-675d4b7575-sgxn7" Jul 07 16:23:46.851468 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:46.850214 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-wwrsk" Jul 07 16:23:46.851916 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:46.851846 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-675d4b7575-sgxn7" Jul 07 16:23:46.872935 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:46.872557 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-kngnh" podStartSLOduration=66.968430494 podStartE2EDuration="1m8.872537492s" totalImagesPullingTime="1.904106998s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:22:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:23:46.872128701 +0000 UTC m=+70.005094161" watchObservedRunningTime="2026-07-07 16:23:46.872537492 +0000 UTC m=+70.005502952" Jul 07 16:23:46.900417 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:46.899036 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-68b757fb67-wwrsk" podStartSLOduration=35.106259355 podStartE2EDuration="44.899018131s" totalImagesPullingTime="9.792758776s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:23:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:23:46.896543769 +0000 UTC m=+70.029509228" watchObservedRunningTime="2026-07-07 16:23:46.899018131 +0000 UTC m=+70.031983590" Jul 07 16:23:47.069094 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:47.068869 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-68b757fb67-wwrsk" Jul 07 16:23:48.025002 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:48.024961 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86c45bc684-958bz"] Jul 07 16:23:48.028229 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:48.028186 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86c45bc684-958bz" Jul 07 16:23:48.031242 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:48.031199 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-86677ccb7-7vb2b"] Jul 07 16:23:48.031753 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:48.031732 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-mrj5m\"" Jul 07 16:23:48.033339 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:48.033312 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 07 16:23:48.033339 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:48.033315 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 07 16:23:48.033513 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:48.033344 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 07 16:23:48.033653 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:48.033639 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 07 16:23:48.034140 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:48.034113 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86677ccb7-7vb2b" Jul 07 16:23:48.035184 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:48.035149 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76768d86c4-2wcdm"] Jul 07 16:23:48.037079 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:48.037058 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 07 16:23:48.038711 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:48.038695 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76768d86c4-2wcdm" Jul 07 16:23:48.043944 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:48.043926 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 07 16:23:48.044215 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:48.044192 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 07 16:23:48.044687 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:48.044669 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 07 16:23:48.045794 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:48.045769 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86c45bc684-958bz"] Jul 07 16:23:48.045867 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:48.045801 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 07 16:23:48.047019 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:48.046995 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-86677ccb7-7vb2b"] Jul 07 16:23:48.049640 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:48.049618 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76768d86c4-2wcdm"] Jul 07 16:23:48.129071 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:48.129036 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/ecd1529d-ebb0-45f2-874d-f33e6ae346f9-ca\") pod \"cluster-proxy-proxy-agent-76768d86c4-2wcdm\" (UID: \"ecd1529d-ebb0-45f2-874d-f33e6ae346f9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76768d86c4-2wcdm" Jul 07 16:23:48.129228 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:48.129118 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/101a8622-5e38-48c7-a81a-49aef45b5f98-klusterlet-config\") pod \"klusterlet-addon-workmgr-86677ccb7-7vb2b\" (UID: \"101a8622-5e38-48c7-a81a-49aef45b5f98\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86677ccb7-7vb2b" Jul 07 16:23:48.129228 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:48.129157 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ecd1529d-ebb0-45f2-874d-f33e6ae346f9-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-76768d86c4-2wcdm\" (UID: \"ecd1529d-ebb0-45f2-874d-f33e6ae346f9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76768d86c4-2wcdm" Jul 07 16:23:48.129228 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:48.129184 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xfwfr\" (UniqueName: \"kubernetes.io/projected/ecd1529d-ebb0-45f2-874d-f33e6ae346f9-kube-api-access-xfwfr\") pod \"cluster-proxy-proxy-agent-76768d86c4-2wcdm\" (UID: \"ecd1529d-ebb0-45f2-874d-f33e6ae346f9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76768d86c4-2wcdm" Jul 07 16:23:48.129377 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:48.129245 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvb7b\" (UniqueName: \"kubernetes.io/projected/101a8622-5e38-48c7-a81a-49aef45b5f98-kube-api-access-qvb7b\") pod \"klusterlet-addon-workmgr-86677ccb7-7vb2b\" (UID: \"101a8622-5e38-48c7-a81a-49aef45b5f98\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86677ccb7-7vb2b" Jul 07 16:23:48.129377 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:48.129289 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/101a8622-5e38-48c7-a81a-49aef45b5f98-tmp\") pod \"klusterlet-addon-workmgr-86677ccb7-7vb2b\" (UID: \"101a8622-5e38-48c7-a81a-49aef45b5f98\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86677ccb7-7vb2b" Jul 07 16:23:48.129460 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:48.129373 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/ecd1529d-ebb0-45f2-874d-f33e6ae346f9-hub\") pod \"cluster-proxy-proxy-agent-76768d86c4-2wcdm\" (UID: \"ecd1529d-ebb0-45f2-874d-f33e6ae346f9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76768d86c4-2wcdm" Jul 07 16:23:48.129502 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:48.129451 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1e4bb150-e982-4c22-b4f6-ee8528db3321-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-86c45bc684-958bz\" (UID: \"1e4bb150-e982-4c22-b4f6-ee8528db3321\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86c45bc684-958bz" Jul 07 16:23:48.129502 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:48.129489 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/ecd1529d-ebb0-45f2-874d-f33e6ae346f9-additional-service-ca\") pod \"cluster-proxy-proxy-agent-76768d86c4-2wcdm\" (UID: \"ecd1529d-ebb0-45f2-874d-f33e6ae346f9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76768d86c4-2wcdm" Jul 07 16:23:48.129589 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:48.129520 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qkfhh\" (UniqueName: \"kubernetes.io/projected/1e4bb150-e982-4c22-b4f6-ee8528db3321-kube-api-access-qkfhh\") pod \"managed-serviceaccount-addon-agent-86c45bc684-958bz\" (UID: \"1e4bb150-e982-4c22-b4f6-ee8528db3321\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86c45bc684-958bz" Jul 07 16:23:48.129643 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:48.129609 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/ecd1529d-ebb0-45f2-874d-f33e6ae346f9-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-76768d86c4-2wcdm\" (UID: \"ecd1529d-ebb0-45f2-874d-f33e6ae346f9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76768d86c4-2wcdm" Jul 07 16:23:48.133841 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:48.133809 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-685bfb5f64-2764c"] Jul 07 16:23:48.140528 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:48.140492 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-2764c" Jul 07 16:23:48.144519 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:48.144495 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 07 16:23:48.144630 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:48.144559 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 07 16:23:48.144936 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:48.144920 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-kflwh\"" Jul 07 16:23:48.152518 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:48.152492 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-2764c"] Jul 07 16:23:48.230601 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:48.230561 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1e4bb150-e982-4c22-b4f6-ee8528db3321-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-86c45bc684-958bz\" (UID: \"1e4bb150-e982-4c22-b4f6-ee8528db3321\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86c45bc684-958bz" Jul 07 16:23:48.230791 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:48.230606 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/ecd1529d-ebb0-45f2-874d-f33e6ae346f9-additional-service-ca\") pod \"cluster-proxy-proxy-agent-76768d86c4-2wcdm\" (UID: \"ecd1529d-ebb0-45f2-874d-f33e6ae346f9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76768d86c4-2wcdm" Jul 07 16:23:48.230791 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:48.230640 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qkfhh\" (UniqueName: \"kubernetes.io/projected/1e4bb150-e982-4c22-b4f6-ee8528db3321-kube-api-access-qkfhh\") pod \"managed-serviceaccount-addon-agent-86c45bc684-958bz\" (UID: \"1e4bb150-e982-4c22-b4f6-ee8528db3321\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86c45bc684-958bz" Jul 07 16:23:48.230791 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:48.230671 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lx24c\" (UniqueName: \"kubernetes.io/projected/9bb059a3-6f73-4ed3-9ab8-1a23a3c7880b-kube-api-access-lx24c\") pod \"downloads-685bfb5f64-2764c\" (UID: \"9bb059a3-6f73-4ed3-9ab8-1a23a3c7880b\") " pod="openshift-console/downloads-685bfb5f64-2764c" Jul 07 16:23:48.230791 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:48.230705 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/ecd1529d-ebb0-45f2-874d-f33e6ae346f9-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-76768d86c4-2wcdm\" (UID: \"ecd1529d-ebb0-45f2-874d-f33e6ae346f9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76768d86c4-2wcdm" Jul 07 16:23:48.230791 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:48.230769 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/ecd1529d-ebb0-45f2-874d-f33e6ae346f9-ca\") pod \"cluster-proxy-proxy-agent-76768d86c4-2wcdm\" (UID: \"ecd1529d-ebb0-45f2-874d-f33e6ae346f9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76768d86c4-2wcdm" Jul 07 16:23:48.231037 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:48.230839 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/101a8622-5e38-48c7-a81a-49aef45b5f98-klusterlet-config\") pod \"klusterlet-addon-workmgr-86677ccb7-7vb2b\" (UID: \"101a8622-5e38-48c7-a81a-49aef45b5f98\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86677ccb7-7vb2b" Jul 07 16:23:48.231037 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:48.230869 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ecd1529d-ebb0-45f2-874d-f33e6ae346f9-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-76768d86c4-2wcdm\" (UID: \"ecd1529d-ebb0-45f2-874d-f33e6ae346f9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76768d86c4-2wcdm" Jul 07 16:23:48.231037 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:48.230898 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xfwfr\" (UniqueName: \"kubernetes.io/projected/ecd1529d-ebb0-45f2-874d-f33e6ae346f9-kube-api-access-xfwfr\") pod \"cluster-proxy-proxy-agent-76768d86c4-2wcdm\" (UID: \"ecd1529d-ebb0-45f2-874d-f33e6ae346f9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76768d86c4-2wcdm" Jul 07 16:23:48.231037 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:48.230927 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qvb7b\" (UniqueName: \"kubernetes.io/projected/101a8622-5e38-48c7-a81a-49aef45b5f98-kube-api-access-qvb7b\") pod \"klusterlet-addon-workmgr-86677ccb7-7vb2b\" (UID: \"101a8622-5e38-48c7-a81a-49aef45b5f98\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86677ccb7-7vb2b" Jul 07 16:23:48.231037 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:48.230961 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/101a8622-5e38-48c7-a81a-49aef45b5f98-tmp\") pod \"klusterlet-addon-workmgr-86677ccb7-7vb2b\" (UID: \"101a8622-5e38-48c7-a81a-49aef45b5f98\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86677ccb7-7vb2b" Jul 07 16:23:48.231037 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:48.231011 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/ecd1529d-ebb0-45f2-874d-f33e6ae346f9-hub\") pod \"cluster-proxy-proxy-agent-76768d86c4-2wcdm\" (UID: \"ecd1529d-ebb0-45f2-874d-f33e6ae346f9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76768d86c4-2wcdm" Jul 07 16:23:48.231472 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:48.231413 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/101a8622-5e38-48c7-a81a-49aef45b5f98-tmp\") pod \"klusterlet-addon-workmgr-86677ccb7-7vb2b\" (UID: \"101a8622-5e38-48c7-a81a-49aef45b5f98\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86677ccb7-7vb2b" Jul 07 16:23:48.231596 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:48.231518 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/ecd1529d-ebb0-45f2-874d-f33e6ae346f9-additional-service-ca\") pod \"cluster-proxy-proxy-agent-76768d86c4-2wcdm\" (UID: \"ecd1529d-ebb0-45f2-874d-f33e6ae346f9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76768d86c4-2wcdm" Jul 07 16:23:48.234409 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:48.234193 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1e4bb150-e982-4c22-b4f6-ee8528db3321-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-86c45bc684-958bz\" (UID: \"1e4bb150-e982-4c22-b4f6-ee8528db3321\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86c45bc684-958bz" Jul 07 16:23:48.234409 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:48.234198 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/ecd1529d-ebb0-45f2-874d-f33e6ae346f9-ca\") pod \"cluster-proxy-proxy-agent-76768d86c4-2wcdm\" (UID: \"ecd1529d-ebb0-45f2-874d-f33e6ae346f9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76768d86c4-2wcdm" Jul 07 16:23:48.234409 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:48.234259 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/101a8622-5e38-48c7-a81a-49aef45b5f98-klusterlet-config\") pod \"klusterlet-addon-workmgr-86677ccb7-7vb2b\" (UID: \"101a8622-5e38-48c7-a81a-49aef45b5f98\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86677ccb7-7vb2b" Jul 07 16:23:48.234409 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:48.234355 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/ecd1529d-ebb0-45f2-874d-f33e6ae346f9-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-76768d86c4-2wcdm\" (UID: \"ecd1529d-ebb0-45f2-874d-f33e6ae346f9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76768d86c4-2wcdm" Jul 07 16:23:48.234691 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:48.234442 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ecd1529d-ebb0-45f2-874d-f33e6ae346f9-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-76768d86c4-2wcdm\" (UID: \"ecd1529d-ebb0-45f2-874d-f33e6ae346f9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76768d86c4-2wcdm" Jul 07 16:23:48.234691 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:48.234526 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/ecd1529d-ebb0-45f2-874d-f33e6ae346f9-hub\") pod \"cluster-proxy-proxy-agent-76768d86c4-2wcdm\" (UID: \"ecd1529d-ebb0-45f2-874d-f33e6ae346f9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76768d86c4-2wcdm" Jul 07 16:23:48.244459 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:48.244409 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvb7b\" (UniqueName: \"kubernetes.io/projected/101a8622-5e38-48c7-a81a-49aef45b5f98-kube-api-access-qvb7b\") pod \"klusterlet-addon-workmgr-86677ccb7-7vb2b\" (UID: \"101a8622-5e38-48c7-a81a-49aef45b5f98\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86677ccb7-7vb2b" Jul 07 16:23:48.244459 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:48.244444 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xfwfr\" (UniqueName: \"kubernetes.io/projected/ecd1529d-ebb0-45f2-874d-f33e6ae346f9-kube-api-access-xfwfr\") pod \"cluster-proxy-proxy-agent-76768d86c4-2wcdm\" (UID: \"ecd1529d-ebb0-45f2-874d-f33e6ae346f9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76768d86c4-2wcdm" Jul 07 16:23:48.245061 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:48.245018 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qkfhh\" (UniqueName: \"kubernetes.io/projected/1e4bb150-e982-4c22-b4f6-ee8528db3321-kube-api-access-qkfhh\") pod \"managed-serviceaccount-addon-agent-86c45bc684-958bz\" (UID: \"1e4bb150-e982-4c22-b4f6-ee8528db3321\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86c45bc684-958bz" Jul 07 16:23:48.332522 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:48.332427 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lx24c\" (UniqueName: \"kubernetes.io/projected/9bb059a3-6f73-4ed3-9ab8-1a23a3c7880b-kube-api-access-lx24c\") pod \"downloads-685bfb5f64-2764c\" (UID: \"9bb059a3-6f73-4ed3-9ab8-1a23a3c7880b\") " pod="openshift-console/downloads-685bfb5f64-2764c" Jul 07 16:23:48.346383 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:48.346331 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lx24c\" (UniqueName: \"kubernetes.io/projected/9bb059a3-6f73-4ed3-9ab8-1a23a3c7880b-kube-api-access-lx24c\") pod \"downloads-685bfb5f64-2764c\" (UID: \"9bb059a3-6f73-4ed3-9ab8-1a23a3c7880b\") " pod="openshift-console/downloads-685bfb5f64-2764c" Jul 07 16:23:48.349955 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:48.349932 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86c45bc684-958bz" Jul 07 16:23:48.359481 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:48.359458 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86677ccb7-7vb2b" Jul 07 16:23:48.365218 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:48.365185 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76768d86c4-2wcdm" Jul 07 16:23:48.457809 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:48.457762 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-2764c" Jul 07 16:23:52.825022 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:52.824814 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-2764c"] Jul 07 16:23:52.830434 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:23:52.828673 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bb059a3_6f73_4ed3_9ab8_1a23a3c7880b.slice/crio-6a6399e0dd1101bd2f4f1132631fb45023f92552e9c6ec18bb1a4c2cbdaf2401 WatchSource:0}: Error finding container 6a6399e0dd1101bd2f4f1132631fb45023f92552e9c6ec18bb1a4c2cbdaf2401: Status 404 returned error can't find the container with id 6a6399e0dd1101bd2f4f1132631fb45023f92552e9c6ec18bb1a4c2cbdaf2401 Jul 07 16:23:52.841751 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:52.841726 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76768d86c4-2wcdm"] Jul 07 16:23:52.880443 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:52.880356 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-2764c" event={"ID":"9bb059a3-6f73-4ed3-9ab8-1a23a3c7880b","Type":"ContainerStarted","Data":"6a6399e0dd1101bd2f4f1132631fb45023f92552e9c6ec18bb1a4c2cbdaf2401"} Jul 07 16:23:52.883903 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:52.883833 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-dbdhv" event={"ID":"22ef84ce-8d9a-48e7-bfbc-36e88476ce7d","Type":"ContainerStarted","Data":"6c40bbfb08cd201c77ed0c5cb9d885c72aa490b67b55ed817af3e4d0a567eda0"} Jul 07 16:23:52.887005 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:52.886967 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-xbz57" event={"ID":"31bd1f2b-6f2c-47cd-a0b5-0f5e1daf3038","Type":"ContainerStarted","Data":"677327488b9e3bda36bdf67e2d90f61a8c4569ca0279cdf8318f5c5547593e18"} Jul 07 16:23:52.889954 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:52.889892 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-8kqd8" event={"ID":"db1a7c4e-7b26-4e89-b989-7329dca3dfcf","Type":"ContainerStarted","Data":"d271d60c36862c708e602cf5cdbb4a3ade2d0e1d1ef9a76162e6aadbe5deefd7"} Jul 07 16:23:52.896270 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:52.896226 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76768d86c4-2wcdm" event={"ID":"ecd1529d-ebb0-45f2-874d-f33e6ae346f9","Type":"ContainerStarted","Data":"ed0da9bb8fe2799296d2dd14f1c62daff254f03ddee0c807570cff2900f9196e"} Jul 07 16:23:52.910393 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:52.909901 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-8kqd8" podStartSLOduration=43.387106638 podStartE2EDuration="50.909880524s" totalImagesPullingTime="7.522773886s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:23:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:23:52.909568599 +0000 UTC m=+76.042534059" watchObservedRunningTime="2026-07-07 16:23:52.909880524 +0000 UTC m=+76.042845984" Jul 07 16:23:53.081450 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:53.079470 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-86677ccb7-7vb2b"] Jul 07 16:23:53.081450 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:53.081117 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86c45bc684-958bz"] Jul 07 16:23:53.083783 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:23:53.083694 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1e4bb150_e982_4c22_b4f6_ee8528db3321.slice/crio-74e33bc7be064f0f878552f9c343772e5e94574c5e0a9a7adaff16a6f2075413 WatchSource:0}: Error finding container 74e33bc7be064f0f878552f9c343772e5e94574c5e0a9a7adaff16a6f2075413: Status 404 returned error can't find the container with id 74e33bc7be064f0f878552f9c343772e5e94574c5e0a9a7adaff16a6f2075413 Jul 07 16:23:53.085736 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:23:53.085704 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod101a8622_5e38_48c7_a81a_49aef45b5f98.slice/crio-26b280be61c5267f53fe08d2e5def8610c81f6d59224dc8caa33cd1f65404fc1 WatchSource:0}: Error finding container 26b280be61c5267f53fe08d2e5def8610c81f6d59224dc8caa33cd1f65404fc1: Status 404 returned error can't find the container with id 26b280be61c5267f53fe08d2e5def8610c81f6d59224dc8caa33cd1f65404fc1 Jul 07 16:23:53.903215 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:53.903156 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-m7r46" event={"ID":"5098470b-c5d3-46b1-9098-8fa69aeac854","Type":"ContainerStarted","Data":"1aa3d39cdef43d9c4ee1da510398cfd42f559c562e9390f8b184ea2b7236f23f"} Jul 07 16:23:53.903658 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:53.903234 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-m7r46" event={"ID":"5098470b-c5d3-46b1-9098-8fa69aeac854","Type":"ContainerStarted","Data":"924fed4471ed04aca78571aec210a7500d00347390fb2c28daaee28b6a8e6cd4"} Jul 07 16:23:53.903658 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:53.903386 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-m7r46" Jul 07 16:23:53.904588 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:53.904539 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86677ccb7-7vb2b" event={"ID":"101a8622-5e38-48c7-a81a-49aef45b5f98","Type":"ContainerStarted","Data":"26b280be61c5267f53fe08d2e5def8610c81f6d59224dc8caa33cd1f65404fc1"} Jul 07 16:23:53.906344 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:53.906323 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-8qbxw" event={"ID":"f5d16211-b5e0-4042-aeba-ba5d273ccd96","Type":"ContainerStarted","Data":"d645b16c4b1b8a6389c4d4064f7868639ea54b8323ce2b0a73a03d2eee241342"} Jul 07 16:23:53.908376 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:53.908349 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-w9n77" event={"ID":"5edb37e4-3383-438d-89dd-37841ca30b87","Type":"ContainerStarted","Data":"5014d983a67f8da90891b73cbf737be8119ba7fe3f0f4cc0e678f26739da8bd2"} Jul 07 16:23:53.909433 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:53.909410 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86c45bc684-958bz" event={"ID":"1e4bb150-e982-4c22-b4f6-ee8528db3321","Type":"ContainerStarted","Data":"74e33bc7be064f0f878552f9c343772e5e94574c5e0a9a7adaff16a6f2075413"} Jul 07 16:23:53.911060 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:53.911034 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-xbz57" event={"ID":"31bd1f2b-6f2c-47cd-a0b5-0f5e1daf3038","Type":"ContainerStarted","Data":"4bff26563e7ef740626c5fea43a9c9db08fe7b9d6a36ce51e532b1980e636243"} Jul 07 16:23:53.927193 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:53.927136 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-m7r46" podStartSLOduration=34.832863966 podStartE2EDuration="41.927115103s" totalImagesPullingTime="7.094251137s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:23:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:23:53.925094953 +0000 UTC m=+77.058060414" watchObservedRunningTime="2026-07-07 16:23:53.927115103 +0000 UTC m=+77.060080567" Jul 07 16:23:53.945002 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:53.944593 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-xbz57" podStartSLOduration=44.583027926 podStartE2EDuration="51.944573171s" totalImagesPullingTime="7.361545245s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:23:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:23:53.944530942 +0000 UTC m=+77.077496401" watchObservedRunningTime="2026-07-07 16:23:53.944573171 +0000 UTC m=+77.077538631" Jul 07 16:23:53.969474 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:53.969412 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6bffdf9778-dbdhv" podStartSLOduration=39.886827105 podStartE2EDuration="46.969388706s" totalImagesPullingTime="7.082561601s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:23:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:23:53.968187999 +0000 UTC m=+77.101153461" watchObservedRunningTime="2026-07-07 16:23:53.969388706 +0000 UTC m=+77.102354168" Jul 07 16:23:53.986843 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:53.986311 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-8qbxw" podStartSLOduration=65.750681911 podStartE2EDuration="1m15.986291724s" totalImagesPullingTime="10.235609813s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:22:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:23:53.985619581 +0000 UTC m=+77.118585040" watchObservedRunningTime="2026-07-07 16:23:53.986291724 +0000 UTC m=+77.119257187" Jul 07 16:23:54.022101 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:23:54.022017 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-w9n77" podStartSLOduration=18.39025154 podStartE2EDuration="30.021983607s" totalImagesPullingTime="11.631732067s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:23:24 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:23:54.020069851 +0000 UTC m=+77.153035311" watchObservedRunningTime="2026-07-07 16:23:54.021983607 +0000 UTC m=+77.154949068" Jul 07 16:24:00.948705 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:24:00.948667 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86677ccb7-7vb2b" event={"ID":"101a8622-5e38-48c7-a81a-49aef45b5f98","Type":"ContainerStarted","Data":"60ab472f0404e2e8431015ef79af1bafa73fbe174d8b21ec6a872ebe8aedb349"} Jul 07 16:24:00.949310 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:24:00.948862 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86677ccb7-7vb2b" Jul 07 16:24:00.950903 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:24:00.950880 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86677ccb7-7vb2b" Jul 07 16:24:00.951498 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:24:00.951434 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76768d86c4-2wcdm" event={"ID":"ecd1529d-ebb0-45f2-874d-f33e6ae346f9","Type":"ContainerStarted","Data":"8c3d10537c1e805020374754109855623ac14668bc5bf567746b07829bf7c3bb"} Jul 07 16:24:00.951498 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:24:00.951475 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76768d86c4-2wcdm" event={"ID":"ecd1529d-ebb0-45f2-874d-f33e6ae346f9","Type":"ContainerStarted","Data":"edf095d49d7a456464d36273fc9435cd22080663ef2f4ae08c94ac86ca2560b6"} Jul 07 16:24:00.951498 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:24:00.951494 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76768d86c4-2wcdm" event={"ID":"ecd1529d-ebb0-45f2-874d-f33e6ae346f9","Type":"ContainerStarted","Data":"f133cc1eac56e8beebf0209e815f260337e2eec539ffe8cab47d4f29d3c4b718"} Jul 07 16:24:00.953075 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:24:00.953052 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86c45bc684-958bz" event={"ID":"1e4bb150-e982-4c22-b4f6-ee8528db3321","Type":"ContainerStarted","Data":"9e9e433799827ce86300d0dbeef316e244875ad44928be4a777a36416ed7e804"} Jul 07 16:24:00.969799 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:24:00.969740 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86677ccb7-7vb2b" podStartSLOduration=5.858616236 podStartE2EDuration="12.969720014s" totalImagesPullingTime="7.111103778s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:23:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:24:00.969096739 +0000 UTC m=+84.102062198" watchObservedRunningTime="2026-07-07 16:24:00.969720014 +0000 UTC m=+84.102685474" Jul 07 16:24:00.989361 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:24:00.989308 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86c45bc684-958bz" podStartSLOduration=5.899455727 podStartE2EDuration="12.989288888s" totalImagesPullingTime="7.089833161s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:23:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:24:00.987807365 +0000 UTC m=+84.120772844" watchObservedRunningTime="2026-07-07 16:24:00.989288888 +0000 UTC m=+84.122254348" Jul 07 16:24:01.030416 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:24:01.030361 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76768d86c4-2wcdm" podStartSLOduration=5.69640349 podStartE2EDuration="13.030343191s" totalImagesPullingTime="7.333939701s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:23:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:24:01.028104453 +0000 UTC m=+84.161069914" watchObservedRunningTime="2026-07-07 16:24:01.030343191 +0000 UTC m=+84.163308650" Jul 07 16:24:03.921255 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:24:03.921227 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-m7r46" Jul 07 16:24:05.041311 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:24:05.041276 2552 patch_prober.go:28] interesting pod/image-registry-647ccd66c4-52n8x container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 07 16:24:05.041729 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:24:05.041333 2552 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-647ccd66c4-52n8x" podUID="7d398452-8b59-4802-b9dc-3332d2ddb17e" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 07 16:24:05.899691 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:24:05.899659 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-9rrbf"] Jul 07 16:24:05.903530 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:24:05.903508 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9rrbf" Jul 07 16:24:05.912038 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:24:05.911983 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 07 16:24:05.913512 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:24:05.912444 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 07 16:24:05.913512 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:24:05.912802 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 07 16:24:05.913512 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:24:05.912987 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 07 16:24:05.913512 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:24:05.913179 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-b7h4n\"" Jul 07 16:24:05.994035 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:24:05.994001 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0d0a557a-e779-4b4d-95bc-c758e5ade958-sys\") pod \"node-exporter-9rrbf\" (UID: \"0d0a557a-e779-4b4d-95bc-c758e5ade958\") " pod="openshift-monitoring/node-exporter-9rrbf" Jul 07 16:24:05.994231 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:24:05.994048 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0d0a557a-e779-4b4d-95bc-c758e5ade958-node-exporter-textfile\") pod \"node-exporter-9rrbf\" (UID: \"0d0a557a-e779-4b4d-95bc-c758e5ade958\") " pod="openshift-monitoring/node-exporter-9rrbf" Jul 07 16:24:05.994231 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:24:05.994085 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0d0a557a-e779-4b4d-95bc-c758e5ade958-node-exporter-tls\") pod \"node-exporter-9rrbf\" (UID: \"0d0a557a-e779-4b4d-95bc-c758e5ade958\") " pod="openshift-monitoring/node-exporter-9rrbf" Jul 07 16:24:05.994231 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:24:05.994108 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0d0a557a-e779-4b4d-95bc-c758e5ade958-metrics-client-ca\") pod \"node-exporter-9rrbf\" (UID: \"0d0a557a-e779-4b4d-95bc-c758e5ade958\") " pod="openshift-monitoring/node-exporter-9rrbf" Jul 07 16:24:05.994231 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:24:05.994133 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0d0a557a-e779-4b4d-95bc-c758e5ade958-node-exporter-accelerators-collector-config\") pod \"node-exporter-9rrbf\" (UID: \"0d0a557a-e779-4b4d-95bc-c758e5ade958\") " pod="openshift-monitoring/node-exporter-9rrbf" Jul 07 16:24:05.994231 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:24:05.994196 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0d0a557a-e779-4b4d-95bc-c758e5ade958-root\") pod \"node-exporter-9rrbf\" (UID: \"0d0a557a-e779-4b4d-95bc-c758e5ade958\") " pod="openshift-monitoring/node-exporter-9rrbf" Jul 07 16:24:05.994496 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:24:05.994242 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvvhm\" (UniqueName: \"kubernetes.io/projected/0d0a557a-e779-4b4d-95bc-c758e5ade958-kube-api-access-fvvhm\") pod \"node-exporter-9rrbf\" (UID: \"0d0a557a-e779-4b4d-95bc-c758e5ade958\") " pod="openshift-monitoring/node-exporter-9rrbf" Jul 07 16:24:05.994496 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:24:05.994283 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0d0a557a-e779-4b4d-95bc-c758e5ade958-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9rrbf\" (UID: \"0d0a557a-e779-4b4d-95bc-c758e5ade958\") " pod="openshift-monitoring/node-exporter-9rrbf" Jul 07 16:24:05.994496 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:24:05.994329 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0d0a557a-e779-4b4d-95bc-c758e5ade958-node-exporter-wtmp\") pod \"node-exporter-9rrbf\" (UID: \"0d0a557a-e779-4b4d-95bc-c758e5ade958\") " pod="openshift-monitoring/node-exporter-9rrbf" Jul 07 16:24:06.095298 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:24:06.095258 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0d0a557a-e779-4b4d-95bc-c758e5ade958-node-exporter-wtmp\") pod \"node-exporter-9rrbf\" (UID: \"0d0a557a-e779-4b4d-95bc-c758e5ade958\") " pod="openshift-monitoring/node-exporter-9rrbf" Jul 07 16:24:06.095741 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:24:06.095323 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0d0a557a-e779-4b4d-95bc-c758e5ade958-sys\") pod \"node-exporter-9rrbf\" (UID: \"0d0a557a-e779-4b4d-95bc-c758e5ade958\") " pod="openshift-monitoring/node-exporter-9rrbf" Jul 07 16:24:06.095741 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:24:06.095351 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0d0a557a-e779-4b4d-95bc-c758e5ade958-node-exporter-textfile\") pod \"node-exporter-9rrbf\" (UID: \"0d0a557a-e779-4b4d-95bc-c758e5ade958\") " pod="openshift-monitoring/node-exporter-9rrbf" Jul 07 16:24:06.095741 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:24:06.095392 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0d0a557a-e779-4b4d-95bc-c758e5ade958-node-exporter-tls\") pod \"node-exporter-9rrbf\" (UID: \"0d0a557a-e779-4b4d-95bc-c758e5ade958\") " pod="openshift-monitoring/node-exporter-9rrbf" Jul 07 16:24:06.095741 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:24:06.095415 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0d0a557a-e779-4b4d-95bc-c758e5ade958-metrics-client-ca\") pod \"node-exporter-9rrbf\" (UID: \"0d0a557a-e779-4b4d-95bc-c758e5ade958\") " pod="openshift-monitoring/node-exporter-9rrbf" Jul 07 16:24:06.095741 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:24:06.095445 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0d0a557a-e779-4b4d-95bc-c758e5ade958-node-exporter-accelerators-collector-config\") pod \"node-exporter-9rrbf\" (UID: \"0d0a557a-e779-4b4d-95bc-c758e5ade958\") " pod="openshift-monitoring/node-exporter-9rrbf" Jul 07 16:24:06.095741 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:24:06.095477 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0d0a557a-e779-4b4d-95bc-c758e5ade958-root\") pod \"node-exporter-9rrbf\" (UID: \"0d0a557a-e779-4b4d-95bc-c758e5ade958\") " pod="openshift-monitoring/node-exporter-9rrbf" Jul 07 16:24:06.095741 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:24:06.095503 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvvhm\" (UniqueName: \"kubernetes.io/projected/0d0a557a-e779-4b4d-95bc-c758e5ade958-kube-api-access-fvvhm\") pod \"node-exporter-9rrbf\" (UID: \"0d0a557a-e779-4b4d-95bc-c758e5ade958\") " pod="openshift-monitoring/node-exporter-9rrbf" Jul 07 16:24:06.095741 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:24:06.095548 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0d0a557a-e779-4b4d-95bc-c758e5ade958-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9rrbf\" (UID: \"0d0a557a-e779-4b4d-95bc-c758e5ade958\") " pod="openshift-monitoring/node-exporter-9rrbf" Jul 07 16:24:06.096137 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:24:06.096113 2552 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 07 16:24:06.096188 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:24:06.096182 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d0a557a-e779-4b4d-95bc-c758e5ade958-node-exporter-tls podName:0d0a557a-e779-4b4d-95bc-c758e5ade958 nodeName:}" failed. No retries permitted until 2026-07-07 16:24:06.59616045 +0000 UTC m=+89.729125889 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/0d0a557a-e779-4b4d-95bc-c758e5ade958-node-exporter-tls") pod "node-exporter-9rrbf" (UID: "0d0a557a-e779-4b4d-95bc-c758e5ade958") : secret "node-exporter-tls" not found Jul 07 16:24:06.097435 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:24:06.096583 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0d0a557a-e779-4b4d-95bc-c758e5ade958-node-exporter-wtmp\") pod \"node-exporter-9rrbf\" (UID: \"0d0a557a-e779-4b4d-95bc-c758e5ade958\") " pod="openshift-monitoring/node-exporter-9rrbf" Jul 07 16:24:06.097435 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:24:06.096649 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0d0a557a-e779-4b4d-95bc-c758e5ade958-sys\") pod \"node-exporter-9rrbf\" (UID: \"0d0a557a-e779-4b4d-95bc-c758e5ade958\") " pod="openshift-monitoring/node-exporter-9rrbf" Jul 07 16:24:06.097435 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:24:06.096820 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0d0a557a-e779-4b4d-95bc-c758e5ade958-node-exporter-textfile\") pod \"node-exporter-9rrbf\" (UID: \"0d0a557a-e779-4b4d-95bc-c758e5ade958\") " pod="openshift-monitoring/node-exporter-9rrbf" Jul 07 16:24:06.097435 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:24:06.097142 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0d0a557a-e779-4b4d-95bc-c758e5ade958-node-exporter-accelerators-collector-config\") pod \"node-exporter-9rrbf\" (UID: \"0d0a557a-e779-4b4d-95bc-c758e5ade958\") " pod="openshift-monitoring/node-exporter-9rrbf" Jul 07 16:24:06.097435 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:24:06.097224 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0d0a557a-e779-4b4d-95bc-c758e5ade958-root\") pod \"node-exporter-9rrbf\" (UID: \"0d0a557a-e779-4b4d-95bc-c758e5ade958\") " pod="openshift-monitoring/node-exporter-9rrbf" Jul 07 16:24:06.097435 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:24:06.097274 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0d0a557a-e779-4b4d-95bc-c758e5ade958-metrics-client-ca\") pod \"node-exporter-9rrbf\" (UID: \"0d0a557a-e779-4b4d-95bc-c758e5ade958\") " pod="openshift-monitoring/node-exporter-9rrbf" Jul 07 16:24:06.098647 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:24:06.098604 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0d0a557a-e779-4b4d-95bc-c758e5ade958-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9rrbf\" (UID: \"0d0a557a-e779-4b4d-95bc-c758e5ade958\") " pod="openshift-monitoring/node-exporter-9rrbf" Jul 07 16:24:06.109096 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:24:06.109053 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvvhm\" (UniqueName: \"kubernetes.io/projected/0d0a557a-e779-4b4d-95bc-c758e5ade958-kube-api-access-fvvhm\") pod \"node-exporter-9rrbf\" (UID: \"0d0a557a-e779-4b4d-95bc-c758e5ade958\") " pod="openshift-monitoring/node-exporter-9rrbf" Jul 07 16:24:06.602033 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:24:06.601993 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0d0a557a-e779-4b4d-95bc-c758e5ade958-node-exporter-tls\") pod \"node-exporter-9rrbf\" (UID: \"0d0a557a-e779-4b4d-95bc-c758e5ade958\") " pod="openshift-monitoring/node-exporter-9rrbf" Jul 07 16:24:06.604985 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:24:06.604958 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0d0a557a-e779-4b4d-95bc-c758e5ade958-node-exporter-tls\") pod \"node-exporter-9rrbf\" (UID: \"0d0a557a-e779-4b4d-95bc-c758e5ade958\") " pod="openshift-monitoring/node-exporter-9rrbf" Jul 07 16:24:06.816141 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:24:06.816099 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9rrbf" Jul 07 16:24:07.856444 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:24:07.856414 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-647ccd66c4-52n8x" Jul 07 16:24:11.795588 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:24:11.795554 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-647ccd66c4-52n8x"] Jul 07 16:24:13.608656 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:24:13.608624 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d0a557a_e779_4b4d_95bc_c758e5ade958.slice/crio-7db42ee4b0a2b6cb0d9690d38cbda08e3ef13ad1f9be1bdf9ed846b3b99784e9 WatchSource:0}: Error finding container 7db42ee4b0a2b6cb0d9690d38cbda08e3ef13ad1f9be1bdf9ed846b3b99784e9: Status 404 returned error can't find the container with id 7db42ee4b0a2b6cb0d9690d38cbda08e3ef13ad1f9be1bdf9ed846b3b99784e9 Jul 07 16:24:14.012377 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:24:14.012343 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9rrbf" event={"ID":"0d0a557a-e779-4b4d-95bc-c758e5ade958","Type":"ContainerStarted","Data":"7db42ee4b0a2b6cb0d9690d38cbda08e3ef13ad1f9be1bdf9ed846b3b99784e9"} Jul 07 16:24:15.018982 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:24:15.018937 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-2764c" event={"ID":"9bb059a3-6f73-4ed3-9ab8-1a23a3c7880b","Type":"ContainerStarted","Data":"3edf153f49477525bc2b3dae35789e49d0dc80116a5747838968a184543fbade"} Jul 07 16:24:15.019470 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:24:15.019162 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-685bfb5f64-2764c" Jul 07 16:24:15.039080 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:24:15.039031 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-685bfb5f64-2764c" podStartSLOduration=5.91233609 podStartE2EDuration="27.039012907s" totalImagesPullingTime="21.126676817s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:23:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:24:15.038634464 +0000 UTC m=+98.171599925" watchObservedRunningTime="2026-07-07 16:24:15.039012907 +0000 UTC m=+98.171978367" Jul 07 16:24:15.039818 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:24:15.039796 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-685bfb5f64-2764c" Jul 07 16:24:16.026266 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:24:16.026185 2552 generic.go:356] "Generic (PLEG): container finished" podID="0d0a557a-e779-4b4d-95bc-c758e5ade958" containerID="c695340055d810901a1b21a2208680f83175e7bd8d05f92ed5c235527066841a" exitCode=0 Jul 07 16:24:16.026266 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:24:16.026244 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9rrbf" event={"ID":"0d0a557a-e779-4b4d-95bc-c758e5ade958","Type":"ContainerDied","Data":"c695340055d810901a1b21a2208680f83175e7bd8d05f92ed5c235527066841a"} Jul 07 16:24:17.033848 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:24:17.033813 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9rrbf" event={"ID":"0d0a557a-e779-4b4d-95bc-c758e5ade958","Type":"ContainerStarted","Data":"88d82934731aa9045d237381d0c6941758076986d231f4ffbccd783147c98a74"} Jul 07 16:24:17.034367 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:24:17.033869 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9rrbf" event={"ID":"0d0a557a-e779-4b4d-95bc-c758e5ade958","Type":"ContainerStarted","Data":"dd5adb3ff23595c0d97fc8ff62b8e379d8d6c6f49d8453fde004f9403f99a03b"} Jul 07 16:24:17.074139 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:24:17.074085 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-9rrbf" podStartSLOduration=10.54531722 podStartE2EDuration="12.074069419s" totalImagesPullingTime="1.425656458s" totalInitContainerRuntime="103.095741ms" isStatefulPod=true podCreationTimestamp="2026-07-07 16:24:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:24:17.071911934 +0000 UTC m=+100.204877393" watchObservedRunningTime="2026-07-07 16:24:17.074069419 +0000 UTC m=+100.207034877" Jul 07 16:24:17.853893 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:24:17.853859 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-8br2k" Jul 07 16:24:35.107324 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:24:35.107291 2552 generic.go:356] "Generic (PLEG): container finished" podID="c82dfb11-b16f-4ed1-96b2-d4ab90984286" containerID="8feed2ee0d8feb9b0ae31b460d2b2a493e979843942abcd5c8a2eb4c41fcd66e" exitCode=0 Jul 07 16:24:35.107718 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:24:35.107364 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-w6fqx" event={"ID":"c82dfb11-b16f-4ed1-96b2-d4ab90984286","Type":"ContainerDied","Data":"8feed2ee0d8feb9b0ae31b460d2b2a493e979843942abcd5c8a2eb4c41fcd66e"} Jul 07 16:24:35.107718 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:24:35.107693 2552 scope.go:117] "RemoveContainer" containerID="8feed2ee0d8feb9b0ae31b460d2b2a493e979843942abcd5c8a2eb4c41fcd66e" Jul 07 16:24:36.112501 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:24:36.112465 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-w6fqx" event={"ID":"c82dfb11-b16f-4ed1-96b2-d4ab90984286","Type":"ContainerStarted","Data":"571df18138054d569db365cb9384d24871be7be82f14699ed87417ea271c7537"} Jul 07 16:24:36.824460 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:24:36.824412 2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-647ccd66c4-52n8x" podUID="7d398452-8b59-4802-b9dc-3332d2ddb17e" containerName="registry" containerID="cri-o://7a7426a8ee01ad94e89130f0cfbb270877ae95b9b82df11b14301448d5c81881" gracePeriod=30 Jul 07 16:24:37.105957 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:24:37.105921 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-647ccd66c4-52n8x" Jul 07 16:24:37.118289 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:24:37.118236 2552 generic.go:356] "Generic (PLEG): container finished" podID="7d398452-8b59-4802-b9dc-3332d2ddb17e" containerID="7a7426a8ee01ad94e89130f0cfbb270877ae95b9b82df11b14301448d5c81881" exitCode=0 Jul 07 16:24:37.118660 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:24:37.118337 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-647ccd66c4-52n8x" Jul 07 16:24:37.118660 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:24:37.118337 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-647ccd66c4-52n8x" event={"ID":"7d398452-8b59-4802-b9dc-3332d2ddb17e","Type":"ContainerDied","Data":"7a7426a8ee01ad94e89130f0cfbb270877ae95b9b82df11b14301448d5c81881"} Jul 07 16:24:37.118660 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:24:37.118484 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-647ccd66c4-52n8x" event={"ID":"7d398452-8b59-4802-b9dc-3332d2ddb17e","Type":"ContainerDied","Data":"2b30f3b7a6174f3e4b143714ccc5305f53b0d4f8048887102a6d9a8b96ef8d74"} Jul 07 16:24:37.118660 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:24:37.118509 2552 scope.go:117] "RemoveContainer" containerID="7a7426a8ee01ad94e89130f0cfbb270877ae95b9b82df11b14301448d5c81881" Jul 07 16:24:37.126405 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:24:37.126389 2552 scope.go:117] "RemoveContainer" containerID="7a7426a8ee01ad94e89130f0cfbb270877ae95b9b82df11b14301448d5c81881" Jul 07 16:24:37.126686 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:24:37.126664 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7a7426a8ee01ad94e89130f0cfbb270877ae95b9b82df11b14301448d5c81881\": container with ID starting with 7a7426a8ee01ad94e89130f0cfbb270877ae95b9b82df11b14301448d5c81881 not found: ID does not exist" containerID="7a7426a8ee01ad94e89130f0cfbb270877ae95b9b82df11b14301448d5c81881" Jul 07 16:24:37.126741 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:24:37.126698 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a7426a8ee01ad94e89130f0cfbb270877ae95b9b82df11b14301448d5c81881"} err="failed to get container status \"7a7426a8ee01ad94e89130f0cfbb270877ae95b9b82df11b14301448d5c81881\": rpc error: code = NotFound desc = could not find container \"7a7426a8ee01ad94e89130f0cfbb270877ae95b9b82df11b14301448d5c81881\": container with ID starting with 7a7426a8ee01ad94e89130f0cfbb270877ae95b9b82df11b14301448d5c81881 not found: ID does not exist" Jul 07 16:24:37.275523 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:24:37.275488 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7d398452-8b59-4802-b9dc-3332d2ddb17e-installation-pull-secrets\") pod \"7d398452-8b59-4802-b9dc-3332d2ddb17e\" (UID: \"7d398452-8b59-4802-b9dc-3332d2ddb17e\") " Jul 07 16:24:37.275703 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:24:37.275538 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7d398452-8b59-4802-b9dc-3332d2ddb17e-bound-sa-token\") pod \"7d398452-8b59-4802-b9dc-3332d2ddb17e\" (UID: \"7d398452-8b59-4802-b9dc-3332d2ddb17e\") " Jul 07 16:24:37.275703 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:24:37.275557 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-txcr7\" (UniqueName: \"kubernetes.io/projected/7d398452-8b59-4802-b9dc-3332d2ddb17e-kube-api-access-txcr7\") pod \"7d398452-8b59-4802-b9dc-3332d2ddb17e\" (UID: \"7d398452-8b59-4802-b9dc-3332d2ddb17e\") " Jul 07 16:24:37.275703 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:24:37.275574 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7d398452-8b59-4802-b9dc-3332d2ddb17e-trusted-ca\") pod \"7d398452-8b59-4802-b9dc-3332d2ddb17e\" (UID: \"7d398452-8b59-4802-b9dc-3332d2ddb17e\") " Jul 07 16:24:37.275703 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:24:37.275594 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7d398452-8b59-4802-b9dc-3332d2ddb17e-ca-trust-extracted\") pod \"7d398452-8b59-4802-b9dc-3332d2ddb17e\" (UID: \"7d398452-8b59-4802-b9dc-3332d2ddb17e\") " Jul 07 16:24:37.275703 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:24:37.275611 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7d398452-8b59-4802-b9dc-3332d2ddb17e-image-registry-private-configuration\") pod \"7d398452-8b59-4802-b9dc-3332d2ddb17e\" (UID: \"7d398452-8b59-4802-b9dc-3332d2ddb17e\") " Jul 07 16:24:37.275703 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:24:37.275661 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7d398452-8b59-4802-b9dc-3332d2ddb17e-registry-certificates\") pod \"7d398452-8b59-4802-b9dc-3332d2ddb17e\" (UID: \"7d398452-8b59-4802-b9dc-3332d2ddb17e\") " Jul 07 16:24:37.275982 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:24:37.275786 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7d398452-8b59-4802-b9dc-3332d2ddb17e-registry-tls\") pod \"7d398452-8b59-4802-b9dc-3332d2ddb17e\" (UID: \"7d398452-8b59-4802-b9dc-3332d2ddb17e\") " Jul 07 16:24:37.276102 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:24:37.276072 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d398452-8b59-4802-b9dc-3332d2ddb17e-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "7d398452-8b59-4802-b9dc-3332d2ddb17e" (UID: "7d398452-8b59-4802-b9dc-3332d2ddb17e"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 16:24:37.276222 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:24:37.276182 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d398452-8b59-4802-b9dc-3332d2ddb17e-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "7d398452-8b59-4802-b9dc-3332d2ddb17e" (UID: "7d398452-8b59-4802-b9dc-3332d2ddb17e"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 16:24:37.276477 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:24:37.276452 2552 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7d398452-8b59-4802-b9dc-3332d2ddb17e-registry-certificates\") on node \"ip-10-0-138-189.ec2.internal\" DevicePath \"\"" Jul 07 16:24:37.276477 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:24:37.276476 2552 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7d398452-8b59-4802-b9dc-3332d2ddb17e-trusted-ca\") on node \"ip-10-0-138-189.ec2.internal\" DevicePath \"\"" Jul 07 16:24:37.278264 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:24:37.278199 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d398452-8b59-4802-b9dc-3332d2ddb17e-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "7d398452-8b59-4802-b9dc-3332d2ddb17e" (UID: "7d398452-8b59-4802-b9dc-3332d2ddb17e"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 16:24:37.278379 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:24:37.278275 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d398452-8b59-4802-b9dc-3332d2ddb17e-kube-api-access-txcr7" (OuterVolumeSpecName: "kube-api-access-txcr7") pod "7d398452-8b59-4802-b9dc-3332d2ddb17e" (UID: "7d398452-8b59-4802-b9dc-3332d2ddb17e"). InnerVolumeSpecName "kube-api-access-txcr7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 16:24:37.278451 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:24:37.278414 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d398452-8b59-4802-b9dc-3332d2ddb17e-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "7d398452-8b59-4802-b9dc-3332d2ddb17e" (UID: "7d398452-8b59-4802-b9dc-3332d2ddb17e"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 16:24:37.278451 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:24:37.278437 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d398452-8b59-4802-b9dc-3332d2ddb17e-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "7d398452-8b59-4802-b9dc-3332d2ddb17e" (UID: "7d398452-8b59-4802-b9dc-3332d2ddb17e"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 16:24:37.278554 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:24:37.278467 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d398452-8b59-4802-b9dc-3332d2ddb17e-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "7d398452-8b59-4802-b9dc-3332d2ddb17e" (UID: "7d398452-8b59-4802-b9dc-3332d2ddb17e"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 16:24:37.284570 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:24:37.284549 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d398452-8b59-4802-b9dc-3332d2ddb17e-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "7d398452-8b59-4802-b9dc-3332d2ddb17e" (UID: "7d398452-8b59-4802-b9dc-3332d2ddb17e"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 16:24:37.377024 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:24:37.376997 2552 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7d398452-8b59-4802-b9dc-3332d2ddb17e-installation-pull-secrets\") on node \"ip-10-0-138-189.ec2.internal\" DevicePath \"\"" Jul 07 16:24:37.377149 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:24:37.377030 2552 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7d398452-8b59-4802-b9dc-3332d2ddb17e-bound-sa-token\") on node \"ip-10-0-138-189.ec2.internal\" DevicePath \"\"" Jul 07 16:24:37.377149 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:24:37.377045 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-txcr7\" (UniqueName: \"kubernetes.io/projected/7d398452-8b59-4802-b9dc-3332d2ddb17e-kube-api-access-txcr7\") on node \"ip-10-0-138-189.ec2.internal\" DevicePath \"\"" Jul 07 16:24:37.377149 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:24:37.377057 2552 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7d398452-8b59-4802-b9dc-3332d2ddb17e-ca-trust-extracted\") on node \"ip-10-0-138-189.ec2.internal\" DevicePath \"\"" Jul 07 16:24:37.377149 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:24:37.377068 2552 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7d398452-8b59-4802-b9dc-3332d2ddb17e-image-registry-private-configuration\") on node \"ip-10-0-138-189.ec2.internal\" DevicePath \"\"" Jul 07 16:24:37.377149 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:24:37.377077 2552 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7d398452-8b59-4802-b9dc-3332d2ddb17e-registry-tls\") on node \"ip-10-0-138-189.ec2.internal\" DevicePath \"\"" Jul 07 16:24:37.440468 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:24:37.440439 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-647ccd66c4-52n8x"] Jul 07 16:24:37.444319 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:24:37.444295 2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-647ccd66c4-52n8x"] Jul 07 16:24:39.440707 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:24:39.440670 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7d398452-8b59-4802-b9dc-3332d2ddb17e" path="/var/lib/kubelet/pods/7d398452-8b59-4802-b9dc-3332d2ddb17e/volumes" Jul 07 16:24:54.182606 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:24:54.182570 2552 generic.go:356] "Generic (PLEG): container finished" podID="c9428da5-4b2b-4c6a-bae9-0f0197fc5f78" containerID="3f8dd0715189fc05c77185e77522634b713724b625da93aef4e59b166f216e2d" exitCode=0 Jul 07 16:24:54.182977 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:24:54.182615 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-qf5bh" event={"ID":"c9428da5-4b2b-4c6a-bae9-0f0197fc5f78","Type":"ContainerDied","Data":"3f8dd0715189fc05c77185e77522634b713724b625da93aef4e59b166f216e2d"} Jul 07 16:24:54.183064 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:24:54.183049 2552 scope.go:117] "RemoveContainer" containerID="3f8dd0715189fc05c77185e77522634b713724b625da93aef4e59b166f216e2d" Jul 07 16:24:55.188717 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:24:55.188677 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-qf5bh" event={"ID":"c9428da5-4b2b-4c6a-bae9-0f0197fc5f78","Type":"ContainerStarted","Data":"cac91f7a5e094e04e6eb169eb641af7e878b8d0759f6fe70cf9c90431d42a8ed"} Jul 07 16:24:55.190167 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:24:55.190143 2552 generic.go:356] "Generic (PLEG): container finished" podID="08d889ae-b463-46fb-a51d-8a4b59146f6c" containerID="119ceaf9584b0753134146275499195a07a62a5c0b926386fcd16993270e7687" exitCode=0 Jul 07 16:24:55.190296 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:24:55.190182 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-b65f8" event={"ID":"08d889ae-b463-46fb-a51d-8a4b59146f6c","Type":"ContainerDied","Data":"119ceaf9584b0753134146275499195a07a62a5c0b926386fcd16993270e7687"} Jul 07 16:24:55.190483 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:24:55.190470 2552 scope.go:117] "RemoveContainer" containerID="119ceaf9584b0753134146275499195a07a62a5c0b926386fcd16993270e7687" Jul 07 16:24:56.196407 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:24:56.196374 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-b65f8" event={"ID":"08d889ae-b463-46fb-a51d-8a4b59146f6c","Type":"ContainerStarted","Data":"ec95f1e64feaeb5c3ba3b31fdc13831835a92280edd6c74c0ac719158a308296"} Jul 07 16:27:26.302470 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:27:26.302427 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6b65b5fdbc-dm259"] Jul 07 16:27:26.302938 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:27:26.302817 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d398452-8b59-4802-b9dc-3332d2ddb17e" containerName="registry" Jul 07 16:27:26.302938 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:27:26.302831 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d398452-8b59-4802-b9dc-3332d2ddb17e" containerName="registry" Jul 07 16:27:26.302938 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:27:26.302884 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d398452-8b59-4802-b9dc-3332d2ddb17e" containerName="registry" Jul 07 16:27:26.306136 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:27:26.306096 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6b65b5fdbc-dm259" Jul 07 16:27:26.313499 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:27:26.313467 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 07 16:27:26.314325 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:27:26.314306 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 07 16:27:26.314421 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:27:26.314350 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-vkgk9\"" Jul 07 16:27:26.314681 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:27:26.314661 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 07 16:27:26.314803 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:27:26.314690 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 07 16:27:26.333377 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:27:26.333354 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/272c2007-d9b7-4dee-9914-00387f2c68d4-tmp\") pod \"opendatahub-operator-controller-manager-6b65b5fdbc-dm259\" (UID: \"272c2007-d9b7-4dee-9914-00387f2c68d4\") " pod="opendatahub/opendatahub-operator-controller-manager-6b65b5fdbc-dm259" Jul 07 16:27:26.333486 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:27:26.333387 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/272c2007-d9b7-4dee-9914-00387f2c68d4-webhook-cert\") pod \"opendatahub-operator-controller-manager-6b65b5fdbc-dm259\" (UID: \"272c2007-d9b7-4dee-9914-00387f2c68d4\") " pod="opendatahub/opendatahub-operator-controller-manager-6b65b5fdbc-dm259" Jul 07 16:27:26.333486 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:27:26.333421 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/272c2007-d9b7-4dee-9914-00387f2c68d4-manifests\") pod \"opendatahub-operator-controller-manager-6b65b5fdbc-dm259\" (UID: \"272c2007-d9b7-4dee-9914-00387f2c68d4\") " pod="opendatahub/opendatahub-operator-controller-manager-6b65b5fdbc-dm259" Jul 07 16:27:26.333486 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:27:26.333447 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/272c2007-d9b7-4dee-9914-00387f2c68d4-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6b65b5fdbc-dm259\" (UID: \"272c2007-d9b7-4dee-9914-00387f2c68d4\") " pod="opendatahub/opendatahub-operator-controller-manager-6b65b5fdbc-dm259" Jul 07 16:27:26.333600 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:27:26.333527 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqzdt\" (UniqueName: \"kubernetes.io/projected/272c2007-d9b7-4dee-9914-00387f2c68d4-kube-api-access-nqzdt\") pod \"opendatahub-operator-controller-manager-6b65b5fdbc-dm259\" (UID: \"272c2007-d9b7-4dee-9914-00387f2c68d4\") " pod="opendatahub/opendatahub-operator-controller-manager-6b65b5fdbc-dm259" Jul 07 16:27:26.342137 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:27:26.342116 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6b65b5fdbc-dm259"] Jul 07 16:27:26.433973 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:27:26.433935 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/272c2007-d9b7-4dee-9914-00387f2c68d4-tmp\") pod \"opendatahub-operator-controller-manager-6b65b5fdbc-dm259\" (UID: \"272c2007-d9b7-4dee-9914-00387f2c68d4\") " pod="opendatahub/opendatahub-operator-controller-manager-6b65b5fdbc-dm259" Jul 07 16:27:26.433973 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:27:26.433977 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/272c2007-d9b7-4dee-9914-00387f2c68d4-webhook-cert\") pod \"opendatahub-operator-controller-manager-6b65b5fdbc-dm259\" (UID: \"272c2007-d9b7-4dee-9914-00387f2c68d4\") " pod="opendatahub/opendatahub-operator-controller-manager-6b65b5fdbc-dm259" Jul 07 16:27:26.434225 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:27:26.434023 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/272c2007-d9b7-4dee-9914-00387f2c68d4-manifests\") pod \"opendatahub-operator-controller-manager-6b65b5fdbc-dm259\" (UID: \"272c2007-d9b7-4dee-9914-00387f2c68d4\") " pod="opendatahub/opendatahub-operator-controller-manager-6b65b5fdbc-dm259" Jul 07 16:27:26.434225 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:27:26.434049 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/272c2007-d9b7-4dee-9914-00387f2c68d4-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6b65b5fdbc-dm259\" (UID: \"272c2007-d9b7-4dee-9914-00387f2c68d4\") " pod="opendatahub/opendatahub-operator-controller-manager-6b65b5fdbc-dm259" Jul 07 16:27:26.434225 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:27:26.434114 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqzdt\" (UniqueName: \"kubernetes.io/projected/272c2007-d9b7-4dee-9914-00387f2c68d4-kube-api-access-nqzdt\") pod \"opendatahub-operator-controller-manager-6b65b5fdbc-dm259\" (UID: \"272c2007-d9b7-4dee-9914-00387f2c68d4\") " pod="opendatahub/opendatahub-operator-controller-manager-6b65b5fdbc-dm259" Jul 07 16:27:26.434530 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:27:26.434505 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/272c2007-d9b7-4dee-9914-00387f2c68d4-manifests\") pod \"opendatahub-operator-controller-manager-6b65b5fdbc-dm259\" (UID: \"272c2007-d9b7-4dee-9914-00387f2c68d4\") " pod="opendatahub/opendatahub-operator-controller-manager-6b65b5fdbc-dm259" Jul 07 16:27:26.436343 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:27:26.436322 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/272c2007-d9b7-4dee-9914-00387f2c68d4-tmp\") pod \"opendatahub-operator-controller-manager-6b65b5fdbc-dm259\" (UID: \"272c2007-d9b7-4dee-9914-00387f2c68d4\") " pod="opendatahub/opendatahub-operator-controller-manager-6b65b5fdbc-dm259" Jul 07 16:27:26.436563 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:27:26.436545 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/272c2007-d9b7-4dee-9914-00387f2c68d4-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6b65b5fdbc-dm259\" (UID: \"272c2007-d9b7-4dee-9914-00387f2c68d4\") " pod="opendatahub/opendatahub-operator-controller-manager-6b65b5fdbc-dm259" Jul 07 16:27:26.436626 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:27:26.436563 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/272c2007-d9b7-4dee-9914-00387f2c68d4-webhook-cert\") pod \"opendatahub-operator-controller-manager-6b65b5fdbc-dm259\" (UID: \"272c2007-d9b7-4dee-9914-00387f2c68d4\") " pod="opendatahub/opendatahub-operator-controller-manager-6b65b5fdbc-dm259" Jul 07 16:27:26.451897 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:27:26.451869 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqzdt\" (UniqueName: \"kubernetes.io/projected/272c2007-d9b7-4dee-9914-00387f2c68d4-kube-api-access-nqzdt\") pod \"opendatahub-operator-controller-manager-6b65b5fdbc-dm259\" (UID: \"272c2007-d9b7-4dee-9914-00387f2c68d4\") " pod="opendatahub/opendatahub-operator-controller-manager-6b65b5fdbc-dm259" Jul 07 16:27:26.617530 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:27:26.617439 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6b65b5fdbc-dm259" Jul 07 16:27:26.754529 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:27:26.754503 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6b65b5fdbc-dm259"] Jul 07 16:27:26.756446 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:27:26.756415 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod272c2007_d9b7_4dee_9914_00387f2c68d4.slice/crio-31ad6f391b5e86bd652dddee8c8258c0b4be40b7129f907223899d6e3c914c47 WatchSource:0}: Error finding container 31ad6f391b5e86bd652dddee8c8258c0b4be40b7129f907223899d6e3c914c47: Status 404 returned error can't find the container with id 31ad6f391b5e86bd652dddee8c8258c0b4be40b7129f907223899d6e3c914c47 Jul 07 16:27:26.776553 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:27:26.776525 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6b65b5fdbc-dm259" event={"ID":"272c2007-d9b7-4dee-9914-00387f2c68d4","Type":"ContainerStarted","Data":"31ad6f391b5e86bd652dddee8c8258c0b4be40b7129f907223899d6e3c914c47"} Jul 07 16:27:30.797363 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:27:30.797320 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6b65b5fdbc-dm259" event={"ID":"272c2007-d9b7-4dee-9914-00387f2c68d4","Type":"ContainerStarted","Data":"c7deb88ee6770a98311fc51a368dafe359c4272ccdce6c58def181cc2465f7ed"} Jul 07 16:27:31.802547 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:27:31.802505 2552 generic.go:356] "Generic (PLEG): container finished" podID="272c2007-d9b7-4dee-9914-00387f2c68d4" containerID="c7deb88ee6770a98311fc51a368dafe359c4272ccdce6c58def181cc2465f7ed" exitCode=0 Jul 07 16:27:31.802913 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:27:31.802579 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6b65b5fdbc-dm259" event={"ID":"272c2007-d9b7-4dee-9914-00387f2c68d4","Type":"ContainerDied","Data":"c7deb88ee6770a98311fc51a368dafe359c4272ccdce6c58def181cc2465f7ed"} Jul 07 16:27:32.398139 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:27:32.398101 2552 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = unable to pull image or OCI artifact: pull image err: copying system image from manifest list: parsing image configuration: fetching blob: received unexpected HTTP status: 503 Service Unavailable; artifact err: provided artifact is a container image" image="quay.io/opendatahub/opendatahub-operator:v3.5.0-ea.2" Jul 07 16:27:32.398329 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:27:32.398250 2552 kuberuntime_manager.go:1459] "Unhandled Error" err="container manager start failed in pod opendatahub-operator-controller-manager-6b65b5fdbc-dm259_opendatahub(272c2007-d9b7-4dee-9914-00387f2c68d4): ErrImagePull: unable to pull image or OCI artifact: pull image err: copying system image from manifest list: parsing image configuration: fetching blob: received unexpected HTTP status: 503 Service Unavailable; artifact err: provided artifact is a container image" logger="UnhandledError" Jul 07 16:27:32.398329 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:27:32.398282 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ErrImagePull: \"unable to pull image or OCI artifact: pull image err: copying system image from manifest list: parsing image configuration: fetching blob: received unexpected HTTP status: 503 Service Unavailable; artifact err: provided artifact is a container image\"" pod="opendatahub/opendatahub-operator-controller-manager-6b65b5fdbc-dm259" podUID="272c2007-d9b7-4dee-9914-00387f2c68d4" Jul 07 16:27:32.807878 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:27:32.807777 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/opendatahub/opendatahub-operator:v3.5.0-ea.2\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: copying system image from manifest list: parsing image configuration: fetching blob: received unexpected HTTP status: 503 Service Unavailable; artifact err: provided artifact is a container image\"" pod="opendatahub/opendatahub-operator-controller-manager-6b65b5fdbc-dm259" podUID="272c2007-d9b7-4dee-9914-00387f2c68d4" Jul 07 16:27:37.302485 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:27:37.302454 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-wwrsk_ab9458b7-cc16-493e-90f5-ff72d3b10ac7/console-operator/1.log" Jul 07 16:27:37.307102 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:27:37.307078 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dbbfb_a1abd5d4-cd31-4b5b-9011-9dd0f248ce19/ovn-acl-logging/0.log" Jul 07 16:27:37.308334 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:27:37.308316 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-wwrsk_ab9458b7-cc16-493e-90f5-ff72d3b10ac7/console-operator/1.log" Jul 07 16:27:37.313056 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:27:37.313040 2552 kubelet.go:1648] "Image garbage collection succeeded" Jul 07 16:27:37.313807 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:27:37.313789 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dbbfb_a1abd5d4-cd31-4b5b-9011-9dd0f248ce19/ovn-acl-logging/0.log" Jul 07 16:27:44.436283 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:27:44.436244 2552 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 16:27:45.861897 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:27:45.861861 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6b65b5fdbc-dm259" event={"ID":"272c2007-d9b7-4dee-9914-00387f2c68d4","Type":"ContainerStarted","Data":"9a78889f8d6c9950724b80feba24e1dbeaf054020df21ee4dc1816ff0ed3bffb"} Jul 07 16:27:45.862287 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:27:45.862082 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6b65b5fdbc-dm259" Jul 07 16:27:45.886210 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:27:45.886161 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6b65b5fdbc-dm259" podStartSLOduration=2.6017005380000002 podStartE2EDuration="19.886147275s" totalImagesPullingTime="16.21391117s" totalInitContainerRuntime="1.070535567s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:27:26 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=1 observedRunningTime="2026-07-07 16:27:45.885652626 +0000 UTC m=+309.018618087" watchObservedRunningTime="2026-07-07 16:27:45.886147275 +0000 UTC m=+309.019112732" Jul 07 16:27:56.867938 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:27:56.867903 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6b65b5fdbc-dm259" Jul 07 16:27:59.226704 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:27:59.226669 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7c9bdf7f84-nk2d8"] Jul 07 16:27:59.229683 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:27:59.229667 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7c9bdf7f84-nk2d8" Jul 07 16:27:59.232328 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:27:59.232309 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-mcqpd\"" Jul 07 16:27:59.232755 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:27:59.232737 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 07 16:27:59.232755 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:27:59.232748 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 07 16:27:59.240543 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:27:59.240520 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7c9bdf7f84-nk2d8"] Jul 07 16:27:59.326345 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:27:59.326301 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/76c522d1-b95d-42f6-9c00-65f89d972926-tls-certs\") pod \"kube-auth-proxy-7c9bdf7f84-nk2d8\" (UID: \"76c522d1-b95d-42f6-9c00-65f89d972926\") " pod="openshift-ingress/kube-auth-proxy-7c9bdf7f84-nk2d8" Jul 07 16:27:59.326516 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:27:59.326357 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fn8fc\" (UniqueName: \"kubernetes.io/projected/76c522d1-b95d-42f6-9c00-65f89d972926-kube-api-access-fn8fc\") pod \"kube-auth-proxy-7c9bdf7f84-nk2d8\" (UID: \"76c522d1-b95d-42f6-9c00-65f89d972926\") " pod="openshift-ingress/kube-auth-proxy-7c9bdf7f84-nk2d8" Jul 07 16:27:59.326516 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:27:59.326444 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/76c522d1-b95d-42f6-9c00-65f89d972926-tmp\") pod \"kube-auth-proxy-7c9bdf7f84-nk2d8\" (UID: \"76c522d1-b95d-42f6-9c00-65f89d972926\") " pod="openshift-ingress/kube-auth-proxy-7c9bdf7f84-nk2d8" Jul 07 16:27:59.427801 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:27:59.427765 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/76c522d1-b95d-42f6-9c00-65f89d972926-tmp\") pod \"kube-auth-proxy-7c9bdf7f84-nk2d8\" (UID: \"76c522d1-b95d-42f6-9c00-65f89d972926\") " pod="openshift-ingress/kube-auth-proxy-7c9bdf7f84-nk2d8" Jul 07 16:27:59.427957 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:27:59.427839 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/76c522d1-b95d-42f6-9c00-65f89d972926-tls-certs\") pod \"kube-auth-proxy-7c9bdf7f84-nk2d8\" (UID: \"76c522d1-b95d-42f6-9c00-65f89d972926\") " pod="openshift-ingress/kube-auth-proxy-7c9bdf7f84-nk2d8" Jul 07 16:27:59.427957 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:27:59.427861 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fn8fc\" (UniqueName: \"kubernetes.io/projected/76c522d1-b95d-42f6-9c00-65f89d972926-kube-api-access-fn8fc\") pod \"kube-auth-proxy-7c9bdf7f84-nk2d8\" (UID: \"76c522d1-b95d-42f6-9c00-65f89d972926\") " pod="openshift-ingress/kube-auth-proxy-7c9bdf7f84-nk2d8" Jul 07 16:27:59.430124 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:27:59.430096 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/76c522d1-b95d-42f6-9c00-65f89d972926-tmp\") pod \"kube-auth-proxy-7c9bdf7f84-nk2d8\" (UID: \"76c522d1-b95d-42f6-9c00-65f89d972926\") " pod="openshift-ingress/kube-auth-proxy-7c9bdf7f84-nk2d8" Jul 07 16:27:59.430327 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:27:59.430307 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/76c522d1-b95d-42f6-9c00-65f89d972926-tls-certs\") pod \"kube-auth-proxy-7c9bdf7f84-nk2d8\" (UID: \"76c522d1-b95d-42f6-9c00-65f89d972926\") " pod="openshift-ingress/kube-auth-proxy-7c9bdf7f84-nk2d8" Jul 07 16:27:59.441790 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:27:59.441571 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fn8fc\" (UniqueName: \"kubernetes.io/projected/76c522d1-b95d-42f6-9c00-65f89d972926-kube-api-access-fn8fc\") pod \"kube-auth-proxy-7c9bdf7f84-nk2d8\" (UID: \"76c522d1-b95d-42f6-9c00-65f89d972926\") " pod="openshift-ingress/kube-auth-proxy-7c9bdf7f84-nk2d8" Jul 07 16:27:59.455944 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:27:59.455904 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-xz26v"] Jul 07 16:27:59.458997 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:27:59.458978 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-xz26v" Jul 07 16:27:59.462048 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:27:59.462026 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jul 07 16:27:59.462226 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:27:59.462052 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-s7xbg\"" Jul 07 16:27:59.473771 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:27:59.473744 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-xz26v"] Jul 07 16:27:59.540259 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:27:59.540156 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7c9bdf7f84-nk2d8" Jul 07 16:27:59.628763 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:27:59.628734 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-drz6d\" (UniqueName: \"kubernetes.io/projected/45774b18-ee9b-4cbf-ad61-b0c90c204a23-kube-api-access-drz6d\") pod \"odh-model-controller-7998c67dc4-xz26v\" (UID: \"45774b18-ee9b-4cbf-ad61-b0c90c204a23\") " pod="opendatahub/odh-model-controller-7998c67dc4-xz26v" Jul 07 16:27:59.628913 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:27:59.628773 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/45774b18-ee9b-4cbf-ad61-b0c90c204a23-cert\") pod \"odh-model-controller-7998c67dc4-xz26v\" (UID: \"45774b18-ee9b-4cbf-ad61-b0c90c204a23\") " pod="opendatahub/odh-model-controller-7998c67dc4-xz26v" Jul 07 16:27:59.692753 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:27:59.692724 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7c9bdf7f84-nk2d8"] Jul 07 16:27:59.694703 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:27:59.694672 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76c522d1_b95d_42f6_9c00_65f89d972926.slice/crio-33bfa010fba5036fa908681c10ddd14c175260258e0ac8897e6b9f9bafd5d0cb WatchSource:0}: Error finding container 33bfa010fba5036fa908681c10ddd14c175260258e0ac8897e6b9f9bafd5d0cb: Status 404 returned error can't find the container with id 33bfa010fba5036fa908681c10ddd14c175260258e0ac8897e6b9f9bafd5d0cb Jul 07 16:27:59.729382 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:27:59.729341 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/45774b18-ee9b-4cbf-ad61-b0c90c204a23-cert\") pod \"odh-model-controller-7998c67dc4-xz26v\" (UID: \"45774b18-ee9b-4cbf-ad61-b0c90c204a23\") " pod="opendatahub/odh-model-controller-7998c67dc4-xz26v" Jul 07 16:27:59.729557 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:27:59.729469 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-drz6d\" (UniqueName: \"kubernetes.io/projected/45774b18-ee9b-4cbf-ad61-b0c90c204a23-kube-api-access-drz6d\") pod \"odh-model-controller-7998c67dc4-xz26v\" (UID: \"45774b18-ee9b-4cbf-ad61-b0c90c204a23\") " pod="opendatahub/odh-model-controller-7998c67dc4-xz26v" Jul 07 16:27:59.731752 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:27:59.731732 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/45774b18-ee9b-4cbf-ad61-b0c90c204a23-cert\") pod \"odh-model-controller-7998c67dc4-xz26v\" (UID: \"45774b18-ee9b-4cbf-ad61-b0c90c204a23\") " pod="opendatahub/odh-model-controller-7998c67dc4-xz26v" Jul 07 16:27:59.742548 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:27:59.742524 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-drz6d\" (UniqueName: \"kubernetes.io/projected/45774b18-ee9b-4cbf-ad61-b0c90c204a23-kube-api-access-drz6d\") pod \"odh-model-controller-7998c67dc4-xz26v\" (UID: \"45774b18-ee9b-4cbf-ad61-b0c90c204a23\") " pod="opendatahub/odh-model-controller-7998c67dc4-xz26v" Jul 07 16:27:59.769531 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:27:59.769495 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-xz26v" Jul 07 16:27:59.906272 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:27:59.906244 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-xz26v"] Jul 07 16:27:59.908110 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:27:59.908085 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45774b18_ee9b_4cbf_ad61_b0c90c204a23.slice/crio-3922e3e5b50f3f1be5dc08a288e1fdb80210f78f56f43ce1e37cb41b95ca9d18 WatchSource:0}: Error finding container 3922e3e5b50f3f1be5dc08a288e1fdb80210f78f56f43ce1e37cb41b95ca9d18: Status 404 returned error can't find the container with id 3922e3e5b50f3f1be5dc08a288e1fdb80210f78f56f43ce1e37cb41b95ca9d18 Jul 07 16:27:59.918501 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:27:59.918473 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-xz26v" event={"ID":"45774b18-ee9b-4cbf-ad61-b0c90c204a23","Type":"ContainerStarted","Data":"3922e3e5b50f3f1be5dc08a288e1fdb80210f78f56f43ce1e37cb41b95ca9d18"} Jul 07 16:27:59.919416 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:27:59.919395 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7c9bdf7f84-nk2d8" event={"ID":"76c522d1-b95d-42f6-9c00-65f89d972926","Type":"ContainerStarted","Data":"33bfa010fba5036fa908681c10ddd14c175260258e0ac8897e6b9f9bafd5d0cb"} Jul 07 16:28:00.378129 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:28:00.378086 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-hkm4g"] Jul 07 16:28:00.381889 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:28:00.381872 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-hkm4g" Jul 07 16:28:00.386076 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:28:00.386051 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jul 07 16:28:00.405512 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:28:00.405475 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-hkm4g"] Jul 07 16:28:00.536261 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:28:00.536222 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/64d274b9-1a3b-4ee6-82b2-60edc42a52ed-tls-certs\") pod \"model-serving-api-54d89bd5fc-hkm4g\" (UID: \"64d274b9-1a3b-4ee6-82b2-60edc42a52ed\") " pod="opendatahub/model-serving-api-54d89bd5fc-hkm4g" Jul 07 16:28:00.536442 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:28:00.536364 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gcmnf\" (UniqueName: \"kubernetes.io/projected/64d274b9-1a3b-4ee6-82b2-60edc42a52ed-kube-api-access-gcmnf\") pod \"model-serving-api-54d89bd5fc-hkm4g\" (UID: \"64d274b9-1a3b-4ee6-82b2-60edc42a52ed\") " pod="opendatahub/model-serving-api-54d89bd5fc-hkm4g" Jul 07 16:28:00.636966 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:28:00.636881 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/64d274b9-1a3b-4ee6-82b2-60edc42a52ed-tls-certs\") pod \"model-serving-api-54d89bd5fc-hkm4g\" (UID: \"64d274b9-1a3b-4ee6-82b2-60edc42a52ed\") " pod="opendatahub/model-serving-api-54d89bd5fc-hkm4g" Jul 07 16:28:00.637155 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:28:00.636984 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gcmnf\" (UniqueName: \"kubernetes.io/projected/64d274b9-1a3b-4ee6-82b2-60edc42a52ed-kube-api-access-gcmnf\") pod \"model-serving-api-54d89bd5fc-hkm4g\" (UID: \"64d274b9-1a3b-4ee6-82b2-60edc42a52ed\") " pod="opendatahub/model-serving-api-54d89bd5fc-hkm4g" Jul 07 16:28:00.640077 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:28:00.640050 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/64d274b9-1a3b-4ee6-82b2-60edc42a52ed-tls-certs\") pod \"model-serving-api-54d89bd5fc-hkm4g\" (UID: \"64d274b9-1a3b-4ee6-82b2-60edc42a52ed\") " pod="opendatahub/model-serving-api-54d89bd5fc-hkm4g" Jul 07 16:28:00.657424 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:28:00.657392 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gcmnf\" (UniqueName: \"kubernetes.io/projected/64d274b9-1a3b-4ee6-82b2-60edc42a52ed-kube-api-access-gcmnf\") pod \"model-serving-api-54d89bd5fc-hkm4g\" (UID: \"64d274b9-1a3b-4ee6-82b2-60edc42a52ed\") " pod="opendatahub/model-serving-api-54d89bd5fc-hkm4g" Jul 07 16:28:00.692741 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:28:00.692449 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-hkm4g" Jul 07 16:28:00.894154 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:28:00.894119 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-hkm4g"] Jul 07 16:28:00.926612 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:28:00.926570 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-hkm4g" event={"ID":"64d274b9-1a3b-4ee6-82b2-60edc42a52ed","Type":"ContainerStarted","Data":"b7266ff202dde7498f636a9363c149272676f7a44e8f9645e1e80895e1cca7a5"} Jul 07 16:28:04.952025 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:28:04.951988 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7c9bdf7f84-nk2d8" event={"ID":"76c522d1-b95d-42f6-9c00-65f89d972926","Type":"ContainerStarted","Data":"5fab4a9c9252006cbba18f5d09c826c531ddbbbe1e0ef69c898539a4001f4519"} Jul 07 16:28:04.953512 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:28:04.953487 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-hkm4g" event={"ID":"64d274b9-1a3b-4ee6-82b2-60edc42a52ed","Type":"ContainerStarted","Data":"1ff3aba0bfa05bb9db37bbb0bc16b131ede54d4359a3d6bb45e2492e36470303"} Jul 07 16:28:04.953607 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:28:04.953591 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-hkm4g" Jul 07 16:28:04.954887 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:28:04.954864 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-xz26v" event={"ID":"45774b18-ee9b-4cbf-ad61-b0c90c204a23","Type":"ContainerStarted","Data":"b009603f2656d0f77684609eaa034f4f930043c7c69024e1f2a4a1198f95402b"} Jul 07 16:28:04.954977 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:28:04.954926 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-xz26v" Jul 07 16:28:04.971620 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:28:04.971573 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7c9bdf7f84-nk2d8" podStartSLOduration=1.642712896 podStartE2EDuration="5.971543888s" totalImagesPullingTime="4.328830992s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:27:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:28:04.970120277 +0000 UTC m=+328.103085737" watchObservedRunningTime="2026-07-07 16:28:04.971543888 +0000 UTC m=+328.104509347" Jul 07 16:28:04.986763 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:28:04.986716 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-xz26v" podStartSLOduration=1.8769088040000002 podStartE2EDuration="5.986702224s" totalImagesPullingTime="4.10979342s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:27:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:28:04.986351798 +0000 UTC m=+328.119317257" watchObservedRunningTime="2026-07-07 16:28:04.986702224 +0000 UTC m=+328.119667682" Jul 07 16:28:05.006925 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:28:05.006856 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-hkm4g" podStartSLOduration=1.8733418849999999 podStartE2EDuration="5.006832529s" totalImagesPullingTime="3.133490644s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:28:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:28:05.00527588 +0000 UTC m=+328.138241335" watchObservedRunningTime="2026-07-07 16:28:05.006832529 +0000 UTC m=+328.139797989" Jul 07 16:28:07.361522 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:28:07.361485 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf464f6k"] Jul 07 16:28:07.364791 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:28:07.364773 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf464f6k" Jul 07 16:28:07.367573 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:28:07.367552 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-d8w8j\"" Jul 07 16:28:07.367702 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:28:07.367558 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 07 16:28:07.380068 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:28:07.380042 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf464f6k"] Jul 07 16:28:07.404378 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:28:07.404339 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/00f5dbed-2ca2-4def-a1c3-d489ca5ca9cc-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf464f6k\" (UID: \"00f5dbed-2ca2-4def-a1c3-d489ca5ca9cc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf464f6k" Jul 07 16:28:07.404378 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:28:07.404380 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/00f5dbed-2ca2-4def-a1c3-d489ca5ca9cc-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf464f6k\" (UID: \"00f5dbed-2ca2-4def-a1c3-d489ca5ca9cc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf464f6k" Jul 07 16:28:07.404611 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:28:07.404398 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ht97\" (UniqueName: \"kubernetes.io/projected/00f5dbed-2ca2-4def-a1c3-d489ca5ca9cc-kube-api-access-5ht97\") pod \"data-science-gateway-data-science-gateway-class-6576859cf464f6k\" (UID: \"00f5dbed-2ca2-4def-a1c3-d489ca5ca9cc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf464f6k" Jul 07 16:28:07.404611 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:28:07.404450 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/00f5dbed-2ca2-4def-a1c3-d489ca5ca9cc-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf464f6k\" (UID: \"00f5dbed-2ca2-4def-a1c3-d489ca5ca9cc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf464f6k" Jul 07 16:28:07.404611 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:28:07.404495 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/00f5dbed-2ca2-4def-a1c3-d489ca5ca9cc-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf464f6k\" (UID: \"00f5dbed-2ca2-4def-a1c3-d489ca5ca9cc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf464f6k" Jul 07 16:28:07.404611 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:28:07.404528 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/00f5dbed-2ca2-4def-a1c3-d489ca5ca9cc-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf464f6k\" (UID: \"00f5dbed-2ca2-4def-a1c3-d489ca5ca9cc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf464f6k" Jul 07 16:28:07.404611 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:28:07.404590 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/00f5dbed-2ca2-4def-a1c3-d489ca5ca9cc-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf464f6k\" (UID: \"00f5dbed-2ca2-4def-a1c3-d489ca5ca9cc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf464f6k" Jul 07 16:28:07.404849 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:28:07.404623 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/00f5dbed-2ca2-4def-a1c3-d489ca5ca9cc-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf464f6k\" (UID: \"00f5dbed-2ca2-4def-a1c3-d489ca5ca9cc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf464f6k" Jul 07 16:28:07.404849 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:28:07.404670 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/00f5dbed-2ca2-4def-a1c3-d489ca5ca9cc-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf464f6k\" (UID: \"00f5dbed-2ca2-4def-a1c3-d489ca5ca9cc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf464f6k" Jul 07 16:28:07.506016 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:28:07.505969 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/00f5dbed-2ca2-4def-a1c3-d489ca5ca9cc-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf464f6k\" (UID: \"00f5dbed-2ca2-4def-a1c3-d489ca5ca9cc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf464f6k" Jul 07 16:28:07.506228 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:28:07.506042 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/00f5dbed-2ca2-4def-a1c3-d489ca5ca9cc-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf464f6k\" (UID: \"00f5dbed-2ca2-4def-a1c3-d489ca5ca9cc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf464f6k" Jul 07 16:28:07.506228 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:28:07.506092 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/00f5dbed-2ca2-4def-a1c3-d489ca5ca9cc-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf464f6k\" (UID: \"00f5dbed-2ca2-4def-a1c3-d489ca5ca9cc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf464f6k" Jul 07 16:28:07.506228 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:28:07.506128 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/00f5dbed-2ca2-4def-a1c3-d489ca5ca9cc-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf464f6k\" (UID: \"00f5dbed-2ca2-4def-a1c3-d489ca5ca9cc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf464f6k" Jul 07 16:28:07.506228 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:28:07.506159 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5ht97\" (UniqueName: \"kubernetes.io/projected/00f5dbed-2ca2-4def-a1c3-d489ca5ca9cc-kube-api-access-5ht97\") pod \"data-science-gateway-data-science-gateway-class-6576859cf464f6k\" (UID: \"00f5dbed-2ca2-4def-a1c3-d489ca5ca9cc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf464f6k" Jul 07 16:28:07.506228 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:28:07.506188 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/00f5dbed-2ca2-4def-a1c3-d489ca5ca9cc-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf464f6k\" (UID: \"00f5dbed-2ca2-4def-a1c3-d489ca5ca9cc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf464f6k" Jul 07 16:28:07.506487 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:28:07.506250 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/00f5dbed-2ca2-4def-a1c3-d489ca5ca9cc-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf464f6k\" (UID: \"00f5dbed-2ca2-4def-a1c3-d489ca5ca9cc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf464f6k" Jul 07 16:28:07.506487 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:28:07.506291 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/00f5dbed-2ca2-4def-a1c3-d489ca5ca9cc-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf464f6k\" (UID: \"00f5dbed-2ca2-4def-a1c3-d489ca5ca9cc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf464f6k" Jul 07 16:28:07.506487 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:28:07.506326 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/00f5dbed-2ca2-4def-a1c3-d489ca5ca9cc-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf464f6k\" (UID: \"00f5dbed-2ca2-4def-a1c3-d489ca5ca9cc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf464f6k" Jul 07 16:28:07.507025 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:28:07.506848 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/00f5dbed-2ca2-4def-a1c3-d489ca5ca9cc-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf464f6k\" (UID: \"00f5dbed-2ca2-4def-a1c3-d489ca5ca9cc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf464f6k" Jul 07 16:28:07.507025 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:28:07.506867 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/00f5dbed-2ca2-4def-a1c3-d489ca5ca9cc-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf464f6k\" (UID: \"00f5dbed-2ca2-4def-a1c3-d489ca5ca9cc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf464f6k" Jul 07 16:28:07.507025 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:28:07.506947 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/00f5dbed-2ca2-4def-a1c3-d489ca5ca9cc-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf464f6k\" (UID: \"00f5dbed-2ca2-4def-a1c3-d489ca5ca9cc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf464f6k" Jul 07 16:28:07.507025 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:28:07.506982 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/00f5dbed-2ca2-4def-a1c3-d489ca5ca9cc-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf464f6k\" (UID: \"00f5dbed-2ca2-4def-a1c3-d489ca5ca9cc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf464f6k" Jul 07 16:28:07.507250 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:28:07.507089 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/00f5dbed-2ca2-4def-a1c3-d489ca5ca9cc-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf464f6k\" (UID: \"00f5dbed-2ca2-4def-a1c3-d489ca5ca9cc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf464f6k" Jul 07 16:28:07.508856 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:28:07.508822 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/00f5dbed-2ca2-4def-a1c3-d489ca5ca9cc-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf464f6k\" (UID: \"00f5dbed-2ca2-4def-a1c3-d489ca5ca9cc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf464f6k" Jul 07 16:28:07.509063 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:28:07.509041 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/00f5dbed-2ca2-4def-a1c3-d489ca5ca9cc-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf464f6k\" (UID: \"00f5dbed-2ca2-4def-a1c3-d489ca5ca9cc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf464f6k" Jul 07 16:28:07.524679 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:28:07.524652 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/00f5dbed-2ca2-4def-a1c3-d489ca5ca9cc-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf464f6k\" (UID: \"00f5dbed-2ca2-4def-a1c3-d489ca5ca9cc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf464f6k" Jul 07 16:28:07.524791 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:28:07.524776 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ht97\" (UniqueName: \"kubernetes.io/projected/00f5dbed-2ca2-4def-a1c3-d489ca5ca9cc-kube-api-access-5ht97\") pod \"data-science-gateway-data-science-gateway-class-6576859cf464f6k\" (UID: \"00f5dbed-2ca2-4def-a1c3-d489ca5ca9cc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf464f6k" Jul 07 16:28:07.675624 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:28:07.675585 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf464f6k" Jul 07 16:28:07.823053 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:28:07.823031 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf464f6k"] Jul 07 16:28:07.824358 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:28:07.824330 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00f5dbed_2ca2_4def_a1c3_d489ca5ca9cc.slice/crio-1e2f47ff2e3c8ead8b8ed33c94f19f9d60fe515e6dd73d761360329fe82b294e WatchSource:0}: Error finding container 1e2f47ff2e3c8ead8b8ed33c94f19f9d60fe515e6dd73d761360329fe82b294e: Status 404 returned error can't find the container with id 1e2f47ff2e3c8ead8b8ed33c94f19f9d60fe515e6dd73d761360329fe82b294e Jul 07 16:28:07.973393 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:28:07.973299 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf464f6k" event={"ID":"00f5dbed-2ca2-4def-a1c3-d489ca5ca9cc","Type":"ContainerStarted","Data":"1e2f47ff2e3c8ead8b8ed33c94f19f9d60fe515e6dd73d761360329fe82b294e"} Jul 07 16:28:07.993229 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:28:07.993173 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kc65s"] Jul 07 16:28:07.996498 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:28:07.996480 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kc65s" Jul 07 16:28:07.999505 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:28:07.999482 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 07 16:28:07.999845 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:28:07.999826 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 07 16:28:07.999940 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:28:07.999864 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 07 16:28:07.999940 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:28:07.999874 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-rv674\"" Jul 07 16:28:08.010289 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:28:08.010265 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/79e3e8bf-cd2f-414e-af43-244c5d6bf8a3-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-kc65s\" (UID: \"79e3e8bf-cd2f-414e-af43-244c5d6bf8a3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kc65s" Jul 07 16:28:08.010377 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:28:08.010316 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/79e3e8bf-cd2f-414e-af43-244c5d6bf8a3-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-kc65s\" (UID: \"79e3e8bf-cd2f-414e-af43-244c5d6bf8a3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kc65s" Jul 07 16:28:08.010377 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:28:08.010368 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/79e3e8bf-cd2f-414e-af43-244c5d6bf8a3-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-kc65s\" (UID: \"79e3e8bf-cd2f-414e-af43-244c5d6bf8a3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kc65s" Jul 07 16:28:08.010456 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:28:08.010386 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/79e3e8bf-cd2f-414e-af43-244c5d6bf8a3-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-kc65s\" (UID: \"79e3e8bf-cd2f-414e-af43-244c5d6bf8a3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kc65s" Jul 07 16:28:08.010456 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:28:08.010411 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bxfhm\" (UniqueName: \"kubernetes.io/projected/79e3e8bf-cd2f-414e-af43-244c5d6bf8a3-kube-api-access-bxfhm\") pod \"istiod-openshift-gateway-94bb8fbfd-kc65s\" (UID: \"79e3e8bf-cd2f-414e-af43-244c5d6bf8a3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kc65s" Jul 07 16:28:08.010526 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:28:08.010464 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/79e3e8bf-cd2f-414e-af43-244c5d6bf8a3-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-kc65s\" (UID: \"79e3e8bf-cd2f-414e-af43-244c5d6bf8a3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kc65s" Jul 07 16:28:08.010526 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:28:08.010499 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/79e3e8bf-cd2f-414e-af43-244c5d6bf8a3-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-kc65s\" (UID: \"79e3e8bf-cd2f-414e-af43-244c5d6bf8a3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kc65s" Jul 07 16:28:08.018781 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:28:08.018760 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kc65s"] Jul 07 16:28:08.111062 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:28:08.111026 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/79e3e8bf-cd2f-414e-af43-244c5d6bf8a3-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-kc65s\" (UID: \"79e3e8bf-cd2f-414e-af43-244c5d6bf8a3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kc65s" Jul 07 16:28:08.111299 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:28:08.111080 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/79e3e8bf-cd2f-414e-af43-244c5d6bf8a3-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-kc65s\" (UID: \"79e3e8bf-cd2f-414e-af43-244c5d6bf8a3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kc65s" Jul 07 16:28:08.111299 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:28:08.111199 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/79e3e8bf-cd2f-414e-af43-244c5d6bf8a3-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-kc65s\" (UID: \"79e3e8bf-cd2f-414e-af43-244c5d6bf8a3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kc65s" Jul 07 16:28:08.111299 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:28:08.111290 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bxfhm\" (UniqueName: \"kubernetes.io/projected/79e3e8bf-cd2f-414e-af43-244c5d6bf8a3-kube-api-access-bxfhm\") pod \"istiod-openshift-gateway-94bb8fbfd-kc65s\" (UID: \"79e3e8bf-cd2f-414e-af43-244c5d6bf8a3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kc65s" Jul 07 16:28:08.111473 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:28:08.111331 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/79e3e8bf-cd2f-414e-af43-244c5d6bf8a3-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-kc65s\" (UID: \"79e3e8bf-cd2f-414e-af43-244c5d6bf8a3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kc65s" Jul 07 16:28:08.111473 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:28:08.111372 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/79e3e8bf-cd2f-414e-af43-244c5d6bf8a3-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-kc65s\" (UID: \"79e3e8bf-cd2f-414e-af43-244c5d6bf8a3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kc65s" Jul 07 16:28:08.111473 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:28:08.111446 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/79e3e8bf-cd2f-414e-af43-244c5d6bf8a3-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-kc65s\" (UID: \"79e3e8bf-cd2f-414e-af43-244c5d6bf8a3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kc65s" Jul 07 16:28:08.112127 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:28:08.112100 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/79e3e8bf-cd2f-414e-af43-244c5d6bf8a3-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-kc65s\" (UID: \"79e3e8bf-cd2f-414e-af43-244c5d6bf8a3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kc65s" Jul 07 16:28:08.113409 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:28:08.113391 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/79e3e8bf-cd2f-414e-af43-244c5d6bf8a3-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-kc65s\" (UID: \"79e3e8bf-cd2f-414e-af43-244c5d6bf8a3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kc65s" Jul 07 16:28:08.113654 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:28:08.113625 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/79e3e8bf-cd2f-414e-af43-244c5d6bf8a3-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-kc65s\" (UID: \"79e3e8bf-cd2f-414e-af43-244c5d6bf8a3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kc65s" Jul 07 16:28:08.113841 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:28:08.113823 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/79e3e8bf-cd2f-414e-af43-244c5d6bf8a3-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-kc65s\" (UID: \"79e3e8bf-cd2f-414e-af43-244c5d6bf8a3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kc65s" Jul 07 16:28:08.113919 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:28:08.113889 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/79e3e8bf-cd2f-414e-af43-244c5d6bf8a3-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-kc65s\" (UID: \"79e3e8bf-cd2f-414e-af43-244c5d6bf8a3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kc65s" Jul 07 16:28:08.125728 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:28:08.125708 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/79e3e8bf-cd2f-414e-af43-244c5d6bf8a3-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-kc65s\" (UID: \"79e3e8bf-cd2f-414e-af43-244c5d6bf8a3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kc65s" Jul 07 16:28:08.127273 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:28:08.127249 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bxfhm\" (UniqueName: \"kubernetes.io/projected/79e3e8bf-cd2f-414e-af43-244c5d6bf8a3-kube-api-access-bxfhm\") pod \"istiod-openshift-gateway-94bb8fbfd-kc65s\" (UID: \"79e3e8bf-cd2f-414e-af43-244c5d6bf8a3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kc65s" Jul 07 16:28:08.306300 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:28:08.306190 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kc65s" Jul 07 16:28:08.453442 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:28:08.453417 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kc65s"] Jul 07 16:28:08.455005 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:28:08.454981 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79e3e8bf_cd2f_414e_af43_244c5d6bf8a3.slice/crio-c102633383059f92598319ea1d93f0e43b13e529c3b25facf37d6a949e61a62b WatchSource:0}: Error finding container c102633383059f92598319ea1d93f0e43b13e529c3b25facf37d6a949e61a62b: Status 404 returned error can't find the container with id c102633383059f92598319ea1d93f0e43b13e529c3b25facf37d6a949e61a62b Jul 07 16:28:08.980140 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:28:08.980102 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kc65s" event={"ID":"79e3e8bf-cd2f-414e-af43-244c5d6bf8a3","Type":"ContainerStarted","Data":"c102633383059f92598319ea1d93f0e43b13e529c3b25facf37d6a949e61a62b"} Jul 07 16:28:11.633349 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:28:11.633302 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"} Jul 07 16:28:11.633710 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:28:11.633399 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"} Jul 07 16:28:11.633710 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:28:11.633302 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"} Jul 07 16:28:11.633710 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:28:11.633478 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"} Jul 07 16:28:11.633710 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:28:11.633516 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"} Jul 07 16:28:11.999151 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:28:11.999046 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kc65s" event={"ID":"79e3e8bf-cd2f-414e-af43-244c5d6bf8a3","Type":"ContainerStarted","Data":"13f9ac3a596e11cc2110fc8aa455e42268f33b9f579e9ed74fce2ac88ff9cc77"} Jul 07 16:28:11.999151 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:28:11.999110 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kc65s" Jul 07 16:28:12.000630 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:28:12.000606 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf464f6k" event={"ID":"00f5dbed-2ca2-4def-a1c3-d489ca5ca9cc","Type":"ContainerStarted","Data":"ac29d2c6bfc59428561392ea6758732b3eb317365cfc86668d7022254dad3877"} Jul 07 16:28:12.026152 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:28:12.026101 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kc65s" podStartSLOduration=1.850077582 podStartE2EDuration="5.026083447s" totalImagesPullingTime="3.176005865s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:28:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:28:12.025442957 +0000 UTC m=+335.158408416" watchObservedRunningTime="2026-07-07 16:28:12.026083447 +0000 UTC m=+335.159048905" Jul 07 16:28:12.050029 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:28:12.049976 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf464f6k" podStartSLOduration=1.243367923 podStartE2EDuration="5.049960927s" totalImagesPullingTime="3.806593004s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:28:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:28:12.048444402 +0000 UTC m=+335.181409865" watchObservedRunningTime="2026-07-07 16:28:12.049960927 +0000 UTC m=+335.182926386" Jul 07 16:28:12.676630 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:28:12.676590 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf464f6k" Jul 07 16:28:12.681773 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:28:12.681749 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf464f6k" Jul 07 16:28:13.006119 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:28:13.006028 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf464f6k" Jul 07 16:28:13.006824 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:28:13.006802 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf464f6k" Jul 07 16:28:13.007495 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:28:13.007477 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kc65s" Jul 07 16:28:15.962330 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:28:15.962300 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-xz26v" Jul 07 16:28:15.964300 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:28:15.964278 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-hkm4g" Jul 07 16:29:36.925735 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:29:36.925699 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-whz94"] Jul 07 16:29:36.928104 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:29:36.928088 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-whz94" Jul 07 16:29:36.934376 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:29:36.934300 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 07 16:29:36.934555 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:29:36.934533 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-h9k6t\"" Jul 07 16:29:36.934638 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:29:36.934616 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 07 16:29:36.956579 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:29:36.956549 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-whz94"] Jul 07 16:29:37.100172 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:29:37.100131 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/62f0dc94-22a0-4c91-a103-b15eaec1e9f8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-whz94\" (UID: \"62f0dc94-22a0-4c91-a103-b15eaec1e9f8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-whz94" Jul 07 16:29:37.100172 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:29:37.100170 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2gff\" (UniqueName: \"kubernetes.io/projected/62f0dc94-22a0-4c91-a103-b15eaec1e9f8-kube-api-access-q2gff\") pod \"kuadrant-operator-controller-manager-8684c9ff49-whz94\" (UID: \"62f0dc94-22a0-4c91-a103-b15eaec1e9f8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-whz94" Jul 07 16:29:37.201031 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:29:37.200935 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/62f0dc94-22a0-4c91-a103-b15eaec1e9f8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-whz94\" (UID: \"62f0dc94-22a0-4c91-a103-b15eaec1e9f8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-whz94" Jul 07 16:29:37.201031 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:29:37.200978 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2gff\" (UniqueName: \"kubernetes.io/projected/62f0dc94-22a0-4c91-a103-b15eaec1e9f8-kube-api-access-q2gff\") pod \"kuadrant-operator-controller-manager-8684c9ff49-whz94\" (UID: \"62f0dc94-22a0-4c91-a103-b15eaec1e9f8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-whz94" Jul 07 16:29:37.201359 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:29:37.201339 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/62f0dc94-22a0-4c91-a103-b15eaec1e9f8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-whz94\" (UID: \"62f0dc94-22a0-4c91-a103-b15eaec1e9f8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-whz94" Jul 07 16:29:37.211249 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:29:37.211227 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2gff\" (UniqueName: \"kubernetes.io/projected/62f0dc94-22a0-4c91-a103-b15eaec1e9f8-kube-api-access-q2gff\") pod \"kuadrant-operator-controller-manager-8684c9ff49-whz94\" (UID: \"62f0dc94-22a0-4c91-a103-b15eaec1e9f8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-whz94" Jul 07 16:29:37.238010 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:29:37.237980 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-whz94" Jul 07 16:29:37.413584 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:29:37.413557 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-whz94"] Jul 07 16:29:37.414250 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:29:37.414228 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62f0dc94_22a0_4c91_a103_b15eaec1e9f8.slice/crio-a8b7f53d24b3acdd6a6b80919c3b696b0a34b6517748941fcf018494d3b6a4a4 WatchSource:0}: Error finding container a8b7f53d24b3acdd6a6b80919c3b696b0a34b6517748941fcf018494d3b6a4a4: Status 404 returned error can't find the container with id a8b7f53d24b3acdd6a6b80919c3b696b0a34b6517748941fcf018494d3b6a4a4 Jul 07 16:29:38.386763 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:29:38.386730 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-whz94" event={"ID":"62f0dc94-22a0-4c91-a103-b15eaec1e9f8","Type":"ContainerStarted","Data":"a8b7f53d24b3acdd6a6b80919c3b696b0a34b6517748941fcf018494d3b6a4a4"} Jul 07 16:29:49.441153 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:29:49.441118 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-whz94" event={"ID":"62f0dc94-22a0-4c91-a103-b15eaec1e9f8","Type":"ContainerStarted","Data":"a6ba8b5495228a9c64311c466cd0e50fe467e923b451df63da08e75c19df2b64"} Jul 07 16:29:49.441602 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:29:49.441189 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-whz94" Jul 07 16:29:49.469419 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:29:49.469374 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-whz94" podStartSLOduration=2.059748588 podStartE2EDuration="13.469359325s" totalImagesPullingTime="11.409610737s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:29:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:29:49.46893539 +0000 UTC m=+432.601900849" watchObservedRunningTime="2026-07-07 16:29:49.469359325 +0000 UTC m=+432.602324845" Jul 07 16:30:00.448115 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:30:00.448043 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-whz94" Jul 07 16:30:02.438992 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:30:02.438958 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-whz94"] Jul 07 16:30:02.439426 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:30:02.439140 2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-whz94" podUID="62f0dc94-22a0-4c91-a103-b15eaec1e9f8" containerName="manager" containerID="cri-o://a6ba8b5495228a9c64311c466cd0e50fe467e923b451df63da08e75c19df2b64" gracePeriod=2 Jul 07 16:30:02.452310 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:30:02.452280 2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-whz94"] Jul 07 16:30:02.479448 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:30:02.479404 2552 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"62f0dc94-22a0-4c91-a103-b15eaec1e9f8\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-whz94\": pods \"kuadrant-operator-controller-manager-8684c9ff49-whz94\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-whz94" Jul 07 16:30:02.501658 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:30:02.501621 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2b5h8"] Jul 07 16:30:02.502013 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:30:02.501983 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62f0dc94-22a0-4c91-a103-b15eaec1e9f8" containerName="manager" Jul 07 16:30:02.502013 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:30:02.502009 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="62f0dc94-22a0-4c91-a103-b15eaec1e9f8" containerName="manager" Jul 07 16:30:02.502170 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:30:02.502135 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="62f0dc94-22a0-4c91-a103-b15eaec1e9f8" containerName="manager" Jul 07 16:30:02.504320 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:30:02.504303 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2b5h8" Jul 07 16:30:02.508619 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:30:02.508589 2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-whz94\" is forbidden: User \"system:node:ip-10-0-138-189.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-189.ec2.internal' and this object" podUID="62f0dc94-22a0-4c91-a103-b15eaec1e9f8" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-whz94" Jul 07 16:30:02.540911 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:30:02.540875 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2b5h8"] Jul 07 16:30:02.621741 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:30:02.621706 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/01ac7b8a-6193-4176-a4a2-107309fb8bb3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2b5h8\" (UID: \"01ac7b8a-6193-4176-a4a2-107309fb8bb3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2b5h8" Jul 07 16:30:02.621898 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:30:02.621752 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9wxj\" (UniqueName: \"kubernetes.io/projected/01ac7b8a-6193-4176-a4a2-107309fb8bb3-kube-api-access-k9wxj\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2b5h8\" (UID: \"01ac7b8a-6193-4176-a4a2-107309fb8bb3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2b5h8" Jul 07 16:30:02.690223 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:30:02.690150 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-whz94" Jul 07 16:30:02.693287 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:30:02.693252 2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-whz94\" is forbidden: User \"system:node:ip-10-0-138-189.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-189.ec2.internal' and this object" podUID="62f0dc94-22a0-4c91-a103-b15eaec1e9f8" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-whz94" Jul 07 16:30:02.722438 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:30:02.722415 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/62f0dc94-22a0-4c91-a103-b15eaec1e9f8-extensions-socket-volume\") pod \"62f0dc94-22a0-4c91-a103-b15eaec1e9f8\" (UID: \"62f0dc94-22a0-4c91-a103-b15eaec1e9f8\") " Jul 07 16:30:02.722576 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:30:02.722509 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q2gff\" (UniqueName: \"kubernetes.io/projected/62f0dc94-22a0-4c91-a103-b15eaec1e9f8-kube-api-access-q2gff\") pod \"62f0dc94-22a0-4c91-a103-b15eaec1e9f8\" (UID: \"62f0dc94-22a0-4c91-a103-b15eaec1e9f8\") " Jul 07 16:30:02.722629 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:30:02.722614 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/01ac7b8a-6193-4176-a4a2-107309fb8bb3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2b5h8\" (UID: \"01ac7b8a-6193-4176-a4a2-107309fb8bb3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2b5h8" Jul 07 16:30:02.722666 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:30:02.722646 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k9wxj\" (UniqueName: \"kubernetes.io/projected/01ac7b8a-6193-4176-a4a2-107309fb8bb3-kube-api-access-k9wxj\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2b5h8\" (UID: \"01ac7b8a-6193-4176-a4a2-107309fb8bb3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2b5h8" Jul 07 16:30:02.722941 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:30:02.722913 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62f0dc94-22a0-4c91-a103-b15eaec1e9f8-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "62f0dc94-22a0-4c91-a103-b15eaec1e9f8" (UID: "62f0dc94-22a0-4c91-a103-b15eaec1e9f8"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 16:30:02.723046 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:30:02.723030 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/01ac7b8a-6193-4176-a4a2-107309fb8bb3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2b5h8\" (UID: \"01ac7b8a-6193-4176-a4a2-107309fb8bb3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2b5h8" Jul 07 16:30:02.724676 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:30:02.724654 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62f0dc94-22a0-4c91-a103-b15eaec1e9f8-kube-api-access-q2gff" (OuterVolumeSpecName: "kube-api-access-q2gff") pod "62f0dc94-22a0-4c91-a103-b15eaec1e9f8" (UID: "62f0dc94-22a0-4c91-a103-b15eaec1e9f8"). InnerVolumeSpecName "kube-api-access-q2gff". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 16:30:02.755357 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:30:02.755331 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9wxj\" (UniqueName: \"kubernetes.io/projected/01ac7b8a-6193-4176-a4a2-107309fb8bb3-kube-api-access-k9wxj\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2b5h8\" (UID: \"01ac7b8a-6193-4176-a4a2-107309fb8bb3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2b5h8" Jul 07 16:30:02.818083 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:30:02.818040 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2b5h8" Jul 07 16:30:02.823645 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:30:02.823611 2552 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/62f0dc94-22a0-4c91-a103-b15eaec1e9f8-extensions-socket-volume\") on node \"ip-10-0-138-189.ec2.internal\" DevicePath \"\"" Jul 07 16:30:02.823752 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:30:02.823648 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q2gff\" (UniqueName: \"kubernetes.io/projected/62f0dc94-22a0-4c91-a103-b15eaec1e9f8-kube-api-access-q2gff\") on node \"ip-10-0-138-189.ec2.internal\" DevicePath \"\"" Jul 07 16:30:02.967876 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:30:02.967849 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2b5h8"] Jul 07 16:30:02.969059 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:30:02.969031 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01ac7b8a_6193_4176_a4a2_107309fb8bb3.slice/crio-4ba27c9428d8c8ef6806ef28050dd718c76b6b275ba803b7e94adcd4d914fb10 WatchSource:0}: Error finding container 4ba27c9428d8c8ef6806ef28050dd718c76b6b275ba803b7e94adcd4d914fb10: Status 404 returned error can't find the container with id 4ba27c9428d8c8ef6806ef28050dd718c76b6b275ba803b7e94adcd4d914fb10 Jul 07 16:30:03.441791 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:30:03.441756 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="62f0dc94-22a0-4c91-a103-b15eaec1e9f8" path="/var/lib/kubelet/pods/62f0dc94-22a0-4c91-a103-b15eaec1e9f8/volumes" Jul 07 16:30:03.506842 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:30:03.506809 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2b5h8" event={"ID":"01ac7b8a-6193-4176-a4a2-107309fb8bb3","Type":"ContainerStarted","Data":"19f72779d4639494147e9ab8d4dbe4188ac3a1399f857fcebf536aad533e16fd"} Jul 07 16:30:03.507010 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:30:03.506867 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2b5h8" event={"ID":"01ac7b8a-6193-4176-a4a2-107309fb8bb3","Type":"ContainerStarted","Data":"4ba27c9428d8c8ef6806ef28050dd718c76b6b275ba803b7e94adcd4d914fb10"} Jul 07 16:30:03.507010 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:30:03.506895 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2b5h8" Jul 07 16:30:03.508027 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:30:03.508009 2552 generic.go:356] "Generic (PLEG): container finished" podID="62f0dc94-22a0-4c91-a103-b15eaec1e9f8" containerID="a6ba8b5495228a9c64311c466cd0e50fe467e923b451df63da08e75c19df2b64" exitCode=0 Jul 07 16:30:03.508099 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:30:03.508045 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-whz94" Jul 07 16:30:03.508099 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:30:03.508061 2552 scope.go:117] "RemoveContainer" containerID="a6ba8b5495228a9c64311c466cd0e50fe467e923b451df63da08e75c19df2b64" Jul 07 16:30:03.516841 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:30:03.516822 2552 scope.go:117] "RemoveContainer" containerID="a6ba8b5495228a9c64311c466cd0e50fe467e923b451df63da08e75c19df2b64" Jul 07 16:30:03.517070 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:30:03.517052 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a6ba8b5495228a9c64311c466cd0e50fe467e923b451df63da08e75c19df2b64\": container with ID starting with a6ba8b5495228a9c64311c466cd0e50fe467e923b451df63da08e75c19df2b64 not found: ID does not exist" containerID="a6ba8b5495228a9c64311c466cd0e50fe467e923b451df63da08e75c19df2b64" Jul 07 16:30:03.517127 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:30:03.517079 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6ba8b5495228a9c64311c466cd0e50fe467e923b451df63da08e75c19df2b64"} err="failed to get container status \"a6ba8b5495228a9c64311c466cd0e50fe467e923b451df63da08e75c19df2b64\": rpc error: code = NotFound desc = could not find container \"a6ba8b5495228a9c64311c466cd0e50fe467e923b451df63da08e75c19df2b64\": container with ID starting with a6ba8b5495228a9c64311c466cd0e50fe467e923b451df63da08e75c19df2b64 not found: ID does not exist" Jul 07 16:30:03.536410 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:30:03.536361 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2b5h8" podStartSLOduration=1.536343467 podStartE2EDuration="1.536343467s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:30:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:30:03.533954459 +0000 UTC m=+446.666919930" watchObservedRunningTime="2026-07-07 16:30:03.536343467 +0000 UTC m=+446.669308926" Jul 07 16:30:14.515846 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:30:14.515816 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2b5h8" Jul 07 16:30:21.717508 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:30:21.717472 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2b5h8"] Jul 07 16:30:21.718047 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:30:21.717673 2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2b5h8" podUID="01ac7b8a-6193-4176-a4a2-107309fb8bb3" containerName="manager" containerID="cri-o://19f72779d4639494147e9ab8d4dbe4188ac3a1399f857fcebf536aad533e16fd" gracePeriod=10 Jul 07 16:30:21.974976 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:30:21.974920 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2b5h8" Jul 07 16:30:22.089754 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:30:22.089717 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/01ac7b8a-6193-4176-a4a2-107309fb8bb3-extensions-socket-volume\") pod \"01ac7b8a-6193-4176-a4a2-107309fb8bb3\" (UID: \"01ac7b8a-6193-4176-a4a2-107309fb8bb3\") " Jul 07 16:30:22.089921 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:30:22.089815 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k9wxj\" (UniqueName: \"kubernetes.io/projected/01ac7b8a-6193-4176-a4a2-107309fb8bb3-kube-api-access-k9wxj\") pod \"01ac7b8a-6193-4176-a4a2-107309fb8bb3\" (UID: \"01ac7b8a-6193-4176-a4a2-107309fb8bb3\") " Jul 07 16:30:22.090100 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:30:22.090073 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/01ac7b8a-6193-4176-a4a2-107309fb8bb3-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "01ac7b8a-6193-4176-a4a2-107309fb8bb3" (UID: "01ac7b8a-6193-4176-a4a2-107309fb8bb3"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 16:30:22.091823 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:30:22.091804 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/01ac7b8a-6193-4176-a4a2-107309fb8bb3-kube-api-access-k9wxj" (OuterVolumeSpecName: "kube-api-access-k9wxj") pod "01ac7b8a-6193-4176-a4a2-107309fb8bb3" (UID: "01ac7b8a-6193-4176-a4a2-107309fb8bb3"). InnerVolumeSpecName "kube-api-access-k9wxj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 16:30:22.190384 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:30:22.190344 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k9wxj\" (UniqueName: \"kubernetes.io/projected/01ac7b8a-6193-4176-a4a2-107309fb8bb3-kube-api-access-k9wxj\") on node \"ip-10-0-138-189.ec2.internal\" DevicePath \"\"" Jul 07 16:30:22.190384 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:30:22.190377 2552 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/01ac7b8a-6193-4176-a4a2-107309fb8bb3-extensions-socket-volume\") on node \"ip-10-0-138-189.ec2.internal\" DevicePath \"\"" Jul 07 16:30:22.597337 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:30:22.597302 2552 generic.go:356] "Generic (PLEG): container finished" podID="01ac7b8a-6193-4176-a4a2-107309fb8bb3" containerID="19f72779d4639494147e9ab8d4dbe4188ac3a1399f857fcebf536aad533e16fd" exitCode=0 Jul 07 16:30:22.597518 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:30:22.597342 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2b5h8" Jul 07 16:30:22.597518 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:30:22.597383 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2b5h8" event={"ID":"01ac7b8a-6193-4176-a4a2-107309fb8bb3","Type":"ContainerDied","Data":"19f72779d4639494147e9ab8d4dbe4188ac3a1399f857fcebf536aad533e16fd"} Jul 07 16:30:22.597518 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:30:22.597434 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2b5h8" event={"ID":"01ac7b8a-6193-4176-a4a2-107309fb8bb3","Type":"ContainerDied","Data":"4ba27c9428d8c8ef6806ef28050dd718c76b6b275ba803b7e94adcd4d914fb10"} Jul 07 16:30:22.597518 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:30:22.597458 2552 scope.go:117] "RemoveContainer" containerID="19f72779d4639494147e9ab8d4dbe4188ac3a1399f857fcebf536aad533e16fd" Jul 07 16:30:22.606561 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:30:22.606546 2552 scope.go:117] "RemoveContainer" containerID="19f72779d4639494147e9ab8d4dbe4188ac3a1399f857fcebf536aad533e16fd" Jul 07 16:30:22.606801 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:30:22.606783 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"19f72779d4639494147e9ab8d4dbe4188ac3a1399f857fcebf536aad533e16fd\": container with ID starting with 19f72779d4639494147e9ab8d4dbe4188ac3a1399f857fcebf536aad533e16fd not found: ID does not exist" containerID="19f72779d4639494147e9ab8d4dbe4188ac3a1399f857fcebf536aad533e16fd" Jul 07 16:30:22.606861 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:30:22.606812 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19f72779d4639494147e9ab8d4dbe4188ac3a1399f857fcebf536aad533e16fd"} err="failed to get container status \"19f72779d4639494147e9ab8d4dbe4188ac3a1399f857fcebf536aad533e16fd\": rpc error: code = NotFound desc = could not find container \"19f72779d4639494147e9ab8d4dbe4188ac3a1399f857fcebf536aad533e16fd\": container with ID starting with 19f72779d4639494147e9ab8d4dbe4188ac3a1399f857fcebf536aad533e16fd not found: ID does not exist" Jul 07 16:30:22.621196 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:30:22.621172 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2b5h8"] Jul 07 16:30:22.625454 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:30:22.625433 2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2b5h8"] Jul 07 16:30:23.441169 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:30:23.441131 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="01ac7b8a-6193-4176-a4a2-107309fb8bb3" path="/var/lib/kubelet/pods/01ac7b8a-6193-4176-a4a2-107309fb8bb3/volumes" Jul 07 16:30:38.340915 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:30:38.340878 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jkbck"] Jul 07 16:30:38.341345 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:30:38.341322 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01ac7b8a-6193-4176-a4a2-107309fb8bb3" containerName="manager" Jul 07 16:30:38.341345 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:30:38.341343 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="01ac7b8a-6193-4176-a4a2-107309fb8bb3" containerName="manager" Jul 07 16:30:38.341483 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:30:38.341441 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="01ac7b8a-6193-4176-a4a2-107309fb8bb3" containerName="manager" Jul 07 16:30:38.344067 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:30:38.344052 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jkbck" Jul 07 16:30:38.349816 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:30:38.349795 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-kxtnx\"" Jul 07 16:30:38.376858 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:30:38.376822 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jkbck"] Jul 07 16:30:38.532575 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:30:38.532541 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/63718783-1233-468a-86ab-ea873f9e5a82-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-jkbck\" (UID: \"63718783-1233-468a-86ab-ea873f9e5a82\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jkbck" Jul 07 16:30:38.532575 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:30:38.532579 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/63718783-1233-468a-86ab-ea873f9e5a82-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-jkbck\" (UID: \"63718783-1233-468a-86ab-ea873f9e5a82\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jkbck" Jul 07 16:30:38.532774 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:30:38.532626 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/63718783-1233-468a-86ab-ea873f9e5a82-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-jkbck\" (UID: \"63718783-1233-468a-86ab-ea873f9e5a82\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jkbck" Jul 07 16:30:38.532774 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:30:38.532676 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/63718783-1233-468a-86ab-ea873f9e5a82-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-jkbck\" (UID: \"63718783-1233-468a-86ab-ea873f9e5a82\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jkbck" Jul 07 16:30:38.532774 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:30:38.532703 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/63718783-1233-468a-86ab-ea873f9e5a82-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-jkbck\" (UID: \"63718783-1233-468a-86ab-ea873f9e5a82\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jkbck" Jul 07 16:30:38.532774 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:30:38.532729 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d2xmt\" (UniqueName: \"kubernetes.io/projected/63718783-1233-468a-86ab-ea873f9e5a82-kube-api-access-d2xmt\") pod \"maas-default-gateway-openshift-default-56654dcf7-jkbck\" (UID: \"63718783-1233-468a-86ab-ea873f9e5a82\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jkbck" Jul 07 16:30:38.532774 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:30:38.532749 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/63718783-1233-468a-86ab-ea873f9e5a82-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-jkbck\" (UID: \"63718783-1233-468a-86ab-ea873f9e5a82\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jkbck" Jul 07 16:30:38.532928 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:30:38.532788 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/63718783-1233-468a-86ab-ea873f9e5a82-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-jkbck\" (UID: \"63718783-1233-468a-86ab-ea873f9e5a82\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jkbck" Jul 07 16:30:38.532928 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:30:38.532811 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/63718783-1233-468a-86ab-ea873f9e5a82-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-jkbck\" (UID: \"63718783-1233-468a-86ab-ea873f9e5a82\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jkbck" Jul 07 16:30:38.633641 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:30:38.633610 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/63718783-1233-468a-86ab-ea873f9e5a82-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-jkbck\" (UID: \"63718783-1233-468a-86ab-ea873f9e5a82\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jkbck" Jul 07 16:30:38.633814 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:30:38.633648 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/63718783-1233-468a-86ab-ea873f9e5a82-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-jkbck\" (UID: \"63718783-1233-468a-86ab-ea873f9e5a82\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jkbck" Jul 07 16:30:38.633814 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:30:38.633665 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/63718783-1233-468a-86ab-ea873f9e5a82-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-jkbck\" (UID: \"63718783-1233-468a-86ab-ea873f9e5a82\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jkbck" Jul 07 16:30:38.634098 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:30:38.634065 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/63718783-1233-468a-86ab-ea873f9e5a82-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-jkbck\" (UID: \"63718783-1233-468a-86ab-ea873f9e5a82\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jkbck" Jul 07 16:30:38.634257 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:30:38.633805 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d2xmt\" (UniqueName: \"kubernetes.io/projected/63718783-1233-468a-86ab-ea873f9e5a82-kube-api-access-d2xmt\") pod \"maas-default-gateway-openshift-default-56654dcf7-jkbck\" (UID: \"63718783-1233-468a-86ab-ea873f9e5a82\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jkbck" Jul 07 16:30:38.634257 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:30:38.634132 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/63718783-1233-468a-86ab-ea873f9e5a82-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-jkbck\" (UID: \"63718783-1233-468a-86ab-ea873f9e5a82\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jkbck" Jul 07 16:30:38.634257 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:30:38.634174 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/63718783-1233-468a-86ab-ea873f9e5a82-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-jkbck\" (UID: \"63718783-1233-468a-86ab-ea873f9e5a82\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jkbck" Jul 07 16:30:38.634257 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:30:38.634220 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/63718783-1233-468a-86ab-ea873f9e5a82-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-jkbck\" (UID: \"63718783-1233-468a-86ab-ea873f9e5a82\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jkbck" Jul 07 16:30:38.634257 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:30:38.634252 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/63718783-1233-468a-86ab-ea873f9e5a82-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-jkbck\" (UID: \"63718783-1233-468a-86ab-ea873f9e5a82\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jkbck" Jul 07 16:30:38.634550 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:30:38.634310 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/63718783-1233-468a-86ab-ea873f9e5a82-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-jkbck\" (UID: \"63718783-1233-468a-86ab-ea873f9e5a82\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jkbck" Jul 07 16:30:38.634550 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:30:38.634338 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/63718783-1233-468a-86ab-ea873f9e5a82-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-jkbck\" (UID: \"63718783-1233-468a-86ab-ea873f9e5a82\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jkbck" Jul 07 16:30:38.634680 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:30:38.634658 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/63718783-1233-468a-86ab-ea873f9e5a82-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-jkbck\" (UID: \"63718783-1233-468a-86ab-ea873f9e5a82\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jkbck" Jul 07 16:30:38.634810 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:30:38.634791 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/63718783-1233-468a-86ab-ea873f9e5a82-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-jkbck\" (UID: \"63718783-1233-468a-86ab-ea873f9e5a82\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jkbck" Jul 07 16:30:38.634895 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:30:38.634879 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/63718783-1233-468a-86ab-ea873f9e5a82-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-jkbck\" (UID: \"63718783-1233-468a-86ab-ea873f9e5a82\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jkbck" Jul 07 16:30:38.636088 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:30:38.636062 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/63718783-1233-468a-86ab-ea873f9e5a82-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-jkbck\" (UID: \"63718783-1233-468a-86ab-ea873f9e5a82\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jkbck" Jul 07 16:30:38.636622 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:30:38.636603 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/63718783-1233-468a-86ab-ea873f9e5a82-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-jkbck\" (UID: \"63718783-1233-468a-86ab-ea873f9e5a82\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jkbck" Jul 07 16:30:38.649710 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:30:38.649683 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/63718783-1233-468a-86ab-ea873f9e5a82-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-jkbck\" (UID: \"63718783-1233-468a-86ab-ea873f9e5a82\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jkbck" Jul 07 16:30:38.649929 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:30:38.649913 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d2xmt\" (UniqueName: \"kubernetes.io/projected/63718783-1233-468a-86ab-ea873f9e5a82-kube-api-access-d2xmt\") pod \"maas-default-gateway-openshift-default-56654dcf7-jkbck\" (UID: \"63718783-1233-468a-86ab-ea873f9e5a82\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jkbck" Jul 07 16:30:38.654790 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:30:38.654768 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jkbck" Jul 07 16:30:38.797721 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:30:38.797698 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jkbck"] Jul 07 16:30:38.799490 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:30:38.799412 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63718783_1233_468a_86ab_ea873f9e5a82.slice/crio-a45963d521c41871d43dff6fbdbb362b8c7d440ce8a1f9f3ab7f11d639059f62 WatchSource:0}: Error finding container a45963d521c41871d43dff6fbdbb362b8c7d440ce8a1f9f3ab7f11d639059f62: Status 404 returned error can't find the container with id a45963d521c41871d43dff6fbdbb362b8c7d440ce8a1f9f3ab7f11d639059f62 Jul 07 16:30:38.801563 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:30:38.801534 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"} Jul 07 16:30:38.801639 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:30:38.801596 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"} Jul 07 16:30:38.801639 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:30:38.801623 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"} Jul 07 16:30:39.678278 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:30:39.678190 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jkbck" event={"ID":"63718783-1233-468a-86ab-ea873f9e5a82","Type":"ContainerStarted","Data":"8838ce6b7429c93d0f3161ff9acd858d85ff4312e207f6805267662200f3e93e"} Jul 07 16:30:39.678278 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:30:39.678271 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jkbck" event={"ID":"63718783-1233-468a-86ab-ea873f9e5a82","Type":"ContainerStarted","Data":"a45963d521c41871d43dff6fbdbb362b8c7d440ce8a1f9f3ab7f11d639059f62"} Jul 07 16:30:39.708481 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:30:39.708435 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jkbck" podStartSLOduration=1.708419251 podStartE2EDuration="1.708419251s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:30:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:30:39.706723713 +0000 UTC m=+482.839689175" watchObservedRunningTime="2026-07-07 16:30:39.708419251 +0000 UTC m=+482.841384752" Jul 07 16:30:40.655119 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:30:40.655081 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jkbck" Jul 07 16:30:40.659915 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:30:40.659895 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jkbck" Jul 07 16:30:40.682773 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:30:40.682747 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jkbck" Jul 07 16:30:40.683432 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:30:40.683415 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jkbck" Jul 07 16:30:40.844450 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:30:40.844413 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-xpxx2"] Jul 07 16:30:40.846935 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:30:40.846918 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-xpxx2" Jul 07 16:30:40.850179 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:30:40.850156 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 07 16:30:40.850303 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:30:40.850225 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 07 16:30:40.850689 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:30:40.850674 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 07 16:30:40.850788 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:30:40.850772 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-clfdp\"" Jul 07 16:30:40.861362 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:30:40.861337 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-xpxx2"] Jul 07 16:30:40.935311 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:30:40.935232 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-xpxx2"] Jul 07 16:30:40.954495 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:30:40.954470 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ad8ad393-25ba-468b-a61f-700f221b9200-config-file\") pod \"limitador-limitador-64c94fd64f-xpxx2\" (UID: \"ad8ad393-25ba-468b-a61f-700f221b9200\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-xpxx2" Jul 07 16:30:40.954622 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:30:40.954597 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-stcg5\" (UniqueName: \"kubernetes.io/projected/ad8ad393-25ba-468b-a61f-700f221b9200-kube-api-access-stcg5\") pod \"limitador-limitador-64c94fd64f-xpxx2\" (UID: \"ad8ad393-25ba-468b-a61f-700f221b9200\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-xpxx2" Jul 07 16:30:41.056037 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:30:41.056001 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-stcg5\" (UniqueName: \"kubernetes.io/projected/ad8ad393-25ba-468b-a61f-700f221b9200-kube-api-access-stcg5\") pod \"limitador-limitador-64c94fd64f-xpxx2\" (UID: \"ad8ad393-25ba-468b-a61f-700f221b9200\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-xpxx2" Jul 07 16:30:41.056037 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:30:41.056040 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ad8ad393-25ba-468b-a61f-700f221b9200-config-file\") pod \"limitador-limitador-64c94fd64f-xpxx2\" (UID: \"ad8ad393-25ba-468b-a61f-700f221b9200\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-xpxx2" Jul 07 16:30:41.056730 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:30:41.056712 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ad8ad393-25ba-468b-a61f-700f221b9200-config-file\") pod \"limitador-limitador-64c94fd64f-xpxx2\" (UID: \"ad8ad393-25ba-468b-a61f-700f221b9200\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-xpxx2" Jul 07 16:30:41.064934 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:30:41.064911 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-stcg5\" (UniqueName: \"kubernetes.io/projected/ad8ad393-25ba-468b-a61f-700f221b9200-kube-api-access-stcg5\") pod \"limitador-limitador-64c94fd64f-xpxx2\" (UID: \"ad8ad393-25ba-468b-a61f-700f221b9200\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-xpxx2" Jul 07 16:30:41.157572 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:30:41.157545 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-xpxx2" Jul 07 16:30:41.286924 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:30:41.286901 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-xpxx2"] Jul 07 16:30:41.288423 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:30:41.288398 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad8ad393_25ba_468b_a61f_700f221b9200.slice/crio-15be27ec7127a1bd9504d576861b9607c3865fc7057b3bb4cf31268d6159dd33 WatchSource:0}: Error finding container 15be27ec7127a1bd9504d576861b9607c3865fc7057b3bb4cf31268d6159dd33: Status 404 returned error can't find the container with id 15be27ec7127a1bd9504d576861b9607c3865fc7057b3bb4cf31268d6159dd33 Jul 07 16:30:41.688846 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:30:41.688808 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-xpxx2" event={"ID":"ad8ad393-25ba-468b-a61f-700f221b9200","Type":"ContainerStarted","Data":"15be27ec7127a1bd9504d576861b9607c3865fc7057b3bb4cf31268d6159dd33"} Jul 07 16:30:44.704855 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:30:44.704816 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-xpxx2" event={"ID":"ad8ad393-25ba-468b-a61f-700f221b9200","Type":"ContainerStarted","Data":"b22966125823522861781f3a9e38f0feaa5c3904e7e38cafa094846d3375574c"} Jul 07 16:30:44.705328 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:30:44.704901 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-xpxx2" Jul 07 16:30:44.736888 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:30:44.736842 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-xpxx2" podStartSLOduration=1.8005572829999998 podStartE2EDuration="4.736827937s" totalImagesPullingTime="2.936270654s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:30:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:30:44.734799476 +0000 UTC m=+487.867764927" watchObservedRunningTime="2026-07-07 16:30:44.736827937 +0000 UTC m=+487.869793395" Jul 07 16:30:55.710432 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:30:55.710394 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-xpxx2" Jul 07 16:30:55.885959 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:30:55.885921 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-xpxx2"] Jul 07 16:30:55.886166 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:30:55.886135 2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-xpxx2" podUID="ad8ad393-25ba-468b-a61f-700f221b9200" containerName="limitador" containerID="cri-o://b22966125823522861781f3a9e38f0feaa5c3904e7e38cafa094846d3375574c" gracePeriod=30 Jul 07 16:30:56.436154 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:30:56.436126 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-xpxx2" Jul 07 16:30:56.475085 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:30:56.474997 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-stcg5\" (UniqueName: \"kubernetes.io/projected/ad8ad393-25ba-468b-a61f-700f221b9200-kube-api-access-stcg5\") pod \"ad8ad393-25ba-468b-a61f-700f221b9200\" (UID: \"ad8ad393-25ba-468b-a61f-700f221b9200\") " Jul 07 16:30:56.475085 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:30:56.475077 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ad8ad393-25ba-468b-a61f-700f221b9200-config-file\") pod \"ad8ad393-25ba-468b-a61f-700f221b9200\" (UID: \"ad8ad393-25ba-468b-a61f-700f221b9200\") " Jul 07 16:30:56.475483 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:30:56.475454 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ad8ad393-25ba-468b-a61f-700f221b9200-config-file" (OuterVolumeSpecName: "config-file") pod "ad8ad393-25ba-468b-a61f-700f221b9200" (UID: "ad8ad393-25ba-468b-a61f-700f221b9200"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 16:30:56.477251 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:30:56.477229 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad8ad393-25ba-468b-a61f-700f221b9200-kube-api-access-stcg5" (OuterVolumeSpecName: "kube-api-access-stcg5") pod "ad8ad393-25ba-468b-a61f-700f221b9200" (UID: "ad8ad393-25ba-468b-a61f-700f221b9200"). InnerVolumeSpecName "kube-api-access-stcg5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 16:30:56.576584 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:30:56.576545 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-stcg5\" (UniqueName: \"kubernetes.io/projected/ad8ad393-25ba-468b-a61f-700f221b9200-kube-api-access-stcg5\") on node \"ip-10-0-138-189.ec2.internal\" DevicePath \"\"" Jul 07 16:30:56.576584 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:30:56.576578 2552 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ad8ad393-25ba-468b-a61f-700f221b9200-config-file\") on node \"ip-10-0-138-189.ec2.internal\" DevicePath \"\"" Jul 07 16:30:56.759777 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:30:56.759692 2552 generic.go:356] "Generic (PLEG): container finished" podID="ad8ad393-25ba-468b-a61f-700f221b9200" containerID="b22966125823522861781f3a9e38f0feaa5c3904e7e38cafa094846d3375574c" exitCode=0 Jul 07 16:30:56.759777 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:30:56.759741 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-xpxx2" Jul 07 16:30:56.759777 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:30:56.759773 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-xpxx2" event={"ID":"ad8ad393-25ba-468b-a61f-700f221b9200","Type":"ContainerDied","Data":"b22966125823522861781f3a9e38f0feaa5c3904e7e38cafa094846d3375574c"} Jul 07 16:30:56.760388 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:30:56.759823 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-xpxx2" event={"ID":"ad8ad393-25ba-468b-a61f-700f221b9200","Type":"ContainerDied","Data":"15be27ec7127a1bd9504d576861b9607c3865fc7057b3bb4cf31268d6159dd33"} Jul 07 16:30:56.760388 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:30:56.759853 2552 scope.go:117] "RemoveContainer" containerID="b22966125823522861781f3a9e38f0feaa5c3904e7e38cafa094846d3375574c" Jul 07 16:30:56.768372 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:30:56.768350 2552 scope.go:117] "RemoveContainer" containerID="b22966125823522861781f3a9e38f0feaa5c3904e7e38cafa094846d3375574c" Jul 07 16:30:56.768626 ip-10-0-138-189 kubenswrapper[2552]: E0707 16:30:56.768604 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b22966125823522861781f3a9e38f0feaa5c3904e7e38cafa094846d3375574c\": container with ID starting with b22966125823522861781f3a9e38f0feaa5c3904e7e38cafa094846d3375574c not found: ID does not exist" containerID="b22966125823522861781f3a9e38f0feaa5c3904e7e38cafa094846d3375574c" Jul 07 16:30:56.768686 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:30:56.768635 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b22966125823522861781f3a9e38f0feaa5c3904e7e38cafa094846d3375574c"} err="failed to get container status \"b22966125823522861781f3a9e38f0feaa5c3904e7e38cafa094846d3375574c\": rpc error: code = NotFound desc = could not find container \"b22966125823522861781f3a9e38f0feaa5c3904e7e38cafa094846d3375574c\": container with ID starting with b22966125823522861781f3a9e38f0feaa5c3904e7e38cafa094846d3375574c not found: ID does not exist" Jul 07 16:30:56.784406 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:30:56.784380 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-xpxx2"] Jul 07 16:30:56.789655 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:30:56.789633 2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-xpxx2"] Jul 07 16:30:57.441034 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:30:57.440992 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ad8ad393-25ba-468b-a61f-700f221b9200" path="/var/lib/kubelet/pods/ad8ad393-25ba-468b-a61f-700f221b9200/volumes" Jul 07 16:31:02.449573 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:31:02.449536 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-fctmd"] Jul 07 16:31:02.450144 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:31:02.450121 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad8ad393-25ba-468b-a61f-700f221b9200" containerName="limitador" Jul 07 16:31:02.450194 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:31:02.450150 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad8ad393-25ba-468b-a61f-700f221b9200" containerName="limitador" Jul 07 16:31:02.450300 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:31:02.450285 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="ad8ad393-25ba-468b-a61f-700f221b9200" containerName="limitador" Jul 07 16:31:02.452863 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:31:02.452844 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-fctmd" Jul 07 16:31:02.455626 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:31:02.455599 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jul 07 16:31:02.455757 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:31:02.455650 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-7w729\"" Jul 07 16:31:02.466492 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:31:02.466470 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-fctmd"] Jul 07 16:31:02.533587 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:31:02.533554 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vf6j\" (UniqueName: \"kubernetes.io/projected/977301e4-9e6c-403c-99c8-00301971efea-kube-api-access-5vf6j\") pod \"postgres-69fb4594cf-fctmd\" (UID: \"977301e4-9e6c-403c-99c8-00301971efea\") " pod="opendatahub/postgres-69fb4594cf-fctmd" Jul 07 16:31:02.533730 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:31:02.533613 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/977301e4-9e6c-403c-99c8-00301971efea-data\") pod \"postgres-69fb4594cf-fctmd\" (UID: \"977301e4-9e6c-403c-99c8-00301971efea\") " pod="opendatahub/postgres-69fb4594cf-fctmd" Jul 07 16:31:02.634565 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:31:02.634523 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vf6j\" (UniqueName: \"kubernetes.io/projected/977301e4-9e6c-403c-99c8-00301971efea-kube-api-access-5vf6j\") pod \"postgres-69fb4594cf-fctmd\" (UID: \"977301e4-9e6c-403c-99c8-00301971efea\") " pod="opendatahub/postgres-69fb4594cf-fctmd" Jul 07 16:31:02.634750 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:31:02.634599 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/977301e4-9e6c-403c-99c8-00301971efea-data\") pod \"postgres-69fb4594cf-fctmd\" (UID: \"977301e4-9e6c-403c-99c8-00301971efea\") " pod="opendatahub/postgres-69fb4594cf-fctmd" Jul 07 16:31:02.634987 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:31:02.634967 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/977301e4-9e6c-403c-99c8-00301971efea-data\") pod \"postgres-69fb4594cf-fctmd\" (UID: \"977301e4-9e6c-403c-99c8-00301971efea\") " pod="opendatahub/postgres-69fb4594cf-fctmd" Jul 07 16:31:02.644253 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:31:02.644228 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vf6j\" (UniqueName: \"kubernetes.io/projected/977301e4-9e6c-403c-99c8-00301971efea-kube-api-access-5vf6j\") pod \"postgres-69fb4594cf-fctmd\" (UID: \"977301e4-9e6c-403c-99c8-00301971efea\") " pod="opendatahub/postgres-69fb4594cf-fctmd" Jul 07 16:31:02.762786 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:31:02.762704 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-fctmd" Jul 07 16:31:02.897270 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:31:02.897246 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-fctmd"] Jul 07 16:31:02.899221 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:31:02.899181 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod977301e4_9e6c_403c_99c8_00301971efea.slice/crio-32067982a466596b9d74f29e8c6524a667e5dcffc929ae983b9157956ba59d18 WatchSource:0}: Error finding container 32067982a466596b9d74f29e8c6524a667e5dcffc929ae983b9157956ba59d18: Status 404 returned error can't find the container with id 32067982a466596b9d74f29e8c6524a667e5dcffc929ae983b9157956ba59d18 Jul 07 16:31:03.794389 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:31:03.794354 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-fctmd" event={"ID":"977301e4-9e6c-403c-99c8-00301971efea","Type":"ContainerStarted","Data":"32067982a466596b9d74f29e8c6524a667e5dcffc929ae983b9157956ba59d18"} Jul 07 16:31:08.820330 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:31:08.820291 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-fctmd" event={"ID":"977301e4-9e6c-403c-99c8-00301971efea","Type":"ContainerStarted","Data":"e6d598fdf8d2bb6c121851f495e8f1bae65ee6b2cebc84468167b1b4ea4174b1"} Jul 07 16:31:08.820796 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:31:08.820413 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-fctmd" Jul 07 16:31:08.857686 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:31:08.857634 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-fctmd" podStartSLOduration=1.810789947 podStartE2EDuration="6.857618255s" totalImagesPullingTime="5.046828308s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:31:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:31:08.857103234 +0000 UTC m=+511.990068693" watchObservedRunningTime="2026-07-07 16:31:08.857618255 +0000 UTC m=+511.990583762" Jul 07 16:31:14.854752 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:31:14.854723 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-fctmd" Jul 07 16:31:25.444586 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:31:25.444555 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/keycloak-operator-d8b9d7b4d-pqrjj"] Jul 07 16:31:25.467773 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:31:25.467744 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d8b9d7b4d-pqrjj"] Jul 07 16:31:25.467931 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:31:25.467842 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d8b9d7b4d-pqrjj" Jul 07 16:31:25.470810 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:31:25.470783 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jul 07 16:31:25.472081 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:31:25.472060 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jul 07 16:31:25.472081 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:31:25.472073 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"keycloak-operator-dockercfg-skzhl\"" Jul 07 16:31:25.547484 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:31:25.547440 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqtx7\" (UniqueName: \"kubernetes.io/projected/ac5e0f1e-5309-4549-ab81-29a967ee0116-kube-api-access-bqtx7\") pod \"keycloak-operator-d8b9d7b4d-pqrjj\" (UID: \"ac5e0f1e-5309-4549-ab81-29a967ee0116\") " pod="keycloak-system/keycloak-operator-d8b9d7b4d-pqrjj" Jul 07 16:31:25.648691 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:31:25.648655 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqtx7\" (UniqueName: \"kubernetes.io/projected/ac5e0f1e-5309-4549-ab81-29a967ee0116-kube-api-access-bqtx7\") pod \"keycloak-operator-d8b9d7b4d-pqrjj\" (UID: \"ac5e0f1e-5309-4549-ab81-29a967ee0116\") " pod="keycloak-system/keycloak-operator-d8b9d7b4d-pqrjj" Jul 07 16:31:25.663500 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:31:25.663474 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqtx7\" (UniqueName: \"kubernetes.io/projected/ac5e0f1e-5309-4549-ab81-29a967ee0116-kube-api-access-bqtx7\") pod \"keycloak-operator-d8b9d7b4d-pqrjj\" (UID: \"ac5e0f1e-5309-4549-ab81-29a967ee0116\") " pod="keycloak-system/keycloak-operator-d8b9d7b4d-pqrjj" Jul 07 16:31:25.781038 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:31:25.780953 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d8b9d7b4d-pqrjj" Jul 07 16:31:25.925796 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:31:25.925771 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d8b9d7b4d-pqrjj"] Jul 07 16:31:25.927413 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:31:25.927386 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac5e0f1e_5309_4549_ab81_29a967ee0116.slice/crio-a22cd18154be0d83dc1e25d4d6d31be45b7f49c9a2be931c2b97b3864b9942eb WatchSource:0}: Error finding container a22cd18154be0d83dc1e25d4d6d31be45b7f49c9a2be931c2b97b3864b9942eb: Status 404 returned error can't find the container with id a22cd18154be0d83dc1e25d4d6d31be45b7f49c9a2be931c2b97b3864b9942eb Jul 07 16:31:26.909190 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:31:26.909127 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d8b9d7b4d-pqrjj" event={"ID":"ac5e0f1e-5309-4549-ab81-29a967ee0116","Type":"ContainerStarted","Data":"a22cd18154be0d83dc1e25d4d6d31be45b7f49c9a2be931c2b97b3864b9942eb"} Jul 07 16:31:32.939949 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:31:32.939911 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d8b9d7b4d-pqrjj" event={"ID":"ac5e0f1e-5309-4549-ab81-29a967ee0116","Type":"ContainerStarted","Data":"31331fe2a84bcaf4de28a4735b9ce60046c685c324c695960d30bbe7db50145f"} Jul 07 16:31:32.962464 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:31:32.962377 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/keycloak-operator-d8b9d7b4d-pqrjj" podStartSLOduration=1.374203843 podStartE2EDuration="7.962359313s" totalImagesPullingTime="6.58815547s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:31:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:31:32.962187772 +0000 UTC m=+536.095153232" watchObservedRunningTime="2026-07-07 16:31:32.962359313 +0000 UTC m=+536.095324776" Jul 07 16:32:37.333414 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:32:37.333390 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-wwrsk_ab9458b7-cc16-493e-90f5-ff72d3b10ac7/console-operator/1.log" Jul 07 16:32:37.337060 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:32:37.337044 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-wwrsk_ab9458b7-cc16-493e-90f5-ff72d3b10ac7/console-operator/1.log" Jul 07 16:32:37.337813 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:32:37.337798 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dbbfb_a1abd5d4-cd31-4b5b-9011-9dd0f248ce19/ovn-acl-logging/0.log" Jul 07 16:32:37.341681 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:32:37.341662 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dbbfb_a1abd5d4-cd31-4b5b-9011-9dd0f248ce19/ovn-acl-logging/0.log" Jul 07 16:33:04.363746 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:33:04.363648 2552 generic.go:356] "Generic (PLEG): container finished" podID="63718783-1233-468a-86ab-ea873f9e5a82" containerID="8838ce6b7429c93d0f3161ff9acd858d85ff4312e207f6805267662200f3e93e" exitCode=0 Jul 07 16:33:04.363746 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:33:04.363720 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jkbck" event={"ID":"63718783-1233-468a-86ab-ea873f9e5a82","Type":"ContainerDied","Data":"8838ce6b7429c93d0f3161ff9acd858d85ff4312e207f6805267662200f3e93e"} Jul 07 16:33:04.364167 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:33:04.364123 2552 scope.go:117] "RemoveContainer" containerID="8838ce6b7429c93d0f3161ff9acd858d85ff4312e207f6805267662200f3e93e" Jul 07 16:33:04.365109 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:33:04.365086 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"} Jul 07 16:33:04.365167 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:33:04.365153 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"} Jul 07 16:33:04.365229 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:33:04.365190 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"} Jul 07 16:33:05.370422 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:33:05.370386 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jkbck" event={"ID":"63718783-1233-468a-86ab-ea873f9e5a82","Type":"ContainerStarted","Data":"19502ad5037dd3186a919b21ed1ac517253466b4f613580b036414abe675d58b"} Jul 07 16:33:05.654986 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:33:05.654952 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jkbck" Jul 07 16:33:05.655169 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:33:05.655147 2552 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-jkbck container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused" start-of-body= Jul 07 16:33:05.655238 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:33:05.655191 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jkbck" podUID="63718783-1233-468a-86ab-ea873f9e5a82" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused" Jul 07 16:33:06.655302 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:33:06.655273 2552 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-jkbck container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused" start-of-body= Jul 07 16:33:06.655649 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:33:06.655334 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jkbck" podUID="63718783-1233-468a-86ab-ea873f9e5a82" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused" Jul 07 16:33:07.656082 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:33:07.656043 2552 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-jkbck container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused" start-of-body= Jul 07 16:33:07.656597 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:33:07.656105 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jkbck" podUID="63718783-1233-468a-86ab-ea873f9e5a82" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused" Jul 07 16:33:08.656238 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:33:08.656186 2552 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-jkbck container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused" start-of-body= Jul 07 16:33:08.656609 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:33:08.656277 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jkbck" podUID="63718783-1233-468a-86ab-ea873f9e5a82" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused" Jul 07 16:33:09.659571 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:33:09.659540 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jkbck" Jul 07 16:33:09.660020 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:33:09.659832 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jkbck" Jul 07 16:33:09.660890 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:33:09.660872 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jkbck" Jul 07 16:33:53.067989 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:33:53.067951 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gjbwb"] Jul 07 16:33:53.071169 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:33:53.071144 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gjbwb" Jul 07 16:33:53.074143 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:33:53.074121 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 07 16:33:53.075460 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:33:53.075436 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jul 07 16:33:53.075572 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:33:53.075467 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 07 16:33:53.075640 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:33:53.075595 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-bkj8k\"" Jul 07 16:33:53.087771 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:33:53.087751 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gjbwb"] Jul 07 16:33:53.156211 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:33:53.156181 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p64w8\" (UniqueName: \"kubernetes.io/projected/25018950-e08f-4dc3-9260-613704d2cde2-kube-api-access-p64w8\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gjbwb\" (UID: \"25018950-e08f-4dc3-9260-613704d2cde2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gjbwb" Jul 07 16:33:53.156366 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:33:53.156239 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/25018950-e08f-4dc3-9260-613704d2cde2-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gjbwb\" (UID: \"25018950-e08f-4dc3-9260-613704d2cde2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gjbwb" Jul 07 16:33:53.156366 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:33:53.156300 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/25018950-e08f-4dc3-9260-613704d2cde2-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gjbwb\" (UID: \"25018950-e08f-4dc3-9260-613704d2cde2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gjbwb" Jul 07 16:33:53.156366 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:33:53.156337 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/25018950-e08f-4dc3-9260-613704d2cde2-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gjbwb\" (UID: \"25018950-e08f-4dc3-9260-613704d2cde2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gjbwb" Jul 07 16:33:53.156366 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:33:53.156365 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/25018950-e08f-4dc3-9260-613704d2cde2-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gjbwb\" (UID: \"25018950-e08f-4dc3-9260-613704d2cde2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gjbwb" Jul 07 16:33:53.156500 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:33:53.156404 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/25018950-e08f-4dc3-9260-613704d2cde2-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gjbwb\" (UID: \"25018950-e08f-4dc3-9260-613704d2cde2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gjbwb" Jul 07 16:33:53.257688 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:33:53.257640 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p64w8\" (UniqueName: \"kubernetes.io/projected/25018950-e08f-4dc3-9260-613704d2cde2-kube-api-access-p64w8\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gjbwb\" (UID: \"25018950-e08f-4dc3-9260-613704d2cde2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gjbwb" Jul 07 16:33:53.257688 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:33:53.257690 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/25018950-e08f-4dc3-9260-613704d2cde2-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gjbwb\" (UID: \"25018950-e08f-4dc3-9260-613704d2cde2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gjbwb" Jul 07 16:33:53.257896 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:33:53.257744 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/25018950-e08f-4dc3-9260-613704d2cde2-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gjbwb\" (UID: \"25018950-e08f-4dc3-9260-613704d2cde2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gjbwb" Jul 07 16:33:53.257896 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:33:53.257785 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/25018950-e08f-4dc3-9260-613704d2cde2-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gjbwb\" (UID: \"25018950-e08f-4dc3-9260-613704d2cde2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gjbwb" Jul 07 16:33:53.257896 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:33:53.257816 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/25018950-e08f-4dc3-9260-613704d2cde2-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gjbwb\" (UID: \"25018950-e08f-4dc3-9260-613704d2cde2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gjbwb" Jul 07 16:33:53.257896 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:33:53.257862 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/25018950-e08f-4dc3-9260-613704d2cde2-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gjbwb\" (UID: \"25018950-e08f-4dc3-9260-613704d2cde2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gjbwb" Jul 07 16:33:53.258159 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:33:53.258136 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/25018950-e08f-4dc3-9260-613704d2cde2-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gjbwb\" (UID: \"25018950-e08f-4dc3-9260-613704d2cde2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gjbwb" Jul 07 16:33:53.258159 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:33:53.258149 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/25018950-e08f-4dc3-9260-613704d2cde2-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gjbwb\" (UID: \"25018950-e08f-4dc3-9260-613704d2cde2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gjbwb" Jul 07 16:33:53.258314 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:33:53.258247 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/25018950-e08f-4dc3-9260-613704d2cde2-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gjbwb\" (UID: \"25018950-e08f-4dc3-9260-613704d2cde2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gjbwb" Jul 07 16:33:53.260068 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:33:53.260042 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/25018950-e08f-4dc3-9260-613704d2cde2-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gjbwb\" (UID: \"25018950-e08f-4dc3-9260-613704d2cde2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gjbwb" Jul 07 16:33:53.260397 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:33:53.260377 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/25018950-e08f-4dc3-9260-613704d2cde2-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gjbwb\" (UID: \"25018950-e08f-4dc3-9260-613704d2cde2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gjbwb" Jul 07 16:33:53.271217 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:33:53.271179 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p64w8\" (UniqueName: \"kubernetes.io/projected/25018950-e08f-4dc3-9260-613704d2cde2-kube-api-access-p64w8\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gjbwb\" (UID: \"25018950-e08f-4dc3-9260-613704d2cde2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gjbwb" Jul 07 16:33:53.381957 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:33:53.381934 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gjbwb" Jul 07 16:33:53.518342 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:33:53.518314 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gjbwb"] Jul 07 16:33:53.520582 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:33:53.520557 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25018950_e08f_4dc3_9260_613704d2cde2.slice/crio-af09eba0975c63cf5380fc1fa97f373c5b36599f445b670594da6bae305a0631 WatchSource:0}: Error finding container af09eba0975c63cf5380fc1fa97f373c5b36599f445b670594da6bae305a0631: Status 404 returned error can't find the container with id af09eba0975c63cf5380fc1fa97f373c5b36599f445b670594da6bae305a0631 Jul 07 16:33:53.521908 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:33:53.521891 2552 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 16:33:53.585578 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:33:53.585546 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gjbwb" event={"ID":"25018950-e08f-4dc3-9260-613704d2cde2","Type":"ContainerStarted","Data":"af09eba0975c63cf5380fc1fa97f373c5b36599f445b670594da6bae305a0631"} Jul 07 16:33:55.596186 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:33:55.596152 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gjbwb" event={"ID":"25018950-e08f-4dc3-9260-613704d2cde2","Type":"ContainerStarted","Data":"142d0521d3b2d6075212ada53004d8e9cfc0fcca76f10b39bc67db9b7ea1307f"} Jul 07 16:33:55.616551 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:33:55.616500 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gjbwb" podStartSLOduration=1.567539292 podStartE2EDuration="2.616484557s" totalImagesPullingTime="1.048945265s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:33:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:33:55.614925224 +0000 UTC m=+678.747890683" watchObservedRunningTime="2026-07-07 16:33:55.616484557 +0000 UTC m=+678.749450016" Jul 07 16:34:03.382853 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:34:03.382814 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gjbwb" Jul 07 16:34:03.383256 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:34:03.382928 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gjbwb" Jul 07 16:34:03.395516 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:34:03.395491 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gjbwb" Jul 07 16:34:03.643423 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:34:03.643346 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gjbwb" Jul 07 16:36:45.007965 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:36:45.007936 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-hkm4g_64d274b9-1a3b-4ee6-82b2-60edc42a52ed/server/0.log" Jul 07 16:36:45.151596 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:36:45.151561 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-xz26v_45774b18-ee9b-4cbf-ad61-b0c90c204a23/manager/0.log" Jul 07 16:36:45.290486 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:36:45.290403 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6b65b5fdbc-dm259_272c2007-d9b7-4dee-9914-00387f2c68d4/manager/0.log" Jul 07 16:36:45.297863 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:36:45.297842 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6b65b5fdbc-dm259_272c2007-d9b7-4dee-9914-00387f2c68d4/copy-manifests/0.log" Jul 07 16:36:45.719811 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:36:45.719784 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-fctmd_977301e4-9e6c-403c-99c8-00301971efea/postgres/0.log" Jul 07 16:36:48.520317 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:36:48.520287 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf464f6k_00f5dbed-2ca2-4def-a1c3-d489ca5ca9cc/istio-proxy/0.log" Jul 07 16:36:48.648240 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:36:48.648193 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-kc65s_79e3e8bf-cd2f-414e-af43-244c5d6bf8a3/discovery/0.log" Jul 07 16:36:48.764823 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:36:48.764797 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7c9bdf7f84-nk2d8_76c522d1-b95d-42f6-9c00-65f89d972926/kube-auth-proxy/0.log" Jul 07 16:36:49.006920 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:36:49.006895 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-jkbck_63718783-1233-468a-86ab-ea873f9e5a82/istio-proxy/1.log" Jul 07 16:36:49.382215 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:36:49.382187 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-675d4b7575-sgxn7_71da8590-3ed3-475d-8d66-fee560bb7abc/router/0.log" Jul 07 16:36:49.771960 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:36:49.771872 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-gjbwb_25018950-e08f-4dc3-9260-613704d2cde2/main/0.log" Jul 07 16:36:58.139827 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:36:58.139793 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-8qbxw_f5d16211-b5e0-4042-aeba-ba5d273ccd96/global-pull-secret-syncer/0.log" Jul 07 16:36:58.384872 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:36:58.384837 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-q798q_dbfa7ead-a6a8-4536-8a8d-cbe2e2b33011/konnectivity-agent/0.log" Jul 07 16:36:58.482538 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:36:58.482454 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-189.ec2.internal_dc5e733733f3672abbc00ed966fa257c/haproxy/0.log" Jul 07 16:37:05.668969 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:37:05.668933 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-8kqd8_db1a7c4e-7b26-4e89-b989-7329dca3dfcf/cluster-monitoring-operator/0.log" Jul 07 16:37:06.043306 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:37:06.043230 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9rrbf_0d0a557a-e779-4b4d-95bc-c758e5ade958/node-exporter/0.log" Jul 07 16:37:06.073795 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:37:06.073762 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9rrbf_0d0a557a-e779-4b4d-95bc-c758e5ade958/kube-rbac-proxy/0.log" Jul 07 16:37:06.100472 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:37:06.100448 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9rrbf_0d0a557a-e779-4b4d-95bc-c758e5ade958/init-textfile/0.log" Jul 07 16:37:07.824773 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:37:07.824738 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-t6vzc/perf-node-gather-daemonset-7jbzt"] Jul 07 16:37:07.828191 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:37:07.828170 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-t6vzc/perf-node-gather-daemonset-7jbzt" Jul 07 16:37:07.831177 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:37:07.831155 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-t6vzc\"/\"kube-root-ca.crt\"" Jul 07 16:37:07.831322 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:37:07.831303 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-t6vzc\"/\"openshift-service-ca.crt\"" Jul 07 16:37:07.832564 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:37:07.832549 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-t6vzc\"/\"default-dockercfg-pzc5s\"" Jul 07 16:37:07.842557 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:37:07.842538 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-t6vzc/perf-node-gather-daemonset-7jbzt"] Jul 07 16:37:07.928750 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:37:07.928710 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4c321df5-d317-48fc-9fc1-20f0c84ea404-proc\") pod \"perf-node-gather-daemonset-7jbzt\" (UID: \"4c321df5-d317-48fc-9fc1-20f0c84ea404\") " pod="openshift-must-gather-t6vzc/perf-node-gather-daemonset-7jbzt" Jul 07 16:37:07.928750 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:37:07.928750 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4c321df5-d317-48fc-9fc1-20f0c84ea404-sys\") pod \"perf-node-gather-daemonset-7jbzt\" (UID: \"4c321df5-d317-48fc-9fc1-20f0c84ea404\") " pod="openshift-must-gather-t6vzc/perf-node-gather-daemonset-7jbzt" Jul 07 16:37:07.928977 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:37:07.928778 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4c321df5-d317-48fc-9fc1-20f0c84ea404-lib-modules\") pod \"perf-node-gather-daemonset-7jbzt\" (UID: \"4c321df5-d317-48fc-9fc1-20f0c84ea404\") " pod="openshift-must-gather-t6vzc/perf-node-gather-daemonset-7jbzt" Jul 07 16:37:07.928977 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:37:07.928859 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4c321df5-d317-48fc-9fc1-20f0c84ea404-podres\") pod \"perf-node-gather-daemonset-7jbzt\" (UID: \"4c321df5-d317-48fc-9fc1-20f0c84ea404\") " pod="openshift-must-gather-t6vzc/perf-node-gather-daemonset-7jbzt" Jul 07 16:37:07.928977 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:37:07.928878 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v58lr\" (UniqueName: \"kubernetes.io/projected/4c321df5-d317-48fc-9fc1-20f0c84ea404-kube-api-access-v58lr\") pod \"perf-node-gather-daemonset-7jbzt\" (UID: \"4c321df5-d317-48fc-9fc1-20f0c84ea404\") " pod="openshift-must-gather-t6vzc/perf-node-gather-daemonset-7jbzt" Jul 07 16:37:08.029583 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:37:08.029547 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4c321df5-d317-48fc-9fc1-20f0c84ea404-podres\") pod \"perf-node-gather-daemonset-7jbzt\" (UID: \"4c321df5-d317-48fc-9fc1-20f0c84ea404\") " pod="openshift-must-gather-t6vzc/perf-node-gather-daemonset-7jbzt" Jul 07 16:37:08.029583 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:37:08.029587 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v58lr\" (UniqueName: \"kubernetes.io/projected/4c321df5-d317-48fc-9fc1-20f0c84ea404-kube-api-access-v58lr\") pod \"perf-node-gather-daemonset-7jbzt\" (UID: \"4c321df5-d317-48fc-9fc1-20f0c84ea404\") " pod="openshift-must-gather-t6vzc/perf-node-gather-daemonset-7jbzt" Jul 07 16:37:08.029833 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:37:08.029637 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4c321df5-d317-48fc-9fc1-20f0c84ea404-proc\") pod \"perf-node-gather-daemonset-7jbzt\" (UID: \"4c321df5-d317-48fc-9fc1-20f0c84ea404\") " pod="openshift-must-gather-t6vzc/perf-node-gather-daemonset-7jbzt" Jul 07 16:37:08.029833 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:37:08.029660 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4c321df5-d317-48fc-9fc1-20f0c84ea404-sys\") pod \"perf-node-gather-daemonset-7jbzt\" (UID: \"4c321df5-d317-48fc-9fc1-20f0c84ea404\") " pod="openshift-must-gather-t6vzc/perf-node-gather-daemonset-7jbzt" Jul 07 16:37:08.029833 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:37:08.029699 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4c321df5-d317-48fc-9fc1-20f0c84ea404-lib-modules\") pod \"perf-node-gather-daemonset-7jbzt\" (UID: \"4c321df5-d317-48fc-9fc1-20f0c84ea404\") " pod="openshift-must-gather-t6vzc/perf-node-gather-daemonset-7jbzt" Jul 07 16:37:08.029833 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:37:08.029715 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4c321df5-d317-48fc-9fc1-20f0c84ea404-podres\") pod \"perf-node-gather-daemonset-7jbzt\" (UID: \"4c321df5-d317-48fc-9fc1-20f0c84ea404\") " pod="openshift-must-gather-t6vzc/perf-node-gather-daemonset-7jbzt" Jul 07 16:37:08.029833 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:37:08.029757 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4c321df5-d317-48fc-9fc1-20f0c84ea404-proc\") pod \"perf-node-gather-daemonset-7jbzt\" (UID: \"4c321df5-d317-48fc-9fc1-20f0c84ea404\") " pod="openshift-must-gather-t6vzc/perf-node-gather-daemonset-7jbzt" Jul 07 16:37:08.029833 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:37:08.029761 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4c321df5-d317-48fc-9fc1-20f0c84ea404-sys\") pod \"perf-node-gather-daemonset-7jbzt\" (UID: \"4c321df5-d317-48fc-9fc1-20f0c84ea404\") " pod="openshift-must-gather-t6vzc/perf-node-gather-daemonset-7jbzt" Jul 07 16:37:08.030037 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:37:08.029851 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4c321df5-d317-48fc-9fc1-20f0c84ea404-lib-modules\") pod \"perf-node-gather-daemonset-7jbzt\" (UID: \"4c321df5-d317-48fc-9fc1-20f0c84ea404\") " pod="openshift-must-gather-t6vzc/perf-node-gather-daemonset-7jbzt" Jul 07 16:37:08.042908 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:37:08.042884 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v58lr\" (UniqueName: \"kubernetes.io/projected/4c321df5-d317-48fc-9fc1-20f0c84ea404-kube-api-access-v58lr\") pod \"perf-node-gather-daemonset-7jbzt\" (UID: \"4c321df5-d317-48fc-9fc1-20f0c84ea404\") " pod="openshift-must-gather-t6vzc/perf-node-gather-daemonset-7jbzt" Jul 07 16:37:08.138564 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:37:08.138529 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-t6vzc/perf-node-gather-daemonset-7jbzt" Jul 07 16:37:08.180146 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:37:08.180116 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6bffdf9778-dbdhv_22ef84ce-8d9a-48e7-bfbc-36e88476ce7d/networking-console-plugin/0.log" Jul 07 16:37:08.276287 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:37:08.276262 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-t6vzc/perf-node-gather-daemonset-7jbzt"] Jul 07 16:37:08.278846 ip-10-0-138-189 kubenswrapper[2552]: W0707 16:37:08.278814 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod4c321df5_d317_48fc_9fc1_20f0c84ea404.slice/crio-37e6d8fe6ebdb4644b138290d3087351855f99aeab9000028dfb828a97a706f6 WatchSource:0}: Error finding container 37e6d8fe6ebdb4644b138290d3087351855f99aeab9000028dfb828a97a706f6: Status 404 returned error can't find the container with id 37e6d8fe6ebdb4644b138290d3087351855f99aeab9000028dfb828a97a706f6 Jul 07 16:37:08.501977 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:37:08.501943 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-t6vzc/perf-node-gather-daemonset-7jbzt" event={"ID":"4c321df5-d317-48fc-9fc1-20f0c84ea404","Type":"ContainerStarted","Data":"e32c5935f49774d93a5e2fa8c80e87e45fdf6953928f4887a880ea96dd31643e"} Jul 07 16:37:08.502192 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:37:08.502111 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-t6vzc/perf-node-gather-daemonset-7jbzt" Jul 07 16:37:08.502192 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:37:08.502161 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-t6vzc/perf-node-gather-daemonset-7jbzt" event={"ID":"4c321df5-d317-48fc-9fc1-20f0c84ea404","Type":"ContainerStarted","Data":"37e6d8fe6ebdb4644b138290d3087351855f99aeab9000028dfb828a97a706f6"} Jul 07 16:37:08.525021 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:37:08.524965 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-t6vzc/perf-node-gather-daemonset-7jbzt" podStartSLOduration=1.524947823 podStartE2EDuration="1.524947823s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:37:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:37:08.522891553 +0000 UTC m=+871.655857025" watchObservedRunningTime="2026-07-07 16:37:08.524947823 +0000 UTC m=+871.657913282" Jul 07 16:37:08.895221 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:37:08.895173 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-wwrsk_ab9458b7-cc16-493e-90f5-ff72d3b10ac7/console-operator/1.log" Jul 07 16:37:08.899169 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:37:08.899141 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-wwrsk_ab9458b7-cc16-493e-90f5-ff72d3b10ac7/console-operator/2.log" Jul 07 16:37:09.562860 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:37:09.562813 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-685bfb5f64-2764c_9bb059a3-6f73-4ed3-9ab8-1a23a3c7880b/download-server/0.log" Jul 07 16:37:10.280440 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:37:10.280412 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5d456fdbcd-h89k9_814d6546-b617-485a-aa09-7c0ce8a65af0/volume-data-source-validator/0.log" Jul 07 16:37:11.477003 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:37:11.476975 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-m7r46_5098470b-c5d3-46b1-9098-8fa69aeac854/dns/0.log" Jul 07 16:37:11.507120 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:37:11.507073 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-m7r46_5098470b-c5d3-46b1-9098-8fa69aeac854/kube-rbac-proxy/0.log" Jul 07 16:37:11.602982 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:37:11.602951 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-59lsn_dcab04ec-d173-4c57-b7a9-fa4d1c73a7bf/dns-node-resolver/0.log" Jul 07 16:37:12.312196 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:37:12.312158 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-dbg2n_c4403f38-090d-4ad3-b880-fad3c7b44627/node-ca/0.log" Jul 07 16:37:13.473918 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:37:13.473890 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf464f6k_00f5dbed-2ca2-4def-a1c3-d489ca5ca9cc/istio-proxy/0.log" Jul 07 16:37:13.526226 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:37:13.526174 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-kc65s_79e3e8bf-cd2f-414e-af43-244c5d6bf8a3/discovery/0.log" Jul 07 16:37:13.552172 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:37:13.552146 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7c9bdf7f84-nk2d8_76c522d1-b95d-42f6-9c00-65f89d972926/kube-auth-proxy/0.log" Jul 07 16:37:13.625058 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:37:13.625031 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-jkbck_63718783-1233-468a-86ab-ea873f9e5a82/istio-proxy/0.log" Jul 07 16:37:13.755487 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:37:13.755408 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-jkbck_63718783-1233-468a-86ab-ea873f9e5a82/istio-proxy/1.log" Jul 07 16:37:13.880842 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:37:13.880813 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-675d4b7575-sgxn7_71da8590-3ed3-475d-8d66-fee560bb7abc/router/0.log" Jul 07 16:37:14.517635 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:37:14.517607 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-t6vzc/perf-node-gather-daemonset-7jbzt" Jul 07 16:37:14.535043 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:37:14.535018 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-ldxhd_e7cc3519-81dc-49db-b07a-9f26d9b1dd36/serve-healthcheck-canary/0.log" Jul 07 16:37:15.222504 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:37:15.222473 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-b65f8_08d889ae-b463-46fb-a51d-8a4b59146f6c/insights-operator/0.log" Jul 07 16:37:15.223749 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:37:15.223730 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-b65f8_08d889ae-b463-46fb-a51d-8a4b59146f6c/insights-operator/1.log" Jul 07 16:37:15.504835 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:37:15.504748 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-w9n77_5edb37e4-3383-438d-89dd-37841ca30b87/kube-rbac-proxy/0.log" Jul 07 16:37:15.534090 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:37:15.534054 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-w9n77_5edb37e4-3383-438d-89dd-37841ca30b87/exporter/0.log" Jul 07 16:37:15.567477 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:37:15.567450 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-w9n77_5edb37e4-3383-438d-89dd-37841ca30b87/extractor/0.log" Jul 07 16:37:18.311174 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:37:18.311078 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-hkm4g_64d274b9-1a3b-4ee6-82b2-60edc42a52ed/server/0.log" Jul 07 16:37:18.365552 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:37:18.365526 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-xz26v_45774b18-ee9b-4cbf-ad61-b0c90c204a23/manager/0.log" Jul 07 16:37:18.399790 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:37:18.399763 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6b65b5fdbc-dm259_272c2007-d9b7-4dee-9914-00387f2c68d4/manager/0.log" Jul 07 16:37:18.435592 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:37:18.435567 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6b65b5fdbc-dm259_272c2007-d9b7-4dee-9914-00387f2c68d4/copy-manifests/0.log" Jul 07 16:37:18.543452 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:37:18.543415 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf464f6k_00f5dbed-2ca2-4def-a1c3-d489ca5ca9cc/istio-proxy/0.log" Jul 07 16:37:18.579479 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:37:18.579394 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-kc65s_79e3e8bf-cd2f-414e-af43-244c5d6bf8a3/discovery/0.log" Jul 07 16:37:18.591523 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:37:18.591489 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7c9bdf7f84-nk2d8_76c522d1-b95d-42f6-9c00-65f89d972926/kube-auth-proxy/0.log" Jul 07 16:37:18.614722 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:37:18.614692 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-fctmd_977301e4-9e6c-403c-99c8-00301971efea/postgres/0.log" Jul 07 16:37:18.634645 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:37:18.634620 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-jkbck_63718783-1233-468a-86ab-ea873f9e5a82/istio-proxy/0.log" Jul 07 16:37:18.767268 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:37:18.767225 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-jkbck_63718783-1233-468a-86ab-ea873f9e5a82/istio-proxy/1.log" Jul 07 16:37:18.874662 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:37:18.874631 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-675d4b7575-sgxn7_71da8590-3ed3-475d-8d66-fee560bb7abc/router/0.log" Jul 07 16:37:20.003649 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:37:20.003624 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf464f6k_00f5dbed-2ca2-4def-a1c3-d489ca5ca9cc/istio-proxy/0.log" Jul 07 16:37:20.043928 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:37:20.043882 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-kc65s_79e3e8bf-cd2f-414e-af43-244c5d6bf8a3/discovery/0.log" Jul 07 16:37:20.057627 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:37:20.057597 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7c9bdf7f84-nk2d8_76c522d1-b95d-42f6-9c00-65f89d972926/kube-auth-proxy/0.log" Jul 07 16:37:20.097976 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:37:20.097950 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-jkbck_63718783-1233-468a-86ab-ea873f9e5a82/istio-proxy/0.log" Jul 07 16:37:20.234782 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:37:20.234749 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-jkbck_63718783-1233-468a-86ab-ea873f9e5a82/istio-proxy/1.log" Jul 07 16:37:20.330995 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:37:20.330915 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-675d4b7575-sgxn7_71da8590-3ed3-475d-8d66-fee560bb7abc/router/0.log" Jul 07 16:37:25.222478 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:37:25.222444 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-szbk5_ea884014-f1e0-4353-99e8-0d08f5bbdf5a/migrator/0.log" Jul 07 16:37:25.246308 ip-10-0-138-189 kubenswrapper[2552]: I0707 16:37:25.246276 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-szbk5_ea884014-f1e0-4353-99e8-0d08f5bbdf5a/graceful-termination/0.log"