Jul 09 04:14:01.592669 ip-10-0-137-76 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 09 04:14:01.592683 ip-10-0-137-76 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 09 04:14:01.592693 ip-10-0-137-76 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 09 04:14:01.593152 ip-10-0-137-76 systemd[1]: Failed to start Kubernetes Kubelet. Jul 09 04:14:11.600160 ip-10-0-137-76 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 09 04:14:11.600174 ip-10-0-137-76 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 4f346e49bece4217b44e0220dde21835 -- Jul 09 04:15:42.244266 ip-10-0-137-76 systemd[1]: Starting Kubernetes Kubelet... Jul 09 04:15:42.710359 ip-10-0-137-76 kubenswrapper[2566]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 09 04:15:42.710359 ip-10-0-137-76 kubenswrapper[2566]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 09 04:15:42.710359 ip-10-0-137-76 kubenswrapper[2566]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 09 04:15:42.710359 ip-10-0-137-76 kubenswrapper[2566]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 09 04:15:42.710359 ip-10-0-137-76 kubenswrapper[2566]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 09 04:15:42.712628 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.712474 2566 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 09 04:15:42.717554 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.717534 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 04:15:42.717554 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.717553 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 04:15:42.717620 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.717557 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 04:15:42.717620 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.717560 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 04:15:42.717620 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.717563 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 04:15:42.717620 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.717566 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 04:15:42.717620 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.717568 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 04:15:42.717620 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.717571 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 04:15:42.717620 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.717576 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 04:15:42.717620 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.717579 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 04:15:42.717620 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.717581 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 04:15:42.717620 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.717590 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 04:15:42.717620 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.717593 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 04:15:42.717620 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.717595 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 04:15:42.717620 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.717598 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 04:15:42.717620 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.717601 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 04:15:42.717620 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.717603 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 04:15:42.717620 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.717606 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 04:15:42.717620 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.717608 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 04:15:42.717620 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.717611 2566 feature_gate.go:328] unrecognized feature gate: Example Jul 09 04:15:42.717620 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.717613 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 04:15:42.717620 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.717616 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 04:15:42.718186 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.717618 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 04:15:42.718186 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.717620 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 04:15:42.718186 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.717623 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 04:15:42.718186 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.717626 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 04:15:42.718186 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.717629 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 04:15:42.718186 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.717631 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 04:15:42.718186 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.717634 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 04:15:42.718186 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.717636 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 04:15:42.718186 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.717639 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 04:15:42.718186 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.717641 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 04:15:42.718186 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.717644 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 04:15:42.718186 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.717646 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 04:15:42.718186 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.717649 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 04:15:42.718186 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.717651 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 04:15:42.718186 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.717654 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 04:15:42.718186 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.717656 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 04:15:42.718186 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.717664 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 04:15:42.718186 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.717668 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 04:15:42.718186 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.717671 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 04:15:42.718186 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.717673 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 04:15:42.718681 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.717676 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 04:15:42.718681 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.717678 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 04:15:42.718681 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.717681 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 04:15:42.718681 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.717683 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 04:15:42.718681 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.717686 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 04:15:42.718681 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.717689 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 04:15:42.718681 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.717691 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 04:15:42.718681 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.717693 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 04:15:42.718681 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.717695 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 04:15:42.718681 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.717698 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 04:15:42.718681 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.717700 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 04:15:42.718681 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.717702 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 04:15:42.718681 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.717705 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 04:15:42.718681 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.717708 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 04:15:42.718681 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.717710 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 04:15:42.718681 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.717713 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 04:15:42.718681 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.717717 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 04:15:42.718681 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.717721 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 04:15:42.718681 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.717724 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 04:15:42.719166 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.717727 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 04:15:42.719166 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.717730 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 04:15:42.719166 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.717733 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 04:15:42.719166 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.717736 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 04:15:42.719166 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.717738 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 04:15:42.719166 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.717742 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 04:15:42.719166 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.717745 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 04:15:42.719166 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.717747 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 04:15:42.719166 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.717750 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 04:15:42.719166 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.717758 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 04:15:42.719166 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.717762 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 04:15:42.719166 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.717765 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 04:15:42.719166 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.717767 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 04:15:42.719166 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.717771 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 04:15:42.719166 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.717774 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 04:15:42.719166 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.717776 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 04:15:42.719166 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.717778 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 04:15:42.719166 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.717781 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 04:15:42.719166 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.717783 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 04:15:42.719166 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.717785 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 04:15:42.719645 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.717788 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 04:15:42.719645 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.717791 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 04:15:42.719645 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.717793 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 04:15:42.719645 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.717795 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 04:15:42.719645 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.717797 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 04:15:42.719645 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.717800 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 04:15:42.719645 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.717804 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 04:15:42.719645 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.717806 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 04:15:42.719645 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.717809 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 04:15:42.719645 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.717811 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 04:15:42.719645 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.717814 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 04:15:42.719645 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.717816 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 04:15:42.719645 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.717819 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 04:15:42.719645 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.717821 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 04:15:42.719645 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.717823 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 04:15:42.719645 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.717826 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 04:15:42.719645 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.717828 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 04:15:42.719645 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.717831 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 04:15:42.719645 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.719409 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 04:15:42.719645 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.719418 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 04:15:42.720148 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.719421 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 04:15:42.720148 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.719424 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 04:15:42.720148 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.719428 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 04:15:42.720148 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.719431 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 04:15:42.720148 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.719434 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 04:15:42.720148 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.719437 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 04:15:42.720148 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.719440 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 04:15:42.720148 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.719442 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 04:15:42.720148 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.719445 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 04:15:42.720148 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.719447 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 04:15:42.720148 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.719450 2566 feature_gate.go:328] unrecognized feature gate: Example Jul 09 04:15:42.720148 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.719453 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 04:15:42.720148 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.719455 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 04:15:42.720148 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.719459 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 04:15:42.720148 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.719463 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 04:15:42.720148 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.719466 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 04:15:42.720148 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.719469 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 04:15:42.720148 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.719471 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 04:15:42.720148 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.719474 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 04:15:42.720607 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.719477 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 04:15:42.720607 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.719480 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 04:15:42.720607 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.719482 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 04:15:42.720607 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.719485 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 04:15:42.720607 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.719488 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 04:15:42.720607 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.719490 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 04:15:42.720607 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.719493 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 04:15:42.720607 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.719496 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 04:15:42.720607 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.719498 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 04:15:42.720607 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.719501 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 04:15:42.720607 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.719503 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 04:15:42.720607 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.719506 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 04:15:42.720607 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.719508 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 04:15:42.720607 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.719513 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 04:15:42.720607 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.719516 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 04:15:42.720607 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.719519 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 04:15:42.720607 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.719522 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 04:15:42.720607 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.719532 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 04:15:42.720607 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.719535 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 04:15:42.721080 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.719538 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 04:15:42.721080 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.719540 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 04:15:42.721080 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.719543 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 04:15:42.721080 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.719545 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 04:15:42.721080 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.719548 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 04:15:42.721080 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.719550 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 04:15:42.721080 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.719553 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 04:15:42.721080 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.719556 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 04:15:42.721080 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.719559 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 04:15:42.721080 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.719561 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 04:15:42.721080 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.719564 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 04:15:42.721080 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.719567 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 04:15:42.721080 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.719571 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 04:15:42.721080 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.719574 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 04:15:42.721080 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.719577 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 04:15:42.721080 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.719579 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 04:15:42.721080 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.719582 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 04:15:42.721080 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.719584 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 04:15:42.721080 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.719587 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 04:15:42.721080 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.719590 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 04:15:42.721551 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.719592 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 04:15:42.721551 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.719595 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 04:15:42.721551 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.719598 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 04:15:42.721551 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.719602 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 04:15:42.721551 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.719605 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 04:15:42.721551 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.719607 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 04:15:42.721551 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.719610 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 04:15:42.721551 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.719614 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 04:15:42.721551 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.719617 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 04:15:42.721551 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.719619 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 04:15:42.721551 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.719622 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 04:15:42.721551 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.719626 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 04:15:42.721551 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.719629 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 04:15:42.721551 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.719631 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 04:15:42.721551 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.719634 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 04:15:42.721551 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.719637 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 04:15:42.721551 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.719640 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 04:15:42.721551 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.719642 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 04:15:42.721551 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.719645 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 04:15:42.722009 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.719648 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 04:15:42.722009 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.719651 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 04:15:42.722009 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.719653 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 04:15:42.722009 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.719657 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 04:15:42.722009 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.719660 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 04:15:42.722009 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.719663 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 04:15:42.722009 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.719666 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 04:15:42.722009 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.719668 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 04:15:42.722009 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.719671 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 04:15:42.722009 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.719673 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 04:15:42.722009 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.719676 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 04:15:42.722009 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.719679 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 04:15:42.722009 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.719694 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 04:15:42.722009 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.719696 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 04:15:42.722009 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.719699 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 04:15:42.722009 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.719701 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 04:15:42.722009 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.719703 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 04:15:42.722009 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.719706 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 04:15:42.722009 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.719709 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 04:15:42.722009 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.719711 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 04:15:42.722513 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.720128 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 04:15:42.722513 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.720134 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 04:15:42.722513 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.720137 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 04:15:42.722513 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.720140 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 04:15:42.722513 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.720143 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 04:15:42.722513 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.720146 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 04:15:42.722513 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.720148 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 04:15:42.722513 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.720151 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 04:15:42.722513 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.720154 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 04:15:42.722513 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.720157 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 04:15:42.722513 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.720160 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 04:15:42.722513 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.720163 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 04:15:42.722513 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.720165 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 04:15:42.722513 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.720168 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 04:15:42.722513 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.720171 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 04:15:42.722513 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.720173 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 04:15:42.722513 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.720175 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 04:15:42.722513 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.720178 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 04:15:42.722513 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.720181 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 04:15:42.722513 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.720184 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 04:15:42.723033 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.720186 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 04:15:42.723033 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.720189 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 04:15:42.723033 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.720191 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 04:15:42.723033 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.720194 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 04:15:42.723033 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.720197 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 04:15:42.723033 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.720200 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 04:15:42.723033 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.720202 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 04:15:42.723033 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.720205 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 04:15:42.723033 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.720207 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 04:15:42.723033 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.720210 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 04:15:42.723033 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.720212 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 04:15:42.723033 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.720214 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 04:15:42.723033 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.720217 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 04:15:42.723033 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.720219 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 04:15:42.723033 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.720222 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 04:15:42.723033 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.720226 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 04:15:42.723033 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.720229 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 04:15:42.723033 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.720232 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 04:15:42.723033 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.720236 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 04:15:42.723033 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.720238 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 04:15:42.723560 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.720241 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 04:15:42.723560 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.720243 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 04:15:42.723560 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.720245 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 04:15:42.723560 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.720248 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 04:15:42.723560 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.720250 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 04:15:42.723560 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.720252 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 04:15:42.723560 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.720254 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 04:15:42.723560 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.720257 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 04:15:42.723560 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.720260 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 04:15:42.723560 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.720265 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 04:15:42.723560 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.720268 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 04:15:42.723560 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.720270 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 04:15:42.723560 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.720272 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 04:15:42.723560 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.720275 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 04:15:42.723560 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.720277 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 04:15:42.723560 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.720280 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 04:15:42.723560 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.720283 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 04:15:42.723560 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.720285 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 04:15:42.723560 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.720287 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 04:15:42.723560 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.720290 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 04:15:42.724074 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.720292 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 04:15:42.724074 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.720295 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 04:15:42.724074 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.720297 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 04:15:42.724074 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.720300 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 04:15:42.724074 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.720302 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 04:15:42.724074 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.720305 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 04:15:42.724074 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.720307 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 04:15:42.724074 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.720310 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 04:15:42.724074 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.720312 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 04:15:42.724074 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.720315 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 04:15:42.724074 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.720319 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 04:15:42.724074 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.720321 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 04:15:42.724074 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.720324 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 04:15:42.724074 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.720326 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 04:15:42.724074 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.720328 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 04:15:42.724074 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.720331 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 04:15:42.724074 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.720333 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 04:15:42.724074 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.720336 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 04:15:42.724074 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.720338 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 04:15:42.724511 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.720341 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 04:15:42.724511 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.720343 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 04:15:42.724511 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.720348 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 04:15:42.724511 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.720350 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 04:15:42.724511 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.720353 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 04:15:42.724511 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.720355 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 04:15:42.724511 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.720358 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 04:15:42.724511 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.720360 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 04:15:42.724511 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.720363 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 04:15:42.724511 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.720365 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 04:15:42.724511 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.720367 2566 feature_gate.go:328] unrecognized feature gate: Example Jul 09 04:15:42.724511 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.720370 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 04:15:42.724511 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.720372 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 04:15:42.724511 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.720375 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 04:15:42.724511 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.720379 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 04:15:42.724511 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.720382 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 04:15:42.724511 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.720385 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 04:15:42.724511 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.720388 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 04:15:42.724511 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.720391 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 04:15:42.724995 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.720395 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 04:15:42.724995 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.720485 2566 flags.go:64] FLAG: --address="0.0.0.0" Jul 09 04:15:42.724995 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.720504 2566 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 09 04:15:42.724995 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.720515 2566 flags.go:64] FLAG: --anonymous-auth="true" Jul 09 04:15:42.724995 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.720521 2566 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 09 04:15:42.724995 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.720528 2566 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 09 04:15:42.724995 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.720533 2566 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 09 04:15:42.724995 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.720537 2566 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 09 04:15:42.724995 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.720541 2566 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 09 04:15:42.724995 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.720544 2566 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 09 04:15:42.724995 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.720547 2566 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 09 04:15:42.724995 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.720550 2566 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 09 04:15:42.724995 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.720553 2566 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 09 04:15:42.724995 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.720556 2566 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 09 04:15:42.724995 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.720559 2566 flags.go:64] FLAG: --cgroup-root="" Jul 09 04:15:42.724995 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.720564 2566 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 09 04:15:42.724995 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.720567 2566 flags.go:64] FLAG: --client-ca-file="" Jul 09 04:15:42.724995 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.720570 2566 flags.go:64] FLAG: --cloud-provider="external" Jul 09 04:15:42.724995 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.720573 2566 flags.go:64] FLAG: --cluster-dns="[]" Jul 09 04:15:42.724995 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.721233 2566 flags.go:64] FLAG: --cluster-domain="" Jul 09 04:15:42.724995 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.721237 2566 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 09 04:15:42.724995 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.721241 2566 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 09 04:15:42.724995 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.721244 2566 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 09 04:15:42.725531 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.721247 2566 flags.go:64] FLAG: --container-log-max-files="5" Jul 09 04:15:42.725531 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.721252 2566 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 09 04:15:42.725531 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.721255 2566 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 09 04:15:42.725531 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.721258 2566 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 09 04:15:42.725531 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.721261 2566 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 09 04:15:42.725531 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.721265 2566 flags.go:64] FLAG: --contention-profiling="false" Jul 09 04:15:42.725531 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.721268 2566 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 09 04:15:42.725531 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.721271 2566 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 09 04:15:42.725531 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.721274 2566 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 09 04:15:42.725531 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.721277 2566 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 09 04:15:42.725531 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.721281 2566 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 09 04:15:42.725531 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.721284 2566 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 09 04:15:42.725531 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.721287 2566 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 09 04:15:42.725531 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.721290 2566 flags.go:64] FLAG: --enable-load-reader="false" Jul 09 04:15:42.725531 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.721293 2566 flags.go:64] FLAG: --enable-server="true" Jul 09 04:15:42.725531 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.721297 2566 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 09 04:15:42.725531 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.721302 2566 flags.go:64] FLAG: --event-burst="100" Jul 09 04:15:42.725531 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.721305 2566 flags.go:64] FLAG: --event-qps="50" Jul 09 04:15:42.725531 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.721308 2566 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 09 04:15:42.725531 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.721310 2566 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 09 04:15:42.725531 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.721313 2566 flags.go:64] FLAG: --eviction-hard="" Jul 09 04:15:42.725531 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.721317 2566 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 09 04:15:42.725531 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.721320 2566 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 09 04:15:42.725531 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.721323 2566 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 09 04:15:42.725531 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.721327 2566 flags.go:64] FLAG: --eviction-soft="" Jul 09 04:15:42.726111 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.721329 2566 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 09 04:15:42.726111 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.721332 2566 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 09 04:15:42.726111 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.721335 2566 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 09 04:15:42.726111 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.721338 2566 flags.go:64] FLAG: --experimental-mounter-path="" Jul 09 04:15:42.726111 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.721340 2566 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 09 04:15:42.726111 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.721343 2566 flags.go:64] FLAG: --fail-swap-on="true" Jul 09 04:15:42.726111 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.721346 2566 flags.go:64] FLAG: --feature-gates="" Jul 09 04:15:42.726111 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.721349 2566 flags.go:64] FLAG: --file-check-frequency="20s" Jul 09 04:15:42.726111 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.721352 2566 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 09 04:15:42.726111 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.721355 2566 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 09 04:15:42.726111 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.721358 2566 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 09 04:15:42.726111 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.721361 2566 flags.go:64] FLAG: --healthz-port="10248" Jul 09 04:15:42.726111 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.721364 2566 flags.go:64] FLAG: --help="false" Jul 09 04:15:42.726111 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.721367 2566 flags.go:64] FLAG: --hostname-override="ip-10-0-137-76.ec2.internal" Jul 09 04:15:42.726111 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.721370 2566 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 09 04:15:42.726111 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.721373 2566 flags.go:64] FLAG: --http-check-frequency="20s" Jul 09 04:15:42.726111 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.721376 2566 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 09 04:15:42.726111 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.721379 2566 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 09 04:15:42.726111 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.721382 2566 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 09 04:15:42.726111 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.721385 2566 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 09 04:15:42.726111 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.721387 2566 flags.go:64] FLAG: --image-service-endpoint="" Jul 09 04:15:42.726111 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.721390 2566 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 09 04:15:42.726111 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.721393 2566 flags.go:64] FLAG: --kube-api-burst="100" Jul 09 04:15:42.726702 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.721396 2566 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 09 04:15:42.726702 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.721399 2566 flags.go:64] FLAG: --kube-api-qps="50" Jul 09 04:15:42.726702 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.721402 2566 flags.go:64] FLAG: --kube-reserved="" Jul 09 04:15:42.726702 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.721404 2566 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 09 04:15:42.726702 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.721407 2566 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 09 04:15:42.726702 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.721410 2566 flags.go:64] FLAG: --kubelet-cgroups="" Jul 09 04:15:42.726702 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.721413 2566 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 09 04:15:42.726702 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.721418 2566 flags.go:64] FLAG: --lock-file="" Jul 09 04:15:42.726702 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.721421 2566 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 09 04:15:42.726702 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.721424 2566 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 09 04:15:42.726702 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.721427 2566 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 09 04:15:42.726702 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.721433 2566 flags.go:64] FLAG: --log-json-split-stream="false" Jul 09 04:15:42.726702 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.721435 2566 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 09 04:15:42.726702 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.721438 2566 flags.go:64] FLAG: --log-text-split-stream="false" Jul 09 04:15:42.726702 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.721441 2566 flags.go:64] FLAG: --logging-format="text" Jul 09 04:15:42.726702 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.721443 2566 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 09 04:15:42.726702 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.721446 2566 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 09 04:15:42.726702 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.721449 2566 flags.go:64] FLAG: --manifest-url="" Jul 09 04:15:42.726702 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.721452 2566 flags.go:64] FLAG: --manifest-url-header="" Jul 09 04:15:42.726702 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.721457 2566 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 09 04:15:42.726702 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.721460 2566 flags.go:64] FLAG: --max-open-files="1000000" Jul 09 04:15:42.726702 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.721464 2566 flags.go:64] FLAG: --max-pods="110" Jul 09 04:15:42.726702 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.721467 2566 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 09 04:15:42.726702 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.721470 2566 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 09 04:15:42.726702 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.721472 2566 flags.go:64] FLAG: --memory-manager-policy="None" Jul 09 04:15:42.727335 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.721475 2566 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 09 04:15:42.727335 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.721478 2566 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 09 04:15:42.727335 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.721480 2566 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 09 04:15:42.727335 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.721483 2566 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 09 04:15:42.727335 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.721491 2566 flags.go:64] FLAG: --node-status-max-images="50" Jul 09 04:15:42.727335 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.721494 2566 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 09 04:15:42.727335 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.721497 2566 flags.go:64] FLAG: --oom-score-adj="-999" Jul 09 04:15:42.727335 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.721501 2566 flags.go:64] FLAG: --pod-cidr="" Jul 09 04:15:42.727335 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.721504 2566 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 09 04:15:42.727335 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.721509 2566 flags.go:64] FLAG: --pod-manifest-path="" Jul 09 04:15:42.727335 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.721512 2566 flags.go:64] FLAG: --pod-max-pids="-1" Jul 09 04:15:42.727335 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.721515 2566 flags.go:64] FLAG: --pods-per-core="0" Jul 09 04:15:42.727335 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.721518 2566 flags.go:64] FLAG: --port="10250" Jul 09 04:15:42.727335 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.721521 2566 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 09 04:15:42.727335 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.721525 2566 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-012263c1508fc1c2f" Jul 09 04:15:42.727335 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.721528 2566 flags.go:64] FLAG: --qos-reserved="" Jul 09 04:15:42.727335 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.721531 2566 flags.go:64] FLAG: --read-only-port="10255" Jul 09 04:15:42.727335 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.721534 2566 flags.go:64] FLAG: --register-node="true" Jul 09 04:15:42.727335 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.721537 2566 flags.go:64] FLAG: --register-with-taints="" Jul 09 04:15:42.727335 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.721540 2566 flags.go:64] FLAG: --registry-burst="10" Jul 09 04:15:42.727335 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.721543 2566 flags.go:64] FLAG: --registry-qps="5" Jul 09 04:15:42.727335 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.721546 2566 flags.go:64] FLAG: --reserved-cpus="" Jul 09 04:15:42.727335 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.721548 2566 flags.go:64] FLAG: --reserved-memory="" Jul 09 04:15:42.727335 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.721552 2566 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 09 04:15:42.727335 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.721555 2566 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 09 04:15:42.727980 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.721558 2566 flags.go:64] FLAG: --rotate-certificates="false" Jul 09 04:15:42.727980 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.721561 2566 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 09 04:15:42.727980 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.721564 2566 flags.go:64] FLAG: --runonce="false" Jul 09 04:15:42.727980 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.721566 2566 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 09 04:15:42.727980 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.721569 2566 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 09 04:15:42.727980 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.721572 2566 flags.go:64] FLAG: --seccomp-default="false" Jul 09 04:15:42.727980 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.721575 2566 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 09 04:15:42.727980 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.721577 2566 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 09 04:15:42.727980 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.721580 2566 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 09 04:15:42.727980 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.721583 2566 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 09 04:15:42.727980 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.721586 2566 flags.go:64] FLAG: --storage-driver-password="root" Jul 09 04:15:42.727980 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.721589 2566 flags.go:64] FLAG: --storage-driver-secure="false" Jul 09 04:15:42.727980 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.721591 2566 flags.go:64] FLAG: --storage-driver-table="stats" Jul 09 04:15:42.727980 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.721594 2566 flags.go:64] FLAG: --storage-driver-user="root" Jul 09 04:15:42.727980 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.721597 2566 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 09 04:15:42.727980 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.721600 2566 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 09 04:15:42.727980 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.721603 2566 flags.go:64] FLAG: --system-cgroups="" Jul 09 04:15:42.727980 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.721606 2566 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 09 04:15:42.727980 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.721611 2566 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 09 04:15:42.727980 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.721614 2566 flags.go:64] FLAG: --tls-cert-file="" Jul 09 04:15:42.727980 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.721617 2566 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 09 04:15:42.727980 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.721622 2566 flags.go:64] FLAG: --tls-min-version="" Jul 09 04:15:42.727980 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.721625 2566 flags.go:64] FLAG: --tls-private-key-file="" Jul 09 04:15:42.727980 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.721628 2566 flags.go:64] FLAG: --topology-manager-policy="none" Jul 09 04:15:42.727980 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.721631 2566 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 09 04:15:42.728956 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.721634 2566 flags.go:64] FLAG: --topology-manager-scope="container" Jul 09 04:15:42.728956 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.721637 2566 flags.go:64] FLAG: --v="2" Jul 09 04:15:42.728956 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.721641 2566 flags.go:64] FLAG: --version="false" Jul 09 04:15:42.728956 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.721645 2566 flags.go:64] FLAG: --vmodule="" Jul 09 04:15:42.728956 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.721648 2566 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 09 04:15:42.728956 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.721651 2566 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 09 04:15:42.728956 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.721772 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 04:15:42.728956 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.721793 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 04:15:42.728956 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.721799 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 04:15:42.728956 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.721803 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 04:15:42.728956 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.721808 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 04:15:42.728956 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.721811 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 04:15:42.728956 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.721813 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 04:15:42.728956 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.721816 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 04:15:42.728956 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.721819 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 04:15:42.728956 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.721821 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 04:15:42.728956 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.721823 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 04:15:42.728956 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.721826 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 04:15:42.728956 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.721828 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 04:15:42.728956 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.721831 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 04:15:42.728956 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.721834 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 04:15:42.729839 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.721836 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 04:15:42.729839 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.721839 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 04:15:42.729839 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.721841 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 04:15:42.729839 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.721845 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 04:15:42.729839 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.721847 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 04:15:42.729839 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.721849 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 04:15:42.729839 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.721852 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 04:15:42.729839 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.721856 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 04:15:42.729839 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.721858 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 04:15:42.729839 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.721863 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 04:15:42.729839 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.721865 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 04:15:42.729839 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.721868 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 04:15:42.729839 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.721871 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 04:15:42.729839 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.721873 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 04:15:42.729839 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.721876 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 04:15:42.729839 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.721878 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 04:15:42.729839 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.721881 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 04:15:42.729839 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.721883 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 04:15:42.729839 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.721886 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 04:15:42.729839 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.721888 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 04:15:42.730720 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.721891 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 04:15:42.730720 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.721893 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 04:15:42.730720 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.721895 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 04:15:42.730720 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.721898 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 04:15:42.730720 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.721902 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 04:15:42.730720 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.721918 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 04:15:42.730720 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.721922 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 04:15:42.730720 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.721925 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 04:15:42.730720 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.721927 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 04:15:42.730720 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.721930 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 04:15:42.730720 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.721933 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 04:15:42.730720 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.721935 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 04:15:42.730720 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.721938 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 04:15:42.730720 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.721940 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 04:15:42.730720 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.721943 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 04:15:42.730720 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.721946 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 04:15:42.730720 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.721950 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 04:15:42.730720 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.721952 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 04:15:42.730720 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.721955 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 04:15:42.731564 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.721959 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 04:15:42.731564 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.721961 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 04:15:42.731564 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.721965 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 04:15:42.731564 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.721967 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 04:15:42.731564 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.721970 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 04:15:42.731564 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.721972 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 04:15:42.731564 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.721975 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 04:15:42.731564 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.721977 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 04:15:42.731564 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.721980 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 04:15:42.731564 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.721982 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 04:15:42.731564 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.721985 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 04:15:42.731564 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.721987 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 04:15:42.731564 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.721990 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 04:15:42.731564 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.721992 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 04:15:42.731564 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.721994 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 04:15:42.731564 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.721997 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 04:15:42.731564 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.721999 2566 feature_gate.go:328] unrecognized feature gate: Example Jul 09 04:15:42.731564 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.722003 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 04:15:42.731564 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.722007 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 04:15:42.732441 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.722010 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 04:15:42.732441 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.722013 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 04:15:42.732441 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.722016 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 04:15:42.732441 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.722018 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 04:15:42.732441 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.722021 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 04:15:42.732441 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.722024 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 04:15:42.732441 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.722026 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 04:15:42.732441 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.722029 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 04:15:42.732441 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.722031 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 04:15:42.732441 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.722033 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 04:15:42.732441 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.722036 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 04:15:42.732441 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.722039 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 04:15:42.732441 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.722041 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 04:15:42.732441 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.722045 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 04:15:42.732441 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.722047 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 04:15:42.732441 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.722051 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 04:15:42.732441 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.722053 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 04:15:42.732441 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.722056 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 04:15:42.732441 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.722058 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 04:15:42.732441 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.722061 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 04:15:42.732997 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.722063 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 04:15:42.732997 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.722066 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 04:15:42.732997 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.722068 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 04:15:42.732997 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.722071 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 04:15:42.732997 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.722073 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 04:15:42.732997 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.722076 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 04:15:42.732997 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.722095 2566 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 09 04:15:42.732997 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.730852 2566 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 09 04:15:42.732997 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.730879 2566 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 09 04:15:42.732997 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.730928 2566 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 09 04:15:42.732997 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.730938 2566 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 09 04:15:42.732997 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731025 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 04:15:42.732997 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731033 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 04:15:42.732997 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731038 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 04:15:42.732997 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731043 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 04:15:42.733489 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731047 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 04:15:42.733489 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731052 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 04:15:42.733489 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731056 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 04:15:42.733489 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731061 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 04:15:42.733489 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731065 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 04:15:42.733489 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731070 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 04:15:42.733489 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731074 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 04:15:42.733489 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731078 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 04:15:42.733489 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731082 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 04:15:42.733489 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731086 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 04:15:42.733489 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731090 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 04:15:42.733489 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731094 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 04:15:42.733489 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731098 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 04:15:42.733489 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731102 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 04:15:42.733489 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731106 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 04:15:42.733489 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731110 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 04:15:42.733489 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731114 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 04:15:42.733489 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731119 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 04:15:42.733489 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731122 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 04:15:42.733489 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731127 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 04:15:42.734284 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731131 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 04:15:42.734284 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731135 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 04:15:42.734284 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731139 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 04:15:42.734284 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731144 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 04:15:42.734284 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731148 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 04:15:42.734284 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731154 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 04:15:42.734284 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731159 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 04:15:42.734284 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731163 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 04:15:42.734284 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731170 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 04:15:42.734284 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731176 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 04:15:42.734284 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731181 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 04:15:42.734284 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731185 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 04:15:42.734284 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731190 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 04:15:42.734284 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731194 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 04:15:42.734284 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731198 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 04:15:42.734284 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731202 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 04:15:42.734284 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731206 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 04:15:42.734284 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731211 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 04:15:42.734284 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731215 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 04:15:42.734995 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731219 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 04:15:42.734995 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731223 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 04:15:42.734995 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731226 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 04:15:42.734995 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731230 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 04:15:42.734995 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731235 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 04:15:42.734995 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731239 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 04:15:42.734995 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731243 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 04:15:42.734995 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731250 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 04:15:42.734995 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731255 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 04:15:42.734995 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731260 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 04:15:42.734995 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731264 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 04:15:42.734995 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731268 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 04:15:42.734995 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731272 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 04:15:42.734995 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731276 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 04:15:42.734995 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731281 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 04:15:42.734995 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731285 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 04:15:42.734995 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731289 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 04:15:42.734995 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731293 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 04:15:42.734995 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731297 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 04:15:42.735515 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731302 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 04:15:42.735515 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731306 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 04:15:42.735515 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731311 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 04:15:42.735515 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731315 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 04:15:42.735515 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731319 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 04:15:42.735515 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731323 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 04:15:42.735515 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731327 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 04:15:42.735515 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731331 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 04:15:42.735515 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731335 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 04:15:42.735515 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731339 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 04:15:42.735515 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731344 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 04:15:42.735515 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731349 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 04:15:42.735515 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731353 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 04:15:42.735515 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731357 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 04:15:42.735515 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731361 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 04:15:42.735515 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731365 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 04:15:42.735515 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731369 2566 feature_gate.go:328] unrecognized feature gate: Example Jul 09 04:15:42.735515 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731374 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 04:15:42.735515 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731378 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 04:15:42.735515 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731382 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 04:15:42.736256 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731386 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 04:15:42.736256 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731390 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 04:15:42.736256 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731394 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 04:15:42.736256 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731398 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 04:15:42.736256 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731402 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 04:15:42.736256 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731407 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 04:15:42.736256 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731411 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 04:15:42.736256 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731415 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 04:15:42.736256 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731419 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 04:15:42.736256 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731424 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 04:15:42.736256 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731428 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 04:15:42.736256 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731434 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 04:15:42.736256 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731440 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 04:15:42.736256 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731446 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 04:15:42.736256 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731451 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 04:15:42.736256 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731455 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 04:15:42.736256 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731459 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 04:15:42.736686 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.731467 2566 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 09 04:15:42.736686 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731683 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 04:15:42.736686 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731708 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 04:15:42.736686 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731714 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 04:15:42.736686 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731719 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 04:15:42.736686 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731724 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 04:15:42.736686 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731728 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 04:15:42.736686 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731732 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 04:15:42.736686 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731736 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 04:15:42.736686 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731740 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 04:15:42.736686 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731744 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 04:15:42.736686 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731748 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 04:15:42.736686 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731752 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 04:15:42.736686 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731757 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 04:15:42.736686 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731760 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 04:15:42.737067 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731764 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 04:15:42.737067 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731769 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 04:15:42.737067 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731773 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 04:15:42.737067 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731777 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 04:15:42.737067 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731781 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 04:15:42.737067 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731785 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 04:15:42.737067 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731791 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 04:15:42.737067 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731796 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 04:15:42.737067 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731802 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 04:15:42.737067 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731806 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 04:15:42.737067 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731811 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 04:15:42.737067 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731815 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 04:15:42.737067 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731820 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 04:15:42.737067 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731825 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 04:15:42.737067 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731830 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 04:15:42.737067 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731835 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 04:15:42.737067 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731839 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 04:15:42.737067 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731843 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 04:15:42.737067 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731847 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 04:15:42.737067 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731851 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 04:15:42.737587 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731856 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 04:15:42.737587 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731860 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 04:15:42.737587 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731864 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 04:15:42.737587 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731868 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 04:15:42.737587 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731873 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 04:15:42.737587 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731877 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 04:15:42.737587 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731881 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 04:15:42.737587 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731885 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 04:15:42.737587 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731890 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 04:15:42.737587 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731894 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 04:15:42.737587 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731899 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 04:15:42.737587 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731903 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 04:15:42.737587 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731925 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 04:15:42.737587 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731929 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 04:15:42.737587 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731933 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 04:15:42.737587 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731937 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 04:15:42.737587 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731941 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 04:15:42.737587 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731945 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 04:15:42.737587 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731949 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 04:15:42.737587 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731952 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 04:15:42.738133 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731958 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 04:15:42.738133 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731963 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 04:15:42.738133 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731967 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 04:15:42.738133 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731971 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 04:15:42.738133 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731975 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 04:15:42.738133 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731979 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 04:15:42.738133 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731983 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 04:15:42.738133 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731988 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 04:15:42.738133 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731992 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 04:15:42.738133 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731995 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 04:15:42.738133 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.731999 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 04:15:42.738133 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.732002 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 04:15:42.738133 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.732006 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 04:15:42.738133 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.732010 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 04:15:42.738133 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.732014 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 04:15:42.738133 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.732018 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 04:15:42.738133 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.732022 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 04:15:42.738133 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.732026 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 04:15:42.738133 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.732030 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 04:15:42.738687 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.732035 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 04:15:42.738687 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.732038 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 04:15:42.738687 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.732042 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 04:15:42.738687 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.732047 2566 feature_gate.go:328] unrecognized feature gate: Example Jul 09 04:15:42.738687 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.732051 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 04:15:42.738687 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.732055 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 04:15:42.738687 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.732059 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 04:15:42.738687 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.732063 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 04:15:42.738687 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.732067 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 04:15:42.738687 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.732071 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 04:15:42.738687 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.732075 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 04:15:42.738687 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.732080 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 04:15:42.738687 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.732084 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 04:15:42.738687 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.732088 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 04:15:42.738687 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.732092 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 04:15:42.738687 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.732097 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 04:15:42.738687 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.732101 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 04:15:42.738687 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.732105 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 04:15:42.738687 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.732109 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 04:15:42.739203 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.732114 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 04:15:42.739203 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.732118 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 04:15:42.739203 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.732123 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 04:15:42.739203 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.732127 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 04:15:42.739203 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.732131 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 04:15:42.739203 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.732135 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 04:15:42.739203 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:42.732139 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 04:15:42.739203 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.732147 2566 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 09 04:15:42.739203 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.732339 2566 server.go:962] "Client rotation is on, will bootstrap in background" Jul 09 04:15:42.739203 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.735526 2566 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 09 04:15:42.739203 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.737285 2566 server.go:1019] "Starting client certificate rotation" Jul 09 04:15:42.739203 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.737397 2566 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 09 04:15:42.739203 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.737439 2566 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 09 04:15:42.740350 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.740330 2566 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 09 04:15:42.743935 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.743890 2566 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 09 04:15:42.754108 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.754090 2566 log.go:25] "Validated CRI v1 runtime API" Jul 09 04:15:42.757619 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.757602 2566 log.go:25] "Validated CRI v1 image API" Jul 09 04:15:42.759269 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.759248 2566 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 09 04:15:42.763221 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.763193 2566 fs.go:135] Filesystem UUIDs: map[5fd6ac1c-0cd0-4689-bec9-4b41ef30c5c8:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 92422980-5b79-4fa9-800c-f86724dee7b0:/dev/nvme0n1p4] Jul 09 04:15:42.763287 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.763220 2566 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 09 04:15:42.767490 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.767371 2566 manager.go:216] Machine: {Timestamp:2026-07-09 04:15:42.766853246 +0000 UTC m=+0.383751457 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3115827 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2fc0fd0b057c733d6f9ce5e9eae99f SystemUUID:ec2fc0fd-0b05-7c73-3d6f-9ce5e9eae99f BootID:4f346e49-bece-4217-b44e-0220dde21835 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:41:da:9e:c7:ff Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:41:da:9e:c7:ff Speed:0 Mtu:9001} {Name:ovs-system MacAddress:92:17:62:dc:16:2a Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 09 04:15:42.767490 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.767478 2566 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 09 04:15:42.767642 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.767561 2566 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 09 04:15:42.768569 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.768550 2566 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 09 04:15:42.771141 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.771112 2566 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 09 04:15:42.771315 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.771147 2566 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-76.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 09 04:15:42.772085 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.772073 2566 topology_manager.go:138] "Creating topology manager with none policy" Jul 09 04:15:42.772151 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.772092 2566 container_manager_linux.go:309] "Creating device plugin manager" Jul 09 04:15:42.772151 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.772103 2566 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 09 04:15:42.773848 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.773834 2566 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 09 04:15:42.775778 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.775763 2566 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 09 04:15:42.780636 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.780617 2566 state_mem.go:36] "Initialized new in-memory state store" Jul 09 04:15:42.780791 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.780780 2566 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 09 04:15:42.780858 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.780824 2566 kubelet.go:486] "Attempting to sync node with API server" Jul 09 04:15:42.780858 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.780847 2566 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 09 04:15:42.780966 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.780867 2566 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 09 04:15:42.780966 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.780886 2566 kubelet.go:398] "Adding apiserver pod source" Jul 09 04:15:42.780966 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.780899 2566 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 09 04:15:42.781429 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.781414 2566 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 09 04:15:42.781488 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.781438 2566 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 09 04:15:42.784874 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.784855 2566 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 09 04:15:42.787387 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.787372 2566 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 09 04:15:42.787460 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.787403 2566 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 09 04:15:42.788654 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.788638 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 09 04:15:42.788654 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.788654 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 09 04:15:42.788764 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.788660 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 09 04:15:42.788764 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.788666 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 09 04:15:42.788764 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.788674 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 09 04:15:42.788764 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.788680 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 09 04:15:42.788764 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.788687 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 09 04:15:42.788764 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.788692 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 09 04:15:42.788764 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.788698 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 09 04:15:42.789049 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.788877 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 09 04:15:42.789090 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.789053 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 09 04:15:42.789140 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.789092 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 09 04:15:42.789981 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.789961 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 09 04:15:42.789981 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.789983 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 09 04:15:42.792012 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:15:42.791985 2566 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-137-76.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 09 04:15:42.792241 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:15:42.791993 2566 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 09 04:15:42.793601 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.793578 2566 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-137-76.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 09 04:15:42.793733 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.793717 2566 server.go:1268] "Started kubelet" Jul 09 04:15:42.793865 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.793831 2566 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 09 04:15:42.793935 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.793837 2566 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 09 04:15:42.793935 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.793930 2566 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 09 04:15:42.794745 ip-10-0-137-76 systemd[1]: Started Kubernetes Kubelet. Jul 09 04:15:42.795014 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.795001 2566 server.go:310] "Adding debug handlers to kubelet server" Jul 09 04:15:42.796014 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.795996 2566 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 09 04:15:42.798968 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:15:42.798946 2566 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 09 04:15:42.803011 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:15:42.801854 2566 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-76.ec2.internal.18c083f57b112bab default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-76.ec2.internal,UID:ip-10-0-137-76.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-137-76.ec2.internal,},FirstTimestamp:2026-07-09 04:15:42.793665451 +0000 UTC m=+0.410563666,LastTimestamp:2026-07-09 04:15:42.793665451 +0000 UTC m=+0.410563666,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-76.ec2.internal,}" Jul 09 04:15:42.804549 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.804531 2566 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 09 04:15:42.804623 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.804534 2566 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 09 04:15:42.804695 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:15:42.804677 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-76.ec2.internal\" not found" Jul 09 04:15:42.805356 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.805337 2566 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 09 04:15:42.805356 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.805339 2566 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 09 04:15:42.805509 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.805367 2566 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 09 04:15:42.805509 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.805386 2566 factory.go:55] Registering systemd factory Jul 09 04:15:42.805509 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.805401 2566 factory.go:223] Registration of the systemd container factory successfully Jul 09 04:15:42.805509 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.805456 2566 reconstruct.go:97] "Volume reconstruction finished" Jul 09 04:15:42.805509 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.805464 2566 reconciler.go:29] "Reconciler: start to sync state" Jul 09 04:15:42.805737 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.805715 2566 factory.go:153] Registering CRI-O factory Jul 09 04:15:42.805737 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.805730 2566 factory.go:223] Registration of the crio container factory successfully Jul 09 04:15:42.805868 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.805813 2566 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 09 04:15:42.805868 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.805851 2566 factory.go:103] Registering Raw factory Jul 09 04:15:42.805868 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.805869 2566 manager.go:1196] Started watching for new ooms in manager Jul 09 04:15:42.806305 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.806291 2566 manager.go:349] Starting recovery of all containers Jul 09 04:15:42.806612 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:15:42.806591 2566 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-137-76.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 09 04:15:42.806922 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:15:42.806888 2566 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 09 04:15:42.814817 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.814787 2566 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-lrdkk" Jul 09 04:15:42.819874 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.819854 2566 manager.go:354] Recovery completed Jul 09 04:15:42.822356 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.822339 2566 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-lrdkk" Jul 09 04:15:42.824187 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.824174 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 04:15:42.826088 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.826071 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-76.ec2.internal" event="NodeHasSufficientMemory" Jul 09 04:15:42.826175 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.826101 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-76.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 04:15:42.826175 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.826111 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-76.ec2.internal" event="NodeHasSufficientPID" Jul 09 04:15:42.826756 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.826741 2566 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 09 04:15:42.826756 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.826754 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 04:15:42.826865 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.826755 2566 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 09 04:15:42.826865 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.826793 2566 state_mem.go:36] "Initialized new in-memory state store" Jul 09 04:15:42.827409 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.827395 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-76.ec2.internal" event="NodeHasSufficientMemory" Jul 09 04:15:42.827511 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.827420 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-76.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 04:15:42.827511 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.827436 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-76.ec2.internal" event="NodeHasSufficientPID" Jul 09 04:15:42.828778 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.828765 2566 policy_none.go:49] "None policy: Start" Jul 09 04:15:42.828778 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.828781 2566 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 09 04:15:42.828870 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.828792 2566 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 09 04:15:42.830708 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.830698 2566 policy_none.go:47] "Start" Jul 09 04:15:42.863758 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.863534 2566 manager.go:337] "Starting Device Plugin manager" Jul 09 04:15:42.883894 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:15:42.863782 2566 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 09 04:15:42.883894 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.863792 2566 server.go:87] "Starting device plugin registration server" Jul 09 04:15:42.883894 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.864078 2566 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 09 04:15:42.883894 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.864093 2566 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 09 04:15:42.883894 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.864252 2566 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 09 04:15:42.883894 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.864345 2566 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 09 04:15:42.883894 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.864351 2566 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 09 04:15:42.883894 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:15:42.864893 2566 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 09 04:15:42.883894 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:15:42.864959 2566 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-76.ec2.internal\" not found" Jul 09 04:15:42.904162 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.904117 2566 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 09 04:15:42.905440 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.905417 2566 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 09 04:15:42.905541 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.905464 2566 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 09 04:15:42.905541 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.905488 2566 kubelet.go:2448] "Starting kubelet main sync loop" Jul 09 04:15:42.905541 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:15:42.905527 2566 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 09 04:15:42.907795 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.907763 2566 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 04:15:42.964759 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.964651 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 04:15:42.965622 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.965603 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-76.ec2.internal" event="NodeHasSufficientMemory" Jul 09 04:15:42.965681 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.965644 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-76.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 04:15:42.965681 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.965680 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-76.ec2.internal" event="NodeHasSufficientPID" Jul 09 04:15:42.965748 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.965705 2566 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-137-76.ec2.internal" Jul 09 04:15:42.978438 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:42.978411 2566 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-137-76.ec2.internal" Jul 09 04:15:42.978594 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:15:42.978441 2566 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-76.ec2.internal\": node \"ip-10-0-137-76.ec2.internal\" not found" Jul 09 04:15:43.002778 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:15:43.002749 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-76.ec2.internal\" not found" Jul 09 04:15:43.005859 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:43.005832 2566 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-76.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-137-76.ec2.internal"] Jul 09 04:15:43.005951 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:43.005904 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 04:15:43.006851 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:43.006829 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-76.ec2.internal" event="NodeHasSufficientMemory" Jul 09 04:15:43.006990 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:43.006868 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-76.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 04:15:43.006990 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:43.006881 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-76.ec2.internal" event="NodeHasSufficientPID" Jul 09 04:15:43.009286 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:43.009270 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 04:15:43.009398 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:43.009383 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-76.ec2.internal" Jul 09 04:15:43.009442 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:43.009426 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 04:15:43.010107 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:43.010089 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-76.ec2.internal" event="NodeHasSufficientMemory" Jul 09 04:15:43.010209 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:43.010115 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-76.ec2.internal" event="NodeHasSufficientMemory" Jul 09 04:15:43.010209 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:43.010122 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-76.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 04:15:43.010209 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:43.010133 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-76.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 04:15:43.010209 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:43.010136 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-76.ec2.internal" event="NodeHasSufficientPID" Jul 09 04:15:43.010209 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:43.010145 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-76.ec2.internal" event="NodeHasSufficientPID" Jul 09 04:15:43.012393 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:43.012376 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-76.ec2.internal" Jul 09 04:15:43.012485 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:43.012402 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 04:15:43.013190 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:43.013172 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-76.ec2.internal" event="NodeHasSufficientMemory" Jul 09 04:15:43.013259 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:43.013207 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-76.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 04:15:43.013259 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:43.013218 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-76.ec2.internal" event="NodeHasSufficientPID" Jul 09 04:15:43.029549 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:15:43.029526 2566 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-76.ec2.internal\" not found" node="ip-10-0-137-76.ec2.internal" Jul 09 04:15:43.032967 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:15:43.032949 2566 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-76.ec2.internal\" not found" node="ip-10-0-137-76.ec2.internal" Jul 09 04:15:43.103061 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:15:43.103030 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-76.ec2.internal\" not found" Jul 09 04:15:43.203735 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:15:43.203706 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-76.ec2.internal\" not found" Jul 09 04:15:43.207017 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:43.206994 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/befd5e4ef7036106ec96059bdd67d179-config\") pod \"kube-apiserver-proxy-ip-10-0-137-76.ec2.internal\" (UID: \"befd5e4ef7036106ec96059bdd67d179\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-76.ec2.internal" Jul 09 04:15:43.207075 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:43.207028 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b5e401d935d56346e11a693f2ace039f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-76.ec2.internal\" (UID: \"b5e401d935d56346e11a693f2ace039f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-76.ec2.internal" Jul 09 04:15:43.207075 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:43.207046 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b5e401d935d56346e11a693f2ace039f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-76.ec2.internal\" (UID: \"b5e401d935d56346e11a693f2ace039f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-76.ec2.internal" Jul 09 04:15:43.304494 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:15:43.304464 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-76.ec2.internal\" not found" Jul 09 04:15:43.307760 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:43.307743 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/befd5e4ef7036106ec96059bdd67d179-config\") pod \"kube-apiserver-proxy-ip-10-0-137-76.ec2.internal\" (UID: \"befd5e4ef7036106ec96059bdd67d179\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-76.ec2.internal" Jul 09 04:15:43.307808 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:43.307767 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b5e401d935d56346e11a693f2ace039f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-76.ec2.internal\" (UID: \"b5e401d935d56346e11a693f2ace039f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-76.ec2.internal" Jul 09 04:15:43.307808 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:43.307782 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b5e401d935d56346e11a693f2ace039f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-76.ec2.internal\" (UID: \"b5e401d935d56346e11a693f2ace039f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-76.ec2.internal" Jul 09 04:15:43.307869 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:43.307809 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b5e401d935d56346e11a693f2ace039f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-76.ec2.internal\" (UID: \"b5e401d935d56346e11a693f2ace039f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-76.ec2.internal" Jul 09 04:15:43.307900 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:43.307858 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b5e401d935d56346e11a693f2ace039f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-76.ec2.internal\" (UID: \"b5e401d935d56346e11a693f2ace039f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-76.ec2.internal" Jul 09 04:15:43.307900 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:43.307858 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/befd5e4ef7036106ec96059bdd67d179-config\") pod \"kube-apiserver-proxy-ip-10-0-137-76.ec2.internal\" (UID: \"befd5e4ef7036106ec96059bdd67d179\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-76.ec2.internal" Jul 09 04:15:43.332892 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:43.332852 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-76.ec2.internal" Jul 09 04:15:43.335980 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:43.335960 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-76.ec2.internal" Jul 09 04:15:43.404659 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:15:43.404618 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-76.ec2.internal\" not found" Jul 09 04:15:43.505427 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:15:43.505395 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-76.ec2.internal\" not found" Jul 09 04:15:43.605870 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:15:43.605803 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-76.ec2.internal\" not found" Jul 09 04:15:43.706326 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:15:43.706290 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-76.ec2.internal\" not found" Jul 09 04:15:43.736628 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:43.736596 2566 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 09 04:15:43.737044 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:43.736784 2566 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 09 04:15:43.790240 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:43.790214 2566 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 04:15:43.806497 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:15:43.806470 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-76.ec2.internal\" not found" Jul 09 04:15:43.825690 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:43.825609 2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-08 04:10:43 +0000 UTC" deadline="2028-03-20 21:43:22.255256474 +0000 UTC" Jul 09 04:15:43.825690 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:43.825641 2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14897h27m38.42961953s" Jul 09 04:15:43.906613 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:15:43.906523 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-76.ec2.internal\" not found" Jul 09 04:15:43.953571 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:43.953526 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbefd5e4ef7036106ec96059bdd67d179.slice/crio-2a9aa265c025d180b92b9b40727edc718c0aa35853105be0e10cf2dd5db97bcc WatchSource:0}: Error finding container 2a9aa265c025d180b92b9b40727edc718c0aa35853105be0e10cf2dd5db97bcc: Status 404 returned error can't find the container with id 2a9aa265c025d180b92b9b40727edc718c0aa35853105be0e10cf2dd5db97bcc Jul 09 04:15:43.954220 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:43.954199 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5e401d935d56346e11a693f2ace039f.slice/crio-2e70cd6dedb0214ec8fc9d6890731627e64d61fa38b1709901dd05000c817cc4 WatchSource:0}: Error finding container 2e70cd6dedb0214ec8fc9d6890731627e64d61fa38b1709901dd05000c817cc4: Status 404 returned error can't find the container with id 2e70cd6dedb0214ec8fc9d6890731627e64d61fa38b1709901dd05000c817cc4 Jul 09 04:15:43.959474 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:43.959458 2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 09 04:15:44.006978 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:15:44.006934 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-76.ec2.internal\" not found" Jul 09 04:15:44.107532 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:15:44.107489 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-76.ec2.internal\" not found" Jul 09 04:15:44.208076 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:15:44.208010 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-76.ec2.internal\" not found" Jul 09 04:15:44.265530 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.265500 2566 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 04:15:44.308368 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:15:44.308341 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-76.ec2.internal\" not found" Jul 09 04:15:44.337335 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.337305 2566 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 04:15:44.406598 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.406552 2566 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-76.ec2.internal" Jul 09 04:15:44.420869 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.420840 2566 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 09 04:15:44.421955 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.421939 2566 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-76.ec2.internal" Jul 09 04:15:44.432061 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.432040 2566 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 09 04:15:44.782560 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.782526 2566 apiserver.go:52] "Watching apiserver" Jul 09 04:15:44.794253 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.793192 2566 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 09 04:15:44.794253 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.793809 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-mvrbd","kube-system/konnectivity-agent-l8qcx","kube-system/kube-apiserver-proxy-ip-10-0-137-76.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vrx8k","openshift-cluster-node-tuning-operator/tuned-cddtq","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-76.ec2.internal","openshift-multus/multus-additional-cni-plugins-xf5wq","openshift-multus/multus-hb42k","openshift-dns/node-resolver-c6vdp","openshift-image-registry/node-ca-h48tl","openshift-multus/network-metrics-daemon-jqcts","openshift-network-diagnostics/network-check-target-fgq98","openshift-network-operator/iptables-alerter-6dfff","openshift-ovn-kubernetes/ovnkube-node-gg754"] Jul 09 04:15:44.797046 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.797018 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-xf5wq" Jul 09 04:15:44.799061 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.799033 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-6dfff" Jul 09 04:15:44.800465 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.800443 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 09 04:15:44.801248 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.800721 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-h22d9\"" Jul 09 04:15:44.801248 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.800735 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 09 04:15:44.801248 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.800890 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 09 04:15:44.801248 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.801037 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 09 04:15:44.801248 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.801131 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 09 04:15:44.802373 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.802353 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 09 04:15:44.802673 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.802658 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-gg754" Jul 09 04:15:44.804100 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.804081 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 09 04:15:44.804309 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.804293 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-kn6wm\"" Jul 09 04:15:44.804510 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.804495 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 09 04:15:44.811007 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.810013 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 09 04:15:44.811007 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.810316 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-ghng8\"" Jul 09 04:15:44.811007 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.810561 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 09 04:15:44.811007 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.810832 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 09 04:15:44.812418 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.811355 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 09 04:15:44.812418 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.811351 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vrx8k" Jul 09 04:15:44.812418 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.812154 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 09 04:15:44.812418 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.812236 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 09 04:15:44.812686 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.812460 2566 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 09 04:15:44.814825 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.814476 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-cddtq" Jul 09 04:15:44.815290 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.815266 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/58e432fb-a7cb-4181-a1a7-003be0cfa3e0-host-run-ovn-kubernetes\") pod \"ovnkube-node-gg754\" (UID: \"58e432fb-a7cb-4181-a1a7-003be0cfa3e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gg754" Jul 09 04:15:44.815388 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.815297 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/58e432fb-a7cb-4181-a1a7-003be0cfa3e0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gg754\" (UID: \"58e432fb-a7cb-4181-a1a7-003be0cfa3e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gg754" Jul 09 04:15:44.815388 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.815327 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pnnhn\" (UniqueName: \"kubernetes.io/projected/29f6cd6d-4200-4245-b71f-4a5fe6806081-kube-api-access-pnnhn\") pod \"aws-ebs-csi-driver-node-vrx8k\" (UID: \"29f6cd6d-4200-4245-b71f-4a5fe6806081\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vrx8k" Jul 09 04:15:44.815388 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.815346 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/58e432fb-a7cb-4181-a1a7-003be0cfa3e0-ovn-node-metrics-cert\") pod \"ovnkube-node-gg754\" (UID: \"58e432fb-a7cb-4181-a1a7-003be0cfa3e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gg754" Jul 09 04:15:44.815388 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.815362 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/58e432fb-a7cb-4181-a1a7-003be0cfa3e0-ovnkube-script-lib\") pod \"ovnkube-node-gg754\" (UID: \"58e432fb-a7cb-4181-a1a7-003be0cfa3e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gg754" Jul 09 04:15:44.815388 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.815379 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/29f6cd6d-4200-4245-b71f-4a5fe6806081-sys-fs\") pod \"aws-ebs-csi-driver-node-vrx8k\" (UID: \"29f6cd6d-4200-4245-b71f-4a5fe6806081\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vrx8k" Jul 09 04:15:44.815639 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.815404 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/213522d5-333f-4b6d-a064-76ea42c4c637-etc-sysctl-conf\") pod \"tuned-cddtq\" (UID: \"213522d5-333f-4b6d-a064-76ea42c4c637\") " pod="openshift-cluster-node-tuning-operator/tuned-cddtq" Jul 09 04:15:44.815639 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.815424 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/213522d5-333f-4b6d-a064-76ea42c4c637-etc-systemd\") pod \"tuned-cddtq\" (UID: \"213522d5-333f-4b6d-a064-76ea42c4c637\") " pod="openshift-cluster-node-tuning-operator/tuned-cddtq" Jul 09 04:15:44.815639 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.815439 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/213522d5-333f-4b6d-a064-76ea42c4c637-etc-tuned\") pod \"tuned-cddtq\" (UID: \"213522d5-333f-4b6d-a064-76ea42c4c637\") " pod="openshift-cluster-node-tuning-operator/tuned-cddtq" Jul 09 04:15:44.815639 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.815462 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/29f6cd6d-4200-4245-b71f-4a5fe6806081-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vrx8k\" (UID: \"29f6cd6d-4200-4245-b71f-4a5fe6806081\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vrx8k" Jul 09 04:15:44.815639 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.815478 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/29f6cd6d-4200-4245-b71f-4a5fe6806081-etc-selinux\") pod \"aws-ebs-csi-driver-node-vrx8k\" (UID: \"29f6cd6d-4200-4245-b71f-4a5fe6806081\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vrx8k" Jul 09 04:15:44.815639 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.815493 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/213522d5-333f-4b6d-a064-76ea42c4c637-etc-kubernetes\") pod \"tuned-cddtq\" (UID: \"213522d5-333f-4b6d-a064-76ea42c4c637\") " pod="openshift-cluster-node-tuning-operator/tuned-cddtq" Jul 09 04:15:44.815639 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.815507 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/213522d5-333f-4b6d-a064-76ea42c4c637-etc-sysctl-d\") pod \"tuned-cddtq\" (UID: \"213522d5-333f-4b6d-a064-76ea42c4c637\") " pod="openshift-cluster-node-tuning-operator/tuned-cddtq" Jul 09 04:15:44.815639 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.815521 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fee2629f-8880-4f02-bf6b-26317084c049-cnibin\") pod \"multus-additional-cni-plugins-xf5wq\" (UID: \"fee2629f-8880-4f02-bf6b-26317084c049\") " pod="openshift-multus/multus-additional-cni-plugins-xf5wq" Jul 09 04:15:44.815639 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.815540 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5pvb5\" (UniqueName: \"kubernetes.io/projected/fee2629f-8880-4f02-bf6b-26317084c049-kube-api-access-5pvb5\") pod \"multus-additional-cni-plugins-xf5wq\" (UID: \"fee2629f-8880-4f02-bf6b-26317084c049\") " pod="openshift-multus/multus-additional-cni-plugins-xf5wq" Jul 09 04:15:44.815639 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.815556 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/289e272c-ff1b-44d3-8411-76fa510b8db9-iptables-alerter-script\") pod \"iptables-alerter-6dfff\" (UID: \"289e272c-ff1b-44d3-8411-76fa510b8db9\") " pod="openshift-network-operator/iptables-alerter-6dfff" Jul 09 04:15:44.815639 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.815576 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/58e432fb-a7cb-4181-a1a7-003be0cfa3e0-host-kubelet\") pod \"ovnkube-node-gg754\" (UID: \"58e432fb-a7cb-4181-a1a7-003be0cfa3e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gg754" Jul 09 04:15:44.815639 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.815608 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/58e432fb-a7cb-4181-a1a7-003be0cfa3e0-systemd-units\") pod \"ovnkube-node-gg754\" (UID: \"58e432fb-a7cb-4181-a1a7-003be0cfa3e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gg754" Jul 09 04:15:44.815639 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.815632 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/58e432fb-a7cb-4181-a1a7-003be0cfa3e0-run-ovn\") pod \"ovnkube-node-gg754\" (UID: \"58e432fb-a7cb-4181-a1a7-003be0cfa3e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gg754" Jul 09 04:15:44.816392 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.815656 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/29f6cd6d-4200-4245-b71f-4a5fe6806081-device-dir\") pod \"aws-ebs-csi-driver-node-vrx8k\" (UID: \"29f6cd6d-4200-4245-b71f-4a5fe6806081\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vrx8k" Jul 09 04:15:44.816392 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.815681 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fee2629f-8880-4f02-bf6b-26317084c049-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xf5wq\" (UID: \"fee2629f-8880-4f02-bf6b-26317084c049\") " pod="openshift-multus/multus-additional-cni-plugins-xf5wq" Jul 09 04:15:44.816392 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.815706 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/fee2629f-8880-4f02-bf6b-26317084c049-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xf5wq\" (UID: \"fee2629f-8880-4f02-bf6b-26317084c049\") " pod="openshift-multus/multus-additional-cni-plugins-xf5wq" Jul 09 04:15:44.816392 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.815732 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/289e272c-ff1b-44d3-8411-76fa510b8db9-host-slash\") pod \"iptables-alerter-6dfff\" (UID: \"289e272c-ff1b-44d3-8411-76fa510b8db9\") " pod="openshift-network-operator/iptables-alerter-6dfff" Jul 09 04:15:44.816392 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.815755 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b7ckg\" (UniqueName: \"kubernetes.io/projected/289e272c-ff1b-44d3-8411-76fa510b8db9-kube-api-access-b7ckg\") pod \"iptables-alerter-6dfff\" (UID: \"289e272c-ff1b-44d3-8411-76fa510b8db9\") " pod="openshift-network-operator/iptables-alerter-6dfff" Jul 09 04:15:44.816392 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.815783 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/58e432fb-a7cb-4181-a1a7-003be0cfa3e0-host-run-netns\") pod \"ovnkube-node-gg754\" (UID: \"58e432fb-a7cb-4181-a1a7-003be0cfa3e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gg754" Jul 09 04:15:44.816392 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.815807 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/58e432fb-a7cb-4181-a1a7-003be0cfa3e0-etc-openvswitch\") pod \"ovnkube-node-gg754\" (UID: \"58e432fb-a7cb-4181-a1a7-003be0cfa3e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gg754" Jul 09 04:15:44.816392 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.815831 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/58e432fb-a7cb-4181-a1a7-003be0cfa3e0-node-log\") pod \"ovnkube-node-gg754\" (UID: \"58e432fb-a7cb-4181-a1a7-003be0cfa3e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gg754" Jul 09 04:15:44.816392 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.815853 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/58e432fb-a7cb-4181-a1a7-003be0cfa3e0-host-cni-netd\") pod \"ovnkube-node-gg754\" (UID: \"58e432fb-a7cb-4181-a1a7-003be0cfa3e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gg754" Jul 09 04:15:44.816392 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.815878 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/213522d5-333f-4b6d-a064-76ea42c4c637-etc-modprobe-d\") pod \"tuned-cddtq\" (UID: \"213522d5-333f-4b6d-a064-76ea42c4c637\") " pod="openshift-cluster-node-tuning-operator/tuned-cddtq" Jul 09 04:15:44.816392 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.815908 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/213522d5-333f-4b6d-a064-76ea42c4c637-var-lib-kubelet\") pod \"tuned-cddtq\" (UID: \"213522d5-333f-4b6d-a064-76ea42c4c637\") " pod="openshift-cluster-node-tuning-operator/tuned-cddtq" Jul 09 04:15:44.816392 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.815929 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/213522d5-333f-4b6d-a064-76ea42c4c637-lib-modules\") pod \"tuned-cddtq\" (UID: \"213522d5-333f-4b6d-a064-76ea42c4c637\") " pod="openshift-cluster-node-tuning-operator/tuned-cddtq" Jul 09 04:15:44.816392 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.815952 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/213522d5-333f-4b6d-a064-76ea42c4c637-host\") pod \"tuned-cddtq\" (UID: \"213522d5-333f-4b6d-a064-76ea42c4c637\") " pod="openshift-cluster-node-tuning-operator/tuned-cddtq" Jul 09 04:15:44.816392 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.815999 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/213522d5-333f-4b6d-a064-76ea42c4c637-tmp\") pod \"tuned-cddtq\" (UID: \"213522d5-333f-4b6d-a064-76ea42c4c637\") " pod="openshift-cluster-node-tuning-operator/tuned-cddtq" Jul 09 04:15:44.816392 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.816028 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lzk6p\" (UniqueName: \"kubernetes.io/projected/213522d5-333f-4b6d-a064-76ea42c4c637-kube-api-access-lzk6p\") pod \"tuned-cddtq\" (UID: \"213522d5-333f-4b6d-a064-76ea42c4c637\") " pod="openshift-cluster-node-tuning-operator/tuned-cddtq" Jul 09 04:15:44.816392 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.816057 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fee2629f-8880-4f02-bf6b-26317084c049-system-cni-dir\") pod \"multus-additional-cni-plugins-xf5wq\" (UID: \"fee2629f-8880-4f02-bf6b-26317084c049\") " pod="openshift-multus/multus-additional-cni-plugins-xf5wq" Jul 09 04:15:44.817186 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.816081 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fee2629f-8880-4f02-bf6b-26317084c049-os-release\") pod \"multus-additional-cni-plugins-xf5wq\" (UID: \"fee2629f-8880-4f02-bf6b-26317084c049\") " pod="openshift-multus/multus-additional-cni-plugins-xf5wq" Jul 09 04:15:44.817186 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.816110 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/58e432fb-a7cb-4181-a1a7-003be0cfa3e0-host-cni-bin\") pod \"ovnkube-node-gg754\" (UID: \"58e432fb-a7cb-4181-a1a7-003be0cfa3e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gg754" Jul 09 04:15:44.817186 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.816246 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ggcmf\" (UniqueName: \"kubernetes.io/projected/58e432fb-a7cb-4181-a1a7-003be0cfa3e0-kube-api-access-ggcmf\") pod \"ovnkube-node-gg754\" (UID: \"58e432fb-a7cb-4181-a1a7-003be0cfa3e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gg754" Jul 09 04:15:44.817186 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.816271 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/29f6cd6d-4200-4245-b71f-4a5fe6806081-socket-dir\") pod \"aws-ebs-csi-driver-node-vrx8k\" (UID: \"29f6cd6d-4200-4245-b71f-4a5fe6806081\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vrx8k" Jul 09 04:15:44.817186 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.816294 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/213522d5-333f-4b6d-a064-76ea42c4c637-sys\") pod \"tuned-cddtq\" (UID: \"213522d5-333f-4b6d-a064-76ea42c4c637\") " pod="openshift-cluster-node-tuning-operator/tuned-cddtq" Jul 09 04:15:44.817186 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.816318 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fee2629f-8880-4f02-bf6b-26317084c049-cni-binary-copy\") pod \"multus-additional-cni-plugins-xf5wq\" (UID: \"fee2629f-8880-4f02-bf6b-26317084c049\") " pod="openshift-multus/multus-additional-cni-plugins-xf5wq" Jul 09 04:15:44.817186 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.816344 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/58e432fb-a7cb-4181-a1a7-003be0cfa3e0-log-socket\") pod \"ovnkube-node-gg754\" (UID: \"58e432fb-a7cb-4181-a1a7-003be0cfa3e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gg754" Jul 09 04:15:44.817186 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.816369 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/58e432fb-a7cb-4181-a1a7-003be0cfa3e0-ovnkube-config\") pod \"ovnkube-node-gg754\" (UID: \"58e432fb-a7cb-4181-a1a7-003be0cfa3e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gg754" Jul 09 04:15:44.817186 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.816387 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/58e432fb-a7cb-4181-a1a7-003be0cfa3e0-env-overrides\") pod \"ovnkube-node-gg754\" (UID: \"58e432fb-a7cb-4181-a1a7-003be0cfa3e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gg754" Jul 09 04:15:44.817186 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.816429 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/29f6cd6d-4200-4245-b71f-4a5fe6806081-registration-dir\") pod \"aws-ebs-csi-driver-node-vrx8k\" (UID: \"29f6cd6d-4200-4245-b71f-4a5fe6806081\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vrx8k" Jul 09 04:15:44.817186 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.816454 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/213522d5-333f-4b6d-a064-76ea42c4c637-etc-sysconfig\") pod \"tuned-cddtq\" (UID: \"213522d5-333f-4b6d-a064-76ea42c4c637\") " pod="openshift-cluster-node-tuning-operator/tuned-cddtq" Jul 09 04:15:44.817186 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.816473 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/213522d5-333f-4b6d-a064-76ea42c4c637-run\") pod \"tuned-cddtq\" (UID: \"213522d5-333f-4b6d-a064-76ea42c4c637\") " pod="openshift-cluster-node-tuning-operator/tuned-cddtq" Jul 09 04:15:44.817186 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.816490 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/fee2629f-8880-4f02-bf6b-26317084c049-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xf5wq\" (UID: \"fee2629f-8880-4f02-bf6b-26317084c049\") " pod="openshift-multus/multus-additional-cni-plugins-xf5wq" Jul 09 04:15:44.817186 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.816511 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/58e432fb-a7cb-4181-a1a7-003be0cfa3e0-host-slash\") pod \"ovnkube-node-gg754\" (UID: \"58e432fb-a7cb-4181-a1a7-003be0cfa3e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gg754" Jul 09 04:15:44.817186 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.816527 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/58e432fb-a7cb-4181-a1a7-003be0cfa3e0-run-systemd\") pod \"ovnkube-node-gg754\" (UID: \"58e432fb-a7cb-4181-a1a7-003be0cfa3e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gg754" Jul 09 04:15:44.817186 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.816549 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/58e432fb-a7cb-4181-a1a7-003be0cfa3e0-var-lib-openvswitch\") pod \"ovnkube-node-gg754\" (UID: \"58e432fb-a7cb-4181-a1a7-003be0cfa3e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gg754" Jul 09 04:15:44.818145 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.816584 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/58e432fb-a7cb-4181-a1a7-003be0cfa3e0-run-openvswitch\") pod \"ovnkube-node-gg754\" (UID: \"58e432fb-a7cb-4181-a1a7-003be0cfa3e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gg754" Jul 09 04:15:44.818145 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.818094 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 09 04:15:44.818145 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.818112 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 09 04:15:44.818665 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.818644 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 09 04:15:44.818879 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.818750 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-w24wb\"" Jul 09 04:15:44.819073 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.818798 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 09 04:15:44.819268 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.819252 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-gfccj\"" Jul 09 04:15:44.819347 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.819299 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 09 04:15:44.821244 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.821199 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-hb42k" Jul 09 04:15:44.823930 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.823907 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 09 04:15:44.824130 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.824116 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-9cq47\"" Jul 09 04:15:44.830389 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.830360 2566 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 09 04:15:44.831924 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.831386 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-c6vdp" Jul 09 04:15:44.834180 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.834147 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mvrbd" Jul 09 04:15:44.834292 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:15:44.834238 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mvrbd" podUID="32c78782-6b5e-4dc1-a3c6-048f98de9c1a" Jul 09 04:15:44.834686 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.834666 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 09 04:15:44.834775 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.834723 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 09 04:15:44.834830 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.834677 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-5z26s\"" Jul 09 04:15:44.838160 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.838140 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-l8qcx" Jul 09 04:15:44.840735 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.840713 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-h48tl" Jul 09 04:15:44.842471 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.842328 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 09 04:15:44.842471 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.842377 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-ldqks\"" Jul 09 04:15:44.842471 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.842333 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 09 04:15:44.844445 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.844424 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jqcts" Jul 09 04:15:44.845256 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.845231 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 09 04:15:44.845631 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.845614 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 09 04:15:44.845897 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.845878 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-vpzqq\"" Jul 09 04:15:44.846138 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.846120 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 09 04:15:44.846372 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:15:44.846349 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jqcts" podUID="64f35da7-cc64-4921-b129-af733326a5f0" Jul 09 04:15:44.846909 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.846887 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fgq98" Jul 09 04:15:44.847023 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:15:44.846979 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fgq98" podUID="50794917-e43f-4a72-ba19-741b2493724a" Jul 09 04:15:44.856978 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.856947 2566 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-99w4g" Jul 09 04:15:44.859439 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.859418 2566 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 04:15:44.866880 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.866855 2566 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-99w4g" Jul 09 04:15:44.907256 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.907226 2566 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 09 04:15:44.913082 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.912994 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-76.ec2.internal" event={"ID":"befd5e4ef7036106ec96059bdd67d179","Type":"ContainerStarted","Data":"2a9aa265c025d180b92b9b40727edc718c0aa35853105be0e10cf2dd5db97bcc"} Jul 09 04:15:44.914287 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.914247 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-76.ec2.internal" event={"ID":"b5e401d935d56346e11a693f2ace039f","Type":"ContainerStarted","Data":"2e70cd6dedb0214ec8fc9d6890731627e64d61fa38b1709901dd05000c817cc4"} Jul 09 04:15:44.916817 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.916791 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/289e272c-ff1b-44d3-8411-76fa510b8db9-host-slash\") pod \"iptables-alerter-6dfff\" (UID: \"289e272c-ff1b-44d3-8411-76fa510b8db9\") " pod="openshift-network-operator/iptables-alerter-6dfff" Jul 09 04:15:44.916926 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.916831 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/58e432fb-a7cb-4181-a1a7-003be0cfa3e0-node-log\") pod \"ovnkube-node-gg754\" (UID: \"58e432fb-a7cb-4181-a1a7-003be0cfa3e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gg754" Jul 09 04:15:44.916926 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.916859 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/213522d5-333f-4b6d-a064-76ea42c4c637-etc-modprobe-d\") pod \"tuned-cddtq\" (UID: \"213522d5-333f-4b6d-a064-76ea42c4c637\") " pod="openshift-cluster-node-tuning-operator/tuned-cddtq" Jul 09 04:15:44.916926 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.916887 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f291469f-093e-496e-96de-8c04b337980b-host\") pod \"node-ca-h48tl\" (UID: \"f291469f-093e-496e-96de-8c04b337980b\") " pod="openshift-image-registry/node-ca-h48tl" Jul 09 04:15:44.916926 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.916913 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0fda490e-3be7-4ca2-ba54-68ab304af491-etc-kubernetes\") pod \"multus-hb42k\" (UID: \"0fda490e-3be7-4ca2-ba54-68ab304af491\") " pod="openshift-multus/multus-hb42k" Jul 09 04:15:44.917199 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.916956 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3562e386-fc03-4589-8bb4-2f36cf7ba1be-hosts-file\") pod \"node-resolver-c6vdp\" (UID: \"3562e386-fc03-4589-8bb4-2f36cf7ba1be\") " pod="openshift-dns/node-resolver-c6vdp" Jul 09 04:15:44.917199 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.916985 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lzk6p\" (UniqueName: \"kubernetes.io/projected/213522d5-333f-4b6d-a064-76ea42c4c637-kube-api-access-lzk6p\") pod \"tuned-cddtq\" (UID: \"213522d5-333f-4b6d-a064-76ea42c4c637\") " pod="openshift-cluster-node-tuning-operator/tuned-cddtq" Jul 09 04:15:44.917199 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.917012 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fee2629f-8880-4f02-bf6b-26317084c049-system-cni-dir\") pod \"multus-additional-cni-plugins-xf5wq\" (UID: \"fee2629f-8880-4f02-bf6b-26317084c049\") " pod="openshift-multus/multus-additional-cni-plugins-xf5wq" Jul 09 04:15:44.917199 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.917036 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0fda490e-3be7-4ca2-ba54-68ab304af491-host-run-netns\") pod \"multus-hb42k\" (UID: \"0fda490e-3be7-4ca2-ba54-68ab304af491\") " pod="openshift-multus/multus-hb42k" Jul 09 04:15:44.917199 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.917060 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjv97\" (UniqueName: \"kubernetes.io/projected/0fda490e-3be7-4ca2-ba54-68ab304af491-kube-api-access-sjv97\") pod \"multus-hb42k\" (UID: \"0fda490e-3be7-4ca2-ba54-68ab304af491\") " pod="openshift-multus/multus-hb42k" Jul 09 04:15:44.917199 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.917087 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/58e432fb-a7cb-4181-a1a7-003be0cfa3e0-host-cni-bin\") pod \"ovnkube-node-gg754\" (UID: \"58e432fb-a7cb-4181-a1a7-003be0cfa3e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gg754" Jul 09 04:15:44.917199 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.917112 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ggcmf\" (UniqueName: \"kubernetes.io/projected/58e432fb-a7cb-4181-a1a7-003be0cfa3e0-kube-api-access-ggcmf\") pod \"ovnkube-node-gg754\" (UID: \"58e432fb-a7cb-4181-a1a7-003be0cfa3e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gg754" Jul 09 04:15:44.917199 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.917135 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/213522d5-333f-4b6d-a064-76ea42c4c637-sys\") pod \"tuned-cddtq\" (UID: \"213522d5-333f-4b6d-a064-76ea42c4c637\") " pod="openshift-cluster-node-tuning-operator/tuned-cddtq" Jul 09 04:15:44.917199 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.917159 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fee2629f-8880-4f02-bf6b-26317084c049-cni-binary-copy\") pod \"multus-additional-cni-plugins-xf5wq\" (UID: \"fee2629f-8880-4f02-bf6b-26317084c049\") " pod="openshift-multus/multus-additional-cni-plugins-xf5wq" Jul 09 04:15:44.917199 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.917191 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sdvvj\" (UniqueName: \"kubernetes.io/projected/f291469f-093e-496e-96de-8c04b337980b-kube-api-access-sdvvj\") pod \"node-ca-h48tl\" (UID: \"f291469f-093e-496e-96de-8c04b337980b\") " pod="openshift-image-registry/node-ca-h48tl" Jul 09 04:15:44.917702 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.917227 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0fda490e-3be7-4ca2-ba54-68ab304af491-host-run-k8s-cni-cncf-io\") pod \"multus-hb42k\" (UID: \"0fda490e-3be7-4ca2-ba54-68ab304af491\") " pod="openshift-multus/multus-hb42k" Jul 09 04:15:44.917702 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.917255 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/29f6cd6d-4200-4245-b71f-4a5fe6806081-registration-dir\") pod \"aws-ebs-csi-driver-node-vrx8k\" (UID: \"29f6cd6d-4200-4245-b71f-4a5fe6806081\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vrx8k" Jul 09 04:15:44.917702 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.917280 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/213522d5-333f-4b6d-a064-76ea42c4c637-run\") pod \"tuned-cddtq\" (UID: \"213522d5-333f-4b6d-a064-76ea42c4c637\") " pod="openshift-cluster-node-tuning-operator/tuned-cddtq" Jul 09 04:15:44.917702 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.917323 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/060291ce-8ee2-46f6-96cf-c2e8ea5804d1-agent-certs\") pod \"konnectivity-agent-l8qcx\" (UID: \"060291ce-8ee2-46f6-96cf-c2e8ea5804d1\") " pod="kube-system/konnectivity-agent-l8qcx" Jul 09 04:15:44.917702 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.917392 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0fda490e-3be7-4ca2-ba54-68ab304af491-cnibin\") pod \"multus-hb42k\" (UID: \"0fda490e-3be7-4ca2-ba54-68ab304af491\") " pod="openshift-multus/multus-hb42k" Jul 09 04:15:44.917702 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.917418 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/58e432fb-a7cb-4181-a1a7-003be0cfa3e0-var-lib-openvswitch\") pod \"ovnkube-node-gg754\" (UID: \"58e432fb-a7cb-4181-a1a7-003be0cfa3e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gg754" Jul 09 04:15:44.917702 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.917444 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/213522d5-333f-4b6d-a064-76ea42c4c637-etc-tuned\") pod \"tuned-cddtq\" (UID: \"213522d5-333f-4b6d-a064-76ea42c4c637\") " pod="openshift-cluster-node-tuning-operator/tuned-cddtq" Jul 09 04:15:44.917702 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.917472 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xlj4k\" (UniqueName: \"kubernetes.io/projected/50794917-e43f-4a72-ba19-741b2493724a-kube-api-access-xlj4k\") pod \"network-check-target-fgq98\" (UID: \"50794917-e43f-4a72-ba19-741b2493724a\") " pod="openshift-network-diagnostics/network-check-target-fgq98" Jul 09 04:15:44.917702 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.917498 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/213522d5-333f-4b6d-a064-76ea42c4c637-etc-sysctl-conf\") pod \"tuned-cddtq\" (UID: \"213522d5-333f-4b6d-a064-76ea42c4c637\") " pod="openshift-cluster-node-tuning-operator/tuned-cddtq" Jul 09 04:15:44.917702 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.917524 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0fda490e-3be7-4ca2-ba54-68ab304af491-cni-binary-copy\") pod \"multus-hb42k\" (UID: \"0fda490e-3be7-4ca2-ba54-68ab304af491\") " pod="openshift-multus/multus-hb42k" Jul 09 04:15:44.917702 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.917550 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/29f6cd6d-4200-4245-b71f-4a5fe6806081-etc-selinux\") pod \"aws-ebs-csi-driver-node-vrx8k\" (UID: \"29f6cd6d-4200-4245-b71f-4a5fe6806081\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vrx8k" Jul 09 04:15:44.917702 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.917575 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0fda490e-3be7-4ca2-ba54-68ab304af491-os-release\") pod \"multus-hb42k\" (UID: \"0fda490e-3be7-4ca2-ba54-68ab304af491\") " pod="openshift-multus/multus-hb42k" Jul 09 04:15:44.917702 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.917598 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5msj5\" (UniqueName: \"kubernetes.io/projected/3562e386-fc03-4589-8bb4-2f36cf7ba1be-kube-api-access-5msj5\") pod \"node-resolver-c6vdp\" (UID: \"3562e386-fc03-4589-8bb4-2f36cf7ba1be\") " pod="openshift-dns/node-resolver-c6vdp" Jul 09 04:15:44.917702 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.917630 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/58e432fb-a7cb-4181-a1a7-003be0cfa3e0-host-kubelet\") pod \"ovnkube-node-gg754\" (UID: \"58e432fb-a7cb-4181-a1a7-003be0cfa3e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gg754" Jul 09 04:15:44.917702 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.917670 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/58e432fb-a7cb-4181-a1a7-003be0cfa3e0-systemd-units\") pod \"ovnkube-node-gg754\" (UID: \"58e432fb-a7cb-4181-a1a7-003be0cfa3e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gg754" Jul 09 04:15:44.917702 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.917704 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/58e432fb-a7cb-4181-a1a7-003be0cfa3e0-run-ovn\") pod \"ovnkube-node-gg754\" (UID: \"58e432fb-a7cb-4181-a1a7-003be0cfa3e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gg754" Jul 09 04:15:44.918509 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.917729 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fee2629f-8880-4f02-bf6b-26317084c049-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xf5wq\" (UID: \"fee2629f-8880-4f02-bf6b-26317084c049\") " pod="openshift-multus/multus-additional-cni-plugins-xf5wq" Jul 09 04:15:44.918509 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.917766 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/fee2629f-8880-4f02-bf6b-26317084c049-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xf5wq\" (UID: \"fee2629f-8880-4f02-bf6b-26317084c049\") " pod="openshift-multus/multus-additional-cni-plugins-xf5wq" Jul 09 04:15:44.918509 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.917793 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0fda490e-3be7-4ca2-ba54-68ab304af491-host-var-lib-cni-multus\") pod \"multus-hb42k\" (UID: \"0fda490e-3be7-4ca2-ba54-68ab304af491\") " pod="openshift-multus/multus-hb42k" Jul 09 04:15:44.918509 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.917817 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3562e386-fc03-4589-8bb4-2f36cf7ba1be-tmp-dir\") pod \"node-resolver-c6vdp\" (UID: \"3562e386-fc03-4589-8bb4-2f36cf7ba1be\") " pod="openshift-dns/node-resolver-c6vdp" Jul 09 04:15:44.918509 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.917844 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b7ckg\" (UniqueName: \"kubernetes.io/projected/289e272c-ff1b-44d3-8411-76fa510b8db9-kube-api-access-b7ckg\") pod \"iptables-alerter-6dfff\" (UID: \"289e272c-ff1b-44d3-8411-76fa510b8db9\") " pod="openshift-network-operator/iptables-alerter-6dfff" Jul 09 04:15:44.918509 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.917882 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/58e432fb-a7cb-4181-a1a7-003be0cfa3e0-host-run-netns\") pod \"ovnkube-node-gg754\" (UID: \"58e432fb-a7cb-4181-a1a7-003be0cfa3e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gg754" Jul 09 04:15:44.918509 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.917908 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/58e432fb-a7cb-4181-a1a7-003be0cfa3e0-etc-openvswitch\") pod \"ovnkube-node-gg754\" (UID: \"58e432fb-a7cb-4181-a1a7-003be0cfa3e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gg754" Jul 09 04:15:44.918509 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.917925 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/213522d5-333f-4b6d-a064-76ea42c4c637-run\") pod \"tuned-cddtq\" (UID: \"213522d5-333f-4b6d-a064-76ea42c4c637\") " pod="openshift-cluster-node-tuning-operator/tuned-cddtq" Jul 09 04:15:44.918509 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.917935 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/58e432fb-a7cb-4181-a1a7-003be0cfa3e0-host-cni-netd\") pod \"ovnkube-node-gg754\" (UID: \"58e432fb-a7cb-4181-a1a7-003be0cfa3e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gg754" Jul 09 04:15:44.918509 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.918001 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/58e432fb-a7cb-4181-a1a7-003be0cfa3e0-host-cni-netd\") pod \"ovnkube-node-gg754\" (UID: \"58e432fb-a7cb-4181-a1a7-003be0cfa3e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gg754" Jul 09 04:15:44.918509 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.918011 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/213522d5-333f-4b6d-a064-76ea42c4c637-var-lib-kubelet\") pod \"tuned-cddtq\" (UID: \"213522d5-333f-4b6d-a064-76ea42c4c637\") " pod="openshift-cluster-node-tuning-operator/tuned-cddtq" Jul 09 04:15:44.918509 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.918042 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/213522d5-333f-4b6d-a064-76ea42c4c637-tmp\") pod \"tuned-cddtq\" (UID: \"213522d5-333f-4b6d-a064-76ea42c4c637\") " pod="openshift-cluster-node-tuning-operator/tuned-cddtq" Jul 09 04:15:44.918509 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.918079 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/58e432fb-a7cb-4181-a1a7-003be0cfa3e0-var-lib-openvswitch\") pod \"ovnkube-node-gg754\" (UID: \"58e432fb-a7cb-4181-a1a7-003be0cfa3e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gg754" Jul 09 04:15:44.918509 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.918102 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/32c78782-6b5e-4dc1-a3c6-048f98de9c1a-kubelet-config\") pod \"global-pull-secret-syncer-mvrbd\" (UID: \"32c78782-6b5e-4dc1-a3c6-048f98de9c1a\") " pod="kube-system/global-pull-secret-syncer-mvrbd" Jul 09 04:15:44.918509 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.918134 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/32c78782-6b5e-4dc1-a3c6-048f98de9c1a-dbus\") pod \"global-pull-secret-syncer-mvrbd\" (UID: \"32c78782-6b5e-4dc1-a3c6-048f98de9c1a\") " pod="kube-system/global-pull-secret-syncer-mvrbd" Jul 09 04:15:44.918509 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.918177 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/213522d5-333f-4b6d-a064-76ea42c4c637-lib-modules\") pod \"tuned-cddtq\" (UID: \"213522d5-333f-4b6d-a064-76ea42c4c637\") " pod="openshift-cluster-node-tuning-operator/tuned-cddtq" Jul 09 04:15:44.918509 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.918205 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/213522d5-333f-4b6d-a064-76ea42c4c637-host\") pod \"tuned-cddtq\" (UID: \"213522d5-333f-4b6d-a064-76ea42c4c637\") " pod="openshift-cluster-node-tuning-operator/tuned-cddtq" Jul 09 04:15:44.919365 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.918246 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fee2629f-8880-4f02-bf6b-26317084c049-os-release\") pod \"multus-additional-cni-plugins-xf5wq\" (UID: \"fee2629f-8880-4f02-bf6b-26317084c049\") " pod="openshift-multus/multus-additional-cni-plugins-xf5wq" Jul 09 04:15:44.919365 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.918275 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gckvf\" (UniqueName: \"kubernetes.io/projected/64f35da7-cc64-4921-b129-af733326a5f0-kube-api-access-gckvf\") pod \"network-metrics-daemon-jqcts\" (UID: \"64f35da7-cc64-4921-b129-af733326a5f0\") " pod="openshift-multus/network-metrics-daemon-jqcts" Jul 09 04:15:44.919365 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.918303 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0fda490e-3be7-4ca2-ba54-68ab304af491-host-var-lib-kubelet\") pod \"multus-hb42k\" (UID: \"0fda490e-3be7-4ca2-ba54-68ab304af491\") " pod="openshift-multus/multus-hb42k" Jul 09 04:15:44.919365 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.918329 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0fda490e-3be7-4ca2-ba54-68ab304af491-host-run-multus-certs\") pod \"multus-hb42k\" (UID: \"0fda490e-3be7-4ca2-ba54-68ab304af491\") " pod="openshift-multus/multus-hb42k" Jul 09 04:15:44.919365 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.918360 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/29f6cd6d-4200-4245-b71f-4a5fe6806081-socket-dir\") pod \"aws-ebs-csi-driver-node-vrx8k\" (UID: \"29f6cd6d-4200-4245-b71f-4a5fe6806081\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vrx8k" Jul 09 04:15:44.919365 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.918388 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5pvb5\" (UniqueName: \"kubernetes.io/projected/fee2629f-8880-4f02-bf6b-26317084c049-kube-api-access-5pvb5\") pod \"multus-additional-cni-plugins-xf5wq\" (UID: \"fee2629f-8880-4f02-bf6b-26317084c049\") " pod="openshift-multus/multus-additional-cni-plugins-xf5wq" Jul 09 04:15:44.919365 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.918416 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/58e432fb-a7cb-4181-a1a7-003be0cfa3e0-log-socket\") pod \"ovnkube-node-gg754\" (UID: \"58e432fb-a7cb-4181-a1a7-003be0cfa3e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gg754" Jul 09 04:15:44.919365 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.918419 2566 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 09 04:15:44.919365 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.918447 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/58e432fb-a7cb-4181-a1a7-003be0cfa3e0-ovnkube-config\") pod \"ovnkube-node-gg754\" (UID: \"58e432fb-a7cb-4181-a1a7-003be0cfa3e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gg754" Jul 09 04:15:44.919365 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.918475 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/58e432fb-a7cb-4181-a1a7-003be0cfa3e0-env-overrides\") pod \"ovnkube-node-gg754\" (UID: \"58e432fb-a7cb-4181-a1a7-003be0cfa3e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gg754" Jul 09 04:15:44.919365 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.918504 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/213522d5-333f-4b6d-a064-76ea42c4c637-etc-sysconfig\") pod \"tuned-cddtq\" (UID: \"213522d5-333f-4b6d-a064-76ea42c4c637\") " pod="openshift-cluster-node-tuning-operator/tuned-cddtq" Jul 09 04:15:44.919365 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.918531 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/fee2629f-8880-4f02-bf6b-26317084c049-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xf5wq\" (UID: \"fee2629f-8880-4f02-bf6b-26317084c049\") " pod="openshift-multus/multus-additional-cni-plugins-xf5wq" Jul 09 04:15:44.919365 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.918574 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/32c78782-6b5e-4dc1-a3c6-048f98de9c1a-original-pull-secret\") pod \"global-pull-secret-syncer-mvrbd\" (UID: \"32c78782-6b5e-4dc1-a3c6-048f98de9c1a\") " pod="kube-system/global-pull-secret-syncer-mvrbd" Jul 09 04:15:44.919365 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.918605 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/58e432fb-a7cb-4181-a1a7-003be0cfa3e0-host-slash\") pod \"ovnkube-node-gg754\" (UID: \"58e432fb-a7cb-4181-a1a7-003be0cfa3e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gg754" Jul 09 04:15:44.919365 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.918632 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/58e432fb-a7cb-4181-a1a7-003be0cfa3e0-run-systemd\") pod \"ovnkube-node-gg754\" (UID: \"58e432fb-a7cb-4181-a1a7-003be0cfa3e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gg754" Jul 09 04:15:44.919365 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.918659 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/58e432fb-a7cb-4181-a1a7-003be0cfa3e0-run-openvswitch\") pod \"ovnkube-node-gg754\" (UID: \"58e432fb-a7cb-4181-a1a7-003be0cfa3e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gg754" Jul 09 04:15:44.919365 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.918687 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/58e432fb-a7cb-4181-a1a7-003be0cfa3e0-host-run-ovn-kubernetes\") pod \"ovnkube-node-gg754\" (UID: \"58e432fb-a7cb-4181-a1a7-003be0cfa3e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gg754" Jul 09 04:15:44.920160 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.918718 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/58e432fb-a7cb-4181-a1a7-003be0cfa3e0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gg754\" (UID: \"58e432fb-a7cb-4181-a1a7-003be0cfa3e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gg754" Jul 09 04:15:44.920160 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.918749 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pnnhn\" (UniqueName: \"kubernetes.io/projected/29f6cd6d-4200-4245-b71f-4a5fe6806081-kube-api-access-pnnhn\") pod \"aws-ebs-csi-driver-node-vrx8k\" (UID: \"29f6cd6d-4200-4245-b71f-4a5fe6806081\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vrx8k" Jul 09 04:15:44.920160 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.918777 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/213522d5-333f-4b6d-a064-76ea42c4c637-etc-systemd\") pod \"tuned-cddtq\" (UID: \"213522d5-333f-4b6d-a064-76ea42c4c637\") " pod="openshift-cluster-node-tuning-operator/tuned-cddtq" Jul 09 04:15:44.920160 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.918803 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/58e432fb-a7cb-4181-a1a7-003be0cfa3e0-ovn-node-metrics-cert\") pod \"ovnkube-node-gg754\" (UID: \"58e432fb-a7cb-4181-a1a7-003be0cfa3e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gg754" Jul 09 04:15:44.920160 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.918805 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/58e432fb-a7cb-4181-a1a7-003be0cfa3e0-systemd-units\") pod \"ovnkube-node-gg754\" (UID: \"58e432fb-a7cb-4181-a1a7-003be0cfa3e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gg754" Jul 09 04:15:44.920160 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.918833 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/58e432fb-a7cb-4181-a1a7-003be0cfa3e0-ovnkube-script-lib\") pod \"ovnkube-node-gg754\" (UID: \"58e432fb-a7cb-4181-a1a7-003be0cfa3e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gg754" Jul 09 04:15:44.920160 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.918844 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/58e432fb-a7cb-4181-a1a7-003be0cfa3e0-run-ovn\") pod \"ovnkube-node-gg754\" (UID: \"58e432fb-a7cb-4181-a1a7-003be0cfa3e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gg754" Jul 09 04:15:44.920160 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.918863 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/29f6cd6d-4200-4245-b71f-4a5fe6806081-sys-fs\") pod \"aws-ebs-csi-driver-node-vrx8k\" (UID: \"29f6cd6d-4200-4245-b71f-4a5fe6806081\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vrx8k" Jul 09 04:15:44.920160 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.918891 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0fda490e-3be7-4ca2-ba54-68ab304af491-system-cni-dir\") pod \"multus-hb42k\" (UID: \"0fda490e-3be7-4ca2-ba54-68ab304af491\") " pod="openshift-multus/multus-hb42k" Jul 09 04:15:44.920160 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.918893 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/58e432fb-a7cb-4181-a1a7-003be0cfa3e0-host-kubelet\") pod \"ovnkube-node-gg754\" (UID: \"58e432fb-a7cb-4181-a1a7-003be0cfa3e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gg754" Jul 09 04:15:44.920160 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.918914 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/29f6cd6d-4200-4245-b71f-4a5fe6806081-etc-selinux\") pod \"aws-ebs-csi-driver-node-vrx8k\" (UID: \"29f6cd6d-4200-4245-b71f-4a5fe6806081\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vrx8k" Jul 09 04:15:44.920160 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.918942 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/58e432fb-a7cb-4181-a1a7-003be0cfa3e0-node-log\") pod \"ovnkube-node-gg754\" (UID: \"58e432fb-a7cb-4181-a1a7-003be0cfa3e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gg754" Jul 09 04:15:44.920160 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.918960 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0fda490e-3be7-4ca2-ba54-68ab304af491-multus-cni-dir\") pod \"multus-hb42k\" (UID: \"0fda490e-3be7-4ca2-ba54-68ab304af491\") " pod="openshift-multus/multus-hb42k" Jul 09 04:15:44.920160 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.918972 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/213522d5-333f-4b6d-a064-76ea42c4c637-host\") pod \"tuned-cddtq\" (UID: \"213522d5-333f-4b6d-a064-76ea42c4c637\") " pod="openshift-cluster-node-tuning-operator/tuned-cddtq" Jul 09 04:15:44.920160 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.918995 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/58e432fb-a7cb-4181-a1a7-003be0cfa3e0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gg754\" (UID: \"58e432fb-a7cb-4181-a1a7-003be0cfa3e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gg754" Jul 09 04:15:44.920160 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.919026 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fee2629f-8880-4f02-bf6b-26317084c049-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xf5wq\" (UID: \"fee2629f-8880-4f02-bf6b-26317084c049\") " pod="openshift-multus/multus-additional-cni-plugins-xf5wq" Jul 09 04:15:44.920160 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.919048 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fee2629f-8880-4f02-bf6b-26317084c049-os-release\") pod \"multus-additional-cni-plugins-xf5wq\" (UID: \"fee2629f-8880-4f02-bf6b-26317084c049\") " pod="openshift-multus/multus-additional-cni-plugins-xf5wq" Jul 09 04:15:44.920921 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.918944 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/289e272c-ff1b-44d3-8411-76fa510b8db9-host-slash\") pod \"iptables-alerter-6dfff\" (UID: \"289e272c-ff1b-44d3-8411-76fa510b8db9\") " pod="openshift-network-operator/iptables-alerter-6dfff" Jul 09 04:15:44.920921 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.919109 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/29f6cd6d-4200-4245-b71f-4a5fe6806081-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vrx8k\" (UID: \"29f6cd6d-4200-4245-b71f-4a5fe6806081\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vrx8k" Jul 09 04:15:44.920921 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.919114 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/213522d5-333f-4b6d-a064-76ea42c4c637-etc-sysconfig\") pod \"tuned-cddtq\" (UID: \"213522d5-333f-4b6d-a064-76ea42c4c637\") " pod="openshift-cluster-node-tuning-operator/tuned-cddtq" Jul 09 04:15:44.920921 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.919141 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/213522d5-333f-4b6d-a064-76ea42c4c637-etc-kubernetes\") pod \"tuned-cddtq\" (UID: \"213522d5-333f-4b6d-a064-76ea42c4c637\") " pod="openshift-cluster-node-tuning-operator/tuned-cddtq" Jul 09 04:15:44.920921 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.919170 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/213522d5-333f-4b6d-a064-76ea42c4c637-etc-sysctl-d\") pod \"tuned-cddtq\" (UID: \"213522d5-333f-4b6d-a064-76ea42c4c637\") " pod="openshift-cluster-node-tuning-operator/tuned-cddtq" Jul 09 04:15:44.920921 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.919195 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/213522d5-333f-4b6d-a064-76ea42c4c637-lib-modules\") pod \"tuned-cddtq\" (UID: \"213522d5-333f-4b6d-a064-76ea42c4c637\") " pod="openshift-cluster-node-tuning-operator/tuned-cddtq" Jul 09 04:15:44.920921 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.919197 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fee2629f-8880-4f02-bf6b-26317084c049-cnibin\") pod \"multus-additional-cni-plugins-xf5wq\" (UID: \"fee2629f-8880-4f02-bf6b-26317084c049\") " pod="openshift-multus/multus-additional-cni-plugins-xf5wq" Jul 09 04:15:44.920921 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.919217 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/213522d5-333f-4b6d-a064-76ea42c4c637-etc-modprobe-d\") pod \"tuned-cddtq\" (UID: \"213522d5-333f-4b6d-a064-76ea42c4c637\") " pod="openshift-cluster-node-tuning-operator/tuned-cddtq" Jul 09 04:15:44.920921 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.919245 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f291469f-093e-496e-96de-8c04b337980b-serviceca\") pod \"node-ca-h48tl\" (UID: \"f291469f-093e-496e-96de-8c04b337980b\") " pod="openshift-image-registry/node-ca-h48tl" Jul 09 04:15:44.920921 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.919264 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/58e432fb-a7cb-4181-a1a7-003be0cfa3e0-run-openvswitch\") pod \"ovnkube-node-gg754\" (UID: \"58e432fb-a7cb-4181-a1a7-003be0cfa3e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gg754" Jul 09 04:15:44.920921 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.919277 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0fda490e-3be7-4ca2-ba54-68ab304af491-multus-socket-dir-parent\") pod \"multus-hb42k\" (UID: \"0fda490e-3be7-4ca2-ba54-68ab304af491\") " pod="openshift-multus/multus-hb42k" Jul 09 04:15:44.920921 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.919301 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/58e432fb-a7cb-4181-a1a7-003be0cfa3e0-host-run-ovn-kubernetes\") pod \"ovnkube-node-gg754\" (UID: \"58e432fb-a7cb-4181-a1a7-003be0cfa3e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gg754" Jul 09 04:15:44.920921 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.919308 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0fda490e-3be7-4ca2-ba54-68ab304af491-multus-conf-dir\") pod \"multus-hb42k\" (UID: \"0fda490e-3be7-4ca2-ba54-68ab304af491\") " pod="openshift-multus/multus-hb42k" Jul 09 04:15:44.920921 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.919342 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/58e432fb-a7cb-4181-a1a7-003be0cfa3e0-host-slash\") pod \"ovnkube-node-gg754\" (UID: \"58e432fb-a7cb-4181-a1a7-003be0cfa3e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gg754" Jul 09 04:15:44.920921 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.919346 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0fda490e-3be7-4ca2-ba54-68ab304af491-multus-daemon-config\") pod \"multus-hb42k\" (UID: \"0fda490e-3be7-4ca2-ba54-68ab304af491\") " pod="openshift-multus/multus-hb42k" Jul 09 04:15:44.920921 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.919378 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/289e272c-ff1b-44d3-8411-76fa510b8db9-iptables-alerter-script\") pod \"iptables-alerter-6dfff\" (UID: \"289e272c-ff1b-44d3-8411-76fa510b8db9\") " pod="openshift-network-operator/iptables-alerter-6dfff" Jul 09 04:15:44.920921 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.919391 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/58e432fb-a7cb-4181-a1a7-003be0cfa3e0-host-cni-bin\") pod \"ovnkube-node-gg754\" (UID: \"58e432fb-a7cb-4181-a1a7-003be0cfa3e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gg754" Jul 09 04:15:44.921743 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.919395 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/213522d5-333f-4b6d-a064-76ea42c4c637-var-lib-kubelet\") pod \"tuned-cddtq\" (UID: \"213522d5-333f-4b6d-a064-76ea42c4c637\") " pod="openshift-cluster-node-tuning-operator/tuned-cddtq" Jul 09 04:15:44.921743 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.919407 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/29f6cd6d-4200-4245-b71f-4a5fe6806081-device-dir\") pod \"aws-ebs-csi-driver-node-vrx8k\" (UID: \"29f6cd6d-4200-4245-b71f-4a5fe6806081\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vrx8k" Jul 09 04:15:44.921743 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.919438 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/060291ce-8ee2-46f6-96cf-c2e8ea5804d1-konnectivity-ca\") pod \"konnectivity-agent-l8qcx\" (UID: \"060291ce-8ee2-46f6-96cf-c2e8ea5804d1\") " pod="kube-system/konnectivity-agent-l8qcx" Jul 09 04:15:44.921743 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.919468 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/64f35da7-cc64-4921-b129-af733326a5f0-metrics-certs\") pod \"network-metrics-daemon-jqcts\" (UID: \"64f35da7-cc64-4921-b129-af733326a5f0\") " pod="openshift-multus/network-metrics-daemon-jqcts" Jul 09 04:15:44.921743 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.919347 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/29f6cd6d-4200-4245-b71f-4a5fe6806081-socket-dir\") pod \"aws-ebs-csi-driver-node-vrx8k\" (UID: \"29f6cd6d-4200-4245-b71f-4a5fe6806081\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vrx8k" Jul 09 04:15:44.921743 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.919605 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/58e432fb-a7cb-4181-a1a7-003be0cfa3e0-env-overrides\") pod \"ovnkube-node-gg754\" (UID: \"58e432fb-a7cb-4181-a1a7-003be0cfa3e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gg754" Jul 09 04:15:44.921743 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.919111 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/58e432fb-a7cb-4181-a1a7-003be0cfa3e0-etc-openvswitch\") pod \"ovnkube-node-gg754\" (UID: \"58e432fb-a7cb-4181-a1a7-003be0cfa3e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gg754" Jul 09 04:15:44.921743 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.919683 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/213522d5-333f-4b6d-a064-76ea42c4c637-etc-systemd\") pod \"tuned-cddtq\" (UID: \"213522d5-333f-4b6d-a064-76ea42c4c637\") " pod="openshift-cluster-node-tuning-operator/tuned-cddtq" Jul 09 04:15:44.921743 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.919688 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fee2629f-8880-4f02-bf6b-26317084c049-cni-binary-copy\") pod \"multus-additional-cni-plugins-xf5wq\" (UID: \"fee2629f-8880-4f02-bf6b-26317084c049\") " pod="openshift-multus/multus-additional-cni-plugins-xf5wq" Jul 09 04:15:44.921743 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.919704 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/fee2629f-8880-4f02-bf6b-26317084c049-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xf5wq\" (UID: \"fee2629f-8880-4f02-bf6b-26317084c049\") " pod="openshift-multus/multus-additional-cni-plugins-xf5wq" Jul 09 04:15:44.921743 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.919736 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fee2629f-8880-4f02-bf6b-26317084c049-cnibin\") pod \"multus-additional-cni-plugins-xf5wq\" (UID: \"fee2629f-8880-4f02-bf6b-26317084c049\") " pod="openshift-multus/multus-additional-cni-plugins-xf5wq" Jul 09 04:15:44.921743 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.919742 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0fda490e-3be7-4ca2-ba54-68ab304af491-host-var-lib-cni-bin\") pod \"multus-hb42k\" (UID: \"0fda490e-3be7-4ca2-ba54-68ab304af491\") " pod="openshift-multus/multus-hb42k" Jul 09 04:15:44.921743 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.919775 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/58e432fb-a7cb-4181-a1a7-003be0cfa3e0-ovnkube-script-lib\") pod \"ovnkube-node-gg754\" (UID: \"58e432fb-a7cb-4181-a1a7-003be0cfa3e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gg754" Jul 09 04:15:44.921743 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.919789 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0fda490e-3be7-4ca2-ba54-68ab304af491-hostroot\") pod \"multus-hb42k\" (UID: \"0fda490e-3be7-4ca2-ba54-68ab304af491\") " pod="openshift-multus/multus-hb42k" Jul 09 04:15:44.921743 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.919804 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/213522d5-333f-4b6d-a064-76ea42c4c637-etc-sysctl-d\") pod \"tuned-cddtq\" (UID: \"213522d5-333f-4b6d-a064-76ea42c4c637\") " pod="openshift-cluster-node-tuning-operator/tuned-cddtq" Jul 09 04:15:44.921743 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.919779 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/29f6cd6d-4200-4245-b71f-4a5fe6806081-sys-fs\") pod \"aws-ebs-csi-driver-node-vrx8k\" (UID: \"29f6cd6d-4200-4245-b71f-4a5fe6806081\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vrx8k" Jul 09 04:15:44.921743 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.919846 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/213522d5-333f-4b6d-a064-76ea42c4c637-etc-kubernetes\") pod \"tuned-cddtq\" (UID: \"213522d5-333f-4b6d-a064-76ea42c4c637\") " pod="openshift-cluster-node-tuning-operator/tuned-cddtq" Jul 09 04:15:44.922580 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.919894 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/29f6cd6d-4200-4245-b71f-4a5fe6806081-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vrx8k\" (UID: \"29f6cd6d-4200-4245-b71f-4a5fe6806081\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vrx8k" Jul 09 04:15:44.922580 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.919936 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/29f6cd6d-4200-4245-b71f-4a5fe6806081-registration-dir\") pod \"aws-ebs-csi-driver-node-vrx8k\" (UID: \"29f6cd6d-4200-4245-b71f-4a5fe6806081\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vrx8k" Jul 09 04:15:44.922580 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.919943 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/58e432fb-a7cb-4181-a1a7-003be0cfa3e0-ovnkube-config\") pod \"ovnkube-node-gg754\" (UID: \"58e432fb-a7cb-4181-a1a7-003be0cfa3e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gg754" Jul 09 04:15:44.922580 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.919961 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/58e432fb-a7cb-4181-a1a7-003be0cfa3e0-log-socket\") pod \"ovnkube-node-gg754\" (UID: \"58e432fb-a7cb-4181-a1a7-003be0cfa3e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gg754" Jul 09 04:15:44.922580 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.919986 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fee2629f-8880-4f02-bf6b-26317084c049-system-cni-dir\") pod \"multus-additional-cni-plugins-xf5wq\" (UID: \"fee2629f-8880-4f02-bf6b-26317084c049\") " pod="openshift-multus/multus-additional-cni-plugins-xf5wq" Jul 09 04:15:44.922580 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.920023 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/213522d5-333f-4b6d-a064-76ea42c4c637-sys\") pod \"tuned-cddtq\" (UID: \"213522d5-333f-4b6d-a064-76ea42c4c637\") " pod="openshift-cluster-node-tuning-operator/tuned-cddtq" Jul 09 04:15:44.922580 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.920033 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/58e432fb-a7cb-4181-a1a7-003be0cfa3e0-run-systemd\") pod \"ovnkube-node-gg754\" (UID: \"58e432fb-a7cb-4181-a1a7-003be0cfa3e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gg754" Jul 09 04:15:44.922580 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.920054 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/29f6cd6d-4200-4245-b71f-4a5fe6806081-device-dir\") pod \"aws-ebs-csi-driver-node-vrx8k\" (UID: \"29f6cd6d-4200-4245-b71f-4a5fe6806081\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vrx8k" Jul 09 04:15:44.922580 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.920068 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/58e432fb-a7cb-4181-a1a7-003be0cfa3e0-host-run-netns\") pod \"ovnkube-node-gg754\" (UID: \"58e432fb-a7cb-4181-a1a7-003be0cfa3e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gg754" Jul 09 04:15:44.922580 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.920165 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/213522d5-333f-4b6d-a064-76ea42c4c637-etc-sysctl-conf\") pod \"tuned-cddtq\" (UID: \"213522d5-333f-4b6d-a064-76ea42c4c637\") " pod="openshift-cluster-node-tuning-operator/tuned-cddtq" Jul 09 04:15:44.922580 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.920333 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/289e272c-ff1b-44d3-8411-76fa510b8db9-iptables-alerter-script\") pod \"iptables-alerter-6dfff\" (UID: \"289e272c-ff1b-44d3-8411-76fa510b8db9\") " pod="openshift-network-operator/iptables-alerter-6dfff" Jul 09 04:15:44.922580 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.920368 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/fee2629f-8880-4f02-bf6b-26317084c049-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xf5wq\" (UID: \"fee2629f-8880-4f02-bf6b-26317084c049\") " pod="openshift-multus/multus-additional-cni-plugins-xf5wq" Jul 09 04:15:44.924343 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.924322 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/213522d5-333f-4b6d-a064-76ea42c4c637-etc-tuned\") pod \"tuned-cddtq\" (UID: \"213522d5-333f-4b6d-a064-76ea42c4c637\") " pod="openshift-cluster-node-tuning-operator/tuned-cddtq" Jul 09 04:15:44.924467 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.924343 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/213522d5-333f-4b6d-a064-76ea42c4c637-tmp\") pod \"tuned-cddtq\" (UID: \"213522d5-333f-4b6d-a064-76ea42c4c637\") " pod="openshift-cluster-node-tuning-operator/tuned-cddtq" Jul 09 04:15:44.925719 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.925700 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/58e432fb-a7cb-4181-a1a7-003be0cfa3e0-ovn-node-metrics-cert\") pod \"ovnkube-node-gg754\" (UID: \"58e432fb-a7cb-4181-a1a7-003be0cfa3e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gg754" Jul 09 04:15:44.931050 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.931023 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b7ckg\" (UniqueName: \"kubernetes.io/projected/289e272c-ff1b-44d3-8411-76fa510b8db9-kube-api-access-b7ckg\") pod \"iptables-alerter-6dfff\" (UID: \"289e272c-ff1b-44d3-8411-76fa510b8db9\") " pod="openshift-network-operator/iptables-alerter-6dfff" Jul 09 04:15:44.931168 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.931024 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pnnhn\" (UniqueName: \"kubernetes.io/projected/29f6cd6d-4200-4245-b71f-4a5fe6806081-kube-api-access-pnnhn\") pod \"aws-ebs-csi-driver-node-vrx8k\" (UID: \"29f6cd6d-4200-4245-b71f-4a5fe6806081\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vrx8k" Jul 09 04:15:44.931296 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.931276 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5pvb5\" (UniqueName: \"kubernetes.io/projected/fee2629f-8880-4f02-bf6b-26317084c049-kube-api-access-5pvb5\") pod \"multus-additional-cni-plugins-xf5wq\" (UID: \"fee2629f-8880-4f02-bf6b-26317084c049\") " pod="openshift-multus/multus-additional-cni-plugins-xf5wq" Jul 09 04:15:44.931905 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.931885 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lzk6p\" (UniqueName: \"kubernetes.io/projected/213522d5-333f-4b6d-a064-76ea42c4c637-kube-api-access-lzk6p\") pod \"tuned-cddtq\" (UID: \"213522d5-333f-4b6d-a064-76ea42c4c637\") " pod="openshift-cluster-node-tuning-operator/tuned-cddtq" Jul 09 04:15:44.932746 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:44.932717 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ggcmf\" (UniqueName: \"kubernetes.io/projected/58e432fb-a7cb-4181-a1a7-003be0cfa3e0-kube-api-access-ggcmf\") pod \"ovnkube-node-gg754\" (UID: \"58e432fb-a7cb-4181-a1a7-003be0cfa3e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gg754" Jul 09 04:15:45.020664 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:45.020621 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gckvf\" (UniqueName: \"kubernetes.io/projected/64f35da7-cc64-4921-b129-af733326a5f0-kube-api-access-gckvf\") pod \"network-metrics-daemon-jqcts\" (UID: \"64f35da7-cc64-4921-b129-af733326a5f0\") " pod="openshift-multus/network-metrics-daemon-jqcts" Jul 09 04:15:45.020862 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:45.020671 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0fda490e-3be7-4ca2-ba54-68ab304af491-host-var-lib-kubelet\") pod \"multus-hb42k\" (UID: \"0fda490e-3be7-4ca2-ba54-68ab304af491\") " pod="openshift-multus/multus-hb42k" Jul 09 04:15:45.020862 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:45.020698 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0fda490e-3be7-4ca2-ba54-68ab304af491-host-run-multus-certs\") pod \"multus-hb42k\" (UID: \"0fda490e-3be7-4ca2-ba54-68ab304af491\") " pod="openshift-multus/multus-hb42k" Jul 09 04:15:45.020862 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:45.020731 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/32c78782-6b5e-4dc1-a3c6-048f98de9c1a-original-pull-secret\") pod \"global-pull-secret-syncer-mvrbd\" (UID: \"32c78782-6b5e-4dc1-a3c6-048f98de9c1a\") " pod="kube-system/global-pull-secret-syncer-mvrbd" Jul 09 04:15:45.020862 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:45.020764 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0fda490e-3be7-4ca2-ba54-68ab304af491-system-cni-dir\") pod \"multus-hb42k\" (UID: \"0fda490e-3be7-4ca2-ba54-68ab304af491\") " pod="openshift-multus/multus-hb42k" Jul 09 04:15:45.020862 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:45.020757 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0fda490e-3be7-4ca2-ba54-68ab304af491-host-var-lib-kubelet\") pod \"multus-hb42k\" (UID: \"0fda490e-3be7-4ca2-ba54-68ab304af491\") " pod="openshift-multus/multus-hb42k" Jul 09 04:15:45.020862 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:45.020788 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0fda490e-3be7-4ca2-ba54-68ab304af491-multus-cni-dir\") pod \"multus-hb42k\" (UID: \"0fda490e-3be7-4ca2-ba54-68ab304af491\") " pod="openshift-multus/multus-hb42k" Jul 09 04:15:45.020862 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:45.020814 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f291469f-093e-496e-96de-8c04b337980b-serviceca\") pod \"node-ca-h48tl\" (UID: \"f291469f-093e-496e-96de-8c04b337980b\") " pod="openshift-image-registry/node-ca-h48tl" Jul 09 04:15:45.020862 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:45.020836 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0fda490e-3be7-4ca2-ba54-68ab304af491-multus-socket-dir-parent\") pod \"multus-hb42k\" (UID: \"0fda490e-3be7-4ca2-ba54-68ab304af491\") " pod="openshift-multus/multus-hb42k" Jul 09 04:15:45.020862 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:45.020860 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0fda490e-3be7-4ca2-ba54-68ab304af491-multus-conf-dir\") pod \"multus-hb42k\" (UID: \"0fda490e-3be7-4ca2-ba54-68ab304af491\") " pod="openshift-multus/multus-hb42k" Jul 09 04:15:45.021233 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:45.020889 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0fda490e-3be7-4ca2-ba54-68ab304af491-multus-daemon-config\") pod \"multus-hb42k\" (UID: \"0fda490e-3be7-4ca2-ba54-68ab304af491\") " pod="openshift-multus/multus-hb42k" Jul 09 04:15:45.021233 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:45.020917 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/060291ce-8ee2-46f6-96cf-c2e8ea5804d1-konnectivity-ca\") pod \"konnectivity-agent-l8qcx\" (UID: \"060291ce-8ee2-46f6-96cf-c2e8ea5804d1\") " pod="kube-system/konnectivity-agent-l8qcx" Jul 09 04:15:45.021233 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:15:45.020942 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 04:15:45.021233 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:45.020943 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/64f35da7-cc64-4921-b129-af733326a5f0-metrics-certs\") pod \"network-metrics-daemon-jqcts\" (UID: \"64f35da7-cc64-4921-b129-af733326a5f0\") " pod="openshift-multus/network-metrics-daemon-jqcts" Jul 09 04:15:45.021233 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:45.020984 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0fda490e-3be7-4ca2-ba54-68ab304af491-host-var-lib-cni-bin\") pod \"multus-hb42k\" (UID: \"0fda490e-3be7-4ca2-ba54-68ab304af491\") " pod="openshift-multus/multus-hb42k" Jul 09 04:15:45.021233 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:45.021006 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0fda490e-3be7-4ca2-ba54-68ab304af491-hostroot\") pod \"multus-hb42k\" (UID: \"0fda490e-3be7-4ca2-ba54-68ab304af491\") " pod="openshift-multus/multus-hb42k" Jul 09 04:15:45.021233 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:15:45.021026 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32c78782-6b5e-4dc1-a3c6-048f98de9c1a-original-pull-secret podName:32c78782-6b5e-4dc1-a3c6-048f98de9c1a nodeName:}" failed. No retries permitted until 2026-07-09 04:15:45.521001337 +0000 UTC m=+3.137899552 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/32c78782-6b5e-4dc1-a3c6-048f98de9c1a-original-pull-secret") pod "global-pull-secret-syncer-mvrbd" (UID: "32c78782-6b5e-4dc1-a3c6-048f98de9c1a") : object "kube-system"/"original-pull-secret" not registered Jul 09 04:15:45.021233 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:45.021041 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0fda490e-3be7-4ca2-ba54-68ab304af491-host-run-multus-certs\") pod \"multus-hb42k\" (UID: \"0fda490e-3be7-4ca2-ba54-68ab304af491\") " pod="openshift-multus/multus-hb42k" Jul 09 04:15:45.021233 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:45.021057 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f291469f-093e-496e-96de-8c04b337980b-host\") pod \"node-ca-h48tl\" (UID: \"f291469f-093e-496e-96de-8c04b337980b\") " pod="openshift-image-registry/node-ca-h48tl" Jul 09 04:15:45.021233 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:45.021093 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f291469f-093e-496e-96de-8c04b337980b-host\") pod \"node-ca-h48tl\" (UID: \"f291469f-093e-496e-96de-8c04b337980b\") " pod="openshift-image-registry/node-ca-h48tl" Jul 09 04:15:45.021233 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:45.021099 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0fda490e-3be7-4ca2-ba54-68ab304af491-etc-kubernetes\") pod \"multus-hb42k\" (UID: \"0fda490e-3be7-4ca2-ba54-68ab304af491\") " pod="openshift-multus/multus-hb42k" Jul 09 04:15:45.021233 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:45.021106 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0fda490e-3be7-4ca2-ba54-68ab304af491-system-cni-dir\") pod \"multus-hb42k\" (UID: \"0fda490e-3be7-4ca2-ba54-68ab304af491\") " pod="openshift-multus/multus-hb42k" Jul 09 04:15:45.021233 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:45.021129 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3562e386-fc03-4589-8bb4-2f36cf7ba1be-hosts-file\") pod \"node-resolver-c6vdp\" (UID: \"3562e386-fc03-4589-8bb4-2f36cf7ba1be\") " pod="openshift-dns/node-resolver-c6vdp" Jul 09 04:15:45.021233 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:45.021157 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0fda490e-3be7-4ca2-ba54-68ab304af491-host-run-netns\") pod \"multus-hb42k\" (UID: \"0fda490e-3be7-4ca2-ba54-68ab304af491\") " pod="openshift-multus/multus-hb42k" Jul 09 04:15:45.021233 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:45.021183 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sjv97\" (UniqueName: \"kubernetes.io/projected/0fda490e-3be7-4ca2-ba54-68ab304af491-kube-api-access-sjv97\") pod \"multus-hb42k\" (UID: \"0fda490e-3be7-4ca2-ba54-68ab304af491\") " pod="openshift-multus/multus-hb42k" Jul 09 04:15:45.021233 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:45.021214 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sdvvj\" (UniqueName: \"kubernetes.io/projected/f291469f-093e-496e-96de-8c04b337980b-kube-api-access-sdvvj\") pod \"node-ca-h48tl\" (UID: \"f291469f-093e-496e-96de-8c04b337980b\") " pod="openshift-image-registry/node-ca-h48tl" Jul 09 04:15:45.021233 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:45.021238 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0fda490e-3be7-4ca2-ba54-68ab304af491-host-run-k8s-cni-cncf-io\") pod \"multus-hb42k\" (UID: \"0fda490e-3be7-4ca2-ba54-68ab304af491\") " pod="openshift-multus/multus-hb42k" Jul 09 04:15:45.022039 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:45.021261 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/060291ce-8ee2-46f6-96cf-c2e8ea5804d1-agent-certs\") pod \"konnectivity-agent-l8qcx\" (UID: \"060291ce-8ee2-46f6-96cf-c2e8ea5804d1\") " pod="kube-system/konnectivity-agent-l8qcx" Jul 09 04:15:45.022039 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:45.021258 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0fda490e-3be7-4ca2-ba54-68ab304af491-multus-cni-dir\") pod \"multus-hb42k\" (UID: \"0fda490e-3be7-4ca2-ba54-68ab304af491\") " pod="openshift-multus/multus-hb42k" Jul 09 04:15:45.022039 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:45.021051 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0fda490e-3be7-4ca2-ba54-68ab304af491-hostroot\") pod \"multus-hb42k\" (UID: \"0fda490e-3be7-4ca2-ba54-68ab304af491\") " pod="openshift-multus/multus-hb42k" Jul 09 04:15:45.022039 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:45.021315 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0fda490e-3be7-4ca2-ba54-68ab304af491-etc-kubernetes\") pod \"multus-hb42k\" (UID: \"0fda490e-3be7-4ca2-ba54-68ab304af491\") " pod="openshift-multus/multus-hb42k" Jul 09 04:15:45.022039 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:45.021361 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0fda490e-3be7-4ca2-ba54-68ab304af491-host-run-netns\") pod \"multus-hb42k\" (UID: \"0fda490e-3be7-4ca2-ba54-68ab304af491\") " pod="openshift-multus/multus-hb42k" Jul 09 04:15:45.022039 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:45.021504 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0fda490e-3be7-4ca2-ba54-68ab304af491-host-run-k8s-cni-cncf-io\") pod \"multus-hb42k\" (UID: \"0fda490e-3be7-4ca2-ba54-68ab304af491\") " pod="openshift-multus/multus-hb42k" Jul 09 04:15:45.022039 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:45.021520 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0fda490e-3be7-4ca2-ba54-68ab304af491-multus-socket-dir-parent\") pod \"multus-hb42k\" (UID: \"0fda490e-3be7-4ca2-ba54-68ab304af491\") " pod="openshift-multus/multus-hb42k" Jul 09 04:15:45.022039 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:45.021567 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0fda490e-3be7-4ca2-ba54-68ab304af491-multus-conf-dir\") pod \"multus-hb42k\" (UID: \"0fda490e-3be7-4ca2-ba54-68ab304af491\") " pod="openshift-multus/multus-hb42k" Jul 09 04:15:45.022039 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:15:45.021629 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 04:15:45.022039 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:45.021673 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0fda490e-3be7-4ca2-ba54-68ab304af491-host-var-lib-cni-bin\") pod \"multus-hb42k\" (UID: \"0fda490e-3be7-4ca2-ba54-68ab304af491\") " pod="openshift-multus/multus-hb42k" Jul 09 04:15:45.022039 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:15:45.021690 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64f35da7-cc64-4921-b129-af733326a5f0-metrics-certs podName:64f35da7-cc64-4921-b129-af733326a5f0 nodeName:}" failed. No retries permitted until 2026-07-09 04:15:45.521668031 +0000 UTC m=+3.138566246 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/64f35da7-cc64-4921-b129-af733326a5f0-metrics-certs") pod "network-metrics-daemon-jqcts" (UID: "64f35da7-cc64-4921-b129-af733326a5f0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 04:15:45.022039 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:45.021718 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0fda490e-3be7-4ca2-ba54-68ab304af491-cnibin\") pod \"multus-hb42k\" (UID: \"0fda490e-3be7-4ca2-ba54-68ab304af491\") " pod="openshift-multus/multus-hb42k" Jul 09 04:15:45.022039 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:45.021750 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3562e386-fc03-4589-8bb4-2f36cf7ba1be-hosts-file\") pod \"node-resolver-c6vdp\" (UID: \"3562e386-fc03-4589-8bb4-2f36cf7ba1be\") " pod="openshift-dns/node-resolver-c6vdp" Jul 09 04:15:45.022039 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:45.021754 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xlj4k\" (UniqueName: \"kubernetes.io/projected/50794917-e43f-4a72-ba19-741b2493724a-kube-api-access-xlj4k\") pod \"network-check-target-fgq98\" (UID: \"50794917-e43f-4a72-ba19-741b2493724a\") " pod="openshift-network-diagnostics/network-check-target-fgq98" Jul 09 04:15:45.022039 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:45.021828 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0fda490e-3be7-4ca2-ba54-68ab304af491-cnibin\") pod \"multus-hb42k\" (UID: \"0fda490e-3be7-4ca2-ba54-68ab304af491\") " pod="openshift-multus/multus-hb42k" Jul 09 04:15:45.022039 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:45.021854 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f291469f-093e-496e-96de-8c04b337980b-serviceca\") pod \"node-ca-h48tl\" (UID: \"f291469f-093e-496e-96de-8c04b337980b\") " pod="openshift-image-registry/node-ca-h48tl" Jul 09 04:15:45.022039 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:45.021866 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0fda490e-3be7-4ca2-ba54-68ab304af491-cni-binary-copy\") pod \"multus-hb42k\" (UID: \"0fda490e-3be7-4ca2-ba54-68ab304af491\") " pod="openshift-multus/multus-hb42k" Jul 09 04:15:45.022039 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:45.021911 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0fda490e-3be7-4ca2-ba54-68ab304af491-os-release\") pod \"multus-hb42k\" (UID: \"0fda490e-3be7-4ca2-ba54-68ab304af491\") " pod="openshift-multus/multus-hb42k" Jul 09 04:15:45.022953 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:45.021945 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0fda490e-3be7-4ca2-ba54-68ab304af491-multus-daemon-config\") pod \"multus-hb42k\" (UID: \"0fda490e-3be7-4ca2-ba54-68ab304af491\") " pod="openshift-multus/multus-hb42k" Jul 09 04:15:45.022953 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:45.021947 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5msj5\" (UniqueName: \"kubernetes.io/projected/3562e386-fc03-4589-8bb4-2f36cf7ba1be-kube-api-access-5msj5\") pod \"node-resolver-c6vdp\" (UID: \"3562e386-fc03-4589-8bb4-2f36cf7ba1be\") " pod="openshift-dns/node-resolver-c6vdp" Jul 09 04:15:45.022953 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:45.022000 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0fda490e-3be7-4ca2-ba54-68ab304af491-os-release\") pod \"multus-hb42k\" (UID: \"0fda490e-3be7-4ca2-ba54-68ab304af491\") " pod="openshift-multus/multus-hb42k" Jul 09 04:15:45.022953 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:45.022023 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0fda490e-3be7-4ca2-ba54-68ab304af491-host-var-lib-cni-multus\") pod \"multus-hb42k\" (UID: \"0fda490e-3be7-4ca2-ba54-68ab304af491\") " pod="openshift-multus/multus-hb42k" Jul 09 04:15:45.022953 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:45.022050 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3562e386-fc03-4589-8bb4-2f36cf7ba1be-tmp-dir\") pod \"node-resolver-c6vdp\" (UID: \"3562e386-fc03-4589-8bb4-2f36cf7ba1be\") " pod="openshift-dns/node-resolver-c6vdp" Jul 09 04:15:45.022953 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:45.022083 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/32c78782-6b5e-4dc1-a3c6-048f98de9c1a-kubelet-config\") pod \"global-pull-secret-syncer-mvrbd\" (UID: \"32c78782-6b5e-4dc1-a3c6-048f98de9c1a\") " pod="kube-system/global-pull-secret-syncer-mvrbd" Jul 09 04:15:45.022953 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:45.022094 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0fda490e-3be7-4ca2-ba54-68ab304af491-host-var-lib-cni-multus\") pod \"multus-hb42k\" (UID: \"0fda490e-3be7-4ca2-ba54-68ab304af491\") " pod="openshift-multus/multus-hb42k" Jul 09 04:15:45.022953 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:45.022107 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/32c78782-6b5e-4dc1-a3c6-048f98de9c1a-dbus\") pod \"global-pull-secret-syncer-mvrbd\" (UID: \"32c78782-6b5e-4dc1-a3c6-048f98de9c1a\") " pod="kube-system/global-pull-secret-syncer-mvrbd" Jul 09 04:15:45.022953 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:45.022160 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/32c78782-6b5e-4dc1-a3c6-048f98de9c1a-kubelet-config\") pod \"global-pull-secret-syncer-mvrbd\" (UID: \"32c78782-6b5e-4dc1-a3c6-048f98de9c1a\") " pod="kube-system/global-pull-secret-syncer-mvrbd" Jul 09 04:15:45.022953 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:45.022193 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/32c78782-6b5e-4dc1-a3c6-048f98de9c1a-dbus\") pod \"global-pull-secret-syncer-mvrbd\" (UID: \"32c78782-6b5e-4dc1-a3c6-048f98de9c1a\") " pod="kube-system/global-pull-secret-syncer-mvrbd" Jul 09 04:15:45.022953 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:45.022206 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/060291ce-8ee2-46f6-96cf-c2e8ea5804d1-konnectivity-ca\") pod \"konnectivity-agent-l8qcx\" (UID: \"060291ce-8ee2-46f6-96cf-c2e8ea5804d1\") " pod="kube-system/konnectivity-agent-l8qcx" Jul 09 04:15:45.022953 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:45.022340 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0fda490e-3be7-4ca2-ba54-68ab304af491-cni-binary-copy\") pod \"multus-hb42k\" (UID: \"0fda490e-3be7-4ca2-ba54-68ab304af491\") " pod="openshift-multus/multus-hb42k" Jul 09 04:15:45.022953 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:45.022398 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3562e386-fc03-4589-8bb4-2f36cf7ba1be-tmp-dir\") pod \"node-resolver-c6vdp\" (UID: \"3562e386-fc03-4589-8bb4-2f36cf7ba1be\") " pod="openshift-dns/node-resolver-c6vdp" Jul 09 04:15:45.024920 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:45.024901 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/060291ce-8ee2-46f6-96cf-c2e8ea5804d1-agent-certs\") pod \"konnectivity-agent-l8qcx\" (UID: \"060291ce-8ee2-46f6-96cf-c2e8ea5804d1\") " pod="kube-system/konnectivity-agent-l8qcx" Jul 09 04:15:45.032004 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:15:45.031406 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 04:15:45.032004 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:15:45.031436 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 04:15:45.032004 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:15:45.031453 2566 projected.go:196] Error preparing data for projected volume kube-api-access-xlj4k for pod openshift-network-diagnostics/network-check-target-fgq98: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 04:15:45.032004 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:15:45.031531 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/50794917-e43f-4a72-ba19-741b2493724a-kube-api-access-xlj4k podName:50794917-e43f-4a72-ba19-741b2493724a nodeName:}" failed. No retries permitted until 2026-07-09 04:15:45.531511171 +0000 UTC m=+3.148409376 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-xlj4k" (UniqueName: "kubernetes.io/projected/50794917-e43f-4a72-ba19-741b2493724a-kube-api-access-xlj4k") pod "network-check-target-fgq98" (UID: "50794917-e43f-4a72-ba19-741b2493724a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 04:15:45.034386 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:45.034288 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjv97\" (UniqueName: \"kubernetes.io/projected/0fda490e-3be7-4ca2-ba54-68ab304af491-kube-api-access-sjv97\") pod \"multus-hb42k\" (UID: \"0fda490e-3be7-4ca2-ba54-68ab304af491\") " pod="openshift-multus/multus-hb42k" Jul 09 04:15:45.035195 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:45.035146 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5msj5\" (UniqueName: \"kubernetes.io/projected/3562e386-fc03-4589-8bb4-2f36cf7ba1be-kube-api-access-5msj5\") pod \"node-resolver-c6vdp\" (UID: \"3562e386-fc03-4589-8bb4-2f36cf7ba1be\") " pod="openshift-dns/node-resolver-c6vdp" Jul 09 04:15:45.035756 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:45.035712 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdvvj\" (UniqueName: \"kubernetes.io/projected/f291469f-093e-496e-96de-8c04b337980b-kube-api-access-sdvvj\") pod \"node-ca-h48tl\" (UID: \"f291469f-093e-496e-96de-8c04b337980b\") " pod="openshift-image-registry/node-ca-h48tl" Jul 09 04:15:45.035890 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:45.035865 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gckvf\" (UniqueName: \"kubernetes.io/projected/64f35da7-cc64-4921-b129-af733326a5f0-kube-api-access-gckvf\") pod \"network-metrics-daemon-jqcts\" (UID: \"64f35da7-cc64-4921-b129-af733326a5f0\") " pod="openshift-multus/network-metrics-daemon-jqcts" Jul 09 04:15:45.123317 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:45.123276 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-xf5wq" Jul 09 04:15:45.132066 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:45.132035 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-6dfff" Jul 09 04:15:45.139191 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:45.139156 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfee2629f_8880_4f02_bf6b_26317084c049.slice/crio-547de8c305471948cba7ee0e9a97a6c3a8542f056965a06b1713812f4261d77f WatchSource:0}: Error finding container 547de8c305471948cba7ee0e9a97a6c3a8542f056965a06b1713812f4261d77f: Status 404 returned error can't find the container with id 547de8c305471948cba7ee0e9a97a6c3a8542f056965a06b1713812f4261d77f Jul 09 04:15:45.142030 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:45.141981 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod289e272c_ff1b_44d3_8411_76fa510b8db9.slice/crio-c71b6f0ec19db93c493007663d1fc91a6f976da2372243e97bfc2370468237c7 WatchSource:0}: Error finding container c71b6f0ec19db93c493007663d1fc91a6f976da2372243e97bfc2370468237c7: Status 404 returned error can't find the container with id c71b6f0ec19db93c493007663d1fc91a6f976da2372243e97bfc2370468237c7 Jul 09 04:15:45.143115 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:45.142898 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-gg754" Jul 09 04:15:45.152004 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:45.151983 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vrx8k" Jul 09 04:15:45.153977 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:45.153950 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58e432fb_a7cb_4181_a1a7_003be0cfa3e0.slice/crio-738cf6e7afe98e0412558828a37f32acad720d8c681999846fc1e2af57fb02c5 WatchSource:0}: Error finding container 738cf6e7afe98e0412558828a37f32acad720d8c681999846fc1e2af57fb02c5: Status 404 returned error can't find the container with id 738cf6e7afe98e0412558828a37f32acad720d8c681999846fc1e2af57fb02c5 Jul 09 04:15:45.157732 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:45.157708 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-cddtq" Jul 09 04:15:45.162158 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:45.162133 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29f6cd6d_4200_4245_b71f_4a5fe6806081.slice/crio-05cc384cb53ee9c54f018864a2462eec2790dd9f9867b7d5a32c5b3a101581ea WatchSource:0}: Error finding container 05cc384cb53ee9c54f018864a2462eec2790dd9f9867b7d5a32c5b3a101581ea: Status 404 returned error can't find the container with id 05cc384cb53ee9c54f018864a2462eec2790dd9f9867b7d5a32c5b3a101581ea Jul 09 04:15:45.166064 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:45.166022 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-hb42k" Jul 09 04:15:45.167810 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:45.167785 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod213522d5_333f_4b6d_a064_76ea42c4c637.slice/crio-50c786d3466bb3c51b7550540630cc05fcfe9ea1c00871ce93d6cab4d03b9359 WatchSource:0}: Error finding container 50c786d3466bb3c51b7550540630cc05fcfe9ea1c00871ce93d6cab4d03b9359: Status 404 returned error can't find the container with id 50c786d3466bb3c51b7550540630cc05fcfe9ea1c00871ce93d6cab4d03b9359 Jul 09 04:15:45.176137 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:45.176091 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fda490e_3be7_4ca2_ba54_68ab304af491.slice/crio-659e54a25cb4dd5ce8ad6be4e2a7f21425bd2a808c15a394c467a1ca2ed0240a WatchSource:0}: Error finding container 659e54a25cb4dd5ce8ad6be4e2a7f21425bd2a808c15a394c467a1ca2ed0240a: Status 404 returned error can't find the container with id 659e54a25cb4dd5ce8ad6be4e2a7f21425bd2a808c15a394c467a1ca2ed0240a Jul 09 04:15:45.176256 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:45.176176 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-c6vdp" Jul 09 04:15:45.183301 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:45.183275 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-l8qcx" Jul 09 04:15:45.186708 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:45.186671 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3562e386_fc03_4589_8bb4_2f36cf7ba1be.slice/crio-8a1981fa35467a4dfe7084c66b90b727500cf4b3597b3da112a72b75144aa114 WatchSource:0}: Error finding container 8a1981fa35467a4dfe7084c66b90b727500cf4b3597b3da112a72b75144aa114: Status 404 returned error can't find the container with id 8a1981fa35467a4dfe7084c66b90b727500cf4b3597b3da112a72b75144aa114 Jul 09 04:15:45.189825 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:45.189803 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-h48tl" Jul 09 04:15:45.194586 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:45.194558 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod060291ce_8ee2_46f6_96cf_c2e8ea5804d1.slice/crio-2f1d9f93122add10728a8d24f6fff4f30903dea620dc5450afc882ea777b899d WatchSource:0}: Error finding container 2f1d9f93122add10728a8d24f6fff4f30903dea620dc5450afc882ea777b899d: Status 404 returned error can't find the container with id 2f1d9f93122add10728a8d24f6fff4f30903dea620dc5450afc882ea777b899d Jul 09 04:15:45.202849 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:15:45.202820 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf291469f_093e_496e_96de_8c04b337980b.slice/crio-4efab8970edd0c6ab5ba24d84767f1cc44553a9023677494aaaa3c8a85277ac5 WatchSource:0}: Error finding container 4efab8970edd0c6ab5ba24d84767f1cc44553a9023677494aaaa3c8a85277ac5: Status 404 returned error can't find the container with id 4efab8970edd0c6ab5ba24d84767f1cc44553a9023677494aaaa3c8a85277ac5 Jul 09 04:15:45.526582 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:45.526546 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/32c78782-6b5e-4dc1-a3c6-048f98de9c1a-original-pull-secret\") pod \"global-pull-secret-syncer-mvrbd\" (UID: \"32c78782-6b5e-4dc1-a3c6-048f98de9c1a\") " pod="kube-system/global-pull-secret-syncer-mvrbd" Jul 09 04:15:45.526582 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:45.526594 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/64f35da7-cc64-4921-b129-af733326a5f0-metrics-certs\") pod \"network-metrics-daemon-jqcts\" (UID: \"64f35da7-cc64-4921-b129-af733326a5f0\") " pod="openshift-multus/network-metrics-daemon-jqcts" Jul 09 04:15:45.526845 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:15:45.526717 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 04:15:45.526845 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:15:45.526726 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 04:15:45.526845 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:15:45.526777 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64f35da7-cc64-4921-b129-af733326a5f0-metrics-certs podName:64f35da7-cc64-4921-b129-af733326a5f0 nodeName:}" failed. No retries permitted until 2026-07-09 04:15:46.526761861 +0000 UTC m=+4.143660060 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/64f35da7-cc64-4921-b129-af733326a5f0-metrics-certs") pod "network-metrics-daemon-jqcts" (UID: "64f35da7-cc64-4921-b129-af733326a5f0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 04:15:45.526845 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:15:45.526805 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32c78782-6b5e-4dc1-a3c6-048f98de9c1a-original-pull-secret podName:32c78782-6b5e-4dc1-a3c6-048f98de9c1a nodeName:}" failed. No retries permitted until 2026-07-09 04:15:46.526783794 +0000 UTC m=+4.143682014 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/32c78782-6b5e-4dc1-a3c6-048f98de9c1a-original-pull-secret") pod "global-pull-secret-syncer-mvrbd" (UID: "32c78782-6b5e-4dc1-a3c6-048f98de9c1a") : object "kube-system"/"original-pull-secret" not registered Jul 09 04:15:45.627410 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:45.627367 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xlj4k\" (UniqueName: \"kubernetes.io/projected/50794917-e43f-4a72-ba19-741b2493724a-kube-api-access-xlj4k\") pod \"network-check-target-fgq98\" (UID: \"50794917-e43f-4a72-ba19-741b2493724a\") " pod="openshift-network-diagnostics/network-check-target-fgq98" Jul 09 04:15:45.627594 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:15:45.627514 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 04:15:45.627594 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:15:45.627536 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 04:15:45.627594 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:15:45.627545 2566 projected.go:196] Error preparing data for projected volume kube-api-access-xlj4k for pod openshift-network-diagnostics/network-check-target-fgq98: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 04:15:45.627825 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:15:45.627601 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/50794917-e43f-4a72-ba19-741b2493724a-kube-api-access-xlj4k podName:50794917-e43f-4a72-ba19-741b2493724a nodeName:}" failed. No retries permitted until 2026-07-09 04:15:46.62758482 +0000 UTC m=+4.244483017 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-xlj4k" (UniqueName: "kubernetes.io/projected/50794917-e43f-4a72-ba19-741b2493724a-kube-api-access-xlj4k") pod "network-check-target-fgq98" (UID: "50794917-e43f-4a72-ba19-741b2493724a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 04:15:45.872117 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:45.871977 2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 04:10:45 +0000 UTC" deadline="2028-01-19 12:32:00.175322661 +0000 UTC" Jul 09 04:15:45.872117 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:45.872055 2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13424h16m14.303272214s" Jul 09 04:15:45.906541 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:45.906502 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mvrbd" Jul 09 04:15:45.906825 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:15:45.906675 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mvrbd" podUID="32c78782-6b5e-4dc1-a3c6-048f98de9c1a" Jul 09 04:15:45.919694 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:45.919611 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-6dfff" event={"ID":"289e272c-ff1b-44d3-8411-76fa510b8db9","Type":"ContainerStarted","Data":"c71b6f0ec19db93c493007663d1fc91a6f976da2372243e97bfc2370468237c7"} Jul 09 04:15:45.922308 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:45.922268 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-l8qcx" event={"ID":"060291ce-8ee2-46f6-96cf-c2e8ea5804d1","Type":"ContainerStarted","Data":"2f1d9f93122add10728a8d24f6fff4f30903dea620dc5450afc882ea777b899d"} Jul 09 04:15:45.926606 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:45.926569 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xf5wq" event={"ID":"fee2629f-8880-4f02-bf6b-26317084c049","Type":"ContainerStarted","Data":"547de8c305471948cba7ee0e9a97a6c3a8542f056965a06b1713812f4261d77f"} Jul 09 04:15:45.929505 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:45.929468 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-h48tl" event={"ID":"f291469f-093e-496e-96de-8c04b337980b","Type":"ContainerStarted","Data":"4efab8970edd0c6ab5ba24d84767f1cc44553a9023677494aaaa3c8a85277ac5"} Jul 09 04:15:45.932425 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:45.932393 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-c6vdp" event={"ID":"3562e386-fc03-4589-8bb4-2f36cf7ba1be","Type":"ContainerStarted","Data":"8a1981fa35467a4dfe7084c66b90b727500cf4b3597b3da112a72b75144aa114"} Jul 09 04:15:45.934464 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:45.934433 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-hb42k" event={"ID":"0fda490e-3be7-4ca2-ba54-68ab304af491","Type":"ContainerStarted","Data":"659e54a25cb4dd5ce8ad6be4e2a7f21425bd2a808c15a394c467a1ca2ed0240a"} Jul 09 04:15:45.936299 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:45.936269 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-cddtq" event={"ID":"213522d5-333f-4b6d-a064-76ea42c4c637","Type":"ContainerStarted","Data":"50c786d3466bb3c51b7550540630cc05fcfe9ea1c00871ce93d6cab4d03b9359"} Jul 09 04:15:45.938670 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:45.938643 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vrx8k" event={"ID":"29f6cd6d-4200-4245-b71f-4a5fe6806081","Type":"ContainerStarted","Data":"05cc384cb53ee9c54f018864a2462eec2790dd9f9867b7d5a32c5b3a101581ea"} Jul 09 04:15:45.943951 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:45.941448 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gg754" event={"ID":"58e432fb-a7cb-4181-a1a7-003be0cfa3e0","Type":"ContainerStarted","Data":"738cf6e7afe98e0412558828a37f32acad720d8c681999846fc1e2af57fb02c5"} Jul 09 04:15:46.535715 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:46.535668 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/32c78782-6b5e-4dc1-a3c6-048f98de9c1a-original-pull-secret\") pod \"global-pull-secret-syncer-mvrbd\" (UID: \"32c78782-6b5e-4dc1-a3c6-048f98de9c1a\") " pod="kube-system/global-pull-secret-syncer-mvrbd" Jul 09 04:15:46.535958 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:46.535747 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/64f35da7-cc64-4921-b129-af733326a5f0-metrics-certs\") pod \"network-metrics-daemon-jqcts\" (UID: \"64f35da7-cc64-4921-b129-af733326a5f0\") " pod="openshift-multus/network-metrics-daemon-jqcts" Jul 09 04:15:46.535958 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:15:46.535928 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 04:15:46.536095 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:15:46.536019 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64f35da7-cc64-4921-b129-af733326a5f0-metrics-certs podName:64f35da7-cc64-4921-b129-af733326a5f0 nodeName:}" failed. No retries permitted until 2026-07-09 04:15:48.535997666 +0000 UTC m=+6.152895876 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/64f35da7-cc64-4921-b129-af733326a5f0-metrics-certs") pod "network-metrics-daemon-jqcts" (UID: "64f35da7-cc64-4921-b129-af733326a5f0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 04:15:46.536095 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:15:46.536093 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 04:15:46.536216 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:15:46.536128 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32c78782-6b5e-4dc1-a3c6-048f98de9c1a-original-pull-secret podName:32c78782-6b5e-4dc1-a3c6-048f98de9c1a nodeName:}" failed. No retries permitted until 2026-07-09 04:15:48.536117481 +0000 UTC m=+6.153015686 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/32c78782-6b5e-4dc1-a3c6-048f98de9c1a-original-pull-secret") pod "global-pull-secret-syncer-mvrbd" (UID: "32c78782-6b5e-4dc1-a3c6-048f98de9c1a") : object "kube-system"/"original-pull-secret" not registered Jul 09 04:15:46.636525 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:46.636424 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xlj4k\" (UniqueName: \"kubernetes.io/projected/50794917-e43f-4a72-ba19-741b2493724a-kube-api-access-xlj4k\") pod \"network-check-target-fgq98\" (UID: \"50794917-e43f-4a72-ba19-741b2493724a\") " pod="openshift-network-diagnostics/network-check-target-fgq98" Jul 09 04:15:46.636746 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:15:46.636635 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 04:15:46.636746 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:15:46.636657 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 04:15:46.636746 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:15:46.636671 2566 projected.go:196] Error preparing data for projected volume kube-api-access-xlj4k for pod openshift-network-diagnostics/network-check-target-fgq98: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 04:15:46.636746 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:15:46.636731 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/50794917-e43f-4a72-ba19-741b2493724a-kube-api-access-xlj4k podName:50794917-e43f-4a72-ba19-741b2493724a nodeName:}" failed. No retries permitted until 2026-07-09 04:15:48.636712999 +0000 UTC m=+6.253611213 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-xlj4k" (UniqueName: "kubernetes.io/projected/50794917-e43f-4a72-ba19-741b2493724a-kube-api-access-xlj4k") pod "network-check-target-fgq98" (UID: "50794917-e43f-4a72-ba19-741b2493724a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 04:15:46.872287 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:46.872230 2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 04:10:45 +0000 UTC" deadline="2028-03-25 01:50:08.112589872 +0000 UTC" Jul 09 04:15:46.872287 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:46.872283 2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14997h34m21.240311902s" Jul 09 04:15:46.906508 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:46.906415 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fgq98" Jul 09 04:15:46.906676 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:15:46.906628 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fgq98" podUID="50794917-e43f-4a72-ba19-741b2493724a" Jul 09 04:15:46.907229 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:46.907191 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jqcts" Jul 09 04:15:46.907345 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:15:46.907320 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jqcts" podUID="64f35da7-cc64-4921-b129-af733326a5f0" Jul 09 04:15:47.906369 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:47.906332 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mvrbd" Jul 09 04:15:47.906908 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:15:47.906547 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mvrbd" podUID="32c78782-6b5e-4dc1-a3c6-048f98de9c1a" Jul 09 04:15:47.970404 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:47.970354 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-76.ec2.internal" event={"ID":"befd5e4ef7036106ec96059bdd67d179","Type":"ContainerStarted","Data":"007e3637ca39c04fde7914d691df188fd4d99a7ef527cbb43fdbddd7ade660a8"} Jul 09 04:15:48.555316 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:48.555220 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/64f35da7-cc64-4921-b129-af733326a5f0-metrics-certs\") pod \"network-metrics-daemon-jqcts\" (UID: \"64f35da7-cc64-4921-b129-af733326a5f0\") " pod="openshift-multus/network-metrics-daemon-jqcts" Jul 09 04:15:48.555489 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:48.555317 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/32c78782-6b5e-4dc1-a3c6-048f98de9c1a-original-pull-secret\") pod \"global-pull-secret-syncer-mvrbd\" (UID: \"32c78782-6b5e-4dc1-a3c6-048f98de9c1a\") " pod="kube-system/global-pull-secret-syncer-mvrbd" Jul 09 04:15:48.555489 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:15:48.555384 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 04:15:48.555489 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:15:48.555452 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64f35da7-cc64-4921-b129-af733326a5f0-metrics-certs podName:64f35da7-cc64-4921-b129-af733326a5f0 nodeName:}" failed. No retries permitted until 2026-07-09 04:15:52.55543467 +0000 UTC m=+10.172332871 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/64f35da7-cc64-4921-b129-af733326a5f0-metrics-certs") pod "network-metrics-daemon-jqcts" (UID: "64f35da7-cc64-4921-b129-af733326a5f0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 04:15:48.555489 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:15:48.555453 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 04:15:48.555745 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:15:48.555508 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32c78782-6b5e-4dc1-a3c6-048f98de9c1a-original-pull-secret podName:32c78782-6b5e-4dc1-a3c6-048f98de9c1a nodeName:}" failed. No retries permitted until 2026-07-09 04:15:52.555490949 +0000 UTC m=+10.172389173 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/32c78782-6b5e-4dc1-a3c6-048f98de9c1a-original-pull-secret") pod "global-pull-secret-syncer-mvrbd" (UID: "32c78782-6b5e-4dc1-a3c6-048f98de9c1a") : object "kube-system"/"original-pull-secret" not registered Jul 09 04:15:48.655676 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:48.655637 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xlj4k\" (UniqueName: \"kubernetes.io/projected/50794917-e43f-4a72-ba19-741b2493724a-kube-api-access-xlj4k\") pod \"network-check-target-fgq98\" (UID: \"50794917-e43f-4a72-ba19-741b2493724a\") " pod="openshift-network-diagnostics/network-check-target-fgq98" Jul 09 04:15:48.655898 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:15:48.655877 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 04:15:48.656030 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:15:48.655920 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 04:15:48.656030 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:15:48.655935 2566 projected.go:196] Error preparing data for projected volume kube-api-access-xlj4k for pod openshift-network-diagnostics/network-check-target-fgq98: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 04:15:48.656030 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:15:48.655999 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/50794917-e43f-4a72-ba19-741b2493724a-kube-api-access-xlj4k podName:50794917-e43f-4a72-ba19-741b2493724a nodeName:}" failed. No retries permitted until 2026-07-09 04:15:52.655979028 +0000 UTC m=+10.272877247 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-xlj4k" (UniqueName: "kubernetes.io/projected/50794917-e43f-4a72-ba19-741b2493724a-kube-api-access-xlj4k") pod "network-check-target-fgq98" (UID: "50794917-e43f-4a72-ba19-741b2493724a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 04:15:48.905891 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:48.905775 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jqcts" Jul 09 04:15:48.906091 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:15:48.905957 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jqcts" podUID="64f35da7-cc64-4921-b129-af733326a5f0" Jul 09 04:15:48.908356 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:48.908331 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fgq98" Jul 09 04:15:48.908877 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:15:48.908459 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fgq98" podUID="50794917-e43f-4a72-ba19-741b2493724a" Jul 09 04:15:48.974945 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:48.974845 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-76.ec2.internal" event={"ID":"b5e401d935d56346e11a693f2ace039f","Type":"ContainerStarted","Data":"3de5e0f809672871cad540b5e6026ba3793404e97bd64cc0d6892cf15a502618"} Jul 09 04:15:48.991140 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:48.990595 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-76.ec2.internal" podStartSLOduration=4.990573247 podStartE2EDuration="4.990573247s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 04:15:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:15:47.989671099 +0000 UTC m=+5.606569321" watchObservedRunningTime="2026-07-09 04:15:48.990573247 +0000 UTC m=+6.607471465" Jul 09 04:15:49.906202 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:49.906163 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mvrbd" Jul 09 04:15:49.906398 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:15:49.906311 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mvrbd" podUID="32c78782-6b5e-4dc1-a3c6-048f98de9c1a" Jul 09 04:15:50.907060 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:50.907018 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fgq98" Jul 09 04:15:50.907493 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:15:50.907151 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fgq98" podUID="50794917-e43f-4a72-ba19-741b2493724a" Jul 09 04:15:50.907493 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:50.907209 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jqcts" Jul 09 04:15:50.907493 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:15:50.907310 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jqcts" podUID="64f35da7-cc64-4921-b129-af733326a5f0" Jul 09 04:15:51.906684 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:51.906648 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mvrbd" Jul 09 04:15:51.906861 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:15:51.906774 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mvrbd" podUID="32c78782-6b5e-4dc1-a3c6-048f98de9c1a" Jul 09 04:15:52.590596 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:52.590555 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/32c78782-6b5e-4dc1-a3c6-048f98de9c1a-original-pull-secret\") pod \"global-pull-secret-syncer-mvrbd\" (UID: \"32c78782-6b5e-4dc1-a3c6-048f98de9c1a\") " pod="kube-system/global-pull-secret-syncer-mvrbd" Jul 09 04:15:52.591111 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:52.590626 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/64f35da7-cc64-4921-b129-af733326a5f0-metrics-certs\") pod \"network-metrics-daemon-jqcts\" (UID: \"64f35da7-cc64-4921-b129-af733326a5f0\") " pod="openshift-multus/network-metrics-daemon-jqcts" Jul 09 04:15:52.591111 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:15:52.590781 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 04:15:52.591111 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:15:52.590843 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64f35da7-cc64-4921-b129-af733326a5f0-metrics-certs podName:64f35da7-cc64-4921-b129-af733326a5f0 nodeName:}" failed. No retries permitted until 2026-07-09 04:16:00.590826397 +0000 UTC m=+18.207724614 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/64f35da7-cc64-4921-b129-af733326a5f0-metrics-certs") pod "network-metrics-daemon-jqcts" (UID: "64f35da7-cc64-4921-b129-af733326a5f0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 04:15:52.591293 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:15:52.591271 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 04:15:52.591356 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:15:52.591327 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32c78782-6b5e-4dc1-a3c6-048f98de9c1a-original-pull-secret podName:32c78782-6b5e-4dc1-a3c6-048f98de9c1a nodeName:}" failed. No retries permitted until 2026-07-09 04:16:00.591313601 +0000 UTC m=+18.208211798 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/32c78782-6b5e-4dc1-a3c6-048f98de9c1a-original-pull-secret") pod "global-pull-secret-syncer-mvrbd" (UID: "32c78782-6b5e-4dc1-a3c6-048f98de9c1a") : object "kube-system"/"original-pull-secret" not registered Jul 09 04:15:52.691296 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:52.691255 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xlj4k\" (UniqueName: \"kubernetes.io/projected/50794917-e43f-4a72-ba19-741b2493724a-kube-api-access-xlj4k\") pod \"network-check-target-fgq98\" (UID: \"50794917-e43f-4a72-ba19-741b2493724a\") " pod="openshift-network-diagnostics/network-check-target-fgq98" Jul 09 04:15:52.691493 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:15:52.691469 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 04:15:52.691493 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:15:52.691485 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 04:15:52.691493 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:15:52.691494 2566 projected.go:196] Error preparing data for projected volume kube-api-access-xlj4k for pod openshift-network-diagnostics/network-check-target-fgq98: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 04:15:52.691605 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:15:52.691542 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/50794917-e43f-4a72-ba19-741b2493724a-kube-api-access-xlj4k podName:50794917-e43f-4a72-ba19-741b2493724a nodeName:}" failed. No retries permitted until 2026-07-09 04:16:00.691529669 +0000 UTC m=+18.308427866 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-xlj4k" (UniqueName: "kubernetes.io/projected/50794917-e43f-4a72-ba19-741b2493724a-kube-api-access-xlj4k") pod "network-check-target-fgq98" (UID: "50794917-e43f-4a72-ba19-741b2493724a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 04:15:52.907342 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:52.907260 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jqcts" Jul 09 04:15:52.907491 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:15:52.907365 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jqcts" podUID="64f35da7-cc64-4921-b129-af733326a5f0" Jul 09 04:15:52.907651 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:52.907635 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fgq98" Jul 09 04:15:52.907725 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:15:52.907712 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fgq98" podUID="50794917-e43f-4a72-ba19-741b2493724a" Jul 09 04:15:53.906462 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:53.906426 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mvrbd" Jul 09 04:15:53.906951 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:15:53.906582 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mvrbd" podUID="32c78782-6b5e-4dc1-a3c6-048f98de9c1a" Jul 09 04:15:53.985971 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:53.985936 2566 generic.go:356] "Generic (PLEG): container finished" podID="b5e401d935d56346e11a693f2ace039f" containerID="3de5e0f809672871cad540b5e6026ba3793404e97bd64cc0d6892cf15a502618" exitCode=0 Jul 09 04:15:53.986158 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:53.985985 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-76.ec2.internal" event={"ID":"b5e401d935d56346e11a693f2ace039f","Type":"ContainerDied","Data":"3de5e0f809672871cad540b5e6026ba3793404e97bd64cc0d6892cf15a502618"} Jul 09 04:15:54.907982 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:54.907942 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jqcts" Jul 09 04:15:54.908445 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:15:54.908066 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jqcts" podUID="64f35da7-cc64-4921-b129-af733326a5f0" Jul 09 04:15:54.908445 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:54.908165 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fgq98" Jul 09 04:15:54.908445 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:15:54.908282 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fgq98" podUID="50794917-e43f-4a72-ba19-741b2493724a" Jul 09 04:15:55.906360 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:55.906322 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mvrbd" Jul 09 04:15:55.906626 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:15:55.906516 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mvrbd" podUID="32c78782-6b5e-4dc1-a3c6-048f98de9c1a" Jul 09 04:15:56.907796 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:56.907715 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fgq98" Jul 09 04:15:56.908212 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:15:56.907818 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fgq98" podUID="50794917-e43f-4a72-ba19-741b2493724a" Jul 09 04:15:56.908212 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:56.908161 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jqcts" Jul 09 04:15:56.908327 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:15:56.908245 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jqcts" podUID="64f35da7-cc64-4921-b129-af733326a5f0" Jul 09 04:15:57.906246 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:57.906213 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mvrbd" Jul 09 04:15:57.906423 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:15:57.906332 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mvrbd" podUID="32c78782-6b5e-4dc1-a3c6-048f98de9c1a" Jul 09 04:15:58.909418 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:58.909383 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jqcts" Jul 09 04:15:58.909418 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:58.909423 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fgq98" Jul 09 04:15:58.909859 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:15:58.909525 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jqcts" podUID="64f35da7-cc64-4921-b129-af733326a5f0" Jul 09 04:15:58.909859 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:15:58.909671 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fgq98" podUID="50794917-e43f-4a72-ba19-741b2493724a" Jul 09 04:15:59.906302 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:15:59.906264 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mvrbd" Jul 09 04:15:59.906605 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:15:59.906387 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mvrbd" podUID="32c78782-6b5e-4dc1-a3c6-048f98de9c1a" Jul 09 04:16:00.651236 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:00.651143 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/32c78782-6b5e-4dc1-a3c6-048f98de9c1a-original-pull-secret\") pod \"global-pull-secret-syncer-mvrbd\" (UID: \"32c78782-6b5e-4dc1-a3c6-048f98de9c1a\") " pod="kube-system/global-pull-secret-syncer-mvrbd" Jul 09 04:16:00.651236 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:00.651199 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/64f35da7-cc64-4921-b129-af733326a5f0-metrics-certs\") pod \"network-metrics-daemon-jqcts\" (UID: \"64f35da7-cc64-4921-b129-af733326a5f0\") " pod="openshift-multus/network-metrics-daemon-jqcts" Jul 09 04:16:00.651742 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:00.651314 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 04:16:00.651742 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:00.651318 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 04:16:00.651742 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:00.651379 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64f35da7-cc64-4921-b129-af733326a5f0-metrics-certs podName:64f35da7-cc64-4921-b129-af733326a5f0 nodeName:}" failed. No retries permitted until 2026-07-09 04:16:16.651358726 +0000 UTC m=+34.268256923 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/64f35da7-cc64-4921-b129-af733326a5f0-metrics-certs") pod "network-metrics-daemon-jqcts" (UID: "64f35da7-cc64-4921-b129-af733326a5f0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 04:16:00.651742 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:00.651400 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32c78782-6b5e-4dc1-a3c6-048f98de9c1a-original-pull-secret podName:32c78782-6b5e-4dc1-a3c6-048f98de9c1a nodeName:}" failed. No retries permitted until 2026-07-09 04:16:16.651389895 +0000 UTC m=+34.268288093 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/32c78782-6b5e-4dc1-a3c6-048f98de9c1a-original-pull-secret") pod "global-pull-secret-syncer-mvrbd" (UID: "32c78782-6b5e-4dc1-a3c6-048f98de9c1a") : object "kube-system"/"original-pull-secret" not registered Jul 09 04:16:00.752220 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:00.752181 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xlj4k\" (UniqueName: \"kubernetes.io/projected/50794917-e43f-4a72-ba19-741b2493724a-kube-api-access-xlj4k\") pod \"network-check-target-fgq98\" (UID: \"50794917-e43f-4a72-ba19-741b2493724a\") " pod="openshift-network-diagnostics/network-check-target-fgq98" Jul 09 04:16:00.752418 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:00.752346 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 04:16:00.752418 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:00.752368 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 04:16:00.752418 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:00.752378 2566 projected.go:196] Error preparing data for projected volume kube-api-access-xlj4k for pod openshift-network-diagnostics/network-check-target-fgq98: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 04:16:00.752574 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:00.752441 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/50794917-e43f-4a72-ba19-741b2493724a-kube-api-access-xlj4k podName:50794917-e43f-4a72-ba19-741b2493724a nodeName:}" failed. No retries permitted until 2026-07-09 04:16:16.752424129 +0000 UTC m=+34.369322346 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-xlj4k" (UniqueName: "kubernetes.io/projected/50794917-e43f-4a72-ba19-741b2493724a-kube-api-access-xlj4k") pod "network-check-target-fgq98" (UID: "50794917-e43f-4a72-ba19-741b2493724a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 04:16:00.906319 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:00.906231 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fgq98" Jul 09 04:16:00.906319 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:00.906259 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jqcts" Jul 09 04:16:00.906548 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:00.906369 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fgq98" podUID="50794917-e43f-4a72-ba19-741b2493724a" Jul 09 04:16:00.906548 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:00.906442 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jqcts" podUID="64f35da7-cc64-4921-b129-af733326a5f0" Jul 09 04:16:01.906652 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:01.906617 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mvrbd" Jul 09 04:16:01.907150 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:01.906757 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mvrbd" podUID="32c78782-6b5e-4dc1-a3c6-048f98de9c1a" Jul 09 04:16:02.907434 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:02.907394 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jqcts" Jul 09 04:16:02.907955 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:02.907504 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jqcts" podUID="64f35da7-cc64-4921-b129-af733326a5f0" Jul 09 04:16:02.908035 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:02.907962 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fgq98" Jul 09 04:16:02.908092 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:02.908058 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fgq98" podUID="50794917-e43f-4a72-ba19-741b2493724a" Jul 09 04:16:03.906005 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:03.905966 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mvrbd" Jul 09 04:16:03.906247 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:03.906120 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mvrbd" podUID="32c78782-6b5e-4dc1-a3c6-048f98de9c1a" Jul 09 04:16:04.906181 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:04.906140 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jqcts" Jul 09 04:16:04.906580 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:04.906257 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jqcts" podUID="64f35da7-cc64-4921-b129-af733326a5f0" Jul 09 04:16:04.906580 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:04.906347 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fgq98" Jul 09 04:16:04.906580 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:04.906426 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fgq98" podUID="50794917-e43f-4a72-ba19-741b2493724a" Jul 09 04:16:05.906526 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:05.906174 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mvrbd" Jul 09 04:16:05.907179 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:05.906567 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mvrbd" podUID="32c78782-6b5e-4dc1-a3c6-048f98de9c1a" Jul 09 04:16:06.009070 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:06.009030 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-76.ec2.internal" event={"ID":"b5e401d935d56346e11a693f2ace039f","Type":"ContainerStarted","Data":"3df19ec3890c3620e898b3d3d0054888b5a589092baf0f68e1cb7bb67ca0d292"} Jul 09 04:16:06.010603 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:06.010569 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-h48tl" event={"ID":"f291469f-093e-496e-96de-8c04b337980b","Type":"ContainerStarted","Data":"6717f55f00f4108a6c0d064e3771baa8a4c157dbcca0a3c6a5757d6f2f25a25d"} Jul 09 04:16:06.012004 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:06.011974 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-c6vdp" event={"ID":"3562e386-fc03-4589-8bb4-2f36cf7ba1be","Type":"ContainerStarted","Data":"308b50c16d22e8a7a24f639d07a3ff2ceae11bccefee300c0b3810d0c5506c68"} Jul 09 04:16:06.013588 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:06.013566 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-hb42k" event={"ID":"0fda490e-3be7-4ca2-ba54-68ab304af491","Type":"ContainerStarted","Data":"d4a940991a811735586dc30b25f841dbcf2b11a9cc60d6ee25b968f6806bfa72"} Jul 09 04:16:06.015191 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:06.015168 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-cddtq" event={"ID":"213522d5-333f-4b6d-a064-76ea42c4c637","Type":"ContainerStarted","Data":"9f87f0aba317a1671150a336782da676f4de30dcb3bbf2b0fc003d47e5d59239"} Jul 09 04:16:06.016453 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:06.016433 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vrx8k" event={"ID":"29f6cd6d-4200-4245-b71f-4a5fe6806081","Type":"ContainerStarted","Data":"774d8b481700d8eddfb6118198b8c39dd1498c1239ff0a00b73a48ea4597f7e6"} Jul 09 04:16:06.019311 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:06.019290 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gg754" event={"ID":"58e432fb-a7cb-4181-a1a7-003be0cfa3e0","Type":"ContainerStarted","Data":"c3b34dcfbcfdcbf2d7d0b070bf80fb85bfa06cad89c259eca534855d04fb6006"} Jul 09 04:16:06.019420 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:06.019352 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gg754" event={"ID":"58e432fb-a7cb-4181-a1a7-003be0cfa3e0","Type":"ContainerStarted","Data":"a90b1d4eda06f6ca1d0d9c0a81fe79bf196334750a9c3822ddc95e398204c39b"} Jul 09 04:16:06.019420 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:06.019394 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gg754" event={"ID":"58e432fb-a7cb-4181-a1a7-003be0cfa3e0","Type":"ContainerStarted","Data":"21100affd90fca4131d19410975d658091ad8d3be58086470e37c36633110a72"} Jul 09 04:16:06.019532 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:06.019438 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gg754" event={"ID":"58e432fb-a7cb-4181-a1a7-003be0cfa3e0","Type":"ContainerStarted","Data":"04ec101c82b7986a8e04876f54df806d6863f873be27c3fa8b095a3761cacb35"} Jul 09 04:16:06.019532 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:06.019479 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gg754" event={"ID":"58e432fb-a7cb-4181-a1a7-003be0cfa3e0","Type":"ContainerStarted","Data":"ee9b50f55440b949bf3004c132459306838d33501218ff59e43ff5007da54e72"} Jul 09 04:16:06.019532 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:06.019518 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gg754" event={"ID":"58e432fb-a7cb-4181-a1a7-003be0cfa3e0","Type":"ContainerStarted","Data":"e658bab48ebc98e3d96da6a303bf37ae57dfcdc51e0964e2143538140b424a19"} Jul 09 04:16:06.020686 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:06.020664 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-l8qcx" event={"ID":"060291ce-8ee2-46f6-96cf-c2e8ea5804d1","Type":"ContainerStarted","Data":"e4b9cf463ce681a4bf589185ed7b644373394ae73b623ed573e0947bf8e505e1"} Jul 09 04:16:06.022219 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:06.022197 2566 generic.go:356] "Generic (PLEG): container finished" podID="fee2629f-8880-4f02-bf6b-26317084c049" containerID="7e596449951e4fce5f26c5ff787f930012044b2325bc96693e3542b29b460bce" exitCode=0 Jul 09 04:16:06.022306 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:06.022230 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xf5wq" event={"ID":"fee2629f-8880-4f02-bf6b-26317084c049","Type":"ContainerDied","Data":"7e596449951e4fce5f26c5ff787f930012044b2325bc96693e3542b29b460bce"} Jul 09 04:16:06.051611 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:06.051550 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-76.ec2.internal" podStartSLOduration=22.051530072 podStartE2EDuration="22.051530072s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 04:15:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:16:06.051415355 +0000 UTC m=+23.668313576" watchObservedRunningTime="2026-07-09 04:16:06.051530072 +0000 UTC m=+23.668428291" Jul 09 04:16:06.069328 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:06.069274 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-c6vdp" podStartSLOduration=3.109530212 podStartE2EDuration="23.069256577s" totalImagesPullingTime="19.959726365s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 04:15:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:16:06.068795987 +0000 UTC m=+23.685694208" watchObservedRunningTime="2026-07-09 04:16:06.069256577 +0000 UTC m=+23.686154795" Jul 09 04:16:06.083167 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:06.083119 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-l8qcx" podStartSLOduration=7.953372139 podStartE2EDuration="23.083102877s" totalImagesPullingTime="15.129730738s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:15:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:16:06.082702438 +0000 UTC m=+23.699600659" watchObservedRunningTime="2026-07-09 04:16:06.083102877 +0000 UTC m=+23.700001096" Jul 09 04:16:06.119902 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:06.119855 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-cddtq" podStartSLOduration=3.088516397 podStartE2EDuration="23.119838565s" totalImagesPullingTime="20.031322168s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 04:15:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:16:06.119368835 +0000 UTC m=+23.736267056" watchObservedRunningTime="2026-07-09 04:16:06.119838565 +0000 UTC m=+23.736736783" Jul 09 04:16:06.133659 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:06.133605 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-h48tl" podStartSLOduration=3.530836017 podStartE2EDuration="23.133587793s" totalImagesPullingTime="19.602751776s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 04:15:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:16:06.133466867 +0000 UTC m=+23.750365086" watchObservedRunningTime="2026-07-09 04:16:06.133587793 +0000 UTC m=+23.750486011" Jul 09 04:16:06.156934 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:06.156815 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-hb42k" podStartSLOduration=3.040187929 podStartE2EDuration="23.156799995s" totalImagesPullingTime="20.116612066s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 04:15:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:16:06.15657852 +0000 UTC m=+23.773476791" watchObservedRunningTime="2026-07-09 04:16:06.156799995 +0000 UTC m=+23.773698214" Jul 09 04:16:06.907080 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:06.907046 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jqcts" Jul 09 04:16:06.907586 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:06.907197 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jqcts" podUID="64f35da7-cc64-4921-b129-af733326a5f0" Jul 09 04:16:06.907707 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:06.907677 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fgq98" Jul 09 04:16:06.907837 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:06.907792 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fgq98" podUID="50794917-e43f-4a72-ba19-741b2493724a" Jul 09 04:16:07.003972 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:07.003945 2566 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 09 04:16:07.026980 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:07.026946 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vrx8k" event={"ID":"29f6cd6d-4200-4245-b71f-4a5fe6806081","Type":"ContainerStarted","Data":"b07bbbab026d23eb24cf799c3422f38e6e35aecabed9dc9b0b6ef5c3825d4a25"} Jul 09 04:16:07.028452 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:07.028422 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-6dfff" event={"ID":"289e272c-ff1b-44d3-8411-76fa510b8db9","Type":"ContainerStarted","Data":"008ee06ec08afa3a5e2b27307608b42353bd90497853eb80f2dc0d959d2ec972"} Jul 09 04:16:07.043380 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:07.043322 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-6dfff" podStartSLOduration=4.017187853 podStartE2EDuration="24.043302583s" totalImagesPullingTime="20.02611473s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 04:15:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:16:07.043299996 +0000 UTC m=+24.660198214" watchObservedRunningTime="2026-07-09 04:16:07.043302583 +0000 UTC m=+24.660200802" Jul 09 04:16:07.487617 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:07.487584 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-l8qcx" Jul 09 04:16:07.488209 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:07.488189 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-l8qcx" Jul 09 04:16:07.877418 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:07.877250 2566 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-09T04:16:07.003965478Z","UUID":"f1c3ad4c-a5e2-4601-9eb4-2159bfd3bca3","Handler":null,"Name":"","Endpoint":""} Jul 09 04:16:07.879283 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:07.879255 2566 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 09 04:16:07.879423 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:07.879306 2566 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 09 04:16:07.905874 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:07.905847 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mvrbd" Jul 09 04:16:07.906053 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:07.905976 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mvrbd" podUID="32c78782-6b5e-4dc1-a3c6-048f98de9c1a" Jul 09 04:16:08.031241 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:08.031157 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-l8qcx" Jul 09 04:16:08.031650 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:08.031513 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-l8qcx" Jul 09 04:16:08.906149 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:08.906110 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jqcts" Jul 09 04:16:08.906149 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:08.906110 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fgq98" Jul 09 04:16:08.906360 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:08.906236 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fgq98" podUID="50794917-e43f-4a72-ba19-741b2493724a" Jul 09 04:16:08.906402 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:08.906357 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jqcts" podUID="64f35da7-cc64-4921-b129-af733326a5f0" Jul 09 04:16:09.035367 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:09.035330 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vrx8k" event={"ID":"29f6cd6d-4200-4245-b71f-4a5fe6806081","Type":"ContainerStarted","Data":"be890f7fe77d38db7f97e9dcef258b84a2f6c246e8099e3479a3d228f81b8fb4"} Jul 09 04:16:09.038581 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:09.038545 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gg754" event={"ID":"58e432fb-a7cb-4181-a1a7-003be0cfa3e0","Type":"ContainerStarted","Data":"417b7479d1a63970debdb0c611782fc6548b264250ee67387e12450d1adcff4f"} Jul 09 04:16:09.051987 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:09.051936 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vrx8k" podStartSLOduration=3.635459592 podStartE2EDuration="26.051905445s" totalImagesPullingTime="22.416445853s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 04:15:43 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:16:09.051900282 +0000 UTC m=+26.668798513" watchObservedRunningTime="2026-07-09 04:16:09.051905445 +0000 UTC m=+26.668803664" Jul 09 04:16:09.905927 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:09.905879 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mvrbd" Jul 09 04:16:09.906092 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:09.906006 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mvrbd" podUID="32c78782-6b5e-4dc1-a3c6-048f98de9c1a" Jul 09 04:16:10.906963 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:10.906695 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jqcts" Jul 09 04:16:10.907453 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:10.906685 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fgq98" Jul 09 04:16:10.907453 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:10.907099 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jqcts" podUID="64f35da7-cc64-4921-b129-af733326a5f0" Jul 09 04:16:10.907453 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:10.907217 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fgq98" podUID="50794917-e43f-4a72-ba19-741b2493724a" Jul 09 04:16:11.906612 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:11.906588 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mvrbd" Jul 09 04:16:11.906730 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:11.906689 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mvrbd" podUID="32c78782-6b5e-4dc1-a3c6-048f98de9c1a" Jul 09 04:16:12.049309 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:12.049094 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gg754" event={"ID":"58e432fb-a7cb-4181-a1a7-003be0cfa3e0","Type":"ContainerStarted","Data":"934c3c91d71ce51313dd54095befb6b4504a03ce88dc8ffc3f9ac6e3aad18d17"} Jul 09 04:16:12.050055 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:12.049384 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gg754" Jul 09 04:16:12.050055 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:12.049441 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gg754" Jul 09 04:16:12.050055 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:12.049486 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gg754" Jul 09 04:16:12.052027 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:12.051999 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xf5wq" event={"ID":"fee2629f-8880-4f02-bf6b-26317084c049","Type":"ContainerStarted","Data":"8713c9f1ee4b78d221552153b3a21e5200acad74a33844aca71ecab113d33ca5"} Jul 09 04:16:12.066711 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:12.066677 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gg754" Jul 09 04:16:12.071492 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:12.071460 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gg754" Jul 09 04:16:12.077354 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:12.075748 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-gg754" podStartSLOduration=8.986164338 podStartE2EDuration="29.07573055s" totalImagesPullingTime="20.089566212s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 04:15:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:16:12.074875575 +0000 UTC m=+29.691773789" watchObservedRunningTime="2026-07-09 04:16:12.07573055 +0000 UTC m=+29.692628771" Jul 09 04:16:12.907849 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:12.907808 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jqcts" Jul 09 04:16:12.908054 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:12.907946 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jqcts" podUID="64f35da7-cc64-4921-b129-af733326a5f0" Jul 09 04:16:12.908507 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:12.908466 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fgq98" Jul 09 04:16:12.908712 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:12.908588 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fgq98" podUID="50794917-e43f-4a72-ba19-741b2493724a" Jul 09 04:16:13.056153 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:13.056120 2566 generic.go:356] "Generic (PLEG): container finished" podID="fee2629f-8880-4f02-bf6b-26317084c049" containerID="8713c9f1ee4b78d221552153b3a21e5200acad74a33844aca71ecab113d33ca5" exitCode=0 Jul 09 04:16:13.056561 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:13.056202 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xf5wq" event={"ID":"fee2629f-8880-4f02-bf6b-26317084c049","Type":"ContainerDied","Data":"8713c9f1ee4b78d221552153b3a21e5200acad74a33844aca71ecab113d33ca5"} Jul 09 04:16:13.618749 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:13.618708 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-mvrbd"] Jul 09 04:16:13.619100 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:13.618826 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mvrbd" Jul 09 04:16:13.619100 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:13.618950 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mvrbd" podUID="32c78782-6b5e-4dc1-a3c6-048f98de9c1a" Jul 09 04:16:13.622093 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:13.622065 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-jqcts"] Jul 09 04:16:13.622248 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:13.622134 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-fgq98"] Jul 09 04:16:13.622248 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:13.622203 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fgq98" Jul 09 04:16:13.622336 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:13.622302 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fgq98" podUID="50794917-e43f-4a72-ba19-741b2493724a" Jul 09 04:16:13.622371 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:13.622361 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jqcts" Jul 09 04:16:13.622458 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:13.622440 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jqcts" podUID="64f35da7-cc64-4921-b129-af733326a5f0" Jul 09 04:16:14.906445 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:14.906406 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fgq98" Jul 09 04:16:14.906956 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:14.906532 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fgq98" podUID="50794917-e43f-4a72-ba19-741b2493724a" Jul 09 04:16:15.061972 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:15.061860 2566 generic.go:356] "Generic (PLEG): container finished" podID="fee2629f-8880-4f02-bf6b-26317084c049" containerID="079f8e027fb0442a7c961879cb8419541ae41f87ad1009e10bcfdda52926e923" exitCode=0 Jul 09 04:16:15.061972 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:15.061900 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xf5wq" event={"ID":"fee2629f-8880-4f02-bf6b-26317084c049","Type":"ContainerDied","Data":"079f8e027fb0442a7c961879cb8419541ae41f87ad1009e10bcfdda52926e923"} Jul 09 04:16:15.906624 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:15.906440 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jqcts" Jul 09 04:16:15.907002 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:15.906511 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mvrbd" Jul 09 04:16:15.907002 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:15.906713 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jqcts" podUID="64f35da7-cc64-4921-b129-af733326a5f0" Jul 09 04:16:15.907002 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:15.906763 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mvrbd" podUID="32c78782-6b5e-4dc1-a3c6-048f98de9c1a" Jul 09 04:16:16.670455 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:16.670358 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/32c78782-6b5e-4dc1-a3c6-048f98de9c1a-original-pull-secret\") pod \"global-pull-secret-syncer-mvrbd\" (UID: \"32c78782-6b5e-4dc1-a3c6-048f98de9c1a\") " pod="kube-system/global-pull-secret-syncer-mvrbd" Jul 09 04:16:16.670455 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:16.670405 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/64f35da7-cc64-4921-b129-af733326a5f0-metrics-certs\") pod \"network-metrics-daemon-jqcts\" (UID: \"64f35da7-cc64-4921-b129-af733326a5f0\") " pod="openshift-multus/network-metrics-daemon-jqcts" Jul 09 04:16:16.670666 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:16.670518 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 04:16:16.670666 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:16.670520 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 04:16:16.670666 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:16.670579 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64f35da7-cc64-4921-b129-af733326a5f0-metrics-certs podName:64f35da7-cc64-4921-b129-af733326a5f0 nodeName:}" failed. No retries permitted until 2026-07-09 04:16:48.67056172 +0000 UTC m=+66.287459918 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/64f35da7-cc64-4921-b129-af733326a5f0-metrics-certs") pod "network-metrics-daemon-jqcts" (UID: "64f35da7-cc64-4921-b129-af733326a5f0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 04:16:16.670666 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:16.670594 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32c78782-6b5e-4dc1-a3c6-048f98de9c1a-original-pull-secret podName:32c78782-6b5e-4dc1-a3c6-048f98de9c1a nodeName:}" failed. No retries permitted until 2026-07-09 04:16:48.67058783 +0000 UTC m=+66.287486028 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/32c78782-6b5e-4dc1-a3c6-048f98de9c1a-original-pull-secret") pod "global-pull-secret-syncer-mvrbd" (UID: "32c78782-6b5e-4dc1-a3c6-048f98de9c1a") : object "kube-system"/"original-pull-secret" not registered Jul 09 04:16:16.771324 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:16.771285 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xlj4k\" (UniqueName: \"kubernetes.io/projected/50794917-e43f-4a72-ba19-741b2493724a-kube-api-access-xlj4k\") pod \"network-check-target-fgq98\" (UID: \"50794917-e43f-4a72-ba19-741b2493724a\") " pod="openshift-network-diagnostics/network-check-target-fgq98" Jul 09 04:16:16.771493 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:16.771451 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 04:16:16.771493 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:16.771478 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 04:16:16.771493 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:16.771488 2566 projected.go:196] Error preparing data for projected volume kube-api-access-xlj4k for pod openshift-network-diagnostics/network-check-target-fgq98: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 04:16:16.771636 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:16.771543 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/50794917-e43f-4a72-ba19-741b2493724a-kube-api-access-xlj4k podName:50794917-e43f-4a72-ba19-741b2493724a nodeName:}" failed. No retries permitted until 2026-07-09 04:16:48.771528957 +0000 UTC m=+66.388427154 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-xlj4k" (UniqueName: "kubernetes.io/projected/50794917-e43f-4a72-ba19-741b2493724a-kube-api-access-xlj4k") pod "network-check-target-fgq98" (UID: "50794917-e43f-4a72-ba19-741b2493724a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 04:16:16.905924 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:16.905879 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fgq98" Jul 09 04:16:16.906080 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:16.906024 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fgq98" podUID="50794917-e43f-4a72-ba19-741b2493724a" Jul 09 04:16:17.068060 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:17.068027 2566 generic.go:356] "Generic (PLEG): container finished" podID="fee2629f-8880-4f02-bf6b-26317084c049" containerID="b8cdd6420aeea4eea03d7363b34e93841e92e5a0499fc42b61f3488bd2e77007" exitCode=0 Jul 09 04:16:17.068457 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:17.068089 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xf5wq" event={"ID":"fee2629f-8880-4f02-bf6b-26317084c049","Type":"ContainerDied","Data":"b8cdd6420aeea4eea03d7363b34e93841e92e5a0499fc42b61f3488bd2e77007"} Jul 09 04:16:17.905728 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:17.905691 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jqcts" Jul 09 04:16:17.905728 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:17.905706 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mvrbd" Jul 09 04:16:17.905987 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:17.905844 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jqcts" podUID="64f35da7-cc64-4921-b129-af733326a5f0" Jul 09 04:16:17.906043 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:17.905999 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mvrbd" podUID="32c78782-6b5e-4dc1-a3c6-048f98de9c1a" Jul 09 04:16:18.210943 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.210852 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-76.ec2.internal" event="NodeReady" Jul 09 04:16:18.211401 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.211024 2566 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 09 04:16:18.243101 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.243065 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-6sjg9"] Jul 09 04:16:18.247950 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.247903 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-cqrqz"] Jul 09 04:16:18.248116 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.248053 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-6sjg9" Jul 09 04:16:18.252037 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.252005 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5bb6bc998-jhp7f"] Jul 09 04:16:18.252187 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.252115 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-cqrqz" Jul 09 04:16:18.255589 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.255562 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-ks9bq"] Jul 09 04:16:18.256118 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.256099 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5bb6bc998-jhp7f" Jul 09 04:16:18.256617 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.256590 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 09 04:16:18.256720 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.256606 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 09 04:16:18.256772 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.256727 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 09 04:16:18.256772 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.256763 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 09 04:16:18.256876 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.256825 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 09 04:16:18.256956 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.256892 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 09 04:16:18.257021 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.257009 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 09 04:16:18.257069 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.257047 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 09 04:16:18.258384 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.258360 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-68nr9\"" Jul 09 04:16:18.259778 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.259758 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-wjb26\"" Jul 09 04:16:18.261147 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.261127 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-679fd94dd5-pmxfd"] Jul 09 04:16:18.261250 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.261242 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-ks9bq" Jul 09 04:16:18.262854 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.262832 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-z54q4\"" Jul 09 04:16:18.263213 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.263187 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 09 04:16:18.266493 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.263714 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 09 04:16:18.268614 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.268587 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 09 04:16:18.269745 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.269689 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 09 04:16:18.270211 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.270128 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 09 04:16:18.273186 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.272685 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 09 04:16:18.273186 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.272690 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-d9vmv"] Jul 09 04:16:18.273186 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.272767 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-679fd94dd5-pmxfd" Jul 09 04:16:18.275621 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.275487 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 09 04:16:18.276360 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.276339 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-v6h2j"] Jul 09 04:16:18.276593 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.276575 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-d9vmv" Jul 09 04:16:18.281653 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.281599 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-lhzlx"] Jul 09 04:16:18.281864 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.281850 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-v6h2j" Jul 09 04:16:18.283734 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.282738 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 09 04:16:18.283995 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.282769 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 09 04:16:18.284190 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.282800 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 09 04:16:18.284342 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.282831 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-stg69\"" Jul 09 04:16:18.285525 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.285505 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-8stqx"] Jul 09 04:16:18.285775 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.285756 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 09 04:16:18.285860 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.285849 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-b8ppd\"" Jul 09 04:16:18.286072 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.286058 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-lhzlx" Jul 09 04:16:18.289141 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.289116 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 09 04:16:18.289359 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.289327 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-7wbd7\"" Jul 09 04:16:18.289901 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.289712 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 09 04:16:18.289901 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.289884 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 09 04:16:18.292297 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.291061 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-rwrjq\"" Jul 09 04:16:18.292297 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.291297 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 09 04:16:18.292297 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.291741 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-5nq2g"] Jul 09 04:16:18.293138 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.293119 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-8stqx" Jul 09 04:16:18.294405 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.294331 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 09 04:16:18.296483 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.296424 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 09 04:16:18.296935 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.296892 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 09 04:16:18.297286 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.297253 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-lzwsf\"" Jul 09 04:16:18.297969 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.297518 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 09 04:16:18.297969 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.297728 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 09 04:16:18.299481 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.294556 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 09 04:16:18.299481 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.299291 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 09 04:16:18.301055 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.301036 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-7c74886bd5-pn4hl"] Jul 09 04:16:18.308184 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.301254 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-5nq2g" Jul 09 04:16:18.308880 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.308675 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 09 04:16:18.310121 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.310099 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 09 04:16:18.310489 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.310395 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-txl2n\"" Jul 09 04:16:18.311774 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.311755 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-6sjg9"] Jul 09 04:16:18.311955 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.311935 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-qthv7"] Jul 09 04:16:18.312699 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.312677 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 09 04:16:18.313312 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.313289 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7c74886bd5-pn4hl" Jul 09 04:16:18.316004 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.315861 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 09 04:16:18.316582 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.316561 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-z8vt7"] Jul 09 04:16:18.316755 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.316728 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 09 04:16:18.316862 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.316778 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-sbbxr\"" Jul 09 04:16:18.316862 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.316844 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-qthv7" Jul 09 04:16:18.317108 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.316969 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 09 04:16:18.317108 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.317021 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 09 04:16:18.317268 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.317260 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 09 04:16:18.317427 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.316660 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 09 04:16:18.319563 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.319470 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 09 04:16:18.319746 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.319731 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 09 04:16:18.319948 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.319930 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5bb6bc998-jhp7f"] Jul 09 04:16:18.320017 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.319902 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-xvcjj\"" Jul 09 04:16:18.320066 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.320032 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-z8vt7" Jul 09 04:16:18.320103 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.320061 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-v6h2j"] Jul 09 04:16:18.320103 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.320084 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 09 04:16:18.320230 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.320090 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-ks9bq"] Jul 09 04:16:18.320348 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.320335 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-5nq2g"] Jul 09 04:16:18.320385 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.320361 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-d9vmv"] Jul 09 04:16:18.320385 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.320375 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-8stqx"] Jul 09 04:16:18.320442 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.320387 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7c74886bd5-pn4hl"] Jul 09 04:16:18.320442 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.320404 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-679fd94dd5-pmxfd"] Jul 09 04:16:18.320442 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.320416 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-cqrqz"] Jul 09 04:16:18.320442 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.320427 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-lhzlx"] Jul 09 04:16:18.320442 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.320439 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-qthv7"] Jul 09 04:16:18.320575 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.320451 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-z8vt7"] Jul 09 04:16:18.322852 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.322830 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 09 04:16:18.322852 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.322847 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 09 04:16:18.323035 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.322836 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-7xx9g\"" Jul 09 04:16:18.381842 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.381805 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c805c009-9a98-4b40-9c74-9bed4868db61-serving-cert\") pod \"insights-operator-5c847dcfc4-6sjg9\" (UID: \"c805c009-9a98-4b40-9c74-9bed4868db61\") " pod="openshift-insights/insights-operator-5c847dcfc4-6sjg9" Jul 09 04:16:18.382025 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.381849 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b7903a28-a0b8-4567-ac5c-d18b25565947-installation-pull-secrets\") pod \"image-registry-679fd94dd5-pmxfd\" (UID: \"b7903a28-a0b8-4567-ac5c-d18b25565947\") " pod="openshift-image-registry/image-registry-679fd94dd5-pmxfd" Jul 09 04:16:18.382025 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.381881 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bk8q9\" (UniqueName: \"kubernetes.io/projected/1095557e-f542-4e1d-a462-0a024f80347e-kube-api-access-bk8q9\") pod \"kube-storage-version-migrator-operator-846bf668f7-8stqx\" (UID: \"1095557e-f542-4e1d-a462-0a024f80347e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-8stqx" Jul 09 04:16:18.382025 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.381970 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d6f634f8-361d-4b31-b9d4-9738cf65153b-cert\") pod \"ingress-canary-qthv7\" (UID: \"d6f634f8-361d-4b31-b9d4-9738cf65153b\") " pod="openshift-ingress-canary/ingress-canary-qthv7" Jul 09 04:16:18.382025 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.381993 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/48514bce-8ca3-41aa-b388-06e16f306fe1-metrics-tls\") pod \"dns-default-z8vt7\" (UID: \"48514bce-8ca3-41aa-b388-06e16f306fe1\") " pod="openshift-dns/dns-default-z8vt7" Jul 09 04:16:18.382025 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.382018 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e2fcabda-d114-4620-b0fa-9229d35ab0ee-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-cqrqz\" (UID: \"e2fcabda-d114-4620-b0fa-9229d35ab0ee\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-cqrqz" Jul 09 04:16:18.382262 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.382041 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3b55ef5-ee9e-47f4-85ae-08fec2d8b98e-service-ca-bundle\") pod \"router-default-7c74886bd5-pn4hl\" (UID: \"e3b55ef5-ee9e-47f4-85ae-08fec2d8b98e\") " pod="openshift-ingress/router-default-7c74886bd5-pn4hl" Jul 09 04:16:18.382262 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.382061 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/c805c009-9a98-4b40-9c74-9bed4868db61-snapshots\") pod \"insights-operator-5c847dcfc4-6sjg9\" (UID: \"c805c009-9a98-4b40-9c74-9bed4868db61\") " pod="openshift-insights/insights-operator-5c847dcfc4-6sjg9" Jul 09 04:16:18.382262 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.382078 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b7903a28-a0b8-4567-ac5c-d18b25565947-registry-tls\") pod \"image-registry-679fd94dd5-pmxfd\" (UID: \"b7903a28-a0b8-4567-ac5c-d18b25565947\") " pod="openshift-image-registry/image-registry-679fd94dd5-pmxfd" Jul 09 04:16:18.382262 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.382129 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/36b72c73-bb0b-4e08-95c8-7f1f263f46f4-installation-pull-secrets\") pod \"image-registry-5bb6bc998-jhp7f\" (UID: \"36b72c73-bb0b-4e08-95c8-7f1f263f46f4\") " pod="openshift-image-registry/image-registry-5bb6bc998-jhp7f" Jul 09 04:16:18.382262 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.382187 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b7903a28-a0b8-4567-ac5c-d18b25565947-bound-sa-token\") pod \"image-registry-679fd94dd5-pmxfd\" (UID: \"b7903a28-a0b8-4567-ac5c-d18b25565947\") " pod="openshift-image-registry/image-registry-679fd94dd5-pmxfd" Jul 09 04:16:18.382262 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.382215 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6mxf9\" (UniqueName: \"kubernetes.io/projected/b7903a28-a0b8-4567-ac5c-d18b25565947-kube-api-access-6mxf9\") pod \"image-registry-679fd94dd5-pmxfd\" (UID: \"b7903a28-a0b8-4567-ac5c-d18b25565947\") " pod="openshift-image-registry/image-registry-679fd94dd5-pmxfd" Jul 09 04:16:18.382262 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.382243 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c805c009-9a98-4b40-9c74-9bed4868db61-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-6sjg9\" (UID: \"c805c009-9a98-4b40-9c74-9bed4868db61\") " pod="openshift-insights/insights-operator-5c847dcfc4-6sjg9" Jul 09 04:16:18.382586 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.382270 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-llnpc\" (UniqueName: \"kubernetes.io/projected/0c091339-91c3-4263-a0fc-090d4f82216e-kube-api-access-llnpc\") pod \"network-check-source-989f8b8dc-v6h2j\" (UID: \"0c091339-91c3-4263-a0fc-090d4f82216e\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-v6h2j" Jul 09 04:16:18.382586 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.382296 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/916c78d9-c922-4dc4-8cc5-8b887e7999d3-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-5nq2g\" (UID: \"916c78d9-c922-4dc4-8cc5-8b887e7999d3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-5nq2g" Jul 09 04:16:18.382586 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.382333 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/be7de4e5-23b0-463b-8618-d0bb0a0895b6-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-d9vmv\" (UID: \"be7de4e5-23b0-463b-8618-d0bb0a0895b6\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-d9vmv" Jul 09 04:16:18.382586 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.382364 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/48514bce-8ca3-41aa-b388-06e16f306fe1-tmp-dir\") pod \"dns-default-z8vt7\" (UID: \"48514bce-8ca3-41aa-b388-06e16f306fe1\") " pod="openshift-dns/dns-default-z8vt7" Jul 09 04:16:18.382586 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.382388 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wpbt2\" (UniqueName: \"kubernetes.io/projected/48514bce-8ca3-41aa-b388-06e16f306fe1-kube-api-access-wpbt2\") pod \"dns-default-z8vt7\" (UID: \"48514bce-8ca3-41aa-b388-06e16f306fe1\") " pod="openshift-dns/dns-default-z8vt7" Jul 09 04:16:18.382586 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.382413 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/36b72c73-bb0b-4e08-95c8-7f1f263f46f4-trusted-ca\") pod \"image-registry-5bb6bc998-jhp7f\" (UID: \"36b72c73-bb0b-4e08-95c8-7f1f263f46f4\") " pod="openshift-image-registry/image-registry-5bb6bc998-jhp7f" Jul 09 04:16:18.382586 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.382437 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e2fcabda-d114-4620-b0fa-9229d35ab0ee-config\") pod \"service-ca-operator-5d46d9ffd4-cqrqz\" (UID: \"e2fcabda-d114-4620-b0fa-9229d35ab0ee\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-cqrqz" Jul 09 04:16:18.382586 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.382466 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/e3b55ef5-ee9e-47f4-85ae-08fec2d8b98e-default-certificate\") pod \"router-default-7c74886bd5-pn4hl\" (UID: \"e3b55ef5-ee9e-47f4-85ae-08fec2d8b98e\") " pod="openshift-ingress/router-default-7c74886bd5-pn4hl" Jul 09 04:16:18.382586 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.382500 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gtpq8\" (UniqueName: \"kubernetes.io/projected/36b72c73-bb0b-4e08-95c8-7f1f263f46f4-kube-api-access-gtpq8\") pod \"image-registry-5bb6bc998-jhp7f\" (UID: \"36b72c73-bb0b-4e08-95c8-7f1f263f46f4\") " pod="openshift-image-registry/image-registry-5bb6bc998-jhp7f" Jul 09 04:16:18.382586 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.382537 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b7903a28-a0b8-4567-ac5c-d18b25565947-image-registry-private-configuration\") pod \"image-registry-679fd94dd5-pmxfd\" (UID: \"b7903a28-a0b8-4567-ac5c-d18b25565947\") " pod="openshift-image-registry/image-registry-679fd94dd5-pmxfd" Jul 09 04:16:18.382586 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.382567 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b7903a28-a0b8-4567-ac5c-d18b25565947-registry-certificates\") pod \"image-registry-679fd94dd5-pmxfd\" (UID: \"b7903a28-a0b8-4567-ac5c-d18b25565947\") " pod="openshift-image-registry/image-registry-679fd94dd5-pmxfd" Jul 09 04:16:18.383118 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.382608 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r89w9\" (UniqueName: \"kubernetes.io/projected/a6976b04-fd52-4288-8d24-fb34cc801459-kube-api-access-r89w9\") pod \"console-operator-68b757fb67-lhzlx\" (UID: \"a6976b04-fd52-4288-8d24-fb34cc801459\") " pod="openshift-console-operator/console-operator-68b757fb67-lhzlx" Jul 09 04:16:18.383118 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.382639 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a6976b04-fd52-4288-8d24-fb34cc801459-trusted-ca\") pod \"console-operator-68b757fb67-lhzlx\" (UID: \"a6976b04-fd52-4288-8d24-fb34cc801459\") " pod="openshift-console-operator/console-operator-68b757fb67-lhzlx" Jul 09 04:16:18.383118 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.382675 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/48514bce-8ca3-41aa-b388-06e16f306fe1-config-volume\") pod \"dns-default-z8vt7\" (UID: \"48514bce-8ca3-41aa-b388-06e16f306fe1\") " pod="openshift-dns/dns-default-z8vt7" Jul 09 04:16:18.383118 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.382714 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c805c009-9a98-4b40-9c74-9bed4868db61-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-6sjg9\" (UID: \"c805c009-9a98-4b40-9c74-9bed4868db61\") " pod="openshift-insights/insights-operator-5c847dcfc4-6sjg9" Jul 09 04:16:18.383118 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.382738 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b7903a28-a0b8-4567-ac5c-d18b25565947-trusted-ca\") pod \"image-registry-679fd94dd5-pmxfd\" (UID: \"b7903a28-a0b8-4567-ac5c-d18b25565947\") " pod="openshift-image-registry/image-registry-679fd94dd5-pmxfd" Jul 09 04:16:18.383118 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.382777 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/36b72c73-bb0b-4e08-95c8-7f1f263f46f4-registry-tls\") pod \"image-registry-5bb6bc998-jhp7f\" (UID: \"36b72c73-bb0b-4e08-95c8-7f1f263f46f4\") " pod="openshift-image-registry/image-registry-5bb6bc998-jhp7f" Jul 09 04:16:18.383118 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.382808 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z2lwr\" (UniqueName: \"kubernetes.io/projected/8c838cc4-8ecb-4bc4-a0f0-5fe843d8c1ad-kube-api-access-z2lwr\") pod \"volume-data-source-validator-5d456fdbcd-ks9bq\" (UID: \"8c838cc4-8ecb-4bc4-a0f0-5fe843d8c1ad\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-ks9bq" Jul 09 04:16:18.383118 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.382832 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3b55ef5-ee9e-47f4-85ae-08fec2d8b98e-metrics-certs\") pod \"router-default-7c74886bd5-pn4hl\" (UID: \"e3b55ef5-ee9e-47f4-85ae-08fec2d8b98e\") " pod="openshift-ingress/router-default-7c74886bd5-pn4hl" Jul 09 04:16:18.383118 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.382880 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/36b72c73-bb0b-4e08-95c8-7f1f263f46f4-image-registry-private-configuration\") pod \"image-registry-5bb6bc998-jhp7f\" (UID: \"36b72c73-bb0b-4e08-95c8-7f1f263f46f4\") " pod="openshift-image-registry/image-registry-5bb6bc998-jhp7f" Jul 09 04:16:18.383118 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.382958 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b7903a28-a0b8-4567-ac5c-d18b25565947-ca-trust-extracted\") pod \"image-registry-679fd94dd5-pmxfd\" (UID: \"b7903a28-a0b8-4567-ac5c-d18b25565947\") " pod="openshift-image-registry/image-registry-679fd94dd5-pmxfd" Jul 09 04:16:18.383118 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.382989 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/e3b55ef5-ee9e-47f4-85ae-08fec2d8b98e-stats-auth\") pod \"router-default-7c74886bd5-pn4hl\" (UID: \"e3b55ef5-ee9e-47f4-85ae-08fec2d8b98e\") " pod="openshift-ingress/router-default-7c74886bd5-pn4hl" Jul 09 04:16:18.383118 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.383028 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a6976b04-fd52-4288-8d24-fb34cc801459-config\") pod \"console-operator-68b757fb67-lhzlx\" (UID: \"a6976b04-fd52-4288-8d24-fb34cc801459\") " pod="openshift-console-operator/console-operator-68b757fb67-lhzlx" Jul 09 04:16:18.383118 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.383054 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fpzw6\" (UniqueName: \"kubernetes.io/projected/c805c009-9a98-4b40-9c74-9bed4868db61-kube-api-access-fpzw6\") pod \"insights-operator-5c847dcfc4-6sjg9\" (UID: \"c805c009-9a98-4b40-9c74-9bed4868db61\") " pod="openshift-insights/insights-operator-5c847dcfc4-6sjg9" Jul 09 04:16:18.383118 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.383077 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/36b72c73-bb0b-4e08-95c8-7f1f263f46f4-registry-certificates\") pod \"image-registry-5bb6bc998-jhp7f\" (UID: \"36b72c73-bb0b-4e08-95c8-7f1f263f46f4\") " pod="openshift-image-registry/image-registry-5bb6bc998-jhp7f" Jul 09 04:16:18.383118 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.383100 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1095557e-f542-4e1d-a462-0a024f80347e-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-8stqx\" (UID: \"1095557e-f542-4e1d-a462-0a024f80347e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-8stqx" Jul 09 04:16:18.383798 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.383132 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/be7de4e5-23b0-463b-8618-d0bb0a0895b6-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-d9vmv\" (UID: \"be7de4e5-23b0-463b-8618-d0bb0a0895b6\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-d9vmv" Jul 09 04:16:18.383798 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.383160 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a6976b04-fd52-4288-8d24-fb34cc801459-serving-cert\") pod \"console-operator-68b757fb67-lhzlx\" (UID: \"a6976b04-fd52-4288-8d24-fb34cc801459\") " pod="openshift-console-operator/console-operator-68b757fb67-lhzlx" Jul 09 04:16:18.383798 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.383188 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zstn7\" (UniqueName: \"kubernetes.io/projected/916c78d9-c922-4dc4-8cc5-8b887e7999d3-kube-api-access-zstn7\") pod \"cluster-samples-operator-56fcf86bf-5nq2g\" (UID: \"916c78d9-c922-4dc4-8cc5-8b887e7999d3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-5nq2g" Jul 09 04:16:18.383798 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.383214 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n6rcq\" (UniqueName: \"kubernetes.io/projected/e3b55ef5-ee9e-47f4-85ae-08fec2d8b98e-kube-api-access-n6rcq\") pod \"router-default-7c74886bd5-pn4hl\" (UID: \"e3b55ef5-ee9e-47f4-85ae-08fec2d8b98e\") " pod="openshift-ingress/router-default-7c74886bd5-pn4hl" Jul 09 04:16:18.383798 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.383240 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1095557e-f542-4e1d-a462-0a024f80347e-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-8stqx\" (UID: \"1095557e-f542-4e1d-a462-0a024f80347e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-8stqx" Jul 09 04:16:18.383798 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.383268 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c805c009-9a98-4b40-9c74-9bed4868db61-tmp\") pod \"insights-operator-5c847dcfc4-6sjg9\" (UID: \"c805c009-9a98-4b40-9c74-9bed4868db61\") " pod="openshift-insights/insights-operator-5c847dcfc4-6sjg9" Jul 09 04:16:18.383798 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.383307 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/36b72c73-bb0b-4e08-95c8-7f1f263f46f4-ca-trust-extracted\") pod \"image-registry-5bb6bc998-jhp7f\" (UID: \"36b72c73-bb0b-4e08-95c8-7f1f263f46f4\") " pod="openshift-image-registry/image-registry-5bb6bc998-jhp7f" Jul 09 04:16:18.383798 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.383332 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/36b72c73-bb0b-4e08-95c8-7f1f263f46f4-bound-sa-token\") pod \"image-registry-5bb6bc998-jhp7f\" (UID: \"36b72c73-bb0b-4e08-95c8-7f1f263f46f4\") " pod="openshift-image-registry/image-registry-5bb6bc998-jhp7f" Jul 09 04:16:18.383798 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.383356 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2j8f\" (UniqueName: \"kubernetes.io/projected/d6f634f8-361d-4b31-b9d4-9738cf65153b-kube-api-access-j2j8f\") pod \"ingress-canary-qthv7\" (UID: \"d6f634f8-361d-4b31-b9d4-9738cf65153b\") " pod="openshift-ingress-canary/ingress-canary-qthv7" Jul 09 04:16:18.383798 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.383383 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzcth\" (UniqueName: \"kubernetes.io/projected/e2fcabda-d114-4620-b0fa-9229d35ab0ee-kube-api-access-kzcth\") pod \"service-ca-operator-5d46d9ffd4-cqrqz\" (UID: \"e2fcabda-d114-4620-b0fa-9229d35ab0ee\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-cqrqz" Jul 09 04:16:18.383798 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.383409 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n5kqk\" (UniqueName: \"kubernetes.io/projected/be7de4e5-23b0-463b-8618-d0bb0a0895b6-kube-api-access-n5kqk\") pod \"cluster-monitoring-operator-64786d9cbb-d9vmv\" (UID: \"be7de4e5-23b0-463b-8618-d0bb0a0895b6\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-d9vmv" Jul 09 04:16:18.484476 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.484441 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1095557e-f542-4e1d-a462-0a024f80347e-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-8stqx\" (UID: \"1095557e-f542-4e1d-a462-0a024f80347e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-8stqx" Jul 09 04:16:18.484476 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.484476 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c805c009-9a98-4b40-9c74-9bed4868db61-tmp\") pod \"insights-operator-5c847dcfc4-6sjg9\" (UID: \"c805c009-9a98-4b40-9c74-9bed4868db61\") " pod="openshift-insights/insights-operator-5c847dcfc4-6sjg9" Jul 09 04:16:18.484745 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.484506 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/36b72c73-bb0b-4e08-95c8-7f1f263f46f4-ca-trust-extracted\") pod \"image-registry-5bb6bc998-jhp7f\" (UID: \"36b72c73-bb0b-4e08-95c8-7f1f263f46f4\") " pod="openshift-image-registry/image-registry-5bb6bc998-jhp7f" Jul 09 04:16:18.484745 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.484522 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/36b72c73-bb0b-4e08-95c8-7f1f263f46f4-bound-sa-token\") pod \"image-registry-5bb6bc998-jhp7f\" (UID: \"36b72c73-bb0b-4e08-95c8-7f1f263f46f4\") " pod="openshift-image-registry/image-registry-5bb6bc998-jhp7f" Jul 09 04:16:18.484745 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.484639 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2j8f\" (UniqueName: \"kubernetes.io/projected/d6f634f8-361d-4b31-b9d4-9738cf65153b-kube-api-access-j2j8f\") pod \"ingress-canary-qthv7\" (UID: \"d6f634f8-361d-4b31-b9d4-9738cf65153b\") " pod="openshift-ingress-canary/ingress-canary-qthv7" Jul 09 04:16:18.484745 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.484683 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzcth\" (UniqueName: \"kubernetes.io/projected/e2fcabda-d114-4620-b0fa-9229d35ab0ee-kube-api-access-kzcth\") pod \"service-ca-operator-5d46d9ffd4-cqrqz\" (UID: \"e2fcabda-d114-4620-b0fa-9229d35ab0ee\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-cqrqz" Jul 09 04:16:18.484745 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.484715 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n5kqk\" (UniqueName: \"kubernetes.io/projected/be7de4e5-23b0-463b-8618-d0bb0a0895b6-kube-api-access-n5kqk\") pod \"cluster-monitoring-operator-64786d9cbb-d9vmv\" (UID: \"be7de4e5-23b0-463b-8618-d0bb0a0895b6\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-d9vmv" Jul 09 04:16:18.485030 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.484752 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c805c009-9a98-4b40-9c74-9bed4868db61-serving-cert\") pod \"insights-operator-5c847dcfc4-6sjg9\" (UID: \"c805c009-9a98-4b40-9c74-9bed4868db61\") " pod="openshift-insights/insights-operator-5c847dcfc4-6sjg9" Jul 09 04:16:18.485030 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.484777 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b7903a28-a0b8-4567-ac5c-d18b25565947-installation-pull-secrets\") pod \"image-registry-679fd94dd5-pmxfd\" (UID: \"b7903a28-a0b8-4567-ac5c-d18b25565947\") " pod="openshift-image-registry/image-registry-679fd94dd5-pmxfd" Jul 09 04:16:18.485030 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.484807 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bk8q9\" (UniqueName: \"kubernetes.io/projected/1095557e-f542-4e1d-a462-0a024f80347e-kube-api-access-bk8q9\") pod \"kube-storage-version-migrator-operator-846bf668f7-8stqx\" (UID: \"1095557e-f542-4e1d-a462-0a024f80347e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-8stqx" Jul 09 04:16:18.485030 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.484847 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d6f634f8-361d-4b31-b9d4-9738cf65153b-cert\") pod \"ingress-canary-qthv7\" (UID: \"d6f634f8-361d-4b31-b9d4-9738cf65153b\") " pod="openshift-ingress-canary/ingress-canary-qthv7" Jul 09 04:16:18.485030 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.484948 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/36b72c73-bb0b-4e08-95c8-7f1f263f46f4-ca-trust-extracted\") pod \"image-registry-5bb6bc998-jhp7f\" (UID: \"36b72c73-bb0b-4e08-95c8-7f1f263f46f4\") " pod="openshift-image-registry/image-registry-5bb6bc998-jhp7f" Jul 09 04:16:18.485030 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.485012 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/48514bce-8ca3-41aa-b388-06e16f306fe1-metrics-tls\") pod \"dns-default-z8vt7\" (UID: \"48514bce-8ca3-41aa-b388-06e16f306fe1\") " pod="openshift-dns/dns-default-z8vt7" Jul 09 04:16:18.485275 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.485048 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e2fcabda-d114-4620-b0fa-9229d35ab0ee-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-cqrqz\" (UID: \"e2fcabda-d114-4620-b0fa-9229d35ab0ee\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-cqrqz" Jul 09 04:16:18.485275 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.485077 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3b55ef5-ee9e-47f4-85ae-08fec2d8b98e-service-ca-bundle\") pod \"router-default-7c74886bd5-pn4hl\" (UID: \"e3b55ef5-ee9e-47f4-85ae-08fec2d8b98e\") " pod="openshift-ingress/router-default-7c74886bd5-pn4hl" Jul 09 04:16:18.485275 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.485101 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/c805c009-9a98-4b40-9c74-9bed4868db61-snapshots\") pod \"insights-operator-5c847dcfc4-6sjg9\" (UID: \"c805c009-9a98-4b40-9c74-9bed4868db61\") " pod="openshift-insights/insights-operator-5c847dcfc4-6sjg9" Jul 09 04:16:18.485275 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.485126 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b7903a28-a0b8-4567-ac5c-d18b25565947-registry-tls\") pod \"image-registry-679fd94dd5-pmxfd\" (UID: \"b7903a28-a0b8-4567-ac5c-d18b25565947\") " pod="openshift-image-registry/image-registry-679fd94dd5-pmxfd" Jul 09 04:16:18.485275 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.485154 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/36b72c73-bb0b-4e08-95c8-7f1f263f46f4-installation-pull-secrets\") pod \"image-registry-5bb6bc998-jhp7f\" (UID: \"36b72c73-bb0b-4e08-95c8-7f1f263f46f4\") " pod="openshift-image-registry/image-registry-5bb6bc998-jhp7f" Jul 09 04:16:18.485275 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.485163 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c805c009-9a98-4b40-9c74-9bed4868db61-tmp\") pod \"insights-operator-5c847dcfc4-6sjg9\" (UID: \"c805c009-9a98-4b40-9c74-9bed4868db61\") " pod="openshift-insights/insights-operator-5c847dcfc4-6sjg9" Jul 09 04:16:18.485275 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.485187 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1095557e-f542-4e1d-a462-0a024f80347e-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-8stqx\" (UID: \"1095557e-f542-4e1d-a462-0a024f80347e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-8stqx" Jul 09 04:16:18.485275 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.485191 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b7903a28-a0b8-4567-ac5c-d18b25565947-bound-sa-token\") pod \"image-registry-679fd94dd5-pmxfd\" (UID: \"b7903a28-a0b8-4567-ac5c-d18b25565947\") " pod="openshift-image-registry/image-registry-679fd94dd5-pmxfd" Jul 09 04:16:18.485275 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.485228 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6mxf9\" (UniqueName: \"kubernetes.io/projected/b7903a28-a0b8-4567-ac5c-d18b25565947-kube-api-access-6mxf9\") pod \"image-registry-679fd94dd5-pmxfd\" (UID: \"b7903a28-a0b8-4567-ac5c-d18b25565947\") " pod="openshift-image-registry/image-registry-679fd94dd5-pmxfd" Jul 09 04:16:18.485275 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.485257 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c805c009-9a98-4b40-9c74-9bed4868db61-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-6sjg9\" (UID: \"c805c009-9a98-4b40-9c74-9bed4868db61\") " pod="openshift-insights/insights-operator-5c847dcfc4-6sjg9" Jul 09 04:16:18.485692 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.485288 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-llnpc\" (UniqueName: \"kubernetes.io/projected/0c091339-91c3-4263-a0fc-090d4f82216e-kube-api-access-llnpc\") pod \"network-check-source-989f8b8dc-v6h2j\" (UID: \"0c091339-91c3-4263-a0fc-090d4f82216e\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-v6h2j" Jul 09 04:16:18.485692 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.485314 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/916c78d9-c922-4dc4-8cc5-8b887e7999d3-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-5nq2g\" (UID: \"916c78d9-c922-4dc4-8cc5-8b887e7999d3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-5nq2g" Jul 09 04:16:18.485692 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.485342 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/be7de4e5-23b0-463b-8618-d0bb0a0895b6-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-d9vmv\" (UID: \"be7de4e5-23b0-463b-8618-d0bb0a0895b6\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-d9vmv" Jul 09 04:16:18.485692 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.485369 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/48514bce-8ca3-41aa-b388-06e16f306fe1-tmp-dir\") pod \"dns-default-z8vt7\" (UID: \"48514bce-8ca3-41aa-b388-06e16f306fe1\") " pod="openshift-dns/dns-default-z8vt7" Jul 09 04:16:18.485692 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.485392 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wpbt2\" (UniqueName: \"kubernetes.io/projected/48514bce-8ca3-41aa-b388-06e16f306fe1-kube-api-access-wpbt2\") pod \"dns-default-z8vt7\" (UID: \"48514bce-8ca3-41aa-b388-06e16f306fe1\") " pod="openshift-dns/dns-default-z8vt7" Jul 09 04:16:18.485692 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.485412 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/36b72c73-bb0b-4e08-95c8-7f1f263f46f4-trusted-ca\") pod \"image-registry-5bb6bc998-jhp7f\" (UID: \"36b72c73-bb0b-4e08-95c8-7f1f263f46f4\") " pod="openshift-image-registry/image-registry-5bb6bc998-jhp7f" Jul 09 04:16:18.485692 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:18.485424 2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 04:16:18.485692 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.485435 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e2fcabda-d114-4620-b0fa-9229d35ab0ee-config\") pod \"service-ca-operator-5d46d9ffd4-cqrqz\" (UID: \"e2fcabda-d114-4620-b0fa-9229d35ab0ee\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-cqrqz" Jul 09 04:16:18.485692 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.485471 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/e3b55ef5-ee9e-47f4-85ae-08fec2d8b98e-default-certificate\") pod \"router-default-7c74886bd5-pn4hl\" (UID: \"e3b55ef5-ee9e-47f4-85ae-08fec2d8b98e\") " pod="openshift-ingress/router-default-7c74886bd5-pn4hl" Jul 09 04:16:18.485692 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.485500 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gtpq8\" (UniqueName: \"kubernetes.io/projected/36b72c73-bb0b-4e08-95c8-7f1f263f46f4-kube-api-access-gtpq8\") pod \"image-registry-5bb6bc998-jhp7f\" (UID: \"36b72c73-bb0b-4e08-95c8-7f1f263f46f4\") " pod="openshift-image-registry/image-registry-5bb6bc998-jhp7f" Jul 09 04:16:18.485692 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.485526 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b7903a28-a0b8-4567-ac5c-d18b25565947-image-registry-private-configuration\") pod \"image-registry-679fd94dd5-pmxfd\" (UID: \"b7903a28-a0b8-4567-ac5c-d18b25565947\") " pod="openshift-image-registry/image-registry-679fd94dd5-pmxfd" Jul 09 04:16:18.485692 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.485552 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b7903a28-a0b8-4567-ac5c-d18b25565947-registry-certificates\") pod \"image-registry-679fd94dd5-pmxfd\" (UID: \"b7903a28-a0b8-4567-ac5c-d18b25565947\") " pod="openshift-image-registry/image-registry-679fd94dd5-pmxfd" Jul 09 04:16:18.485692 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.485580 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r89w9\" (UniqueName: \"kubernetes.io/projected/a6976b04-fd52-4288-8d24-fb34cc801459-kube-api-access-r89w9\") pod \"console-operator-68b757fb67-lhzlx\" (UID: \"a6976b04-fd52-4288-8d24-fb34cc801459\") " pod="openshift-console-operator/console-operator-68b757fb67-lhzlx" Jul 09 04:16:18.485692 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.485603 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a6976b04-fd52-4288-8d24-fb34cc801459-trusted-ca\") pod \"console-operator-68b757fb67-lhzlx\" (UID: \"a6976b04-fd52-4288-8d24-fb34cc801459\") " pod="openshift-console-operator/console-operator-68b757fb67-lhzlx" Jul 09 04:16:18.485692 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.485638 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/48514bce-8ca3-41aa-b388-06e16f306fe1-config-volume\") pod \"dns-default-z8vt7\" (UID: \"48514bce-8ca3-41aa-b388-06e16f306fe1\") " pod="openshift-dns/dns-default-z8vt7" Jul 09 04:16:18.485692 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.485640 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/c805c009-9a98-4b40-9c74-9bed4868db61-snapshots\") pod \"insights-operator-5c847dcfc4-6sjg9\" (UID: \"c805c009-9a98-4b40-9c74-9bed4868db61\") " pod="openshift-insights/insights-operator-5c847dcfc4-6sjg9" Jul 09 04:16:18.485692 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.485665 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c805c009-9a98-4b40-9c74-9bed4868db61-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-6sjg9\" (UID: \"c805c009-9a98-4b40-9c74-9bed4868db61\") " pod="openshift-insights/insights-operator-5c847dcfc4-6sjg9" Jul 09 04:16:18.486407 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.485700 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b7903a28-a0b8-4567-ac5c-d18b25565947-trusted-ca\") pod \"image-registry-679fd94dd5-pmxfd\" (UID: \"b7903a28-a0b8-4567-ac5c-d18b25565947\") " pod="openshift-image-registry/image-registry-679fd94dd5-pmxfd" Jul 09 04:16:18.486407 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.485724 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/36b72c73-bb0b-4e08-95c8-7f1f263f46f4-registry-tls\") pod \"image-registry-5bb6bc998-jhp7f\" (UID: \"36b72c73-bb0b-4e08-95c8-7f1f263f46f4\") " pod="openshift-image-registry/image-registry-5bb6bc998-jhp7f" Jul 09 04:16:18.486407 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.485749 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2lwr\" (UniqueName: \"kubernetes.io/projected/8c838cc4-8ecb-4bc4-a0f0-5fe843d8c1ad-kube-api-access-z2lwr\") pod \"volume-data-source-validator-5d456fdbcd-ks9bq\" (UID: \"8c838cc4-8ecb-4bc4-a0f0-5fe843d8c1ad\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-ks9bq" Jul 09 04:16:18.486407 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.485772 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3b55ef5-ee9e-47f4-85ae-08fec2d8b98e-metrics-certs\") pod \"router-default-7c74886bd5-pn4hl\" (UID: \"e3b55ef5-ee9e-47f4-85ae-08fec2d8b98e\") " pod="openshift-ingress/router-default-7c74886bd5-pn4hl" Jul 09 04:16:18.486407 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.485800 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/36b72c73-bb0b-4e08-95c8-7f1f263f46f4-image-registry-private-configuration\") pod \"image-registry-5bb6bc998-jhp7f\" (UID: \"36b72c73-bb0b-4e08-95c8-7f1f263f46f4\") " pod="openshift-image-registry/image-registry-5bb6bc998-jhp7f" Jul 09 04:16:18.486407 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.485832 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b7903a28-a0b8-4567-ac5c-d18b25565947-ca-trust-extracted\") pod \"image-registry-679fd94dd5-pmxfd\" (UID: \"b7903a28-a0b8-4567-ac5c-d18b25565947\") " pod="openshift-image-registry/image-registry-679fd94dd5-pmxfd" Jul 09 04:16:18.486407 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.485854 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/e3b55ef5-ee9e-47f4-85ae-08fec2d8b98e-stats-auth\") pod \"router-default-7c74886bd5-pn4hl\" (UID: \"e3b55ef5-ee9e-47f4-85ae-08fec2d8b98e\") " pod="openshift-ingress/router-default-7c74886bd5-pn4hl" Jul 09 04:16:18.486407 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.485879 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a6976b04-fd52-4288-8d24-fb34cc801459-config\") pod \"console-operator-68b757fb67-lhzlx\" (UID: \"a6976b04-fd52-4288-8d24-fb34cc801459\") " pod="openshift-console-operator/console-operator-68b757fb67-lhzlx" Jul 09 04:16:18.486407 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.485902 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fpzw6\" (UniqueName: \"kubernetes.io/projected/c805c009-9a98-4b40-9c74-9bed4868db61-kube-api-access-fpzw6\") pod \"insights-operator-5c847dcfc4-6sjg9\" (UID: \"c805c009-9a98-4b40-9c74-9bed4868db61\") " pod="openshift-insights/insights-operator-5c847dcfc4-6sjg9" Jul 09 04:16:18.486407 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.485948 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/36b72c73-bb0b-4e08-95c8-7f1f263f46f4-registry-certificates\") pod \"image-registry-5bb6bc998-jhp7f\" (UID: \"36b72c73-bb0b-4e08-95c8-7f1f263f46f4\") " pod="openshift-image-registry/image-registry-5bb6bc998-jhp7f" Jul 09 04:16:18.486407 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.485971 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1095557e-f542-4e1d-a462-0a024f80347e-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-8stqx\" (UID: \"1095557e-f542-4e1d-a462-0a024f80347e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-8stqx" Jul 09 04:16:18.486407 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.485995 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/be7de4e5-23b0-463b-8618-d0bb0a0895b6-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-d9vmv\" (UID: \"be7de4e5-23b0-463b-8618-d0bb0a0895b6\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-d9vmv" Jul 09 04:16:18.486407 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.486026 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a6976b04-fd52-4288-8d24-fb34cc801459-serving-cert\") pod \"console-operator-68b757fb67-lhzlx\" (UID: \"a6976b04-fd52-4288-8d24-fb34cc801459\") " pod="openshift-console-operator/console-operator-68b757fb67-lhzlx" Jul 09 04:16:18.486407 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.486060 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zstn7\" (UniqueName: \"kubernetes.io/projected/916c78d9-c922-4dc4-8cc5-8b887e7999d3-kube-api-access-zstn7\") pod \"cluster-samples-operator-56fcf86bf-5nq2g\" (UID: \"916c78d9-c922-4dc4-8cc5-8b887e7999d3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-5nq2g" Jul 09 04:16:18.486407 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.486085 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n6rcq\" (UniqueName: \"kubernetes.io/projected/e3b55ef5-ee9e-47f4-85ae-08fec2d8b98e-kube-api-access-n6rcq\") pod \"router-default-7c74886bd5-pn4hl\" (UID: \"e3b55ef5-ee9e-47f4-85ae-08fec2d8b98e\") " pod="openshift-ingress/router-default-7c74886bd5-pn4hl" Jul 09 04:16:18.486407 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.486389 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c805c009-9a98-4b40-9c74-9bed4868db61-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-6sjg9\" (UID: \"c805c009-9a98-4b40-9c74-9bed4868db61\") " pod="openshift-insights/insights-operator-5c847dcfc4-6sjg9" Jul 09 04:16:18.488980 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:18.485441 2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-679fd94dd5-pmxfd: secret "image-registry-tls" not found Jul 09 04:16:18.488980 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:18.487617 2566 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 09 04:16:18.488980 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.487629 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a6976b04-fd52-4288-8d24-fb34cc801459-config\") pod \"console-operator-68b757fb67-lhzlx\" (UID: \"a6976b04-fd52-4288-8d24-fb34cc801459\") " pod="openshift-console-operator/console-operator-68b757fb67-lhzlx" Jul 09 04:16:18.488980 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.487687 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b7903a28-a0b8-4567-ac5c-d18b25565947-trusted-ca\") pod \"image-registry-679fd94dd5-pmxfd\" (UID: \"b7903a28-a0b8-4567-ac5c-d18b25565947\") " pod="openshift-image-registry/image-registry-679fd94dd5-pmxfd" Jul 09 04:16:18.488980 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:18.487765 2566 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 09 04:16:18.488980 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.488046 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/48514bce-8ca3-41aa-b388-06e16f306fe1-tmp-dir\") pod \"dns-default-z8vt7\" (UID: \"48514bce-8ca3-41aa-b388-06e16f306fe1\") " pod="openshift-dns/dns-default-z8vt7" Jul 09 04:16:18.488980 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:18.488080 2566 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 09 04:16:18.488980 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.488300 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b7903a28-a0b8-4567-ac5c-d18b25565947-registry-certificates\") pod \"image-registry-679fd94dd5-pmxfd\" (UID: \"b7903a28-a0b8-4567-ac5c-d18b25565947\") " pod="openshift-image-registry/image-registry-679fd94dd5-pmxfd" Jul 09 04:16:18.489455 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.489172 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a6976b04-fd52-4288-8d24-fb34cc801459-trusted-ca\") pod \"console-operator-68b757fb67-lhzlx\" (UID: \"a6976b04-fd52-4288-8d24-fb34cc801459\") " pod="openshift-console-operator/console-operator-68b757fb67-lhzlx" Jul 09 04:16:18.490864 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.487096 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c805c009-9a98-4b40-9c74-9bed4868db61-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-6sjg9\" (UID: \"c805c009-9a98-4b40-9c74-9bed4868db61\") " pod="openshift-insights/insights-operator-5c847dcfc4-6sjg9" Jul 09 04:16:18.490864 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:18.486419 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e3b55ef5-ee9e-47f4-85ae-08fec2d8b98e-service-ca-bundle podName:e3b55ef5-ee9e-47f4-85ae-08fec2d8b98e nodeName:}" failed. No retries permitted until 2026-07-09 04:16:18.986401764 +0000 UTC m=+36.603299979 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e3b55ef5-ee9e-47f4-85ae-08fec2d8b98e-service-ca-bundle") pod "router-default-7c74886bd5-pn4hl" (UID: "e3b55ef5-ee9e-47f4-85ae-08fec2d8b98e") : configmap references non-existent config key: service-ca.crt Jul 09 04:16:18.490864 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:18.489707 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b7903a28-a0b8-4567-ac5c-d18b25565947-registry-tls podName:b7903a28-a0b8-4567-ac5c-d18b25565947 nodeName:}" failed. No retries permitted until 2026-07-09 04:16:18.989681198 +0000 UTC m=+36.606579410 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b7903a28-a0b8-4567-ac5c-d18b25565947-registry-tls") pod "image-registry-679fd94dd5-pmxfd" (UID: "b7903a28-a0b8-4567-ac5c-d18b25565947") : secret "image-registry-tls" not found Jul 09 04:16:18.490864 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:18.489732 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/916c78d9-c922-4dc4-8cc5-8b887e7999d3-samples-operator-tls podName:916c78d9-c922-4dc4-8cc5-8b887e7999d3 nodeName:}" failed. No retries permitted until 2026-07-09 04:16:18.989718558 +0000 UTC m=+36.606616792 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/916c78d9-c922-4dc4-8cc5-8b887e7999d3-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-5nq2g" (UID: "916c78d9-c922-4dc4-8cc5-8b887e7999d3") : secret "samples-operator-tls" not found Jul 09 04:16:18.490864 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:18.489759 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be7de4e5-23b0-463b-8618-d0bb0a0895b6-cluster-monitoring-operator-tls podName:be7de4e5-23b0-463b-8618-d0bb0a0895b6 nodeName:}" failed. No retries permitted until 2026-07-09 04:16:18.989748111 +0000 UTC m=+36.606646313 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/be7de4e5-23b0-463b-8618-d0bb0a0895b6-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-d9vmv" (UID: "be7de4e5-23b0-463b-8618-d0bb0a0895b6") : secret "cluster-monitoring-operator-tls" not found Jul 09 04:16:18.490864 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:18.489778 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3b55ef5-ee9e-47f4-85ae-08fec2d8b98e-metrics-certs podName:e3b55ef5-ee9e-47f4-85ae-08fec2d8b98e nodeName:}" failed. No retries permitted until 2026-07-09 04:16:18.989768419 +0000 UTC m=+36.606666615 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e3b55ef5-ee9e-47f4-85ae-08fec2d8b98e-metrics-certs") pod "router-default-7c74886bd5-pn4hl" (UID: "e3b55ef5-ee9e-47f4-85ae-08fec2d8b98e") : secret "router-metrics-certs-default" not found Jul 09 04:16:18.490864 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:18.486793 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 04:16:18.490864 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:18.489831 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/48514bce-8ca3-41aa-b388-06e16f306fe1-metrics-tls podName:48514bce-8ca3-41aa-b388-06e16f306fe1 nodeName:}" failed. No retries permitted until 2026-07-09 04:16:18.989821995 +0000 UTC m=+36.606720210 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/48514bce-8ca3-41aa-b388-06e16f306fe1-metrics-tls") pod "dns-default-z8vt7" (UID: "48514bce-8ca3-41aa-b388-06e16f306fe1") : secret "dns-default-metrics-tls" not found Jul 09 04:16:18.490864 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.489967 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/48514bce-8ca3-41aa-b388-06e16f306fe1-config-volume\") pod \"dns-default-z8vt7\" (UID: \"48514bce-8ca3-41aa-b388-06e16f306fe1\") " pod="openshift-dns/dns-default-z8vt7" Jul 09 04:16:18.490864 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.490251 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e2fcabda-d114-4620-b0fa-9229d35ab0ee-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-cqrqz\" (UID: \"e2fcabda-d114-4620-b0fa-9229d35ab0ee\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-cqrqz" Jul 09 04:16:18.490864 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.490302 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e2fcabda-d114-4620-b0fa-9229d35ab0ee-config\") pod \"service-ca-operator-5d46d9ffd4-cqrqz\" (UID: \"e2fcabda-d114-4620-b0fa-9229d35ab0ee\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-cqrqz" Jul 09 04:16:18.490864 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.490428 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d6f634f8-361d-4b31-b9d4-9738cf65153b-cert\") pod \"ingress-canary-qthv7\" (UID: \"d6f634f8-361d-4b31-b9d4-9738cf65153b\") " pod="openshift-ingress-canary/ingress-canary-qthv7" Jul 09 04:16:18.490864 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.490529 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/e3b55ef5-ee9e-47f4-85ae-08fec2d8b98e-default-certificate\") pod \"router-default-7c74886bd5-pn4hl\" (UID: \"e3b55ef5-ee9e-47f4-85ae-08fec2d8b98e\") " pod="openshift-ingress/router-default-7c74886bd5-pn4hl" Jul 09 04:16:18.491727 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.490602 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b7903a28-a0b8-4567-ac5c-d18b25565947-ca-trust-extracted\") pod \"image-registry-679fd94dd5-pmxfd\" (UID: \"b7903a28-a0b8-4567-ac5c-d18b25565947\") " pod="openshift-image-registry/image-registry-679fd94dd5-pmxfd" Jul 09 04:16:18.491727 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:18.490697 2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 04:16:18.491727 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:18.490713 2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bb6bc998-jhp7f: secret "image-registry-tls" not found Jul 09 04:16:18.491727 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:18.490758 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/36b72c73-bb0b-4e08-95c8-7f1f263f46f4-registry-tls podName:36b72c73-bb0b-4e08-95c8-7f1f263f46f4 nodeName:}" failed. No retries permitted until 2026-07-09 04:16:18.990740956 +0000 UTC m=+36.607639174 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/36b72c73-bb0b-4e08-95c8-7f1f263f46f4-registry-tls") pod "image-registry-5bb6bc998-jhp7f" (UID: "36b72c73-bb0b-4e08-95c8-7f1f263f46f4") : secret "image-registry-tls" not found Jul 09 04:16:18.491727 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.491022 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/be7de4e5-23b0-463b-8618-d0bb0a0895b6-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-d9vmv\" (UID: \"be7de4e5-23b0-463b-8618-d0bb0a0895b6\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-d9vmv" Jul 09 04:16:18.491727 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.491069 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/36b72c73-bb0b-4e08-95c8-7f1f263f46f4-registry-certificates\") pod \"image-registry-5bb6bc998-jhp7f\" (UID: \"36b72c73-bb0b-4e08-95c8-7f1f263f46f4\") " pod="openshift-image-registry/image-registry-5bb6bc998-jhp7f" Jul 09 04:16:18.491727 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.491244 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b7903a28-a0b8-4567-ac5c-d18b25565947-installation-pull-secrets\") pod \"image-registry-679fd94dd5-pmxfd\" (UID: \"b7903a28-a0b8-4567-ac5c-d18b25565947\") " pod="openshift-image-registry/image-registry-679fd94dd5-pmxfd" Jul 09 04:16:18.492749 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.492721 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/36b72c73-bb0b-4e08-95c8-7f1f263f46f4-trusted-ca\") pod \"image-registry-5bb6bc998-jhp7f\" (UID: \"36b72c73-bb0b-4e08-95c8-7f1f263f46f4\") " pod="openshift-image-registry/image-registry-5bb6bc998-jhp7f" Jul 09 04:16:18.492966 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.492931 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/36b72c73-bb0b-4e08-95c8-7f1f263f46f4-installation-pull-secrets\") pod \"image-registry-5bb6bc998-jhp7f\" (UID: \"36b72c73-bb0b-4e08-95c8-7f1f263f46f4\") " pod="openshift-image-registry/image-registry-5bb6bc998-jhp7f" Jul 09 04:16:18.493253 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.493207 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c805c009-9a98-4b40-9c74-9bed4868db61-serving-cert\") pod \"insights-operator-5c847dcfc4-6sjg9\" (UID: \"c805c009-9a98-4b40-9c74-9bed4868db61\") " pod="openshift-insights/insights-operator-5c847dcfc4-6sjg9" Jul 09 04:16:18.493731 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.493711 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/36b72c73-bb0b-4e08-95c8-7f1f263f46f4-image-registry-private-configuration\") pod \"image-registry-5bb6bc998-jhp7f\" (UID: \"36b72c73-bb0b-4e08-95c8-7f1f263f46f4\") " pod="openshift-image-registry/image-registry-5bb6bc998-jhp7f" Jul 09 04:16:18.497156 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.497074 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bk8q9\" (UniqueName: \"kubernetes.io/projected/1095557e-f542-4e1d-a462-0a024f80347e-kube-api-access-bk8q9\") pod \"kube-storage-version-migrator-operator-846bf668f7-8stqx\" (UID: \"1095557e-f542-4e1d-a462-0a024f80347e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-8stqx" Jul 09 04:16:18.498617 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.497565 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/36b72c73-bb0b-4e08-95c8-7f1f263f46f4-bound-sa-token\") pod \"image-registry-5bb6bc998-jhp7f\" (UID: \"36b72c73-bb0b-4e08-95c8-7f1f263f46f4\") " pod="openshift-image-registry/image-registry-5bb6bc998-jhp7f" Jul 09 04:16:18.498617 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.497786 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b7903a28-a0b8-4567-ac5c-d18b25565947-image-registry-private-configuration\") pod \"image-registry-679fd94dd5-pmxfd\" (UID: \"b7903a28-a0b8-4567-ac5c-d18b25565947\") " pod="openshift-image-registry/image-registry-679fd94dd5-pmxfd" Jul 09 04:16:18.498617 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.497842 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1095557e-f542-4e1d-a462-0a024f80347e-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-8stqx\" (UID: \"1095557e-f542-4e1d-a462-0a024f80347e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-8stqx" Jul 09 04:16:18.498617 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.498214 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b7903a28-a0b8-4567-ac5c-d18b25565947-bound-sa-token\") pod \"image-registry-679fd94dd5-pmxfd\" (UID: \"b7903a28-a0b8-4567-ac5c-d18b25565947\") " pod="openshift-image-registry/image-registry-679fd94dd5-pmxfd" Jul 09 04:16:18.498617 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.498296 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n6rcq\" (UniqueName: \"kubernetes.io/projected/e3b55ef5-ee9e-47f4-85ae-08fec2d8b98e-kube-api-access-n6rcq\") pod \"router-default-7c74886bd5-pn4hl\" (UID: \"e3b55ef5-ee9e-47f4-85ae-08fec2d8b98e\") " pod="openshift-ingress/router-default-7c74886bd5-pn4hl" Jul 09 04:16:18.498617 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.498405 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2j8f\" (UniqueName: \"kubernetes.io/projected/d6f634f8-361d-4b31-b9d4-9738cf65153b-kube-api-access-j2j8f\") pod \"ingress-canary-qthv7\" (UID: \"d6f634f8-361d-4b31-b9d4-9738cf65153b\") " pod="openshift-ingress-canary/ingress-canary-qthv7" Jul 09 04:16:18.498617 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.498522 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a6976b04-fd52-4288-8d24-fb34cc801459-serving-cert\") pod \"console-operator-68b757fb67-lhzlx\" (UID: \"a6976b04-fd52-4288-8d24-fb34cc801459\") " pod="openshift-console-operator/console-operator-68b757fb67-lhzlx" Jul 09 04:16:18.498617 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.498543 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzcth\" (UniqueName: \"kubernetes.io/projected/e2fcabda-d114-4620-b0fa-9229d35ab0ee-kube-api-access-kzcth\") pod \"service-ca-operator-5d46d9ffd4-cqrqz\" (UID: \"e2fcabda-d114-4620-b0fa-9229d35ab0ee\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-cqrqz" Jul 09 04:16:18.499080 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.498838 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gtpq8\" (UniqueName: \"kubernetes.io/projected/36b72c73-bb0b-4e08-95c8-7f1f263f46f4-kube-api-access-gtpq8\") pod \"image-registry-5bb6bc998-jhp7f\" (UID: \"36b72c73-bb0b-4e08-95c8-7f1f263f46f4\") " pod="openshift-image-registry/image-registry-5bb6bc998-jhp7f" Jul 09 04:16:18.499080 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.498966 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-llnpc\" (UniqueName: \"kubernetes.io/projected/0c091339-91c3-4263-a0fc-090d4f82216e-kube-api-access-llnpc\") pod \"network-check-source-989f8b8dc-v6h2j\" (UID: \"0c091339-91c3-4263-a0fc-090d4f82216e\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-v6h2j" Jul 09 04:16:18.499178 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.499142 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z2lwr\" (UniqueName: \"kubernetes.io/projected/8c838cc4-8ecb-4bc4-a0f0-5fe843d8c1ad-kube-api-access-z2lwr\") pod \"volume-data-source-validator-5d456fdbcd-ks9bq\" (UID: \"8c838cc4-8ecb-4bc4-a0f0-5fe843d8c1ad\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-ks9bq" Jul 09 04:16:18.499321 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.499266 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/e3b55ef5-ee9e-47f4-85ae-08fec2d8b98e-stats-auth\") pod \"router-default-7c74886bd5-pn4hl\" (UID: \"e3b55ef5-ee9e-47f4-85ae-08fec2d8b98e\") " pod="openshift-ingress/router-default-7c74886bd5-pn4hl" Jul 09 04:16:18.500308 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.499811 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zstn7\" (UniqueName: \"kubernetes.io/projected/916c78d9-c922-4dc4-8cc5-8b887e7999d3-kube-api-access-zstn7\") pod \"cluster-samples-operator-56fcf86bf-5nq2g\" (UID: \"916c78d9-c922-4dc4-8cc5-8b887e7999d3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-5nq2g" Jul 09 04:16:18.500308 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.499982 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r89w9\" (UniqueName: \"kubernetes.io/projected/a6976b04-fd52-4288-8d24-fb34cc801459-kube-api-access-r89w9\") pod \"console-operator-68b757fb67-lhzlx\" (UID: \"a6976b04-fd52-4288-8d24-fb34cc801459\") " pod="openshift-console-operator/console-operator-68b757fb67-lhzlx" Jul 09 04:16:18.500308 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.500265 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6mxf9\" (UniqueName: \"kubernetes.io/projected/b7903a28-a0b8-4567-ac5c-d18b25565947-kube-api-access-6mxf9\") pod \"image-registry-679fd94dd5-pmxfd\" (UID: \"b7903a28-a0b8-4567-ac5c-d18b25565947\") " pod="openshift-image-registry/image-registry-679fd94dd5-pmxfd" Jul 09 04:16:18.501041 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.500989 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wpbt2\" (UniqueName: \"kubernetes.io/projected/48514bce-8ca3-41aa-b388-06e16f306fe1-kube-api-access-wpbt2\") pod \"dns-default-z8vt7\" (UID: \"48514bce-8ca3-41aa-b388-06e16f306fe1\") " pod="openshift-dns/dns-default-z8vt7" Jul 09 04:16:18.501443 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.501420 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n5kqk\" (UniqueName: \"kubernetes.io/projected/be7de4e5-23b0-463b-8618-d0bb0a0895b6-kube-api-access-n5kqk\") pod \"cluster-monitoring-operator-64786d9cbb-d9vmv\" (UID: \"be7de4e5-23b0-463b-8618-d0bb0a0895b6\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-d9vmv" Jul 09 04:16:18.501646 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.501631 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fpzw6\" (UniqueName: \"kubernetes.io/projected/c805c009-9a98-4b40-9c74-9bed4868db61-kube-api-access-fpzw6\") pod \"insights-operator-5c847dcfc4-6sjg9\" (UID: \"c805c009-9a98-4b40-9c74-9bed4868db61\") " pod="openshift-insights/insights-operator-5c847dcfc4-6sjg9" Jul 09 04:16:18.569185 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.569152 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-6sjg9" Jul 09 04:16:18.577208 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.577174 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-cqrqz" Jul 09 04:16:18.596595 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.596558 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-ks9bq" Jul 09 04:16:18.629216 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.629175 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-v6h2j" Jul 09 04:16:18.634778 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.634754 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-lhzlx" Jul 09 04:16:18.642572 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.642542 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-8stqx" Jul 09 04:16:18.674235 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.674062 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-qthv7" Jul 09 04:16:18.784152 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.783615 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-6sjg9"] Jul 09 04:16:18.797611 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:16:18.797564 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc805c009_9a98_4b40_9c74_9bed4868db61.slice/crio-12a5051db1fce9159fd552bf88f33217dbba69b47faf475baecb5b930e47ef14 WatchSource:0}: Error finding container 12a5051db1fce9159fd552bf88f33217dbba69b47faf475baecb5b930e47ef14: Status 404 returned error can't find the container with id 12a5051db1fce9159fd552bf88f33217dbba69b47faf475baecb5b930e47ef14 Jul 09 04:16:18.853711 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.853672 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-cqrqz"] Jul 09 04:16:18.877491 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.877458 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-v6h2j"] Jul 09 04:16:18.882703 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.882536 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-ks9bq"] Jul 09 04:16:18.906135 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.906094 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fgq98" Jul 09 04:16:18.909356 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.909329 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-9gr88\"" Jul 09 04:16:18.913717 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.913632 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-lhzlx"] Jul 09 04:16:18.918168 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.918141 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-8stqx"] Jul 09 04:16:18.918461 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:16:18.918431 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6976b04_fd52_4288_8d24_fb34cc801459.slice/crio-cfd482c3926cc45d160618db6e97488ce7a694c33384e5d98dbdb35ad66d73f7 WatchSource:0}: Error finding container cfd482c3926cc45d160618db6e97488ce7a694c33384e5d98dbdb35ad66d73f7: Status 404 returned error can't find the container with id cfd482c3926cc45d160618db6e97488ce7a694c33384e5d98dbdb35ad66d73f7 Jul 09 04:16:18.923355 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:16:18.923289 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1095557e_f542_4e1d_a462_0a024f80347e.slice/crio-2fc0c2ef8c76690a67110b36e2064d340a9ec6dc6df8945519371ebd98cc9183 WatchSource:0}: Error finding container 2fc0c2ef8c76690a67110b36e2064d340a9ec6dc6df8945519371ebd98cc9183: Status 404 returned error can't find the container with id 2fc0c2ef8c76690a67110b36e2064d340a9ec6dc6df8945519371ebd98cc9183 Jul 09 04:16:18.928285 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.928257 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-qthv7"] Jul 09 04:16:18.931769 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:16:18.931743 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6f634f8_361d_4b31_b9d4_9738cf65153b.slice/crio-64640529a68172ba89ce9ad4e886661e4bbba4103de88c52940c1c57975dcffc WatchSource:0}: Error finding container 64640529a68172ba89ce9ad4e886661e4bbba4103de88c52940c1c57975dcffc: Status 404 returned error can't find the container with id 64640529a68172ba89ce9ad4e886661e4bbba4103de88c52940c1c57975dcffc Jul 09 04:16:18.994567 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.994509 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3b55ef5-ee9e-47f4-85ae-08fec2d8b98e-metrics-certs\") pod \"router-default-7c74886bd5-pn4hl\" (UID: \"e3b55ef5-ee9e-47f4-85ae-08fec2d8b98e\") " pod="openshift-ingress/router-default-7c74886bd5-pn4hl" Jul 09 04:16:18.994733 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.994666 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/48514bce-8ca3-41aa-b388-06e16f306fe1-metrics-tls\") pod \"dns-default-z8vt7\" (UID: \"48514bce-8ca3-41aa-b388-06e16f306fe1\") " pod="openshift-dns/dns-default-z8vt7" Jul 09 04:16:18.994733 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:18.994682 2566 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 09 04:16:18.994733 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.994692 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3b55ef5-ee9e-47f4-85ae-08fec2d8b98e-service-ca-bundle\") pod \"router-default-7c74886bd5-pn4hl\" (UID: \"e3b55ef5-ee9e-47f4-85ae-08fec2d8b98e\") " pod="openshift-ingress/router-default-7c74886bd5-pn4hl" Jul 09 04:16:18.994733 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.994714 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b7903a28-a0b8-4567-ac5c-d18b25565947-registry-tls\") pod \"image-registry-679fd94dd5-pmxfd\" (UID: \"b7903a28-a0b8-4567-ac5c-d18b25565947\") " pod="openshift-image-registry/image-registry-679fd94dd5-pmxfd" Jul 09 04:16:18.994903 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:18.994756 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3b55ef5-ee9e-47f4-85ae-08fec2d8b98e-metrics-certs podName:e3b55ef5-ee9e-47f4-85ae-08fec2d8b98e nodeName:}" failed. No retries permitted until 2026-07-09 04:16:19.994735676 +0000 UTC m=+37.611633892 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e3b55ef5-ee9e-47f4-85ae-08fec2d8b98e-metrics-certs") pod "router-default-7c74886bd5-pn4hl" (UID: "e3b55ef5-ee9e-47f4-85ae-08fec2d8b98e") : secret "router-metrics-certs-default" not found Jul 09 04:16:18.994903 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:18.994776 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 04:16:18.994903 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.994805 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/916c78d9-c922-4dc4-8cc5-8b887e7999d3-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-5nq2g\" (UID: \"916c78d9-c922-4dc4-8cc5-8b887e7999d3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-5nq2g" Jul 09 04:16:18.994903 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:18.994815 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/48514bce-8ca3-41aa-b388-06e16f306fe1-metrics-tls podName:48514bce-8ca3-41aa-b388-06e16f306fe1 nodeName:}" failed. No retries permitted until 2026-07-09 04:16:19.994802539 +0000 UTC m=+37.611700738 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/48514bce-8ca3-41aa-b388-06e16f306fe1-metrics-tls") pod "dns-default-z8vt7" (UID: "48514bce-8ca3-41aa-b388-06e16f306fe1") : secret "dns-default-metrics-tls" not found Jul 09 04:16:18.994903 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:18.994816 2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 04:16:18.994903 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:18.994831 2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-679fd94dd5-pmxfd: secret "image-registry-tls" not found Jul 09 04:16:18.994903 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.994848 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/be7de4e5-23b0-463b-8618-d0bb0a0895b6-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-d9vmv\" (UID: \"be7de4e5-23b0-463b-8618-d0bb0a0895b6\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-d9vmv" Jul 09 04:16:18.994903 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:18.994862 2566 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 09 04:16:18.994903 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:18.994869 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b7903a28-a0b8-4567-ac5c-d18b25565947-registry-tls podName:b7903a28-a0b8-4567-ac5c-d18b25565947 nodeName:}" failed. No retries permitted until 2026-07-09 04:16:19.994858018 +0000 UTC m=+37.611756214 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b7903a28-a0b8-4567-ac5c-d18b25565947-registry-tls") pod "image-registry-679fd94dd5-pmxfd" (UID: "b7903a28-a0b8-4567-ac5c-d18b25565947") : secret "image-registry-tls" not found Jul 09 04:16:18.994903 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:18.994893 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/916c78d9-c922-4dc4-8cc5-8b887e7999d3-samples-operator-tls podName:916c78d9-c922-4dc4-8cc5-8b887e7999d3 nodeName:}" failed. No retries permitted until 2026-07-09 04:16:19.994883072 +0000 UTC m=+37.611781272 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/916c78d9-c922-4dc4-8cc5-8b887e7999d3-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-5nq2g" (UID: "916c78d9-c922-4dc4-8cc5-8b887e7999d3") : secret "samples-operator-tls" not found Jul 09 04:16:18.994903 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:18.994905 2566 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 09 04:16:18.995327 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:18.994956 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be7de4e5-23b0-463b-8618-d0bb0a0895b6-cluster-monitoring-operator-tls podName:be7de4e5-23b0-463b-8618-d0bb0a0895b6 nodeName:}" failed. No retries permitted until 2026-07-09 04:16:19.994945865 +0000 UTC m=+37.611844064 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/be7de4e5-23b0-463b-8618-d0bb0a0895b6-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-d9vmv" (UID: "be7de4e5-23b0-463b-8618-d0bb0a0895b6") : secret "cluster-monitoring-operator-tls" not found Jul 09 04:16:18.995327 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:18.994972 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/36b72c73-bb0b-4e08-95c8-7f1f263f46f4-registry-tls\") pod \"image-registry-5bb6bc998-jhp7f\" (UID: \"36b72c73-bb0b-4e08-95c8-7f1f263f46f4\") " pod="openshift-image-registry/image-registry-5bb6bc998-jhp7f" Jul 09 04:16:18.995327 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:18.995016 2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 04:16:18.995327 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:18.995021 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e3b55ef5-ee9e-47f4-85ae-08fec2d8b98e-service-ca-bundle podName:e3b55ef5-ee9e-47f4-85ae-08fec2d8b98e nodeName:}" failed. No retries permitted until 2026-07-09 04:16:19.995012737 +0000 UTC m=+37.611910941 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e3b55ef5-ee9e-47f4-85ae-08fec2d8b98e-service-ca-bundle") pod "router-default-7c74886bd5-pn4hl" (UID: "e3b55ef5-ee9e-47f4-85ae-08fec2d8b98e") : configmap references non-existent config key: service-ca.crt Jul 09 04:16:18.995327 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:18.995030 2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bb6bc998-jhp7f: secret "image-registry-tls" not found Jul 09 04:16:18.995327 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:18.995067 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/36b72c73-bb0b-4e08-95c8-7f1f263f46f4-registry-tls podName:36b72c73-bb0b-4e08-95c8-7f1f263f46f4 nodeName:}" failed. No retries permitted until 2026-07-09 04:16:19.995054462 +0000 UTC m=+37.611952693 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/36b72c73-bb0b-4e08-95c8-7f1f263f46f4-registry-tls") pod "image-registry-5bb6bc998-jhp7f" (UID: "36b72c73-bb0b-4e08-95c8-7f1f263f46f4") : secret "image-registry-tls" not found Jul 09 04:16:19.073346 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:19.073245 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-cqrqz" event={"ID":"e2fcabda-d114-4620-b0fa-9229d35ab0ee","Type":"ContainerStarted","Data":"e082fc4275f7d5d50645f075626007d38a011675551bb5a286f6fba8271b2a12"} Jul 09 04:16:19.074452 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:19.074416 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-qthv7" event={"ID":"d6f634f8-361d-4b31-b9d4-9738cf65153b","Type":"ContainerStarted","Data":"64640529a68172ba89ce9ad4e886661e4bbba4103de88c52940c1c57975dcffc"} Jul 09 04:16:19.075543 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:19.075519 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-lhzlx" event={"ID":"a6976b04-fd52-4288-8d24-fb34cc801459","Type":"ContainerStarted","Data":"cfd482c3926cc45d160618db6e97488ce7a694c33384e5d98dbdb35ad66d73f7"} Jul 09 04:16:19.076608 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:19.076589 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-v6h2j" event={"ID":"0c091339-91c3-4263-a0fc-090d4f82216e","Type":"ContainerStarted","Data":"d3e10672007121da293db0e33386d0c176122f9555b15f979edb14bc0dfefac4"} Jul 09 04:16:19.077621 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:19.077603 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-ks9bq" event={"ID":"8c838cc4-8ecb-4bc4-a0f0-5fe843d8c1ad","Type":"ContainerStarted","Data":"9528eaef712b48c56266a7bdc976132abbafff00f7c5a86e3ff1eba5e141abe2"} Jul 09 04:16:19.078649 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:19.078629 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-6sjg9" event={"ID":"c805c009-9a98-4b40-9c74-9bed4868db61","Type":"ContainerStarted","Data":"12a5051db1fce9159fd552bf88f33217dbba69b47faf475baecb5b930e47ef14"} Jul 09 04:16:19.079580 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:19.079559 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-8stqx" event={"ID":"1095557e-f542-4e1d-a462-0a024f80347e","Type":"ContainerStarted","Data":"2fc0c2ef8c76690a67110b36e2064d340a9ec6dc6df8945519371ebd98cc9183"} Jul 09 04:16:19.906256 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:19.906215 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mvrbd" Jul 09 04:16:19.907191 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:19.906387 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jqcts" Jul 09 04:16:19.909470 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:19.909232 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 09 04:16:19.911882 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:19.911858 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 09 04:16:19.912500 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:19.912148 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-q46hf\"" Jul 09 04:16:20.007154 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:20.007112 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/36b72c73-bb0b-4e08-95c8-7f1f263f46f4-registry-tls\") pod \"image-registry-5bb6bc998-jhp7f\" (UID: \"36b72c73-bb0b-4e08-95c8-7f1f263f46f4\") " pod="openshift-image-registry/image-registry-5bb6bc998-jhp7f" Jul 09 04:16:20.007436 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:20.007171 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3b55ef5-ee9e-47f4-85ae-08fec2d8b98e-metrics-certs\") pod \"router-default-7c74886bd5-pn4hl\" (UID: \"e3b55ef5-ee9e-47f4-85ae-08fec2d8b98e\") " pod="openshift-ingress/router-default-7c74886bd5-pn4hl" Jul 09 04:16:20.007436 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:20.007304 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/48514bce-8ca3-41aa-b388-06e16f306fe1-metrics-tls\") pod \"dns-default-z8vt7\" (UID: \"48514bce-8ca3-41aa-b388-06e16f306fe1\") " pod="openshift-dns/dns-default-z8vt7" Jul 09 04:16:20.007436 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:20.007337 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3b55ef5-ee9e-47f4-85ae-08fec2d8b98e-service-ca-bundle\") pod \"router-default-7c74886bd5-pn4hl\" (UID: \"e3b55ef5-ee9e-47f4-85ae-08fec2d8b98e\") " pod="openshift-ingress/router-default-7c74886bd5-pn4hl" Jul 09 04:16:20.007436 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:20.007363 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b7903a28-a0b8-4567-ac5c-d18b25565947-registry-tls\") pod \"image-registry-679fd94dd5-pmxfd\" (UID: \"b7903a28-a0b8-4567-ac5c-d18b25565947\") " pod="openshift-image-registry/image-registry-679fd94dd5-pmxfd" Jul 09 04:16:20.007436 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:20.007412 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/916c78d9-c922-4dc4-8cc5-8b887e7999d3-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-5nq2g\" (UID: \"916c78d9-c922-4dc4-8cc5-8b887e7999d3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-5nq2g" Jul 09 04:16:20.007672 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:20.007441 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/be7de4e5-23b0-463b-8618-d0bb0a0895b6-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-d9vmv\" (UID: \"be7de4e5-23b0-463b-8618-d0bb0a0895b6\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-d9vmv" Jul 09 04:16:20.007672 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:20.007591 2566 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 09 04:16:20.007672 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:20.007657 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be7de4e5-23b0-463b-8618-d0bb0a0895b6-cluster-monitoring-operator-tls podName:be7de4e5-23b0-463b-8618-d0bb0a0895b6 nodeName:}" failed. No retries permitted until 2026-07-09 04:16:22.007636716 +0000 UTC m=+39.624534932 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/be7de4e5-23b0-463b-8618-d0bb0a0895b6-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-d9vmv" (UID: "be7de4e5-23b0-463b-8618-d0bb0a0895b6") : secret "cluster-monitoring-operator-tls" not found Jul 09 04:16:20.008142 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:20.008119 2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 04:16:20.008214 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:20.008145 2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bb6bc998-jhp7f: secret "image-registry-tls" not found Jul 09 04:16:20.008214 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:20.008195 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/36b72c73-bb0b-4e08-95c8-7f1f263f46f4-registry-tls podName:36b72c73-bb0b-4e08-95c8-7f1f263f46f4 nodeName:}" failed. No retries permitted until 2026-07-09 04:16:22.008178992 +0000 UTC m=+39.625077213 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/36b72c73-bb0b-4e08-95c8-7f1f263f46f4-registry-tls") pod "image-registry-5bb6bc998-jhp7f" (UID: "36b72c73-bb0b-4e08-95c8-7f1f263f46f4") : secret "image-registry-tls" not found Jul 09 04:16:20.008316 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:20.008272 2566 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 09 04:16:20.008316 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:20.008307 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3b55ef5-ee9e-47f4-85ae-08fec2d8b98e-metrics-certs podName:e3b55ef5-ee9e-47f4-85ae-08fec2d8b98e nodeName:}" failed. No retries permitted until 2026-07-09 04:16:22.008296464 +0000 UTC m=+39.625194675 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e3b55ef5-ee9e-47f4-85ae-08fec2d8b98e-metrics-certs") pod "router-default-7c74886bd5-pn4hl" (UID: "e3b55ef5-ee9e-47f4-85ae-08fec2d8b98e") : secret "router-metrics-certs-default" not found Jul 09 04:16:20.008722 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:20.008696 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 04:16:20.008796 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:20.008750 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/48514bce-8ca3-41aa-b388-06e16f306fe1-metrics-tls podName:48514bce-8ca3-41aa-b388-06e16f306fe1 nodeName:}" failed. No retries permitted until 2026-07-09 04:16:22.008736559 +0000 UTC m=+39.625634761 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/48514bce-8ca3-41aa-b388-06e16f306fe1-metrics-tls") pod "dns-default-z8vt7" (UID: "48514bce-8ca3-41aa-b388-06e16f306fe1") : secret "dns-default-metrics-tls" not found Jul 09 04:16:20.008856 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:20.008819 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e3b55ef5-ee9e-47f4-85ae-08fec2d8b98e-service-ca-bundle podName:e3b55ef5-ee9e-47f4-85ae-08fec2d8b98e nodeName:}" failed. No retries permitted until 2026-07-09 04:16:22.008809264 +0000 UTC m=+39.625707465 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e3b55ef5-ee9e-47f4-85ae-08fec2d8b98e-service-ca-bundle") pod "router-default-7c74886bd5-pn4hl" (UID: "e3b55ef5-ee9e-47f4-85ae-08fec2d8b98e") : configmap references non-existent config key: service-ca.crt Jul 09 04:16:20.008931 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:20.008881 2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 04:16:20.008931 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:20.008891 2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-679fd94dd5-pmxfd: secret "image-registry-tls" not found Jul 09 04:16:20.009033 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:20.008954 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b7903a28-a0b8-4567-ac5c-d18b25565947-registry-tls podName:b7903a28-a0b8-4567-ac5c-d18b25565947 nodeName:}" failed. No retries permitted until 2026-07-09 04:16:22.008943132 +0000 UTC m=+39.625841344 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b7903a28-a0b8-4567-ac5c-d18b25565947-registry-tls") pod "image-registry-679fd94dd5-pmxfd" (UID: "b7903a28-a0b8-4567-ac5c-d18b25565947") : secret "image-registry-tls" not found Jul 09 04:16:20.009033 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:20.009014 2566 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 09 04:16:20.009128 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:20.009043 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/916c78d9-c922-4dc4-8cc5-8b887e7999d3-samples-operator-tls podName:916c78d9-c922-4dc4-8cc5-8b887e7999d3 nodeName:}" failed. No retries permitted until 2026-07-09 04:16:22.009033537 +0000 UTC m=+39.625931737 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/916c78d9-c922-4dc4-8cc5-8b887e7999d3-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-5nq2g" (UID: "916c78d9-c922-4dc4-8cc5-8b887e7999d3") : secret "samples-operator-tls" not found Jul 09 04:16:22.030842 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:22.030799 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/36b72c73-bb0b-4e08-95c8-7f1f263f46f4-registry-tls\") pod \"image-registry-5bb6bc998-jhp7f\" (UID: \"36b72c73-bb0b-4e08-95c8-7f1f263f46f4\") " pod="openshift-image-registry/image-registry-5bb6bc998-jhp7f" Jul 09 04:16:22.031419 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:22.030850 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3b55ef5-ee9e-47f4-85ae-08fec2d8b98e-metrics-certs\") pod \"router-default-7c74886bd5-pn4hl\" (UID: \"e3b55ef5-ee9e-47f4-85ae-08fec2d8b98e\") " pod="openshift-ingress/router-default-7c74886bd5-pn4hl" Jul 09 04:16:22.031419 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:22.030979 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/48514bce-8ca3-41aa-b388-06e16f306fe1-metrics-tls\") pod \"dns-default-z8vt7\" (UID: \"48514bce-8ca3-41aa-b388-06e16f306fe1\") " pod="openshift-dns/dns-default-z8vt7" Jul 09 04:16:22.031419 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:22.031013 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3b55ef5-ee9e-47f4-85ae-08fec2d8b98e-service-ca-bundle\") pod \"router-default-7c74886bd5-pn4hl\" (UID: \"e3b55ef5-ee9e-47f4-85ae-08fec2d8b98e\") " pod="openshift-ingress/router-default-7c74886bd5-pn4hl" Jul 09 04:16:22.031419 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:22.031043 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b7903a28-a0b8-4567-ac5c-d18b25565947-registry-tls\") pod \"image-registry-679fd94dd5-pmxfd\" (UID: \"b7903a28-a0b8-4567-ac5c-d18b25565947\") " pod="openshift-image-registry/image-registry-679fd94dd5-pmxfd" Jul 09 04:16:22.031419 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:22.031083 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/916c78d9-c922-4dc4-8cc5-8b887e7999d3-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-5nq2g\" (UID: \"916c78d9-c922-4dc4-8cc5-8b887e7999d3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-5nq2g" Jul 09 04:16:22.031419 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:22.031110 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/be7de4e5-23b0-463b-8618-d0bb0a0895b6-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-d9vmv\" (UID: \"be7de4e5-23b0-463b-8618-d0bb0a0895b6\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-d9vmv" Jul 09 04:16:22.031419 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:22.031263 2566 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 09 04:16:22.031419 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:22.031327 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be7de4e5-23b0-463b-8618-d0bb0a0895b6-cluster-monitoring-operator-tls podName:be7de4e5-23b0-463b-8618-d0bb0a0895b6 nodeName:}" failed. No retries permitted until 2026-07-09 04:16:26.03130966 +0000 UTC m=+43.648207860 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/be7de4e5-23b0-463b-8618-d0bb0a0895b6-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-d9vmv" (UID: "be7de4e5-23b0-463b-8618-d0bb0a0895b6") : secret "cluster-monitoring-operator-tls" not found Jul 09 04:16:22.031784 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:22.031755 2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 04:16:22.031784 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:22.031773 2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bb6bc998-jhp7f: secret "image-registry-tls" not found Jul 09 04:16:22.031889 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:22.031819 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/36b72c73-bb0b-4e08-95c8-7f1f263f46f4-registry-tls podName:36b72c73-bb0b-4e08-95c8-7f1f263f46f4 nodeName:}" failed. No retries permitted until 2026-07-09 04:16:26.031803564 +0000 UTC m=+43.648701778 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/36b72c73-bb0b-4e08-95c8-7f1f263f46f4-registry-tls") pod "image-registry-5bb6bc998-jhp7f" (UID: "36b72c73-bb0b-4e08-95c8-7f1f263f46f4") : secret "image-registry-tls" not found Jul 09 04:16:22.031889 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:22.031879 2566 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 09 04:16:22.032033 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:22.031933 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3b55ef5-ee9e-47f4-85ae-08fec2d8b98e-metrics-certs podName:e3b55ef5-ee9e-47f4-85ae-08fec2d8b98e nodeName:}" failed. No retries permitted until 2026-07-09 04:16:26.031900779 +0000 UTC m=+43.648798975 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e3b55ef5-ee9e-47f4-85ae-08fec2d8b98e-metrics-certs") pod "router-default-7c74886bd5-pn4hl" (UID: "e3b55ef5-ee9e-47f4-85ae-08fec2d8b98e") : secret "router-metrics-certs-default" not found Jul 09 04:16:22.032033 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:22.031993 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 04:16:22.032033 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:22.032025 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/48514bce-8ca3-41aa-b388-06e16f306fe1-metrics-tls podName:48514bce-8ca3-41aa-b388-06e16f306fe1 nodeName:}" failed. No retries permitted until 2026-07-09 04:16:26.032014404 +0000 UTC m=+43.648912616 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/48514bce-8ca3-41aa-b388-06e16f306fe1-metrics-tls") pod "dns-default-z8vt7" (UID: "48514bce-8ca3-41aa-b388-06e16f306fe1") : secret "dns-default-metrics-tls" not found Jul 09 04:16:22.032250 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:22.032087 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e3b55ef5-ee9e-47f4-85ae-08fec2d8b98e-service-ca-bundle podName:e3b55ef5-ee9e-47f4-85ae-08fec2d8b98e nodeName:}" failed. No retries permitted until 2026-07-09 04:16:26.032076415 +0000 UTC m=+43.648974626 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e3b55ef5-ee9e-47f4-85ae-08fec2d8b98e-service-ca-bundle") pod "router-default-7c74886bd5-pn4hl" (UID: "e3b55ef5-ee9e-47f4-85ae-08fec2d8b98e") : configmap references non-existent config key: service-ca.crt Jul 09 04:16:22.032250 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:22.032143 2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 04:16:22.032250 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:22.032153 2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-679fd94dd5-pmxfd: secret "image-registry-tls" not found Jul 09 04:16:22.032250 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:22.032184 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b7903a28-a0b8-4567-ac5c-d18b25565947-registry-tls podName:b7903a28-a0b8-4567-ac5c-d18b25565947 nodeName:}" failed. No retries permitted until 2026-07-09 04:16:26.032174247 +0000 UTC m=+43.649072443 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b7903a28-a0b8-4567-ac5c-d18b25565947-registry-tls") pod "image-registry-679fd94dd5-pmxfd" (UID: "b7903a28-a0b8-4567-ac5c-d18b25565947") : secret "image-registry-tls" not found Jul 09 04:16:22.032250 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:22.032238 2566 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 09 04:16:22.032484 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:22.032267 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/916c78d9-c922-4dc4-8cc5-8b887e7999d3-samples-operator-tls podName:916c78d9-c922-4dc4-8cc5-8b887e7999d3 nodeName:}" failed. No retries permitted until 2026-07-09 04:16:26.032257549 +0000 UTC m=+43.649155746 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/916c78d9-c922-4dc4-8cc5-8b887e7999d3-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-5nq2g" (UID: "916c78d9-c922-4dc4-8cc5-8b887e7999d3") : secret "samples-operator-tls" not found Jul 09 04:16:22.507685 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:22.507652 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l8qcx_060291ce-8ee2-46f6-96cf-c2e8ea5804d1/konnectivity-agent/0.log" limit=1024 Jul 09 04:16:22.584850 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:22.584742 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l8qcx_060291ce-8ee2-46f6-96cf-c2e8ea5804d1/konnectivity-agent/0.log" limit=1024 Jul 09 04:16:23.350700 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:23.350634 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l8qcx_060291ce-8ee2-46f6-96cf-c2e8ea5804d1/konnectivity-agent/0.log" limit=1024 Jul 09 04:16:23.430736 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:23.430637 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l8qcx_060291ce-8ee2-46f6-96cf-c2e8ea5804d1/konnectivity-agent/0.log" limit=1024 Jul 09 04:16:23.497886 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:23.497840 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l8qcx_060291ce-8ee2-46f6-96cf-c2e8ea5804d1/konnectivity-agent/0.log" limit=1024 Jul 09 04:16:23.580615 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:23.580506 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l8qcx_060291ce-8ee2-46f6-96cf-c2e8ea5804d1/konnectivity-agent/0.log" limit=1024 Jul 09 04:16:23.678363 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:23.678256 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l8qcx_060291ce-8ee2-46f6-96cf-c2e8ea5804d1/konnectivity-agent/0.log" limit=1024 Jul 09 04:16:23.778522 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:23.778487 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l8qcx_060291ce-8ee2-46f6-96cf-c2e8ea5804d1/konnectivity-agent/0.log" limit=1024 Jul 09 04:16:23.838419 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:23.838373 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l8qcx_060291ce-8ee2-46f6-96cf-c2e8ea5804d1/konnectivity-agent/0.log" limit=1024 Jul 09 04:16:24.565331 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:24.565293 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l8qcx_060291ce-8ee2-46f6-96cf-c2e8ea5804d1/konnectivity-agent/0.log" limit=1024 Jul 09 04:16:24.620986 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:24.620948 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l8qcx_060291ce-8ee2-46f6-96cf-c2e8ea5804d1/konnectivity-agent/0.log" limit=1024 Jul 09 04:16:25.015193 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:25.015142 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l8qcx_060291ce-8ee2-46f6-96cf-c2e8ea5804d1/konnectivity-agent/0.log" limit=1024 Jul 09 04:16:25.123493 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:25.123454 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l8qcx_060291ce-8ee2-46f6-96cf-c2e8ea5804d1/konnectivity-agent/0.log" limit=1024 Jul 09 04:16:25.326065 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:25.325976 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l8qcx_060291ce-8ee2-46f6-96cf-c2e8ea5804d1/konnectivity-agent/0.log" limit=1024 Jul 09 04:16:25.382679 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:25.382642 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l8qcx_060291ce-8ee2-46f6-96cf-c2e8ea5804d1/konnectivity-agent/0.log" limit=1024 Jul 09 04:16:26.072186 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:26.072154 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/48514bce-8ca3-41aa-b388-06e16f306fe1-metrics-tls\") pod \"dns-default-z8vt7\" (UID: \"48514bce-8ca3-41aa-b388-06e16f306fe1\") " pod="openshift-dns/dns-default-z8vt7" Jul 09 04:16:26.072186 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:26.072196 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3b55ef5-ee9e-47f4-85ae-08fec2d8b98e-service-ca-bundle\") pod \"router-default-7c74886bd5-pn4hl\" (UID: \"e3b55ef5-ee9e-47f4-85ae-08fec2d8b98e\") " pod="openshift-ingress/router-default-7c74886bd5-pn4hl" Jul 09 04:16:26.072694 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:26.072260 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b7903a28-a0b8-4567-ac5c-d18b25565947-registry-tls\") pod \"image-registry-679fd94dd5-pmxfd\" (UID: \"b7903a28-a0b8-4567-ac5c-d18b25565947\") " pod="openshift-image-registry/image-registry-679fd94dd5-pmxfd" Jul 09 04:16:26.072694 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:26.072307 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/916c78d9-c922-4dc4-8cc5-8b887e7999d3-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-5nq2g\" (UID: \"916c78d9-c922-4dc4-8cc5-8b887e7999d3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-5nq2g" Jul 09 04:16:26.072694 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:26.072327 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 04:16:26.072694 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:26.072354 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e3b55ef5-ee9e-47f4-85ae-08fec2d8b98e-service-ca-bundle podName:e3b55ef5-ee9e-47f4-85ae-08fec2d8b98e nodeName:}" failed. No retries permitted until 2026-07-09 04:16:34.072332321 +0000 UTC m=+51.689230534 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e3b55ef5-ee9e-47f4-85ae-08fec2d8b98e-service-ca-bundle") pod "router-default-7c74886bd5-pn4hl" (UID: "e3b55ef5-ee9e-47f4-85ae-08fec2d8b98e") : configmap references non-existent config key: service-ca.crt Jul 09 04:16:26.072694 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:26.072377 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/48514bce-8ca3-41aa-b388-06e16f306fe1-metrics-tls podName:48514bce-8ca3-41aa-b388-06e16f306fe1 nodeName:}" failed. No retries permitted until 2026-07-09 04:16:34.072364746 +0000 UTC m=+51.689262948 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/48514bce-8ca3-41aa-b388-06e16f306fe1-metrics-tls") pod "dns-default-z8vt7" (UID: "48514bce-8ca3-41aa-b388-06e16f306fe1") : secret "dns-default-metrics-tls" not found Jul 09 04:16:26.072694 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:26.072330 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/be7de4e5-23b0-463b-8618-d0bb0a0895b6-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-d9vmv\" (UID: \"be7de4e5-23b0-463b-8618-d0bb0a0895b6\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-d9vmv" Jul 09 04:16:26.072694 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:26.072394 2566 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 09 04:16:26.072694 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:26.072392 2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 04:16:26.072694 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:26.072419 2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-679fd94dd5-pmxfd: secret "image-registry-tls" not found Jul 09 04:16:26.072694 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:26.072439 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/36b72c73-bb0b-4e08-95c8-7f1f263f46f4-registry-tls\") pod \"image-registry-5bb6bc998-jhp7f\" (UID: \"36b72c73-bb0b-4e08-95c8-7f1f263f46f4\") " pod="openshift-image-registry/image-registry-5bb6bc998-jhp7f" Jul 09 04:16:26.072694 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:26.072465 2566 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 09 04:16:26.072694 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:26.072467 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3b55ef5-ee9e-47f4-85ae-08fec2d8b98e-metrics-certs\") pod \"router-default-7c74886bd5-pn4hl\" (UID: \"e3b55ef5-ee9e-47f4-85ae-08fec2d8b98e\") " pod="openshift-ingress/router-default-7c74886bd5-pn4hl" Jul 09 04:16:26.072694 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:26.072484 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b7903a28-a0b8-4567-ac5c-d18b25565947-registry-tls podName:b7903a28-a0b8-4567-ac5c-d18b25565947 nodeName:}" failed. No retries permitted until 2026-07-09 04:16:34.072465669 +0000 UTC m=+51.689363884 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b7903a28-a0b8-4567-ac5c-d18b25565947-registry-tls") pod "image-registry-679fd94dd5-pmxfd" (UID: "b7903a28-a0b8-4567-ac5c-d18b25565947") : secret "image-registry-tls" not found Jul 09 04:16:26.072694 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:26.072512 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/916c78d9-c922-4dc4-8cc5-8b887e7999d3-samples-operator-tls podName:916c78d9-c922-4dc4-8cc5-8b887e7999d3 nodeName:}" failed. No retries permitted until 2026-07-09 04:16:34.072502238 +0000 UTC m=+51.689400436 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/916c78d9-c922-4dc4-8cc5-8b887e7999d3-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-5nq2g" (UID: "916c78d9-c922-4dc4-8cc5-8b887e7999d3") : secret "samples-operator-tls" not found Jul 09 04:16:26.072694 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:26.072525 2566 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 09 04:16:26.072694 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:26.072532 2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 04:16:26.072694 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:26.072540 2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bb6bc998-jhp7f: secret "image-registry-tls" not found Jul 09 04:16:26.073351 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:26.072557 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3b55ef5-ee9e-47f4-85ae-08fec2d8b98e-metrics-certs podName:e3b55ef5-ee9e-47f4-85ae-08fec2d8b98e nodeName:}" failed. No retries permitted until 2026-07-09 04:16:34.072546866 +0000 UTC m=+51.689445067 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e3b55ef5-ee9e-47f4-85ae-08fec2d8b98e-metrics-certs") pod "router-default-7c74886bd5-pn4hl" (UID: "e3b55ef5-ee9e-47f4-85ae-08fec2d8b98e") : secret "router-metrics-certs-default" not found Jul 09 04:16:26.073351 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:26.072576 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be7de4e5-23b0-463b-8618-d0bb0a0895b6-cluster-monitoring-operator-tls podName:be7de4e5-23b0-463b-8618-d0bb0a0895b6 nodeName:}" failed. No retries permitted until 2026-07-09 04:16:34.072567669 +0000 UTC m=+51.689465885 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/be7de4e5-23b0-463b-8618-d0bb0a0895b6-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-d9vmv" (UID: "be7de4e5-23b0-463b-8618-d0bb0a0895b6") : secret "cluster-monitoring-operator-tls" not found Jul 09 04:16:26.073351 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:26.072595 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/36b72c73-bb0b-4e08-95c8-7f1f263f46f4-registry-tls podName:36b72c73-bb0b-4e08-95c8-7f1f263f46f4 nodeName:}" failed. No retries permitted until 2026-07-09 04:16:34.072587211 +0000 UTC m=+51.689485408 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/36b72c73-bb0b-4e08-95c8-7f1f263f46f4-registry-tls") pod "image-registry-5bb6bc998-jhp7f" (UID: "36b72c73-bb0b-4e08-95c8-7f1f263f46f4") : secret "image-registry-tls" not found Jul 09 04:16:27.391109 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:27.391063 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-rct7b"] Jul 09 04:16:27.408239 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:27.408207 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-rct7b"] Jul 09 04:16:27.408374 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:27.408300 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-rct7b" Jul 09 04:16:27.410926 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:27.410887 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 09 04:16:27.410926 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:27.410897 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-2cjhj\"" Jul 09 04:16:27.412156 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:27.412138 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 09 04:16:27.514423 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:27.514370 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l8qcx_060291ce-8ee2-46f6-96cf-c2e8ea5804d1/konnectivity-agent/0.log" limit=1024 Jul 09 04:16:27.587542 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:27.587501 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/73292436-9d26-4890-a595-3a417aedd88d-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-rct7b\" (UID: \"73292436-9d26-4890-a595-3a417aedd88d\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-rct7b" Jul 09 04:16:27.587698 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:27.587674 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/73292436-9d26-4890-a595-3a417aedd88d-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-rct7b\" (UID: \"73292436-9d26-4890-a595-3a417aedd88d\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-rct7b" Jul 09 04:16:27.617625 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:27.617587 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l8qcx_060291ce-8ee2-46f6-96cf-c2e8ea5804d1/konnectivity-agent/0.log" limit=1024 Jul 09 04:16:27.688500 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:27.688418 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/73292436-9d26-4890-a595-3a417aedd88d-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-rct7b\" (UID: \"73292436-9d26-4890-a595-3a417aedd88d\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-rct7b" Jul 09 04:16:27.688630 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:27.688559 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/73292436-9d26-4890-a595-3a417aedd88d-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-rct7b\" (UID: \"73292436-9d26-4890-a595-3a417aedd88d\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-rct7b" Jul 09 04:16:27.688687 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:27.688671 2566 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 09 04:16:27.688771 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:27.688760 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73292436-9d26-4890-a595-3a417aedd88d-networking-console-plugin-cert podName:73292436-9d26-4890-a595-3a417aedd88d nodeName:}" failed. No retries permitted until 2026-07-09 04:16:28.188740115 +0000 UTC m=+45.805638312 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/73292436-9d26-4890-a595-3a417aedd88d-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-rct7b" (UID: "73292436-9d26-4890-a595-3a417aedd88d") : secret "networking-console-plugin-cert" not found Jul 09 04:16:27.689228 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:27.689210 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/73292436-9d26-4890-a595-3a417aedd88d-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-rct7b\" (UID: \"73292436-9d26-4890-a595-3a417aedd88d\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-rct7b" Jul 09 04:16:27.715580 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:27.715530 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l8qcx_060291ce-8ee2-46f6-96cf-c2e8ea5804d1/konnectivity-agent/0.log" limit=1024 Jul 09 04:16:27.787586 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:27.787537 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l8qcx_060291ce-8ee2-46f6-96cf-c2e8ea5804d1/konnectivity-agent/0.log" limit=1024 Jul 09 04:16:28.192596 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:28.192547 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/73292436-9d26-4890-a595-3a417aedd88d-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-rct7b\" (UID: \"73292436-9d26-4890-a595-3a417aedd88d\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-rct7b" Jul 09 04:16:28.192790 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:28.192720 2566 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 09 04:16:28.192841 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:28.192803 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73292436-9d26-4890-a595-3a417aedd88d-networking-console-plugin-cert podName:73292436-9d26-4890-a595-3a417aedd88d nodeName:}" failed. No retries permitted until 2026-07-09 04:16:29.192781087 +0000 UTC m=+46.809679289 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/73292436-9d26-4890-a595-3a417aedd88d-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-rct7b" (UID: "73292436-9d26-4890-a595-3a417aedd88d") : secret "networking-console-plugin-cert" not found Jul 09 04:16:29.113375 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:29.113258 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-ks9bq" event={"ID":"8c838cc4-8ecb-4bc4-a0f0-5fe843d8c1ad","Type":"ContainerStarted","Data":"22e19a0683d955ded489372b0d5bc0ae77f4e8b795daee262ab6816108ad23a6"} Jul 09 04:16:29.202264 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:29.202235 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/73292436-9d26-4890-a595-3a417aedd88d-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-rct7b\" (UID: \"73292436-9d26-4890-a595-3a417aedd88d\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-rct7b" Jul 09 04:16:29.202431 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:29.202411 2566 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 09 04:16:29.202675 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:29.202490 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73292436-9d26-4890-a595-3a417aedd88d-networking-console-plugin-cert podName:73292436-9d26-4890-a595-3a417aedd88d nodeName:}" failed. No retries permitted until 2026-07-09 04:16:31.202459848 +0000 UTC m=+48.819358047 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/73292436-9d26-4890-a595-3a417aedd88d-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-rct7b" (UID: "73292436-9d26-4890-a595-3a417aedd88d") : secret "networking-console-plugin-cert" not found Jul 09 04:16:29.218488 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:29.218161 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l8qcx_060291ce-8ee2-46f6-96cf-c2e8ea5804d1/konnectivity-agent/0.log" limit=1024 Jul 09 04:16:29.321107 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:29.320928 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l8qcx_060291ce-8ee2-46f6-96cf-c2e8ea5804d1/konnectivity-agent/0.log" limit=1024 Jul 09 04:16:30.118185 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:30.118146 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-v6h2j" event={"ID":"0c091339-91c3-4263-a0fc-090d4f82216e","Type":"ContainerStarted","Data":"7b31dfa5b37161550bd29260cae06c47003db3f36889698983c69bc7ccabee56"} Jul 09 04:16:30.120235 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:30.120201 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-6sjg9" event={"ID":"c805c009-9a98-4b40-9c74-9bed4868db61","Type":"ContainerStarted","Data":"55176caffce1c69c76c5d21672a08fd9ff0a43c8ea520bedcb4d538ebb4d7c99"} Jul 09 04:16:30.121863 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:30.121837 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-8stqx" event={"ID":"1095557e-f542-4e1d-a462-0a024f80347e","Type":"ContainerStarted","Data":"5218217817c8caffc09e035b8ebc16515e65a2c613793eadd1c79f178a789c3b"} Jul 09 04:16:30.125495 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:30.125460 2566 generic.go:356] "Generic (PLEG): container finished" podID="fee2629f-8880-4f02-bf6b-26317084c049" containerID="543e9cf149b08003a4539c5750d9731125bc8a4890258c1206b3103d93bd0162" exitCode=0 Jul 09 04:16:30.125659 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:30.125540 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xf5wq" event={"ID":"fee2629f-8880-4f02-bf6b-26317084c049","Type":"ContainerDied","Data":"543e9cf149b08003a4539c5750d9731125bc8a4890258c1206b3103d93bd0162"} Jul 09 04:16:30.127340 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:30.127317 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-cqrqz" event={"ID":"e2fcabda-d114-4620-b0fa-9229d35ab0ee","Type":"ContainerStarted","Data":"b630804427087400c257243ae4421dc5a4bbb8b3602c5a18bcb8c053b3fd2ba4"} Jul 09 04:16:30.129192 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:30.129165 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-qthv7" event={"ID":"d6f634f8-361d-4b31-b9d4-9738cf65153b","Type":"ContainerStarted","Data":"5fe0798d51f1db470a2d66d3b9c018b43316d77f0fede63021f81c697a48bbf5"} Jul 09 04:16:30.131036 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:30.131014 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-lhzlx_a6976b04-fd52-4288-8d24-fb34cc801459/console-operator/0.log" Jul 09 04:16:30.131150 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:30.131056 2566 generic.go:356] "Generic (PLEG): container finished" podID="a6976b04-fd52-4288-8d24-fb34cc801459" containerID="9185c45ac63555799c58dccc69af9b413cc88d131099d733ce5d013db187db5b" exitCode=255 Jul 09 04:16:30.131150 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:30.131110 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-lhzlx" event={"ID":"a6976b04-fd52-4288-8d24-fb34cc801459","Type":"ContainerDied","Data":"9185c45ac63555799c58dccc69af9b413cc88d131099d733ce5d013db187db5b"} Jul 09 04:16:30.132059 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:30.132039 2566 scope.go:117] "RemoveContainer" containerID="9185c45ac63555799c58dccc69af9b413cc88d131099d733ce5d013db187db5b" Jul 09 04:16:30.139996 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:30.139833 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-ks9bq" podStartSLOduration=6.202831278 podStartE2EDuration="16.139812196s" totalImagesPullingTime="9.936980918s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:16:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:16:29.147261034 +0000 UTC m=+46.764159254" watchObservedRunningTime="2026-07-09 04:16:30.139812196 +0000 UTC m=+47.756710413" Jul 09 04:16:30.140719 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:30.140684 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-v6h2j" podStartSLOduration=5.926301138 podStartE2EDuration="16.140670375s" totalImagesPullingTime="10.214369237s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:16:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:16:30.139426054 +0000 UTC m=+47.756324271" watchObservedRunningTime="2026-07-09 04:16:30.140670375 +0000 UTC m=+47.757568594" Jul 09 04:16:30.170989 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:30.170883 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-qthv7" podStartSLOduration=2.215217977 podStartE2EDuration="12.170865082s" totalImagesPullingTime="9.955647105s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:16:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:16:30.170817935 +0000 UTC m=+47.787716154" watchObservedRunningTime="2026-07-09 04:16:30.170865082 +0000 UTC m=+47.787763296" Jul 09 04:16:30.191984 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:30.191952 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l8qcx_060291ce-8ee2-46f6-96cf-c2e8ea5804d1/konnectivity-agent/0.log" limit=1024 Jul 09 04:16:30.211668 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:30.211639 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-lmjbt"] Jul 09 04:16:30.236618 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:30.233578 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-8stqx" podStartSLOduration=6.269153662 podStartE2EDuration="16.233553993s" totalImagesPullingTime="9.964400331s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:16:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:16:30.226002914 +0000 UTC m=+47.842901134" watchObservedRunningTime="2026-07-09 04:16:30.233553993 +0000 UTC m=+47.850452213" Jul 09 04:16:30.239978 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:30.239950 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-lmjbt"] Jul 09 04:16:30.240771 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:30.240217 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-lmjbt" Jul 09 04:16:30.244638 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:30.244608 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-dbxgk\"" Jul 09 04:16:30.245866 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:30.245275 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 09 04:16:30.247156 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:30.245325 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 09 04:16:30.257767 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:30.257049 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5c847dcfc4-6sjg9" podStartSLOduration=6.167663769 podStartE2EDuration="16.257026477s" totalImagesPullingTime="10.089362708s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:16:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:16:30.254274243 +0000 UTC m=+47.871172462" watchObservedRunningTime="2026-07-09 04:16:30.257026477 +0000 UTC m=+47.873924688" Jul 09 04:16:30.278355 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:30.278283 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-cqrqz" podStartSLOduration=6.248381679 podStartE2EDuration="16.278230165s" totalImagesPullingTime="10.029848486s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:16:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:16:30.277202132 +0000 UTC m=+47.894100352" watchObservedRunningTime="2026-07-09 04:16:30.278230165 +0000 UTC m=+47.895128384" Jul 09 04:16:30.281307 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:30.281265 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l8qcx_060291ce-8ee2-46f6-96cf-c2e8ea5804d1/konnectivity-agent/0.log" limit=1024 Jul 09 04:16:30.314541 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:30.314472 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ck7zq\" (UniqueName: \"kubernetes.io/projected/baa359d9-92f1-40e4-84b9-bbeb07910bb6-kube-api-access-ck7zq\") pod \"migrator-d57d58cc9-lmjbt\" (UID: \"baa359d9-92f1-40e4-84b9-bbeb07910bb6\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-lmjbt" Jul 09 04:16:30.345768 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:30.345737 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l8qcx_060291ce-8ee2-46f6-96cf-c2e8ea5804d1/konnectivity-agent/0.log" limit=1024 Jul 09 04:16:30.415631 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:30.415585 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ck7zq\" (UniqueName: \"kubernetes.io/projected/baa359d9-92f1-40e4-84b9-bbeb07910bb6-kube-api-access-ck7zq\") pod \"migrator-d57d58cc9-lmjbt\" (UID: \"baa359d9-92f1-40e4-84b9-bbeb07910bb6\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-lmjbt" Jul 09 04:16:30.426066 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:30.426039 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ck7zq\" (UniqueName: \"kubernetes.io/projected/baa359d9-92f1-40e4-84b9-bbeb07910bb6-kube-api-access-ck7zq\") pod \"migrator-d57d58cc9-lmjbt\" (UID: \"baa359d9-92f1-40e4-84b9-bbeb07910bb6\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-lmjbt" Jul 09 04:16:30.446970 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:30.446936 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l8qcx_060291ce-8ee2-46f6-96cf-c2e8ea5804d1/konnectivity-agent/0.log" limit=1024 Jul 09 04:16:30.568039 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:30.568003 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-lmjbt" Jul 09 04:16:30.735217 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:30.735190 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-lmjbt"] Jul 09 04:16:30.739138 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:16:30.739111 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbaa359d9_92f1_40e4_84b9_bbeb07910bb6.slice/crio-df0db37cb9a55df9c2b68221cda5405421c980f2a54147b45e2252d803bbfe85 WatchSource:0}: Error finding container df0db37cb9a55df9c2b68221cda5405421c980f2a54147b45e2252d803bbfe85: Status 404 returned error can't find the container with id df0db37cb9a55df9c2b68221cda5405421c980f2a54147b45e2252d803bbfe85 Jul 09 04:16:30.851858 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:30.851764 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l8qcx_060291ce-8ee2-46f6-96cf-c2e8ea5804d1/konnectivity-agent/0.log" limit=1024 Jul 09 04:16:30.915479 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:30.915435 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l8qcx_060291ce-8ee2-46f6-96cf-c2e8ea5804d1/konnectivity-agent/0.log" limit=1024 Jul 09 04:16:31.106843 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:31.106801 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l8qcx_060291ce-8ee2-46f6-96cf-c2e8ea5804d1/konnectivity-agent/0.log" limit=1024 Jul 09 04:16:31.138853 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:31.138824 2566 generic.go:356] "Generic (PLEG): container finished" podID="fee2629f-8880-4f02-bf6b-26317084c049" containerID="37b855931497452ce521f0f8af132c7591c9c1827afd44a6e202b74d23b61c84" exitCode=0 Jul 09 04:16:31.139325 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:31.138939 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xf5wq" event={"ID":"fee2629f-8880-4f02-bf6b-26317084c049","Type":"ContainerDied","Data":"37b855931497452ce521f0f8af132c7591c9c1827afd44a6e202b74d23b61c84"} Jul 09 04:16:31.140189 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:31.140161 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-lmjbt" event={"ID":"baa359d9-92f1-40e4-84b9-bbeb07910bb6","Type":"ContainerStarted","Data":"df0db37cb9a55df9c2b68221cda5405421c980f2a54147b45e2252d803bbfe85"} Jul 09 04:16:31.141743 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:31.141726 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-lhzlx_a6976b04-fd52-4288-8d24-fb34cc801459/console-operator/1.log" Jul 09 04:16:31.142195 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:31.142179 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-lhzlx_a6976b04-fd52-4288-8d24-fb34cc801459/console-operator/0.log" Jul 09 04:16:31.142271 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:31.142218 2566 generic.go:356] "Generic (PLEG): container finished" podID="a6976b04-fd52-4288-8d24-fb34cc801459" containerID="2a6f648de11f3f19dbbd722f8f00134a56282952564e172d7242fe1095c62643" exitCode=255 Jul 09 04:16:31.142338 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:31.142290 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-lhzlx" event={"ID":"a6976b04-fd52-4288-8d24-fb34cc801459","Type":"ContainerDied","Data":"2a6f648de11f3f19dbbd722f8f00134a56282952564e172d7242fe1095c62643"} Jul 09 04:16:31.142396 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:31.142352 2566 scope.go:117] "RemoveContainer" containerID="9185c45ac63555799c58dccc69af9b413cc88d131099d733ce5d013db187db5b" Jul 09 04:16:31.142538 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:31.142518 2566 scope.go:117] "RemoveContainer" containerID="2a6f648de11f3f19dbbd722f8f00134a56282952564e172d7242fe1095c62643" Jul 09 04:16:31.142715 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:31.142693 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-lhzlx_openshift-console-operator(a6976b04-fd52-4288-8d24-fb34cc801459)\"" pod="openshift-console-operator/console-operator-68b757fb67-lhzlx" podUID="a6976b04-fd52-4288-8d24-fb34cc801459" Jul 09 04:16:31.182644 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:31.182612 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l8qcx_060291ce-8ee2-46f6-96cf-c2e8ea5804d1/konnectivity-agent/0.log" limit=1024 Jul 09 04:16:31.224582 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:31.223697 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/73292436-9d26-4890-a595-3a417aedd88d-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-rct7b\" (UID: \"73292436-9d26-4890-a595-3a417aedd88d\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-rct7b" Jul 09 04:16:31.224582 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:31.224210 2566 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 09 04:16:31.224582 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:31.224283 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73292436-9d26-4890-a595-3a417aedd88d-networking-console-plugin-cert podName:73292436-9d26-4890-a595-3a417aedd88d nodeName:}" failed. No retries permitted until 2026-07-09 04:16:35.224263184 +0000 UTC m=+52.841161384 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/73292436-9d26-4890-a595-3a417aedd88d-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-rct7b" (UID: "73292436-9d26-4890-a595-3a417aedd88d") : secret "networking-console-plugin-cert" not found Jul 09 04:16:31.372257 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:31.372176 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-g65cg"] Jul 09 04:16:31.386880 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:31.386844 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-g65cg"] Jul 09 04:16:31.387084 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:31.386998 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-g65cg" Jul 09 04:16:31.389854 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:31.389802 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-lwxll\"" Jul 09 04:16:31.390008 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:31.389980 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 09 04:16:31.390008 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:31.389991 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 09 04:16:31.408350 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:31.408262 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l8qcx_060291ce-8ee2-46f6-96cf-c2e8ea5804d1/konnectivity-agent/0.log" limit=1024 Jul 09 04:16:31.425960 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:31.425904 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c2518b2b-81fb-4e88-97d7-36274a995550-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-g65cg\" (UID: \"c2518b2b-81fb-4e88-97d7-36274a995550\") " pod="openshift-insights/insights-runtime-extractor-g65cg" Jul 09 04:16:31.426126 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:31.425976 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c2518b2b-81fb-4e88-97d7-36274a995550-data-volume\") pod \"insights-runtime-extractor-g65cg\" (UID: \"c2518b2b-81fb-4e88-97d7-36274a995550\") " pod="openshift-insights/insights-runtime-extractor-g65cg" Jul 09 04:16:31.426126 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:31.426069 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c2518b2b-81fb-4e88-97d7-36274a995550-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-g65cg\" (UID: \"c2518b2b-81fb-4e88-97d7-36274a995550\") " pod="openshift-insights/insights-runtime-extractor-g65cg" Jul 09 04:16:31.426225 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:31.426123 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l9jjv\" (UniqueName: \"kubernetes.io/projected/c2518b2b-81fb-4e88-97d7-36274a995550-kube-api-access-l9jjv\") pod \"insights-runtime-extractor-g65cg\" (UID: \"c2518b2b-81fb-4e88-97d7-36274a995550\") " pod="openshift-insights/insights-runtime-extractor-g65cg" Jul 09 04:16:31.426225 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:31.426167 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c2518b2b-81fb-4e88-97d7-36274a995550-crio-socket\") pod \"insights-runtime-extractor-g65cg\" (UID: \"c2518b2b-81fb-4e88-97d7-36274a995550\") " pod="openshift-insights/insights-runtime-extractor-g65cg" Jul 09 04:16:31.473246 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:31.473214 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l8qcx_060291ce-8ee2-46f6-96cf-c2e8ea5804d1/konnectivity-agent/0.log" limit=1024 Jul 09 04:16:31.527376 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:31.527338 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c2518b2b-81fb-4e88-97d7-36274a995550-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-g65cg\" (UID: \"c2518b2b-81fb-4e88-97d7-36274a995550\") " pod="openshift-insights/insights-runtime-extractor-g65cg" Jul 09 04:16:31.527376 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:31.527381 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c2518b2b-81fb-4e88-97d7-36274a995550-data-volume\") pod \"insights-runtime-extractor-g65cg\" (UID: \"c2518b2b-81fb-4e88-97d7-36274a995550\") " pod="openshift-insights/insights-runtime-extractor-g65cg" Jul 09 04:16:31.527633 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:31.527506 2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 04:16:31.527633 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:31.527571 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c2518b2b-81fb-4e88-97d7-36274a995550-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-g65cg\" (UID: \"c2518b2b-81fb-4e88-97d7-36274a995550\") " pod="openshift-insights/insights-runtime-extractor-g65cg" Jul 09 04:16:31.527633 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:31.527584 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2518b2b-81fb-4e88-97d7-36274a995550-insights-runtime-extractor-tls podName:c2518b2b-81fb-4e88-97d7-36274a995550 nodeName:}" failed. No retries permitted until 2026-07-09 04:16:32.027565018 +0000 UTC m=+49.644463216 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c2518b2b-81fb-4e88-97d7-36274a995550-insights-runtime-extractor-tls") pod "insights-runtime-extractor-g65cg" (UID: "c2518b2b-81fb-4e88-97d7-36274a995550") : secret "insights-runtime-extractor-tls" not found Jul 09 04:16:31.527633 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:31.527628 2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 04:16:31.527832 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:31.527634 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9jjv\" (UniqueName: \"kubernetes.io/projected/c2518b2b-81fb-4e88-97d7-36274a995550-kube-api-access-l9jjv\") pod \"insights-runtime-extractor-g65cg\" (UID: \"c2518b2b-81fb-4e88-97d7-36274a995550\") " pod="openshift-insights/insights-runtime-extractor-g65cg" Jul 09 04:16:31.527832 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:31.527676 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c2518b2b-81fb-4e88-97d7-36274a995550-crio-socket\") pod \"insights-runtime-extractor-g65cg\" (UID: \"c2518b2b-81fb-4e88-97d7-36274a995550\") " pod="openshift-insights/insights-runtime-extractor-g65cg" Jul 09 04:16:31.527832 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:31.527689 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c2518b2b-81fb-4e88-97d7-36274a995550-kube-rbac-proxy-cm podName:c2518b2b-81fb-4e88-97d7-36274a995550 nodeName:}" failed. No retries permitted until 2026-07-09 04:16:32.027673429 +0000 UTC m=+49.644571629 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c2518b2b-81fb-4e88-97d7-36274a995550-kube-rbac-proxy-cm") pod "insights-runtime-extractor-g65cg" (UID: "c2518b2b-81fb-4e88-97d7-36274a995550") : configmap "kube-rbac-proxy" not found Jul 09 04:16:31.527832 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:31.527734 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c2518b2b-81fb-4e88-97d7-36274a995550-crio-socket\") pod \"insights-runtime-extractor-g65cg\" (UID: \"c2518b2b-81fb-4e88-97d7-36274a995550\") " pod="openshift-insights/insights-runtime-extractor-g65cg" Jul 09 04:16:31.527832 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:31.527768 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c2518b2b-81fb-4e88-97d7-36274a995550-data-volume\") pod \"insights-runtime-extractor-g65cg\" (UID: \"c2518b2b-81fb-4e88-97d7-36274a995550\") " pod="openshift-insights/insights-runtime-extractor-g65cg" Jul 09 04:16:31.537569 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:31.537522 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l9jjv\" (UniqueName: \"kubernetes.io/projected/c2518b2b-81fb-4e88-97d7-36274a995550-kube-api-access-l9jjv\") pod \"insights-runtime-extractor-g65cg\" (UID: \"c2518b2b-81fb-4e88-97d7-36274a995550\") " pod="openshift-insights/insights-runtime-extractor-g65cg" Jul 09 04:16:32.033758 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:32.033717 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c2518b2b-81fb-4e88-97d7-36274a995550-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-g65cg\" (UID: \"c2518b2b-81fb-4e88-97d7-36274a995550\") " pod="openshift-insights/insights-runtime-extractor-g65cg" Jul 09 04:16:32.034009 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:32.033875 2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 04:16:32.034009 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:32.033882 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c2518b2b-81fb-4e88-97d7-36274a995550-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-g65cg\" (UID: \"c2518b2b-81fb-4e88-97d7-36274a995550\") " pod="openshift-insights/insights-runtime-extractor-g65cg" Jul 09 04:16:32.034009 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:32.033967 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c2518b2b-81fb-4e88-97d7-36274a995550-kube-rbac-proxy-cm podName:c2518b2b-81fb-4e88-97d7-36274a995550 nodeName:}" failed. No retries permitted until 2026-07-09 04:16:33.033950265 +0000 UTC m=+50.650848463 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c2518b2b-81fb-4e88-97d7-36274a995550-kube-rbac-proxy-cm") pod "insights-runtime-extractor-g65cg" (UID: "c2518b2b-81fb-4e88-97d7-36274a995550") : configmap "kube-rbac-proxy" not found Jul 09 04:16:32.034009 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:32.033997 2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 04:16:32.034191 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:32.034059 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2518b2b-81fb-4e88-97d7-36274a995550-insights-runtime-extractor-tls podName:c2518b2b-81fb-4e88-97d7-36274a995550 nodeName:}" failed. No retries permitted until 2026-07-09 04:16:33.034043851 +0000 UTC m=+50.650942063 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c2518b2b-81fb-4e88-97d7-36274a995550-insights-runtime-extractor-tls") pod "insights-runtime-extractor-g65cg" (UID: "c2518b2b-81fb-4e88-97d7-36274a995550") : secret "insights-runtime-extractor-tls" not found Jul 09 04:16:32.151217 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:32.151182 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xf5wq" event={"ID":"fee2629f-8880-4f02-bf6b-26317084c049","Type":"ContainerStarted","Data":"a9681eb601c489b31ab02980f612c90ba234e475545c61fa6cb00f76f05fb054"} Jul 09 04:16:32.153194 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:32.153172 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-lhzlx_a6976b04-fd52-4288-8d24-fb34cc801459/console-operator/1.log" Jul 09 04:16:32.153470 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:32.153453 2566 scope.go:117] "RemoveContainer" containerID="2a6f648de11f3f19dbbd722f8f00134a56282952564e172d7242fe1095c62643" Jul 09 04:16:32.153658 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:32.153634 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-lhzlx_openshift-console-operator(a6976b04-fd52-4288-8d24-fb34cc801459)\"" pod="openshift-console-operator/console-operator-68b757fb67-lhzlx" podUID="a6976b04-fd52-4288-8d24-fb34cc801459" Jul 09 04:16:32.177315 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:32.177253 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-xf5wq" podStartSLOduration=9.123835386 podStartE2EDuration="49.177234695s" totalImagesPullingTime="40.053399309s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 04:15:43 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:16:32.175362182 +0000 UTC m=+49.792260451" watchObservedRunningTime="2026-07-09 04:16:32.177234695 +0000 UTC m=+49.794132919" Jul 09 04:16:32.270692 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:32.270648 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l8qcx_060291ce-8ee2-46f6-96cf-c2e8ea5804d1/konnectivity-agent/0.log" limit=1024 Jul 09 04:16:32.371227 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:32.371151 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l8qcx_060291ce-8ee2-46f6-96cf-c2e8ea5804d1/konnectivity-agent/0.log" limit=1024 Jul 09 04:16:32.707822 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:32.707802 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-758f599c5-pwjj6"] Jul 09 04:16:32.725322 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:32.725291 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-pwjj6"] Jul 09 04:16:32.725505 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:32.725387 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-pwjj6" Jul 09 04:16:32.728318 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:32.728294 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-pmfz4\"" Jul 09 04:16:32.728318 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:32.728305 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 09 04:16:32.728502 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:32.728294 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 09 04:16:32.729822 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:32.729798 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 09 04:16:32.729970 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:32.729845 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 09 04:16:32.740275 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:32.740242 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/fa285a9c-ee3d-4cfc-a953-8f06b69cecbe-signing-key\") pod \"service-ca-758f599c5-pwjj6\" (UID: \"fa285a9c-ee3d-4cfc-a953-8f06b69cecbe\") " pod="openshift-service-ca/service-ca-758f599c5-pwjj6" Jul 09 04:16:32.740563 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:32.740539 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/fa285a9c-ee3d-4cfc-a953-8f06b69cecbe-signing-cabundle\") pod \"service-ca-758f599c5-pwjj6\" (UID: \"fa285a9c-ee3d-4cfc-a953-8f06b69cecbe\") " pod="openshift-service-ca/service-ca-758f599c5-pwjj6" Jul 09 04:16:32.740748 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:32.740664 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mlxn\" (UniqueName: \"kubernetes.io/projected/fa285a9c-ee3d-4cfc-a953-8f06b69cecbe-kube-api-access-5mlxn\") pod \"service-ca-758f599c5-pwjj6\" (UID: \"fa285a9c-ee3d-4cfc-a953-8f06b69cecbe\") " pod="openshift-service-ca/service-ca-758f599c5-pwjj6" Jul 09 04:16:32.743341 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:32.743299 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l8qcx_060291ce-8ee2-46f6-96cf-c2e8ea5804d1/konnectivity-agent/0.log" limit=1024 Jul 09 04:16:32.842018 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:32.841981 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5mlxn\" (UniqueName: \"kubernetes.io/projected/fa285a9c-ee3d-4cfc-a953-8f06b69cecbe-kube-api-access-5mlxn\") pod \"service-ca-758f599c5-pwjj6\" (UID: \"fa285a9c-ee3d-4cfc-a953-8f06b69cecbe\") " pod="openshift-service-ca/service-ca-758f599c5-pwjj6" Jul 09 04:16:32.842219 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:32.842055 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/fa285a9c-ee3d-4cfc-a953-8f06b69cecbe-signing-key\") pod \"service-ca-758f599c5-pwjj6\" (UID: \"fa285a9c-ee3d-4cfc-a953-8f06b69cecbe\") " pod="openshift-service-ca/service-ca-758f599c5-pwjj6" Jul 09 04:16:32.842283 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:32.842245 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/fa285a9c-ee3d-4cfc-a953-8f06b69cecbe-signing-cabundle\") pod \"service-ca-758f599c5-pwjj6\" (UID: \"fa285a9c-ee3d-4cfc-a953-8f06b69cecbe\") " pod="openshift-service-ca/service-ca-758f599c5-pwjj6" Jul 09 04:16:32.842945 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:32.842904 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/fa285a9c-ee3d-4cfc-a953-8f06b69cecbe-signing-cabundle\") pod \"service-ca-758f599c5-pwjj6\" (UID: \"fa285a9c-ee3d-4cfc-a953-8f06b69cecbe\") " pod="openshift-service-ca/service-ca-758f599c5-pwjj6" Jul 09 04:16:32.844775 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:32.844749 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/fa285a9c-ee3d-4cfc-a953-8f06b69cecbe-signing-key\") pod \"service-ca-758f599c5-pwjj6\" (UID: \"fa285a9c-ee3d-4cfc-a953-8f06b69cecbe\") " pod="openshift-service-ca/service-ca-758f599c5-pwjj6" Jul 09 04:16:32.850430 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:32.850406 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5mlxn\" (UniqueName: \"kubernetes.io/projected/fa285a9c-ee3d-4cfc-a953-8f06b69cecbe-kube-api-access-5mlxn\") pod \"service-ca-758f599c5-pwjj6\" (UID: \"fa285a9c-ee3d-4cfc-a953-8f06b69cecbe\") " pod="openshift-service-ca/service-ca-758f599c5-pwjj6" Jul 09 04:16:33.043479 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:33.043437 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c2518b2b-81fb-4e88-97d7-36274a995550-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-g65cg\" (UID: \"c2518b2b-81fb-4e88-97d7-36274a995550\") " pod="openshift-insights/insights-runtime-extractor-g65cg" Jul 09 04:16:33.043701 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:33.043580 2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 04:16:33.043701 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:33.043585 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c2518b2b-81fb-4e88-97d7-36274a995550-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-g65cg\" (UID: \"c2518b2b-81fb-4e88-97d7-36274a995550\") " pod="openshift-insights/insights-runtime-extractor-g65cg" Jul 09 04:16:33.043701 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:33.043657 2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 04:16:33.043701 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:33.043662 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c2518b2b-81fb-4e88-97d7-36274a995550-kube-rbac-proxy-cm podName:c2518b2b-81fb-4e88-97d7-36274a995550 nodeName:}" failed. No retries permitted until 2026-07-09 04:16:35.043640485 +0000 UTC m=+52.660538686 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c2518b2b-81fb-4e88-97d7-36274a995550-kube-rbac-proxy-cm") pod "insights-runtime-extractor-g65cg" (UID: "c2518b2b-81fb-4e88-97d7-36274a995550") : configmap "kube-rbac-proxy" not found Jul 09 04:16:33.043853 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:33.043706 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2518b2b-81fb-4e88-97d7-36274a995550-insights-runtime-extractor-tls podName:c2518b2b-81fb-4e88-97d7-36274a995550 nodeName:}" failed. No retries permitted until 2026-07-09 04:16:35.043691362 +0000 UTC m=+52.660589563 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c2518b2b-81fb-4e88-97d7-36274a995550-insights-runtime-extractor-tls") pod "insights-runtime-extractor-g65cg" (UID: "c2518b2b-81fb-4e88-97d7-36274a995550") : secret "insights-runtime-extractor-tls" not found Jul 09 04:16:33.065092 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:33.065060 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-pwjj6" Jul 09 04:16:33.158513 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:33.158469 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-lmjbt" event={"ID":"baa359d9-92f1-40e4-84b9-bbeb07910bb6","Type":"ContainerStarted","Data":"4dc181994ca5cfb7162e894d3ac20597aa20c588b36c9269c6108207d2724d1f"} Jul 09 04:16:33.158959 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:33.158564 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-lmjbt" event={"ID":"baa359d9-92f1-40e4-84b9-bbeb07910bb6","Type":"ContainerStarted","Data":"8700aec2520c01cc2599467f69d01a560268983c9219a3d4458b161777f61b98"} Jul 09 04:16:33.171063 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:33.171040 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-c6vdp_3562e386-fc03-4589-8bb4-2f36cf7ba1be/dns-node-resolver/0.log" Jul 09 04:16:33.175775 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:33.175720 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-lmjbt" podStartSLOduration=1.2332248080000001 podStartE2EDuration="3.175699114s" totalImagesPullingTime="1.942474306s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:16:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:16:33.174443077 +0000 UTC m=+50.791341324" watchObservedRunningTime="2026-07-09 04:16:33.175699114 +0000 UTC m=+50.792597534" Jul 09 04:16:33.216633 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:33.216609 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-pwjj6"] Jul 09 04:16:33.219112 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:16:33.219078 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa285a9c_ee3d_4cfc_a953_8f06b69cecbe.slice/crio-d56df65246e0368e914224281cfe4bbf61c1b55138078a611a3a7e483527661f WatchSource:0}: Error finding container d56df65246e0368e914224281cfe4bbf61c1b55138078a611a3a7e483527661f: Status 404 returned error can't find the container with id d56df65246e0368e914224281cfe4bbf61c1b55138078a611a3a7e483527661f Jul 09 04:16:33.247551 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:33.247522 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l8qcx_060291ce-8ee2-46f6-96cf-c2e8ea5804d1/konnectivity-agent/0.log" limit=1024 Jul 09 04:16:33.305244 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:33.305160 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l8qcx_060291ce-8ee2-46f6-96cf-c2e8ea5804d1/konnectivity-agent/0.log" limit=1024 Jul 09 04:16:33.652637 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:33.652547 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l8qcx_060291ce-8ee2-46f6-96cf-c2e8ea5804d1/konnectivity-agent/0.log" limit=1024 Jul 09 04:16:34.155580 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:34.155541 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/48514bce-8ca3-41aa-b388-06e16f306fe1-metrics-tls\") pod \"dns-default-z8vt7\" (UID: \"48514bce-8ca3-41aa-b388-06e16f306fe1\") " pod="openshift-dns/dns-default-z8vt7" Jul 09 04:16:34.155757 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:34.155584 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3b55ef5-ee9e-47f4-85ae-08fec2d8b98e-service-ca-bundle\") pod \"router-default-7c74886bd5-pn4hl\" (UID: \"e3b55ef5-ee9e-47f4-85ae-08fec2d8b98e\") " pod="openshift-ingress/router-default-7c74886bd5-pn4hl" Jul 09 04:16:34.155757 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:34.155611 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b7903a28-a0b8-4567-ac5c-d18b25565947-registry-tls\") pod \"image-registry-679fd94dd5-pmxfd\" (UID: \"b7903a28-a0b8-4567-ac5c-d18b25565947\") " pod="openshift-image-registry/image-registry-679fd94dd5-pmxfd" Jul 09 04:16:34.155757 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:34.155712 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 04:16:34.155757 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:34.155722 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/916c78d9-c922-4dc4-8cc5-8b887e7999d3-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-5nq2g\" (UID: \"916c78d9-c922-4dc4-8cc5-8b887e7999d3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-5nq2g" Jul 09 04:16:34.155977 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:34.155757 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/be7de4e5-23b0-463b-8618-d0bb0a0895b6-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-d9vmv\" (UID: \"be7de4e5-23b0-463b-8618-d0bb0a0895b6\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-d9vmv" Jul 09 04:16:34.155977 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:34.155714 2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 04:16:34.155977 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:34.155783 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/48514bce-8ca3-41aa-b388-06e16f306fe1-metrics-tls podName:48514bce-8ca3-41aa-b388-06e16f306fe1 nodeName:}" failed. No retries permitted until 2026-07-09 04:16:50.155762959 +0000 UTC m=+67.772661159 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/48514bce-8ca3-41aa-b388-06e16f306fe1-metrics-tls") pod "dns-default-z8vt7" (UID: "48514bce-8ca3-41aa-b388-06e16f306fe1") : secret "dns-default-metrics-tls" not found Jul 09 04:16:34.155977 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:34.155790 2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-679fd94dd5-pmxfd: secret "image-registry-tls" not found Jul 09 04:16:34.155977 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:34.155819 2566 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 09 04:16:34.155977 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:34.155827 2566 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 09 04:16:34.155977 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:34.155853 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e3b55ef5-ee9e-47f4-85ae-08fec2d8b98e-service-ca-bundle podName:e3b55ef5-ee9e-47f4-85ae-08fec2d8b98e nodeName:}" failed. No retries permitted until 2026-07-09 04:16:50.155835947 +0000 UTC m=+67.772734159 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e3b55ef5-ee9e-47f4-85ae-08fec2d8b98e-service-ca-bundle") pod "router-default-7c74886bd5-pn4hl" (UID: "e3b55ef5-ee9e-47f4-85ae-08fec2d8b98e") : configmap references non-existent config key: service-ca.crt Jul 09 04:16:34.155977 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:34.155881 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b7903a28-a0b8-4567-ac5c-d18b25565947-registry-tls podName:b7903a28-a0b8-4567-ac5c-d18b25565947 nodeName:}" failed. No retries permitted until 2026-07-09 04:16:50.155872088 +0000 UTC m=+67.772770290 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b7903a28-a0b8-4567-ac5c-d18b25565947-registry-tls") pod "image-registry-679fd94dd5-pmxfd" (UID: "b7903a28-a0b8-4567-ac5c-d18b25565947") : secret "image-registry-tls" not found Jul 09 04:16:34.155977 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:34.155899 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be7de4e5-23b0-463b-8618-d0bb0a0895b6-cluster-monitoring-operator-tls podName:be7de4e5-23b0-463b-8618-d0bb0a0895b6 nodeName:}" failed. No retries permitted until 2026-07-09 04:16:50.155890223 +0000 UTC m=+67.772788425 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/be7de4e5-23b0-463b-8618-d0bb0a0895b6-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-d9vmv" (UID: "be7de4e5-23b0-463b-8618-d0bb0a0895b6") : secret "cluster-monitoring-operator-tls" not found Jul 09 04:16:34.155977 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:34.155933 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/916c78d9-c922-4dc4-8cc5-8b887e7999d3-samples-operator-tls podName:916c78d9-c922-4dc4-8cc5-8b887e7999d3 nodeName:}" failed. No retries permitted until 2026-07-09 04:16:50.155924587 +0000 UTC m=+67.772822790 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/916c78d9-c922-4dc4-8cc5-8b887e7999d3-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-5nq2g" (UID: "916c78d9-c922-4dc4-8cc5-8b887e7999d3") : secret "samples-operator-tls" not found Jul 09 04:16:34.156272 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:34.156004 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/36b72c73-bb0b-4e08-95c8-7f1f263f46f4-registry-tls\") pod \"image-registry-5bb6bc998-jhp7f\" (UID: \"36b72c73-bb0b-4e08-95c8-7f1f263f46f4\") " pod="openshift-image-registry/image-registry-5bb6bc998-jhp7f" Jul 09 04:16:34.156272 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:34.156032 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3b55ef5-ee9e-47f4-85ae-08fec2d8b98e-metrics-certs\") pod \"router-default-7c74886bd5-pn4hl\" (UID: \"e3b55ef5-ee9e-47f4-85ae-08fec2d8b98e\") " pod="openshift-ingress/router-default-7c74886bd5-pn4hl" Jul 09 04:16:34.156272 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:34.156136 2566 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 09 04:16:34.156272 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:34.156149 2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 04:16:34.156272 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:34.156163 2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bb6bc998-jhp7f: secret "image-registry-tls" not found Jul 09 04:16:34.156272 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:34.156179 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3b55ef5-ee9e-47f4-85ae-08fec2d8b98e-metrics-certs podName:e3b55ef5-ee9e-47f4-85ae-08fec2d8b98e nodeName:}" failed. No retries permitted until 2026-07-09 04:16:50.156168499 +0000 UTC m=+67.773066700 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e3b55ef5-ee9e-47f4-85ae-08fec2d8b98e-metrics-certs") pod "router-default-7c74886bd5-pn4hl" (UID: "e3b55ef5-ee9e-47f4-85ae-08fec2d8b98e") : secret "router-metrics-certs-default" not found Jul 09 04:16:34.156272 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:34.156213 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/36b72c73-bb0b-4e08-95c8-7f1f263f46f4-registry-tls podName:36b72c73-bb0b-4e08-95c8-7f1f263f46f4 nodeName:}" failed. No retries permitted until 2026-07-09 04:16:50.156201161 +0000 UTC m=+67.773099358 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/36b72c73-bb0b-4e08-95c8-7f1f263f46f4-registry-tls") pod "image-registry-5bb6bc998-jhp7f" (UID: "36b72c73-bb0b-4e08-95c8-7f1f263f46f4") : secret "image-registry-tls" not found Jul 09 04:16:34.163459 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:34.163423 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-pwjj6" event={"ID":"fa285a9c-ee3d-4cfc-a953-8f06b69cecbe","Type":"ContainerStarted","Data":"2d16074be1ba67de698b7d6b8288e2f1db56a6cf005d23c31567c23f541f1527"} Jul 09 04:16:34.163808 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:34.163471 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-pwjj6" event={"ID":"fa285a9c-ee3d-4cfc-a953-8f06b69cecbe","Type":"ContainerStarted","Data":"d56df65246e0368e914224281cfe4bbf61c1b55138078a611a3a7e483527661f"} Jul 09 04:16:34.171232 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:34.171203 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-h48tl_f291469f-093e-496e-96de-8c04b337980b/node-ca/0.log" Jul 09 04:16:34.180097 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:34.180047 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-758f599c5-pwjj6" podStartSLOduration=2.180028129 podStartE2EDuration="2.180028129s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:16:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:16:34.17955043 +0000 UTC m=+51.796448670" watchObservedRunningTime="2026-07-09 04:16:34.180028129 +0000 UTC m=+51.796926404" Jul 09 04:16:34.571251 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:34.571194 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-qthv7_d6f634f8-361d-4b31-b9d4-9738cf65153b/serve-healthcheck-canary/0.log" Jul 09 04:16:34.709038 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:34.708992 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l8qcx_060291ce-8ee2-46f6-96cf-c2e8ea5804d1/konnectivity-agent/0.log" limit=1024 Jul 09 04:16:34.771680 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:34.771633 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-lmjbt_baa359d9-92f1-40e4-84b9-bbeb07910bb6/migrator/0.log" Jul 09 04:16:34.977059 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:34.977022 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-lmjbt_baa359d9-92f1-40e4-84b9-bbeb07910bb6/graceful-termination/0.log" Jul 09 04:16:35.027189 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:35.027154 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l8qcx_060291ce-8ee2-46f6-96cf-c2e8ea5804d1/konnectivity-agent/0.log" limit=1024 Jul 09 04:16:35.066213 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:35.066175 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c2518b2b-81fb-4e88-97d7-36274a995550-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-g65cg\" (UID: \"c2518b2b-81fb-4e88-97d7-36274a995550\") " pod="openshift-insights/insights-runtime-extractor-g65cg" Jul 09 04:16:35.066405 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:35.066311 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c2518b2b-81fb-4e88-97d7-36274a995550-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-g65cg\" (UID: \"c2518b2b-81fb-4e88-97d7-36274a995550\") " pod="openshift-insights/insights-runtime-extractor-g65cg" Jul 09 04:16:35.066405 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:35.066366 2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 04:16:35.066528 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:35.066444 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2518b2b-81fb-4e88-97d7-36274a995550-insights-runtime-extractor-tls podName:c2518b2b-81fb-4e88-97d7-36274a995550 nodeName:}" failed. No retries permitted until 2026-07-09 04:16:39.066423555 +0000 UTC m=+56.683321764 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c2518b2b-81fb-4e88-97d7-36274a995550-insights-runtime-extractor-tls") pod "insights-runtime-extractor-g65cg" (UID: "c2518b2b-81fb-4e88-97d7-36274a995550") : secret "insights-runtime-extractor-tls" not found Jul 09 04:16:35.067036 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:35.067016 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c2518b2b-81fb-4e88-97d7-36274a995550-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-g65cg\" (UID: \"c2518b2b-81fb-4e88-97d7-36274a995550\") " pod="openshift-insights/insights-runtime-extractor-g65cg" Jul 09 04:16:35.129069 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:35.129027 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l8qcx_060291ce-8ee2-46f6-96cf-c2e8ea5804d1/konnectivity-agent/0.log" limit=1024 Jul 09 04:16:35.173833 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:35.173804 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-8stqx_1095557e-f542-4e1d-a462-0a024f80347e/kube-storage-version-migrator-operator/0.log" Jul 09 04:16:35.269182 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:35.269075 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/73292436-9d26-4890-a595-3a417aedd88d-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-rct7b\" (UID: \"73292436-9d26-4890-a595-3a417aedd88d\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-rct7b" Jul 09 04:16:35.269345 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:35.269291 2566 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 09 04:16:35.269400 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:35.269352 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73292436-9d26-4890-a595-3a417aedd88d-networking-console-plugin-cert podName:73292436-9d26-4890-a595-3a417aedd88d nodeName:}" failed. No retries permitted until 2026-07-09 04:16:43.26933293 +0000 UTC m=+60.886231131 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/73292436-9d26-4890-a595-3a417aedd88d-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-rct7b" (UID: "73292436-9d26-4890-a595-3a417aedd88d") : secret "networking-console-plugin-cert" not found Jul 09 04:16:35.277281 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:35.277245 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l8qcx_060291ce-8ee2-46f6-96cf-c2e8ea5804d1/konnectivity-agent/0.log" limit=1024 Jul 09 04:16:35.383419 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:35.383386 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l8qcx_060291ce-8ee2-46f6-96cf-c2e8ea5804d1/konnectivity-agent/0.log" limit=1024 Jul 09 04:16:35.475764 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:35.475696 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l8qcx_060291ce-8ee2-46f6-96cf-c2e8ea5804d1/konnectivity-agent/0.log" limit=1024 Jul 09 04:16:35.707240 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:35.707156 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l8qcx_060291ce-8ee2-46f6-96cf-c2e8ea5804d1/konnectivity-agent/0.log" limit=1024 Jul 09 04:16:36.389993 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:36.389954 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l8qcx_060291ce-8ee2-46f6-96cf-c2e8ea5804d1/konnectivity-agent/0.log" limit=1024 Jul 09 04:16:36.490348 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:36.490316 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l8qcx_060291ce-8ee2-46f6-96cf-c2e8ea5804d1/konnectivity-agent/0.log" limit=1024 Jul 09 04:16:36.548606 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:36.548568 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l8qcx_060291ce-8ee2-46f6-96cf-c2e8ea5804d1/konnectivity-agent/0.log" limit=1024 Jul 09 04:16:36.766828 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:36.766786 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l8qcx_060291ce-8ee2-46f6-96cf-c2e8ea5804d1/konnectivity-agent/0.log" limit=1024 Jul 09 04:16:37.113496 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:37.113404 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l8qcx_060291ce-8ee2-46f6-96cf-c2e8ea5804d1/konnectivity-agent/0.log" limit=1024 Jul 09 04:16:37.316940 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:37.316882 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l8qcx_060291ce-8ee2-46f6-96cf-c2e8ea5804d1/konnectivity-agent/0.log" limit=1024 Jul 09 04:16:37.717602 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:37.717550 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l8qcx_060291ce-8ee2-46f6-96cf-c2e8ea5804d1/konnectivity-agent/0.log" limit=1024 Jul 09 04:16:37.916680 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:37.916646 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l8qcx_060291ce-8ee2-46f6-96cf-c2e8ea5804d1/konnectivity-agent/0.log" limit=1024 Jul 09 04:16:38.310542 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:38.310501 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l8qcx_060291ce-8ee2-46f6-96cf-c2e8ea5804d1/konnectivity-agent/0.log" limit=1024 Jul 09 04:16:38.635257 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:38.635170 2566 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-lhzlx" Jul 09 04:16:38.635257 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:38.635226 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-lhzlx" Jul 09 04:16:38.635588 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:38.635575 2566 scope.go:117] "RemoveContainer" containerID="2a6f648de11f3f19dbbd722f8f00134a56282952564e172d7242fe1095c62643" Jul 09 04:16:38.635737 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:38.635719 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-lhzlx_openshift-console-operator(a6976b04-fd52-4288-8d24-fb34cc801459)\"" pod="openshift-console-operator/console-operator-68b757fb67-lhzlx" podUID="a6976b04-fd52-4288-8d24-fb34cc801459" Jul 09 04:16:38.710824 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:38.710783 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l8qcx_060291ce-8ee2-46f6-96cf-c2e8ea5804d1/konnectivity-agent/0.log" limit=1024 Jul 09 04:16:38.961275 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:38.961173 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l8qcx_060291ce-8ee2-46f6-96cf-c2e8ea5804d1/konnectivity-agent/0.log" limit=1024 Jul 09 04:16:39.106302 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:39.106266 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l8qcx_060291ce-8ee2-46f6-96cf-c2e8ea5804d1/konnectivity-agent/0.log" limit=1024 Jul 09 04:16:39.110427 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:39.110394 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c2518b2b-81fb-4e88-97d7-36274a995550-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-g65cg\" (UID: \"c2518b2b-81fb-4e88-97d7-36274a995550\") " pod="openshift-insights/insights-runtime-extractor-g65cg" Jul 09 04:16:39.110609 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:39.110574 2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 04:16:39.110661 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:16:39.110650 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2518b2b-81fb-4e88-97d7-36274a995550-insights-runtime-extractor-tls podName:c2518b2b-81fb-4e88-97d7-36274a995550 nodeName:}" failed. No retries permitted until 2026-07-09 04:16:47.110633589 +0000 UTC m=+64.727531786 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c2518b2b-81fb-4e88-97d7-36274a995550-insights-runtime-extractor-tls") pod "insights-runtime-extractor-g65cg" (UID: "c2518b2b-81fb-4e88-97d7-36274a995550") : secret "insights-runtime-extractor-tls" not found Jul 09 04:16:39.306488 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:39.306451 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l8qcx_060291ce-8ee2-46f6-96cf-c2e8ea5804d1/konnectivity-agent/0.log" limit=1024 Jul 09 04:16:39.709106 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:39.708993 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l8qcx_060291ce-8ee2-46f6-96cf-c2e8ea5804d1/konnectivity-agent/0.log" limit=1024 Jul 09 04:16:39.763285 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:39.763248 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l8qcx_060291ce-8ee2-46f6-96cf-c2e8ea5804d1/konnectivity-agent/0.log" limit=1024 Jul 09 04:16:39.910640 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:39.910601 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l8qcx_060291ce-8ee2-46f6-96cf-c2e8ea5804d1/konnectivity-agent/0.log" limit=1024 Jul 09 04:16:40.321542 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:40.321510 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l8qcx_060291ce-8ee2-46f6-96cf-c2e8ea5804d1/konnectivity-agent/0.log" limit=1024 Jul 09 04:16:40.378408 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:40.378370 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l8qcx_060291ce-8ee2-46f6-96cf-c2e8ea5804d1/konnectivity-agent/0.log" limit=1024 Jul 09 04:16:40.517616 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:40.517567 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l8qcx_060291ce-8ee2-46f6-96cf-c2e8ea5804d1/konnectivity-agent/0.log" limit=1024 Jul 09 04:16:41.013983 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:41.013938 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l8qcx_060291ce-8ee2-46f6-96cf-c2e8ea5804d1/konnectivity-agent/0.log" limit=1024 Jul 09 04:16:41.115255 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:41.115216 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l8qcx_060291ce-8ee2-46f6-96cf-c2e8ea5804d1/konnectivity-agent/0.log" limit=1024 Jul 09 04:16:41.312314 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:41.312220 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l8qcx_060291ce-8ee2-46f6-96cf-c2e8ea5804d1/konnectivity-agent/0.log" limit=1024 Jul 09 04:16:41.713520 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:41.713435 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l8qcx_060291ce-8ee2-46f6-96cf-c2e8ea5804d1/konnectivity-agent/0.log" limit=1024 Jul 09 04:16:41.910725 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:41.910688 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l8qcx_060291ce-8ee2-46f6-96cf-c2e8ea5804d1/konnectivity-agent/0.log" limit=1024 Jul 09 04:16:42.109824 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:42.109785 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l8qcx_060291ce-8ee2-46f6-96cf-c2e8ea5804d1/konnectivity-agent/0.log" limit=1024 Jul 09 04:16:43.104759 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:43.104722 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l8qcx_060291ce-8ee2-46f6-96cf-c2e8ea5804d1/konnectivity-agent/0.log" limit=1024 Jul 09 04:16:43.348290 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:43.348236 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/73292436-9d26-4890-a595-3a417aedd88d-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-rct7b\" (UID: \"73292436-9d26-4890-a595-3a417aedd88d\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-rct7b" Jul 09 04:16:43.350928 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:43.350883 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/73292436-9d26-4890-a595-3a417aedd88d-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-rct7b\" (UID: \"73292436-9d26-4890-a595-3a417aedd88d\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-rct7b" Jul 09 04:16:43.507107 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:43.507071 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l8qcx_060291ce-8ee2-46f6-96cf-c2e8ea5804d1/konnectivity-agent/0.log" limit=1024 Jul 09 04:16:43.620674 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:43.620643 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-2cjhj\"" Jul 09 04:16:43.628541 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:43.628511 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-rct7b" Jul 09 04:16:43.707566 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:43.707533 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l8qcx_060291ce-8ee2-46f6-96cf-c2e8ea5804d1/konnectivity-agent/0.log" limit=1024 Jul 09 04:16:43.769937 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:43.769891 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-rct7b"] Jul 09 04:16:43.772462 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:16:43.772435 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73292436_9d26_4890_a595_3a417aedd88d.slice/crio-a7a288824f04b495a1cdc55a061a8dbb9410e95e10285fdb087422fc27a10f34 WatchSource:0}: Error finding container a7a288824f04b495a1cdc55a061a8dbb9410e95e10285fdb087422fc27a10f34: Status 404 returned error can't find the container with id a7a288824f04b495a1cdc55a061a8dbb9410e95e10285fdb087422fc27a10f34 Jul 09 04:16:43.908156 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:43.908121 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l8qcx_060291ce-8ee2-46f6-96cf-c2e8ea5804d1/konnectivity-agent/0.log" limit=1024 Jul 09 04:16:44.070001 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:44.069888 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gg754" Jul 09 04:16:44.103143 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:44.103110 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l8qcx_060291ce-8ee2-46f6-96cf-c2e8ea5804d1/konnectivity-agent/0.log" limit=1024 Jul 09 04:16:44.198396 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:44.198361 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-rct7b" event={"ID":"73292436-9d26-4890-a595-3a417aedd88d","Type":"ContainerStarted","Data":"a7a288824f04b495a1cdc55a061a8dbb9410e95e10285fdb087422fc27a10f34"} Jul 09 04:16:44.939226 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:44.939163 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l8qcx_060291ce-8ee2-46f6-96cf-c2e8ea5804d1/konnectivity-agent/0.log" limit=1024 Jul 09 04:16:45.107698 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:45.107657 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l8qcx_060291ce-8ee2-46f6-96cf-c2e8ea5804d1/konnectivity-agent/0.log" limit=1024 Jul 09 04:16:45.308191 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:45.308158 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l8qcx_060291ce-8ee2-46f6-96cf-c2e8ea5804d1/konnectivity-agent/0.log" limit=1024 Jul 09 04:16:45.612396 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:45.612363 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l8qcx_060291ce-8ee2-46f6-96cf-c2e8ea5804d1/konnectivity-agent/0.log" limit=1024 Jul 09 04:16:45.713971 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:45.713898 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l8qcx_060291ce-8ee2-46f6-96cf-c2e8ea5804d1/konnectivity-agent/0.log" limit=1024 Jul 09 04:16:46.206379 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:46.206346 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-rct7b" event={"ID":"73292436-9d26-4890-a595-3a417aedd88d","Type":"ContainerStarted","Data":"59a553cc74e62d7e8ea204ce78be9e26bb567d30ffa078aeb3fd26eb50238f26"} Jul 09 04:16:46.222803 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:46.222750 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6bffdf9778-rct7b" podStartSLOduration=17.792421545 podStartE2EDuration="19.222732647s" totalImagesPullingTime="1.430311102s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:16:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:16:46.221195428 +0000 UTC m=+63.838093659" watchObservedRunningTime="2026-07-09 04:16:46.222732647 +0000 UTC m=+63.839630866" Jul 09 04:16:47.184950 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:47.184863 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c2518b2b-81fb-4e88-97d7-36274a995550-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-g65cg\" (UID: \"c2518b2b-81fb-4e88-97d7-36274a995550\") " pod="openshift-insights/insights-runtime-extractor-g65cg" Jul 09 04:16:47.187371 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:47.187352 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c2518b2b-81fb-4e88-97d7-36274a995550-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-g65cg\" (UID: \"c2518b2b-81fb-4e88-97d7-36274a995550\") " pod="openshift-insights/insights-runtime-extractor-g65cg" Jul 09 04:16:47.299569 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:47.299534 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-lwxll\"" Jul 09 04:16:47.307838 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:47.307811 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-g65cg" Jul 09 04:16:47.453050 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:47.452967 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-g65cg"] Jul 09 04:16:47.456566 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:16:47.456521 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2518b2b_81fb_4e88_97d7_36274a995550.slice/crio-11ebaae919e6eafc5f4c5294f937b21e7d9907c4bab3869652def7f6d5b9a712 WatchSource:0}: Error finding container 11ebaae919e6eafc5f4c5294f937b21e7d9907c4bab3869652def7f6d5b9a712: Status 404 returned error can't find the container with id 11ebaae919e6eafc5f4c5294f937b21e7d9907c4bab3869652def7f6d5b9a712 Jul 09 04:16:48.216450 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:48.216374 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-g65cg" event={"ID":"c2518b2b-81fb-4e88-97d7-36274a995550","Type":"ContainerStarted","Data":"11ebaae919e6eafc5f4c5294f937b21e7d9907c4bab3869652def7f6d5b9a712"} Jul 09 04:16:48.702085 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:48.701999 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/64f35da7-cc64-4921-b129-af733326a5f0-metrics-certs\") pod \"network-metrics-daemon-jqcts\" (UID: \"64f35da7-cc64-4921-b129-af733326a5f0\") " pod="openshift-multus/network-metrics-daemon-jqcts" Jul 09 04:16:48.702261 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:48.702142 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/32c78782-6b5e-4dc1-a3c6-048f98de9c1a-original-pull-secret\") pod \"global-pull-secret-syncer-mvrbd\" (UID: \"32c78782-6b5e-4dc1-a3c6-048f98de9c1a\") " pod="kube-system/global-pull-secret-syncer-mvrbd" Jul 09 04:16:48.705207 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:48.705181 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 09 04:16:48.705373 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:48.705230 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 09 04:16:48.715452 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:48.715419 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/64f35da7-cc64-4921-b129-af733326a5f0-metrics-certs\") pod \"network-metrics-daemon-jqcts\" (UID: \"64f35da7-cc64-4921-b129-af733326a5f0\") " pod="openshift-multus/network-metrics-daemon-jqcts" Jul 09 04:16:48.715621 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:48.715459 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/32c78782-6b5e-4dc1-a3c6-048f98de9c1a-original-pull-secret\") pod \"global-pull-secret-syncer-mvrbd\" (UID: \"32c78782-6b5e-4dc1-a3c6-048f98de9c1a\") " pod="kube-system/global-pull-secret-syncer-mvrbd" Jul 09 04:16:48.724569 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:48.724536 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mvrbd" Jul 09 04:16:48.735971 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:48.735707 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-q46hf\"" Jul 09 04:16:48.743586 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:48.743550 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jqcts" Jul 09 04:16:48.805463 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:48.804845 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xlj4k\" (UniqueName: \"kubernetes.io/projected/50794917-e43f-4a72-ba19-741b2493724a-kube-api-access-xlj4k\") pod \"network-check-target-fgq98\" (UID: \"50794917-e43f-4a72-ba19-741b2493724a\") " pod="openshift-network-diagnostics/network-check-target-fgq98" Jul 09 04:16:48.808721 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:48.808694 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xlj4k\" (UniqueName: \"kubernetes.io/projected/50794917-e43f-4a72-ba19-741b2493724a-kube-api-access-xlj4k\") pod \"network-check-target-fgq98\" (UID: \"50794917-e43f-4a72-ba19-741b2493724a\") " pod="openshift-network-diagnostics/network-check-target-fgq98" Jul 09 04:16:48.895925 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:48.895765 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-mvrbd"] Jul 09 04:16:48.898205 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:16:48.898168 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32c78782_6b5e_4dc1_a3c6_048f98de9c1a.slice/crio-256b8c3e53d8c0f35a095456e61c5babbf1be6192107dba306dc034d6b45ec20 WatchSource:0}: Error finding container 256b8c3e53d8c0f35a095456e61c5babbf1be6192107dba306dc034d6b45ec20: Status 404 returned error can't find the container with id 256b8c3e53d8c0f35a095456e61c5babbf1be6192107dba306dc034d6b45ec20 Jul 09 04:16:48.921885 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:48.921856 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-jqcts"] Jul 09 04:16:48.924508 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:16:48.924464 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64f35da7_cc64_4921_b129_af733326a5f0.slice/crio-32d4fb8a30c00c0032a22a79acb42d375c7e687b902bbe11a44e6baef68b8d9c WatchSource:0}: Error finding container 32d4fb8a30c00c0032a22a79acb42d375c7e687b902bbe11a44e6baef68b8d9c: Status 404 returned error can't find the container with id 32d4fb8a30c00c0032a22a79acb42d375c7e687b902bbe11a44e6baef68b8d9c Jul 09 04:16:48.926850 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:48.926824 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-9gr88\"" Jul 09 04:16:48.934591 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:48.934562 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fgq98" Jul 09 04:16:49.088488 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:49.088422 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-fgq98"] Jul 09 04:16:49.221578 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:49.221538 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-mvrbd" event={"ID":"32c78782-6b5e-4dc1-a3c6-048f98de9c1a","Type":"ContainerStarted","Data":"256b8c3e53d8c0f35a095456e61c5babbf1be6192107dba306dc034d6b45ec20"} Jul 09 04:16:49.222959 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:49.222935 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jqcts" event={"ID":"64f35da7-cc64-4921-b129-af733326a5f0","Type":"ContainerStarted","Data":"32d4fb8a30c00c0032a22a79acb42d375c7e687b902bbe11a44e6baef68b8d9c"} Jul 09 04:16:50.217857 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:50.217821 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/916c78d9-c922-4dc4-8cc5-8b887e7999d3-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-5nq2g\" (UID: \"916c78d9-c922-4dc4-8cc5-8b887e7999d3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-5nq2g" Jul 09 04:16:50.217857 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:50.217871 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/be7de4e5-23b0-463b-8618-d0bb0a0895b6-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-d9vmv\" (UID: \"be7de4e5-23b0-463b-8618-d0bb0a0895b6\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-d9vmv" Jul 09 04:16:50.218127 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:50.217930 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/36b72c73-bb0b-4e08-95c8-7f1f263f46f4-registry-tls\") pod \"image-registry-5bb6bc998-jhp7f\" (UID: \"36b72c73-bb0b-4e08-95c8-7f1f263f46f4\") " pod="openshift-image-registry/image-registry-5bb6bc998-jhp7f" Jul 09 04:16:50.218127 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:50.217957 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3b55ef5-ee9e-47f4-85ae-08fec2d8b98e-metrics-certs\") pod \"router-default-7c74886bd5-pn4hl\" (UID: \"e3b55ef5-ee9e-47f4-85ae-08fec2d8b98e\") " pod="openshift-ingress/router-default-7c74886bd5-pn4hl" Jul 09 04:16:50.218127 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:50.218023 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/48514bce-8ca3-41aa-b388-06e16f306fe1-metrics-tls\") pod \"dns-default-z8vt7\" (UID: \"48514bce-8ca3-41aa-b388-06e16f306fe1\") " pod="openshift-dns/dns-default-z8vt7" Jul 09 04:16:50.218127 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:50.218052 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3b55ef5-ee9e-47f4-85ae-08fec2d8b98e-service-ca-bundle\") pod \"router-default-7c74886bd5-pn4hl\" (UID: \"e3b55ef5-ee9e-47f4-85ae-08fec2d8b98e\") " pod="openshift-ingress/router-default-7c74886bd5-pn4hl" Jul 09 04:16:50.218127 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:50.218078 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b7903a28-a0b8-4567-ac5c-d18b25565947-registry-tls\") pod \"image-registry-679fd94dd5-pmxfd\" (UID: \"b7903a28-a0b8-4567-ac5c-d18b25565947\") " pod="openshift-image-registry/image-registry-679fd94dd5-pmxfd" Jul 09 04:16:50.219259 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:50.219167 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3b55ef5-ee9e-47f4-85ae-08fec2d8b98e-service-ca-bundle\") pod \"router-default-7c74886bd5-pn4hl\" (UID: \"e3b55ef5-ee9e-47f4-85ae-08fec2d8b98e\") " pod="openshift-ingress/router-default-7c74886bd5-pn4hl" Jul 09 04:16:50.221251 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:50.221198 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/916c78d9-c922-4dc4-8cc5-8b887e7999d3-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-5nq2g\" (UID: \"916c78d9-c922-4dc4-8cc5-8b887e7999d3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-5nq2g" Jul 09 04:16:50.221391 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:50.221275 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/be7de4e5-23b0-463b-8618-d0bb0a0895b6-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-d9vmv\" (UID: \"be7de4e5-23b0-463b-8618-d0bb0a0895b6\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-d9vmv" Jul 09 04:16:50.221391 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:50.221275 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/36b72c73-bb0b-4e08-95c8-7f1f263f46f4-registry-tls\") pod \"image-registry-5bb6bc998-jhp7f\" (UID: \"36b72c73-bb0b-4e08-95c8-7f1f263f46f4\") " pod="openshift-image-registry/image-registry-5bb6bc998-jhp7f" Jul 09 04:16:50.221612 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:50.221586 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b7903a28-a0b8-4567-ac5c-d18b25565947-registry-tls\") pod \"image-registry-679fd94dd5-pmxfd\" (UID: \"b7903a28-a0b8-4567-ac5c-d18b25565947\") " pod="openshift-image-registry/image-registry-679fd94dd5-pmxfd" Jul 09 04:16:50.221612 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:50.221593 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/48514bce-8ca3-41aa-b388-06e16f306fe1-metrics-tls\") pod \"dns-default-z8vt7\" (UID: \"48514bce-8ca3-41aa-b388-06e16f306fe1\") " pod="openshift-dns/dns-default-z8vt7" Jul 09 04:16:50.222035 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:50.221757 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3b55ef5-ee9e-47f4-85ae-08fec2d8b98e-metrics-certs\") pod \"router-default-7c74886bd5-pn4hl\" (UID: \"e3b55ef5-ee9e-47f4-85ae-08fec2d8b98e\") " pod="openshift-ingress/router-default-7c74886bd5-pn4hl" Jul 09 04:16:50.364892 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:16:50.364847 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50794917_e43f_4a72_ba19_741b2493724a.slice/crio-0be9b8182344195ca23905c497c97bdd9f712f722820989228796a016cf98051 WatchSource:0}: Error finding container 0be9b8182344195ca23905c497c97bdd9f712f722820989228796a016cf98051: Status 404 returned error can't find the container with id 0be9b8182344195ca23905c497c97bdd9f712f722820989228796a016cf98051 Jul 09 04:16:50.392130 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:50.392093 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-z54q4\"" Jul 09 04:16:50.398827 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:50.398798 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5bb6bc998-jhp7f" Jul 09 04:16:50.410315 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:50.410284 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-679fd94dd5-pmxfd" Jul 09 04:16:50.424704 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:50.424668 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-b8ppd\"" Jul 09 04:16:50.430080 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:50.430052 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-d9vmv" Jul 09 04:16:50.456262 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:50.456230 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-txl2n\"" Jul 09 04:16:50.461374 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:50.461342 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-5nq2g" Jul 09 04:16:50.461571 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:50.461543 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-sbbxr\"" Jul 09 04:16:50.469073 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:50.469010 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7c74886bd5-pn4hl" Jul 09 04:16:50.477384 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:50.477356 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-7xx9g\"" Jul 09 04:16:50.482020 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:50.481984 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-z8vt7" Jul 09 04:16:51.239330 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:51.239289 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-fgq98" event={"ID":"50794917-e43f-4a72-ba19-741b2493724a","Type":"ContainerStarted","Data":"0be9b8182344195ca23905c497c97bdd9f712f722820989228796a016cf98051"} Jul 09 04:16:51.910109 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:51.909494 2566 scope.go:117] "RemoveContainer" containerID="2a6f648de11f3f19dbbd722f8f00134a56282952564e172d7242fe1095c62643" Jul 09 04:16:52.069107 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:52.065994 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5bb6bc998-jhp7f"] Jul 09 04:16:52.070162 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:16:52.070128 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36b72c73_bb0b_4e08_95c8_7f1f263f46f4.slice/crio-bfff7c23a43958e018ce057542a9e1adea766f6b5bb897c783a48371dec92de3 WatchSource:0}: Error finding container bfff7c23a43958e018ce057542a9e1adea766f6b5bb897c783a48371dec92de3: Status 404 returned error can't find the container with id bfff7c23a43958e018ce057542a9e1adea766f6b5bb897c783a48371dec92de3 Jul 09 04:16:52.093497 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:52.091186 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7c74886bd5-pn4hl"] Jul 09 04:16:52.100634 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:16:52.100569 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3b55ef5_ee9e_47f4_85ae_08fec2d8b98e.slice/crio-5c6b761828acb1265346e089534f9a0513b6ba3e13bcfa072759c013d929e6ca WatchSource:0}: Error finding container 5c6b761828acb1265346e089534f9a0513b6ba3e13bcfa072759c013d929e6ca: Status 404 returned error can't find the container with id 5c6b761828acb1265346e089534f9a0513b6ba3e13bcfa072759c013d929e6ca Jul 09 04:16:52.113696 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:52.111410 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-5nq2g"] Jul 09 04:16:52.124078 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:52.124052 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-679fd94dd5-pmxfd"] Jul 09 04:16:52.151430 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:52.151340 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-z8vt7"] Jul 09 04:16:52.161441 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:52.161412 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-d9vmv"] Jul 09 04:16:52.248780 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:52.248577 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-lhzlx_a6976b04-fd52-4288-8d24-fb34cc801459/console-operator/1.log" Jul 09 04:16:52.248780 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:52.248691 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-lhzlx" event={"ID":"a6976b04-fd52-4288-8d24-fb34cc801459","Type":"ContainerStarted","Data":"7246b191e32fe45c039a496ceea5d021ffcd1a092d65b1d26a0442ec5681f5c1"} Jul 09 04:16:52.250857 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:52.249934 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-lhzlx" Jul 09 04:16:52.253434 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:52.253290 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5bb6bc998-jhp7f" event={"ID":"36b72c73-bb0b-4e08-95c8-7f1f263f46f4","Type":"ContainerStarted","Data":"fac1650f74812f7390e3237c616850b4f348d7d481b8e320f5d4d8b00271b5f5"} Jul 09 04:16:52.253434 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:52.253374 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5bb6bc998-jhp7f" event={"ID":"36b72c73-bb0b-4e08-95c8-7f1f263f46f4","Type":"ContainerStarted","Data":"bfff7c23a43958e018ce057542a9e1adea766f6b5bb897c783a48371dec92de3"} Jul 09 04:16:52.253434 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:52.253404 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5bb6bc998-jhp7f" Jul 09 04:16:52.254865 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:52.254840 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-d9vmv" event={"ID":"be7de4e5-23b0-463b-8618-d0bb0a0895b6","Type":"ContainerStarted","Data":"b785f6065a0fe1266b2b5c4df045e8e99548368a82363b29117469706323e68c"} Jul 09 04:16:52.256968 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:52.256848 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-z8vt7" event={"ID":"48514bce-8ca3-41aa-b388-06e16f306fe1","Type":"ContainerStarted","Data":"a379bd5c049c244184949b57b271d0a2206e4f5a4fa14e3c02d75d94819e9774"} Jul 09 04:16:52.259775 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:52.259129 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-679fd94dd5-pmxfd" event={"ID":"b7903a28-a0b8-4567-ac5c-d18b25565947","Type":"ContainerStarted","Data":"bf3e6d50e4032385f8a5350287ef11e6dff31b523cf30b9e3d7f041c8da2b837"} Jul 09 04:16:52.259775 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:52.259528 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-679fd94dd5-pmxfd" Jul 09 04:16:52.261533 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:52.261478 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-g65cg" event={"ID":"c2518b2b-81fb-4e88-97d7-36274a995550","Type":"ContainerStarted","Data":"8940fb140848408c404847d87ec01782ba4e5463edf56961793be31a67894505"} Jul 09 04:16:52.263849 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:52.263773 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-5nq2g" event={"ID":"916c78d9-c922-4dc4-8cc5-8b887e7999d3","Type":"ContainerStarted","Data":"225963c5cebbae222175eb13e8cf99f0675b88cfc4271d24137bc620821be193"} Jul 09 04:16:52.267737 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:52.267619 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-68b757fb67-lhzlx" podStartSLOduration=28.29298906 podStartE2EDuration="38.267599415s" totalImagesPullingTime="9.974610355s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:16:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:16:52.266272887 +0000 UTC m=+69.883171107" watchObservedRunningTime="2026-07-09 04:16:52.267599415 +0000 UTC m=+69.884497619" Jul 09 04:16:52.269546 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:52.269515 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jqcts" event={"ID":"64f35da7-cc64-4921-b129-af733326a5f0","Type":"ContainerStarted","Data":"ff6e0834ff88f00400a4587e832d308030f352f4b72fe5f11f35204a27c08a0c"} Jul 09 04:16:52.272516 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:52.272065 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7c74886bd5-pn4hl" event={"ID":"e3b55ef5-ee9e-47f4-85ae-08fec2d8b98e","Type":"ContainerStarted","Data":"9cd732436d26459990cb9478bf824869a28500fbc6b49c5805647c149df2f025"} Jul 09 04:16:52.272516 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:52.272107 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7c74886bd5-pn4hl" event={"ID":"e3b55ef5-ee9e-47f4-85ae-08fec2d8b98e","Type":"ContainerStarted","Data":"5c6b761828acb1265346e089534f9a0513b6ba3e13bcfa072759c013d929e6ca"} Jul 09 04:16:52.275166 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:52.274662 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-fgq98" event={"ID":"50794917-e43f-4a72-ba19-741b2493724a","Type":"ContainerStarted","Data":"7603038dd5136457624eb3a07d293b76ff7fd34d76efd7ecef4bce4874b2e728"} Jul 09 04:16:52.275166 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:52.275133 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-fgq98" Jul 09 04:16:52.303540 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:52.303389 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-679fd94dd5-pmxfd" podStartSLOduration=38.303365054 podStartE2EDuration="38.303365054s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:16:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:16:52.284043208 +0000 UTC m=+69.900941430" watchObservedRunningTime="2026-07-09 04:16:52.303365054 +0000 UTC m=+69.920263278" Jul 09 04:16:52.304587 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:52.304522 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5bb6bc998-jhp7f" podStartSLOduration=69.304502969 podStartE2EDuration="1m9.304502969s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:15:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:16:52.302444358 +0000 UTC m=+69.919342578" watchObservedRunningTime="2026-07-09 04:16:52.304502969 +0000 UTC m=+69.921401191" Jul 09 04:16:52.319781 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:52.319709 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-jqcts" podStartSLOduration=66.436325233 podStartE2EDuration="1m9.319683565s" totalImagesPullingTime="2.883358332s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:15:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:16:52.317702767 +0000 UTC m=+69.934600987" watchObservedRunningTime="2026-07-09 04:16:52.319683565 +0000 UTC m=+69.936581785" Jul 09 04:16:52.333330 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:52.333204 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-fgq98" podStartSLOduration=69.333186691 podStartE2EDuration="1m9.333186691s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:15:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:16:52.331807488 +0000 UTC m=+69.948705708" watchObservedRunningTime="2026-07-09 04:16:52.333186691 +0000 UTC m=+69.950084909" Jul 09 04:16:52.349603 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:52.349540 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-7c74886bd5-pn4hl" podStartSLOduration=38.349523931 podStartE2EDuration="38.349523931s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:16:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:16:52.348994489 +0000 UTC m=+69.965892778" watchObservedRunningTime="2026-07-09 04:16:52.349523931 +0000 UTC m=+69.966422150" Jul 09 04:16:52.469591 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:52.469546 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-7c74886bd5-pn4hl" Jul 09 04:16:52.473285 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:52.473249 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-7c74886bd5-pn4hl" Jul 09 04:16:52.529038 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:52.529005 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-68b757fb67-lhzlx" Jul 09 04:16:53.283569 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:53.282794 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-679fd94dd5-pmxfd" event={"ID":"b7903a28-a0b8-4567-ac5c-d18b25565947","Type":"ContainerStarted","Data":"81c1796d62b741ad4f9c82c3d3231a6cb1dc211f5c1494b5e0e0789747608e23"} Jul 09 04:16:53.286006 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:53.285828 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-g65cg" event={"ID":"c2518b2b-81fb-4e88-97d7-36274a995550","Type":"ContainerStarted","Data":"bcfcb11b1bc7ce0da1e73d43a54a702a5d7dcdc4373f4e12c008ae7f7940b312"} Jul 09 04:16:53.289219 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:53.289046 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jqcts" event={"ID":"64f35da7-cc64-4921-b129-af733326a5f0","Type":"ContainerStarted","Data":"4c13e01b5b2a36ddeff6680bac807cf892079a1b3e006c3b124a0a66c0ac583c"} Jul 09 04:16:53.290699 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:53.290181 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-7c74886bd5-pn4hl" Jul 09 04:16:53.292590 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:53.292370 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-7c74886bd5-pn4hl" Jul 09 04:16:55.757215 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:55.757178 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f5d4bccfb-8kcc8"] Jul 09 04:16:55.781997 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:55.781961 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55bd4c6fcc-wq88s"] Jul 09 04:16:55.782617 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:55.782588 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f5d4bccfb-8kcc8" Jul 09 04:16:55.787182 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:55.787158 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 09 04:16:55.795495 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:55.787235 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 09 04:16:55.795495 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:55.787288 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 09 04:16:55.795495 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:55.787634 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 09 04:16:55.795495 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:55.787814 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-nffrs\"" Jul 09 04:16:55.795495 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:55.794748 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-669b87f-945vj"] Jul 09 04:16:55.795495 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:55.794845 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55bd4c6fcc-wq88s" Jul 09 04:16:55.805495 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:55.804931 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 09 04:16:55.805495 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:55.805291 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 09 04:16:55.805495 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:55.805330 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 09 04:16:55.805495 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:55.805337 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 09 04:16:55.808982 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:55.808944 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f5d4bccfb-8kcc8"] Jul 09 04:16:55.809141 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:55.808995 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-679fd94dd5-pmxfd"] Jul 09 04:16:55.809141 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:55.809024 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55bd4c6fcc-wq88s"] Jul 09 04:16:55.809417 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:55.809397 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-669b87f-945vj" Jul 09 04:16:55.810597 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:55.810513 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-669b87f-945vj"] Jul 09 04:16:55.815412 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:55.815292 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 09 04:16:55.867621 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:55.867580 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/97330e06-5a39-4cee-804e-54631c7a8296-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7f5d4bccfb-8kcc8\" (UID: \"97330e06-5a39-4cee-804e-54631c7a8296\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f5d4bccfb-8kcc8" Jul 09 04:16:55.867807 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:55.867643 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8lv6z\" (UniqueName: \"kubernetes.io/projected/97330e06-5a39-4cee-804e-54631c7a8296-kube-api-access-8lv6z\") pod \"managed-serviceaccount-addon-agent-7f5d4bccfb-8kcc8\" (UID: \"97330e06-5a39-4cee-804e-54631c7a8296\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f5d4bccfb-8kcc8" Jul 09 04:16:55.891074 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:55.891032 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-685bfb5f64-6mzsz"] Jul 09 04:16:55.909017 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:55.908985 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-6mzsz"] Jul 09 04:16:55.909189 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:55.909065 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-6mzsz" Jul 09 04:16:55.911893 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:55.911865 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 09 04:16:55.912583 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:55.912158 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 09 04:16:55.912583 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:55.912418 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-tq9w6\"" Jul 09 04:16:55.940975 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:55.940944 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5cb499cd5c-s8kgk"] Jul 09 04:16:55.968535 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:55.968089 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wk9k6\" (UniqueName: \"kubernetes.io/projected/415e1192-b7b0-41ff-8bd5-ee0719d5162c-kube-api-access-wk9k6\") pod \"klusterlet-addon-workmgr-669b87f-945vj\" (UID: \"415e1192-b7b0-41ff-8bd5-ee0719d5162c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-669b87f-945vj" Jul 09 04:16:55.968535 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:55.968150 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/97330e06-5a39-4cee-804e-54631c7a8296-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7f5d4bccfb-8kcc8\" (UID: \"97330e06-5a39-4cee-804e-54631c7a8296\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f5d4bccfb-8kcc8" Jul 09 04:16:55.968535 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:55.968201 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8lv6z\" (UniqueName: \"kubernetes.io/projected/97330e06-5a39-4cee-804e-54631c7a8296-kube-api-access-8lv6z\") pod \"managed-serviceaccount-addon-agent-7f5d4bccfb-8kcc8\" (UID: \"97330e06-5a39-4cee-804e-54631c7a8296\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f5d4bccfb-8kcc8" Jul 09 04:16:55.968535 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:55.968240 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/415e1192-b7b0-41ff-8bd5-ee0719d5162c-tmp\") pod \"klusterlet-addon-workmgr-669b87f-945vj\" (UID: \"415e1192-b7b0-41ff-8bd5-ee0719d5162c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-669b87f-945vj" Jul 09 04:16:55.968535 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:55.968278 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/91e61fd6-05d2-4a42-86f0-9483400f9b78-ca\") pod \"cluster-proxy-proxy-agent-55bd4c6fcc-wq88s\" (UID: \"91e61fd6-05d2-4a42-86f0-9483400f9b78\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55bd4c6fcc-wq88s" Jul 09 04:16:55.968535 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:55.968301 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/91e61fd6-05d2-4a42-86f0-9483400f9b78-additional-service-ca\") pod \"cluster-proxy-proxy-agent-55bd4c6fcc-wq88s\" (UID: \"91e61fd6-05d2-4a42-86f0-9483400f9b78\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55bd4c6fcc-wq88s" Jul 09 04:16:55.968535 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:55.968322 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/91e61fd6-05d2-4a42-86f0-9483400f9b78-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-55bd4c6fcc-wq88s\" (UID: \"91e61fd6-05d2-4a42-86f0-9483400f9b78\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55bd4c6fcc-wq88s" Jul 09 04:16:55.968535 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:55.968352 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/91e61fd6-05d2-4a42-86f0-9483400f9b78-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-55bd4c6fcc-wq88s\" (UID: \"91e61fd6-05d2-4a42-86f0-9483400f9b78\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55bd4c6fcc-wq88s" Jul 09 04:16:55.968535 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:55.968378 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2f88b\" (UniqueName: \"kubernetes.io/projected/91e61fd6-05d2-4a42-86f0-9483400f9b78-kube-api-access-2f88b\") pod \"cluster-proxy-proxy-agent-55bd4c6fcc-wq88s\" (UID: \"91e61fd6-05d2-4a42-86f0-9483400f9b78\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55bd4c6fcc-wq88s" Jul 09 04:16:55.968535 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:55.968404 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/415e1192-b7b0-41ff-8bd5-ee0719d5162c-klusterlet-config\") pod \"klusterlet-addon-workmgr-669b87f-945vj\" (UID: \"415e1192-b7b0-41ff-8bd5-ee0719d5162c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-669b87f-945vj" Jul 09 04:16:55.968535 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:55.968429 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/91e61fd6-05d2-4a42-86f0-9483400f9b78-hub\") pod \"cluster-proxy-proxy-agent-55bd4c6fcc-wq88s\" (UID: \"91e61fd6-05d2-4a42-86f0-9483400f9b78\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55bd4c6fcc-wq88s" Jul 09 04:16:55.971303 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:55.971279 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/97330e06-5a39-4cee-804e-54631c7a8296-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7f5d4bccfb-8kcc8\" (UID: \"97330e06-5a39-4cee-804e-54631c7a8296\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f5d4bccfb-8kcc8" Jul 09 04:16:55.982222 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:55.982193 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8lv6z\" (UniqueName: \"kubernetes.io/projected/97330e06-5a39-4cee-804e-54631c7a8296-kube-api-access-8lv6z\") pod \"managed-serviceaccount-addon-agent-7f5d4bccfb-8kcc8\" (UID: \"97330e06-5a39-4cee-804e-54631c7a8296\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f5d4bccfb-8kcc8" Jul 09 04:16:55.986189 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:55.986162 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5cb499cd5c-s8kgk"] Jul 09 04:16:55.986287 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:55.986266 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cb499cd5c-s8kgk" Jul 09 04:16:55.988896 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:55.988874 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 09 04:16:55.989038 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:55.988904 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 09 04:16:55.989173 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:55.989150 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-45x5c\"" Jul 09 04:16:55.989299 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:55.989210 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 09 04:16:55.989299 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:55.989155 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 09 04:16:55.989299 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:55.989253 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 09 04:16:56.069985 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:56.069868 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-st5dq\" (UniqueName: \"kubernetes.io/projected/6af07cc3-e722-4d84-b338-825c2ca46c79-kube-api-access-st5dq\") pod \"console-5cb499cd5c-s8kgk\" (UID: \"6af07cc3-e722-4d84-b338-825c2ca46c79\") " pod="openshift-console/console-5cb499cd5c-s8kgk" Jul 09 04:16:56.069985 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:56.069929 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wk9k6\" (UniqueName: \"kubernetes.io/projected/415e1192-b7b0-41ff-8bd5-ee0719d5162c-kube-api-access-wk9k6\") pod \"klusterlet-addon-workmgr-669b87f-945vj\" (UID: \"415e1192-b7b0-41ff-8bd5-ee0719d5162c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-669b87f-945vj" Jul 09 04:16:56.070224 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:56.070021 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6af07cc3-e722-4d84-b338-825c2ca46c79-oauth-serving-cert\") pod \"console-5cb499cd5c-s8kgk\" (UID: \"6af07cc3-e722-4d84-b338-825c2ca46c79\") " pod="openshift-console/console-5cb499cd5c-s8kgk" Jul 09 04:16:56.070224 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:56.070057 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6af07cc3-e722-4d84-b338-825c2ca46c79-console-serving-cert\") pod \"console-5cb499cd5c-s8kgk\" (UID: \"6af07cc3-e722-4d84-b338-825c2ca46c79\") " pod="openshift-console/console-5cb499cd5c-s8kgk" Jul 09 04:16:56.070224 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:56.070079 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6af07cc3-e722-4d84-b338-825c2ca46c79-console-oauth-config\") pod \"console-5cb499cd5c-s8kgk\" (UID: \"6af07cc3-e722-4d84-b338-825c2ca46c79\") " pod="openshift-console/console-5cb499cd5c-s8kgk" Jul 09 04:16:56.070224 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:56.070103 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49vct\" (UniqueName: \"kubernetes.io/projected/f1ce87a2-b9e6-41ca-8286-30e91108aeb1-kube-api-access-49vct\") pod \"downloads-685bfb5f64-6mzsz\" (UID: \"f1ce87a2-b9e6-41ca-8286-30e91108aeb1\") " pod="openshift-console/downloads-685bfb5f64-6mzsz" Jul 09 04:16:56.070224 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:56.070122 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/415e1192-b7b0-41ff-8bd5-ee0719d5162c-tmp\") pod \"klusterlet-addon-workmgr-669b87f-945vj\" (UID: \"415e1192-b7b0-41ff-8bd5-ee0719d5162c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-669b87f-945vj" Jul 09 04:16:56.070224 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:56.070139 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6af07cc3-e722-4d84-b338-825c2ca46c79-console-config\") pod \"console-5cb499cd5c-s8kgk\" (UID: \"6af07cc3-e722-4d84-b338-825c2ca46c79\") " pod="openshift-console/console-5cb499cd5c-s8kgk" Jul 09 04:16:56.070224 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:56.070197 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6af07cc3-e722-4d84-b338-825c2ca46c79-service-ca\") pod \"console-5cb499cd5c-s8kgk\" (UID: \"6af07cc3-e722-4d84-b338-825c2ca46c79\") " pod="openshift-console/console-5cb499cd5c-s8kgk" Jul 09 04:16:56.070568 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:56.070237 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/91e61fd6-05d2-4a42-86f0-9483400f9b78-ca\") pod \"cluster-proxy-proxy-agent-55bd4c6fcc-wq88s\" (UID: \"91e61fd6-05d2-4a42-86f0-9483400f9b78\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55bd4c6fcc-wq88s" Jul 09 04:16:56.070568 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:56.070268 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/91e61fd6-05d2-4a42-86f0-9483400f9b78-additional-service-ca\") pod \"cluster-proxy-proxy-agent-55bd4c6fcc-wq88s\" (UID: \"91e61fd6-05d2-4a42-86f0-9483400f9b78\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55bd4c6fcc-wq88s" Jul 09 04:16:56.070568 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:56.070284 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/91e61fd6-05d2-4a42-86f0-9483400f9b78-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-55bd4c6fcc-wq88s\" (UID: \"91e61fd6-05d2-4a42-86f0-9483400f9b78\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55bd4c6fcc-wq88s" Jul 09 04:16:56.070568 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:56.070313 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/91e61fd6-05d2-4a42-86f0-9483400f9b78-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-55bd4c6fcc-wq88s\" (UID: \"91e61fd6-05d2-4a42-86f0-9483400f9b78\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55bd4c6fcc-wq88s" Jul 09 04:16:56.070568 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:56.070333 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2f88b\" (UniqueName: \"kubernetes.io/projected/91e61fd6-05d2-4a42-86f0-9483400f9b78-kube-api-access-2f88b\") pod \"cluster-proxy-proxy-agent-55bd4c6fcc-wq88s\" (UID: \"91e61fd6-05d2-4a42-86f0-9483400f9b78\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55bd4c6fcc-wq88s" Jul 09 04:16:56.070568 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:56.070352 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/415e1192-b7b0-41ff-8bd5-ee0719d5162c-klusterlet-config\") pod \"klusterlet-addon-workmgr-669b87f-945vj\" (UID: \"415e1192-b7b0-41ff-8bd5-ee0719d5162c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-669b87f-945vj" Jul 09 04:16:56.070568 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:56.070375 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/91e61fd6-05d2-4a42-86f0-9483400f9b78-hub\") pod \"cluster-proxy-proxy-agent-55bd4c6fcc-wq88s\" (UID: \"91e61fd6-05d2-4a42-86f0-9483400f9b78\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55bd4c6fcc-wq88s" Jul 09 04:16:56.071357 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:56.071306 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/91e61fd6-05d2-4a42-86f0-9483400f9b78-additional-service-ca\") pod \"cluster-proxy-proxy-agent-55bd4c6fcc-wq88s\" (UID: \"91e61fd6-05d2-4a42-86f0-9483400f9b78\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55bd4c6fcc-wq88s" Jul 09 04:16:56.071653 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:56.071628 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/415e1192-b7b0-41ff-8bd5-ee0719d5162c-tmp\") pod \"klusterlet-addon-workmgr-669b87f-945vj\" (UID: \"415e1192-b7b0-41ff-8bd5-ee0719d5162c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-669b87f-945vj" Jul 09 04:16:56.073192 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:56.073169 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/91e61fd6-05d2-4a42-86f0-9483400f9b78-ca\") pod \"cluster-proxy-proxy-agent-55bd4c6fcc-wq88s\" (UID: \"91e61fd6-05d2-4a42-86f0-9483400f9b78\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55bd4c6fcc-wq88s" Jul 09 04:16:56.073352 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:56.073330 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/91e61fd6-05d2-4a42-86f0-9483400f9b78-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-55bd4c6fcc-wq88s\" (UID: \"91e61fd6-05d2-4a42-86f0-9483400f9b78\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55bd4c6fcc-wq88s" Jul 09 04:16:56.073792 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:56.073757 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/91e61fd6-05d2-4a42-86f0-9483400f9b78-hub\") pod \"cluster-proxy-proxy-agent-55bd4c6fcc-wq88s\" (UID: \"91e61fd6-05d2-4a42-86f0-9483400f9b78\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55bd4c6fcc-wq88s" Jul 09 04:16:56.073861 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:56.073762 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/91e61fd6-05d2-4a42-86f0-9483400f9b78-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-55bd4c6fcc-wq88s\" (UID: \"91e61fd6-05d2-4a42-86f0-9483400f9b78\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55bd4c6fcc-wq88s" Jul 09 04:16:56.073861 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:56.073831 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/415e1192-b7b0-41ff-8bd5-ee0719d5162c-klusterlet-config\") pod \"klusterlet-addon-workmgr-669b87f-945vj\" (UID: \"415e1192-b7b0-41ff-8bd5-ee0719d5162c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-669b87f-945vj" Jul 09 04:16:56.082122 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:56.082036 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wk9k6\" (UniqueName: \"kubernetes.io/projected/415e1192-b7b0-41ff-8bd5-ee0719d5162c-kube-api-access-wk9k6\") pod \"klusterlet-addon-workmgr-669b87f-945vj\" (UID: \"415e1192-b7b0-41ff-8bd5-ee0719d5162c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-669b87f-945vj" Jul 09 04:16:56.082122 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:56.082100 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2f88b\" (UniqueName: \"kubernetes.io/projected/91e61fd6-05d2-4a42-86f0-9483400f9b78-kube-api-access-2f88b\") pod \"cluster-proxy-proxy-agent-55bd4c6fcc-wq88s\" (UID: \"91e61fd6-05d2-4a42-86f0-9483400f9b78\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55bd4c6fcc-wq88s" Jul 09 04:16:56.106809 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:56.106774 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f5d4bccfb-8kcc8" Jul 09 04:16:56.124764 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:56.124735 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55bd4c6fcc-wq88s" Jul 09 04:16:56.142148 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:56.142118 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-669b87f-945vj" Jul 09 04:16:56.171026 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:56.170977 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6af07cc3-e722-4d84-b338-825c2ca46c79-oauth-serving-cert\") pod \"console-5cb499cd5c-s8kgk\" (UID: \"6af07cc3-e722-4d84-b338-825c2ca46c79\") " pod="openshift-console/console-5cb499cd5c-s8kgk" Jul 09 04:16:56.171026 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:56.171022 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6af07cc3-e722-4d84-b338-825c2ca46c79-console-serving-cert\") pod \"console-5cb499cd5c-s8kgk\" (UID: \"6af07cc3-e722-4d84-b338-825c2ca46c79\") " pod="openshift-console/console-5cb499cd5c-s8kgk" Jul 09 04:16:56.171275 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:56.171046 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6af07cc3-e722-4d84-b338-825c2ca46c79-console-oauth-config\") pod \"console-5cb499cd5c-s8kgk\" (UID: \"6af07cc3-e722-4d84-b338-825c2ca46c79\") " pod="openshift-console/console-5cb499cd5c-s8kgk" Jul 09 04:16:56.171275 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:56.171078 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-49vct\" (UniqueName: \"kubernetes.io/projected/f1ce87a2-b9e6-41ca-8286-30e91108aeb1-kube-api-access-49vct\") pod \"downloads-685bfb5f64-6mzsz\" (UID: \"f1ce87a2-b9e6-41ca-8286-30e91108aeb1\") " pod="openshift-console/downloads-685bfb5f64-6mzsz" Jul 09 04:16:56.171275 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:56.171104 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6af07cc3-e722-4d84-b338-825c2ca46c79-console-config\") pod \"console-5cb499cd5c-s8kgk\" (UID: \"6af07cc3-e722-4d84-b338-825c2ca46c79\") " pod="openshift-console/console-5cb499cd5c-s8kgk" Jul 09 04:16:56.171761 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:56.171585 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6af07cc3-e722-4d84-b338-825c2ca46c79-service-ca\") pod \"console-5cb499cd5c-s8kgk\" (UID: \"6af07cc3-e722-4d84-b338-825c2ca46c79\") " pod="openshift-console/console-5cb499cd5c-s8kgk" Jul 09 04:16:56.171761 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:56.171673 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-st5dq\" (UniqueName: \"kubernetes.io/projected/6af07cc3-e722-4d84-b338-825c2ca46c79-kube-api-access-st5dq\") pod \"console-5cb499cd5c-s8kgk\" (UID: \"6af07cc3-e722-4d84-b338-825c2ca46c79\") " pod="openshift-console/console-5cb499cd5c-s8kgk" Jul 09 04:16:56.172116 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:56.171877 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6af07cc3-e722-4d84-b338-825c2ca46c79-oauth-serving-cert\") pod \"console-5cb499cd5c-s8kgk\" (UID: \"6af07cc3-e722-4d84-b338-825c2ca46c79\") " pod="openshift-console/console-5cb499cd5c-s8kgk" Jul 09 04:16:56.172116 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:56.171957 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6af07cc3-e722-4d84-b338-825c2ca46c79-console-config\") pod \"console-5cb499cd5c-s8kgk\" (UID: \"6af07cc3-e722-4d84-b338-825c2ca46c79\") " pod="openshift-console/console-5cb499cd5c-s8kgk" Jul 09 04:16:56.172512 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:56.172487 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6af07cc3-e722-4d84-b338-825c2ca46c79-service-ca\") pod \"console-5cb499cd5c-s8kgk\" (UID: \"6af07cc3-e722-4d84-b338-825c2ca46c79\") " pod="openshift-console/console-5cb499cd5c-s8kgk" Jul 09 04:16:56.173956 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:56.173934 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6af07cc3-e722-4d84-b338-825c2ca46c79-console-serving-cert\") pod \"console-5cb499cd5c-s8kgk\" (UID: \"6af07cc3-e722-4d84-b338-825c2ca46c79\") " pod="openshift-console/console-5cb499cd5c-s8kgk" Jul 09 04:16:56.174074 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:56.174041 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6af07cc3-e722-4d84-b338-825c2ca46c79-console-oauth-config\") pod \"console-5cb499cd5c-s8kgk\" (UID: \"6af07cc3-e722-4d84-b338-825c2ca46c79\") " pod="openshift-console/console-5cb499cd5c-s8kgk" Jul 09 04:16:56.181874 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:56.181848 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-49vct\" (UniqueName: \"kubernetes.io/projected/f1ce87a2-b9e6-41ca-8286-30e91108aeb1-kube-api-access-49vct\") pod \"downloads-685bfb5f64-6mzsz\" (UID: \"f1ce87a2-b9e6-41ca-8286-30e91108aeb1\") " pod="openshift-console/downloads-685bfb5f64-6mzsz" Jul 09 04:16:56.182034 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:56.181972 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-st5dq\" (UniqueName: \"kubernetes.io/projected/6af07cc3-e722-4d84-b338-825c2ca46c79-kube-api-access-st5dq\") pod \"console-5cb499cd5c-s8kgk\" (UID: \"6af07cc3-e722-4d84-b338-825c2ca46c79\") " pod="openshift-console/console-5cb499cd5c-s8kgk" Jul 09 04:16:56.222929 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:56.222882 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-6mzsz" Jul 09 04:16:56.297673 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:56.297413 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cb499cd5c-s8kgk" Jul 09 04:16:59.637927 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:59.633408 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-669b87f-945vj"] Jul 09 04:16:59.669790 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:59.668084 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f5d4bccfb-8kcc8"] Jul 09 04:16:59.676897 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:59.676825 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-6mzsz"] Jul 09 04:16:59.721484 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:59.721457 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5cb499cd5c-s8kgk"] Jul 09 04:16:59.723101 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:16:59.723072 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6af07cc3_e722_4d84_b338_825c2ca46c79.slice/crio-40c5444a34aeb198d1f22447919388e54c2dd930f9e0a69d6053e7ed2b7348e5 WatchSource:0}: Error finding container 40c5444a34aeb198d1f22447919388e54c2dd930f9e0a69d6053e7ed2b7348e5: Status 404 returned error can't find the container with id 40c5444a34aeb198d1f22447919388e54c2dd930f9e0a69d6053e7ed2b7348e5 Jul 09 04:16:59.740059 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:16:59.740020 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55bd4c6fcc-wq88s"] Jul 09 04:16:59.745374 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:16:59.745335 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod91e61fd6_05d2_4a42_86f0_9483400f9b78.slice/crio-9d52c6a824caa46af58750a4a46c16679e66f8f53805fe2b8b269b835f26ac57 WatchSource:0}: Error finding container 9d52c6a824caa46af58750a4a46c16679e66f8f53805fe2b8b269b835f26ac57: Status 404 returned error can't find the container with id 9d52c6a824caa46af58750a4a46c16679e66f8f53805fe2b8b269b835f26ac57 Jul 09 04:17:00.215031 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:00.212896 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-8snjq"] Jul 09 04:17:00.233731 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:00.233689 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-8snjq"] Jul 09 04:17:00.233895 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:00.233818 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-8snjq" Jul 09 04:17:00.236638 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:00.236606 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-z64bc\"" Jul 09 04:17:00.236779 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:00.236616 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 09 04:17:00.321577 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:00.321525 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-6mzsz" event={"ID":"f1ce87a2-b9e6-41ca-8286-30e91108aeb1","Type":"ContainerStarted","Data":"faa8f0778896092a91de5de940dca911e1b61bd7cacefc865f71a53655470437"} Jul 09 04:17:00.324939 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:00.324871 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f5d4bccfb-8kcc8" event={"ID":"97330e06-5a39-4cee-804e-54631c7a8296","Type":"ContainerStarted","Data":"1a7078ddc7902e2ef3979979b335d2e99ca8eb0a00d792f95a2d322c2f1473c6"} Jul 09 04:17:00.326502 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:00.326474 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-d9vmv" event={"ID":"be7de4e5-23b0-463b-8618-d0bb0a0895b6","Type":"ContainerStarted","Data":"a6f30dbaad57701d4d7c3a99b7e216412dc64190f948a5ebbf3e459d4d59046a"} Jul 09 04:17:00.328478 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:00.328453 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-z8vt7" event={"ID":"48514bce-8ca3-41aa-b388-06e16f306fe1","Type":"ContainerStarted","Data":"e7d05a6047ad97e28a1db6dd15b70cb874a3713405d34910205b92d96d319c8e"} Jul 09 04:17:00.328618 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:00.328498 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-z8vt7" event={"ID":"48514bce-8ca3-41aa-b388-06e16f306fe1","Type":"ContainerStarted","Data":"5bed149e7582c0d32b734595287cfc7aed1dd6256c891f8af201ee82947cc526"} Jul 09 04:17:00.328618 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:00.328528 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-z8vt7" Jul 09 04:17:00.330668 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:00.330645 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-g65cg" event={"ID":"c2518b2b-81fb-4e88-97d7-36274a995550","Type":"ContainerStarted","Data":"287ad5dc85cdfb4a7acb1d7058287ee5e561e82d4312c621a3adc3e776a87a38"} Jul 09 04:17:00.332049 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:00.332029 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cb499cd5c-s8kgk" event={"ID":"6af07cc3-e722-4d84-b338-825c2ca46c79","Type":"ContainerStarted","Data":"40c5444a34aeb198d1f22447919388e54c2dd930f9e0a69d6053e7ed2b7348e5"} Jul 09 04:17:00.333730 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:00.333705 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-5nq2g" event={"ID":"916c78d9-c922-4dc4-8cc5-8b887e7999d3","Type":"ContainerStarted","Data":"459fdf2ea426aa62c68382304927128e52e630b9dd098047ca78b1de4804a180"} Jul 09 04:17:00.333834 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:00.333751 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-5nq2g" event={"ID":"916c78d9-c922-4dc4-8cc5-8b887e7999d3","Type":"ContainerStarted","Data":"3fa6191a4f227c7a74dea726836b553a102535379654547c2bfc826d45f178fe"} Jul 09 04:17:00.334788 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:00.334767 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55bd4c6fcc-wq88s" event={"ID":"91e61fd6-05d2-4a42-86f0-9483400f9b78","Type":"ContainerStarted","Data":"9d52c6a824caa46af58750a4a46c16679e66f8f53805fe2b8b269b835f26ac57"} Jul 09 04:17:00.335817 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:00.335797 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-669b87f-945vj" event={"ID":"415e1192-b7b0-41ff-8bd5-ee0719d5162c","Type":"ContainerStarted","Data":"faf591d6a1716ff6e4727a927415a81050babbff9ea657579c46b30e062d565b"} Jul 09 04:17:00.337095 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:00.337076 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-mvrbd" event={"ID":"32c78782-6b5e-4dc1-a3c6-048f98de9c1a","Type":"ContainerStarted","Data":"fa94dba06b29cdcf3435463760cf0f515e1034c699a42633a95e785fc3625540"} Jul 09 04:17:00.343444 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:00.343402 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-d9vmv" podStartSLOduration=39.104274593 podStartE2EDuration="46.343387832s" totalImagesPullingTime="7.239113239s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:16:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:17:00.342448036 +0000 UTC m=+77.959346284" watchObservedRunningTime="2026-07-09 04:17:00.343387832 +0000 UTC m=+77.960286091" Jul 09 04:17:00.361839 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:00.361774 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-g65cg" podStartSLOduration=17.73409768 podStartE2EDuration="29.361750963s" totalImagesPullingTime="11.627653283s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 04:16:31 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:17:00.359737966 +0000 UTC m=+77.976636186" watchObservedRunningTime="2026-07-09 04:17:00.361750963 +0000 UTC m=+77.978649183" Jul 09 04:17:00.378545 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:00.378483 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-z8vt7" podStartSLOduration=35.146228658 podStartE2EDuration="42.378461558s" totalImagesPullingTime="7.2322329s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:16:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:17:00.377033134 +0000 UTC m=+77.993931392" watchObservedRunningTime="2026-07-09 04:17:00.378461558 +0000 UTC m=+77.995359778" Jul 09 04:17:00.395105 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:00.395034 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-mvrbd" podStartSLOduration=66.888766331 podStartE2EDuration="1m17.395009344s" totalImagesPullingTime="10.506243013s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 04:15:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:17:00.394214308 +0000 UTC m=+78.011112529" watchObservedRunningTime="2026-07-09 04:17:00.395009344 +0000 UTC m=+78.011907563" Jul 09 04:17:00.412408 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:00.412376 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/34b579dc-e7f8-4420-98a7-6083fd0c076b-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-8snjq\" (UID: \"34b579dc-e7f8-4420-98a7-6083fd0c076b\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-8snjq" Jul 09 04:17:00.412575 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:00.412422 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-5nq2g" podStartSLOduration=39.209923266 podStartE2EDuration="46.412399869s" totalImagesPullingTime="7.202476603s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:16:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:17:00.411966898 +0000 UTC m=+78.028865117" watchObservedRunningTime="2026-07-09 04:17:00.412399869 +0000 UTC m=+78.029298109" Jul 09 04:17:00.513811 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:00.513763 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/34b579dc-e7f8-4420-98a7-6083fd0c076b-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-8snjq\" (UID: \"34b579dc-e7f8-4420-98a7-6083fd0c076b\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-8snjq" Jul 09 04:17:00.517184 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:00.517149 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/34b579dc-e7f8-4420-98a7-6083fd0c076b-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-8snjq\" (UID: \"34b579dc-e7f8-4420-98a7-6083fd0c076b\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-8snjq" Jul 09 04:17:00.544985 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:00.544722 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-8snjq" Jul 09 04:17:00.766678 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:00.766530 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-8snjq"] Jul 09 04:17:00.771092 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:17:00.771057 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34b579dc_e7f8_4420_98a7_6083fd0c076b.slice/crio-62746144ca87995424402028fc70e8ead69d613f519ffe286a58d74e90653be8 WatchSource:0}: Error finding container 62746144ca87995424402028fc70e8ead69d613f519ffe286a58d74e90653be8: Status 404 returned error can't find the container with id 62746144ca87995424402028fc70e8ead69d613f519ffe286a58d74e90653be8 Jul 09 04:17:01.353848 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:01.353810 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-8snjq" event={"ID":"34b579dc-e7f8-4420-98a7-6083fd0c076b","Type":"ContainerStarted","Data":"62746144ca87995424402028fc70e8ead69d613f519ffe286a58d74e90653be8"} Jul 09 04:17:09.413546 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:09.413454 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f5d4bccfb-8kcc8" event={"ID":"97330e06-5a39-4cee-804e-54631c7a8296","Type":"ContainerStarted","Data":"bb3563e023cc1557b0d4860ab432f4b957f8e6231fac345dc95020fc5c951cc0"} Jul 09 04:17:09.415585 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:09.415555 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cb499cd5c-s8kgk" event={"ID":"6af07cc3-e722-4d84-b338-825c2ca46c79","Type":"ContainerStarted","Data":"6ac46945230f319e602d8ac2f9ddfc47d7189fe7ff556b131cdc32207aee7c47"} Jul 09 04:17:09.417304 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:09.417277 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-8snjq" event={"ID":"34b579dc-e7f8-4420-98a7-6083fd0c076b","Type":"ContainerStarted","Data":"c9128ad3b7a69918d7ecc1ec6462b7d2edaab8477067c3151b821cca50607393"} Jul 09 04:17:09.417832 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:09.417802 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-8snjq" Jul 09 04:17:09.419864 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:09.419836 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55bd4c6fcc-wq88s" event={"ID":"91e61fd6-05d2-4a42-86f0-9483400f9b78","Type":"ContainerStarted","Data":"6f4d80847f6dd63bde5aa0b5fe559d9a8562e4459390a536755bc8c97e6d2583"} Jul 09 04:17:09.419972 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:09.419879 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55bd4c6fcc-wq88s" event={"ID":"91e61fd6-05d2-4a42-86f0-9483400f9b78","Type":"ContainerStarted","Data":"c3dd53b73ebe3d3e33425cdb5fdd71751a60552704c4d8725ebebedf93f19357"} Jul 09 04:17:09.419972 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:09.419927 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55bd4c6fcc-wq88s" event={"ID":"91e61fd6-05d2-4a42-86f0-9483400f9b78","Type":"ContainerStarted","Data":"b91822741ca1589b1605c9c88c49220f174dd21089ef1a7bd420ede845f7b362"} Jul 09 04:17:09.421809 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:09.421788 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-669b87f-945vj" event={"ID":"415e1192-b7b0-41ff-8bd5-ee0719d5162c","Type":"ContainerStarted","Data":"e70e7c0739abc9188f7e8af313dc85b62418f47cf62719ca85113780d1d5d85d"} Jul 09 04:17:09.422050 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:09.422033 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-669b87f-945vj" Jul 09 04:17:09.423383 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:09.423341 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-8snjq" Jul 09 04:17:09.423599 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:09.423583 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-669b87f-945vj" Jul 09 04:17:09.429374 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:09.429325 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f5d4bccfb-8kcc8" podStartSLOduration=5.277042647 podStartE2EDuration="14.429307906s" totalImagesPullingTime="9.152265259s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:16:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:17:09.428284259 +0000 UTC m=+87.045182479" watchObservedRunningTime="2026-07-09 04:17:09.429307906 +0000 UTC m=+87.046206127" Jul 09 04:17:09.442543 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:09.442490 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-669b87f-945vj" podStartSLOduration=5.245341433 podStartE2EDuration="14.44246567s" totalImagesPullingTime="9.197124237s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:16:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:17:09.442422477 +0000 UTC m=+87.059320693" watchObservedRunningTime="2026-07-09 04:17:09.44246567 +0000 UTC m=+87.059363890" Jul 09 04:17:09.460549 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:09.460484 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5cb499cd5c-s8kgk" podStartSLOduration=5.348102332 podStartE2EDuration="14.460467224s" totalImagesPullingTime="9.112364892s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:16:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:17:09.458887243 +0000 UTC m=+87.075785499" watchObservedRunningTime="2026-07-09 04:17:09.460467224 +0000 UTC m=+87.077365514" Jul 09 04:17:09.477269 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:09.477216 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55bd4c6fcc-wq88s" podStartSLOduration=5.357669289 podStartE2EDuration="14.477199905s" totalImagesPullingTime="9.119530616s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:16:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:17:09.475259008 +0000 UTC m=+87.092157228" watchObservedRunningTime="2026-07-09 04:17:09.477199905 +0000 UTC m=+87.094098125" Jul 09 04:17:09.494537 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:09.494466 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-8snjq" podStartSLOduration=1.443330524 podStartE2EDuration="9.494444906s" totalImagesPullingTime="8.051114382s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:17:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:17:09.489181779 +0000 UTC m=+87.106079999" watchObservedRunningTime="2026-07-09 04:17:09.494444906 +0000 UTC m=+87.111343127" Jul 09 04:17:10.355781 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:10.355747 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-z8vt7" Jul 09 04:17:10.404241 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:10.404177 2566 patch_prober.go:28] interesting pod/image-registry-5bb6bc998-jhp7f container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 09 04:17:10.404421 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:10.404255 2566 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5bb6bc998-jhp7f" podUID="36b72c73-bb0b-4e08-95c8-7f1f263f46f4" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 09 04:17:13.295417 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:13.295391 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5bb6bc998-jhp7f" Jul 09 04:17:15.817076 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:15.817048 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-679fd94dd5-pmxfd" Jul 09 04:17:15.861735 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:15.861696 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5cb499cd5c-s8kgk"] Jul 09 04:17:16.298214 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:16.298175 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5cb499cd5c-s8kgk" Jul 09 04:17:17.647589 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:17.647552 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-7dbtx"] Jul 09 04:17:17.793930 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:17.791631 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-7dbtx" Jul 09 04:17:17.797927 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:17.795436 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 09 04:17:17.797927 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:17.795819 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-j7t5j\"" Jul 09 04:17:17.797927 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:17.796013 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 09 04:17:17.797927 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:17.796289 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 09 04:17:17.797927 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:17.796462 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 09 04:17:17.893980 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:17.893943 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d725de2c-361f-43cc-92b3-8fff39f6ff2d-node-exporter-tls\") pod \"node-exporter-7dbtx\" (UID: \"d725de2c-361f-43cc-92b3-8fff39f6ff2d\") " pod="openshift-monitoring/node-exporter-7dbtx" Jul 09 04:17:17.894141 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:17.894003 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d725de2c-361f-43cc-92b3-8fff39f6ff2d-node-exporter-textfile\") pod \"node-exporter-7dbtx\" (UID: \"d725de2c-361f-43cc-92b3-8fff39f6ff2d\") " pod="openshift-monitoring/node-exporter-7dbtx" Jul 09 04:17:17.894141 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:17.894030 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d725de2c-361f-43cc-92b3-8fff39f6ff2d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7dbtx\" (UID: \"d725de2c-361f-43cc-92b3-8fff39f6ff2d\") " pod="openshift-monitoring/node-exporter-7dbtx" Jul 09 04:17:17.894141 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:17.894049 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d725de2c-361f-43cc-92b3-8fff39f6ff2d-metrics-client-ca\") pod \"node-exporter-7dbtx\" (UID: \"d725de2c-361f-43cc-92b3-8fff39f6ff2d\") " pod="openshift-monitoring/node-exporter-7dbtx" Jul 09 04:17:17.894141 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:17.894083 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gk57q\" (UniqueName: \"kubernetes.io/projected/d725de2c-361f-43cc-92b3-8fff39f6ff2d-kube-api-access-gk57q\") pod \"node-exporter-7dbtx\" (UID: \"d725de2c-361f-43cc-92b3-8fff39f6ff2d\") " pod="openshift-monitoring/node-exporter-7dbtx" Jul 09 04:17:17.894319 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:17.894153 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d725de2c-361f-43cc-92b3-8fff39f6ff2d-sys\") pod \"node-exporter-7dbtx\" (UID: \"d725de2c-361f-43cc-92b3-8fff39f6ff2d\") " pod="openshift-monitoring/node-exporter-7dbtx" Jul 09 04:17:17.894319 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:17.894186 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d725de2c-361f-43cc-92b3-8fff39f6ff2d-root\") pod \"node-exporter-7dbtx\" (UID: \"d725de2c-361f-43cc-92b3-8fff39f6ff2d\") " pod="openshift-monitoring/node-exporter-7dbtx" Jul 09 04:17:17.894319 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:17.894202 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d725de2c-361f-43cc-92b3-8fff39f6ff2d-node-exporter-wtmp\") pod \"node-exporter-7dbtx\" (UID: \"d725de2c-361f-43cc-92b3-8fff39f6ff2d\") " pod="openshift-monitoring/node-exporter-7dbtx" Jul 09 04:17:17.894319 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:17.894228 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d725de2c-361f-43cc-92b3-8fff39f6ff2d-node-exporter-accelerators-collector-config\") pod \"node-exporter-7dbtx\" (UID: \"d725de2c-361f-43cc-92b3-8fff39f6ff2d\") " pod="openshift-monitoring/node-exporter-7dbtx" Jul 09 04:17:17.995563 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:17.995516 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gk57q\" (UniqueName: \"kubernetes.io/projected/d725de2c-361f-43cc-92b3-8fff39f6ff2d-kube-api-access-gk57q\") pod \"node-exporter-7dbtx\" (UID: \"d725de2c-361f-43cc-92b3-8fff39f6ff2d\") " pod="openshift-monitoring/node-exporter-7dbtx" Jul 09 04:17:17.995746 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:17.995624 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d725de2c-361f-43cc-92b3-8fff39f6ff2d-sys\") pod \"node-exporter-7dbtx\" (UID: \"d725de2c-361f-43cc-92b3-8fff39f6ff2d\") " pod="openshift-monitoring/node-exporter-7dbtx" Jul 09 04:17:17.995746 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:17.995667 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d725de2c-361f-43cc-92b3-8fff39f6ff2d-root\") pod \"node-exporter-7dbtx\" (UID: \"d725de2c-361f-43cc-92b3-8fff39f6ff2d\") " pod="openshift-monitoring/node-exporter-7dbtx" Jul 09 04:17:17.995746 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:17.995682 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d725de2c-361f-43cc-92b3-8fff39f6ff2d-node-exporter-wtmp\") pod \"node-exporter-7dbtx\" (UID: \"d725de2c-361f-43cc-92b3-8fff39f6ff2d\") " pod="openshift-monitoring/node-exporter-7dbtx" Jul 09 04:17:17.995746 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:17.995705 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d725de2c-361f-43cc-92b3-8fff39f6ff2d-node-exporter-accelerators-collector-config\") pod \"node-exporter-7dbtx\" (UID: \"d725de2c-361f-43cc-92b3-8fff39f6ff2d\") " pod="openshift-monitoring/node-exporter-7dbtx" Jul 09 04:17:17.995746 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:17.995742 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d725de2c-361f-43cc-92b3-8fff39f6ff2d-node-exporter-tls\") pod \"node-exporter-7dbtx\" (UID: \"d725de2c-361f-43cc-92b3-8fff39f6ff2d\") " pod="openshift-monitoring/node-exporter-7dbtx" Jul 09 04:17:17.996041 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:17.995770 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d725de2c-361f-43cc-92b3-8fff39f6ff2d-node-exporter-textfile\") pod \"node-exporter-7dbtx\" (UID: \"d725de2c-361f-43cc-92b3-8fff39f6ff2d\") " pod="openshift-monitoring/node-exporter-7dbtx" Jul 09 04:17:17.996041 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:17.995786 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d725de2c-361f-43cc-92b3-8fff39f6ff2d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7dbtx\" (UID: \"d725de2c-361f-43cc-92b3-8fff39f6ff2d\") " pod="openshift-monitoring/node-exporter-7dbtx" Jul 09 04:17:17.996041 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:17.995804 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d725de2c-361f-43cc-92b3-8fff39f6ff2d-metrics-client-ca\") pod \"node-exporter-7dbtx\" (UID: \"d725de2c-361f-43cc-92b3-8fff39f6ff2d\") " pod="openshift-monitoring/node-exporter-7dbtx" Jul 09 04:17:17.996416 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:17.996391 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d725de2c-361f-43cc-92b3-8fff39f6ff2d-metrics-client-ca\") pod \"node-exporter-7dbtx\" (UID: \"d725de2c-361f-43cc-92b3-8fff39f6ff2d\") " pod="openshift-monitoring/node-exporter-7dbtx" Jul 09 04:17:17.996764 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:17.996743 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d725de2c-361f-43cc-92b3-8fff39f6ff2d-sys\") pod \"node-exporter-7dbtx\" (UID: \"d725de2c-361f-43cc-92b3-8fff39f6ff2d\") " pod="openshift-monitoring/node-exporter-7dbtx" Jul 09 04:17:17.996854 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:17.996802 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d725de2c-361f-43cc-92b3-8fff39f6ff2d-root\") pod \"node-exporter-7dbtx\" (UID: \"d725de2c-361f-43cc-92b3-8fff39f6ff2d\") " pod="openshift-monitoring/node-exporter-7dbtx" Jul 09 04:17:17.996936 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:17.996923 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d725de2c-361f-43cc-92b3-8fff39f6ff2d-node-exporter-wtmp\") pod \"node-exporter-7dbtx\" (UID: \"d725de2c-361f-43cc-92b3-8fff39f6ff2d\") " pod="openshift-monitoring/node-exporter-7dbtx" Jul 09 04:17:17.997772 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:17:17.997749 2566 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 09 04:17:17.997891 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:17:17.997830 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d725de2c-361f-43cc-92b3-8fff39f6ff2d-node-exporter-tls podName:d725de2c-361f-43cc-92b3-8fff39f6ff2d nodeName:}" failed. No retries permitted until 2026-07-09 04:17:18.497808996 +0000 UTC m=+96.114707204 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/d725de2c-361f-43cc-92b3-8fff39f6ff2d-node-exporter-tls") pod "node-exporter-7dbtx" (UID: "d725de2c-361f-43cc-92b3-8fff39f6ff2d") : secret "node-exporter-tls" not found Jul 09 04:17:17.997891 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:17.997864 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d725de2c-361f-43cc-92b3-8fff39f6ff2d-node-exporter-textfile\") pod \"node-exporter-7dbtx\" (UID: \"d725de2c-361f-43cc-92b3-8fff39f6ff2d\") " pod="openshift-monitoring/node-exporter-7dbtx" Jul 09 04:17:17.998053 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:17.997938 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d725de2c-361f-43cc-92b3-8fff39f6ff2d-node-exporter-accelerators-collector-config\") pod \"node-exporter-7dbtx\" (UID: \"d725de2c-361f-43cc-92b3-8fff39f6ff2d\") " pod="openshift-monitoring/node-exporter-7dbtx" Jul 09 04:17:18.000295 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:18.000274 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d725de2c-361f-43cc-92b3-8fff39f6ff2d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7dbtx\" (UID: \"d725de2c-361f-43cc-92b3-8fff39f6ff2d\") " pod="openshift-monitoring/node-exporter-7dbtx" Jul 09 04:17:18.006075 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:18.006053 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gk57q\" (UniqueName: \"kubernetes.io/projected/d725de2c-361f-43cc-92b3-8fff39f6ff2d-kube-api-access-gk57q\") pod \"node-exporter-7dbtx\" (UID: \"d725de2c-361f-43cc-92b3-8fff39f6ff2d\") " pod="openshift-monitoring/node-exporter-7dbtx" Jul 09 04:17:18.501243 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:18.501202 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d725de2c-361f-43cc-92b3-8fff39f6ff2d-node-exporter-tls\") pod \"node-exporter-7dbtx\" (UID: \"d725de2c-361f-43cc-92b3-8fff39f6ff2d\") " pod="openshift-monitoring/node-exporter-7dbtx" Jul 09 04:17:18.504006 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:18.503979 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d725de2c-361f-43cc-92b3-8fff39f6ff2d-node-exporter-tls\") pod \"node-exporter-7dbtx\" (UID: \"d725de2c-361f-43cc-92b3-8fff39f6ff2d\") " pod="openshift-monitoring/node-exporter-7dbtx" Jul 09 04:17:18.706818 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:18.706780 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-7dbtx" Jul 09 04:17:20.320450 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:17:20.320414 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd725de2c_361f_43cc_92b3_8fff39f6ff2d.slice/crio-d3481371977c89821a4f2430628c28b6d2d952d54e57887e22bd17537f8e008c WatchSource:0}: Error finding container d3481371977c89821a4f2430628c28b6d2d952d54e57887e22bd17537f8e008c: Status 404 returned error can't find the container with id d3481371977c89821a4f2430628c28b6d2d952d54e57887e22bd17537f8e008c Jul 09 04:17:20.479844 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:20.479806 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7dbtx" event={"ID":"d725de2c-361f-43cc-92b3-8fff39f6ff2d","Type":"ContainerStarted","Data":"d3481371977c89821a4f2430628c28b6d2d952d54e57887e22bd17537f8e008c"} Jul 09 04:17:20.841160 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:20.841091 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-679fd94dd5-pmxfd" podUID="b7903a28-a0b8-4567-ac5c-d18b25565947" containerName="registry" containerID="cri-o://81c1796d62b741ad4f9c82c3d3231a6cb1dc211f5c1494b5e0e0789747608e23" gracePeriod=30 Jul 09 04:17:21.407111 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:21.407074 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-679fd94dd5-pmxfd" Jul 09 04:17:21.487542 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:21.487511 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-6mzsz" event={"ID":"f1ce87a2-b9e6-41ca-8286-30e91108aeb1","Type":"ContainerStarted","Data":"3f2dcc57750c3a32622bae4f52fa50bc510e150cf99966916c490c0e93f5d70f"} Jul 09 04:17:21.487728 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:21.487569 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-685bfb5f64-6mzsz" Jul 09 04:17:21.489761 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:21.489726 2566 generic.go:356] "Generic (PLEG): container finished" podID="b7903a28-a0b8-4567-ac5c-d18b25565947" containerID="81c1796d62b741ad4f9c82c3d3231a6cb1dc211f5c1494b5e0e0789747608e23" exitCode=0 Jul 09 04:17:21.489901 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:21.489786 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-679fd94dd5-pmxfd" Jul 09 04:17:21.489901 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:21.489803 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-679fd94dd5-pmxfd" event={"ID":"b7903a28-a0b8-4567-ac5c-d18b25565947","Type":"ContainerDied","Data":"81c1796d62b741ad4f9c82c3d3231a6cb1dc211f5c1494b5e0e0789747608e23"} Jul 09 04:17:21.489901 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:21.489838 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-679fd94dd5-pmxfd" event={"ID":"b7903a28-a0b8-4567-ac5c-d18b25565947","Type":"ContainerDied","Data":"bf3e6d50e4032385f8a5350287ef11e6dff31b523cf30b9e3d7f041c8da2b837"} Jul 09 04:17:21.489901 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:21.489856 2566 scope.go:117] "RemoveContainer" containerID="81c1796d62b741ad4f9c82c3d3231a6cb1dc211f5c1494b5e0e0789747608e23" Jul 09 04:17:21.506732 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:21.506703 2566 scope.go:117] "RemoveContainer" containerID="81c1796d62b741ad4f9c82c3d3231a6cb1dc211f5c1494b5e0e0789747608e23" Jul 09 04:17:21.507207 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:17:21.507172 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"81c1796d62b741ad4f9c82c3d3231a6cb1dc211f5c1494b5e0e0789747608e23\": container with ID starting with 81c1796d62b741ad4f9c82c3d3231a6cb1dc211f5c1494b5e0e0789747608e23 not found: ID does not exist" containerID="81c1796d62b741ad4f9c82c3d3231a6cb1dc211f5c1494b5e0e0789747608e23" Jul 09 04:17:21.507312 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:21.507220 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81c1796d62b741ad4f9c82c3d3231a6cb1dc211f5c1494b5e0e0789747608e23"} err="failed to get container status \"81c1796d62b741ad4f9c82c3d3231a6cb1dc211f5c1494b5e0e0789747608e23\": rpc error: code = NotFound desc = could not find container \"81c1796d62b741ad4f9c82c3d3231a6cb1dc211f5c1494b5e0e0789747608e23\": container with ID starting with 81c1796d62b741ad4f9c82c3d3231a6cb1dc211f5c1494b5e0e0789747608e23 not found: ID does not exist" Jul 09 04:17:21.507820 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:21.507797 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-685bfb5f64-6mzsz" Jul 09 04:17:21.509671 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:21.509624 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-685bfb5f64-6mzsz" podStartSLOduration=5.5086209870000005 podStartE2EDuration="26.509605187s" totalImagesPullingTime="21.0009842s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:16:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:17:21.508608723 +0000 UTC m=+99.125506971" watchObservedRunningTime="2026-07-09 04:17:21.509605187 +0000 UTC m=+99.126503409" Jul 09 04:17:21.528740 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:21.528701 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b7903a28-a0b8-4567-ac5c-d18b25565947-registry-certificates\") pod \"b7903a28-a0b8-4567-ac5c-d18b25565947\" (UID: \"b7903a28-a0b8-4567-ac5c-d18b25565947\") " Jul 09 04:17:21.528988 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:21.528764 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b7903a28-a0b8-4567-ac5c-d18b25565947-bound-sa-token\") pod \"b7903a28-a0b8-4567-ac5c-d18b25565947\" (UID: \"b7903a28-a0b8-4567-ac5c-d18b25565947\") " Jul 09 04:17:21.528988 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:21.528812 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b7903a28-a0b8-4567-ac5c-d18b25565947-trusted-ca\") pod \"b7903a28-a0b8-4567-ac5c-d18b25565947\" (UID: \"b7903a28-a0b8-4567-ac5c-d18b25565947\") " Jul 09 04:17:21.528988 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:21.528850 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b7903a28-a0b8-4567-ac5c-d18b25565947-image-registry-private-configuration\") pod \"b7903a28-a0b8-4567-ac5c-d18b25565947\" (UID: \"b7903a28-a0b8-4567-ac5c-d18b25565947\") " Jul 09 04:17:21.528988 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:21.528882 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6mxf9\" (UniqueName: \"kubernetes.io/projected/b7903a28-a0b8-4567-ac5c-d18b25565947-kube-api-access-6mxf9\") pod \"b7903a28-a0b8-4567-ac5c-d18b25565947\" (UID: \"b7903a28-a0b8-4567-ac5c-d18b25565947\") " Jul 09 04:17:21.528988 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:21.528943 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b7903a28-a0b8-4567-ac5c-d18b25565947-installation-pull-secrets\") pod \"b7903a28-a0b8-4567-ac5c-d18b25565947\" (UID: \"b7903a28-a0b8-4567-ac5c-d18b25565947\") " Jul 09 04:17:21.528988 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:21.528970 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b7903a28-a0b8-4567-ac5c-d18b25565947-registry-tls\") pod \"b7903a28-a0b8-4567-ac5c-d18b25565947\" (UID: \"b7903a28-a0b8-4567-ac5c-d18b25565947\") " Jul 09 04:17:21.529329 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:21.529002 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b7903a28-a0b8-4567-ac5c-d18b25565947-ca-trust-extracted\") pod \"b7903a28-a0b8-4567-ac5c-d18b25565947\" (UID: \"b7903a28-a0b8-4567-ac5c-d18b25565947\") " Jul 09 04:17:21.529329 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:21.529164 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b7903a28-a0b8-4567-ac5c-d18b25565947-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "b7903a28-a0b8-4567-ac5c-d18b25565947" (UID: "b7903a28-a0b8-4567-ac5c-d18b25565947"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 04:17:21.529329 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:21.529297 2566 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b7903a28-a0b8-4567-ac5c-d18b25565947-registry-certificates\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\"" Jul 09 04:17:21.530047 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:21.530019 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b7903a28-a0b8-4567-ac5c-d18b25565947-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "b7903a28-a0b8-4567-ac5c-d18b25565947" (UID: "b7903a28-a0b8-4567-ac5c-d18b25565947"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 04:17:21.534706 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:21.534671 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b7903a28-a0b8-4567-ac5c-d18b25565947-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "b7903a28-a0b8-4567-ac5c-d18b25565947" (UID: "b7903a28-a0b8-4567-ac5c-d18b25565947"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 04:17:21.536278 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:21.536250 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b7903a28-a0b8-4567-ac5c-d18b25565947-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "b7903a28-a0b8-4567-ac5c-d18b25565947" (UID: "b7903a28-a0b8-4567-ac5c-d18b25565947"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 04:17:21.536549 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:21.536473 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b7903a28-a0b8-4567-ac5c-d18b25565947-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "b7903a28-a0b8-4567-ac5c-d18b25565947" (UID: "b7903a28-a0b8-4567-ac5c-d18b25565947"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 04:17:21.536794 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:21.536766 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b7903a28-a0b8-4567-ac5c-d18b25565947-kube-api-access-6mxf9" (OuterVolumeSpecName: "kube-api-access-6mxf9") pod "b7903a28-a0b8-4567-ac5c-d18b25565947" (UID: "b7903a28-a0b8-4567-ac5c-d18b25565947"). InnerVolumeSpecName "kube-api-access-6mxf9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 04:17:21.537717 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:21.537592 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b7903a28-a0b8-4567-ac5c-d18b25565947-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "b7903a28-a0b8-4567-ac5c-d18b25565947" (UID: "b7903a28-a0b8-4567-ac5c-d18b25565947"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 04:17:21.554056 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:21.549195 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b7903a28-a0b8-4567-ac5c-d18b25565947-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "b7903a28-a0b8-4567-ac5c-d18b25565947" (UID: "b7903a28-a0b8-4567-ac5c-d18b25565947"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 04:17:21.630329 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:21.630241 2566 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b7903a28-a0b8-4567-ac5c-d18b25565947-bound-sa-token\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\"" Jul 09 04:17:21.630329 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:21.630281 2566 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b7903a28-a0b8-4567-ac5c-d18b25565947-trusted-ca\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\"" Jul 09 04:17:21.630329 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:21.630295 2566 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b7903a28-a0b8-4567-ac5c-d18b25565947-image-registry-private-configuration\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\"" Jul 09 04:17:21.630329 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:21.630304 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6mxf9\" (UniqueName: \"kubernetes.io/projected/b7903a28-a0b8-4567-ac5c-d18b25565947-kube-api-access-6mxf9\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\"" Jul 09 04:17:21.630329 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:21.630313 2566 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b7903a28-a0b8-4567-ac5c-d18b25565947-installation-pull-secrets\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\"" Jul 09 04:17:21.630329 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:21.630322 2566 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b7903a28-a0b8-4567-ac5c-d18b25565947-registry-tls\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\"" Jul 09 04:17:21.630329 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:21.630330 2566 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b7903a28-a0b8-4567-ac5c-d18b25565947-ca-trust-extracted\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\"" Jul 09 04:17:21.815485 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:21.815448 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-679fd94dd5-pmxfd"] Jul 09 04:17:21.819057 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:21.819028 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-679fd94dd5-pmxfd"] Jul 09 04:17:22.428583 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:22.428538 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-54984f66fd-6rz2j"] Jul 09 04:17:22.429079 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:22.429042 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b7903a28-a0b8-4567-ac5c-d18b25565947" containerName="registry" Jul 09 04:17:22.429079 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:22.429059 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7903a28-a0b8-4567-ac5c-d18b25565947" containerName="registry" Jul 09 04:17:22.429188 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:22.429157 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="b7903a28-a0b8-4567-ac5c-d18b25565947" containerName="registry" Jul 09 04:17:22.469134 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:22.469094 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-54984f66fd-6rz2j"] Jul 09 04:17:22.469387 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:22.469239 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54984f66fd-6rz2j" Jul 09 04:17:22.479071 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:22.478426 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 09 04:17:22.500018 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:22.499903 2566 generic.go:356] "Generic (PLEG): container finished" podID="d725de2c-361f-43cc-92b3-8fff39f6ff2d" containerID="fc2b5927d13174461052d577b61cd3fbf4b2730f76c86a77241e7610cd9ae6ee" exitCode=0 Jul 09 04:17:22.500018 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:22.499961 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7dbtx" event={"ID":"d725de2c-361f-43cc-92b3-8fff39f6ff2d","Type":"ContainerDied","Data":"fc2b5927d13174461052d577b61cd3fbf4b2730f76c86a77241e7610cd9ae6ee"} Jul 09 04:17:22.539449 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:22.539406 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e2304aa8-9607-4d94-8fab-8829bfb9368a-service-ca\") pod \"console-54984f66fd-6rz2j\" (UID: \"e2304aa8-9607-4d94-8fab-8829bfb9368a\") " pod="openshift-console/console-54984f66fd-6rz2j" Jul 09 04:17:22.539658 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:22.539461 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e2304aa8-9607-4d94-8fab-8829bfb9368a-console-serving-cert\") pod \"console-54984f66fd-6rz2j\" (UID: \"e2304aa8-9607-4d94-8fab-8829bfb9368a\") " pod="openshift-console/console-54984f66fd-6rz2j" Jul 09 04:17:22.539658 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:22.539490 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e2304aa8-9607-4d94-8fab-8829bfb9368a-console-oauth-config\") pod \"console-54984f66fd-6rz2j\" (UID: \"e2304aa8-9607-4d94-8fab-8829bfb9368a\") " pod="openshift-console/console-54984f66fd-6rz2j" Jul 09 04:17:22.539658 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:22.539518 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l7fgh\" (UniqueName: \"kubernetes.io/projected/e2304aa8-9607-4d94-8fab-8829bfb9368a-kube-api-access-l7fgh\") pod \"console-54984f66fd-6rz2j\" (UID: \"e2304aa8-9607-4d94-8fab-8829bfb9368a\") " pod="openshift-console/console-54984f66fd-6rz2j" Jul 09 04:17:22.539658 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:22.539641 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e2304aa8-9607-4d94-8fab-8829bfb9368a-console-config\") pod \"console-54984f66fd-6rz2j\" (UID: \"e2304aa8-9607-4d94-8fab-8829bfb9368a\") " pod="openshift-console/console-54984f66fd-6rz2j" Jul 09 04:17:22.539857 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:22.539671 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e2304aa8-9607-4d94-8fab-8829bfb9368a-oauth-serving-cert\") pod \"console-54984f66fd-6rz2j\" (UID: \"e2304aa8-9607-4d94-8fab-8829bfb9368a\") " pod="openshift-console/console-54984f66fd-6rz2j" Jul 09 04:17:22.539857 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:22.539734 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e2304aa8-9607-4d94-8fab-8829bfb9368a-trusted-ca-bundle\") pod \"console-54984f66fd-6rz2j\" (UID: \"e2304aa8-9607-4d94-8fab-8829bfb9368a\") " pod="openshift-console/console-54984f66fd-6rz2j" Jul 09 04:17:22.641214 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:22.641117 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e2304aa8-9607-4d94-8fab-8829bfb9368a-console-config\") pod \"console-54984f66fd-6rz2j\" (UID: \"e2304aa8-9607-4d94-8fab-8829bfb9368a\") " pod="openshift-console/console-54984f66fd-6rz2j" Jul 09 04:17:22.641214 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:22.641186 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e2304aa8-9607-4d94-8fab-8829bfb9368a-oauth-serving-cert\") pod \"console-54984f66fd-6rz2j\" (UID: \"e2304aa8-9607-4d94-8fab-8829bfb9368a\") " pod="openshift-console/console-54984f66fd-6rz2j" Jul 09 04:17:22.641214 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:22.641217 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e2304aa8-9607-4d94-8fab-8829bfb9368a-trusted-ca-bundle\") pod \"console-54984f66fd-6rz2j\" (UID: \"e2304aa8-9607-4d94-8fab-8829bfb9368a\") " pod="openshift-console/console-54984f66fd-6rz2j" Jul 09 04:17:22.641492 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:22.641254 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e2304aa8-9607-4d94-8fab-8829bfb9368a-service-ca\") pod \"console-54984f66fd-6rz2j\" (UID: \"e2304aa8-9607-4d94-8fab-8829bfb9368a\") " pod="openshift-console/console-54984f66fd-6rz2j" Jul 09 04:17:22.641492 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:22.641285 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e2304aa8-9607-4d94-8fab-8829bfb9368a-console-serving-cert\") pod \"console-54984f66fd-6rz2j\" (UID: \"e2304aa8-9607-4d94-8fab-8829bfb9368a\") " pod="openshift-console/console-54984f66fd-6rz2j" Jul 09 04:17:22.641492 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:22.641310 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e2304aa8-9607-4d94-8fab-8829bfb9368a-console-oauth-config\") pod \"console-54984f66fd-6rz2j\" (UID: \"e2304aa8-9607-4d94-8fab-8829bfb9368a\") " pod="openshift-console/console-54984f66fd-6rz2j" Jul 09 04:17:22.641492 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:22.641335 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l7fgh\" (UniqueName: \"kubernetes.io/projected/e2304aa8-9607-4d94-8fab-8829bfb9368a-kube-api-access-l7fgh\") pod \"console-54984f66fd-6rz2j\" (UID: \"e2304aa8-9607-4d94-8fab-8829bfb9368a\") " pod="openshift-console/console-54984f66fd-6rz2j" Jul 09 04:17:22.643127 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:22.642925 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e2304aa8-9607-4d94-8fab-8829bfb9368a-oauth-serving-cert\") pod \"console-54984f66fd-6rz2j\" (UID: \"e2304aa8-9607-4d94-8fab-8829bfb9368a\") " pod="openshift-console/console-54984f66fd-6rz2j" Jul 09 04:17:22.643242 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:22.643177 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e2304aa8-9607-4d94-8fab-8829bfb9368a-trusted-ca-bundle\") pod \"console-54984f66fd-6rz2j\" (UID: \"e2304aa8-9607-4d94-8fab-8829bfb9368a\") " pod="openshift-console/console-54984f66fd-6rz2j" Jul 09 04:17:22.643888 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:22.643805 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e2304aa8-9607-4d94-8fab-8829bfb9368a-console-config\") pod \"console-54984f66fd-6rz2j\" (UID: \"e2304aa8-9607-4d94-8fab-8829bfb9368a\") " pod="openshift-console/console-54984f66fd-6rz2j" Jul 09 04:17:22.644675 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:22.644651 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e2304aa8-9607-4d94-8fab-8829bfb9368a-service-ca\") pod \"console-54984f66fd-6rz2j\" (UID: \"e2304aa8-9607-4d94-8fab-8829bfb9368a\") " pod="openshift-console/console-54984f66fd-6rz2j" Jul 09 04:17:22.646010 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:22.645967 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e2304aa8-9607-4d94-8fab-8829bfb9368a-console-serving-cert\") pod \"console-54984f66fd-6rz2j\" (UID: \"e2304aa8-9607-4d94-8fab-8829bfb9368a\") " pod="openshift-console/console-54984f66fd-6rz2j" Jul 09 04:17:22.651746 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:22.651705 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l7fgh\" (UniqueName: \"kubernetes.io/projected/e2304aa8-9607-4d94-8fab-8829bfb9368a-kube-api-access-l7fgh\") pod \"console-54984f66fd-6rz2j\" (UID: \"e2304aa8-9607-4d94-8fab-8829bfb9368a\") " pod="openshift-console/console-54984f66fd-6rz2j" Jul 09 04:17:22.652331 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:22.652306 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e2304aa8-9607-4d94-8fab-8829bfb9368a-console-oauth-config\") pod \"console-54984f66fd-6rz2j\" (UID: \"e2304aa8-9607-4d94-8fab-8829bfb9368a\") " pod="openshift-console/console-54984f66fd-6rz2j" Jul 09 04:17:22.783013 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:22.782972 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54984f66fd-6rz2j" Jul 09 04:17:22.930430 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:22.930386 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b7903a28-a0b8-4567-ac5c-d18b25565947" path="/var/lib/kubelet/pods/b7903a28-a0b8-4567-ac5c-d18b25565947/volumes" Jul 09 04:17:23.025534 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:23.025497 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-54984f66fd-6rz2j"] Jul 09 04:17:23.027735 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:17:23.027700 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2304aa8_9607_4d94_8fab_8829bfb9368a.slice/crio-cfa3576e81fdf1ed070daafea6730bbeb1a779c67ffc354566811c64e643a92d WatchSource:0}: Error finding container cfa3576e81fdf1ed070daafea6730bbeb1a779c67ffc354566811c64e643a92d: Status 404 returned error can't find the container with id cfa3576e81fdf1ed070daafea6730bbeb1a779c67ffc354566811c64e643a92d Jul 09 04:17:23.510496 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:23.510453 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7dbtx" event={"ID":"d725de2c-361f-43cc-92b3-8fff39f6ff2d","Type":"ContainerStarted","Data":"518d453d45bc42dd6fbfe7ae6f38d96f77414adf5dea9df2b3910a8b24763244"} Jul 09 04:17:23.511035 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:23.510522 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7dbtx" event={"ID":"d725de2c-361f-43cc-92b3-8fff39f6ff2d","Type":"ContainerStarted","Data":"5064e98160559eaf45b536c83fefafeb6266b8b869ff0de293bfe3cebff765c6"} Jul 09 04:17:23.512476 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:23.512446 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54984f66fd-6rz2j" event={"ID":"e2304aa8-9607-4d94-8fab-8829bfb9368a","Type":"ContainerStarted","Data":"6745eefc0834672883647a2fcd7e1a151dff84c1405ed7c536cc8327e429679e"} Jul 09 04:17:23.512604 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:23.512497 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54984f66fd-6rz2j" event={"ID":"e2304aa8-9607-4d94-8fab-8829bfb9368a","Type":"ContainerStarted","Data":"cfa3576e81fdf1ed070daafea6730bbeb1a779c67ffc354566811c64e643a92d"} Jul 09 04:17:23.548446 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:23.548375 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-54984f66fd-6rz2j" podStartSLOduration=1.548351225 podStartE2EDuration="1.548351225s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:17:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:17:23.547116647 +0000 UTC m=+101.164014894" watchObservedRunningTime="2026-07-09 04:17:23.548351225 +0000 UTC m=+101.165249444" Jul 09 04:17:23.549199 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:23.549155 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-7dbtx" podStartSLOduration=4.981678732 podStartE2EDuration="6.549141139s" totalImagesPullingTime="1.448454435s" totalInitContainerRuntime="119.007972ms" isStatefulPod=true podCreationTimestamp="2026-07-09 04:17:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:17:23.528688381 +0000 UTC m=+101.145586622" watchObservedRunningTime="2026-07-09 04:17:23.549141139 +0000 UTC m=+101.166039364" Jul 09 04:17:23.793851 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:23.793747 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5bb6bc998-jhp7f"] Jul 09 04:17:24.296140 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:24.296102 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-fgq98" Jul 09 04:17:32.784191 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:32.784146 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-54984f66fd-6rz2j" Jul 09 04:17:32.784659 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:32.784212 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-54984f66fd-6rz2j" Jul 09 04:17:32.789295 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:32.789271 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-54984f66fd-6rz2j" Jul 09 04:17:33.564190 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:33.564158 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-54984f66fd-6rz2j" Jul 09 04:17:35.570387 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:35.570347 2566 generic.go:356] "Generic (PLEG): container finished" podID="e2fcabda-d114-4620-b0fa-9229d35ab0ee" containerID="b630804427087400c257243ae4421dc5a4bbb8b3602c5a18bcb8c053b3fd2ba4" exitCode=0 Jul 09 04:17:35.570797 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:35.570365 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-cqrqz" event={"ID":"e2fcabda-d114-4620-b0fa-9229d35ab0ee","Type":"ContainerDied","Data":"b630804427087400c257243ae4421dc5a4bbb8b3602c5a18bcb8c053b3fd2ba4"} Jul 09 04:17:35.570852 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:35.570798 2566 scope.go:117] "RemoveContainer" containerID="b630804427087400c257243ae4421dc5a4bbb8b3602c5a18bcb8c053b3fd2ba4" Jul 09 04:17:36.577117 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:36.577083 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-cqrqz" event={"ID":"e2fcabda-d114-4620-b0fa-9229d35ab0ee","Type":"ContainerStarted","Data":"e71be98390c72b133d325c30b95b405f23615d3713e736a0041db777e6751080"} Jul 09 04:17:40.890604 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:40.890539 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5cb499cd5c-s8kgk" podUID="6af07cc3-e722-4d84-b338-825c2ca46c79" containerName="console" containerID="cri-o://6ac46945230f319e602d8ac2f9ddfc47d7189fe7ff556b131cdc32207aee7c47" gracePeriod=15 Jul 09 04:17:41.182335 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:41.182244 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cb499cd5c-s8kgk" Jul 09 04:17:41.317725 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:41.317687 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6af07cc3-e722-4d84-b338-825c2ca46c79-console-serving-cert\") pod \"6af07cc3-e722-4d84-b338-825c2ca46c79\" (UID: \"6af07cc3-e722-4d84-b338-825c2ca46c79\") " Jul 09 04:17:41.317961 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:41.317739 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6af07cc3-e722-4d84-b338-825c2ca46c79-oauth-serving-cert\") pod \"6af07cc3-e722-4d84-b338-825c2ca46c79\" (UID: \"6af07cc3-e722-4d84-b338-825c2ca46c79\") " Jul 09 04:17:41.317961 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:41.317780 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6af07cc3-e722-4d84-b338-825c2ca46c79-console-config\") pod \"6af07cc3-e722-4d84-b338-825c2ca46c79\" (UID: \"6af07cc3-e722-4d84-b338-825c2ca46c79\") " Jul 09 04:17:41.318058 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:41.318014 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6af07cc3-e722-4d84-b338-825c2ca46c79-service-ca\") pod \"6af07cc3-e722-4d84-b338-825c2ca46c79\" (UID: \"6af07cc3-e722-4d84-b338-825c2ca46c79\") " Jul 09 04:17:41.318110 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:41.318070 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6af07cc3-e722-4d84-b338-825c2ca46c79-console-oauth-config\") pod \"6af07cc3-e722-4d84-b338-825c2ca46c79\" (UID: \"6af07cc3-e722-4d84-b338-825c2ca46c79\") " Jul 09 04:17:41.318207 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:41.318184 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6af07cc3-e722-4d84-b338-825c2ca46c79-console-config" (OuterVolumeSpecName: "console-config") pod "6af07cc3-e722-4d84-b338-825c2ca46c79" (UID: "6af07cc3-e722-4d84-b338-825c2ca46c79"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 04:17:41.318478 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:41.318192 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-st5dq\" (UniqueName: \"kubernetes.io/projected/6af07cc3-e722-4d84-b338-825c2ca46c79-kube-api-access-st5dq\") pod \"6af07cc3-e722-4d84-b338-825c2ca46c79\" (UID: \"6af07cc3-e722-4d84-b338-825c2ca46c79\") " Jul 09 04:17:41.318689 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:41.318207 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6af07cc3-e722-4d84-b338-825c2ca46c79-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "6af07cc3-e722-4d84-b338-825c2ca46c79" (UID: "6af07cc3-e722-4d84-b338-825c2ca46c79"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 04:17:41.318840 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:41.318419 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6af07cc3-e722-4d84-b338-825c2ca46c79-service-ca" (OuterVolumeSpecName: "service-ca") pod "6af07cc3-e722-4d84-b338-825c2ca46c79" (UID: "6af07cc3-e722-4d84-b338-825c2ca46c79"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 04:17:41.319104 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:41.319081 2566 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6af07cc3-e722-4d84-b338-825c2ca46c79-oauth-serving-cert\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\"" Jul 09 04:17:41.319165 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:41.319125 2566 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6af07cc3-e722-4d84-b338-825c2ca46c79-console-config\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\"" Jul 09 04:17:41.319165 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:41.319142 2566 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6af07cc3-e722-4d84-b338-825c2ca46c79-service-ca\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\"" Jul 09 04:17:41.320727 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:41.320686 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6af07cc3-e722-4d84-b338-825c2ca46c79-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "6af07cc3-e722-4d84-b338-825c2ca46c79" (UID: "6af07cc3-e722-4d84-b338-825c2ca46c79"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 04:17:41.320825 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:41.320747 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6af07cc3-e722-4d84-b338-825c2ca46c79-kube-api-access-st5dq" (OuterVolumeSpecName: "kube-api-access-st5dq") pod "6af07cc3-e722-4d84-b338-825c2ca46c79" (UID: "6af07cc3-e722-4d84-b338-825c2ca46c79"). InnerVolumeSpecName "kube-api-access-st5dq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 04:17:41.320825 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:41.320761 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6af07cc3-e722-4d84-b338-825c2ca46c79-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "6af07cc3-e722-4d84-b338-825c2ca46c79" (UID: "6af07cc3-e722-4d84-b338-825c2ca46c79"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 04:17:41.420027 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:41.419989 2566 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6af07cc3-e722-4d84-b338-825c2ca46c79-console-oauth-config\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\"" Jul 09 04:17:41.420027 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:41.420020 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-st5dq\" (UniqueName: \"kubernetes.io/projected/6af07cc3-e722-4d84-b338-825c2ca46c79-kube-api-access-st5dq\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\"" Jul 09 04:17:41.420027 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:41.420036 2566 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6af07cc3-e722-4d84-b338-825c2ca46c79-console-serving-cert\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\"" Jul 09 04:17:41.600397 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:41.600362 2566 generic.go:356] "Generic (PLEG): container finished" podID="6af07cc3-e722-4d84-b338-825c2ca46c79" containerID="6ac46945230f319e602d8ac2f9ddfc47d7189fe7ff556b131cdc32207aee7c47" exitCode=0 Jul 09 04:17:41.600591 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:41.600411 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cb499cd5c-s8kgk" Jul 09 04:17:41.600591 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:41.600449 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cb499cd5c-s8kgk" event={"ID":"6af07cc3-e722-4d84-b338-825c2ca46c79","Type":"ContainerDied","Data":"6ac46945230f319e602d8ac2f9ddfc47d7189fe7ff556b131cdc32207aee7c47"} Jul 09 04:17:41.600591 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:41.600527 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cb499cd5c-s8kgk" event={"ID":"6af07cc3-e722-4d84-b338-825c2ca46c79","Type":"ContainerDied","Data":"40c5444a34aeb198d1f22447919388e54c2dd930f9e0a69d6053e7ed2b7348e5"} Jul 09 04:17:41.600591 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:41.600550 2566 scope.go:117] "RemoveContainer" containerID="6ac46945230f319e602d8ac2f9ddfc47d7189fe7ff556b131cdc32207aee7c47" Jul 09 04:17:41.610103 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:41.610085 2566 scope.go:117] "RemoveContainer" containerID="6ac46945230f319e602d8ac2f9ddfc47d7189fe7ff556b131cdc32207aee7c47" Jul 09 04:17:41.610410 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:17:41.610391 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6ac46945230f319e602d8ac2f9ddfc47d7189fe7ff556b131cdc32207aee7c47\": container with ID starting with 6ac46945230f319e602d8ac2f9ddfc47d7189fe7ff556b131cdc32207aee7c47 not found: ID does not exist" containerID="6ac46945230f319e602d8ac2f9ddfc47d7189fe7ff556b131cdc32207aee7c47" Jul 09 04:17:41.610469 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:41.610419 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ac46945230f319e602d8ac2f9ddfc47d7189fe7ff556b131cdc32207aee7c47"} err="failed to get container status \"6ac46945230f319e602d8ac2f9ddfc47d7189fe7ff556b131cdc32207aee7c47\": rpc error: code = NotFound desc = could not find container \"6ac46945230f319e602d8ac2f9ddfc47d7189fe7ff556b131cdc32207aee7c47\": container with ID starting with 6ac46945230f319e602d8ac2f9ddfc47d7189fe7ff556b131cdc32207aee7c47 not found: ID does not exist" Jul 09 04:17:41.623967 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:41.623939 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5cb499cd5c-s8kgk"] Jul 09 04:17:41.627886 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:41.627862 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5cb499cd5c-s8kgk"] Jul 09 04:17:42.912677 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:42.912640 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6af07cc3-e722-4d84-b338-825c2ca46c79" path="/var/lib/kubelet/pods/6af07cc3-e722-4d84-b338-825c2ca46c79/volumes" Jul 09 04:17:48.826379 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:48.826332 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5bb6bc998-jhp7f" podUID="36b72c73-bb0b-4e08-95c8-7f1f263f46f4" containerName="registry" containerID="cri-o://fac1650f74812f7390e3237c616850b4f348d7d481b8e320f5d4d8b00271b5f5" gracePeriod=30 Jul 09 04:17:49.101720 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:49.101698 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5bb6bc998-jhp7f" Jul 09 04:17:49.182124 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:49.182089 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/36b72c73-bb0b-4e08-95c8-7f1f263f46f4-registry-tls\") pod \"36b72c73-bb0b-4e08-95c8-7f1f263f46f4\" (UID: \"36b72c73-bb0b-4e08-95c8-7f1f263f46f4\") " Jul 09 04:17:49.182124 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:49.182126 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/36b72c73-bb0b-4e08-95c8-7f1f263f46f4-trusted-ca\") pod \"36b72c73-bb0b-4e08-95c8-7f1f263f46f4\" (UID: \"36b72c73-bb0b-4e08-95c8-7f1f263f46f4\") " Jul 09 04:17:49.182349 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:49.182164 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gtpq8\" (UniqueName: \"kubernetes.io/projected/36b72c73-bb0b-4e08-95c8-7f1f263f46f4-kube-api-access-gtpq8\") pod \"36b72c73-bb0b-4e08-95c8-7f1f263f46f4\" (UID: \"36b72c73-bb0b-4e08-95c8-7f1f263f46f4\") " Jul 09 04:17:49.182349 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:49.182309 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/36b72c73-bb0b-4e08-95c8-7f1f263f46f4-image-registry-private-configuration\") pod \"36b72c73-bb0b-4e08-95c8-7f1f263f46f4\" (UID: \"36b72c73-bb0b-4e08-95c8-7f1f263f46f4\") " Jul 09 04:17:49.182460 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:49.182358 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/36b72c73-bb0b-4e08-95c8-7f1f263f46f4-ca-trust-extracted\") pod \"36b72c73-bb0b-4e08-95c8-7f1f263f46f4\" (UID: \"36b72c73-bb0b-4e08-95c8-7f1f263f46f4\") " Jul 09 04:17:49.182520 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:49.182500 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/36b72c73-bb0b-4e08-95c8-7f1f263f46f4-installation-pull-secrets\") pod \"36b72c73-bb0b-4e08-95c8-7f1f263f46f4\" (UID: \"36b72c73-bb0b-4e08-95c8-7f1f263f46f4\") " Jul 09 04:17:49.182601 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:49.182582 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/36b72c73-bb0b-4e08-95c8-7f1f263f46f4-bound-sa-token\") pod \"36b72c73-bb0b-4e08-95c8-7f1f263f46f4\" (UID: \"36b72c73-bb0b-4e08-95c8-7f1f263f46f4\") " Jul 09 04:17:49.182699 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:49.182661 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/36b72c73-bb0b-4e08-95c8-7f1f263f46f4-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "36b72c73-bb0b-4e08-95c8-7f1f263f46f4" (UID: "36b72c73-bb0b-4e08-95c8-7f1f263f46f4"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 04:17:49.183151 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:49.183130 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/36b72c73-bb0b-4e08-95c8-7f1f263f46f4-registry-certificates\") pod \"36b72c73-bb0b-4e08-95c8-7f1f263f46f4\" (UID: \"36b72c73-bb0b-4e08-95c8-7f1f263f46f4\") " Jul 09 04:17:49.183631 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:49.183612 2566 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/36b72c73-bb0b-4e08-95c8-7f1f263f46f4-trusted-ca\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\"" Jul 09 04:17:49.183784 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:49.183673 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/36b72c73-bb0b-4e08-95c8-7f1f263f46f4-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "36b72c73-bb0b-4e08-95c8-7f1f263f46f4" (UID: "36b72c73-bb0b-4e08-95c8-7f1f263f46f4"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 04:17:49.184988 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:49.184926 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/36b72c73-bb0b-4e08-95c8-7f1f263f46f4-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "36b72c73-bb0b-4e08-95c8-7f1f263f46f4" (UID: "36b72c73-bb0b-4e08-95c8-7f1f263f46f4"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 04:17:49.184988 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:49.184935 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36b72c73-bb0b-4e08-95c8-7f1f263f46f4-kube-api-access-gtpq8" (OuterVolumeSpecName: "kube-api-access-gtpq8") pod "36b72c73-bb0b-4e08-95c8-7f1f263f46f4" (UID: "36b72c73-bb0b-4e08-95c8-7f1f263f46f4"). InnerVolumeSpecName "kube-api-access-gtpq8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 04:17:49.185149 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:49.185125 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/36b72c73-bb0b-4e08-95c8-7f1f263f46f4-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "36b72c73-bb0b-4e08-95c8-7f1f263f46f4" (UID: "36b72c73-bb0b-4e08-95c8-7f1f263f46f4"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 04:17:49.185330 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:49.185303 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36b72c73-bb0b-4e08-95c8-7f1f263f46f4-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "36b72c73-bb0b-4e08-95c8-7f1f263f46f4" (UID: "36b72c73-bb0b-4e08-95c8-7f1f263f46f4"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 04:17:49.185442 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:49.185422 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36b72c73-bb0b-4e08-95c8-7f1f263f46f4-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "36b72c73-bb0b-4e08-95c8-7f1f263f46f4" (UID: "36b72c73-bb0b-4e08-95c8-7f1f263f46f4"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 04:17:49.191130 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:49.191107 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36b72c73-bb0b-4e08-95c8-7f1f263f46f4-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "36b72c73-bb0b-4e08-95c8-7f1f263f46f4" (UID: "36b72c73-bb0b-4e08-95c8-7f1f263f46f4"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 04:17:49.284865 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:49.284820 2566 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/36b72c73-bb0b-4e08-95c8-7f1f263f46f4-registry-certificates\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\"" Jul 09 04:17:49.284865 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:49.284860 2566 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/36b72c73-bb0b-4e08-95c8-7f1f263f46f4-registry-tls\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\"" Jul 09 04:17:49.284865 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:49.284871 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gtpq8\" (UniqueName: \"kubernetes.io/projected/36b72c73-bb0b-4e08-95c8-7f1f263f46f4-kube-api-access-gtpq8\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\"" Jul 09 04:17:49.284865 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:49.284880 2566 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/36b72c73-bb0b-4e08-95c8-7f1f263f46f4-image-registry-private-configuration\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\"" Jul 09 04:17:49.285157 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:49.284889 2566 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/36b72c73-bb0b-4e08-95c8-7f1f263f46f4-ca-trust-extracted\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\"" Jul 09 04:17:49.285157 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:49.284899 2566 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/36b72c73-bb0b-4e08-95c8-7f1f263f46f4-installation-pull-secrets\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\"" Jul 09 04:17:49.285157 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:49.284930 2566 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/36b72c73-bb0b-4e08-95c8-7f1f263f46f4-bound-sa-token\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\"" Jul 09 04:17:49.636058 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:49.636022 2566 generic.go:356] "Generic (PLEG): container finished" podID="36b72c73-bb0b-4e08-95c8-7f1f263f46f4" containerID="fac1650f74812f7390e3237c616850b4f348d7d481b8e320f5d4d8b00271b5f5" exitCode=0 Jul 09 04:17:49.636217 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:49.636069 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5bb6bc998-jhp7f" Jul 09 04:17:49.636217 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:49.636116 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5bb6bc998-jhp7f" event={"ID":"36b72c73-bb0b-4e08-95c8-7f1f263f46f4","Type":"ContainerDied","Data":"fac1650f74812f7390e3237c616850b4f348d7d481b8e320f5d4d8b00271b5f5"} Jul 09 04:17:49.636217 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:49.636173 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5bb6bc998-jhp7f" event={"ID":"36b72c73-bb0b-4e08-95c8-7f1f263f46f4","Type":"ContainerDied","Data":"bfff7c23a43958e018ce057542a9e1adea766f6b5bb897c783a48371dec92de3"} Jul 09 04:17:49.636217 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:49.636194 2566 scope.go:117] "RemoveContainer" containerID="fac1650f74812f7390e3237c616850b4f348d7d481b8e320f5d4d8b00271b5f5" Jul 09 04:17:49.645053 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:49.645039 2566 scope.go:117] "RemoveContainer" containerID="fac1650f74812f7390e3237c616850b4f348d7d481b8e320f5d4d8b00271b5f5" Jul 09 04:17:49.645309 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:17:49.645291 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fac1650f74812f7390e3237c616850b4f348d7d481b8e320f5d4d8b00271b5f5\": container with ID starting with fac1650f74812f7390e3237c616850b4f348d7d481b8e320f5d4d8b00271b5f5 not found: ID does not exist" containerID="fac1650f74812f7390e3237c616850b4f348d7d481b8e320f5d4d8b00271b5f5" Jul 09 04:17:49.645375 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:49.645322 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fac1650f74812f7390e3237c616850b4f348d7d481b8e320f5d4d8b00271b5f5"} err="failed to get container status \"fac1650f74812f7390e3237c616850b4f348d7d481b8e320f5d4d8b00271b5f5\": rpc error: code = NotFound desc = could not find container \"fac1650f74812f7390e3237c616850b4f348d7d481b8e320f5d4d8b00271b5f5\": container with ID starting with fac1650f74812f7390e3237c616850b4f348d7d481b8e320f5d4d8b00271b5f5 not found: ID does not exist" Jul 09 04:17:49.656975 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:49.656952 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5bb6bc998-jhp7f"] Jul 09 04:17:49.661325 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:49.661306 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5bb6bc998-jhp7f"] Jul 09 04:17:50.641342 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:50.641310 2566 generic.go:356] "Generic (PLEG): container finished" podID="1095557e-f542-4e1d-a462-0a024f80347e" containerID="5218217817c8caffc09e035b8ebc16515e65a2c613793eadd1c79f178a789c3b" exitCode=0 Jul 09 04:17:50.641727 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:50.641388 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-8stqx" event={"ID":"1095557e-f542-4e1d-a462-0a024f80347e","Type":"ContainerDied","Data":"5218217817c8caffc09e035b8ebc16515e65a2c613793eadd1c79f178a789c3b"} Jul 09 04:17:50.641833 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:50.641799 2566 scope.go:117] "RemoveContainer" containerID="5218217817c8caffc09e035b8ebc16515e65a2c613793eadd1c79f178a789c3b" Jul 09 04:17:50.911354 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:50.911279 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="36b72c73-bb0b-4e08-95c8-7f1f263f46f4" path="/var/lib/kubelet/pods/36b72c73-bb0b-4e08-95c8-7f1f263f46f4/volumes" Jul 09 04:17:51.648390 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:51.648356 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-8stqx" event={"ID":"1095557e-f542-4e1d-a462-0a024f80347e","Type":"ContainerStarted","Data":"95ed7103ae5e859186542f53a024a7cb0d2f690dc4ae21ba1f5743f5e0ee4744"} Jul 09 04:17:55.666805 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:55.666767 2566 generic.go:356] "Generic (PLEG): container finished" podID="c805c009-9a98-4b40-9c74-9bed4868db61" containerID="55176caffce1c69c76c5d21672a08fd9ff0a43c8ea520bedcb4d538ebb4d7c99" exitCode=0 Jul 09 04:17:55.667234 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:55.666843 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-6sjg9" event={"ID":"c805c009-9a98-4b40-9c74-9bed4868db61","Type":"ContainerDied","Data":"55176caffce1c69c76c5d21672a08fd9ff0a43c8ea520bedcb4d538ebb4d7c99"} Jul 09 04:17:55.667234 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:55.667206 2566 scope.go:117] "RemoveContainer" containerID="55176caffce1c69c76c5d21672a08fd9ff0a43c8ea520bedcb4d538ebb4d7c99" Jul 09 04:17:56.673168 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:17:56.673138 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-6sjg9" event={"ID":"c805c009-9a98-4b40-9c74-9bed4868db61","Type":"ContainerStarted","Data":"46c4c90dfc2c18f50007260361396b4bbf55c7982a1abe9c62073d25348e2692"} Jul 09 04:19:03.411076 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:19:03.411032 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-54984f66fd-6rz2j"] Jul 09 04:19:28.431863 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:19:28.431821 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-54984f66fd-6rz2j" podUID="e2304aa8-9607-4d94-8fab-8829bfb9368a" containerName="console" containerID="cri-o://6745eefc0834672883647a2fcd7e1a151dff84c1405ed7c536cc8327e429679e" gracePeriod=15 Jul 09 04:19:28.702525 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:19:28.702489 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54984f66fd-6rz2j" Jul 09 04:19:28.821178 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:19:28.821141 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e2304aa8-9607-4d94-8fab-8829bfb9368a-console-oauth-config\") pod \"e2304aa8-9607-4d94-8fab-8829bfb9368a\" (UID: \"e2304aa8-9607-4d94-8fab-8829bfb9368a\") " Jul 09 04:19:28.821178 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:19:28.821178 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e2304aa8-9607-4d94-8fab-8829bfb9368a-trusted-ca-bundle\") pod \"e2304aa8-9607-4d94-8fab-8829bfb9368a\" (UID: \"e2304aa8-9607-4d94-8fab-8829bfb9368a\") " Jul 09 04:19:28.821432 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:19:28.821204 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e2304aa8-9607-4d94-8fab-8829bfb9368a-console-config\") pod \"e2304aa8-9607-4d94-8fab-8829bfb9368a\" (UID: \"e2304aa8-9607-4d94-8fab-8829bfb9368a\") " Jul 09 04:19:28.821432 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:19:28.821240 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e2304aa8-9607-4d94-8fab-8829bfb9368a-console-serving-cert\") pod \"e2304aa8-9607-4d94-8fab-8829bfb9368a\" (UID: \"e2304aa8-9607-4d94-8fab-8829bfb9368a\") " Jul 09 04:19:28.821432 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:19:28.821391 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e2304aa8-9607-4d94-8fab-8829bfb9368a-service-ca\") pod \"e2304aa8-9607-4d94-8fab-8829bfb9368a\" (UID: \"e2304aa8-9607-4d94-8fab-8829bfb9368a\") " Jul 09 04:19:28.821593 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:19:28.821481 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l7fgh\" (UniqueName: \"kubernetes.io/projected/e2304aa8-9607-4d94-8fab-8829bfb9368a-kube-api-access-l7fgh\") pod \"e2304aa8-9607-4d94-8fab-8829bfb9368a\" (UID: \"e2304aa8-9607-4d94-8fab-8829bfb9368a\") " Jul 09 04:19:28.821593 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:19:28.821559 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e2304aa8-9607-4d94-8fab-8829bfb9368a-oauth-serving-cert\") pod \"e2304aa8-9607-4d94-8fab-8829bfb9368a\" (UID: \"e2304aa8-9607-4d94-8fab-8829bfb9368a\") " Jul 09 04:19:28.821691 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:19:28.821659 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e2304aa8-9607-4d94-8fab-8829bfb9368a-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "e2304aa8-9607-4d94-8fab-8829bfb9368a" (UID: "e2304aa8-9607-4d94-8fab-8829bfb9368a"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 04:19:28.821741 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:19:28.821681 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e2304aa8-9607-4d94-8fab-8829bfb9368a-console-config" (OuterVolumeSpecName: "console-config") pod "e2304aa8-9607-4d94-8fab-8829bfb9368a" (UID: "e2304aa8-9607-4d94-8fab-8829bfb9368a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 04:19:28.821741 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:19:28.821707 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e2304aa8-9607-4d94-8fab-8829bfb9368a-service-ca" (OuterVolumeSpecName: "service-ca") pod "e2304aa8-9607-4d94-8fab-8829bfb9368a" (UID: "e2304aa8-9607-4d94-8fab-8829bfb9368a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 04:19:28.822009 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:19:28.821992 2566 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e2304aa8-9607-4d94-8fab-8829bfb9368a-console-config\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\"" Jul 09 04:19:28.822009 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:19:28.822010 2566 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e2304aa8-9607-4d94-8fab-8829bfb9368a-service-ca\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\"" Jul 09 04:19:28.822106 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:19:28.822019 2566 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e2304aa8-9607-4d94-8fab-8829bfb9368a-trusted-ca-bundle\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\"" Jul 09 04:19:28.822230 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:19:28.822208 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e2304aa8-9607-4d94-8fab-8829bfb9368a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e2304aa8-9607-4d94-8fab-8829bfb9368a" (UID: "e2304aa8-9607-4d94-8fab-8829bfb9368a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 04:19:28.823567 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:19:28.823537 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e2304aa8-9607-4d94-8fab-8829bfb9368a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e2304aa8-9607-4d94-8fab-8829bfb9368a" (UID: "e2304aa8-9607-4d94-8fab-8829bfb9368a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 04:19:28.823672 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:19:28.823607 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e2304aa8-9607-4d94-8fab-8829bfb9368a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e2304aa8-9607-4d94-8fab-8829bfb9368a" (UID: "e2304aa8-9607-4d94-8fab-8829bfb9368a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 04:19:28.823850 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:19:28.823827 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e2304aa8-9607-4d94-8fab-8829bfb9368a-kube-api-access-l7fgh" (OuterVolumeSpecName: "kube-api-access-l7fgh") pod "e2304aa8-9607-4d94-8fab-8829bfb9368a" (UID: "e2304aa8-9607-4d94-8fab-8829bfb9368a"). InnerVolumeSpecName "kube-api-access-l7fgh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 04:19:28.923310 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:19:28.923280 2566 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e2304aa8-9607-4d94-8fab-8829bfb9368a-oauth-serving-cert\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\"" Jul 09 04:19:28.923310 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:19:28.923311 2566 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e2304aa8-9607-4d94-8fab-8829bfb9368a-console-oauth-config\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\"" Jul 09 04:19:28.923495 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:19:28.923321 2566 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e2304aa8-9607-4d94-8fab-8829bfb9368a-console-serving-cert\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\"" Jul 09 04:19:28.923495 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:19:28.923330 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l7fgh\" (UniqueName: \"kubernetes.io/projected/e2304aa8-9607-4d94-8fab-8829bfb9368a-kube-api-access-l7fgh\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\"" Jul 09 04:19:29.054993 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:19:29.054957 2566 generic.go:356] "Generic (PLEG): container finished" podID="e2304aa8-9607-4d94-8fab-8829bfb9368a" containerID="6745eefc0834672883647a2fcd7e1a151dff84c1405ed7c536cc8327e429679e" exitCode=0 Jul 09 04:19:29.055199 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:19:29.055007 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54984f66fd-6rz2j" Jul 09 04:19:29.055199 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:19:29.055049 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54984f66fd-6rz2j" event={"ID":"e2304aa8-9607-4d94-8fab-8829bfb9368a","Type":"ContainerDied","Data":"6745eefc0834672883647a2fcd7e1a151dff84c1405ed7c536cc8327e429679e"} Jul 09 04:19:29.055199 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:19:29.055105 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54984f66fd-6rz2j" event={"ID":"e2304aa8-9607-4d94-8fab-8829bfb9368a","Type":"ContainerDied","Data":"cfa3576e81fdf1ed070daafea6730bbeb1a779c67ffc354566811c64e643a92d"} Jul 09 04:19:29.055199 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:19:29.055133 2566 scope.go:117] "RemoveContainer" containerID="6745eefc0834672883647a2fcd7e1a151dff84c1405ed7c536cc8327e429679e" Jul 09 04:19:29.066504 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:19:29.066482 2566 scope.go:117] "RemoveContainer" containerID="6745eefc0834672883647a2fcd7e1a151dff84c1405ed7c536cc8327e429679e" Jul 09 04:19:29.066877 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:19:29.066855 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6745eefc0834672883647a2fcd7e1a151dff84c1405ed7c536cc8327e429679e\": container with ID starting with 6745eefc0834672883647a2fcd7e1a151dff84c1405ed7c536cc8327e429679e not found: ID does not exist" containerID="6745eefc0834672883647a2fcd7e1a151dff84c1405ed7c536cc8327e429679e" Jul 09 04:19:29.066941 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:19:29.066888 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6745eefc0834672883647a2fcd7e1a151dff84c1405ed7c536cc8327e429679e"} err="failed to get container status \"6745eefc0834672883647a2fcd7e1a151dff84c1405ed7c536cc8327e429679e\": rpc error: code = NotFound desc = could not find container \"6745eefc0834672883647a2fcd7e1a151dff84c1405ed7c536cc8327e429679e\": container with ID starting with 6745eefc0834672883647a2fcd7e1a151dff84c1405ed7c536cc8327e429679e not found: ID does not exist" Jul 09 04:19:29.072109 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:19:29.072081 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-54984f66fd-6rz2j"] Jul 09 04:19:29.077347 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:19:29.077318 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-54984f66fd-6rz2j"] Jul 09 04:19:30.911480 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:19:30.911444 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e2304aa8-9607-4d94-8fab-8829bfb9368a" path="/var/lib/kubelet/pods/e2304aa8-9607-4d94-8fab-8829bfb9368a/volumes" Jul 09 04:20:42.816035 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:20:42.816007 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-lhzlx_a6976b04-fd52-4288-8d24-fb34cc801459/console-operator/1.log" Jul 09 04:20:42.823070 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:20:42.823039 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-lhzlx_a6976b04-fd52-4288-8d24-fb34cc801459/console-operator/1.log" Jul 09 04:20:42.830993 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:20:42.830964 2566 kubelet.go:1648] "Image garbage collection succeeded" Jul 09 04:21:07.207211 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:07.207174 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-8564dc47f7-xqgq5"] Jul 09 04:21:07.208584 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:07.207528 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6af07cc3-e722-4d84-b338-825c2ca46c79" containerName="console" Jul 09 04:21:07.208584 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:07.207540 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="6af07cc3-e722-4d84-b338-825c2ca46c79" containerName="console" Jul 09 04:21:07.208584 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:07.207553 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36b72c73-bb0b-4e08-95c8-7f1f263f46f4" containerName="registry" Jul 09 04:21:07.208584 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:07.207558 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="36b72c73-bb0b-4e08-95c8-7f1f263f46f4" containerName="registry" Jul 09 04:21:07.208584 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:07.207575 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2304aa8-9607-4d94-8fab-8829bfb9368a" containerName="console" Jul 09 04:21:07.208584 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:07.207584 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2304aa8-9607-4d94-8fab-8829bfb9368a" containerName="console" Jul 09 04:21:07.208584 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:07.207658 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="36b72c73-bb0b-4e08-95c8-7f1f263f46f4" containerName="registry" Jul 09 04:21:07.208584 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:07.207672 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="6af07cc3-e722-4d84-b338-825c2ca46c79" containerName="console" Jul 09 04:21:07.208584 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:07.207678 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="e2304aa8-9607-4d94-8fab-8829bfb9368a" containerName="console" Jul 09 04:21:07.209435 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:07.209420 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-8564dc47f7-xqgq5" Jul 09 04:21:07.220343 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:07.220323 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 09 04:21:07.220647 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:07.220631 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 09 04:21:07.223030 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:07.223016 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 09 04:21:07.223491 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:07.223477 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 09 04:21:07.223571 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:07.223537 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-p2hll\"" Jul 09 04:21:07.247085 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:07.247056 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-8564dc47f7-xqgq5"] Jul 09 04:21:07.309774 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:07.309740 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/26205900-770c-43b1-bfa7-e6c96c89f40c-manifests\") pod \"opendatahub-operator-controller-manager-8564dc47f7-xqgq5\" (UID: \"26205900-770c-43b1-bfa7-e6c96c89f40c\") " pod="opendatahub/opendatahub-operator-controller-manager-8564dc47f7-xqgq5" Jul 09 04:21:07.309967 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:07.309791 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/26205900-770c-43b1-bfa7-e6c96c89f40c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8564dc47f7-xqgq5\" (UID: \"26205900-770c-43b1-bfa7-e6c96c89f40c\") " pod="opendatahub/opendatahub-operator-controller-manager-8564dc47f7-xqgq5" Jul 09 04:21:07.309967 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:07.309820 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/26205900-770c-43b1-bfa7-e6c96c89f40c-webhook-cert\") pod \"opendatahub-operator-controller-manager-8564dc47f7-xqgq5\" (UID: \"26205900-770c-43b1-bfa7-e6c96c89f40c\") " pod="opendatahub/opendatahub-operator-controller-manager-8564dc47f7-xqgq5" Jul 09 04:21:07.309967 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:07.309861 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9fhhx\" (UniqueName: \"kubernetes.io/projected/26205900-770c-43b1-bfa7-e6c96c89f40c-kube-api-access-9fhhx\") pod \"opendatahub-operator-controller-manager-8564dc47f7-xqgq5\" (UID: \"26205900-770c-43b1-bfa7-e6c96c89f40c\") " pod="opendatahub/opendatahub-operator-controller-manager-8564dc47f7-xqgq5" Jul 09 04:21:07.309967 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:07.309891 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/26205900-770c-43b1-bfa7-e6c96c89f40c-tmp\") pod \"opendatahub-operator-controller-manager-8564dc47f7-xqgq5\" (UID: \"26205900-770c-43b1-bfa7-e6c96c89f40c\") " pod="opendatahub/opendatahub-operator-controller-manager-8564dc47f7-xqgq5" Jul 09 04:21:07.410765 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:07.410723 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/26205900-770c-43b1-bfa7-e6c96c89f40c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8564dc47f7-xqgq5\" (UID: \"26205900-770c-43b1-bfa7-e6c96c89f40c\") " pod="opendatahub/opendatahub-operator-controller-manager-8564dc47f7-xqgq5" Jul 09 04:21:07.410765 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:07.410767 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/26205900-770c-43b1-bfa7-e6c96c89f40c-webhook-cert\") pod \"opendatahub-operator-controller-manager-8564dc47f7-xqgq5\" (UID: \"26205900-770c-43b1-bfa7-e6c96c89f40c\") " pod="opendatahub/opendatahub-operator-controller-manager-8564dc47f7-xqgq5" Jul 09 04:21:07.411077 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:07.410816 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9fhhx\" (UniqueName: \"kubernetes.io/projected/26205900-770c-43b1-bfa7-e6c96c89f40c-kube-api-access-9fhhx\") pod \"opendatahub-operator-controller-manager-8564dc47f7-xqgq5\" (UID: \"26205900-770c-43b1-bfa7-e6c96c89f40c\") " pod="opendatahub/opendatahub-operator-controller-manager-8564dc47f7-xqgq5" Jul 09 04:21:07.411077 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:07.410846 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/26205900-770c-43b1-bfa7-e6c96c89f40c-tmp\") pod \"opendatahub-operator-controller-manager-8564dc47f7-xqgq5\" (UID: \"26205900-770c-43b1-bfa7-e6c96c89f40c\") " pod="opendatahub/opendatahub-operator-controller-manager-8564dc47f7-xqgq5" Jul 09 04:21:07.411077 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:07.410905 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/26205900-770c-43b1-bfa7-e6c96c89f40c-manifests\") pod \"opendatahub-operator-controller-manager-8564dc47f7-xqgq5\" (UID: \"26205900-770c-43b1-bfa7-e6c96c89f40c\") " pod="opendatahub/opendatahub-operator-controller-manager-8564dc47f7-xqgq5" Jul 09 04:21:07.411372 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:07.411348 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/26205900-770c-43b1-bfa7-e6c96c89f40c-manifests\") pod \"opendatahub-operator-controller-manager-8564dc47f7-xqgq5\" (UID: \"26205900-770c-43b1-bfa7-e6c96c89f40c\") " pod="opendatahub/opendatahub-operator-controller-manager-8564dc47f7-xqgq5" Jul 09 04:21:07.413316 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:07.413283 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/26205900-770c-43b1-bfa7-e6c96c89f40c-tmp\") pod \"opendatahub-operator-controller-manager-8564dc47f7-xqgq5\" (UID: \"26205900-770c-43b1-bfa7-e6c96c89f40c\") " pod="opendatahub/opendatahub-operator-controller-manager-8564dc47f7-xqgq5" Jul 09 04:21:07.413424 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:07.413332 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/26205900-770c-43b1-bfa7-e6c96c89f40c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8564dc47f7-xqgq5\" (UID: \"26205900-770c-43b1-bfa7-e6c96c89f40c\") " pod="opendatahub/opendatahub-operator-controller-manager-8564dc47f7-xqgq5" Jul 09 04:21:07.413563 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:07.413543 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/26205900-770c-43b1-bfa7-e6c96c89f40c-webhook-cert\") pod \"opendatahub-operator-controller-manager-8564dc47f7-xqgq5\" (UID: \"26205900-770c-43b1-bfa7-e6c96c89f40c\") " pod="opendatahub/opendatahub-operator-controller-manager-8564dc47f7-xqgq5" Jul 09 04:21:07.436956 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:07.436923 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9fhhx\" (UniqueName: \"kubernetes.io/projected/26205900-770c-43b1-bfa7-e6c96c89f40c-kube-api-access-9fhhx\") pod \"opendatahub-operator-controller-manager-8564dc47f7-xqgq5\" (UID: \"26205900-770c-43b1-bfa7-e6c96c89f40c\") " pod="opendatahub/opendatahub-operator-controller-manager-8564dc47f7-xqgq5" Jul 09 04:21:07.520012 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:07.519981 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-8564dc47f7-xqgq5" Jul 09 04:21:07.665051 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:07.665024 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-8564dc47f7-xqgq5"] Jul 09 04:21:07.667779 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:21:07.667750 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26205900_770c_43b1_bfa7_e6c96c89f40c.slice/crio-1b04e6c66f4d3da29ebf774f6cf042c14596180a3e422d5c8b73a998e1dacc79 WatchSource:0}: Error finding container 1b04e6c66f4d3da29ebf774f6cf042c14596180a3e422d5c8b73a998e1dacc79: Status 404 returned error can't find the container with id 1b04e6c66f4d3da29ebf774f6cf042c14596180a3e422d5c8b73a998e1dacc79 Jul 09 04:21:07.669677 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:07.669662 2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 09 04:21:08.442418 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:08.442367 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8564dc47f7-xqgq5" event={"ID":"26205900-770c-43b1-bfa7-e6c96c89f40c","Type":"ContainerStarted","Data":"1b04e6c66f4d3da29ebf774f6cf042c14596180a3e422d5c8b73a998e1dacc79"} Jul 09 04:21:11.459872 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:11.459835 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8564dc47f7-xqgq5" event={"ID":"26205900-770c-43b1-bfa7-e6c96c89f40c","Type":"ContainerStarted","Data":"b6a78c141407e6d4e725551a992c7a92cfb3e40f8d30b32c2dad0dd1df0663b0"} Jul 09 04:21:12.465296 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:12.465261 2566 generic.go:356] "Generic (PLEG): container finished" podID="26205900-770c-43b1-bfa7-e6c96c89f40c" containerID="b6a78c141407e6d4e725551a992c7a92cfb3e40f8d30b32c2dad0dd1df0663b0" exitCode=0 Jul 09 04:21:12.465689 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:12.465351 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8564dc47f7-xqgq5" event={"ID":"26205900-770c-43b1-bfa7-e6c96c89f40c","Type":"ContainerDied","Data":"b6a78c141407e6d4e725551a992c7a92cfb3e40f8d30b32c2dad0dd1df0663b0"} Jul 09 04:21:13.472340 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:13.472287 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8564dc47f7-xqgq5" event={"ID":"26205900-770c-43b1-bfa7-e6c96c89f40c","Type":"ContainerStarted","Data":"c8cd42ef1079e3c168e5d6c1324ab7060348f84cdc297f53f0440113a7ef0378"} Jul 09 04:21:13.472837 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:13.472399 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-8564dc47f7-xqgq5" Jul 09 04:21:13.495938 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:13.495849 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-8564dc47f7-xqgq5" podStartSLOduration=2.010300817 podStartE2EDuration="6.495827419s" totalImagesPullingTime="3.413045882s" totalInitContainerRuntime="1.07248072s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:21:07 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:21:13.49266078 +0000 UTC m=+331.109558998" watchObservedRunningTime="2026-07-09 04:21:13.495827419 +0000 UTC m=+331.112725639" Jul 09 04:21:24.479311 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:24.479273 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-8564dc47f7-xqgq5" Jul 09 04:21:38.293305 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:38.293222 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-b5df4b696-plrg5"] Jul 09 04:21:38.296567 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:38.296546 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-b5df4b696-plrg5" Jul 09 04:21:38.299728 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:38.299707 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 09 04:21:38.301137 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:38.301117 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 09 04:21:38.301137 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:38.301117 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-4sb2z\"" Jul 09 04:21:38.311184 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:38.311158 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-b5df4b696-plrg5"] Jul 09 04:21:38.483069 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:38.483029 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8dbefb98-6f37-4473-993f-649aaeb3b524-tmp\") pod \"kube-auth-proxy-b5df4b696-plrg5\" (UID: \"8dbefb98-6f37-4473-993f-649aaeb3b524\") " pod="openshift-ingress/kube-auth-proxy-b5df4b696-plrg5" Jul 09 04:21:38.483259 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:38.483089 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwjht\" (UniqueName: \"kubernetes.io/projected/8dbefb98-6f37-4473-993f-649aaeb3b524-kube-api-access-hwjht\") pod \"kube-auth-proxy-b5df4b696-plrg5\" (UID: \"8dbefb98-6f37-4473-993f-649aaeb3b524\") " pod="openshift-ingress/kube-auth-proxy-b5df4b696-plrg5" Jul 09 04:21:38.483259 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:38.483129 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8dbefb98-6f37-4473-993f-649aaeb3b524-tls-certs\") pod \"kube-auth-proxy-b5df4b696-plrg5\" (UID: \"8dbefb98-6f37-4473-993f-649aaeb3b524\") " pod="openshift-ingress/kube-auth-proxy-b5df4b696-plrg5" Jul 09 04:21:38.584190 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:38.584095 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8dbefb98-6f37-4473-993f-649aaeb3b524-tmp\") pod \"kube-auth-proxy-b5df4b696-plrg5\" (UID: \"8dbefb98-6f37-4473-993f-649aaeb3b524\") " pod="openshift-ingress/kube-auth-proxy-b5df4b696-plrg5" Jul 09 04:21:38.584190 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:38.584149 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwjht\" (UniqueName: \"kubernetes.io/projected/8dbefb98-6f37-4473-993f-649aaeb3b524-kube-api-access-hwjht\") pod \"kube-auth-proxy-b5df4b696-plrg5\" (UID: \"8dbefb98-6f37-4473-993f-649aaeb3b524\") " pod="openshift-ingress/kube-auth-proxy-b5df4b696-plrg5" Jul 09 04:21:38.584190 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:38.584183 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8dbefb98-6f37-4473-993f-649aaeb3b524-tls-certs\") pod \"kube-auth-proxy-b5df4b696-plrg5\" (UID: \"8dbefb98-6f37-4473-993f-649aaeb3b524\") " pod="openshift-ingress/kube-auth-proxy-b5df4b696-plrg5" Jul 09 04:21:38.586671 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:38.586644 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8dbefb98-6f37-4473-993f-649aaeb3b524-tmp\") pod \"kube-auth-proxy-b5df4b696-plrg5\" (UID: \"8dbefb98-6f37-4473-993f-649aaeb3b524\") " pod="openshift-ingress/kube-auth-proxy-b5df4b696-plrg5" Jul 09 04:21:38.586938 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:38.586896 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8dbefb98-6f37-4473-993f-649aaeb3b524-tls-certs\") pod \"kube-auth-proxy-b5df4b696-plrg5\" (UID: \"8dbefb98-6f37-4473-993f-649aaeb3b524\") " pod="openshift-ingress/kube-auth-proxy-b5df4b696-plrg5" Jul 09 04:21:38.594791 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:38.594656 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwjht\" (UniqueName: \"kubernetes.io/projected/8dbefb98-6f37-4473-993f-649aaeb3b524-kube-api-access-hwjht\") pod \"kube-auth-proxy-b5df4b696-plrg5\" (UID: \"8dbefb98-6f37-4473-993f-649aaeb3b524\") " pod="openshift-ingress/kube-auth-proxy-b5df4b696-plrg5" Jul 09 04:21:38.606380 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:38.606349 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-b5df4b696-plrg5" Jul 09 04:21:38.760962 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:38.760935 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-b5df4b696-plrg5"] Jul 09 04:21:38.762925 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:21:38.762877 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8dbefb98_6f37_4473_993f_649aaeb3b524.slice/crio-951108151d305187157bdfbcc65e908508141aa0ad6bb4cd1e231ab1423ae9ed WatchSource:0}: Error finding container 951108151d305187157bdfbcc65e908508141aa0ad6bb4cd1e231ab1423ae9ed: Status 404 returned error can't find the container with id 951108151d305187157bdfbcc65e908508141aa0ad6bb4cd1e231ab1423ae9ed Jul 09 04:21:39.300040 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:39.300006 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-bhqtq"] Jul 09 04:21:39.304538 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:39.304511 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-bhqtq" Jul 09 04:21:39.307358 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:39.307337 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jul 09 04:21:39.314833 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:39.314808 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-bhqtq"] Jul 09 04:21:39.392033 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:39.391980 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5a12cfa1-d3d6-40be-8e54-def504456032-tls-certs\") pod \"model-serving-api-54d89bd5fc-bhqtq\" (UID: \"5a12cfa1-d3d6-40be-8e54-def504456032\") " pod="opendatahub/model-serving-api-54d89bd5fc-bhqtq" Jul 09 04:21:39.392270 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:39.392097 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xsbhn\" (UniqueName: \"kubernetes.io/projected/5a12cfa1-d3d6-40be-8e54-def504456032-kube-api-access-xsbhn\") pod \"model-serving-api-54d89bd5fc-bhqtq\" (UID: \"5a12cfa1-d3d6-40be-8e54-def504456032\") " pod="opendatahub/model-serving-api-54d89bd5fc-bhqtq" Jul 09 04:21:39.447213 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:39.447169 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-fkjcz"] Jul 09 04:21:39.450882 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:39.450853 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-fkjcz" Jul 09 04:21:39.453739 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:39.453578 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 09 04:21:39.453739 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:39.453593 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 09 04:21:39.453739 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:39.453646 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 09 04:21:39.454023 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:39.453856 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 09 04:21:39.454023 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:39.453893 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-gz2zr\"" Jul 09 04:21:39.465844 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:39.465480 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-fkjcz"] Jul 09 04:21:39.504570 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:39.504533 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xsbhn\" (UniqueName: \"kubernetes.io/projected/5a12cfa1-d3d6-40be-8e54-def504456032-kube-api-access-xsbhn\") pod \"model-serving-api-54d89bd5fc-bhqtq\" (UID: \"5a12cfa1-d3d6-40be-8e54-def504456032\") " pod="opendatahub/model-serving-api-54d89bd5fc-bhqtq" Jul 09 04:21:39.504773 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:39.504580 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ca7d3e70-8034-4d22-8eb1-c90e7c068783-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-fkjcz\" (UID: \"ca7d3e70-8034-4d22-8eb1-c90e7c068783\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-fkjcz" Jul 09 04:21:39.504773 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:39.504601 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ca7d3e70-8034-4d22-8eb1-c90e7c068783-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-fkjcz\" (UID: \"ca7d3e70-8034-4d22-8eb1-c90e7c068783\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-fkjcz" Jul 09 04:21:39.504773 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:39.504696 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bjt8f\" (UniqueName: \"kubernetes.io/projected/ca7d3e70-8034-4d22-8eb1-c90e7c068783-kube-api-access-bjt8f\") pod \"istiod-openshift-gateway-7574459656-fkjcz\" (UID: \"ca7d3e70-8034-4d22-8eb1-c90e7c068783\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-fkjcz" Jul 09 04:21:39.504773 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:39.504749 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ca7d3e70-8034-4d22-8eb1-c90e7c068783-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-fkjcz\" (UID: \"ca7d3e70-8034-4d22-8eb1-c90e7c068783\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-fkjcz" Jul 09 04:21:39.505026 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:39.504794 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ca7d3e70-8034-4d22-8eb1-c90e7c068783-istio-token\") pod \"istiod-openshift-gateway-7574459656-fkjcz\" (UID: \"ca7d3e70-8034-4d22-8eb1-c90e7c068783\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-fkjcz" Jul 09 04:21:39.505026 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:39.504831 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ca7d3e70-8034-4d22-8eb1-c90e7c068783-local-certs\") pod \"istiod-openshift-gateway-7574459656-fkjcz\" (UID: \"ca7d3e70-8034-4d22-8eb1-c90e7c068783\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-fkjcz" Jul 09 04:21:39.505026 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:39.504862 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ca7d3e70-8034-4d22-8eb1-c90e7c068783-cacerts\") pod \"istiod-openshift-gateway-7574459656-fkjcz\" (UID: \"ca7d3e70-8034-4d22-8eb1-c90e7c068783\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-fkjcz" Jul 09 04:21:39.505026 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:39.504941 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5a12cfa1-d3d6-40be-8e54-def504456032-tls-certs\") pod \"model-serving-api-54d89bd5fc-bhqtq\" (UID: \"5a12cfa1-d3d6-40be-8e54-def504456032\") " pod="opendatahub/model-serving-api-54d89bd5fc-bhqtq" Jul 09 04:21:39.505026 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:21:39.505020 2566 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Jul 09 04:21:39.505195 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:21:39.505095 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a12cfa1-d3d6-40be-8e54-def504456032-tls-certs podName:5a12cfa1-d3d6-40be-8e54-def504456032 nodeName:}" failed. No retries permitted until 2026-07-09 04:21:40.005074009 +0000 UTC m=+357.621972205 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/5a12cfa1-d3d6-40be-8e54-def504456032-tls-certs") pod "model-serving-api-54d89bd5fc-bhqtq" (UID: "5a12cfa1-d3d6-40be-8e54-def504456032") : secret "model-serving-api-tls" not found Jul 09 04:21:39.513405 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:39.513322 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xsbhn\" (UniqueName: \"kubernetes.io/projected/5a12cfa1-d3d6-40be-8e54-def504456032-kube-api-access-xsbhn\") pod \"model-serving-api-54d89bd5fc-bhqtq\" (UID: \"5a12cfa1-d3d6-40be-8e54-def504456032\") " pod="opendatahub/model-serving-api-54d89bd5fc-bhqtq" Jul 09 04:21:39.586067 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:39.585950 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-b5df4b696-plrg5" event={"ID":"8dbefb98-6f37-4473-993f-649aaeb3b524","Type":"ContainerStarted","Data":"951108151d305187157bdfbcc65e908508141aa0ad6bb4cd1e231ab1423ae9ed"} Jul 09 04:21:39.605715 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:39.605673 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ca7d3e70-8034-4d22-8eb1-c90e7c068783-istio-token\") pod \"istiod-openshift-gateway-7574459656-fkjcz\" (UID: \"ca7d3e70-8034-4d22-8eb1-c90e7c068783\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-fkjcz" Jul 09 04:21:39.605897 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:39.605725 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ca7d3e70-8034-4d22-8eb1-c90e7c068783-local-certs\") pod \"istiod-openshift-gateway-7574459656-fkjcz\" (UID: \"ca7d3e70-8034-4d22-8eb1-c90e7c068783\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-fkjcz" Jul 09 04:21:39.605897 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:39.605869 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ca7d3e70-8034-4d22-8eb1-c90e7c068783-cacerts\") pod \"istiod-openshift-gateway-7574459656-fkjcz\" (UID: \"ca7d3e70-8034-4d22-8eb1-c90e7c068783\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-fkjcz" Jul 09 04:21:39.606060 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:39.605984 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ca7d3e70-8034-4d22-8eb1-c90e7c068783-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-fkjcz\" (UID: \"ca7d3e70-8034-4d22-8eb1-c90e7c068783\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-fkjcz" Jul 09 04:21:39.606177 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:39.606146 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ca7d3e70-8034-4d22-8eb1-c90e7c068783-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-fkjcz\" (UID: \"ca7d3e70-8034-4d22-8eb1-c90e7c068783\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-fkjcz" Jul 09 04:21:39.606253 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:39.606212 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bjt8f\" (UniqueName: \"kubernetes.io/projected/ca7d3e70-8034-4d22-8eb1-c90e7c068783-kube-api-access-bjt8f\") pod \"istiod-openshift-gateway-7574459656-fkjcz\" (UID: \"ca7d3e70-8034-4d22-8eb1-c90e7c068783\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-fkjcz" Jul 09 04:21:39.606314 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:39.606266 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ca7d3e70-8034-4d22-8eb1-c90e7c068783-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-fkjcz\" (UID: \"ca7d3e70-8034-4d22-8eb1-c90e7c068783\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-fkjcz" Jul 09 04:21:39.606868 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:39.606842 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ca7d3e70-8034-4d22-8eb1-c90e7c068783-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-fkjcz\" (UID: \"ca7d3e70-8034-4d22-8eb1-c90e7c068783\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-fkjcz" Jul 09 04:21:39.608940 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:39.608877 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ca7d3e70-8034-4d22-8eb1-c90e7c068783-local-certs\") pod \"istiod-openshift-gateway-7574459656-fkjcz\" (UID: \"ca7d3e70-8034-4d22-8eb1-c90e7c068783\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-fkjcz" Jul 09 04:21:39.609091 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:39.609071 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ca7d3e70-8034-4d22-8eb1-c90e7c068783-cacerts\") pod \"istiod-openshift-gateway-7574459656-fkjcz\" (UID: \"ca7d3e70-8034-4d22-8eb1-c90e7c068783\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-fkjcz" Jul 09 04:21:39.609641 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:39.609618 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ca7d3e70-8034-4d22-8eb1-c90e7c068783-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-fkjcz\" (UID: \"ca7d3e70-8034-4d22-8eb1-c90e7c068783\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-fkjcz" Jul 09 04:21:39.610449 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:39.610426 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ca7d3e70-8034-4d22-8eb1-c90e7c068783-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-fkjcz\" (UID: \"ca7d3e70-8034-4d22-8eb1-c90e7c068783\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-fkjcz" Jul 09 04:21:39.615845 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:39.615820 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bjt8f\" (UniqueName: \"kubernetes.io/projected/ca7d3e70-8034-4d22-8eb1-c90e7c068783-kube-api-access-bjt8f\") pod \"istiod-openshift-gateway-7574459656-fkjcz\" (UID: \"ca7d3e70-8034-4d22-8eb1-c90e7c068783\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-fkjcz" Jul 09 04:21:39.616086 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:39.616069 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ca7d3e70-8034-4d22-8eb1-c90e7c068783-istio-token\") pod \"istiod-openshift-gateway-7574459656-fkjcz\" (UID: \"ca7d3e70-8034-4d22-8eb1-c90e7c068783\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-fkjcz" Jul 09 04:21:39.765989 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:39.765953 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-fkjcz" Jul 09 04:21:39.916372 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:39.916346 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-fkjcz"] Jul 09 04:21:39.918968 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:21:39.918939 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca7d3e70_8034_4d22_8eb1_c90e7c068783.slice/crio-e6b5e9288580f3d2fe0103c91099fa5f3b9caaae0c3ce45d6da1ead2d4b8f433 WatchSource:0}: Error finding container e6b5e9288580f3d2fe0103c91099fa5f3b9caaae0c3ce45d6da1ead2d4b8f433: Status 404 returned error can't find the container with id e6b5e9288580f3d2fe0103c91099fa5f3b9caaae0c3ce45d6da1ead2d4b8f433 Jul 09 04:21:40.009680 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:40.009645 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5a12cfa1-d3d6-40be-8e54-def504456032-tls-certs\") pod \"model-serving-api-54d89bd5fc-bhqtq\" (UID: \"5a12cfa1-d3d6-40be-8e54-def504456032\") " pod="opendatahub/model-serving-api-54d89bd5fc-bhqtq" Jul 09 04:21:40.012253 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:40.012226 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5a12cfa1-d3d6-40be-8e54-def504456032-tls-certs\") pod \"model-serving-api-54d89bd5fc-bhqtq\" (UID: \"5a12cfa1-d3d6-40be-8e54-def504456032\") " pod="opendatahub/model-serving-api-54d89bd5fc-bhqtq" Jul 09 04:21:40.217855 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:40.217822 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-bhqtq" Jul 09 04:21:40.387800 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:40.387601 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-bhqtq"] Jul 09 04:21:40.390855 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:21:40.390820 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a12cfa1_d3d6_40be_8e54_def504456032.slice/crio-ea9fe1e4d4878177f92d785da3366a652e34f46da5deb05f2939b64c945c34ac WatchSource:0}: Error finding container ea9fe1e4d4878177f92d785da3366a652e34f46da5deb05f2939b64c945c34ac: Status 404 returned error can't find the container with id ea9fe1e4d4878177f92d785da3366a652e34f46da5deb05f2939b64c945c34ac Jul 09 04:21:40.592838 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:40.592746 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-bhqtq" event={"ID":"5a12cfa1-d3d6-40be-8e54-def504456032","Type":"ContainerStarted","Data":"ea9fe1e4d4878177f92d785da3366a652e34f46da5deb05f2939b64c945c34ac"} Jul 09 04:21:40.597810 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:40.594773 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-fkjcz" event={"ID":"ca7d3e70-8034-4d22-8eb1-c90e7c068783","Type":"ContainerStarted","Data":"e6b5e9288580f3d2fe0103c91099fa5f3b9caaae0c3ce45d6da1ead2d4b8f433"} Jul 09 04:21:42.609549 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:42.609513 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-b5df4b696-plrg5" event={"ID":"8dbefb98-6f37-4473-993f-649aaeb3b524","Type":"ContainerStarted","Data":"3c3da7150fd845209a393c6b6d3e2b32e368cc916e5dc4a674df2350952ac122"} Jul 09 04:21:42.626868 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:42.626811 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-b5df4b696-plrg5" podStartSLOduration=1.7935142530000001 podStartE2EDuration="4.626789427s" totalImagesPullingTime="2.833275174s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:21:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:21:42.625011188 +0000 UTC m=+360.241909407" watchObservedRunningTime="2026-07-09 04:21:42.626789427 +0000 UTC m=+360.243687649" Jul 09 04:21:43.970657 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:43.970589 2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 09 04:21:43.971067 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:43.970692 2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 09 04:21:44.622263 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:44.622221 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-fkjcz" event={"ID":"ca7d3e70-8034-4d22-8eb1-c90e7c068783","Type":"ContainerStarted","Data":"8811cca459b17eb3a3260b0739503fdbccc02582478457c8e17f818ad00705d8"} Jul 09 04:21:44.622477 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:44.622329 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-fkjcz" Jul 09 04:21:44.624034 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:44.624002 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-bhqtq" event={"ID":"5a12cfa1-d3d6-40be-8e54-def504456032","Type":"ContainerStarted","Data":"121841e71b76c8a8dea2d22eac25b36dd1b3f9b90d84ae1861031bb68224e25c"} Jul 09 04:21:44.624179 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:44.624054 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-bhqtq" Jul 09 04:21:44.643490 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:44.643441 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-fkjcz" podStartSLOduration=1.5941728099999999 podStartE2EDuration="5.643424666s" totalImagesPullingTime="4.049251856s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:21:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:21:44.642659018 +0000 UTC m=+362.259557273" watchObservedRunningTime="2026-07-09 04:21:44.643424666 +0000 UTC m=+362.260322885" Jul 09 04:21:44.658661 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:44.658605 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-bhqtq" podStartSLOduration=2.080644248 podStartE2EDuration="5.658584266s" totalImagesPullingTime="3.577940018s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:21:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:21:44.658050923 +0000 UTC m=+362.274949153" watchObservedRunningTime="2026-07-09 04:21:44.658584266 +0000 UTC m=+362.275482548" Jul 09 04:21:45.630278 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:45.630244 2566 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-fkjcz container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 09 04:21:45.630685 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:45.630310 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-fkjcz" podUID="ca7d3e70-8034-4d22-8eb1-c90e7c068783" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 09 04:21:48.630193 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:48.630163 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-fkjcz" Jul 09 04:21:50.312049 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:50.312000 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-dxzq7"] Jul 09 04:21:50.315374 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:50.315354 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-dxzq7" Jul 09 04:21:50.319138 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:50.319105 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-fbs9z\"" Jul 09 04:21:50.319506 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:50.319487 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jul 09 04:21:50.356303 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:50.356270 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-dxzq7"] Jul 09 04:21:50.409497 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:50.409456 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47tsl\" (UniqueName: \"kubernetes.io/projected/ef2a6f27-43de-49e6-815f-cbba26acb863-kube-api-access-47tsl\") pod \"kserve-controller-manager-d6f4b65b8-dxzq7\" (UID: \"ef2a6f27-43de-49e6-815f-cbba26acb863\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-dxzq7" Jul 09 04:21:50.409683 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:50.409566 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ef2a6f27-43de-49e6-815f-cbba26acb863-cert\") pod \"kserve-controller-manager-d6f4b65b8-dxzq7\" (UID: \"ef2a6f27-43de-49e6-815f-cbba26acb863\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-dxzq7" Jul 09 04:21:50.510260 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:50.510222 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-47tsl\" (UniqueName: \"kubernetes.io/projected/ef2a6f27-43de-49e6-815f-cbba26acb863-kube-api-access-47tsl\") pod \"kserve-controller-manager-d6f4b65b8-dxzq7\" (UID: \"ef2a6f27-43de-49e6-815f-cbba26acb863\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-dxzq7" Jul 09 04:21:50.510455 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:50.510279 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ef2a6f27-43de-49e6-815f-cbba26acb863-cert\") pod \"kserve-controller-manager-d6f4b65b8-dxzq7\" (UID: \"ef2a6f27-43de-49e6-815f-cbba26acb863\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-dxzq7" Jul 09 04:21:50.513096 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:50.513064 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ef2a6f27-43de-49e6-815f-cbba26acb863-cert\") pod \"kserve-controller-manager-d6f4b65b8-dxzq7\" (UID: \"ef2a6f27-43de-49e6-815f-cbba26acb863\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-dxzq7" Jul 09 04:21:50.539263 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:50.539228 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-47tsl\" (UniqueName: \"kubernetes.io/projected/ef2a6f27-43de-49e6-815f-cbba26acb863-kube-api-access-47tsl\") pod \"kserve-controller-manager-d6f4b65b8-dxzq7\" (UID: \"ef2a6f27-43de-49e6-815f-cbba26acb863\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-dxzq7" Jul 09 04:21:50.626832 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:50.626745 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-dxzq7" Jul 09 04:21:50.787259 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:50.787235 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-dxzq7"] Jul 09 04:21:50.789894 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:21:50.789863 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef2a6f27_43de_49e6_815f_cbba26acb863.slice/crio-91383594aec838f490243d44421ef12a35d7846faad0a380267a6e6c91d5aa8f WatchSource:0}: Error finding container 91383594aec838f490243d44421ef12a35d7846faad0a380267a6e6c91d5aa8f: Status 404 returned error can't find the container with id 91383594aec838f490243d44421ef12a35d7846faad0a380267a6e6c91d5aa8f Jul 09 04:21:51.657622 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:51.657590 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-dxzq7" event={"ID":"ef2a6f27-43de-49e6-815f-cbba26acb863","Type":"ContainerStarted","Data":"91383594aec838f490243d44421ef12a35d7846faad0a380267a6e6c91d5aa8f"} Jul 09 04:21:53.306148 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:53.306115 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-fkjcz"] Jul 09 04:21:53.306653 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:53.306307 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-fkjcz" podUID="ca7d3e70-8034-4d22-8eb1-c90e7c068783" containerName="discovery" containerID="cri-o://8811cca459b17eb3a3260b0739503fdbccc02582478457c8e17f818ad00705d8" gracePeriod=30 Jul 09 04:21:53.571544 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:53.571513 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-fkjcz" Jul 09 04:21:53.638180 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:53.638142 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ca7d3e70-8034-4d22-8eb1-c90e7c068783-istio-csr-ca-configmap\") pod \"ca7d3e70-8034-4d22-8eb1-c90e7c068783\" (UID: \"ca7d3e70-8034-4d22-8eb1-c90e7c068783\") " Jul 09 04:21:53.638180 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:53.638181 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ca7d3e70-8034-4d22-8eb1-c90e7c068783-local-certs\") pod \"ca7d3e70-8034-4d22-8eb1-c90e7c068783\" (UID: \"ca7d3e70-8034-4d22-8eb1-c90e7c068783\") " Jul 09 04:21:53.638447 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:53.638204 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bjt8f\" (UniqueName: \"kubernetes.io/projected/ca7d3e70-8034-4d22-8eb1-c90e7c068783-kube-api-access-bjt8f\") pod \"ca7d3e70-8034-4d22-8eb1-c90e7c068783\" (UID: \"ca7d3e70-8034-4d22-8eb1-c90e7c068783\") " Jul 09 04:21:53.638447 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:53.638231 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ca7d3e70-8034-4d22-8eb1-c90e7c068783-cacerts\") pod \"ca7d3e70-8034-4d22-8eb1-c90e7c068783\" (UID: \"ca7d3e70-8034-4d22-8eb1-c90e7c068783\") " Jul 09 04:21:53.638447 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:53.638296 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ca7d3e70-8034-4d22-8eb1-c90e7c068783-istio-kubeconfig\") pod \"ca7d3e70-8034-4d22-8eb1-c90e7c068783\" (UID: \"ca7d3e70-8034-4d22-8eb1-c90e7c068783\") " Jul 09 04:21:53.638447 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:53.638332 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ca7d3e70-8034-4d22-8eb1-c90e7c068783-istio-csr-dns-cert\") pod \"ca7d3e70-8034-4d22-8eb1-c90e7c068783\" (UID: \"ca7d3e70-8034-4d22-8eb1-c90e7c068783\") " Jul 09 04:21:53.638447 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:53.638376 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ca7d3e70-8034-4d22-8eb1-c90e7c068783-istio-token\") pod \"ca7d3e70-8034-4d22-8eb1-c90e7c068783\" (UID: \"ca7d3e70-8034-4d22-8eb1-c90e7c068783\") " Jul 09 04:21:53.638698 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:53.638636 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca7d3e70-8034-4d22-8eb1-c90e7c068783-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "ca7d3e70-8034-4d22-8eb1-c90e7c068783" (UID: "ca7d3e70-8034-4d22-8eb1-c90e7c068783"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 04:21:53.640875 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:53.640831 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca7d3e70-8034-4d22-8eb1-c90e7c068783-cacerts" (OuterVolumeSpecName: "cacerts") pod "ca7d3e70-8034-4d22-8eb1-c90e7c068783" (UID: "ca7d3e70-8034-4d22-8eb1-c90e7c068783"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 04:21:53.641086 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:53.641050 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca7d3e70-8034-4d22-8eb1-c90e7c068783-istio-token" (OuterVolumeSpecName: "istio-token") pod "ca7d3e70-8034-4d22-8eb1-c90e7c068783" (UID: "ca7d3e70-8034-4d22-8eb1-c90e7c068783"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 04:21:53.641164 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:53.641104 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca7d3e70-8034-4d22-8eb1-c90e7c068783-kube-api-access-bjt8f" (OuterVolumeSpecName: "kube-api-access-bjt8f") pod "ca7d3e70-8034-4d22-8eb1-c90e7c068783" (UID: "ca7d3e70-8034-4d22-8eb1-c90e7c068783"). InnerVolumeSpecName "kube-api-access-bjt8f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 04:21:53.641164 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:53.641146 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca7d3e70-8034-4d22-8eb1-c90e7c068783-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "ca7d3e70-8034-4d22-8eb1-c90e7c068783" (UID: "ca7d3e70-8034-4d22-8eb1-c90e7c068783"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 04:21:53.641253 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:53.641154 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca7d3e70-8034-4d22-8eb1-c90e7c068783-local-certs" (OuterVolumeSpecName: "local-certs") pod "ca7d3e70-8034-4d22-8eb1-c90e7c068783" (UID: "ca7d3e70-8034-4d22-8eb1-c90e7c068783"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 04:21:53.641291 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:53.641249 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca7d3e70-8034-4d22-8eb1-c90e7c068783-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "ca7d3e70-8034-4d22-8eb1-c90e7c068783" (UID: "ca7d3e70-8034-4d22-8eb1-c90e7c068783"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 04:21:53.669087 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:53.669043 2566 generic.go:356] "Generic (PLEG): container finished" podID="ca7d3e70-8034-4d22-8eb1-c90e7c068783" containerID="8811cca459b17eb3a3260b0739503fdbccc02582478457c8e17f818ad00705d8" exitCode=0 Jul 09 04:21:53.669275 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:53.669105 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-fkjcz" Jul 09 04:21:53.669275 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:53.669127 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-fkjcz" event={"ID":"ca7d3e70-8034-4d22-8eb1-c90e7c068783","Type":"ContainerDied","Data":"8811cca459b17eb3a3260b0739503fdbccc02582478457c8e17f818ad00705d8"} Jul 09 04:21:53.669275 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:53.669198 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-fkjcz" event={"ID":"ca7d3e70-8034-4d22-8eb1-c90e7c068783","Type":"ContainerDied","Data":"e6b5e9288580f3d2fe0103c91099fa5f3b9caaae0c3ce45d6da1ead2d4b8f433"} Jul 09 04:21:53.669275 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:53.669228 2566 scope.go:117] "RemoveContainer" containerID="8811cca459b17eb3a3260b0739503fdbccc02582478457c8e17f818ad00705d8" Jul 09 04:21:53.679068 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:53.679047 2566 scope.go:117] "RemoveContainer" containerID="8811cca459b17eb3a3260b0739503fdbccc02582478457c8e17f818ad00705d8" Jul 09 04:21:53.679399 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:21:53.679376 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8811cca459b17eb3a3260b0739503fdbccc02582478457c8e17f818ad00705d8\": container with ID starting with 8811cca459b17eb3a3260b0739503fdbccc02582478457c8e17f818ad00705d8 not found: ID does not exist" containerID="8811cca459b17eb3a3260b0739503fdbccc02582478457c8e17f818ad00705d8" Jul 09 04:21:53.679492 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:53.679406 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8811cca459b17eb3a3260b0739503fdbccc02582478457c8e17f818ad00705d8"} err="failed to get container status \"8811cca459b17eb3a3260b0739503fdbccc02582478457c8e17f818ad00705d8\": rpc error: code = NotFound desc = could not find container \"8811cca459b17eb3a3260b0739503fdbccc02582478457c8e17f818ad00705d8\": container with ID starting with 8811cca459b17eb3a3260b0739503fdbccc02582478457c8e17f818ad00705d8 not found: ID does not exist" Jul 09 04:21:53.692498 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:53.692465 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-fkjcz"] Jul 09 04:21:53.694971 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:53.694943 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-fkjcz"] Jul 09 04:21:53.739352 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:53.739315 2566 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ca7d3e70-8034-4d22-8eb1-c90e7c068783-istio-csr-dns-cert\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\"" Jul 09 04:21:53.739352 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:53.739344 2566 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ca7d3e70-8034-4d22-8eb1-c90e7c068783-istio-token\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\"" Jul 09 04:21:53.739352 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:53.739354 2566 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ca7d3e70-8034-4d22-8eb1-c90e7c068783-istio-csr-ca-configmap\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\"" Jul 09 04:21:53.739589 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:53.739364 2566 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ca7d3e70-8034-4d22-8eb1-c90e7c068783-local-certs\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\"" Jul 09 04:21:53.739589 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:53.739373 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bjt8f\" (UniqueName: \"kubernetes.io/projected/ca7d3e70-8034-4d22-8eb1-c90e7c068783-kube-api-access-bjt8f\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\"" Jul 09 04:21:53.739589 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:53.739381 2566 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ca7d3e70-8034-4d22-8eb1-c90e7c068783-cacerts\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\"" Jul 09 04:21:53.739589 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:53.739389 2566 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ca7d3e70-8034-4d22-8eb1-c90e7c068783-istio-kubeconfig\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\"" Jul 09 04:21:54.914210 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:54.914167 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ca7d3e70-8034-4d22-8eb1-c90e7c068783" path="/var/lib/kubelet/pods/ca7d3e70-8034-4d22-8eb1-c90e7c068783/volumes" Jul 09 04:21:55.632819 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:55.632785 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-bhqtq" Jul 09 04:21:55.685680 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:55.685574 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-dxzq7" event={"ID":"ef2a6f27-43de-49e6-815f-cbba26acb863","Type":"ContainerStarted","Data":"7d23d99449d4e0367c71e8fa2ad0dbcee656218f950004962c7fa34bd6d9f490"} Jul 09 04:21:55.685882 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:55.685729 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-dxzq7" Jul 09 04:21:55.707406 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:21:55.707344 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-dxzq7" podStartSLOduration=1.106012042 podStartE2EDuration="5.707327097s" totalImagesPullingTime="4.601315055s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:21:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:21:55.70648157 +0000 UTC m=+373.323379792" watchObservedRunningTime="2026-07-09 04:21:55.707327097 +0000 UTC m=+373.324225315" Jul 09 04:22:26.696143 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:22:26.696107 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-dxzq7" Jul 09 04:22:29.014014 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:22:29.013979 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-kxsdb"] Jul 09 04:22:29.014404 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:22:29.014311 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca7d3e70-8034-4d22-8eb1-c90e7c068783" containerName="discovery" Jul 09 04:22:29.014404 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:22:29.014322 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca7d3e70-8034-4d22-8eb1-c90e7c068783" containerName="discovery" Jul 09 04:22:29.014404 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:22:29.014388 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca7d3e70-8034-4d22-8eb1-c90e7c068783" containerName="discovery" Jul 09 04:22:29.022736 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:22:29.022701 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-kxsdb" Jul 09 04:22:29.025860 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:22:29.025824 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 09 04:22:29.027102 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:22:29.027079 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-pv87g\"" Jul 09 04:22:29.027313 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:22:29.027290 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 09 04:22:29.029391 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:22:29.029371 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-kxsdb"] Jul 09 04:22:29.032335 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:22:29.032307 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pxg7q\" (UniqueName: \"kubernetes.io/projected/d70f11ef-a7e1-4f6c-bcb3-4dcdfb091bc0-kube-api-access-pxg7q\") pod \"kuadrant-operator-catalog-kxsdb\" (UID: \"d70f11ef-a7e1-4f6c-bcb3-4dcdfb091bc0\") " pod="kuadrant-system/kuadrant-operator-catalog-kxsdb" Jul 09 04:22:29.132967 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:22:29.132904 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pxg7q\" (UniqueName: \"kubernetes.io/projected/d70f11ef-a7e1-4f6c-bcb3-4dcdfb091bc0-kube-api-access-pxg7q\") pod \"kuadrant-operator-catalog-kxsdb\" (UID: \"d70f11ef-a7e1-4f6c-bcb3-4dcdfb091bc0\") " pod="kuadrant-system/kuadrant-operator-catalog-kxsdb" Jul 09 04:22:29.141619 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:22:29.141584 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pxg7q\" (UniqueName: \"kubernetes.io/projected/d70f11ef-a7e1-4f6c-bcb3-4dcdfb091bc0-kube-api-access-pxg7q\") pod \"kuadrant-operator-catalog-kxsdb\" (UID: \"d70f11ef-a7e1-4f6c-bcb3-4dcdfb091bc0\") " pod="kuadrant-system/kuadrant-operator-catalog-kxsdb" Jul 09 04:22:29.334116 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:22:29.334026 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-kxsdb" Jul 09 04:22:29.386667 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:22:29.386502 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-kxsdb"] Jul 09 04:22:29.477222 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:22:29.477198 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-kxsdb"] Jul 09 04:22:29.479219 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:22:29.479142 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd70f11ef_a7e1_4f6c_bcb3_4dcdfb091bc0.slice/crio-5e7a5b4fb7f425397e8efa6edc1ff704fb0667fdf33d128dfb39b8b41a4af4a7 WatchSource:0}: Error finding container 5e7a5b4fb7f425397e8efa6edc1ff704fb0667fdf33d128dfb39b8b41a4af4a7: Status 404 returned error can't find the container with id 5e7a5b4fb7f425397e8efa6edc1ff704fb0667fdf33d128dfb39b8b41a4af4a7 Jul 09 04:22:29.589564 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:22:29.589486 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-6tjt6"] Jul 09 04:22:29.593941 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:22:29.593925 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-6tjt6" Jul 09 04:22:29.601197 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:22:29.601168 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-6tjt6"] Jul 09 04:22:29.637106 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:22:29.637061 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wjcf\" (UniqueName: \"kubernetes.io/projected/11dac32c-222e-485e-aca4-3678a2a6ed06-kube-api-access-6wjcf\") pod \"kuadrant-operator-catalog-6tjt6\" (UID: \"11dac32c-222e-485e-aca4-3678a2a6ed06\") " pod="kuadrant-system/kuadrant-operator-catalog-6tjt6" Jul 09 04:22:29.737834 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:22:29.737794 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wjcf\" (UniqueName: \"kubernetes.io/projected/11dac32c-222e-485e-aca4-3678a2a6ed06-kube-api-access-6wjcf\") pod \"kuadrant-operator-catalog-6tjt6\" (UID: \"11dac32c-222e-485e-aca4-3678a2a6ed06\") " pod="kuadrant-system/kuadrant-operator-catalog-6tjt6" Jul 09 04:22:29.747616 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:22:29.747583 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wjcf\" (UniqueName: \"kubernetes.io/projected/11dac32c-222e-485e-aca4-3678a2a6ed06-kube-api-access-6wjcf\") pod \"kuadrant-operator-catalog-6tjt6\" (UID: \"11dac32c-222e-485e-aca4-3678a2a6ed06\") " pod="kuadrant-system/kuadrant-operator-catalog-6tjt6" Jul 09 04:22:29.837946 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:22:29.837891 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-kxsdb" event={"ID":"d70f11ef-a7e1-4f6c-bcb3-4dcdfb091bc0","Type":"ContainerStarted","Data":"5e7a5b4fb7f425397e8efa6edc1ff704fb0667fdf33d128dfb39b8b41a4af4a7"} Jul 09 04:22:29.904857 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:22:29.904766 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-6tjt6" Jul 09 04:22:30.044024 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:22:30.044002 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-6tjt6"] Jul 09 04:22:30.087642 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:22:30.087599 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11dac32c_222e_485e_aca4_3678a2a6ed06.slice/crio-1554a9c3437bae358c8388f904af7004be605392f36dcbcf337d5973d3c364e8 WatchSource:0}: Error finding container 1554a9c3437bae358c8388f904af7004be605392f36dcbcf337d5973d3c364e8: Status 404 returned error can't find the container with id 1554a9c3437bae358c8388f904af7004be605392f36dcbcf337d5973d3c364e8 Jul 09 04:22:30.844626 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:22:30.844585 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-6tjt6" event={"ID":"11dac32c-222e-485e-aca4-3678a2a6ed06","Type":"ContainerStarted","Data":"1554a9c3437bae358c8388f904af7004be605392f36dcbcf337d5973d3c364e8"} Jul 09 04:22:31.850257 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:22:31.850218 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-kxsdb" event={"ID":"d70f11ef-a7e1-4f6c-bcb3-4dcdfb091bc0","Type":"ContainerStarted","Data":"296f14395b0788c2fd5e71c57a33934650bcb63ca7e62324e221e9e4de0835e9"} Jul 09 04:22:31.850751 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:22:31.850296 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-kxsdb" podUID="d70f11ef-a7e1-4f6c-bcb3-4dcdfb091bc0" containerName="registry-server" containerID="cri-o://296f14395b0788c2fd5e71c57a33934650bcb63ca7e62324e221e9e4de0835e9" gracePeriod=2 Jul 09 04:22:31.851896 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:22:31.851870 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-6tjt6" event={"ID":"11dac32c-222e-485e-aca4-3678a2a6ed06","Type":"ContainerStarted","Data":"62b7864f4053e71668056e344c9c95934f0ff68d4df5caf3d891c1edc0fa34d7"} Jul 09 04:22:31.870172 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:22:31.870120 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-kxsdb" podStartSLOduration=1.714627057 podStartE2EDuration="3.870104925s" totalImagesPullingTime="2.155477868s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:22:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:22:31.869361239 +0000 UTC m=+409.486259455" watchObservedRunningTime="2026-07-09 04:22:31.870104925 +0000 UTC m=+409.487003180" Jul 09 04:22:31.886459 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:22:31.886370 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-6tjt6" podStartSLOduration=1.336715141 podStartE2EDuration="2.88635364s" totalImagesPullingTime="1.549638499s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:22:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:22:31.88566017 +0000 UTC m=+409.502558390" watchObservedRunningTime="2026-07-09 04:22:31.88635364 +0000 UTC m=+409.503251858" Jul 09 04:22:32.093135 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:22:32.093099 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-kxsdb" Jul 09 04:22:32.157259 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:22:32.157166 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pxg7q\" (UniqueName: \"kubernetes.io/projected/d70f11ef-a7e1-4f6c-bcb3-4dcdfb091bc0-kube-api-access-pxg7q\") pod \"d70f11ef-a7e1-4f6c-bcb3-4dcdfb091bc0\" (UID: \"d70f11ef-a7e1-4f6c-bcb3-4dcdfb091bc0\") " Jul 09 04:22:32.159489 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:22:32.159461 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d70f11ef-a7e1-4f6c-bcb3-4dcdfb091bc0-kube-api-access-pxg7q" (OuterVolumeSpecName: "kube-api-access-pxg7q") pod "d70f11ef-a7e1-4f6c-bcb3-4dcdfb091bc0" (UID: "d70f11ef-a7e1-4f6c-bcb3-4dcdfb091bc0"). InnerVolumeSpecName "kube-api-access-pxg7q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 04:22:32.258511 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:22:32.258474 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pxg7q\" (UniqueName: \"kubernetes.io/projected/d70f11ef-a7e1-4f6c-bcb3-4dcdfb091bc0-kube-api-access-pxg7q\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\"" Jul 09 04:22:32.857526 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:22:32.857493 2566 generic.go:356] "Generic (PLEG): container finished" podID="d70f11ef-a7e1-4f6c-bcb3-4dcdfb091bc0" containerID="296f14395b0788c2fd5e71c57a33934650bcb63ca7e62324e221e9e4de0835e9" exitCode=0 Jul 09 04:22:32.857973 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:22:32.857543 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-kxsdb" Jul 09 04:22:32.857973 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:22:32.857573 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-kxsdb" event={"ID":"d70f11ef-a7e1-4f6c-bcb3-4dcdfb091bc0","Type":"ContainerDied","Data":"296f14395b0788c2fd5e71c57a33934650bcb63ca7e62324e221e9e4de0835e9"} Jul 09 04:22:32.857973 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:22:32.857620 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-kxsdb" event={"ID":"d70f11ef-a7e1-4f6c-bcb3-4dcdfb091bc0","Type":"ContainerDied","Data":"5e7a5b4fb7f425397e8efa6edc1ff704fb0667fdf33d128dfb39b8b41a4af4a7"} Jul 09 04:22:32.857973 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:22:32.857640 2566 scope.go:117] "RemoveContainer" containerID="296f14395b0788c2fd5e71c57a33934650bcb63ca7e62324e221e9e4de0835e9" Jul 09 04:22:32.867236 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:22:32.867217 2566 scope.go:117] "RemoveContainer" containerID="296f14395b0788c2fd5e71c57a33934650bcb63ca7e62324e221e9e4de0835e9" Jul 09 04:22:32.867517 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:22:32.867500 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"296f14395b0788c2fd5e71c57a33934650bcb63ca7e62324e221e9e4de0835e9\": container with ID starting with 296f14395b0788c2fd5e71c57a33934650bcb63ca7e62324e221e9e4de0835e9 not found: ID does not exist" containerID="296f14395b0788c2fd5e71c57a33934650bcb63ca7e62324e221e9e4de0835e9" Jul 09 04:22:32.867578 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:22:32.867525 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"296f14395b0788c2fd5e71c57a33934650bcb63ca7e62324e221e9e4de0835e9"} err="failed to get container status \"296f14395b0788c2fd5e71c57a33934650bcb63ca7e62324e221e9e4de0835e9\": rpc error: code = NotFound desc = could not find container \"296f14395b0788c2fd5e71c57a33934650bcb63ca7e62324e221e9e4de0835e9\": container with ID starting with 296f14395b0788c2fd5e71c57a33934650bcb63ca7e62324e221e9e4de0835e9 not found: ID does not exist" Jul 09 04:22:32.881137 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:22:32.881110 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-kxsdb"] Jul 09 04:22:32.884725 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:22:32.884697 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-kxsdb"] Jul 09 04:22:32.911661 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:22:32.911567 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d70f11ef-a7e1-4f6c-bcb3-4dcdfb091bc0" path="/var/lib/kubelet/pods/d70f11ef-a7e1-4f6c-bcb3-4dcdfb091bc0/volumes" Jul 09 04:22:39.905884 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:22:39.905845 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-6tjt6" Jul 09 04:22:39.906308 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:22:39.905901 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-6tjt6" Jul 09 04:22:39.928700 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:22:39.928671 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-6tjt6" Jul 09 04:22:40.918717 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:22:40.918692 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-6tjt6" Jul 09 04:23:00.463607 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:00.463554 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-mbhsb"] Jul 09 04:23:00.464102 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:00.463978 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d70f11ef-a7e1-4f6c-bcb3-4dcdfb091bc0" containerName="registry-server" Jul 09 04:23:00.464102 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:00.463996 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="d70f11ef-a7e1-4f6c-bcb3-4dcdfb091bc0" containerName="registry-server" Jul 09 04:23:00.464102 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:00.464085 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="d70f11ef-a7e1-4f6c-bcb3-4dcdfb091bc0" containerName="registry-server" Jul 09 04:23:00.470566 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:00.470545 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mbhsb" Jul 09 04:23:00.474365 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:00.474344 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-tj768\"" Jul 09 04:23:00.474787 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:00.474771 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jul 09 04:23:00.484131 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:00.484107 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-mbhsb"] Jul 09 04:23:00.600314 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:00.600272 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ks4dx\" (UniqueName: \"kubernetes.io/projected/448915ae-4bfe-436a-964a-86938d122f47-kube-api-access-ks4dx\") pod \"dns-operator-controller-manager-864dd78c4c-mbhsb\" (UID: \"448915ae-4bfe-436a-964a-86938d122f47\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mbhsb" Jul 09 04:23:00.701255 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:00.701216 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ks4dx\" (UniqueName: \"kubernetes.io/projected/448915ae-4bfe-436a-964a-86938d122f47-kube-api-access-ks4dx\") pod \"dns-operator-controller-manager-864dd78c4c-mbhsb\" (UID: \"448915ae-4bfe-436a-964a-86938d122f47\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mbhsb" Jul 09 04:23:00.712209 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:00.712171 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ks4dx\" (UniqueName: \"kubernetes.io/projected/448915ae-4bfe-436a-964a-86938d122f47-kube-api-access-ks4dx\") pod \"dns-operator-controller-manager-864dd78c4c-mbhsb\" (UID: \"448915ae-4bfe-436a-964a-86938d122f47\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mbhsb" Jul 09 04:23:00.780249 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:00.780211 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mbhsb" Jul 09 04:23:00.919467 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:00.919359 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-mbhsb"] Jul 09 04:23:00.921758 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:23:00.921732 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod448915ae_4bfe_436a_964a_86938d122f47.slice/crio-3c6d3ab1c40c68379aaf966403c0a60cbb72deaa1e445bfd587624e075a7d718 WatchSource:0}: Error finding container 3c6d3ab1c40c68379aaf966403c0a60cbb72deaa1e445bfd587624e075a7d718: Status 404 returned error can't find the container with id 3c6d3ab1c40c68379aaf966403c0a60cbb72deaa1e445bfd587624e075a7d718 Jul 09 04:23:00.979879 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:00.979847 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mbhsb" event={"ID":"448915ae-4bfe-436a-964a-86938d122f47","Type":"ContainerStarted","Data":"3c6d3ab1c40c68379aaf966403c0a60cbb72deaa1e445bfd587624e075a7d718"} Jul 09 04:23:03.937394 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:03.937314 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rjmqg"] Jul 09 04:23:03.940795 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:03.940776 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rjmqg" Jul 09 04:23:03.943489 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:03.943461 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-v6psm\"" Jul 09 04:23:03.952418 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:03.952393 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rjmqg"] Jul 09 04:23:04.004668 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:04.004621 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mbhsb" event={"ID":"448915ae-4bfe-436a-964a-86938d122f47","Type":"ContainerStarted","Data":"e47033e9825bcb624bd94390970fc225b4885dabb2de45fa455060b1f056741d"} Jul 09 04:23:04.004847 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:04.004728 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mbhsb" Jul 09 04:23:04.024644 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:04.024592 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mbhsb" podStartSLOduration=1.797566297 podStartE2EDuration="4.024574167s" totalImagesPullingTime="2.22700787s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:23:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:23:04.02358027 +0000 UTC m=+441.640478514" watchObservedRunningTime="2026-07-09 04:23:04.024574167 +0000 UTC m=+441.641472387" Jul 09 04:23:04.036501 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:04.036464 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jpw75\" (UniqueName: \"kubernetes.io/projected/449146bd-db95-4f9a-b1a6-8bc7e6c2dbff-kube-api-access-jpw75\") pod \"limitador-operator-controller-manager-859d7b78bd-rjmqg\" (UID: \"449146bd-db95-4f9a-b1a6-8bc7e6c2dbff\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rjmqg" Jul 09 04:23:04.138019 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:04.137973 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jpw75\" (UniqueName: \"kubernetes.io/projected/449146bd-db95-4f9a-b1a6-8bc7e6c2dbff-kube-api-access-jpw75\") pod \"limitador-operator-controller-manager-859d7b78bd-rjmqg\" (UID: \"449146bd-db95-4f9a-b1a6-8bc7e6c2dbff\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rjmqg" Jul 09 04:23:04.146961 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:04.146904 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jpw75\" (UniqueName: \"kubernetes.io/projected/449146bd-db95-4f9a-b1a6-8bc7e6c2dbff-kube-api-access-jpw75\") pod \"limitador-operator-controller-manager-859d7b78bd-rjmqg\" (UID: \"449146bd-db95-4f9a-b1a6-8bc7e6c2dbff\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rjmqg" Jul 09 04:23:04.251834 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:04.251791 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rjmqg" Jul 09 04:23:04.391548 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:04.391526 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rjmqg"] Jul 09 04:23:04.393844 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:23:04.393814 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod449146bd_db95_4f9a_b1a6_8bc7e6c2dbff.slice/crio-4efa295ef19736db3e5ef660ed3f613a7b2cb1d8554e776d0032442a64c5ad19 WatchSource:0}: Error finding container 4efa295ef19736db3e5ef660ed3f613a7b2cb1d8554e776d0032442a64c5ad19: Status 404 returned error can't find the container with id 4efa295ef19736db3e5ef660ed3f613a7b2cb1d8554e776d0032442a64c5ad19 Jul 09 04:23:05.010568 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:05.010531 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rjmqg" event={"ID":"449146bd-db95-4f9a-b1a6-8bc7e6c2dbff","Type":"ContainerStarted","Data":"4efa295ef19736db3e5ef660ed3f613a7b2cb1d8554e776d0032442a64c5ad19"} Jul 09 04:23:07.021532 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:07.021496 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rjmqg" event={"ID":"449146bd-db95-4f9a-b1a6-8bc7e6c2dbff","Type":"ContainerStarted","Data":"b17f3e612f5db4ff081c837843a0bfa31d4c551ff9170a1825501473a82c55c9"} Jul 09 04:23:07.021953 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:07.021566 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rjmqg" Jul 09 04:23:07.044856 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:07.044808 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rjmqg" podStartSLOduration=2.083265979 podStartE2EDuration="4.04479084s" totalImagesPullingTime="1.961524861s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:23:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:23:07.04337136 +0000 UTC m=+444.660269580" watchObservedRunningTime="2026-07-09 04:23:07.04479084 +0000 UTC m=+444.661689057" Jul 09 04:23:09.018754 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:09.018719 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z5txw"] Jul 09 04:23:09.022359 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:09.022339 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z5txw" Jul 09 04:23:09.025281 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:09.025261 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-w9m2m\"" Jul 09 04:23:09.036111 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:09.036082 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z5txw"] Jul 09 04:23:09.179068 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:09.178945 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c8877d88-c834-44de-8383-f2991548515d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-z5txw\" (UID: \"c8877d88-c834-44de-8383-f2991548515d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z5txw" Jul 09 04:23:09.179265 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:09.179135 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47x8x\" (UniqueName: \"kubernetes.io/projected/c8877d88-c834-44de-8383-f2991548515d-kube-api-access-47x8x\") pod \"kuadrant-operator-controller-manager-8684c9ff49-z5txw\" (UID: \"c8877d88-c834-44de-8383-f2991548515d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z5txw" Jul 09 04:23:09.279877 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:09.279766 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-47x8x\" (UniqueName: \"kubernetes.io/projected/c8877d88-c834-44de-8383-f2991548515d-kube-api-access-47x8x\") pod \"kuadrant-operator-controller-manager-8684c9ff49-z5txw\" (UID: \"c8877d88-c834-44de-8383-f2991548515d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z5txw" Jul 09 04:23:09.279877 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:09.279857 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c8877d88-c834-44de-8383-f2991548515d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-z5txw\" (UID: \"c8877d88-c834-44de-8383-f2991548515d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z5txw" Jul 09 04:23:09.280266 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:09.280248 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c8877d88-c834-44de-8383-f2991548515d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-z5txw\" (UID: \"c8877d88-c834-44de-8383-f2991548515d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z5txw" Jul 09 04:23:09.293653 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:09.293625 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-47x8x\" (UniqueName: \"kubernetes.io/projected/c8877d88-c834-44de-8383-f2991548515d-kube-api-access-47x8x\") pod \"kuadrant-operator-controller-manager-8684c9ff49-z5txw\" (UID: \"c8877d88-c834-44de-8383-f2991548515d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z5txw" Jul 09 04:23:09.334243 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:09.334201 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z5txw" Jul 09 04:23:09.482554 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:09.482518 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z5txw"] Jul 09 04:23:09.485856 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:23:09.485825 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8877d88_c834_44de_8383_f2991548515d.slice/crio-4fbf1d6b16ed06bdd521182f4df489475a390bc6bcc3012ae9fc170af1bb8676 WatchSource:0}: Error finding container 4fbf1d6b16ed06bdd521182f4df489475a390bc6bcc3012ae9fc170af1bb8676: Status 404 returned error can't find the container with id 4fbf1d6b16ed06bdd521182f4df489475a390bc6bcc3012ae9fc170af1bb8676 Jul 09 04:23:10.040028 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:10.039994 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z5txw" event={"ID":"c8877d88-c834-44de-8383-f2991548515d","Type":"ContainerStarted","Data":"4fbf1d6b16ed06bdd521182f4df489475a390bc6bcc3012ae9fc170af1bb8676"} Jul 09 04:23:12.529498 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:12.529467 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-plnfq"] Jul 09 04:23:12.532888 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:12.532870 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-plnfq" Jul 09 04:23:12.535973 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:12.535943 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-bqcmc\"" Jul 09 04:23:12.544166 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:12.544138 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-plnfq"] Jul 09 04:23:12.607197 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:12.607155 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5smlq\" (UniqueName: \"kubernetes.io/projected/7a064f35-15c3-4495-abe4-0e6dd0ed2d01-kube-api-access-5smlq\") pod \"authorino-operator-75cc8d5cb7-plnfq\" (UID: \"7a064f35-15c3-4495-abe4-0e6dd0ed2d01\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-plnfq" Jul 09 04:23:12.708318 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:12.708273 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5smlq\" (UniqueName: \"kubernetes.io/projected/7a064f35-15c3-4495-abe4-0e6dd0ed2d01-kube-api-access-5smlq\") pod \"authorino-operator-75cc8d5cb7-plnfq\" (UID: \"7a064f35-15c3-4495-abe4-0e6dd0ed2d01\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-plnfq" Jul 09 04:23:12.719850 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:12.719815 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5smlq\" (UniqueName: \"kubernetes.io/projected/7a064f35-15c3-4495-abe4-0e6dd0ed2d01-kube-api-access-5smlq\") pod \"authorino-operator-75cc8d5cb7-plnfq\" (UID: \"7a064f35-15c3-4495-abe4-0e6dd0ed2d01\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-plnfq" Jul 09 04:23:12.844868 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:12.844776 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-plnfq" Jul 09 04:23:13.000837 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:13.000803 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-plnfq"] Jul 09 04:23:13.004454 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:23:13.004421 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a064f35_15c3_4495_abe4_0e6dd0ed2d01.slice/crio-1d939cefd255bb3a15e11ef8d8b7c8463eabfe497b2b014b02e034e8998726e9 WatchSource:0}: Error finding container 1d939cefd255bb3a15e11ef8d8b7c8463eabfe497b2b014b02e034e8998726e9: Status 404 returned error can't find the container with id 1d939cefd255bb3a15e11ef8d8b7c8463eabfe497b2b014b02e034e8998726e9 Jul 09 04:23:13.055220 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:13.055184 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-plnfq" event={"ID":"7a064f35-15c3-4495-abe4-0e6dd0ed2d01","Type":"ContainerStarted","Data":"1d939cefd255bb3a15e11ef8d8b7c8463eabfe497b2b014b02e034e8998726e9"} Jul 09 04:23:15.013640 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:15.013609 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mbhsb" Jul 09 04:23:15.070424 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:15.070382 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z5txw" event={"ID":"c8877d88-c834-44de-8383-f2991548515d","Type":"ContainerStarted","Data":"a124b5489de045ed34732f59871b3d58504add7251a25369b8f64415bf1fee98"} Jul 09 04:23:15.070630 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:15.070576 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z5txw" Jul 09 04:23:15.092727 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:15.092661 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z5txw" podStartSLOduration=2.005454711 podStartE2EDuration="7.092639453s" totalImagesPullingTime="5.087184742s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:23:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:23:15.089518842 +0000 UTC m=+452.706417061" watchObservedRunningTime="2026-07-09 04:23:15.092639453 +0000 UTC m=+452.709537672" Jul 09 04:23:17.083685 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:17.083647 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-plnfq" event={"ID":"7a064f35-15c3-4495-abe4-0e6dd0ed2d01","Type":"ContainerStarted","Data":"f1154cf6f8e6dc78c04d1906c0901d2024c29d1c9ae34df60271c955183ffb7c"} Jul 09 04:23:17.084147 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:17.083706 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-plnfq" Jul 09 04:23:17.107129 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:17.107073 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-plnfq" podStartSLOduration=1.672533222 podStartE2EDuration="5.107054039s" totalImagesPullingTime="3.434520817s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:23:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:23:17.10465439 +0000 UTC m=+454.721552622" watchObservedRunningTime="2026-07-09 04:23:17.107054039 +0000 UTC m=+454.723952258" Jul 09 04:23:18.029308 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:18.029277 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rjmqg" Jul 09 04:23:26.079730 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:26.079698 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z5txw" Jul 09 04:23:27.900024 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:27.899993 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-b72s4"] Jul 09 04:23:27.903585 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:27.903566 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z5txw"] Jul 09 04:23:27.903735 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:27.903725 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-b72s4" Jul 09 04:23:27.903786 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:27.903743 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z5txw" podUID="c8877d88-c834-44de-8383-f2991548515d" containerName="manager" containerID="cri-o://a124b5489de045ed34732f59871b3d58504add7251a25369b8f64415bf1fee98" gracePeriod=2 Jul 09 04:23:27.909588 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:27.909555 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z5txw"] Jul 09 04:23:27.918540 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:27.918514 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-b72s4"] Jul 09 04:23:27.928133 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:27.928103 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rjmqg"] Jul 09 04:23:27.928346 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:27.928313 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rjmqg" podUID="449146bd-db95-4f9a-b1a6-8bc7e6c2dbff" containerName="manager" containerID="cri-o://b17f3e612f5db4ff081c837843a0bfa31d4c551ff9170a1825501473a82c55c9" gracePeriod=2 Jul 09 04:23:27.938192 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:27.938133 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rjmqg"] Jul 09 04:23:27.938597 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:27.938564 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7vm4g\" (UniqueName: \"kubernetes.io/projected/f25578ac-39a7-4dde-9afe-f0e6041a7ff2-kube-api-access-7vm4g\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-b72s4\" (UID: \"f25578ac-39a7-4dde-9afe-f0e6041a7ff2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-b72s4" Jul 09 04:23:27.938706 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:27.938674 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f25578ac-39a7-4dde-9afe-f0e6041a7ff2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-b72s4\" (UID: \"f25578ac-39a7-4dde-9afe-f0e6041a7ff2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-b72s4" Jul 09 04:23:27.944298 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:23:27.944262 2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-z5txw\" is forbidden: User \"system:node:ip-10-0-137-76.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-76.ec2.internal' and this object" podUID="c8877d88-c834-44de-8383-f2991548515d" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z5txw" Jul 09 04:23:27.947203 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:23:27.947158 2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-rjmqg\" is forbidden: User \"system:node:ip-10-0-137-76.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-76.ec2.internal' and this object" podUID="449146bd-db95-4f9a-b1a6-8bc7e6c2dbff" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rjmqg" Jul 09 04:23:27.956805 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:27.956767 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6tdsk"] Jul 09 04:23:27.957178 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:27.957164 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8877d88-c834-44de-8383-f2991548515d" containerName="manager" Jul 09 04:23:27.957178 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:27.957178 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8877d88-c834-44de-8383-f2991548515d" containerName="manager" Jul 09 04:23:27.957300 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:27.957203 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="449146bd-db95-4f9a-b1a6-8bc7e6c2dbff" containerName="manager" Jul 09 04:23:27.957300 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:27.957208 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="449146bd-db95-4f9a-b1a6-8bc7e6c2dbff" containerName="manager" Jul 09 04:23:27.957300 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:27.957273 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="449146bd-db95-4f9a-b1a6-8bc7e6c2dbff" containerName="manager" Jul 09 04:23:27.957300 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:27.957280 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="c8877d88-c834-44de-8383-f2991548515d" containerName="manager" Jul 09 04:23:27.967195 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:27.967163 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6tdsk" Jul 09 04:23:27.970286 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:23:27.970237 2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-z5txw\" is forbidden: User \"system:node:ip-10-0-137-76.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-76.ec2.internal' and this object" podUID="c8877d88-c834-44de-8383-f2991548515d" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z5txw" Jul 09 04:23:27.971847 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:27.971815 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6tdsk"] Jul 09 04:23:27.972656 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:23:27.972626 2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-rjmqg\" is forbidden: User \"system:node:ip-10-0-137-76.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-76.ec2.internal' and this object" podUID="449146bd-db95-4f9a-b1a6-8bc7e6c2dbff" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rjmqg" Jul 09 04:23:28.039727 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:28.039688 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f25578ac-39a7-4dde-9afe-f0e6041a7ff2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-b72s4\" (UID: \"f25578ac-39a7-4dde-9afe-f0e6041a7ff2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-b72s4" Jul 09 04:23:28.039863 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:28.039799 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzrlx\" (UniqueName: \"kubernetes.io/projected/1b3c730e-e52c-42df-a64a-120bd2683bff-kube-api-access-kzrlx\") pod \"limitador-operator-controller-manager-859d7b78bd-6tdsk\" (UID: \"1b3c730e-e52c-42df-a64a-120bd2683bff\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6tdsk" Jul 09 04:23:28.039960 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:28.039878 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7vm4g\" (UniqueName: \"kubernetes.io/projected/f25578ac-39a7-4dde-9afe-f0e6041a7ff2-kube-api-access-7vm4g\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-b72s4\" (UID: \"f25578ac-39a7-4dde-9afe-f0e6041a7ff2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-b72s4" Jul 09 04:23:28.040216 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:28.040149 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f25578ac-39a7-4dde-9afe-f0e6041a7ff2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-b72s4\" (UID: \"f25578ac-39a7-4dde-9afe-f0e6041a7ff2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-b72s4" Jul 09 04:23:28.049464 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:28.049430 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7vm4g\" (UniqueName: \"kubernetes.io/projected/f25578ac-39a7-4dde-9afe-f0e6041a7ff2-kube-api-access-7vm4g\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-b72s4\" (UID: \"f25578ac-39a7-4dde-9afe-f0e6041a7ff2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-b72s4" Jul 09 04:23:28.092262 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:28.092234 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-plnfq" Jul 09 04:23:28.112454 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:23:28.112409 2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-z5txw\" is forbidden: User \"system:node:ip-10-0-137-76.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-76.ec2.internal' and this object" podUID="c8877d88-c834-44de-8383-f2991548515d" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z5txw" Jul 09 04:23:28.118148 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:23:28.118106 2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-rjmqg\" is forbidden: User \"system:node:ip-10-0-137-76.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-76.ec2.internal' and this object" podUID="449146bd-db95-4f9a-b1a6-8bc7e6c2dbff" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rjmqg" Jul 09 04:23:28.139995 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:28.139960 2566 generic.go:356] "Generic (PLEG): container finished" podID="449146bd-db95-4f9a-b1a6-8bc7e6c2dbff" containerID="b17f3e612f5db4ff081c837843a0bfa31d4c551ff9170a1825501473a82c55c9" exitCode=0 Jul 09 04:23:28.140862 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:28.140767 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzrlx\" (UniqueName: \"kubernetes.io/projected/1b3c730e-e52c-42df-a64a-120bd2683bff-kube-api-access-kzrlx\") pod \"limitador-operator-controller-manager-859d7b78bd-6tdsk\" (UID: \"1b3c730e-e52c-42df-a64a-120bd2683bff\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6tdsk" Jul 09 04:23:28.142016 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:28.141979 2566 generic.go:356] "Generic (PLEG): container finished" podID="c8877d88-c834-44de-8383-f2991548515d" containerID="a124b5489de045ed34732f59871b3d58504add7251a25369b8f64415bf1fee98" exitCode=0 Jul 09 04:23:28.153144 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:28.153067 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzrlx\" (UniqueName: \"kubernetes.io/projected/1b3c730e-e52c-42df-a64a-120bd2683bff-kube-api-access-kzrlx\") pod \"limitador-operator-controller-manager-859d7b78bd-6tdsk\" (UID: \"1b3c730e-e52c-42df-a64a-120bd2683bff\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6tdsk" Jul 09 04:23:28.184902 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:28.184872 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z5txw" Jul 09 04:23:28.186998 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:28.186979 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rjmqg" Jul 09 04:23:28.187425 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:23:28.187398 2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-z5txw\" is forbidden: User \"system:node:ip-10-0-137-76.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-76.ec2.internal' and this object" podUID="c8877d88-c834-44de-8383-f2991548515d" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z5txw" Jul 09 04:23:28.192550 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:23:28.192526 2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-rjmqg\" is forbidden: User \"system:node:ip-10-0-137-76.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-76.ec2.internal' and this object" podUID="449146bd-db95-4f9a-b1a6-8bc7e6c2dbff" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rjmqg" Jul 09 04:23:28.194727 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:23:28.194705 2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-z5txw\" is forbidden: User \"system:node:ip-10-0-137-76.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-76.ec2.internal' and this object" podUID="c8877d88-c834-44de-8383-f2991548515d" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z5txw" Jul 09 04:23:28.196814 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:23:28.196795 2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-rjmqg\" is forbidden: User \"system:node:ip-10-0-137-76.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-76.ec2.internal' and this object" podUID="449146bd-db95-4f9a-b1a6-8bc7e6c2dbff" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rjmqg" Jul 09 04:23:28.217454 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:28.217421 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-b72s4" Jul 09 04:23:28.241496 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:28.241470 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c8877d88-c834-44de-8383-f2991548515d-extensions-socket-volume\") pod \"c8877d88-c834-44de-8383-f2991548515d\" (UID: \"c8877d88-c834-44de-8383-f2991548515d\") " Jul 09 04:23:28.241640 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:28.241518 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jpw75\" (UniqueName: \"kubernetes.io/projected/449146bd-db95-4f9a-b1a6-8bc7e6c2dbff-kube-api-access-jpw75\") pod \"449146bd-db95-4f9a-b1a6-8bc7e6c2dbff\" (UID: \"449146bd-db95-4f9a-b1a6-8bc7e6c2dbff\") " Jul 09 04:23:28.241640 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:28.241542 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-47x8x\" (UniqueName: \"kubernetes.io/projected/c8877d88-c834-44de-8383-f2991548515d-kube-api-access-47x8x\") pod \"c8877d88-c834-44de-8383-f2991548515d\" (UID: \"c8877d88-c834-44de-8383-f2991548515d\") " Jul 09 04:23:28.242018 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:28.241993 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8877d88-c834-44de-8383-f2991548515d-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "c8877d88-c834-44de-8383-f2991548515d" (UID: "c8877d88-c834-44de-8383-f2991548515d"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 04:23:28.243969 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:28.243941 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8877d88-c834-44de-8383-f2991548515d-kube-api-access-47x8x" (OuterVolumeSpecName: "kube-api-access-47x8x") pod "c8877d88-c834-44de-8383-f2991548515d" (UID: "c8877d88-c834-44de-8383-f2991548515d"). InnerVolumeSpecName "kube-api-access-47x8x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 04:23:28.244046 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:28.243982 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/449146bd-db95-4f9a-b1a6-8bc7e6c2dbff-kube-api-access-jpw75" (OuterVolumeSpecName: "kube-api-access-jpw75") pod "449146bd-db95-4f9a-b1a6-8bc7e6c2dbff" (UID: "449146bd-db95-4f9a-b1a6-8bc7e6c2dbff"). InnerVolumeSpecName "kube-api-access-jpw75". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 04:23:28.342466 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:28.342427 2566 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c8877d88-c834-44de-8383-f2991548515d-extensions-socket-volume\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\"" Jul 09 04:23:28.342466 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:28.342465 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jpw75\" (UniqueName: \"kubernetes.io/projected/449146bd-db95-4f9a-b1a6-8bc7e6c2dbff-kube-api-access-jpw75\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\"" Jul 09 04:23:28.342652 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:28.342476 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-47x8x\" (UniqueName: \"kubernetes.io/projected/c8877d88-c834-44de-8383-f2991548515d-kube-api-access-47x8x\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\"" Jul 09 04:23:28.362612 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:28.362582 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-b72s4"] Jul 09 04:23:28.364186 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:28.364164 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6tdsk" Jul 09 04:23:28.365195 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:23:28.365168 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf25578ac_39a7_4dde_9afe_f0e6041a7ff2.slice/crio-faa89d078dd9c7713aef7599a51df951cdb750af083782b07a997515b9201b2a WatchSource:0}: Error finding container faa89d078dd9c7713aef7599a51df951cdb750af083782b07a997515b9201b2a: Status 404 returned error can't find the container with id faa89d078dd9c7713aef7599a51df951cdb750af083782b07a997515b9201b2a Jul 09 04:23:28.530448 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:28.530424 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6tdsk"] Jul 09 04:23:28.533256 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:23:28.533217 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b3c730e_e52c_42df_a64a_120bd2683bff.slice/crio-5664d667c64ac7fd87b7a228defa9c1fd5e37862151268e195ba75839ea6809e WatchSource:0}: Error finding container 5664d667c64ac7fd87b7a228defa9c1fd5e37862151268e195ba75839ea6809e: Status 404 returned error can't find the container with id 5664d667c64ac7fd87b7a228defa9c1fd5e37862151268e195ba75839ea6809e Jul 09 04:23:28.912279 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:28.912237 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="449146bd-db95-4f9a-b1a6-8bc7e6c2dbff" path="/var/lib/kubelet/pods/449146bd-db95-4f9a-b1a6-8bc7e6c2dbff/volumes" Jul 09 04:23:28.912764 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:28.912745 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c8877d88-c834-44de-8383-f2991548515d" path="/var/lib/kubelet/pods/c8877d88-c834-44de-8383-f2991548515d/volumes" Jul 09 04:23:29.028009 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:29.027952 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rjmqg" podUID="449146bd-db95-4f9a-b1a6-8bc7e6c2dbff" containerName="manager" probeResult="failure" output="Get \"http://10.132.0.38:8081/readyz\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 09 04:23:29.149166 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:29.149132 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rjmqg" Jul 09 04:23:29.149389 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:29.149148 2566 scope.go:117] "RemoveContainer" containerID="b17f3e612f5db4ff081c837843a0bfa31d4c551ff9170a1825501473a82c55c9" Jul 09 04:23:29.150704 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:29.150686 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z5txw" Jul 09 04:23:29.152691 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:29.152654 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6tdsk" event={"ID":"1b3c730e-e52c-42df-a64a-120bd2683bff","Type":"ContainerStarted","Data":"9e5bf3b7ec32fa9bd0000d68a5e1447b7d4c35ef77ad9e8ae14217394925b6c3"} Jul 09 04:23:29.152809 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:29.152752 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6tdsk" event={"ID":"1b3c730e-e52c-42df-a64a-120bd2683bff","Type":"ContainerStarted","Data":"5664d667c64ac7fd87b7a228defa9c1fd5e37862151268e195ba75839ea6809e"} Jul 09 04:23:29.152809 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:29.152784 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6tdsk" Jul 09 04:23:29.154531 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:29.154507 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-b72s4" event={"ID":"f25578ac-39a7-4dde-9afe-f0e6041a7ff2","Type":"ContainerStarted","Data":"e19836610281259b72186072cdb3cbaf523f9cfc5e77edd56be011dd44d3e904"} Jul 09 04:23:29.154624 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:29.154557 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-b72s4" Jul 09 04:23:29.154624 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:29.154580 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-b72s4" event={"ID":"f25578ac-39a7-4dde-9afe-f0e6041a7ff2","Type":"ContainerStarted","Data":"faa89d078dd9c7713aef7599a51df951cdb750af083782b07a997515b9201b2a"} Jul 09 04:23:29.159472 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:29.159434 2566 scope.go:117] "RemoveContainer" containerID="a124b5489de045ed34732f59871b3d58504add7251a25369b8f64415bf1fee98" Jul 09 04:23:29.172621 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:29.172567 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6tdsk" podStartSLOduration=2.172546009 podStartE2EDuration="2.172546009s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:23:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:23:29.170358522 +0000 UTC m=+466.787256759" watchObservedRunningTime="2026-07-09 04:23:29.172546009 +0000 UTC m=+466.789444277" Jul 09 04:23:29.196216 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:29.196156 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-b72s4" podStartSLOduration=2.196141053 podStartE2EDuration="2.196141053s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:23:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:23:29.194672271 +0000 UTC m=+466.811570492" watchObservedRunningTime="2026-07-09 04:23:29.196141053 +0000 UTC m=+466.813039271" Jul 09 04:23:40.164467 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:40.164436 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-b72s4" Jul 09 04:23:40.164994 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:40.164602 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6tdsk" Jul 09 04:23:40.822242 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:40.822153 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h6gp4"] Jul 09 04:23:40.826263 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:40.826243 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h6gp4" Jul 09 04:23:40.842070 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:40.842038 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h6gp4"] Jul 09 04:23:40.849723 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:40.849684 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/50c242dc-db41-4a27-acb4-b1c1b6039321-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-h6gp4\" (UID: \"50c242dc-db41-4a27-acb4-b1c1b6039321\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h6gp4" Jul 09 04:23:40.849898 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:40.849738 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6dscp\" (UniqueName: \"kubernetes.io/projected/50c242dc-db41-4a27-acb4-b1c1b6039321-kube-api-access-6dscp\") pod \"kuadrant-operator-controller-manager-86878c769f-h6gp4\" (UID: \"50c242dc-db41-4a27-acb4-b1c1b6039321\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h6gp4" Jul 09 04:23:40.950625 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:40.950583 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/50c242dc-db41-4a27-acb4-b1c1b6039321-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-h6gp4\" (UID: \"50c242dc-db41-4a27-acb4-b1c1b6039321\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h6gp4" Jul 09 04:23:40.950625 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:40.950631 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6dscp\" (UniqueName: \"kubernetes.io/projected/50c242dc-db41-4a27-acb4-b1c1b6039321-kube-api-access-6dscp\") pod \"kuadrant-operator-controller-manager-86878c769f-h6gp4\" (UID: \"50c242dc-db41-4a27-acb4-b1c1b6039321\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h6gp4" Jul 09 04:23:40.950985 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:40.950966 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/50c242dc-db41-4a27-acb4-b1c1b6039321-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-h6gp4\" (UID: \"50c242dc-db41-4a27-acb4-b1c1b6039321\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h6gp4" Jul 09 04:23:40.965986 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:40.965949 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6dscp\" (UniqueName: \"kubernetes.io/projected/50c242dc-db41-4a27-acb4-b1c1b6039321-kube-api-access-6dscp\") pod \"kuadrant-operator-controller-manager-86878c769f-h6gp4\" (UID: \"50c242dc-db41-4a27-acb4-b1c1b6039321\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h6gp4" Jul 09 04:23:41.136591 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:41.136499 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h6gp4" Jul 09 04:23:41.294169 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:41.294144 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h6gp4"] Jul 09 04:23:41.296749 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:23:41.296717 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50c242dc_db41_4a27_acb4_b1c1b6039321.slice/crio-c9f0ce2e6f5bc3ab956d493cd2f1ee68c88bee1dafe75d4db984b6a8164fef80 WatchSource:0}: Error finding container c9f0ce2e6f5bc3ab956d493cd2f1ee68c88bee1dafe75d4db984b6a8164fef80: Status 404 returned error can't find the container with id c9f0ce2e6f5bc3ab956d493cd2f1ee68c88bee1dafe75d4db984b6a8164fef80 Jul 09 04:23:42.227656 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:42.227617 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h6gp4" event={"ID":"50c242dc-db41-4a27-acb4-b1c1b6039321","Type":"ContainerStarted","Data":"a74bbbff36a05854c90303157800fea7d4b0d66cb70af139c146dc732f939471"} Jul 09 04:23:42.227845 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:42.227701 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h6gp4" event={"ID":"50c242dc-db41-4a27-acb4-b1c1b6039321","Type":"ContainerStarted","Data":"c9f0ce2e6f5bc3ab956d493cd2f1ee68c88bee1dafe75d4db984b6a8164fef80"} Jul 09 04:23:42.227845 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:42.227729 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h6gp4" Jul 09 04:23:42.254979 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:42.254880 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h6gp4" podStartSLOduration=2.254863195 podStartE2EDuration="2.254863195s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:23:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:23:42.254686041 +0000 UTC m=+479.871584261" watchObservedRunningTime="2026-07-09 04:23:42.254863195 +0000 UTC m=+479.871761501" Jul 09 04:23:53.235708 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:53.235676 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h6gp4" Jul 09 04:23:53.309245 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:53.309204 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-b72s4"] Jul 09 04:23:53.309438 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:53.309416 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-b72s4" podUID="f25578ac-39a7-4dde-9afe-f0e6041a7ff2" containerName="manager" containerID="cri-o://e19836610281259b72186072cdb3cbaf523f9cfc5e77edd56be011dd44d3e904" gracePeriod=10 Jul 09 04:23:53.577754 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:53.577728 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-b72s4" Jul 09 04:23:53.659821 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:53.659785 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7vm4g\" (UniqueName: \"kubernetes.io/projected/f25578ac-39a7-4dde-9afe-f0e6041a7ff2-kube-api-access-7vm4g\") pod \"f25578ac-39a7-4dde-9afe-f0e6041a7ff2\" (UID: \"f25578ac-39a7-4dde-9afe-f0e6041a7ff2\") " Jul 09 04:23:53.659821 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:53.659826 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f25578ac-39a7-4dde-9afe-f0e6041a7ff2-extensions-socket-volume\") pod \"f25578ac-39a7-4dde-9afe-f0e6041a7ff2\" (UID: \"f25578ac-39a7-4dde-9afe-f0e6041a7ff2\") " Jul 09 04:23:53.660246 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:53.660225 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f25578ac-39a7-4dde-9afe-f0e6041a7ff2-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "f25578ac-39a7-4dde-9afe-f0e6041a7ff2" (UID: "f25578ac-39a7-4dde-9afe-f0e6041a7ff2"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 04:23:53.662141 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:53.662119 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f25578ac-39a7-4dde-9afe-f0e6041a7ff2-kube-api-access-7vm4g" (OuterVolumeSpecName: "kube-api-access-7vm4g") pod "f25578ac-39a7-4dde-9afe-f0e6041a7ff2" (UID: "f25578ac-39a7-4dde-9afe-f0e6041a7ff2"). InnerVolumeSpecName "kube-api-access-7vm4g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 04:23:53.761256 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:53.761217 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7vm4g\" (UniqueName: \"kubernetes.io/projected/f25578ac-39a7-4dde-9afe-f0e6041a7ff2-kube-api-access-7vm4g\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\"" Jul 09 04:23:53.761256 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:53.761248 2566 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f25578ac-39a7-4dde-9afe-f0e6041a7ff2-extensions-socket-volume\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\"" Jul 09 04:23:54.293585 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:54.293546 2566 generic.go:356] "Generic (PLEG): container finished" podID="f25578ac-39a7-4dde-9afe-f0e6041a7ff2" containerID="e19836610281259b72186072cdb3cbaf523f9cfc5e77edd56be011dd44d3e904" exitCode=0 Jul 09 04:23:54.293585 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:54.293583 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-b72s4" event={"ID":"f25578ac-39a7-4dde-9afe-f0e6041a7ff2","Type":"ContainerDied","Data":"e19836610281259b72186072cdb3cbaf523f9cfc5e77edd56be011dd44d3e904"} Jul 09 04:23:54.294150 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:54.293611 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-b72s4" Jul 09 04:23:54.294150 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:54.293634 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-b72s4" event={"ID":"f25578ac-39a7-4dde-9afe-f0e6041a7ff2","Type":"ContainerDied","Data":"faa89d078dd9c7713aef7599a51df951cdb750af083782b07a997515b9201b2a"} Jul 09 04:23:54.294150 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:54.293659 2566 scope.go:117] "RemoveContainer" containerID="e19836610281259b72186072cdb3cbaf523f9cfc5e77edd56be011dd44d3e904" Jul 09 04:23:54.303371 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:54.303348 2566 scope.go:117] "RemoveContainer" containerID="e19836610281259b72186072cdb3cbaf523f9cfc5e77edd56be011dd44d3e904" Jul 09 04:23:54.303678 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:23:54.303656 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e19836610281259b72186072cdb3cbaf523f9cfc5e77edd56be011dd44d3e904\": container with ID starting with e19836610281259b72186072cdb3cbaf523f9cfc5e77edd56be011dd44d3e904 not found: ID does not exist" containerID="e19836610281259b72186072cdb3cbaf523f9cfc5e77edd56be011dd44d3e904" Jul 09 04:23:54.303728 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:54.303689 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e19836610281259b72186072cdb3cbaf523f9cfc5e77edd56be011dd44d3e904"} err="failed to get container status \"e19836610281259b72186072cdb3cbaf523f9cfc5e77edd56be011dd44d3e904\": rpc error: code = NotFound desc = could not find container \"e19836610281259b72186072cdb3cbaf523f9cfc5e77edd56be011dd44d3e904\": container with ID starting with e19836610281259b72186072cdb3cbaf523f9cfc5e77edd56be011dd44d3e904 not found: ID does not exist" Jul 09 04:23:54.321366 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:54.321333 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-b72s4"] Jul 09 04:23:54.327441 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:54.327410 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-b72s4"] Jul 09 04:23:54.912578 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:23:54.912544 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f25578ac-39a7-4dde-9afe-f0e6041a7ff2" path="/var/lib/kubelet/pods/f25578ac-39a7-4dde-9afe-f0e6041a7ff2/volumes" Jul 09 04:24:10.546683 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:10.546642 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-7g8q6"] Jul 09 04:24:10.547226 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:10.547210 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f25578ac-39a7-4dde-9afe-f0e6041a7ff2" containerName="manager" Jul 09 04:24:10.547274 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:10.547230 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="f25578ac-39a7-4dde-9afe-f0e6041a7ff2" containerName="manager" Jul 09 04:24:10.547343 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:10.547333 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="f25578ac-39a7-4dde-9afe-f0e6041a7ff2" containerName="manager" Jul 09 04:24:10.550647 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:10.550626 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-7g8q6" Jul 09 04:24:10.553587 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:10.553567 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 09 04:24:10.553809 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:10.553793 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-49hk6\"" Jul 09 04:24:10.558386 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:10.558347 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-7g8q6"] Jul 09 04:24:10.642305 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:10.642270 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-7g8q6"] Jul 09 04:24:10.713283 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:10.713242 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e25af16b-e13f-440c-a539-c7d82656d929-config-file\") pod \"limitador-limitador-64c94fd64f-7g8q6\" (UID: \"e25af16b-e13f-440c-a539-c7d82656d929\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-7g8q6" Jul 09 04:24:10.713462 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:10.713306 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgp2d\" (UniqueName: \"kubernetes.io/projected/e25af16b-e13f-440c-a539-c7d82656d929-kube-api-access-mgp2d\") pod \"limitador-limitador-64c94fd64f-7g8q6\" (UID: \"e25af16b-e13f-440c-a539-c7d82656d929\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-7g8q6" Jul 09 04:24:10.814174 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:10.814080 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mgp2d\" (UniqueName: \"kubernetes.io/projected/e25af16b-e13f-440c-a539-c7d82656d929-kube-api-access-mgp2d\") pod \"limitador-limitador-64c94fd64f-7g8q6\" (UID: \"e25af16b-e13f-440c-a539-c7d82656d929\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-7g8q6" Jul 09 04:24:10.814337 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:10.814177 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e25af16b-e13f-440c-a539-c7d82656d929-config-file\") pod \"limitador-limitador-64c94fd64f-7g8q6\" (UID: \"e25af16b-e13f-440c-a539-c7d82656d929\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-7g8q6" Jul 09 04:24:10.814825 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:10.814805 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e25af16b-e13f-440c-a539-c7d82656d929-config-file\") pod \"limitador-limitador-64c94fd64f-7g8q6\" (UID: \"e25af16b-e13f-440c-a539-c7d82656d929\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-7g8q6" Jul 09 04:24:10.824058 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:10.824027 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgp2d\" (UniqueName: \"kubernetes.io/projected/e25af16b-e13f-440c-a539-c7d82656d929-kube-api-access-mgp2d\") pod \"limitador-limitador-64c94fd64f-7g8q6\" (UID: \"e25af16b-e13f-440c-a539-c7d82656d929\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-7g8q6" Jul 09 04:24:10.862928 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:10.862881 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-7g8q6" Jul 09 04:24:11.017844 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:11.017798 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-7g8q6"] Jul 09 04:24:11.021143 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:24:11.021098 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode25af16b_e13f_440c_a539_c7d82656d929.slice/crio-00dc283b7cfd35f36b5848349c090561170e2e14835f3779459ee8d3b14cf1e4 WatchSource:0}: Error finding container 00dc283b7cfd35f36b5848349c090561170e2e14835f3779459ee8d3b14cf1e4: Status 404 returned error can't find the container with id 00dc283b7cfd35f36b5848349c090561170e2e14835f3779459ee8d3b14cf1e4 Jul 09 04:24:11.360674 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:11.360640 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-mjhl7"] Jul 09 04:24:11.365364 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:11.365339 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-mjhl7" Jul 09 04:24:11.368005 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:11.367983 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-sjqwt\"" Jul 09 04:24:11.376608 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:11.376567 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-mjhl7"] Jul 09 04:24:11.383709 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:11.383678 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-7g8q6" event={"ID":"e25af16b-e13f-440c-a539-c7d82656d929","Type":"ContainerStarted","Data":"00dc283b7cfd35f36b5848349c090561170e2e14835f3779459ee8d3b14cf1e4"} Jul 09 04:24:11.522223 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:11.522188 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-498rf\" (UniqueName: \"kubernetes.io/projected/90e498e5-5383-4ac1-9ec1-4cc48d28071e-kube-api-access-498rf\") pod \"authorino-58cd955675-mjhl7\" (UID: \"90e498e5-5383-4ac1-9ec1-4cc48d28071e\") " pod="kuadrant-system/authorino-58cd955675-mjhl7" Jul 09 04:24:11.623507 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:11.623419 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-498rf\" (UniqueName: \"kubernetes.io/projected/90e498e5-5383-4ac1-9ec1-4cc48d28071e-kube-api-access-498rf\") pod \"authorino-58cd955675-mjhl7\" (UID: \"90e498e5-5383-4ac1-9ec1-4cc48d28071e\") " pod="kuadrant-system/authorino-58cd955675-mjhl7" Jul 09 04:24:11.632691 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:11.632662 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-498rf\" (UniqueName: \"kubernetes.io/projected/90e498e5-5383-4ac1-9ec1-4cc48d28071e-kube-api-access-498rf\") pod \"authorino-58cd955675-mjhl7\" (UID: \"90e498e5-5383-4ac1-9ec1-4cc48d28071e\") " pod="kuadrant-system/authorino-58cd955675-mjhl7" Jul 09 04:24:11.649717 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:11.649679 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-whk2b"] Jul 09 04:24:11.653303 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:11.653279 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-whk2b" Jul 09 04:24:11.662329 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:11.662305 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-whk2b"] Jul 09 04:24:11.681346 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:11.681311 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-mjhl7" Jul 09 04:24:11.825370 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:11.825319 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmrc5\" (UniqueName: \"kubernetes.io/projected/5381385a-50d5-46d0-8f86-49e559617725-kube-api-access-hmrc5\") pod \"authorino-75d556bd77-whk2b\" (UID: \"5381385a-50d5-46d0-8f86-49e559617725\") " pod="kuadrant-system/authorino-75d556bd77-whk2b" Jul 09 04:24:11.848953 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:11.848308 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-mjhl7"] Jul 09 04:24:11.926733 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:11.926185 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmrc5\" (UniqueName: \"kubernetes.io/projected/5381385a-50d5-46d0-8f86-49e559617725-kube-api-access-hmrc5\") pod \"authorino-75d556bd77-whk2b\" (UID: \"5381385a-50d5-46d0-8f86-49e559617725\") " pod="kuadrant-system/authorino-75d556bd77-whk2b" Jul 09 04:24:11.935720 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:11.935684 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmrc5\" (UniqueName: \"kubernetes.io/projected/5381385a-50d5-46d0-8f86-49e559617725-kube-api-access-hmrc5\") pod \"authorino-75d556bd77-whk2b\" (UID: \"5381385a-50d5-46d0-8f86-49e559617725\") " pod="kuadrant-system/authorino-75d556bd77-whk2b" Jul 09 04:24:11.964303 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:11.964258 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-whk2b" Jul 09 04:24:12.172032 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:12.171995 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-whk2b"] Jul 09 04:24:12.175405 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:24:12.175358 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5381385a_50d5_46d0_8f86_49e559617725.slice/crio-a1aae26429575b9d16185c6a10b5235c8ce9c19bd69fcb8e3ecaa117c0b08a8e WatchSource:0}: Error finding container a1aae26429575b9d16185c6a10b5235c8ce9c19bd69fcb8e3ecaa117c0b08a8e: Status 404 returned error can't find the container with id a1aae26429575b9d16185c6a10b5235c8ce9c19bd69fcb8e3ecaa117c0b08a8e Jul 09 04:24:12.391454 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:12.391418 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-whk2b" event={"ID":"5381385a-50d5-46d0-8f86-49e559617725","Type":"ContainerStarted","Data":"a1aae26429575b9d16185c6a10b5235c8ce9c19bd69fcb8e3ecaa117c0b08a8e"} Jul 09 04:24:12.393024 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:12.392987 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-mjhl7" event={"ID":"90e498e5-5383-4ac1-9ec1-4cc48d28071e","Type":"ContainerStarted","Data":"04896790a4b0cb2d9e30762bb62ef412cebeb0e50e3eda5f19e53c0319037488"} Jul 09 04:24:16.418148 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:16.418057 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-7g8q6" event={"ID":"e25af16b-e13f-440c-a539-c7d82656d929","Type":"ContainerStarted","Data":"2e52a2ee51a195c51f3ac883e2f6b6f85b12c1a3326bcdfd8dd458b0d727b771"} Jul 09 04:24:16.418576 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:16.418160 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-7g8q6" Jul 09 04:24:16.419741 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:16.419715 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-mjhl7" event={"ID":"90e498e5-5383-4ac1-9ec1-4cc48d28071e","Type":"ContainerStarted","Data":"233ee6ee335ac02447f3b2e6ed9362c084d0e8be300867bbc6209611fe83e2e2"} Jul 09 04:24:16.421186 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:16.421156 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-whk2b" event={"ID":"5381385a-50d5-46d0-8f86-49e559617725","Type":"ContainerStarted","Data":"a7e049497d9ddc61fa734c29bbd3008ea7f9d66862b39a3fbb2039b6e8b2468b"} Jul 09 04:24:16.436975 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:16.436904 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-7g8q6" podStartSLOduration=1.410680377 podStartE2EDuration="6.436888633s" totalImagesPullingTime="5.026208256s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:24:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:24:16.435212424 +0000 UTC m=+514.052110660" watchObservedRunningTime="2026-07-09 04:24:16.436888633 +0000 UTC m=+514.053786852" Jul 09 04:24:16.450503 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:16.450451 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-mjhl7" podStartSLOduration=1.253907048 podStartE2EDuration="5.450425336s" totalImagesPullingTime="4.196518288s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:24:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:24:16.449969344 +0000 UTC m=+514.066867564" watchObservedRunningTime="2026-07-09 04:24:16.450425336 +0000 UTC m=+514.067323559" Jul 09 04:24:16.464340 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:16.464281 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-whk2b" podStartSLOduration=1.580022313 podStartE2EDuration="5.464264336s" totalImagesPullingTime="3.884242023s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:24:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:24:16.463503713 +0000 UTC m=+514.080401934" watchObservedRunningTime="2026-07-09 04:24:16.464264336 +0000 UTC m=+514.081162563" Jul 09 04:24:16.487350 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:16.487316 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-mjhl7"] Jul 09 04:24:18.431166 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:18.431111 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-mjhl7" podUID="90e498e5-5383-4ac1-9ec1-4cc48d28071e" containerName="authorino" containerID="cri-o://233ee6ee335ac02447f3b2e6ed9362c084d0e8be300867bbc6209611fe83e2e2" gracePeriod=30 Jul 09 04:24:18.692524 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:18.692456 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-mjhl7" Jul 09 04:24:18.789583 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:18.789548 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-498rf\" (UniqueName: \"kubernetes.io/projected/90e498e5-5383-4ac1-9ec1-4cc48d28071e-kube-api-access-498rf\") pod \"90e498e5-5383-4ac1-9ec1-4cc48d28071e\" (UID: \"90e498e5-5383-4ac1-9ec1-4cc48d28071e\") " Jul 09 04:24:18.791873 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:18.791841 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90e498e5-5383-4ac1-9ec1-4cc48d28071e-kube-api-access-498rf" (OuterVolumeSpecName: "kube-api-access-498rf") pod "90e498e5-5383-4ac1-9ec1-4cc48d28071e" (UID: "90e498e5-5383-4ac1-9ec1-4cc48d28071e"). InnerVolumeSpecName "kube-api-access-498rf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 04:24:18.890388 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:18.890351 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-498rf\" (UniqueName: \"kubernetes.io/projected/90e498e5-5383-4ac1-9ec1-4cc48d28071e-kube-api-access-498rf\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\"" Jul 09 04:24:19.437124 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:19.437086 2566 generic.go:356] "Generic (PLEG): container finished" podID="90e498e5-5383-4ac1-9ec1-4cc48d28071e" containerID="233ee6ee335ac02447f3b2e6ed9362c084d0e8be300867bbc6209611fe83e2e2" exitCode=0 Jul 09 04:24:19.437124 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:19.437125 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-mjhl7" Jul 09 04:24:19.437612 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:19.437169 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-mjhl7" event={"ID":"90e498e5-5383-4ac1-9ec1-4cc48d28071e","Type":"ContainerDied","Data":"233ee6ee335ac02447f3b2e6ed9362c084d0e8be300867bbc6209611fe83e2e2"} Jul 09 04:24:19.437612 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:19.437215 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-mjhl7" event={"ID":"90e498e5-5383-4ac1-9ec1-4cc48d28071e","Type":"ContainerDied","Data":"04896790a4b0cb2d9e30762bb62ef412cebeb0e50e3eda5f19e53c0319037488"} Jul 09 04:24:19.437612 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:19.437236 2566 scope.go:117] "RemoveContainer" containerID="233ee6ee335ac02447f3b2e6ed9362c084d0e8be300867bbc6209611fe83e2e2" Jul 09 04:24:19.446115 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:19.446097 2566 scope.go:117] "RemoveContainer" containerID="233ee6ee335ac02447f3b2e6ed9362c084d0e8be300867bbc6209611fe83e2e2" Jul 09 04:24:19.446387 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:24:19.446368 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"233ee6ee335ac02447f3b2e6ed9362c084d0e8be300867bbc6209611fe83e2e2\": container with ID starting with 233ee6ee335ac02447f3b2e6ed9362c084d0e8be300867bbc6209611fe83e2e2 not found: ID does not exist" containerID="233ee6ee335ac02447f3b2e6ed9362c084d0e8be300867bbc6209611fe83e2e2" Jul 09 04:24:19.446431 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:19.446398 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"233ee6ee335ac02447f3b2e6ed9362c084d0e8be300867bbc6209611fe83e2e2"} err="failed to get container status \"233ee6ee335ac02447f3b2e6ed9362c084d0e8be300867bbc6209611fe83e2e2\": rpc error: code = NotFound desc = could not find container \"233ee6ee335ac02447f3b2e6ed9362c084d0e8be300867bbc6209611fe83e2e2\": container with ID starting with 233ee6ee335ac02447f3b2e6ed9362c084d0e8be300867bbc6209611fe83e2e2 not found: ID does not exist" Jul 09 04:24:19.454066 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:19.454037 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-mjhl7"] Jul 09 04:24:19.459420 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:19.459385 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-mjhl7"] Jul 09 04:24:20.912197 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:20.912159 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="90e498e5-5383-4ac1-9ec1-4cc48d28071e" path="/var/lib/kubelet/pods/90e498e5-5383-4ac1-9ec1-4cc48d28071e/volumes" Jul 09 04:24:25.792550 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:25.792516 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-7g8q6"] Jul 09 04:24:25.793031 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:25.792751 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-7g8q6" podUID="e25af16b-e13f-440c-a539-c7d82656d929" containerName="limitador" containerID="cri-o://2e52a2ee51a195c51f3ac883e2f6b6f85b12c1a3326bcdfd8dd458b0d727b771" gracePeriod=30 Jul 09 04:24:25.795468 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:25.795440 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-7g8q6" Jul 09 04:24:26.360746 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:26.360680 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-7g8q6" Jul 09 04:24:26.455588 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:26.455534 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e25af16b-e13f-440c-a539-c7d82656d929-config-file\") pod \"e25af16b-e13f-440c-a539-c7d82656d929\" (UID: \"e25af16b-e13f-440c-a539-c7d82656d929\") " Jul 09 04:24:26.455772 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:26.455626 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mgp2d\" (UniqueName: \"kubernetes.io/projected/e25af16b-e13f-440c-a539-c7d82656d929-kube-api-access-mgp2d\") pod \"e25af16b-e13f-440c-a539-c7d82656d929\" (UID: \"e25af16b-e13f-440c-a539-c7d82656d929\") " Jul 09 04:24:26.455962 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:26.455936 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e25af16b-e13f-440c-a539-c7d82656d929-config-file" (OuterVolumeSpecName: "config-file") pod "e25af16b-e13f-440c-a539-c7d82656d929" (UID: "e25af16b-e13f-440c-a539-c7d82656d929"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 04:24:26.457849 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:26.457823 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e25af16b-e13f-440c-a539-c7d82656d929-kube-api-access-mgp2d" (OuterVolumeSpecName: "kube-api-access-mgp2d") pod "e25af16b-e13f-440c-a539-c7d82656d929" (UID: "e25af16b-e13f-440c-a539-c7d82656d929"). InnerVolumeSpecName "kube-api-access-mgp2d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 04:24:26.474474 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:26.474439 2566 generic.go:356] "Generic (PLEG): container finished" podID="e25af16b-e13f-440c-a539-c7d82656d929" containerID="2e52a2ee51a195c51f3ac883e2f6b6f85b12c1a3326bcdfd8dd458b0d727b771" exitCode=0 Jul 09 04:24:26.474659 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:26.474483 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-7g8q6" Jul 09 04:24:26.474659 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:26.474527 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-7g8q6" event={"ID":"e25af16b-e13f-440c-a539-c7d82656d929","Type":"ContainerDied","Data":"2e52a2ee51a195c51f3ac883e2f6b6f85b12c1a3326bcdfd8dd458b0d727b771"} Jul 09 04:24:26.474659 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:26.474585 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-7g8q6" event={"ID":"e25af16b-e13f-440c-a539-c7d82656d929","Type":"ContainerDied","Data":"00dc283b7cfd35f36b5848349c090561170e2e14835f3779459ee8d3b14cf1e4"} Jul 09 04:24:26.474659 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:26.474610 2566 scope.go:117] "RemoveContainer" containerID="2e52a2ee51a195c51f3ac883e2f6b6f85b12c1a3326bcdfd8dd458b0d727b771" Jul 09 04:24:26.483944 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:26.483924 2566 scope.go:117] "RemoveContainer" containerID="2e52a2ee51a195c51f3ac883e2f6b6f85b12c1a3326bcdfd8dd458b0d727b771" Jul 09 04:24:26.484273 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:24:26.484253 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2e52a2ee51a195c51f3ac883e2f6b6f85b12c1a3326bcdfd8dd458b0d727b771\": container with ID starting with 2e52a2ee51a195c51f3ac883e2f6b6f85b12c1a3326bcdfd8dd458b0d727b771 not found: ID does not exist" containerID="2e52a2ee51a195c51f3ac883e2f6b6f85b12c1a3326bcdfd8dd458b0d727b771" Jul 09 04:24:26.484337 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:26.484285 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e52a2ee51a195c51f3ac883e2f6b6f85b12c1a3326bcdfd8dd458b0d727b771"} err="failed to get container status \"2e52a2ee51a195c51f3ac883e2f6b6f85b12c1a3326bcdfd8dd458b0d727b771\": rpc error: code = NotFound desc = could not find container \"2e52a2ee51a195c51f3ac883e2f6b6f85b12c1a3326bcdfd8dd458b0d727b771\": container with ID starting with 2e52a2ee51a195c51f3ac883e2f6b6f85b12c1a3326bcdfd8dd458b0d727b771 not found: ID does not exist" Jul 09 04:24:26.495573 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:26.495529 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-7g8q6"] Jul 09 04:24:26.498590 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:26.498558 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-7g8q6"] Jul 09 04:24:26.556186 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:26.556145 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mgp2d\" (UniqueName: \"kubernetes.io/projected/e25af16b-e13f-440c-a539-c7d82656d929-kube-api-access-mgp2d\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\"" Jul 09 04:24:26.556186 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:26.556180 2566 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e25af16b-e13f-440c-a539-c7d82656d929-config-file\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\"" Jul 09 04:24:26.912712 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:26.912680 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e25af16b-e13f-440c-a539-c7d82656d929" path="/var/lib/kubelet/pods/e25af16b-e13f-440c-a539-c7d82656d929/volumes" Jul 09 04:24:30.834569 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:30.834539 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-rnt8v"] Jul 09 04:24:30.834982 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:30.834900 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e25af16b-e13f-440c-a539-c7d82656d929" containerName="limitador" Jul 09 04:24:30.834982 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:30.834926 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="e25af16b-e13f-440c-a539-c7d82656d929" containerName="limitador" Jul 09 04:24:30.834982 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:30.834940 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90e498e5-5383-4ac1-9ec1-4cc48d28071e" containerName="authorino" Jul 09 04:24:30.834982 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:30.834946 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="90e498e5-5383-4ac1-9ec1-4cc48d28071e" containerName="authorino" Jul 09 04:24:30.835111 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:30.835000 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="e25af16b-e13f-440c-a539-c7d82656d929" containerName="limitador" Jul 09 04:24:30.835111 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:30.835012 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="90e498e5-5383-4ac1-9ec1-4cc48d28071e" containerName="authorino" Jul 09 04:24:30.840059 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:30.840010 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-rnt8v" Jul 09 04:24:30.843990 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:30.843967 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\"" Jul 09 04:24:30.844223 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:30.844197 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-qsmzs\"" Jul 09 04:24:30.844332 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:30.844271 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 09 04:24:30.845209 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:30.845191 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 09 04:24:30.851962 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:30.851935 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-rnt8v"] Jul 09 04:24:30.894806 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:30.894771 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nschr\" (UniqueName: \"kubernetes.io/projected/a5a9255f-8201-4446-9406-06f55227f371-kube-api-access-nschr\") pod \"postgres-69fb4594cf-rnt8v\" (UID: \"a5a9255f-8201-4446-9406-06f55227f371\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-rnt8v" Jul 09 04:24:30.895024 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:30.894977 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/a5a9255f-8201-4446-9406-06f55227f371-data\") pod \"postgres-69fb4594cf-rnt8v\" (UID: \"a5a9255f-8201-4446-9406-06f55227f371\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-rnt8v" Jul 09 04:24:30.995818 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:30.995776 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nschr\" (UniqueName: \"kubernetes.io/projected/a5a9255f-8201-4446-9406-06f55227f371-kube-api-access-nschr\") pod \"postgres-69fb4594cf-rnt8v\" (UID: \"a5a9255f-8201-4446-9406-06f55227f371\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-rnt8v" Jul 09 04:24:30.996052 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:30.995961 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/a5a9255f-8201-4446-9406-06f55227f371-data\") pod \"postgres-69fb4594cf-rnt8v\" (UID: \"a5a9255f-8201-4446-9406-06f55227f371\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-rnt8v" Jul 09 04:24:30.996392 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:30.996370 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/a5a9255f-8201-4446-9406-06f55227f371-data\") pod \"postgres-69fb4594cf-rnt8v\" (UID: \"a5a9255f-8201-4446-9406-06f55227f371\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-rnt8v" Jul 09 04:24:31.004050 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:31.004024 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nschr\" (UniqueName: \"kubernetes.io/projected/a5a9255f-8201-4446-9406-06f55227f371-kube-api-access-nschr\") pod \"postgres-69fb4594cf-rnt8v\" (UID: \"a5a9255f-8201-4446-9406-06f55227f371\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-rnt8v" Jul 09 04:24:31.153062 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:31.152970 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-rnt8v" Jul 09 04:24:31.296633 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:31.296608 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-rnt8v"] Jul 09 04:24:31.299119 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:24:31.299071 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5a9255f_8201_4446_9406_06f55227f371.slice/crio-e11bea2fe85fff8edb49822b8288dfd765c6d17645897c6e1170aca94923fdae WatchSource:0}: Error finding container e11bea2fe85fff8edb49822b8288dfd765c6d17645897c6e1170aca94923fdae: Status 404 returned error can't find the container with id e11bea2fe85fff8edb49822b8288dfd765c6d17645897c6e1170aca94923fdae Jul 09 04:24:31.500936 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:31.500877 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-rnt8v" event={"ID":"a5a9255f-8201-4446-9406-06f55227f371","Type":"ContainerStarted","Data":"e11bea2fe85fff8edb49822b8288dfd765c6d17645897c6e1170aca94923fdae"} Jul 09 04:24:36.533577 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:36.533538 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-rnt8v" event={"ID":"a5a9255f-8201-4446-9406-06f55227f371","Type":"ContainerStarted","Data":"066db52995d863f1fb9a8f00efdb86ad357b86381cace8a8e34258b3e40ed9a7"} Jul 09 04:24:36.534005 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:36.533652 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-rnt8v" Jul 09 04:24:36.551819 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:36.551762 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-rnt8v" podStartSLOduration=1.746748352 podStartE2EDuration="6.551744989s" totalImagesPullingTime="4.804996637s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:24:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:24:36.550272211 +0000 UTC m=+534.167170430" watchObservedRunningTime="2026-07-09 04:24:36.551744989 +0000 UTC m=+534.168643208" Jul 09 04:24:42.571168 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:42.571138 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-rnt8v" Jul 09 04:24:43.117936 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:43.117869 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-88mwg"] Jul 09 04:24:43.125531 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:43.125500 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-88mwg" Jul 09 04:24:43.128787 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:43.128757 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-88mwg"] Jul 09 04:24:43.208139 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:43.208045 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pm55z\" (UniqueName: \"kubernetes.io/projected/8b5aa94b-547d-4898-9698-a299d1be1b61-kube-api-access-pm55z\") pod \"authorino-5d4b67c446-88mwg\" (UID: \"8b5aa94b-547d-4898-9698-a299d1be1b61\") " pod="kuadrant-system/authorino-5d4b67c446-88mwg" Jul 09 04:24:43.308804 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:43.308748 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pm55z\" (UniqueName: \"kubernetes.io/projected/8b5aa94b-547d-4898-9698-a299d1be1b61-kube-api-access-pm55z\") pod \"authorino-5d4b67c446-88mwg\" (UID: \"8b5aa94b-547d-4898-9698-a299d1be1b61\") " pod="kuadrant-system/authorino-5d4b67c446-88mwg" Jul 09 04:24:43.317761 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:43.317724 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pm55z\" (UniqueName: \"kubernetes.io/projected/8b5aa94b-547d-4898-9698-a299d1be1b61-kube-api-access-pm55z\") pod \"authorino-5d4b67c446-88mwg\" (UID: \"8b5aa94b-547d-4898-9698-a299d1be1b61\") " pod="kuadrant-system/authorino-5d4b67c446-88mwg" Jul 09 04:24:43.358100 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:43.358066 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-88mwg"] Jul 09 04:24:43.358332 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:43.358320 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-88mwg" Jul 09 04:24:43.500195 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:43.500163 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7f6c469cc8-xckdx"] Jul 09 04:24:43.515371 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:24:43.515333 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8b5aa94b_547d_4898_9698_a299d1be1b61.slice/crio-b20cd13e9f5c086962bca17ce159cbb521b07a6c5d86ab09d6976527ea68ec0c WatchSource:0}: Error finding container b20cd13e9f5c086962bca17ce159cbb521b07a6c5d86ab09d6976527ea68ec0c: Status 404 returned error can't find the container with id b20cd13e9f5c086962bca17ce159cbb521b07a6c5d86ab09d6976527ea68ec0c Jul 09 04:24:43.536277 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:43.536237 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-88mwg"] Jul 09 04:24:43.536277 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:43.536275 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7f6c469cc8-xckdx"] Jul 09 04:24:43.536473 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:43.536356 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7f6c469cc8-xckdx" Jul 09 04:24:43.538885 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:43.538861 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 09 04:24:43.572061 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:43.572024 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-88mwg" event={"ID":"8b5aa94b-547d-4898-9698-a299d1be1b61","Type":"ContainerStarted","Data":"b20cd13e9f5c086962bca17ce159cbb521b07a6c5d86ab09d6976527ea68ec0c"} Jul 09 04:24:43.611590 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:43.611551 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4m4sq\" (UniqueName: \"kubernetes.io/projected/e675690b-731a-4bd4-81fc-f64b0606cfb9-kube-api-access-4m4sq\") pod \"authorino-7f6c469cc8-xckdx\" (UID: \"e675690b-731a-4bd4-81fc-f64b0606cfb9\") " pod="kuadrant-system/authorino-7f6c469cc8-xckdx" Jul 09 04:24:43.611751 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:43.611618 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e675690b-731a-4bd4-81fc-f64b0606cfb9-tls-cert\") pod \"authorino-7f6c469cc8-xckdx\" (UID: \"e675690b-731a-4bd4-81fc-f64b0606cfb9\") " pod="kuadrant-system/authorino-7f6c469cc8-xckdx" Jul 09 04:24:43.712564 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:43.712526 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4m4sq\" (UniqueName: \"kubernetes.io/projected/e675690b-731a-4bd4-81fc-f64b0606cfb9-kube-api-access-4m4sq\") pod \"authorino-7f6c469cc8-xckdx\" (UID: \"e675690b-731a-4bd4-81fc-f64b0606cfb9\") " pod="kuadrant-system/authorino-7f6c469cc8-xckdx" Jul 09 04:24:43.712752 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:43.712582 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e675690b-731a-4bd4-81fc-f64b0606cfb9-tls-cert\") pod \"authorino-7f6c469cc8-xckdx\" (UID: \"e675690b-731a-4bd4-81fc-f64b0606cfb9\") " pod="kuadrant-system/authorino-7f6c469cc8-xckdx" Jul 09 04:24:43.715331 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:43.715299 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e675690b-731a-4bd4-81fc-f64b0606cfb9-tls-cert\") pod \"authorino-7f6c469cc8-xckdx\" (UID: \"e675690b-731a-4bd4-81fc-f64b0606cfb9\") " pod="kuadrant-system/authorino-7f6c469cc8-xckdx" Jul 09 04:24:43.720662 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:43.720637 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4m4sq\" (UniqueName: \"kubernetes.io/projected/e675690b-731a-4bd4-81fc-f64b0606cfb9-kube-api-access-4m4sq\") pod \"authorino-7f6c469cc8-xckdx\" (UID: \"e675690b-731a-4bd4-81fc-f64b0606cfb9\") " pod="kuadrant-system/authorino-7f6c469cc8-xckdx" Jul 09 04:24:43.845464 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:43.845377 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7f6c469cc8-xckdx" Jul 09 04:24:44.007835 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:44.007809 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7f6c469cc8-xckdx"] Jul 09 04:24:44.010259 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:24:44.010231 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode675690b_731a_4bd4_81fc_f64b0606cfb9.slice/crio-fe81c9ffdaa92f3eb75f9fab23c9b9a7f1fc02fd8c8776b085bfc42ff8d13656 WatchSource:0}: Error finding container fe81c9ffdaa92f3eb75f9fab23c9b9a7f1fc02fd8c8776b085bfc42ff8d13656: Status 404 returned error can't find the container with id fe81c9ffdaa92f3eb75f9fab23c9b9a7f1fc02fd8c8776b085bfc42ff8d13656 Jul 09 04:24:44.579158 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:44.579110 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-88mwg" event={"ID":"8b5aa94b-547d-4898-9698-a299d1be1b61","Type":"ContainerStarted","Data":"95b745856187490b14295ae06bf6a3ec68575fb2d65bb98123dd587b11b3e8b8"} Jul 09 04:24:44.579567 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:44.579177 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-88mwg" podUID="8b5aa94b-547d-4898-9698-a299d1be1b61" containerName="authorino" containerID="cri-o://95b745856187490b14295ae06bf6a3ec68575fb2d65bb98123dd587b11b3e8b8" gracePeriod=30 Jul 09 04:24:44.580633 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:44.580559 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7f6c469cc8-xckdx" event={"ID":"e675690b-731a-4bd4-81fc-f64b0606cfb9","Type":"ContainerStarted","Data":"fe81c9ffdaa92f3eb75f9fab23c9b9a7f1fc02fd8c8776b085bfc42ff8d13656"} Jul 09 04:24:44.595173 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:44.595111 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-88mwg" podStartSLOduration=1.036920505 podStartE2EDuration="1.595094372s" totalImagesPullingTime="558.173867ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:24:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:24:44.59399656 +0000 UTC m=+542.210894781" watchObservedRunningTime="2026-07-09 04:24:44.595094372 +0000 UTC m=+542.211992591" Jul 09 04:24:44.867189 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:44.867162 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-88mwg" Jul 09 04:24:44.923813 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:44.923784 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pm55z\" (UniqueName: \"kubernetes.io/projected/8b5aa94b-547d-4898-9698-a299d1be1b61-kube-api-access-pm55z\") pod \"8b5aa94b-547d-4898-9698-a299d1be1b61\" (UID: \"8b5aa94b-547d-4898-9698-a299d1be1b61\") " Jul 09 04:24:44.925981 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:44.925959 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b5aa94b-547d-4898-9698-a299d1be1b61-kube-api-access-pm55z" (OuterVolumeSpecName: "kube-api-access-pm55z") pod "8b5aa94b-547d-4898-9698-a299d1be1b61" (UID: "8b5aa94b-547d-4898-9698-a299d1be1b61"). InnerVolumeSpecName "kube-api-access-pm55z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 04:24:45.025275 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:45.025235 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pm55z\" (UniqueName: \"kubernetes.io/projected/8b5aa94b-547d-4898-9698-a299d1be1b61-kube-api-access-pm55z\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\"" Jul 09 04:24:45.586160 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:45.586068 2566 generic.go:356] "Generic (PLEG): container finished" podID="8b5aa94b-547d-4898-9698-a299d1be1b61" containerID="95b745856187490b14295ae06bf6a3ec68575fb2d65bb98123dd587b11b3e8b8" exitCode=0 Jul 09 04:24:45.586160 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:45.586106 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-88mwg" Jul 09 04:24:45.586675 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:45.586166 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-88mwg" event={"ID":"8b5aa94b-547d-4898-9698-a299d1be1b61","Type":"ContainerDied","Data":"95b745856187490b14295ae06bf6a3ec68575fb2d65bb98123dd587b11b3e8b8"} Jul 09 04:24:45.586675 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:45.586217 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-88mwg" event={"ID":"8b5aa94b-547d-4898-9698-a299d1be1b61","Type":"ContainerDied","Data":"b20cd13e9f5c086962bca17ce159cbb521b07a6c5d86ab09d6976527ea68ec0c"} Jul 09 04:24:45.586675 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:45.586235 2566 scope.go:117] "RemoveContainer" containerID="95b745856187490b14295ae06bf6a3ec68575fb2d65bb98123dd587b11b3e8b8" Jul 09 04:24:45.587928 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:45.587890 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7f6c469cc8-xckdx" event={"ID":"e675690b-731a-4bd4-81fc-f64b0606cfb9","Type":"ContainerStarted","Data":"c0af30b9d2e56b71286a925238ba9b54eb72cba1e4a6ed54974cc11b296a1938"} Jul 09 04:24:45.595419 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:45.595402 2566 scope.go:117] "RemoveContainer" containerID="95b745856187490b14295ae06bf6a3ec68575fb2d65bb98123dd587b11b3e8b8" Jul 09 04:24:45.595684 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:24:45.595668 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"95b745856187490b14295ae06bf6a3ec68575fb2d65bb98123dd587b11b3e8b8\": container with ID starting with 95b745856187490b14295ae06bf6a3ec68575fb2d65bb98123dd587b11b3e8b8 not found: ID does not exist" containerID="95b745856187490b14295ae06bf6a3ec68575fb2d65bb98123dd587b11b3e8b8" Jul 09 04:24:45.595750 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:45.595692 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95b745856187490b14295ae06bf6a3ec68575fb2d65bb98123dd587b11b3e8b8"} err="failed to get container status \"95b745856187490b14295ae06bf6a3ec68575fb2d65bb98123dd587b11b3e8b8\": rpc error: code = NotFound desc = could not find container \"95b745856187490b14295ae06bf6a3ec68575fb2d65bb98123dd587b11b3e8b8\": container with ID starting with 95b745856187490b14295ae06bf6a3ec68575fb2d65bb98123dd587b11b3e8b8 not found: ID does not exist" Jul 09 04:24:45.604596 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:45.604533 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7f6c469cc8-xckdx" podStartSLOduration=2.0813482309999998 podStartE2EDuration="2.604512362s" totalImagesPullingTime="523.164131ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:24:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:24:45.604154483 +0000 UTC m=+543.221052715" watchObservedRunningTime="2026-07-09 04:24:45.604512362 +0000 UTC m=+543.221410585" Jul 09 04:24:45.618900 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:45.618859 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-88mwg"] Jul 09 04:24:45.621702 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:45.621659 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-88mwg"] Jul 09 04:24:45.633288 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:45.633254 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-whk2b"] Jul 09 04:24:45.633504 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:45.633475 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-whk2b" podUID="5381385a-50d5-46d0-8f86-49e559617725" containerName="authorino" containerID="cri-o://a7e049497d9ddc61fa734c29bbd3008ea7f9d66862b39a3fbb2039b6e8b2468b" gracePeriod=30 Jul 09 04:24:45.952842 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:45.952809 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-whk2b" Jul 09 04:24:46.036082 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:46.036042 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hmrc5\" (UniqueName: \"kubernetes.io/projected/5381385a-50d5-46d0-8f86-49e559617725-kube-api-access-hmrc5\") pod \"5381385a-50d5-46d0-8f86-49e559617725\" (UID: \"5381385a-50d5-46d0-8f86-49e559617725\") " Jul 09 04:24:46.038350 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:46.038314 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5381385a-50d5-46d0-8f86-49e559617725-kube-api-access-hmrc5" (OuterVolumeSpecName: "kube-api-access-hmrc5") pod "5381385a-50d5-46d0-8f86-49e559617725" (UID: "5381385a-50d5-46d0-8f86-49e559617725"). InnerVolumeSpecName "kube-api-access-hmrc5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 04:24:46.136751 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:46.136666 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hmrc5\" (UniqueName: \"kubernetes.io/projected/5381385a-50d5-46d0-8f86-49e559617725-kube-api-access-hmrc5\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\"" Jul 09 04:24:46.595314 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:46.595275 2566 generic.go:356] "Generic (PLEG): container finished" podID="5381385a-50d5-46d0-8f86-49e559617725" containerID="a7e049497d9ddc61fa734c29bbd3008ea7f9d66862b39a3fbb2039b6e8b2468b" exitCode=0 Jul 09 04:24:46.595314 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:46.595317 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-whk2b" Jul 09 04:24:46.595841 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:46.595365 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-whk2b" event={"ID":"5381385a-50d5-46d0-8f86-49e559617725","Type":"ContainerDied","Data":"a7e049497d9ddc61fa734c29bbd3008ea7f9d66862b39a3fbb2039b6e8b2468b"} Jul 09 04:24:46.595841 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:46.595411 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-whk2b" event={"ID":"5381385a-50d5-46d0-8f86-49e559617725","Type":"ContainerDied","Data":"a1aae26429575b9d16185c6a10b5235c8ce9c19bd69fcb8e3ecaa117c0b08a8e"} Jul 09 04:24:46.595841 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:46.595437 2566 scope.go:117] "RemoveContainer" containerID="a7e049497d9ddc61fa734c29bbd3008ea7f9d66862b39a3fbb2039b6e8b2468b" Jul 09 04:24:46.604445 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:46.604424 2566 scope.go:117] "RemoveContainer" containerID="a7e049497d9ddc61fa734c29bbd3008ea7f9d66862b39a3fbb2039b6e8b2468b" Jul 09 04:24:46.604778 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:24:46.604758 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a7e049497d9ddc61fa734c29bbd3008ea7f9d66862b39a3fbb2039b6e8b2468b\": container with ID starting with a7e049497d9ddc61fa734c29bbd3008ea7f9d66862b39a3fbb2039b6e8b2468b not found: ID does not exist" containerID="a7e049497d9ddc61fa734c29bbd3008ea7f9d66862b39a3fbb2039b6e8b2468b" Jul 09 04:24:46.604846 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:46.604790 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7e049497d9ddc61fa734c29bbd3008ea7f9d66862b39a3fbb2039b6e8b2468b"} err="failed to get container status \"a7e049497d9ddc61fa734c29bbd3008ea7f9d66862b39a3fbb2039b6e8b2468b\": rpc error: code = NotFound desc = could not find container \"a7e049497d9ddc61fa734c29bbd3008ea7f9d66862b39a3fbb2039b6e8b2468b\": container with ID starting with a7e049497d9ddc61fa734c29bbd3008ea7f9d66862b39a3fbb2039b6e8b2468b not found: ID does not exist" Jul 09 04:24:46.615451 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:46.615417 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-whk2b"] Jul 09 04:24:46.619304 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:46.619279 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-whk2b"] Jul 09 04:24:46.912436 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:46.912355 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5381385a-50d5-46d0-8f86-49e559617725" path="/var/lib/kubelet/pods/5381385a-50d5-46d0-8f86-49e559617725/volumes" Jul 09 04:24:46.912725 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:46.912708 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8b5aa94b-547d-4898-9698-a299d1be1b61" path="/var/lib/kubelet/pods/8b5aa94b-547d-4898-9698-a299d1be1b61/volumes" Jul 09 04:24:50.213890 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:50.213853 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7db8bf86d7-2wfrp"] Jul 09 04:24:50.214379 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:50.214349 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5381385a-50d5-46d0-8f86-49e559617725" containerName="authorino" Jul 09 04:24:50.214565 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:50.214382 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="5381385a-50d5-46d0-8f86-49e559617725" containerName="authorino" Jul 09 04:24:50.214565 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:50.214409 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b5aa94b-547d-4898-9698-a299d1be1b61" containerName="authorino" Jul 09 04:24:50.214565 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:50.214420 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b5aa94b-547d-4898-9698-a299d1be1b61" containerName="authorino" Jul 09 04:24:50.214786 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:50.214564 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="5381385a-50d5-46d0-8f86-49e559617725" containerName="authorino" Jul 09 04:24:50.214786 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:50.214579 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="8b5aa94b-547d-4898-9698-a299d1be1b61" containerName="authorino" Jul 09 04:24:50.225081 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:50.225045 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7db8bf86d7-2wfrp" Jul 09 04:24:50.227479 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:50.227446 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7db8bf86d7-2wfrp"] Jul 09 04:24:50.227966 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:50.227945 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-c74xn\"" Jul 09 04:24:50.229086 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:50.229060 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 09 04:24:50.229210 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:50.229116 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 09 04:24:50.375375 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:50.375318 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cde7df77-b194-4f6d-84d2-823d69636344-webhook-cert\") pod \"maas-controller-7db8bf86d7-2wfrp\" (UID: \"cde7df77-b194-4f6d-84d2-823d69636344\") " pod="opendatahub/maas-controller-7db8bf86d7-2wfrp" Jul 09 04:24:50.375575 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:50.375397 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x72p4\" (UniqueName: \"kubernetes.io/projected/cde7df77-b194-4f6d-84d2-823d69636344-kube-api-access-x72p4\") pod \"maas-controller-7db8bf86d7-2wfrp\" (UID: \"cde7df77-b194-4f6d-84d2-823d69636344\") " pod="opendatahub/maas-controller-7db8bf86d7-2wfrp" Jul 09 04:24:50.476676 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:50.476639 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cde7df77-b194-4f6d-84d2-823d69636344-webhook-cert\") pod \"maas-controller-7db8bf86d7-2wfrp\" (UID: \"cde7df77-b194-4f6d-84d2-823d69636344\") " pod="opendatahub/maas-controller-7db8bf86d7-2wfrp" Jul 09 04:24:50.476862 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:50.476721 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x72p4\" (UniqueName: \"kubernetes.io/projected/cde7df77-b194-4f6d-84d2-823d69636344-kube-api-access-x72p4\") pod \"maas-controller-7db8bf86d7-2wfrp\" (UID: \"cde7df77-b194-4f6d-84d2-823d69636344\") " pod="opendatahub/maas-controller-7db8bf86d7-2wfrp" Jul 09 04:24:50.479277 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:50.479256 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cde7df77-b194-4f6d-84d2-823d69636344-webhook-cert\") pod \"maas-controller-7db8bf86d7-2wfrp\" (UID: \"cde7df77-b194-4f6d-84d2-823d69636344\") " pod="opendatahub/maas-controller-7db8bf86d7-2wfrp" Jul 09 04:24:50.486195 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:50.486165 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x72p4\" (UniqueName: \"kubernetes.io/projected/cde7df77-b194-4f6d-84d2-823d69636344-kube-api-access-x72p4\") pod \"maas-controller-7db8bf86d7-2wfrp\" (UID: \"cde7df77-b194-4f6d-84d2-823d69636344\") " pod="opendatahub/maas-controller-7db8bf86d7-2wfrp" Jul 09 04:24:50.537085 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:50.537041 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7db8bf86d7-2wfrp" Jul 09 04:24:50.680654 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:50.680623 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7db8bf86d7-2wfrp"] Jul 09 04:24:50.683448 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:24:50.683420 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcde7df77_b194_4f6d_84d2_823d69636344.slice/crio-87c80c7e6928dd48ca50414c11e977596083ea597503f5cbce33b79c8935d99b WatchSource:0}: Error finding container 87c80c7e6928dd48ca50414c11e977596083ea597503f5cbce33b79c8935d99b: Status 404 returned error can't find the container with id 87c80c7e6928dd48ca50414c11e977596083ea597503f5cbce33b79c8935d99b Jul 09 04:24:51.623112 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:51.623078 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7db8bf86d7-2wfrp" event={"ID":"cde7df77-b194-4f6d-84d2-823d69636344","Type":"ContainerStarted","Data":"87c80c7e6928dd48ca50414c11e977596083ea597503f5cbce33b79c8935d99b"} Jul 09 04:24:53.639226 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:53.639181 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7db8bf86d7-2wfrp" event={"ID":"cde7df77-b194-4f6d-84d2-823d69636344","Type":"ContainerStarted","Data":"9436c416e60715d262619498406103b3737a7b3908ec00e9f561ba70fcc56d43"} Jul 09 04:24:53.639700 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:53.639366 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7db8bf86d7-2wfrp" Jul 09 04:24:53.664883 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:24:53.664826 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7db8bf86d7-2wfrp" podStartSLOduration=1.216936918 podStartE2EDuration="3.66480664s" totalImagesPullingTime="2.447869722s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:24:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:24:53.664509433 +0000 UTC m=+551.281407696" watchObservedRunningTime="2026-07-09 04:24:53.66480664 +0000 UTC m=+551.281704860" Jul 09 04:25:04.651383 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:25:04.651347 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7db8bf86d7-2wfrp" Jul 09 04:25:23.518972 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:25:23.518929 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-54f755dfc7-qnxmr"] Jul 09 04:25:23.522869 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:25:23.522852 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-54f755dfc7-qnxmr" Jul 09 04:25:23.526125 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:25:23.526101 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\"" Jul 09 04:25:23.526262 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:25:23.526178 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-7v6h8\"" Jul 09 04:25:23.535067 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:25:23.535043 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-54f755dfc7-qnxmr"] Jul 09 04:25:23.556726 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:25:23.556696 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-74vmz\" (UniqueName: \"kubernetes.io/projected/6f0c256f-a584-4cf7-be23-5853a71bd904-kube-api-access-74vmz\") pod \"maas-api-54f755dfc7-qnxmr\" (UID: \"6f0c256f-a584-4cf7-be23-5853a71bd904\") " pod="odh-ai-gateway-infra/maas-api-54f755dfc7-qnxmr" Jul 09 04:25:23.556891 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:25:23.556740 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6f0c256f-a584-4cf7-be23-5853a71bd904-openshift-service-ca\") pod \"maas-api-54f755dfc7-qnxmr\" (UID: \"6f0c256f-a584-4cf7-be23-5853a71bd904\") " pod="odh-ai-gateway-infra/maas-api-54f755dfc7-qnxmr" Jul 09 04:25:23.556891 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:25:23.556800 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6f0c256f-a584-4cf7-be23-5853a71bd904-maas-api-tls\") pod \"maas-api-54f755dfc7-qnxmr\" (UID: \"6f0c256f-a584-4cf7-be23-5853a71bd904\") " pod="odh-ai-gateway-infra/maas-api-54f755dfc7-qnxmr" Jul 09 04:25:23.657529 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:25:23.657465 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6f0c256f-a584-4cf7-be23-5853a71bd904-maas-api-tls\") pod \"maas-api-54f755dfc7-qnxmr\" (UID: \"6f0c256f-a584-4cf7-be23-5853a71bd904\") " pod="odh-ai-gateway-infra/maas-api-54f755dfc7-qnxmr" Jul 09 04:25:23.657717 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:25:23.657575 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-74vmz\" (UniqueName: \"kubernetes.io/projected/6f0c256f-a584-4cf7-be23-5853a71bd904-kube-api-access-74vmz\") pod \"maas-api-54f755dfc7-qnxmr\" (UID: \"6f0c256f-a584-4cf7-be23-5853a71bd904\") " pod="odh-ai-gateway-infra/maas-api-54f755dfc7-qnxmr" Jul 09 04:25:23.657717 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:25:23.657608 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6f0c256f-a584-4cf7-be23-5853a71bd904-openshift-service-ca\") pod \"maas-api-54f755dfc7-qnxmr\" (UID: \"6f0c256f-a584-4cf7-be23-5853a71bd904\") " pod="odh-ai-gateway-infra/maas-api-54f755dfc7-qnxmr" Jul 09 04:25:23.657717 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:25:23.657625 2566 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-serving-cert: secret "maas-api-serving-cert" not found Jul 09 04:25:23.657717 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:25:23.657711 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f0c256f-a584-4cf7-be23-5853a71bd904-maas-api-tls podName:6f0c256f-a584-4cf7-be23-5853a71bd904 nodeName:}" failed. No retries permitted until 2026-07-09 04:25:24.157693021 +0000 UTC m=+581.774591231 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/6f0c256f-a584-4cf7-be23-5853a71bd904-maas-api-tls") pod "maas-api-54f755dfc7-qnxmr" (UID: "6f0c256f-a584-4cf7-be23-5853a71bd904") : secret "maas-api-serving-cert" not found Jul 09 04:25:23.658351 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:25:23.658323 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6f0c256f-a584-4cf7-be23-5853a71bd904-openshift-service-ca\") pod \"maas-api-54f755dfc7-qnxmr\" (UID: \"6f0c256f-a584-4cf7-be23-5853a71bd904\") " pod="odh-ai-gateway-infra/maas-api-54f755dfc7-qnxmr" Jul 09 04:25:23.671967 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:25:23.667345 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-74vmz\" (UniqueName: \"kubernetes.io/projected/6f0c256f-a584-4cf7-be23-5853a71bd904-kube-api-access-74vmz\") pod \"maas-api-54f755dfc7-qnxmr\" (UID: \"6f0c256f-a584-4cf7-be23-5853a71bd904\") " pod="odh-ai-gateway-infra/maas-api-54f755dfc7-qnxmr" Jul 09 04:25:24.162170 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:25:24.162127 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6f0c256f-a584-4cf7-be23-5853a71bd904-maas-api-tls\") pod \"maas-api-54f755dfc7-qnxmr\" (UID: \"6f0c256f-a584-4cf7-be23-5853a71bd904\") " pod="odh-ai-gateway-infra/maas-api-54f755dfc7-qnxmr" Jul 09 04:25:24.165025 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:25:24.164996 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6f0c256f-a584-4cf7-be23-5853a71bd904-maas-api-tls\") pod \"maas-api-54f755dfc7-qnxmr\" (UID: \"6f0c256f-a584-4cf7-be23-5853a71bd904\") " pod="odh-ai-gateway-infra/maas-api-54f755dfc7-qnxmr" Jul 09 04:25:24.434220 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:25:24.434120 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-54f755dfc7-qnxmr" Jul 09 04:25:24.585482 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:25:24.585360 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-54f755dfc7-qnxmr"] Jul 09 04:25:24.587677 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:25:24.587643 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f0c256f_a584_4cf7_be23_5853a71bd904.slice/crio-f96d5ecb2c0944a73ad5f62a9cb36e97d1cdae69253a11ee4b186628eb38e420 WatchSource:0}: Error finding container f96d5ecb2c0944a73ad5f62a9cb36e97d1cdae69253a11ee4b186628eb38e420: Status 404 returned error can't find the container with id f96d5ecb2c0944a73ad5f62a9cb36e97d1cdae69253a11ee4b186628eb38e420 Jul 09 04:25:24.795326 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:25:24.795289 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-54f755dfc7-qnxmr" event={"ID":"6f0c256f-a584-4cf7-be23-5853a71bd904","Type":"ContainerStarted","Data":"f96d5ecb2c0944a73ad5f62a9cb36e97d1cdae69253a11ee4b186628eb38e420"} Jul 09 04:25:26.807432 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:25:26.807380 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-54f755dfc7-qnxmr" event={"ID":"6f0c256f-a584-4cf7-be23-5853a71bd904","Type":"ContainerStarted","Data":"c9bf9d232e5eeca4ffca33f998d94799953d637c82cd74e5bec8b6ce181659c8"} Jul 09 04:25:26.807825 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:25:26.807467 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-54f755dfc7-qnxmr" Jul 09 04:25:26.825568 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:25:26.825518 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-54f755dfc7-qnxmr" podStartSLOduration=2.19198737 podStartE2EDuration="3.825499876s" totalImagesPullingTime="1.633512506s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:25:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:25:26.824061426 +0000 UTC m=+584.440959667" watchObservedRunningTime="2026-07-09 04:25:26.825499876 +0000 UTC m=+584.442398094" Jul 09 04:25:32.818058 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:25:32.818029 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-54f755dfc7-qnxmr" Jul 09 04:25:42.852648 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:25:42.852618 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-lhzlx_a6976b04-fd52-4288-8d24-fb34cc801459/console-operator/1.log" Jul 09 04:25:42.857547 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:25:42.857516 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-lhzlx_a6976b04-fd52-4288-8d24-fb34cc801459/console-operator/1.log" Jul 09 04:26:00.406837 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:26:00.406790 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-lxs9s"] Jul 09 04:26:00.412824 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:26:00.412796 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-lxs9s" Jul 09 04:26:00.416866 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:26:00.416838 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 09 04:26:00.417054 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:26:00.416844 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jul 09 04:26:00.417054 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:26:00.416844 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 09 04:26:00.417054 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:26:00.416846 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-mxjbf\"" Jul 09 04:26:00.420486 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:26:00.420459 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-lxs9s"] Jul 09 04:26:00.468746 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:26:00.468706 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a93d5f8e-3243-4eea-8bb7-0eef92e251d1-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-lxs9s\" (UID: \"a93d5f8e-3243-4eea-8bb7-0eef92e251d1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-lxs9s" Jul 09 04:26:00.468746 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:26:00.468748 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a93d5f8e-3243-4eea-8bb7-0eef92e251d1-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-lxs9s\" (UID: \"a93d5f8e-3243-4eea-8bb7-0eef92e251d1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-lxs9s" Jul 09 04:26:00.469058 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:26:00.468780 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a93d5f8e-3243-4eea-8bb7-0eef92e251d1-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-lxs9s\" (UID: \"a93d5f8e-3243-4eea-8bb7-0eef92e251d1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-lxs9s" Jul 09 04:26:00.469058 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:26:00.468874 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a93d5f8e-3243-4eea-8bb7-0eef92e251d1-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-lxs9s\" (UID: \"a93d5f8e-3243-4eea-8bb7-0eef92e251d1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-lxs9s" Jul 09 04:26:00.469058 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:26:00.468922 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kth7q\" (UniqueName: \"kubernetes.io/projected/a93d5f8e-3243-4eea-8bb7-0eef92e251d1-kube-api-access-kth7q\") pod \"e2e-distinct-simulated-kserve-59975d69f9-lxs9s\" (UID: \"a93d5f8e-3243-4eea-8bb7-0eef92e251d1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-lxs9s" Jul 09 04:26:00.469058 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:26:00.468993 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a93d5f8e-3243-4eea-8bb7-0eef92e251d1-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-lxs9s\" (UID: \"a93d5f8e-3243-4eea-8bb7-0eef92e251d1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-lxs9s" Jul 09 04:26:00.569578 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:26:00.569544 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a93d5f8e-3243-4eea-8bb7-0eef92e251d1-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-lxs9s\" (UID: \"a93d5f8e-3243-4eea-8bb7-0eef92e251d1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-lxs9s" Jul 09 04:26:00.569783 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:26:00.569606 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a93d5f8e-3243-4eea-8bb7-0eef92e251d1-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-lxs9s\" (UID: \"a93d5f8e-3243-4eea-8bb7-0eef92e251d1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-lxs9s" Jul 09 04:26:00.569783 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:26:00.569631 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a93d5f8e-3243-4eea-8bb7-0eef92e251d1-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-lxs9s\" (UID: \"a93d5f8e-3243-4eea-8bb7-0eef92e251d1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-lxs9s" Jul 09 04:26:00.569783 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:26:00.569647 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a93d5f8e-3243-4eea-8bb7-0eef92e251d1-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-lxs9s\" (UID: \"a93d5f8e-3243-4eea-8bb7-0eef92e251d1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-lxs9s" Jul 09 04:26:00.569783 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:26:00.569689 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a93d5f8e-3243-4eea-8bb7-0eef92e251d1-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-lxs9s\" (UID: \"a93d5f8e-3243-4eea-8bb7-0eef92e251d1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-lxs9s" Jul 09 04:26:00.569783 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:26:00.569709 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kth7q\" (UniqueName: \"kubernetes.io/projected/a93d5f8e-3243-4eea-8bb7-0eef92e251d1-kube-api-access-kth7q\") pod \"e2e-distinct-simulated-kserve-59975d69f9-lxs9s\" (UID: \"a93d5f8e-3243-4eea-8bb7-0eef92e251d1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-lxs9s" Jul 09 04:26:00.570123 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:26:00.570097 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a93d5f8e-3243-4eea-8bb7-0eef92e251d1-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-lxs9s\" (UID: \"a93d5f8e-3243-4eea-8bb7-0eef92e251d1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-lxs9s" Jul 09 04:26:00.570191 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:26:00.570137 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a93d5f8e-3243-4eea-8bb7-0eef92e251d1-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-lxs9s\" (UID: \"a93d5f8e-3243-4eea-8bb7-0eef92e251d1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-lxs9s" Jul 09 04:26:00.570191 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:26:00.570174 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a93d5f8e-3243-4eea-8bb7-0eef92e251d1-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-lxs9s\" (UID: \"a93d5f8e-3243-4eea-8bb7-0eef92e251d1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-lxs9s" Jul 09 04:26:00.572211 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:26:00.572185 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a93d5f8e-3243-4eea-8bb7-0eef92e251d1-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-lxs9s\" (UID: \"a93d5f8e-3243-4eea-8bb7-0eef92e251d1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-lxs9s" Jul 09 04:26:00.572491 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:26:00.572472 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a93d5f8e-3243-4eea-8bb7-0eef92e251d1-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-lxs9s\" (UID: \"a93d5f8e-3243-4eea-8bb7-0eef92e251d1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-lxs9s" Jul 09 04:26:00.577869 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:26:00.577844 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kth7q\" (UniqueName: \"kubernetes.io/projected/a93d5f8e-3243-4eea-8bb7-0eef92e251d1-kube-api-access-kth7q\") pod \"e2e-distinct-simulated-kserve-59975d69f9-lxs9s\" (UID: \"a93d5f8e-3243-4eea-8bb7-0eef92e251d1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-lxs9s" Jul 09 04:26:00.724511 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:26:00.724470 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-lxs9s" Jul 09 04:26:00.868956 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:26:00.868902 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-lxs9s"] Jul 09 04:26:00.872312 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:26:00.872278 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda93d5f8e_3243_4eea_8bb7_0eef92e251d1.slice/crio-946e6ecd25a1858e1516b5a866cec4eefed8d3f63a781ad7c0a560dcb2ff545c WatchSource:0}: Error finding container 946e6ecd25a1858e1516b5a866cec4eefed8d3f63a781ad7c0a560dcb2ff545c: Status 404 returned error can't find the container with id 946e6ecd25a1858e1516b5a866cec4eefed8d3f63a781ad7c0a560dcb2ff545c Jul 09 04:26:00.976928 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:26:00.976818 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-lxs9s" event={"ID":"a93d5f8e-3243-4eea-8bb7-0eef92e251d1","Type":"ContainerStarted","Data":"946e6ecd25a1858e1516b5a866cec4eefed8d3f63a781ad7c0a560dcb2ff545c"} Jul 09 04:26:02.990418 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:26:02.990381 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-lxs9s" event={"ID":"a93d5f8e-3243-4eea-8bb7-0eef92e251d1","Type":"ContainerStarted","Data":"614bc240fc2434a40b1f06eed3bca1caff8ba3c8405af8c9d9d9f26150d627ac"} Jul 09 04:26:03.008788 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:26:03.008731 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-lxs9s" podStartSLOduration=1.885974333 podStartE2EDuration="3.008709456s" totalImagesPullingTime="1.122735123s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:26:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:26:03.006632498 +0000 UTC m=+620.623530743" watchObservedRunningTime="2026-07-09 04:26:03.008709456 +0000 UTC m=+620.625607676" Jul 09 04:26:10.724887 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:26:10.724842 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-lxs9s" Jul 09 04:26:10.728756 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:26:10.724938 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-lxs9s" Jul 09 04:26:10.740428 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:26:10.740393 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-lxs9s" Jul 09 04:26:11.044745 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:26:11.044655 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-lxs9s" Jul 09 04:26:13.505358 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:26:13.505327 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-wdvdz"] Jul 09 04:26:13.509109 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:26:13.509086 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wdvdz" Jul 09 04:26:13.514713 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:26:13.514680 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 09 04:26:13.521486 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:26:13.521449 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-wdvdz"] Jul 09 04:26:13.585799 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:26:13.585761 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f57038a6-f8dc-4e6f-8e57-d42aca47bb3f-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-wdvdz\" (UID: \"f57038a6-f8dc-4e6f-8e57-d42aca47bb3f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wdvdz" Jul 09 04:26:13.585992 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:26:13.585819 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gn2bj\" (UniqueName: \"kubernetes.io/projected/f57038a6-f8dc-4e6f-8e57-d42aca47bb3f-kube-api-access-gn2bj\") pod \"e2e-trlp-test-simulated-kserve-598466548d-wdvdz\" (UID: \"f57038a6-f8dc-4e6f-8e57-d42aca47bb3f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wdvdz" Jul 09 04:26:13.585992 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:26:13.585841 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f57038a6-f8dc-4e6f-8e57-d42aca47bb3f-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-wdvdz\" (UID: \"f57038a6-f8dc-4e6f-8e57-d42aca47bb3f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wdvdz" Jul 09 04:26:13.585992 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:26:13.585889 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f57038a6-f8dc-4e6f-8e57-d42aca47bb3f-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-wdvdz\" (UID: \"f57038a6-f8dc-4e6f-8e57-d42aca47bb3f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wdvdz" Jul 09 04:26:13.585992 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:26:13.585955 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f57038a6-f8dc-4e6f-8e57-d42aca47bb3f-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-wdvdz\" (UID: \"f57038a6-f8dc-4e6f-8e57-d42aca47bb3f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wdvdz" Jul 09 04:26:13.586136 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:26:13.586002 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f57038a6-f8dc-4e6f-8e57-d42aca47bb3f-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-wdvdz\" (UID: \"f57038a6-f8dc-4e6f-8e57-d42aca47bb3f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wdvdz" Jul 09 04:26:13.686476 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:26:13.686436 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gn2bj\" (UniqueName: \"kubernetes.io/projected/f57038a6-f8dc-4e6f-8e57-d42aca47bb3f-kube-api-access-gn2bj\") pod \"e2e-trlp-test-simulated-kserve-598466548d-wdvdz\" (UID: \"f57038a6-f8dc-4e6f-8e57-d42aca47bb3f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wdvdz" Jul 09 04:26:13.686476 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:26:13.686479 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f57038a6-f8dc-4e6f-8e57-d42aca47bb3f-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-wdvdz\" (UID: \"f57038a6-f8dc-4e6f-8e57-d42aca47bb3f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wdvdz" Jul 09 04:26:13.686742 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:26:13.686514 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f57038a6-f8dc-4e6f-8e57-d42aca47bb3f-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-wdvdz\" (UID: \"f57038a6-f8dc-4e6f-8e57-d42aca47bb3f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wdvdz" Jul 09 04:26:13.686742 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:26:13.686534 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f57038a6-f8dc-4e6f-8e57-d42aca47bb3f-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-wdvdz\" (UID: \"f57038a6-f8dc-4e6f-8e57-d42aca47bb3f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wdvdz" Jul 09 04:26:13.686742 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:26:13.686560 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f57038a6-f8dc-4e6f-8e57-d42aca47bb3f-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-wdvdz\" (UID: \"f57038a6-f8dc-4e6f-8e57-d42aca47bb3f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wdvdz" Jul 09 04:26:13.686742 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:26:13.686601 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f57038a6-f8dc-4e6f-8e57-d42aca47bb3f-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-wdvdz\" (UID: \"f57038a6-f8dc-4e6f-8e57-d42aca47bb3f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wdvdz" Jul 09 04:26:13.687084 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:26:13.687054 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f57038a6-f8dc-4e6f-8e57-d42aca47bb3f-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-wdvdz\" (UID: \"f57038a6-f8dc-4e6f-8e57-d42aca47bb3f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wdvdz" Jul 09 04:26:13.687084 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:26:13.687077 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f57038a6-f8dc-4e6f-8e57-d42aca47bb3f-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-wdvdz\" (UID: \"f57038a6-f8dc-4e6f-8e57-d42aca47bb3f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wdvdz" Jul 09 04:26:13.687245 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:26:13.687143 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f57038a6-f8dc-4e6f-8e57-d42aca47bb3f-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-wdvdz\" (UID: \"f57038a6-f8dc-4e6f-8e57-d42aca47bb3f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wdvdz" Jul 09 04:26:13.689019 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:26:13.688995 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f57038a6-f8dc-4e6f-8e57-d42aca47bb3f-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-wdvdz\" (UID: \"f57038a6-f8dc-4e6f-8e57-d42aca47bb3f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wdvdz" Jul 09 04:26:13.689309 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:26:13.689287 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f57038a6-f8dc-4e6f-8e57-d42aca47bb3f-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-wdvdz\" (UID: \"f57038a6-f8dc-4e6f-8e57-d42aca47bb3f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wdvdz" Jul 09 04:26:13.698420 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:26:13.698392 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gn2bj\" (UniqueName: \"kubernetes.io/projected/f57038a6-f8dc-4e6f-8e57-d42aca47bb3f-kube-api-access-gn2bj\") pod \"e2e-trlp-test-simulated-kserve-598466548d-wdvdz\" (UID: \"f57038a6-f8dc-4e6f-8e57-d42aca47bb3f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wdvdz" Jul 09 04:26:13.821332 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:26:13.821231 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wdvdz" Jul 09 04:26:13.964123 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:26:13.964095 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-wdvdz"] Jul 09 04:26:13.965830 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:26:13.965798 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf57038a6_f8dc_4e6f_8e57_d42aca47bb3f.slice/crio-fcf244621dd9574e3da2d194a1de752a3fbbfbc9779b8e43084dd0d38eebecf7 WatchSource:0}: Error finding container fcf244621dd9574e3da2d194a1de752a3fbbfbc9779b8e43084dd0d38eebecf7: Status 404 returned error can't find the container with id fcf244621dd9574e3da2d194a1de752a3fbbfbc9779b8e43084dd0d38eebecf7 Jul 09 04:26:13.967162 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:26:13.967137 2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 09 04:26:14.050076 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:26:14.050042 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wdvdz" event={"ID":"f57038a6-f8dc-4e6f-8e57-d42aca47bb3f","Type":"ContainerStarted","Data":"fcf244621dd9574e3da2d194a1de752a3fbbfbc9779b8e43084dd0d38eebecf7"} Jul 09 04:26:15.057746 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:26:15.057703 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wdvdz" event={"ID":"f57038a6-f8dc-4e6f-8e57-d42aca47bb3f","Type":"ContainerStarted","Data":"2bad5004c2006d6a7dd1d3de521949e464f6b024803177797ff4932becdc2de9"} Jul 09 04:26:15.100196 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:26:15.100131 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wdvdz" podStartSLOduration=1.9284127359999998 podStartE2EDuration="2.100111109s" totalImagesPullingTime="171.698373ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:26:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:26:15.099288358 +0000 UTC m=+632.716186568" watchObservedRunningTime="2026-07-09 04:26:15.100111109 +0000 UTC m=+632.717009328" Jul 09 04:26:23.821980 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:26:23.821898 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wdvdz" Jul 09 04:26:23.821980 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:26:23.821992 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wdvdz" Jul 09 04:26:23.834988 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:26:23.834960 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wdvdz" Jul 09 04:26:24.114994 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:26:24.114880 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wdvdz" Jul 09 04:27:23.192677 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:27:23.192638 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-c69fdbb4c-tqtcm"] Jul 09 04:27:23.196369 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:27:23.196346 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c69fdbb4c-tqtcm" Jul 09 04:27:23.207563 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:27:23.207530 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-c69fdbb4c-tqtcm"] Jul 09 04:27:23.320933 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:27:23.320877 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbl7s\" (UniqueName: \"kubernetes.io/projected/07720431-9dbc-4b8d-b83f-e143ddcd738a-kube-api-access-nbl7s\") pod \"authorino-c69fdbb4c-tqtcm\" (UID: \"07720431-9dbc-4b8d-b83f-e143ddcd738a\") " pod="kuadrant-system/authorino-c69fdbb4c-tqtcm" Jul 09 04:27:23.321111 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:27:23.320999 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/07720431-9dbc-4b8d-b83f-e143ddcd738a-tls-cert\") pod \"authorino-c69fdbb4c-tqtcm\" (UID: \"07720431-9dbc-4b8d-b83f-e143ddcd738a\") " pod="kuadrant-system/authorino-c69fdbb4c-tqtcm" Jul 09 04:27:23.422444 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:27:23.422342 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/07720431-9dbc-4b8d-b83f-e143ddcd738a-tls-cert\") pod \"authorino-c69fdbb4c-tqtcm\" (UID: \"07720431-9dbc-4b8d-b83f-e143ddcd738a\") " pod="kuadrant-system/authorino-c69fdbb4c-tqtcm" Jul 09 04:27:23.422637 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:27:23.422489 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nbl7s\" (UniqueName: \"kubernetes.io/projected/07720431-9dbc-4b8d-b83f-e143ddcd738a-kube-api-access-nbl7s\") pod \"authorino-c69fdbb4c-tqtcm\" (UID: \"07720431-9dbc-4b8d-b83f-e143ddcd738a\") " pod="kuadrant-system/authorino-c69fdbb4c-tqtcm" Jul 09 04:27:23.424917 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:27:23.424887 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/07720431-9dbc-4b8d-b83f-e143ddcd738a-tls-cert\") pod \"authorino-c69fdbb4c-tqtcm\" (UID: \"07720431-9dbc-4b8d-b83f-e143ddcd738a\") " pod="kuadrant-system/authorino-c69fdbb4c-tqtcm" Jul 09 04:27:23.430113 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:27:23.430089 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbl7s\" (UniqueName: \"kubernetes.io/projected/07720431-9dbc-4b8d-b83f-e143ddcd738a-kube-api-access-nbl7s\") pod \"authorino-c69fdbb4c-tqtcm\" (UID: \"07720431-9dbc-4b8d-b83f-e143ddcd738a\") " pod="kuadrant-system/authorino-c69fdbb4c-tqtcm" Jul 09 04:27:23.505939 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:27:23.505878 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c69fdbb4c-tqtcm" Jul 09 04:27:23.694658 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:27:23.694571 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-c69fdbb4c-tqtcm"] Jul 09 04:27:23.697898 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:27:23.697867 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod07720431_9dbc_4b8d_b83f_e143ddcd738a.slice/crio-74c779de196504980309826a9d8c027720dda29d323054cba098d3b624c53a9f WatchSource:0}: Error finding container 74c779de196504980309826a9d8c027720dda29d323054cba098d3b624c53a9f: Status 404 returned error can't find the container with id 74c779de196504980309826a9d8c027720dda29d323054cba098d3b624c53a9f Jul 09 04:27:24.412669 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:27:24.412561 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c69fdbb4c-tqtcm" event={"ID":"07720431-9dbc-4b8d-b83f-e143ddcd738a","Type":"ContainerStarted","Data":"4ede16b9909349771517bca288ef4a85ae16b6bab149ea0e1ea1aa6a7c064504"} Jul 09 04:27:24.412669 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:27:24.412610 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c69fdbb4c-tqtcm" event={"ID":"07720431-9dbc-4b8d-b83f-e143ddcd738a","Type":"ContainerStarted","Data":"74c779de196504980309826a9d8c027720dda29d323054cba098d3b624c53a9f"} Jul 09 04:27:24.453550 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:27:24.453472 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-c69fdbb4c-tqtcm" podStartSLOduration=1.157293883 podStartE2EDuration="1.453448922s" totalImagesPullingTime="296.155039ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:27:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:27:24.450146849 +0000 UTC m=+702.067045069" watchObservedRunningTime="2026-07-09 04:27:24.453448922 +0000 UTC m=+702.070347142" Jul 09 04:27:24.521935 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:27:24.518196 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7f6c469cc8-xckdx"] Jul 09 04:27:24.521935 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:27:24.518428 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-7f6c469cc8-xckdx" podUID="e675690b-731a-4bd4-81fc-f64b0606cfb9" containerName="authorino" containerID="cri-o://c0af30b9d2e56b71286a925238ba9b54eb72cba1e4a6ed54974cc11b296a1938" gracePeriod=30 Jul 09 04:27:24.820059 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:27:24.820026 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7f6c469cc8-xckdx" Jul 09 04:27:24.939188 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:27:24.939151 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4m4sq\" (UniqueName: \"kubernetes.io/projected/e675690b-731a-4bd4-81fc-f64b0606cfb9-kube-api-access-4m4sq\") pod \"e675690b-731a-4bd4-81fc-f64b0606cfb9\" (UID: \"e675690b-731a-4bd4-81fc-f64b0606cfb9\") " Jul 09 04:27:24.939366 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:27:24.939197 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e675690b-731a-4bd4-81fc-f64b0606cfb9-tls-cert\") pod \"e675690b-731a-4bd4-81fc-f64b0606cfb9\" (UID: \"e675690b-731a-4bd4-81fc-f64b0606cfb9\") " Jul 09 04:27:24.941587 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:27:24.941547 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e675690b-731a-4bd4-81fc-f64b0606cfb9-kube-api-access-4m4sq" (OuterVolumeSpecName: "kube-api-access-4m4sq") pod "e675690b-731a-4bd4-81fc-f64b0606cfb9" (UID: "e675690b-731a-4bd4-81fc-f64b0606cfb9"). InnerVolumeSpecName "kube-api-access-4m4sq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 04:27:24.956936 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:27:24.953105 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e675690b-731a-4bd4-81fc-f64b0606cfb9-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "e675690b-731a-4bd4-81fc-f64b0606cfb9" (UID: "e675690b-731a-4bd4-81fc-f64b0606cfb9"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 04:27:25.040492 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:27:25.040402 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4m4sq\" (UniqueName: \"kubernetes.io/projected/e675690b-731a-4bd4-81fc-f64b0606cfb9-kube-api-access-4m4sq\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\"" Jul 09 04:27:25.040492 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:27:25.040441 2566 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e675690b-731a-4bd4-81fc-f64b0606cfb9-tls-cert\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\"" Jul 09 04:27:25.418675 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:27:25.418571 2566 generic.go:356] "Generic (PLEG): container finished" podID="e675690b-731a-4bd4-81fc-f64b0606cfb9" containerID="c0af30b9d2e56b71286a925238ba9b54eb72cba1e4a6ed54974cc11b296a1938" exitCode=0 Jul 09 04:27:25.418675 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:27:25.418638 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7f6c469cc8-xckdx" Jul 09 04:27:25.419188 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:27:25.418661 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7f6c469cc8-xckdx" event={"ID":"e675690b-731a-4bd4-81fc-f64b0606cfb9","Type":"ContainerDied","Data":"c0af30b9d2e56b71286a925238ba9b54eb72cba1e4a6ed54974cc11b296a1938"} Jul 09 04:27:25.419188 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:27:25.418713 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7f6c469cc8-xckdx" event={"ID":"e675690b-731a-4bd4-81fc-f64b0606cfb9","Type":"ContainerDied","Data":"fe81c9ffdaa92f3eb75f9fab23c9b9a7f1fc02fd8c8776b085bfc42ff8d13656"} Jul 09 04:27:25.419188 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:27:25.418738 2566 scope.go:117] "RemoveContainer" containerID="c0af30b9d2e56b71286a925238ba9b54eb72cba1e4a6ed54974cc11b296a1938" Jul 09 04:27:25.429686 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:27:25.429654 2566 scope.go:117] "RemoveContainer" containerID="c0af30b9d2e56b71286a925238ba9b54eb72cba1e4a6ed54974cc11b296a1938" Jul 09 04:27:25.430050 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:27:25.430032 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c0af30b9d2e56b71286a925238ba9b54eb72cba1e4a6ed54974cc11b296a1938\": container with ID starting with c0af30b9d2e56b71286a925238ba9b54eb72cba1e4a6ed54974cc11b296a1938 not found: ID does not exist" containerID="c0af30b9d2e56b71286a925238ba9b54eb72cba1e4a6ed54974cc11b296a1938" Jul 09 04:27:25.430131 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:27:25.430060 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c0af30b9d2e56b71286a925238ba9b54eb72cba1e4a6ed54974cc11b296a1938"} err="failed to get container status \"c0af30b9d2e56b71286a925238ba9b54eb72cba1e4a6ed54974cc11b296a1938\": rpc error: code = NotFound desc = could not find container \"c0af30b9d2e56b71286a925238ba9b54eb72cba1e4a6ed54974cc11b296a1938\": container with ID starting with c0af30b9d2e56b71286a925238ba9b54eb72cba1e4a6ed54974cc11b296a1938 not found: ID does not exist" Jul 09 04:27:25.457189 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:27:25.457150 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7f6c469cc8-xckdx"] Jul 09 04:27:25.461774 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:27:25.461741 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7f6c469cc8-xckdx"] Jul 09 04:27:26.912609 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:27:26.912576 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e675690b-731a-4bd4-81fc-f64b0606cfb9" path="/var/lib/kubelet/pods/e675690b-731a-4bd4-81fc-f64b0606cfb9/volumes" Jul 09 04:29:07.780080 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:29:07.779985 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7db8bf86d7-2wfrp"] Jul 09 04:29:07.780646 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:29:07.780219 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-7db8bf86d7-2wfrp" podUID="cde7df77-b194-4f6d-84d2-823d69636344" containerName="manager" containerID="cri-o://9436c416e60715d262619498406103b3737a7b3908ec00e9f561ba70fcc56d43" gracePeriod=30 Jul 09 04:29:07.943967 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:29:07.943924 2566 generic.go:356] "Generic (PLEG): container finished" podID="cde7df77-b194-4f6d-84d2-823d69636344" containerID="9436c416e60715d262619498406103b3737a7b3908ec00e9f561ba70fcc56d43" exitCode=0 Jul 09 04:29:07.943967 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:29:07.943948 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7db8bf86d7-2wfrp" event={"ID":"cde7df77-b194-4f6d-84d2-823d69636344","Type":"ContainerDied","Data":"9436c416e60715d262619498406103b3737a7b3908ec00e9f561ba70fcc56d43"} Jul 09 04:29:08.045619 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:29:08.045550 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7db8bf86d7-2wfrp" Jul 09 04:29:08.180534 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:29:08.180500 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x72p4\" (UniqueName: \"kubernetes.io/projected/cde7df77-b194-4f6d-84d2-823d69636344-kube-api-access-x72p4\") pod \"cde7df77-b194-4f6d-84d2-823d69636344\" (UID: \"cde7df77-b194-4f6d-84d2-823d69636344\") " Jul 09 04:29:08.180758 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:29:08.180597 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cde7df77-b194-4f6d-84d2-823d69636344-webhook-cert\") pod \"cde7df77-b194-4f6d-84d2-823d69636344\" (UID: \"cde7df77-b194-4f6d-84d2-823d69636344\") " Jul 09 04:29:08.183085 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:29:08.183047 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cde7df77-b194-4f6d-84d2-823d69636344-kube-api-access-x72p4" (OuterVolumeSpecName: "kube-api-access-x72p4") pod "cde7df77-b194-4f6d-84d2-823d69636344" (UID: "cde7df77-b194-4f6d-84d2-823d69636344"). InnerVolumeSpecName "kube-api-access-x72p4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 04:29:08.183217 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:29:08.183143 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cde7df77-b194-4f6d-84d2-823d69636344-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "cde7df77-b194-4f6d-84d2-823d69636344" (UID: "cde7df77-b194-4f6d-84d2-823d69636344"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 04:29:08.281890 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:29:08.281851 2566 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cde7df77-b194-4f6d-84d2-823d69636344-webhook-cert\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\"" Jul 09 04:29:08.281890 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:29:08.281884 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x72p4\" (UniqueName: \"kubernetes.io/projected/cde7df77-b194-4f6d-84d2-823d69636344-kube-api-access-x72p4\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\"" Jul 09 04:29:08.950365 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:29:08.950327 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7db8bf86d7-2wfrp" event={"ID":"cde7df77-b194-4f6d-84d2-823d69636344","Type":"ContainerDied","Data":"87c80c7e6928dd48ca50414c11e977596083ea597503f5cbce33b79c8935d99b"} Jul 09 04:29:08.950794 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:29:08.950406 2566 scope.go:117] "RemoveContainer" containerID="9436c416e60715d262619498406103b3737a7b3908ec00e9f561ba70fcc56d43" Jul 09 04:29:08.950794 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:29:08.950340 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7db8bf86d7-2wfrp" Jul 09 04:29:08.966144 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:29:08.966113 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7db8bf86d7-2wfrp"] Jul 09 04:29:08.969478 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:29:08.969449 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7db8bf86d7-2wfrp"] Jul 09 04:29:09.751896 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:29:09.751861 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7db8bf86d7-fx2x4"] Jul 09 04:29:09.752300 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:29:09.752287 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e675690b-731a-4bd4-81fc-f64b0606cfb9" containerName="authorino" Jul 09 04:29:09.752355 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:29:09.752301 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="e675690b-731a-4bd4-81fc-f64b0606cfb9" containerName="authorino" Jul 09 04:29:09.752355 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:29:09.752332 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cde7df77-b194-4f6d-84d2-823d69636344" containerName="manager" Jul 09 04:29:09.752355 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:29:09.752338 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="cde7df77-b194-4f6d-84d2-823d69636344" containerName="manager" Jul 09 04:29:09.752454 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:29:09.752393 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="cde7df77-b194-4f6d-84d2-823d69636344" containerName="manager" Jul 09 04:29:09.752454 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:29:09.752406 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="e675690b-731a-4bd4-81fc-f64b0606cfb9" containerName="authorino" Jul 09 04:29:09.756774 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:29:09.756751 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7db8bf86d7-fx2x4" Jul 09 04:29:09.760810 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:29:09.760782 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-c74xn\"" Jul 09 04:29:09.760810 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:29:09.760782 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 09 04:29:09.761061 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:29:09.760969 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 09 04:29:09.763755 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:29:09.763717 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7db8bf86d7-fx2x4"] Jul 09 04:29:09.797094 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:29:09.797050 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5lrwz\" (UniqueName: \"kubernetes.io/projected/03e4fa27-c40a-4ad1-9f9c-511340646079-kube-api-access-5lrwz\") pod \"maas-controller-7db8bf86d7-fx2x4\" (UID: \"03e4fa27-c40a-4ad1-9f9c-511340646079\") " pod="opendatahub/maas-controller-7db8bf86d7-fx2x4" Jul 09 04:29:09.797094 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:29:09.797103 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/03e4fa27-c40a-4ad1-9f9c-511340646079-webhook-cert\") pod \"maas-controller-7db8bf86d7-fx2x4\" (UID: \"03e4fa27-c40a-4ad1-9f9c-511340646079\") " pod="opendatahub/maas-controller-7db8bf86d7-fx2x4" Jul 09 04:29:09.897975 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:29:09.897929 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5lrwz\" (UniqueName: \"kubernetes.io/projected/03e4fa27-c40a-4ad1-9f9c-511340646079-kube-api-access-5lrwz\") pod \"maas-controller-7db8bf86d7-fx2x4\" (UID: \"03e4fa27-c40a-4ad1-9f9c-511340646079\") " pod="opendatahub/maas-controller-7db8bf86d7-fx2x4" Jul 09 04:29:09.898190 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:29:09.897990 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/03e4fa27-c40a-4ad1-9f9c-511340646079-webhook-cert\") pod \"maas-controller-7db8bf86d7-fx2x4\" (UID: \"03e4fa27-c40a-4ad1-9f9c-511340646079\") " pod="opendatahub/maas-controller-7db8bf86d7-fx2x4" Jul 09 04:29:09.900721 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:29:09.900693 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/03e4fa27-c40a-4ad1-9f9c-511340646079-webhook-cert\") pod \"maas-controller-7db8bf86d7-fx2x4\" (UID: \"03e4fa27-c40a-4ad1-9f9c-511340646079\") " pod="opendatahub/maas-controller-7db8bf86d7-fx2x4" Jul 09 04:29:09.906758 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:29:09.906731 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5lrwz\" (UniqueName: \"kubernetes.io/projected/03e4fa27-c40a-4ad1-9f9c-511340646079-kube-api-access-5lrwz\") pod \"maas-controller-7db8bf86d7-fx2x4\" (UID: \"03e4fa27-c40a-4ad1-9f9c-511340646079\") " pod="opendatahub/maas-controller-7db8bf86d7-fx2x4" Jul 09 04:29:10.070712 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:29:10.070616 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7db8bf86d7-fx2x4" Jul 09 04:29:10.218852 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:29:10.218824 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7db8bf86d7-fx2x4"] Jul 09 04:29:10.221251 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:29:10.221223 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03e4fa27_c40a_4ad1_9f9c_511340646079.slice/crio-ce6bbebdfd7110ace8ffb39dc0e2cd854af03185093d6dfbe0fc1ca009f4b571 WatchSource:0}: Error finding container ce6bbebdfd7110ace8ffb39dc0e2cd854af03185093d6dfbe0fc1ca009f4b571: Status 404 returned error can't find the container with id ce6bbebdfd7110ace8ffb39dc0e2cd854af03185093d6dfbe0fc1ca009f4b571 Jul 09 04:29:10.913565 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:29:10.913530 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cde7df77-b194-4f6d-84d2-823d69636344" path="/var/lib/kubelet/pods/cde7df77-b194-4f6d-84d2-823d69636344/volumes" Jul 09 04:29:10.964550 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:29:10.964511 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7db8bf86d7-fx2x4" event={"ID":"03e4fa27-c40a-4ad1-9f9c-511340646079","Type":"ContainerStarted","Data":"ce6bbebdfd7110ace8ffb39dc0e2cd854af03185093d6dfbe0fc1ca009f4b571"} Jul 09 04:29:11.971288 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:29:11.971244 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7db8bf86d7-fx2x4" event={"ID":"03e4fa27-c40a-4ad1-9f9c-511340646079","Type":"ContainerStarted","Data":"aca3c97366c47375f508fd1fbeb2af4ff73ea08cc99f860a034c8efc732460ec"} Jul 09 04:29:11.971667 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:29:11.971340 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7db8bf86d7-fx2x4" Jul 09 04:29:11.988572 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:29:11.988520 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7db8bf86d7-fx2x4" podStartSLOduration=2.287324568 podStartE2EDuration="2.988503977s" totalImagesPullingTime="701.179409ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:29:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:29:11.986324744 +0000 UTC m=+809.603222963" watchObservedRunningTime="2026-07-09 04:29:11.988503977 +0000 UTC m=+809.605402195" Jul 09 04:29:22.981585 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:29:22.981553 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7db8bf86d7-fx2x4" Jul 09 04:30:00.155198 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:30:00.155151 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726190-lhx6q"] Jul 09 04:30:00.159597 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:30:00.159567 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726190-lhx6q" Jul 09 04:30:00.167175 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:30:00.167142 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726190-lhx6q"] Jul 09 04:30:00.258760 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:30:00.258716 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-579gl\" (UniqueName: \"kubernetes.io/projected/4e513fbb-73e0-4843-9fa4-94133570ded1-kube-api-access-579gl\") pod \"maas-api-key-cleanup-29726190-lhx6q\" (UID: \"4e513fbb-73e0-4843-9fa4-94133570ded1\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726190-lhx6q" Jul 09 04:30:00.359767 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:30:00.359733 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-579gl\" (UniqueName: \"kubernetes.io/projected/4e513fbb-73e0-4843-9fa4-94133570ded1-kube-api-access-579gl\") pod \"maas-api-key-cleanup-29726190-lhx6q\" (UID: \"4e513fbb-73e0-4843-9fa4-94133570ded1\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726190-lhx6q" Jul 09 04:30:00.375900 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:30:00.375857 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-579gl\" (UniqueName: \"kubernetes.io/projected/4e513fbb-73e0-4843-9fa4-94133570ded1-kube-api-access-579gl\") pod \"maas-api-key-cleanup-29726190-lhx6q\" (UID: \"4e513fbb-73e0-4843-9fa4-94133570ded1\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726190-lhx6q" Jul 09 04:30:00.475034 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:30:00.474990 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726190-lhx6q" Jul 09 04:30:00.636435 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:30:00.636397 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726190-lhx6q"] Jul 09 04:30:00.640414 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:30:00.640381 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e513fbb_73e0_4843_9fa4_94133570ded1.slice/crio-19e487885ccab298a01eb57320ee1ebcb486630984f0d4017ee3bab66b0fc319 WatchSource:0}: Error finding container 19e487885ccab298a01eb57320ee1ebcb486630984f0d4017ee3bab66b0fc319: Status 404 returned error can't find the container with id 19e487885ccab298a01eb57320ee1ebcb486630984f0d4017ee3bab66b0fc319 Jul 09 04:30:01.225640 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:30:01.225597 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726190-lhx6q" event={"ID":"4e513fbb-73e0-4843-9fa4-94133570ded1","Type":"ContainerStarted","Data":"19e487885ccab298a01eb57320ee1ebcb486630984f0d4017ee3bab66b0fc319"} Jul 09 04:30:04.247616 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:30:04.247577 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726190-lhx6q" event={"ID":"4e513fbb-73e0-4843-9fa4-94133570ded1","Type":"ContainerStarted","Data":"d70c7434615a5132f9abf3cab7f10ab13f94ee689ee4e74e011798c6a68d2d1a"} Jul 09 04:30:04.268610 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:30:04.268543 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726190-lhx6q" podStartSLOduration=1.240077296 podStartE2EDuration="4.26852794s" totalImagesPullingTime="3.028450644s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:30:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:30:04.268300508 +0000 UTC m=+861.885198728" watchObservedRunningTime="2026-07-09 04:30:04.26852794 +0000 UTC m=+861.885426161" Jul 09 04:30:42.885123 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:30:42.885089 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-lhzlx_a6976b04-fd52-4288-8d24-fb34cc801459/console-operator/1.log" Jul 09 04:30:42.887088 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:30:42.887065 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-lhzlx_a6976b04-fd52-4288-8d24-fb34cc801459/console-operator/1.log" Jul 09 04:31:00.011572 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:31:00.011529 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726190-lhx6q"] Jul 09 04:31:00.012166 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:31:00.011761 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726190-lhx6q" podUID="4e513fbb-73e0-4843-9fa4-94133570ded1" containerName="cleanup" containerID="cri-o://d70c7434615a5132f9abf3cab7f10ab13f94ee689ee4e74e011798c6a68d2d1a" gracePeriod=30 Jul 09 04:31:30.223039 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:31:30.223009 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726190-lhx6q" Jul 09 04:31:30.398288 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:31:30.398194 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-579gl\" (UniqueName: \"kubernetes.io/projected/4e513fbb-73e0-4843-9fa4-94133570ded1-kube-api-access-579gl\") pod \"4e513fbb-73e0-4843-9fa4-94133570ded1\" (UID: \"4e513fbb-73e0-4843-9fa4-94133570ded1\") " Jul 09 04:31:30.400608 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:31:30.400582 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e513fbb-73e0-4843-9fa4-94133570ded1-kube-api-access-579gl" (OuterVolumeSpecName: "kube-api-access-579gl") pod "4e513fbb-73e0-4843-9fa4-94133570ded1" (UID: "4e513fbb-73e0-4843-9fa4-94133570ded1"). InnerVolumeSpecName "kube-api-access-579gl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 04:31:30.499936 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:31:30.499865 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-579gl\" (UniqueName: \"kubernetes.io/projected/4e513fbb-73e0-4843-9fa4-94133570ded1-kube-api-access-579gl\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\"" Jul 09 04:31:30.716043 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:31:30.715947 2566 generic.go:356] "Generic (PLEG): container finished" podID="4e513fbb-73e0-4843-9fa4-94133570ded1" containerID="d70c7434615a5132f9abf3cab7f10ab13f94ee689ee4e74e011798c6a68d2d1a" exitCode=137 Jul 09 04:31:30.716043 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:31:30.715995 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726190-lhx6q" Jul 09 04:31:30.716239 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:31:30.716040 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726190-lhx6q" event={"ID":"4e513fbb-73e0-4843-9fa4-94133570ded1","Type":"ContainerDied","Data":"d70c7434615a5132f9abf3cab7f10ab13f94ee689ee4e74e011798c6a68d2d1a"} Jul 09 04:31:30.716239 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:31:30.716089 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726190-lhx6q" event={"ID":"4e513fbb-73e0-4843-9fa4-94133570ded1","Type":"ContainerDied","Data":"19e487885ccab298a01eb57320ee1ebcb486630984f0d4017ee3bab66b0fc319"} Jul 09 04:31:30.716239 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:31:30.716118 2566 scope.go:117] "RemoveContainer" containerID="d70c7434615a5132f9abf3cab7f10ab13f94ee689ee4e74e011798c6a68d2d1a" Jul 09 04:31:30.725493 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:31:30.725465 2566 scope.go:117] "RemoveContainer" containerID="d70c7434615a5132f9abf3cab7f10ab13f94ee689ee4e74e011798c6a68d2d1a" Jul 09 04:31:30.725850 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:31:30.725828 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d70c7434615a5132f9abf3cab7f10ab13f94ee689ee4e74e011798c6a68d2d1a\": container with ID starting with d70c7434615a5132f9abf3cab7f10ab13f94ee689ee4e74e011798c6a68d2d1a not found: ID does not exist" containerID="d70c7434615a5132f9abf3cab7f10ab13f94ee689ee4e74e011798c6a68d2d1a" Jul 09 04:31:30.726089 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:31:30.725863 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d70c7434615a5132f9abf3cab7f10ab13f94ee689ee4e74e011798c6a68d2d1a"} err="failed to get container status \"d70c7434615a5132f9abf3cab7f10ab13f94ee689ee4e74e011798c6a68d2d1a\": rpc error: code = NotFound desc = could not find container \"d70c7434615a5132f9abf3cab7f10ab13f94ee689ee4e74e011798c6a68d2d1a\": container with ID starting with d70c7434615a5132f9abf3cab7f10ab13f94ee689ee4e74e011798c6a68d2d1a not found: ID does not exist" Jul 09 04:31:30.739205 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:31:30.739177 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726190-lhx6q"] Jul 09 04:31:30.745054 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:31:30.745028 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726190-lhx6q"] Jul 09 04:31:30.912740 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:31:30.912703 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4e513fbb-73e0-4843-9fa4-94133570ded1" path="/var/lib/kubelet/pods/4e513fbb-73e0-4843-9fa4-94133570ded1/volumes" Jul 09 04:33:48.776077 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:33:48.776007 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h6gp4"] Jul 09 04:33:48.776716 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:33:48.776290 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h6gp4" podUID="50c242dc-db41-4a27-acb4-b1c1b6039321" containerName="manager" containerID="cri-o://a74bbbff36a05854c90303157800fea7d4b0d66cb70af139c146dc732f939471" gracePeriod=10 Jul 09 04:33:52.034695 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:33:52.034667 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h6gp4" Jul 09 04:33:52.129652 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:33:52.129564 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/50c242dc-db41-4a27-acb4-b1c1b6039321-extensions-socket-volume\") pod \"50c242dc-db41-4a27-acb4-b1c1b6039321\" (UID: \"50c242dc-db41-4a27-acb4-b1c1b6039321\") " Jul 09 04:33:52.129652 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:33:52.129632 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6dscp\" (UniqueName: \"kubernetes.io/projected/50c242dc-db41-4a27-acb4-b1c1b6039321-kube-api-access-6dscp\") pod \"50c242dc-db41-4a27-acb4-b1c1b6039321\" (UID: \"50c242dc-db41-4a27-acb4-b1c1b6039321\") " Jul 09 04:33:52.130013 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:33:52.129993 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50c242dc-db41-4a27-acb4-b1c1b6039321-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "50c242dc-db41-4a27-acb4-b1c1b6039321" (UID: "50c242dc-db41-4a27-acb4-b1c1b6039321"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 04:33:52.131844 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:33:52.131820 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/50c242dc-db41-4a27-acb4-b1c1b6039321-kube-api-access-6dscp" (OuterVolumeSpecName: "kube-api-access-6dscp") pod "50c242dc-db41-4a27-acb4-b1c1b6039321" (UID: "50c242dc-db41-4a27-acb4-b1c1b6039321"). InnerVolumeSpecName "kube-api-access-6dscp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 04:33:52.230456 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:33:52.230417 2566 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/50c242dc-db41-4a27-acb4-b1c1b6039321-extensions-socket-volume\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\"" Jul 09 04:33:52.230456 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:33:52.230448 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6dscp\" (UniqueName: \"kubernetes.io/projected/50c242dc-db41-4a27-acb4-b1c1b6039321-kube-api-access-6dscp\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\"" Jul 09 04:33:52.474582 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:33:52.474547 2566 generic.go:356] "Generic (PLEG): container finished" podID="50c242dc-db41-4a27-acb4-b1c1b6039321" containerID="a74bbbff36a05854c90303157800fea7d4b0d66cb70af139c146dc732f939471" exitCode=0 Jul 09 04:33:52.474770 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:33:52.474588 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h6gp4" Jul 09 04:33:52.474770 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:33:52.474612 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h6gp4" event={"ID":"50c242dc-db41-4a27-acb4-b1c1b6039321","Type":"ContainerDied","Data":"a74bbbff36a05854c90303157800fea7d4b0d66cb70af139c146dc732f939471"} Jul 09 04:33:52.474770 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:33:52.474656 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h6gp4" event={"ID":"50c242dc-db41-4a27-acb4-b1c1b6039321","Type":"ContainerDied","Data":"c9f0ce2e6f5bc3ab956d493cd2f1ee68c88bee1dafe75d4db984b6a8164fef80"} Jul 09 04:33:52.474770 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:33:52.474678 2566 scope.go:117] "RemoveContainer" containerID="a74bbbff36a05854c90303157800fea7d4b0d66cb70af139c146dc732f939471" Jul 09 04:33:52.485621 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:33:52.485596 2566 scope.go:117] "RemoveContainer" containerID="a74bbbff36a05854c90303157800fea7d4b0d66cb70af139c146dc732f939471" Jul 09 04:33:52.485951 ip-10-0-137-76 kubenswrapper[2566]: E0709 04:33:52.485925 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a74bbbff36a05854c90303157800fea7d4b0d66cb70af139c146dc732f939471\": container with ID starting with a74bbbff36a05854c90303157800fea7d4b0d66cb70af139c146dc732f939471 not found: ID does not exist" containerID="a74bbbff36a05854c90303157800fea7d4b0d66cb70af139c146dc732f939471" Jul 09 04:33:52.486042 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:33:52.485969 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a74bbbff36a05854c90303157800fea7d4b0d66cb70af139c146dc732f939471"} err="failed to get container status \"a74bbbff36a05854c90303157800fea7d4b0d66cb70af139c146dc732f939471\": rpc error: code = NotFound desc = could not find container \"a74bbbff36a05854c90303157800fea7d4b0d66cb70af139c146dc732f939471\": container with ID starting with a74bbbff36a05854c90303157800fea7d4b0d66cb70af139c146dc732f939471 not found: ID does not exist" Jul 09 04:33:52.498723 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:33:52.498686 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h6gp4"] Jul 09 04:33:52.502787 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:33:52.502764 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h6gp4"] Jul 09 04:33:52.912877 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:33:52.912790 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="50c242dc-db41-4a27-acb4-b1c1b6039321" path="/var/lib/kubelet/pods/50c242dc-db41-4a27-acb4-b1c1b6039321/volumes" Jul 09 04:34:49.961610 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:34:49.961574 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sbzhz"] Jul 09 04:34:49.962102 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:34:49.962020 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e513fbb-73e0-4843-9fa4-94133570ded1" containerName="cleanup" Jul 09 04:34:49.962102 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:34:49.962033 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e513fbb-73e0-4843-9fa4-94133570ded1" containerName="cleanup" Jul 09 04:34:49.962102 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:34:49.962050 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50c242dc-db41-4a27-acb4-b1c1b6039321" containerName="manager" Jul 09 04:34:49.962102 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:34:49.962057 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="50c242dc-db41-4a27-acb4-b1c1b6039321" containerName="manager" Jul 09 04:34:49.962237 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:34:49.962140 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="4e513fbb-73e0-4843-9fa4-94133570ded1" containerName="cleanup" Jul 09 04:34:49.962237 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:34:49.962150 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="50c242dc-db41-4a27-acb4-b1c1b6039321" containerName="manager" Jul 09 04:34:49.966399 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:34:49.966379 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sbzhz" Jul 09 04:34:49.969656 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:34:49.969632 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-w9m2m\"" Jul 09 04:34:49.980376 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:34:49.980343 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sbzhz"] Jul 09 04:34:50.049435 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:34:50.049398 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-87kr5\" (UniqueName: \"kubernetes.io/projected/0a8748de-1236-4269-b568-57e3eacd8f20-kube-api-access-87kr5\") pod \"kuadrant-operator-controller-manager-86878c769f-sbzhz\" (UID: \"0a8748de-1236-4269-b568-57e3eacd8f20\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sbzhz" Jul 09 04:34:50.049632 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:34:50.049462 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0a8748de-1236-4269-b568-57e3eacd8f20-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-sbzhz\" (UID: \"0a8748de-1236-4269-b568-57e3eacd8f20\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sbzhz" Jul 09 04:34:50.150193 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:34:50.150144 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0a8748de-1236-4269-b568-57e3eacd8f20-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-sbzhz\" (UID: \"0a8748de-1236-4269-b568-57e3eacd8f20\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sbzhz" Jul 09 04:34:50.150373 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:34:50.150249 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-87kr5\" (UniqueName: \"kubernetes.io/projected/0a8748de-1236-4269-b568-57e3eacd8f20-kube-api-access-87kr5\") pod \"kuadrant-operator-controller-manager-86878c769f-sbzhz\" (UID: \"0a8748de-1236-4269-b568-57e3eacd8f20\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sbzhz" Jul 09 04:34:50.150589 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:34:50.150567 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0a8748de-1236-4269-b568-57e3eacd8f20-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-sbzhz\" (UID: \"0a8748de-1236-4269-b568-57e3eacd8f20\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sbzhz" Jul 09 04:34:50.159837 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:34:50.159798 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-87kr5\" (UniqueName: \"kubernetes.io/projected/0a8748de-1236-4269-b568-57e3eacd8f20-kube-api-access-87kr5\") pod \"kuadrant-operator-controller-manager-86878c769f-sbzhz\" (UID: \"0a8748de-1236-4269-b568-57e3eacd8f20\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sbzhz" Jul 09 04:34:50.277631 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:34:50.277595 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sbzhz" Jul 09 04:34:50.428952 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:34:50.428878 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sbzhz"] Jul 09 04:34:50.433155 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:34:50.433125 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a8748de_1236_4269_b568_57e3eacd8f20.slice/crio-a8af7b6a14b8d9924912c23989040678012746a71082db7be46df5fa67269875 WatchSource:0}: Error finding container a8af7b6a14b8d9924912c23989040678012746a71082db7be46df5fa67269875: Status 404 returned error can't find the container with id a8af7b6a14b8d9924912c23989040678012746a71082db7be46df5fa67269875 Jul 09 04:34:50.762380 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:34:50.762337 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sbzhz" event={"ID":"0a8748de-1236-4269-b568-57e3eacd8f20","Type":"ContainerStarted","Data":"b558aea0e0de63b6a2b058299ced5cd81e3476320e22ccd748d16adce3edbd19"} Jul 09 04:34:50.762588 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:34:50.762403 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sbzhz" event={"ID":"0a8748de-1236-4269-b568-57e3eacd8f20","Type":"ContainerStarted","Data":"a8af7b6a14b8d9924912c23989040678012746a71082db7be46df5fa67269875"} Jul 09 04:34:50.762588 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:34:50.762432 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sbzhz" Jul 09 04:34:50.781631 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:34:50.781575 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sbzhz" podStartSLOduration=1.781556364 podStartE2EDuration="1.781556364s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:34:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:34:50.779258313 +0000 UTC m=+1148.396156531" watchObservedRunningTime="2026-07-09 04:34:50.781556364 +0000 UTC m=+1148.398454582" Jul 09 04:35:01.771066 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:35:01.771029 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sbzhz" Jul 09 04:35:42.919614 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:35:42.919588 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-lhzlx_a6976b04-fd52-4288-8d24-fb34cc801459/console-operator/1.log" Jul 09 04:35:42.921764 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:35:42.921739 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-lhzlx_a6976b04-fd52-4288-8d24-fb34cc801459/console-operator/1.log" Jul 09 04:40:23.453037 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:40:23.453001 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-c69fdbb4c-tqtcm_07720431-9dbc-4b8d-b83f-e143ddcd738a/authorino/0.log" Jul 09 04:40:28.086903 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:40:28.086872 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-dxzq7_ef2a6f27-43de-49e6-815f-cbba26acb863/manager/0.log" Jul 09 04:40:28.336793 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:40:28.336764 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7db8bf86d7-fx2x4_03e4fa27-c40a-4ad1-9f9c-511340646079/manager/0.log" Jul 09 04:40:28.450644 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:40:28.450565 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-bhqtq_5a12cfa1-d3d6-40be-8e54-def504456032/server/0.log" Jul 09 04:40:28.949717 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:40:28.949688 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8564dc47f7-xqgq5_26205900-770c-43b1-bfa7-e6c96c89f40c/copy-manifests/0.log" Jul 09 04:40:28.963522 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:40:28.963488 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8564dc47f7-xqgq5_26205900-770c-43b1-bfa7-e6c96c89f40c/manager/0.log" Jul 09 04:40:30.311488 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:40:30.311450 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-c69fdbb4c-tqtcm_07720431-9dbc-4b8d-b83f-e143ddcd738a/authorino/0.log" Jul 09 04:40:30.432104 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:40:30.432074 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-plnfq_7a064f35-15c3-4495-abe4-0e6dd0ed2d01/manager/0.log" Jul 09 04:40:30.553084 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:40:30.553057 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-mbhsb_448915ae-4bfe-436a-964a-86938d122f47/manager/0.log" Jul 09 04:40:30.792228 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:40:30.792195 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-6tjt6_11dac32c-222e-485e-aca4-3678a2a6ed06/registry-server/0.log" Jul 09 04:40:30.927523 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:40:30.927494 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-sbzhz_0a8748de-1236-4269-b568-57e3eacd8f20/manager/0.log" Jul 09 04:40:31.204446 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:40:31.204366 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-6tdsk_1b3c730e-e52c-42df-a64a-120bd2683bff/manager/0.log" Jul 09 04:40:31.929191 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:40:31.929163 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-b5df4b696-plrg5_8dbefb98-6f37-4473-993f-649aaeb3b524/kube-auth-proxy/0.log" Jul 09 04:40:32.418490 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:40:32.418458 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7c74886bd5-pn4hl_e3b55ef5-ee9e-47f4-85ae-08fec2d8b98e/router/0.log" Jul 09 04:40:32.889073 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:40:32.889047 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-lxs9s_a93d5f8e-3243-4eea-8bb7-0eef92e251d1/main/0.log" Jul 09 04:40:33.005874 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:40:33.005844 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-wdvdz_f57038a6-f8dc-4e6f-8e57-d42aca47bb3f/main/0.log" Jul 09 04:40:40.569492 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:40:40.569462 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-mvrbd_32c78782-6b5e-4dc1-a3c6-048f98de9c1a/global-pull-secret-syncer/0.log" Jul 09 04:40:40.863999 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:40:40.863896 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-l8qcx_060291ce-8ee2-46f6-96cf-c2e8ea5804d1/konnectivity-agent/0.log" Jul 09 04:40:40.943802 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:40:40.943776 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-76.ec2.internal_befd5e4ef7036106ec96059bdd67d179/haproxy/0.log" Jul 09 04:40:42.951588 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:40:42.951551 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-lhzlx_a6976b04-fd52-4288-8d24-fb34cc801459/console-operator/1.log" Jul 09 04:40:42.954982 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:40:42.954959 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-lhzlx_a6976b04-fd52-4288-8d24-fb34cc801459/console-operator/1.log" Jul 09 04:40:46.159201 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:40:46.159171 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-c69fdbb4c-tqtcm_07720431-9dbc-4b8d-b83f-e143ddcd738a/authorino/0.log" Jul 09 04:40:46.192843 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:40:46.192808 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-plnfq_7a064f35-15c3-4495-abe4-0e6dd0ed2d01/manager/0.log" Jul 09 04:40:46.218358 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:40:46.218325 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-mbhsb_448915ae-4bfe-436a-964a-86938d122f47/manager/0.log" Jul 09 04:40:46.283069 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:40:46.283039 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-6tjt6_11dac32c-222e-485e-aca4-3678a2a6ed06/registry-server/0.log" Jul 09 04:40:46.372888 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:40:46.372851 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-sbzhz_0a8748de-1236-4269-b568-57e3eacd8f20/manager/0.log" Jul 09 04:40:46.471588 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:40:46.471558 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-6tdsk_1b3c730e-e52c-42df-a64a-120bd2683bff/manager/0.log" Jul 09 04:40:48.407163 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:40:48.407087 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-d9vmv_be7de4e5-23b0-463b-8618-d0bb0a0895b6/cluster-monitoring-operator/0.log" Jul 09 04:40:48.577089 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:40:48.577060 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7dbtx_d725de2c-361f-43cc-92b3-8fff39f6ff2d/node-exporter/0.log" Jul 09 04:40:48.599202 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:40:48.599175 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7dbtx_d725de2c-361f-43cc-92b3-8fff39f6ff2d/kube-rbac-proxy/0.log" Jul 09 04:40:48.622318 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:40:48.622292 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7dbtx_d725de2c-361f-43cc-92b3-8fff39f6ff2d/init-textfile/0.log" Jul 09 04:40:49.169135 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:40:49.169097 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-d559d66d5-8snjq_34b579dc-e7f8-4420-98a7-6083fd0c076b/prometheus-operator-admission-webhook/0.log" Jul 09 04:40:50.659693 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:40:50.659665 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6bffdf9778-rct7b_73292436-9d26-4890-a595-3a417aedd88d/networking-console-plugin/0.log" Jul 09 04:40:51.288445 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:40:51.288409 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-lhzlx_a6976b04-fd52-4288-8d24-fb34cc801459/console-operator/1.log" Jul 09 04:40:51.293417 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:40:51.293394 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-lhzlx_a6976b04-fd52-4288-8d24-fb34cc801459/console-operator/2.log" Jul 09 04:40:51.427088 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:40:51.427048 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-d4bdc/perf-node-gather-daemonset-ldg5n"] Jul 09 04:40:51.431270 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:40:51.431241 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-d4bdc/perf-node-gather-daemonset-ldg5n" Jul 09 04:40:51.434037 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:40:51.434013 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-d4bdc\"/\"openshift-service-ca.crt\"" Jul 09 04:40:51.435113 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:40:51.435097 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-d4bdc\"/\"kube-root-ca.crt\"" Jul 09 04:40:51.435183 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:40:51.435112 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-d4bdc\"/\"default-dockercfg-kbqxj\"" Jul 09 04:40:51.442842 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:40:51.442814 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-d4bdc/perf-node-gather-daemonset-ldg5n"] Jul 09 04:40:51.534993 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:40:51.534948 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9q2qb\" (UniqueName: \"kubernetes.io/projected/f3fbc963-1b8a-4d70-ad55-b0db4ff53f67-kube-api-access-9q2qb\") pod \"perf-node-gather-daemonset-ldg5n\" (UID: \"f3fbc963-1b8a-4d70-ad55-b0db4ff53f67\") " pod="openshift-must-gather-d4bdc/perf-node-gather-daemonset-ldg5n" Jul 09 04:40:51.535196 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:40:51.535001 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f3fbc963-1b8a-4d70-ad55-b0db4ff53f67-lib-modules\") pod \"perf-node-gather-daemonset-ldg5n\" (UID: \"f3fbc963-1b8a-4d70-ad55-b0db4ff53f67\") " pod="openshift-must-gather-d4bdc/perf-node-gather-daemonset-ldg5n" Jul 09 04:40:51.535196 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:40:51.535026 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f3fbc963-1b8a-4d70-ad55-b0db4ff53f67-podres\") pod \"perf-node-gather-daemonset-ldg5n\" (UID: \"f3fbc963-1b8a-4d70-ad55-b0db4ff53f67\") " pod="openshift-must-gather-d4bdc/perf-node-gather-daemonset-ldg5n" Jul 09 04:40:51.535196 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:40:51.535065 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f3fbc963-1b8a-4d70-ad55-b0db4ff53f67-sys\") pod \"perf-node-gather-daemonset-ldg5n\" (UID: \"f3fbc963-1b8a-4d70-ad55-b0db4ff53f67\") " pod="openshift-must-gather-d4bdc/perf-node-gather-daemonset-ldg5n" Jul 09 04:40:51.535196 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:40:51.535116 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f3fbc963-1b8a-4d70-ad55-b0db4ff53f67-proc\") pod \"perf-node-gather-daemonset-ldg5n\" (UID: \"f3fbc963-1b8a-4d70-ad55-b0db4ff53f67\") " pod="openshift-must-gather-d4bdc/perf-node-gather-daemonset-ldg5n" Jul 09 04:40:51.636380 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:40:51.636277 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f3fbc963-1b8a-4d70-ad55-b0db4ff53f67-sys\") pod \"perf-node-gather-daemonset-ldg5n\" (UID: \"f3fbc963-1b8a-4d70-ad55-b0db4ff53f67\") " pod="openshift-must-gather-d4bdc/perf-node-gather-daemonset-ldg5n" Jul 09 04:40:51.636380 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:40:51.636322 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f3fbc963-1b8a-4d70-ad55-b0db4ff53f67-proc\") pod \"perf-node-gather-daemonset-ldg5n\" (UID: \"f3fbc963-1b8a-4d70-ad55-b0db4ff53f67\") " pod="openshift-must-gather-d4bdc/perf-node-gather-daemonset-ldg5n" Jul 09 04:40:51.636613 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:40:51.636386 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9q2qb\" (UniqueName: \"kubernetes.io/projected/f3fbc963-1b8a-4d70-ad55-b0db4ff53f67-kube-api-access-9q2qb\") pod \"perf-node-gather-daemonset-ldg5n\" (UID: \"f3fbc963-1b8a-4d70-ad55-b0db4ff53f67\") " pod="openshift-must-gather-d4bdc/perf-node-gather-daemonset-ldg5n" Jul 09 04:40:51.636613 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:40:51.636407 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f3fbc963-1b8a-4d70-ad55-b0db4ff53f67-lib-modules\") pod \"perf-node-gather-daemonset-ldg5n\" (UID: \"f3fbc963-1b8a-4d70-ad55-b0db4ff53f67\") " pod="openshift-must-gather-d4bdc/perf-node-gather-daemonset-ldg5n" Jul 09 04:40:51.636613 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:40:51.636427 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f3fbc963-1b8a-4d70-ad55-b0db4ff53f67-podres\") pod \"perf-node-gather-daemonset-ldg5n\" (UID: \"f3fbc963-1b8a-4d70-ad55-b0db4ff53f67\") " pod="openshift-must-gather-d4bdc/perf-node-gather-daemonset-ldg5n" Jul 09 04:40:51.636613 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:40:51.636434 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f3fbc963-1b8a-4d70-ad55-b0db4ff53f67-sys\") pod \"perf-node-gather-daemonset-ldg5n\" (UID: \"f3fbc963-1b8a-4d70-ad55-b0db4ff53f67\") " pod="openshift-must-gather-d4bdc/perf-node-gather-daemonset-ldg5n" Jul 09 04:40:51.636613 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:40:51.636506 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f3fbc963-1b8a-4d70-ad55-b0db4ff53f67-proc\") pod \"perf-node-gather-daemonset-ldg5n\" (UID: \"f3fbc963-1b8a-4d70-ad55-b0db4ff53f67\") " pod="openshift-must-gather-d4bdc/perf-node-gather-daemonset-ldg5n" Jul 09 04:40:51.636613 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:40:51.636566 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f3fbc963-1b8a-4d70-ad55-b0db4ff53f67-podres\") pod \"perf-node-gather-daemonset-ldg5n\" (UID: \"f3fbc963-1b8a-4d70-ad55-b0db4ff53f67\") " pod="openshift-must-gather-d4bdc/perf-node-gather-daemonset-ldg5n" Jul 09 04:40:51.636613 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:40:51.636569 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f3fbc963-1b8a-4d70-ad55-b0db4ff53f67-lib-modules\") pod \"perf-node-gather-daemonset-ldg5n\" (UID: \"f3fbc963-1b8a-4d70-ad55-b0db4ff53f67\") " pod="openshift-must-gather-d4bdc/perf-node-gather-daemonset-ldg5n" Jul 09 04:40:51.648783 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:40:51.648745 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9q2qb\" (UniqueName: \"kubernetes.io/projected/f3fbc963-1b8a-4d70-ad55-b0db4ff53f67-kube-api-access-9q2qb\") pod \"perf-node-gather-daemonset-ldg5n\" (UID: \"f3fbc963-1b8a-4d70-ad55-b0db4ff53f67\") " pod="openshift-must-gather-d4bdc/perf-node-gather-daemonset-ldg5n" Jul 09 04:40:51.742539 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:40:51.742489 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-d4bdc/perf-node-gather-daemonset-ldg5n" Jul 09 04:40:51.847150 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:40:51.847124 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-685bfb5f64-6mzsz_f1ce87a2-b9e6-41ca-8286-30e91108aeb1/download-server/0.log" Jul 09 04:40:51.889927 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:40:51.889884 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-d4bdc/perf-node-gather-daemonset-ldg5n"] Jul 09 04:40:51.892092 ip-10-0-137-76 kubenswrapper[2566]: W0709 04:40:51.892066 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podf3fbc963_1b8a_4d70_ad55_b0db4ff53f67.slice/crio-30a32babe04f907026d84d086421b8a569ab86a7429dc93b8cc7a12a72bc4749 WatchSource:0}: Error finding container 30a32babe04f907026d84d086421b8a569ab86a7429dc93b8cc7a12a72bc4749: Status 404 returned error can't find the container with id 30a32babe04f907026d84d086421b8a569ab86a7429dc93b8cc7a12a72bc4749 Jul 09 04:40:52.443576 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:40:52.443541 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5d456fdbcd-ks9bq_8c838cc4-8ecb-4bc4-a0f0-5fe843d8c1ad/volume-data-source-validator/0.log" Jul 09 04:40:52.669530 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:40:52.669493 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-d4bdc/perf-node-gather-daemonset-ldg5n" event={"ID":"f3fbc963-1b8a-4d70-ad55-b0db4ff53f67","Type":"ContainerStarted","Data":"7e1bc9966078ed2a5b0a94d6cc2e8f9acf820e33a8ddf7d687d017d7578f0ae8"} Jul 09 04:40:52.669716 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:40:52.669551 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-d4bdc/perf-node-gather-daemonset-ldg5n" event={"ID":"f3fbc963-1b8a-4d70-ad55-b0db4ff53f67","Type":"ContainerStarted","Data":"30a32babe04f907026d84d086421b8a569ab86a7429dc93b8cc7a12a72bc4749"} Jul 09 04:40:52.669716 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:40:52.669622 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-d4bdc/perf-node-gather-daemonset-ldg5n" Jul 09 04:40:52.685708 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:40:52.685648 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-d4bdc/perf-node-gather-daemonset-ldg5n" podStartSLOduration=1.685627807 podStartE2EDuration="1.685627807s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 04:40:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:40:52.683417209 +0000 UTC m=+1510.300315436" watchObservedRunningTime="2026-07-09 04:40:52.685627807 +0000 UTC m=+1510.302526056" Jul 09 04:40:53.604704 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:40:53.604675 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-z8vt7_48514bce-8ca3-41aa-b388-06e16f306fe1/dns/0.log" Jul 09 04:40:53.629638 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:40:53.629595 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-z8vt7_48514bce-8ca3-41aa-b388-06e16f306fe1/kube-rbac-proxy/0.log" Jul 09 04:40:53.657061 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:40:53.657032 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-c6vdp_3562e386-fc03-4589-8bb4-2f36cf7ba1be/dns-node-resolver/0.log" Jul 09 04:40:54.297926 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:40:54.297870 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-h48tl_f291469f-093e-496e-96de-8c04b337980b/node-ca/0.log" Jul 09 04:40:55.399203 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:40:55.399165 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-b5df4b696-plrg5_8dbefb98-6f37-4473-993f-649aaeb3b524/kube-auth-proxy/0.log" Jul 09 04:40:55.638065 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:40:55.638030 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7c74886bd5-pn4hl_e3b55ef5-ee9e-47f4-85ae-08fec2d8b98e/router/0.log" Jul 09 04:40:56.319859 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:40:56.319833 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-qthv7_d6f634f8-361d-4b31-b9d4-9738cf65153b/serve-healthcheck-canary/0.log" Jul 09 04:40:56.806966 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:40:56.806931 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-6sjg9_c805c009-9a98-4b40-9c74-9bed4868db61/insights-operator/0.log" Jul 09 04:40:56.807412 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:40:56.807133 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-6sjg9_c805c009-9a98-4b40-9c74-9bed4868db61/insights-operator/1.log" Jul 09 04:40:56.903532 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:40:56.903498 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-g65cg_c2518b2b-81fb-4e88-97d7-36274a995550/kube-rbac-proxy/0.log" Jul 09 04:40:56.927545 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:40:56.927520 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-g65cg_c2518b2b-81fb-4e88-97d7-36274a995550/exporter/0.log" Jul 09 04:40:56.952093 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:40:56.952066 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-g65cg_c2518b2b-81fb-4e88-97d7-36274a995550/extractor/0.log" Jul 09 04:40:58.685504 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:40:58.685474 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-d4bdc/perf-node-gather-daemonset-ldg5n" Jul 09 04:40:59.253208 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:40:59.253178 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-dxzq7_ef2a6f27-43de-49e6-815f-cbba26acb863/manager/0.log" Jul 09 04:40:59.415043 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:40:59.415001 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7db8bf86d7-fx2x4_03e4fa27-c40a-4ad1-9f9c-511340646079/manager/0.log" Jul 09 04:40:59.445309 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:40:59.445283 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-bhqtq_5a12cfa1-d3d6-40be-8e54-def504456032/server/0.log" Jul 09 04:40:59.685378 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:40:59.685296 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8564dc47f7-xqgq5_26205900-770c-43b1-bfa7-e6c96c89f40c/manager/0.log" Jul 09 04:40:59.703356 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:40:59.703332 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8564dc47f7-xqgq5_26205900-770c-43b1-bfa7-e6c96c89f40c/copy-manifests/0.log" Jul 09 04:41:01.857646 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:41:01.857553 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-b5df4b696-plrg5_8dbefb98-6f37-4473-993f-649aaeb3b524/kube-auth-proxy/0.log" Jul 09 04:41:02.052501 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:41:02.052464 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7c74886bd5-pn4hl_e3b55ef5-ee9e-47f4-85ae-08fec2d8b98e/router/0.log" Jul 09 04:41:03.244945 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:41:03.244899 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-b5df4b696-plrg5_8dbefb98-6f37-4473-993f-649aaeb3b524/kube-auth-proxy/0.log" Jul 09 04:41:03.455378 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:41:03.455349 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7c74886bd5-pn4hl_e3b55ef5-ee9e-47f4-85ae-08fec2d8b98e/router/0.log" Jul 09 04:41:06.227756 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:41:06.227728 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-lmjbt_baa359d9-92f1-40e4-84b9-bbeb07910bb6/migrator/0.log" Jul 09 04:41:06.249858 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:41:06.249830 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-lmjbt_baa359d9-92f1-40e4-84b9-bbeb07910bb6/graceful-termination/0.log" Jul 09 04:41:06.611466 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:41:06.611319 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-8stqx_1095557e-f542-4e1d-a462-0a024f80347e/kube-storage-version-migrator-operator/1.log" Jul 09 04:41:06.612238 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:41:06.612208 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-8stqx_1095557e-f542-4e1d-a462-0a024f80347e/kube-storage-version-migrator-operator/0.log" Jul 09 04:41:07.993363 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:41:07.993337 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xf5wq_fee2629f-8880-4f02-bf6b-26317084c049/kube-multus-additional-cni-plugins/0.log" Jul 09 04:41:08.018203 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:41:08.018178 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xf5wq_fee2629f-8880-4f02-bf6b-26317084c049/egress-router-binary-copy/0.log" Jul 09 04:41:08.044470 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:41:08.044441 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xf5wq_fee2629f-8880-4f02-bf6b-26317084c049/cni-plugins/0.log" Jul 09 04:41:08.068096 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:41:08.068041 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xf5wq_fee2629f-8880-4f02-bf6b-26317084c049/bond-cni-plugin/0.log" Jul 09 04:41:08.107301 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:41:08.107274 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xf5wq_fee2629f-8880-4f02-bf6b-26317084c049/routeoverride-cni/0.log" Jul 09 04:41:08.130641 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:41:08.130615 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xf5wq_fee2629f-8880-4f02-bf6b-26317084c049/whereabouts-cni-bincopy/0.log" Jul 09 04:41:08.152987 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:41:08.152959 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xf5wq_fee2629f-8880-4f02-bf6b-26317084c049/whereabouts-cni/0.log" Jul 09 04:41:08.187925 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:41:08.187874 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-hb42k_0fda490e-3be7-4ca2-ba54-68ab304af491/kube-multus/0.log" Jul 09 04:41:08.319430 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:41:08.319324 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-jqcts_64f35da7-cc64-4921-b129-af733326a5f0/network-metrics-daemon/0.log" Jul 09 04:41:08.339171 ip-10-0-137-76 kubenswrapper[2566]: I0709 04:41:08.339144 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-jqcts_64f35da7-cc64-4921-b129-af733326a5f0/kube-rbac-proxy/0.log"