Jul 08 23:00:44.673319 ip-10-0-140-79 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 08 23:00:44.673333 ip-10-0-140-79 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 08 23:00:44.673343 ip-10-0-140-79 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 08 23:00:44.673693 ip-10-0-140-79 systemd[1]: Failed to start Kubernetes Kubelet. Jul 08 23:00:54.901335 ip-10-0-140-79 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 08 23:00:54.901352 ip-10-0-140-79 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 266b4e57e5354a328fb4a9fbca4af154 -- Jul 08 23:02:29.853832 ip-10-0-140-79 systemd[1]: Starting Kubernetes Kubelet... Jul 08 23:02:30.350527 ip-10-0-140-79 kubenswrapper[2574]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 08 23:02:30.350527 ip-10-0-140-79 kubenswrapper[2574]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 08 23:02:30.350527 ip-10-0-140-79 kubenswrapper[2574]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 08 23:02:30.350527 ip-10-0-140-79 kubenswrapper[2574]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 08 23:02:30.350527 ip-10-0-140-79 kubenswrapper[2574]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 08 23:02:30.350527 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.262035 2574 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 08 23:02:30.350527 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.269572 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 23:02:30.350527 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.269583 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 23:02:30.350527 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.269587 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 23:02:30.350527 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.269591 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 23:02:30.350527 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.269594 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 23:02:30.350527 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.269597 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 23:02:30.350527 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.269600 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 23:02:30.350527 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.269603 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 23:02:30.346119 ip-10-0-140-79 systemd[1]: Started Kubernetes Kubelet. Jul 08 23:02:30.352730 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.269607 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 23:02:30.352730 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.269612 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 23:02:30.352730 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.269616 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 23:02:30.352730 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.269619 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 23:02:30.352730 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.269622 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 23:02:30.352730 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.269624 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 23:02:30.352730 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.269627 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 23:02:30.352730 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.269630 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 23:02:30.352730 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.269632 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 23:02:30.352730 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.269635 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 23:02:30.352730 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.269638 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 23:02:30.352730 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.269640 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 23:02:30.352730 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.269643 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 23:02:30.352730 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.269646 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 23:02:30.352730 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.269648 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 23:02:30.352730 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.269651 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 23:02:30.352730 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.269654 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 23:02:30.352730 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.269656 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 23:02:30.352730 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.269659 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 23:02:30.352730 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.269664 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 23:02:30.366796 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.269666 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 23:02:30.366796 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.269669 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 23:02:30.366796 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.269672 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 23:02:30.366796 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.269675 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 23:02:30.366796 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.269678 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 23:02:30.366796 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.269680 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 23:02:30.366796 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.269683 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 23:02:30.366796 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.269686 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 23:02:30.366796 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.269689 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 23:02:30.366796 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.269691 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 23:02:30.366796 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.269695 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 23:02:30.366796 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.269700 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 23:02:30.366796 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.269703 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 23:02:30.366796 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.269707 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 23:02:30.366796 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.269710 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 23:02:30.366796 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.269712 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 23:02:30.366796 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.269715 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 23:02:30.366796 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.269718 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 23:02:30.366796 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.269720 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 23:02:30.382333 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.269723 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 23:02:30.382333 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.269725 2574 feature_gate.go:328] unrecognized feature gate: Example Jul 08 23:02:30.382333 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.269728 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 23:02:30.382333 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.269730 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 23:02:30.382333 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.269733 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 23:02:30.382333 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.269735 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 23:02:30.382333 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.269738 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 23:02:30.382333 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.269740 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 23:02:30.382333 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.269743 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 23:02:30.382333 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.269746 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 23:02:30.382333 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.269748 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 23:02:30.382333 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.269751 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 23:02:30.382333 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.269754 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 23:02:30.382333 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.269757 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 23:02:30.382333 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.269760 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 23:02:30.382333 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.269763 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 23:02:30.382333 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.269766 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 23:02:30.382333 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.269768 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 23:02:30.382333 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.269771 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 23:02:30.382333 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.269773 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 23:02:30.384939 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.269776 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 23:02:30.384939 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.269778 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 23:02:30.384939 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.269781 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 23:02:30.384939 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.269783 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 23:02:30.384939 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.269786 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 23:02:30.384939 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.269789 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 23:02:30.384939 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.269792 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 23:02:30.384939 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.269794 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 23:02:30.384939 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.269797 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 23:02:30.384939 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.269799 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 23:02:30.384939 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.269802 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 23:02:30.384939 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.269804 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 23:02:30.384939 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.269807 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 23:02:30.384939 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.269811 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 23:02:30.384939 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.269813 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 23:02:30.384939 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.269816 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 23:02:30.384939 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.269818 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 23:02:30.384939 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.269821 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 23:02:30.384939 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.269824 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 23:02:30.398307 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.269826 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 23:02:30.398307 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.269829 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 23:02:30.398307 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.269831 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 23:02:30.398307 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.269834 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 23:02:30.398307 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.269837 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 23:02:30.398307 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.269839 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 23:02:30.398307 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.269842 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 23:02:30.398307 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.269844 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 23:02:30.398307 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.269847 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 23:02:30.398307 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.269849 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 23:02:30.398307 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.269852 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 23:02:30.398307 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.269854 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 23:02:30.398307 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.269857 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 23:02:30.398307 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.270562 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 23:02:30.398307 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.270569 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 23:02:30.398307 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.270572 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 23:02:30.398307 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.270575 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 23:02:30.398307 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.270577 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 23:02:30.398307 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.270580 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 23:02:30.401263 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.270584 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 23:02:30.401263 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.270587 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 23:02:30.401263 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.270590 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 23:02:30.401263 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.270593 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 23:02:30.401263 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.270596 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 23:02:30.401263 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.270598 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 23:02:30.401263 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.270601 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 23:02:30.401263 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.270604 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 23:02:30.401263 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.270606 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 23:02:30.401263 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.270609 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 23:02:30.401263 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.270612 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 23:02:30.401263 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.270614 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 23:02:30.401263 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.270620 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 23:02:30.401263 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.270623 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 23:02:30.401263 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.270626 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 23:02:30.401263 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.270628 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 23:02:30.401263 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.270632 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 23:02:30.401263 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.270636 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 23:02:30.401263 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.270639 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 23:02:30.410301 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.270643 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 23:02:30.410301 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.270647 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 23:02:30.410301 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.270650 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 23:02:30.410301 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.270653 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 23:02:30.410301 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.270656 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 23:02:30.410301 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.270659 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 23:02:30.410301 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.270662 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 23:02:30.410301 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.270664 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 23:02:30.410301 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.270667 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 23:02:30.410301 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.270670 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 23:02:30.410301 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.270672 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 23:02:30.410301 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.270675 2574 feature_gate.go:328] unrecognized feature gate: Example Jul 08 23:02:30.410301 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.270677 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 23:02:30.410301 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.270680 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 23:02:30.410301 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.270683 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 23:02:30.410301 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.270686 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 23:02:30.410301 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.270688 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 23:02:30.410301 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.270691 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 23:02:30.410301 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.270693 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 23:02:30.410301 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.270696 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 23:02:30.413441 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.270699 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 23:02:30.413441 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.270702 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 23:02:30.413441 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.270704 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 23:02:30.413441 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.270706 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 23:02:30.413441 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.270709 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 23:02:30.413441 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.270713 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 23:02:30.413441 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.270715 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 23:02:30.413441 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.270718 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 23:02:30.413441 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.270720 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 23:02:30.413441 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.270723 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 23:02:30.413441 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.270725 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 23:02:30.413441 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.270728 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 23:02:30.413441 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.270730 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 23:02:30.413441 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.270733 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 23:02:30.413441 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.270736 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 23:02:30.413441 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.270739 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 23:02:30.413441 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.270741 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 23:02:30.413441 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.270746 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 23:02:30.413441 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.270749 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 23:02:30.413441 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.270752 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 23:02:30.571160 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.270755 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 23:02:30.571160 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.270758 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 23:02:30.571160 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.270761 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 23:02:30.571160 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.270764 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 23:02:30.571160 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.270766 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 23:02:30.571160 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.270769 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 23:02:30.571160 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.270771 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 23:02:30.571160 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.270774 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 23:02:30.571160 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.270776 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 23:02:30.571160 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.270779 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 23:02:30.571160 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.270781 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 23:02:30.571160 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.270784 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 23:02:30.571160 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.270786 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 23:02:30.571160 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.270789 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 23:02:30.571160 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.270791 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 23:02:30.571160 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.270795 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 23:02:30.571160 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.270797 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 23:02:30.571160 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.270803 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 23:02:30.571160 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.270805 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 23:02:30.571160 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.270808 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 23:02:30.572045 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.270810 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 23:02:30.572045 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.270813 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 23:02:30.572045 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.270815 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 23:02:30.572045 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.270818 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 23:02:30.572045 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.270821 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 23:02:30.572045 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.270823 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 23:02:30.572045 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.270826 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 23:02:30.572045 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.270828 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 23:02:30.572045 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.270831 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 23:02:30.572045 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.270833 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 23:02:30.572045 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.270836 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 23:02:30.572045 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.270838 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 23:02:30.572045 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.270841 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 23:02:30.572045 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.270843 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 23:02:30.572045 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.271210 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 23:02:30.572045 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.271214 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 23:02:30.572045 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.271217 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 23:02:30.572045 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.271220 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 23:02:30.572045 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.271222 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 23:02:30.572045 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.271225 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 23:02:30.575419 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.271228 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 23:02:30.575419 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.271231 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 23:02:30.575419 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.271233 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 23:02:30.575419 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.271236 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 23:02:30.575419 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.271238 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 23:02:30.575419 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.271241 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 23:02:30.575419 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.271243 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 23:02:30.575419 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.271247 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 23:02:30.575419 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.271249 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 23:02:30.575419 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.271253 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 23:02:30.575419 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.271256 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 23:02:30.575419 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.271258 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 23:02:30.575419 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.271261 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 23:02:30.575419 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.271263 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 23:02:30.575419 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.271266 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 23:02:30.575419 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.271268 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 23:02:30.575419 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.271271 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 23:02:30.575419 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.271273 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 23:02:30.575419 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.271276 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 23:02:30.575419 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.271278 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 23:02:30.576624 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.271281 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 23:02:30.576624 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.271283 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 23:02:30.576624 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.271286 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 23:02:30.576624 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.271288 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 23:02:30.576624 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.271291 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 23:02:30.576624 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.271293 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 23:02:30.576624 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.271295 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 23:02:30.576624 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.271298 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 23:02:30.576624 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.271300 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 23:02:30.576624 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.271303 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 23:02:30.576624 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.271305 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 23:02:30.576624 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.271308 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 23:02:30.576624 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.271311 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 23:02:30.576624 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.271313 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 23:02:30.576624 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.271316 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 23:02:30.576624 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.271318 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 23:02:30.576624 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.271321 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 23:02:30.576624 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.271323 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 23:02:30.576624 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.271326 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 23:02:30.576624 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.271329 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 23:02:30.578217 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.271334 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 23:02:30.578217 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.271339 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 23:02:30.578217 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.271341 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 23:02:30.578217 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.271344 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 23:02:30.578217 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.271347 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 23:02:30.578217 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.271350 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 23:02:30.578217 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.271352 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 23:02:30.578217 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.271355 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 23:02:30.578217 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.271359 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 23:02:30.578217 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.271362 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 23:02:30.578217 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.271365 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 23:02:30.578217 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.271368 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 23:02:30.578217 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.271371 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 23:02:30.578217 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.271373 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 23:02:30.578217 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.271376 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 23:02:30.578217 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.271379 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 23:02:30.578217 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.271382 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 23:02:30.578217 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.271384 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 23:02:30.578217 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.271386 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 23:02:30.579359 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.271389 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 23:02:30.579359 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.271392 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 23:02:30.579359 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.271394 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 23:02:30.579359 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.271397 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 23:02:30.579359 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.271400 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 23:02:30.579359 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.271402 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 23:02:30.579359 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.271408 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 23:02:30.579359 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.271410 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 23:02:30.579359 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.271413 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 23:02:30.579359 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.271415 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 23:02:30.579359 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.271418 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 23:02:30.579359 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.271420 2574 feature_gate.go:328] unrecognized feature gate: Example Jul 08 23:02:30.579359 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.271424 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 23:02:30.579359 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.271427 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 23:02:30.579359 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.271430 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 23:02:30.579359 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.271433 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 23:02:30.579359 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.271435 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 23:02:30.579359 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.271438 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 23:02:30.579359 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.271440 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 23:02:30.579359 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.271443 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 23:02:30.581086 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.271446 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 23:02:30.581086 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.271449 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 23:02:30.581086 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.271451 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 23:02:30.581086 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.271454 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 23:02:30.581086 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.271457 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 23:02:30.581086 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.271459 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 23:02:30.581086 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.271463 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 23:02:30.581086 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.271466 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 23:02:30.581086 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.271468 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 23:02:30.581086 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.271471 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 23:02:30.581086 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.271473 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 23:02:30.581086 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.271476 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 23:02:30.581086 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.271478 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 23:02:30.581086 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.271481 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 23:02:30.581086 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.271571 2574 flags.go:64] FLAG: --address="0.0.0.0" Jul 08 23:02:30.581086 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.271579 2574 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 08 23:02:30.581086 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.271585 2574 flags.go:64] FLAG: --anonymous-auth="true" Jul 08 23:02:30.581086 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.271602 2574 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 08 23:02:30.581086 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.271607 2574 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 08 23:02:30.581086 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.271611 2574 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 08 23:02:30.581086 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.271615 2574 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 08 23:02:30.583090 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.271619 2574 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 08 23:02:30.583090 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.271623 2574 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 08 23:02:30.583090 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.271626 2574 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 08 23:02:30.583090 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.271631 2574 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 08 23:02:30.583090 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.271634 2574 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 08 23:02:30.583090 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.271638 2574 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 08 23:02:30.583090 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.271641 2574 flags.go:64] FLAG: --cgroup-root="" Jul 08 23:02:30.583090 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.271644 2574 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 08 23:02:30.583090 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.271647 2574 flags.go:64] FLAG: --client-ca-file="" Jul 08 23:02:30.583090 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.271650 2574 flags.go:64] FLAG: --cloud-provider="external" Jul 08 23:02:30.583090 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.271653 2574 flags.go:64] FLAG: --cluster-dns="[]" Jul 08 23:02:30.583090 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.271657 2574 flags.go:64] FLAG: --cluster-domain="" Jul 08 23:02:30.583090 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.271659 2574 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 08 23:02:30.583090 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.271662 2574 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 08 23:02:30.583090 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.271665 2574 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 08 23:02:30.583090 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.271668 2574 flags.go:64] FLAG: --container-log-max-files="5" Jul 08 23:02:30.583090 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.271672 2574 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 08 23:02:30.583090 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.271675 2574 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 08 23:02:30.583090 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.271677 2574 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 08 23:02:30.583090 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.271680 2574 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 08 23:02:30.583090 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.271683 2574 flags.go:64] FLAG: --contention-profiling="false" Jul 08 23:02:30.583090 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.271686 2574 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 08 23:02:30.583090 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.271689 2574 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 08 23:02:30.583090 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.271692 2574 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 08 23:02:30.583855 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.271695 2574 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 08 23:02:30.583855 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.271699 2574 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 08 23:02:30.583855 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.271702 2574 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 08 23:02:30.583855 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.271705 2574 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 08 23:02:30.583855 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.271708 2574 flags.go:64] FLAG: --enable-load-reader="false" Jul 08 23:02:30.583855 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.271711 2574 flags.go:64] FLAG: --enable-server="true" Jul 08 23:02:30.583855 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.271714 2574 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 08 23:02:30.583855 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.271718 2574 flags.go:64] FLAG: --event-burst="100" Jul 08 23:02:30.583855 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.271722 2574 flags.go:64] FLAG: --event-qps="50" Jul 08 23:02:30.583855 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.271724 2574 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 08 23:02:30.583855 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.271727 2574 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 08 23:02:30.583855 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.271731 2574 flags.go:64] FLAG: --eviction-hard="" Jul 08 23:02:30.583855 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.271735 2574 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 08 23:02:30.583855 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.271739 2574 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 08 23:02:30.583855 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.271742 2574 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 08 23:02:30.583855 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.271745 2574 flags.go:64] FLAG: --eviction-soft="" Jul 08 23:02:30.583855 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.271747 2574 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 08 23:02:30.583855 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.271750 2574 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 08 23:02:30.583855 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.271753 2574 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 08 23:02:30.583855 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.271756 2574 flags.go:64] FLAG: --experimental-mounter-path="" Jul 08 23:02:30.583855 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.271759 2574 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 08 23:02:30.583855 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.271761 2574 flags.go:64] FLAG: --fail-swap-on="true" Jul 08 23:02:30.583855 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.271764 2574 flags.go:64] FLAG: --feature-gates="" Jul 08 23:02:30.583855 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.271768 2574 flags.go:64] FLAG: --file-check-frequency="20s" Jul 08 23:02:30.583855 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.271771 2574 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 08 23:02:30.585367 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.271774 2574 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 08 23:02:30.585367 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.271777 2574 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 08 23:02:30.585367 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.271779 2574 flags.go:64] FLAG: --healthz-port="10248" Jul 08 23:02:30.585367 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.271782 2574 flags.go:64] FLAG: --help="false" Jul 08 23:02:30.585367 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.271785 2574 flags.go:64] FLAG: --hostname-override="ip-10-0-140-79.ec2.internal" Jul 08 23:02:30.585367 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.271788 2574 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 08 23:02:30.585367 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.271791 2574 flags.go:64] FLAG: --http-check-frequency="20s" Jul 08 23:02:30.585367 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.271794 2574 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 08 23:02:30.585367 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.271797 2574 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 08 23:02:30.585367 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.271800 2574 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 08 23:02:30.585367 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.271803 2574 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 08 23:02:30.585367 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.271805 2574 flags.go:64] FLAG: --image-service-endpoint="" Jul 08 23:02:30.585367 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.271808 2574 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 08 23:02:30.585367 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.271811 2574 flags.go:64] FLAG: --kube-api-burst="100" Jul 08 23:02:30.585367 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.271814 2574 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 08 23:02:30.585367 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.271817 2574 flags.go:64] FLAG: --kube-api-qps="50" Jul 08 23:02:30.585367 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.271820 2574 flags.go:64] FLAG: --kube-reserved="" Jul 08 23:02:30.585367 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.271822 2574 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 08 23:02:30.585367 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.271826 2574 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 08 23:02:30.585367 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.271830 2574 flags.go:64] FLAG: --kubelet-cgroups="" Jul 08 23:02:30.585367 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.271834 2574 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 08 23:02:30.585367 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.271837 2574 flags.go:64] FLAG: --lock-file="" Jul 08 23:02:30.585367 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.271840 2574 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 08 23:02:30.585367 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.271842 2574 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 08 23:02:30.592112 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.271846 2574 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 08 23:02:30.592112 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.271851 2574 flags.go:64] FLAG: --log-json-split-stream="false" Jul 08 23:02:30.592112 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.271853 2574 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 08 23:02:30.592112 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.271856 2574 flags.go:64] FLAG: --log-text-split-stream="false" Jul 08 23:02:30.592112 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.271859 2574 flags.go:64] FLAG: --logging-format="text" Jul 08 23:02:30.592112 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.271862 2574 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 08 23:02:30.592112 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.271865 2574 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 08 23:02:30.592112 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.271868 2574 flags.go:64] FLAG: --manifest-url="" Jul 08 23:02:30.592112 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.271871 2574 flags.go:64] FLAG: --manifest-url-header="" Jul 08 23:02:30.592112 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.271875 2574 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 08 23:02:30.592112 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.271878 2574 flags.go:64] FLAG: --max-open-files="1000000" Jul 08 23:02:30.592112 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.271881 2574 flags.go:64] FLAG: --max-pods="110" Jul 08 23:02:30.592112 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.271884 2574 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 08 23:02:30.592112 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.271887 2574 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 08 23:02:30.592112 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.271890 2574 flags.go:64] FLAG: --memory-manager-policy="None" Jul 08 23:02:30.592112 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.271893 2574 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 08 23:02:30.592112 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.271895 2574 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 08 23:02:30.592112 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.271898 2574 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 08 23:02:30.592112 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.271901 2574 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 08 23:02:30.592112 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.271907 2574 flags.go:64] FLAG: --node-status-max-images="50" Jul 08 23:02:30.592112 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.271910 2574 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 08 23:02:30.592112 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.271913 2574 flags.go:64] FLAG: --oom-score-adj="-999" Jul 08 23:02:30.592112 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.271916 2574 flags.go:64] FLAG: --pod-cidr="" Jul 08 23:02:30.593185 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.271919 2574 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 08 23:02:30.593185 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.271924 2574 flags.go:64] FLAG: --pod-manifest-path="" Jul 08 23:02:30.593185 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.271927 2574 flags.go:64] FLAG: --pod-max-pids="-1" Jul 08 23:02:30.593185 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.271932 2574 flags.go:64] FLAG: --pods-per-core="0" Jul 08 23:02:30.593185 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.271934 2574 flags.go:64] FLAG: --port="10250" Jul 08 23:02:30.593185 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.271937 2574 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 08 23:02:30.593185 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.271941 2574 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-021bd39473a86e980" Jul 08 23:02:30.593185 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.271944 2574 flags.go:64] FLAG: --qos-reserved="" Jul 08 23:02:30.593185 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.271947 2574 flags.go:64] FLAG: --read-only-port="10255" Jul 08 23:02:30.593185 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.271950 2574 flags.go:64] FLAG: --register-node="true" Jul 08 23:02:30.593185 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.271953 2574 flags.go:64] FLAG: --register-with-taints="" Jul 08 23:02:30.593185 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.271956 2574 flags.go:64] FLAG: --registry-burst="10" Jul 08 23:02:30.593185 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.271959 2574 flags.go:64] FLAG: --registry-qps="5" Jul 08 23:02:30.593185 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.271962 2574 flags.go:64] FLAG: --reserved-cpus="" Jul 08 23:02:30.593185 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.271965 2574 flags.go:64] FLAG: --reserved-memory="" Jul 08 23:02:30.593185 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.271968 2574 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 08 23:02:30.593185 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.271971 2574 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 08 23:02:30.593185 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.271974 2574 flags.go:64] FLAG: --rotate-certificates="false" Jul 08 23:02:30.593185 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.271977 2574 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 08 23:02:30.593185 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.271980 2574 flags.go:64] FLAG: --runonce="false" Jul 08 23:02:30.593185 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.271982 2574 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 08 23:02:30.593185 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.271985 2574 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 08 23:02:30.593185 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.271988 2574 flags.go:64] FLAG: --seccomp-default="false" Jul 08 23:02:30.593185 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.271991 2574 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 08 23:02:30.593185 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.271993 2574 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 08 23:02:30.596469 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.271996 2574 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 08 23:02:30.596469 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.271999 2574 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 08 23:02:30.596469 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.272002 2574 flags.go:64] FLAG: --storage-driver-password="root" Jul 08 23:02:30.596469 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.272004 2574 flags.go:64] FLAG: --storage-driver-secure="false" Jul 08 23:02:30.596469 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.272007 2574 flags.go:64] FLAG: --storage-driver-table="stats" Jul 08 23:02:30.596469 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.272010 2574 flags.go:64] FLAG: --storage-driver-user="root" Jul 08 23:02:30.596469 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.272012 2574 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 08 23:02:30.596469 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.272015 2574 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 08 23:02:30.596469 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.272018 2574 flags.go:64] FLAG: --system-cgroups="" Jul 08 23:02:30.596469 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.272021 2574 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 08 23:02:30.596469 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.272028 2574 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 08 23:02:30.596469 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.272031 2574 flags.go:64] FLAG: --tls-cert-file="" Jul 08 23:02:30.596469 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.272033 2574 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 08 23:02:30.596469 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.272038 2574 flags.go:64] FLAG: --tls-min-version="" Jul 08 23:02:30.596469 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.272041 2574 flags.go:64] FLAG: --tls-private-key-file="" Jul 08 23:02:30.596469 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.272043 2574 flags.go:64] FLAG: --topology-manager-policy="none" Jul 08 23:02:30.596469 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.272046 2574 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 08 23:02:30.596469 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.272049 2574 flags.go:64] FLAG: --topology-manager-scope="container" Jul 08 23:02:30.596469 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.272052 2574 flags.go:64] FLAG: --v="2" Jul 08 23:02:30.596469 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.272055 2574 flags.go:64] FLAG: --version="false" Jul 08 23:02:30.596469 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.272059 2574 flags.go:64] FLAG: --vmodule="" Jul 08 23:02:30.596469 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.272063 2574 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 08 23:02:30.596469 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.272066 2574 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 08 23:02:30.596469 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.272188 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 23:02:30.596469 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.272192 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 23:02:30.597223 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.272195 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 23:02:30.597223 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.272198 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 23:02:30.597223 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.272201 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 23:02:30.597223 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.272203 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 23:02:30.597223 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.272206 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 23:02:30.597223 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.272208 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 23:02:30.597223 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.272211 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 23:02:30.597223 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.272214 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 23:02:30.597223 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.272216 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 23:02:30.597223 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.272219 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 23:02:30.597223 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.272221 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 23:02:30.597223 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.272224 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 23:02:30.597223 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.272227 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 23:02:30.597223 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.272229 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 23:02:30.597223 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.272232 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 23:02:30.597223 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.272234 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 23:02:30.597223 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.272237 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 23:02:30.597223 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.272241 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 23:02:30.597223 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.272245 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 23:02:30.597223 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.272249 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 23:02:30.597833 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.272253 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 23:02:30.597833 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.272255 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 23:02:30.597833 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.272258 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 23:02:30.597833 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.272261 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 23:02:30.597833 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.272264 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 23:02:30.597833 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.272267 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 23:02:30.597833 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.272269 2574 feature_gate.go:328] unrecognized feature gate: Example Jul 08 23:02:30.597833 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.272273 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 23:02:30.597833 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.272275 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 23:02:30.597833 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.272278 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 23:02:30.597833 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.272281 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 23:02:30.597833 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.272283 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 23:02:30.597833 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.272286 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 23:02:30.597833 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.272289 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 23:02:30.597833 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.272291 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 23:02:30.597833 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.272294 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 23:02:30.597833 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.272296 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 23:02:30.597833 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.272299 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 23:02:30.597833 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.272301 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 23:02:30.887573 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.272304 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 23:02:30.887573 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.272306 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 23:02:30.887573 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.272308 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 23:02:30.887573 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.272311 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 23:02:30.887573 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.272313 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 23:02:30.887573 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.272316 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 23:02:30.887573 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.272318 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 23:02:30.887573 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.272321 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 23:02:30.887573 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.272323 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 23:02:30.887573 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.272326 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 23:02:30.887573 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.272330 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 23:02:30.887573 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.272333 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 23:02:30.887573 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.272335 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 23:02:30.887573 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.272339 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 23:02:30.887573 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.272342 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 23:02:30.887573 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.272344 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 23:02:30.887573 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.272347 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 23:02:30.887573 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.272349 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 23:02:30.887573 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.272352 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 23:02:30.888500 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.272354 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 23:02:30.888500 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.272357 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 23:02:30.888500 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.272359 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 23:02:30.888500 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.272362 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 23:02:30.888500 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.272364 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 23:02:30.888500 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.272367 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 23:02:30.888500 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.272369 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 23:02:30.888500 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.272372 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 23:02:30.888500 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.272374 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 23:02:30.888500 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.272377 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 23:02:30.888500 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.272379 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 23:02:30.888500 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.272382 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 23:02:30.888500 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.272386 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 23:02:30.888500 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.272389 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 23:02:30.888500 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.272391 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 23:02:30.888500 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.272394 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 23:02:30.888500 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.272396 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 23:02:30.888500 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.272399 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 23:02:30.888500 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.272402 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 23:02:30.888500 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.272405 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 23:02:30.889121 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.272407 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 23:02:30.889121 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.272410 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 23:02:30.889121 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.272413 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 23:02:30.889121 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.272416 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 23:02:30.889121 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.272419 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 23:02:30.889121 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.272421 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 23:02:30.889121 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.272425 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 23:02:30.889121 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.272427 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 23:02:30.889121 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.272430 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 23:02:30.889121 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.272434 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 23:02:30.889121 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.272437 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 23:02:30.889121 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.272440 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 23:02:30.889121 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.272443 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 23:02:30.889121 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.272446 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 23:02:30.889121 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.272448 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 23:02:30.889121 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.272451 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 23:02:30.889121 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.272454 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 23:02:30.889121 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.272457 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 23:02:30.889121 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.272459 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 23:02:30.889657 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.273221 2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 08 23:02:30.889657 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.282108 2574 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 08 23:02:30.889657 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.282123 2574 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 08 23:02:30.889657 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.283064 2574 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 08 23:02:30.889657 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.283071 2574 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 08 23:02:30.889657 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283128 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 23:02:30.889657 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283135 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 23:02:30.889657 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283139 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 23:02:30.889657 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283142 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 23:02:30.889657 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283144 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 23:02:30.889657 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283147 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 23:02:30.889657 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283150 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 23:02:30.889657 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283152 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 23:02:30.889657 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283155 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 23:02:30.890092 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283158 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 23:02:30.890092 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283160 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 23:02:30.890092 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283163 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 23:02:30.890092 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283166 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 23:02:30.890092 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283168 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 23:02:30.890092 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283171 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 23:02:30.890092 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283174 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 23:02:30.890092 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283177 2574 feature_gate.go:328] unrecognized feature gate: Example Jul 08 23:02:30.890092 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283179 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 23:02:30.890092 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283182 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 23:02:30.890092 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283184 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 23:02:30.890092 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283187 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 23:02:30.890092 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283189 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 23:02:30.890092 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283192 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 23:02:30.890092 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283194 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 23:02:30.890092 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283197 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 23:02:30.890092 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283199 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 23:02:30.890092 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283203 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 23:02:30.890092 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283206 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 23:02:30.890092 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283209 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 23:02:30.890640 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283212 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 23:02:30.890640 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283214 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 23:02:30.890640 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283217 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 23:02:30.890640 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283220 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 23:02:30.890640 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283222 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 23:02:30.890640 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283224 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 23:02:30.890640 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283227 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 23:02:30.890640 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283230 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 23:02:30.890640 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283232 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 23:02:30.890640 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283235 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 23:02:30.890640 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283237 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 23:02:30.890640 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283239 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 23:02:30.890640 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283243 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 23:02:30.890640 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283245 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 23:02:30.890640 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283247 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 23:02:30.890640 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283250 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 23:02:30.890640 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283252 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 23:02:30.890640 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283255 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 23:02:30.890640 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283258 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 23:02:30.890640 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283261 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 23:02:30.891202 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283263 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 23:02:30.891202 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283265 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 23:02:30.891202 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283268 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 23:02:30.891202 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283271 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 23:02:30.891202 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283273 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 23:02:30.891202 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283275 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 23:02:30.891202 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283278 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 23:02:30.891202 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283281 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 23:02:30.891202 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283284 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 23:02:30.891202 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283286 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 23:02:30.891202 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283290 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 23:02:30.891202 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283293 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 23:02:30.891202 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283295 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 23:02:30.891202 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283298 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 23:02:30.891202 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283301 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 23:02:30.891202 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283304 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 23:02:30.891202 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283306 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 23:02:30.891202 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283310 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 23:02:30.891202 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283315 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 23:02:30.891202 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283318 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 23:02:30.891761 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283320 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 23:02:30.891761 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283323 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 23:02:30.891761 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283326 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 23:02:30.891761 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283328 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 23:02:30.891761 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283331 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 23:02:30.891761 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283334 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 23:02:30.891761 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283336 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 23:02:30.891761 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283339 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 23:02:30.891761 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283345 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 23:02:30.891761 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283347 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 23:02:30.891761 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283351 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 23:02:30.891761 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283354 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 23:02:30.891761 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283356 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 23:02:30.891761 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283359 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 23:02:30.891761 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283361 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 23:02:30.891761 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283364 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 23:02:30.891761 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283366 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 23:02:30.891761 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283369 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 23:02:30.891761 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283371 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 23:02:30.892317 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283374 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 23:02:30.892317 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283377 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 23:02:30.892317 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283379 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 23:02:30.892317 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283382 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 23:02:30.892317 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283384 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 23:02:30.892317 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283387 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 23:02:30.892317 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283389 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 23:02:30.892317 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283392 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 23:02:30.892317 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283396 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 23:02:30.892317 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283399 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 23:02:30.892317 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283403 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 23:02:30.892317 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.283408 2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 08 23:02:30.892317 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283532 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 23:02:30.892317 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283537 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 23:02:30.892317 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283540 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 23:02:30.892761 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283543 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 23:02:30.892761 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283546 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 23:02:30.892761 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283549 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 23:02:30.892761 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283551 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 23:02:30.892761 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283554 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 23:02:30.892761 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283557 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 23:02:30.892761 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283562 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 23:02:30.892761 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283565 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 23:02:30.892761 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283567 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 23:02:30.892761 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283571 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 23:02:30.892761 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283574 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 23:02:30.892761 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283576 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 23:02:30.892761 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283579 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 23:02:30.892761 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283582 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 23:02:30.892761 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283584 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 23:02:30.892761 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283588 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 23:02:30.892761 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283591 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 23:02:30.892761 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283594 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 23:02:30.892761 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283597 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 23:02:30.893344 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283599 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 23:02:30.893344 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283602 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 23:02:30.893344 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283605 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 23:02:30.893344 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283607 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 23:02:30.893344 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283609 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 23:02:30.893344 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283612 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 23:02:30.893344 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283615 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 23:02:30.893344 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283617 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 23:02:30.893344 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283620 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 23:02:30.893344 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283624 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 23:02:30.893344 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283626 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 23:02:30.893344 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283629 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 23:02:30.893344 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283631 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 23:02:30.893344 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283634 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 23:02:30.893344 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283637 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 23:02:30.893344 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283639 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 23:02:30.893344 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283642 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 23:02:30.893344 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283644 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 23:02:30.893344 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283647 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 23:02:30.893344 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283651 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 23:02:30.893892 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283653 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 23:02:30.893892 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283656 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 23:02:30.893892 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283658 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 23:02:30.893892 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283661 2574 feature_gate.go:328] unrecognized feature gate: Example Jul 08 23:02:30.893892 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283664 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 23:02:30.893892 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283666 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 23:02:30.893892 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283669 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 23:02:30.893892 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283671 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 23:02:30.893892 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283674 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 23:02:30.893892 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283677 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 23:02:30.893892 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283679 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 23:02:30.893892 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283682 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 23:02:30.893892 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283684 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 23:02:30.893892 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283687 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 23:02:30.893892 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283689 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 23:02:30.893892 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283692 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 23:02:30.893892 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283694 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 23:02:30.893892 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283697 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 23:02:30.893892 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283699 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 23:02:30.893892 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283702 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 23:02:30.893892 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283704 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 23:02:30.894526 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283709 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 23:02:30.894526 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283711 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 23:02:30.894526 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283714 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 23:02:30.894526 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283717 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 23:02:30.894526 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283719 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 23:02:30.894526 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283722 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 23:02:30.894526 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283725 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 23:02:30.894526 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283727 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 23:02:30.894526 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283730 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 23:02:30.894526 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283732 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 23:02:30.894526 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283736 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 23:02:30.894526 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283738 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 23:02:30.894526 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283741 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 23:02:30.894526 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283744 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 23:02:30.894526 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283747 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 23:02:30.894526 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283752 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 23:02:30.894526 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283755 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 23:02:30.894526 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283758 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 23:02:30.894526 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283761 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 23:02:30.895046 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283764 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 23:02:30.895046 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283766 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 23:02:30.895046 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283769 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 23:02:30.895046 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283771 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 23:02:30.895046 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283774 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 23:02:30.895046 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283776 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 23:02:30.895046 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283779 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 23:02:30.895046 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283781 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 23:02:30.895046 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283784 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 23:02:30.895046 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283786 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 23:02:30.895046 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283790 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 23:02:30.895046 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283793 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 23:02:30.895046 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283796 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 23:02:30.895046 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283800 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 23:02:30.895046 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283804 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 23:02:30.895046 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283807 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 23:02:30.895046 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:30.283809 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 23:02:30.895561 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.283814 2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 08 23:02:30.895561 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.283914 2574 server.go:962] "Client rotation is on, will bootstrap in background" Jul 08 23:02:30.895561 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.287291 2574 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 08 23:02:30.895561 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.288844 2574 server.go:1019] "Starting client certificate rotation" Jul 08 23:02:30.895561 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.288945 2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 08 23:02:30.895561 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.288981 2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 08 23:02:30.895561 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.291630 2574 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 08 23:02:30.895561 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.292673 2574 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 08 23:02:30.895561 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.308095 2574 log.go:25] "Validated CRI v1 runtime API" Jul 08 23:02:30.895561 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.310352 2574 log.go:25] "Validated CRI v1 image API" Jul 08 23:02:30.895561 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.311200 2574 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 08 23:02:30.895561 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.314448 2574 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 8dd50a49-79be-4b9b-817b-82b5f5e19029:/dev/nvme0n1p3 fa1978d5-8b59-41b1-87b7-003bb2997f68:/dev/nvme0n1p4] Jul 08 23:02:30.895952 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.314462 2574 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 08 23:02:30.895952 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.318811 2574 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 08 23:02:30.896614 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.321800 2574 manager.go:216] Machine: {Timestamp:2026-07-08 23:02:30.320327128 +0000 UTC m=+0.368601021 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100252 MemoryCapacity:33164505088 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec25d8e46ff4fd7d26657eebee8ffa1d SystemUUID:ec25d8e4-6ff4-fd7d-2665-7eebee8ffa1d BootID:266b4e57-e535-4a32-8fb4-a9fbca4af154 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582254592 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:bc:65:87:98:07 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:bc:65:87:98:07 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:a6:d5:d3:c5:80:6f Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164505088 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 08 23:02:30.896614 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.321895 2574 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 08 23:02:30.896614 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.321973 2574 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 08 23:02:30.896614 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.325636 2574 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 08 23:02:30.896614 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.325661 2574 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-79.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 08 23:02:30.896614 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.326448 2574 topology_manager.go:138] "Creating topology manager with none policy" Jul 08 23:02:30.896614 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.326457 2574 container_manager_linux.go:309] "Creating device plugin manager" Jul 08 23:02:30.896614 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.326464 2574 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 08 23:02:30.896614 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.327369 2574 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 08 23:02:30.896614 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.329299 2574 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 08 23:02:30.896614 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.333548 2574 state_mem.go:36] "Initialized new in-memory state store" Jul 08 23:02:30.896614 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.333682 2574 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 08 23:02:30.896614 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.333716 2574 kubelet.go:486] "Attempting to sync node with API server" Jul 08 23:02:30.896614 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.333729 2574 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 08 23:02:30.896614 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.333747 2574 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 08 23:02:30.896614 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.333760 2574 kubelet.go:398] "Adding apiserver pod source" Jul 08 23:02:30.896614 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.333775 2574 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 08 23:02:30.896614 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.334183 2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 08 23:02:30.897180 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.334202 2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 08 23:02:30.897180 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.336642 2574 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 08 23:02:30.897180 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.338997 2574 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 08 23:02:30.897180 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.339024 2574 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 08 23:02:30.897180 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.340413 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 08 23:02:30.897180 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.340425 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 08 23:02:30.897180 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.340431 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 08 23:02:30.897180 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.340437 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 08 23:02:30.897180 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.340445 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 08 23:02:30.897180 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.340451 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 08 23:02:30.897180 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.340465 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 08 23:02:30.897180 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.340470 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 08 23:02:30.897180 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.340476 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 08 23:02:30.897180 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.340482 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 08 23:02:30.897180 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.340499 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 08 23:02:30.897180 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.340504 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 08 23:02:30.897180 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.342280 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 08 23:02:30.897180 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.342289 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 08 23:02:30.897180 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:02:30.345077 2574 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-79.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 08 23:02:30.897180 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:02:30.345077 2574 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 08 23:02:30.897180 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.345116 2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-79.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 08 23:02:30.897180 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.345355 2574 server.go:1268] "Started kubelet" Jul 08 23:02:30.897180 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.345418 2574 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 08 23:02:30.897180 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.345487 2574 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 08 23:02:30.897180 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.345586 2574 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 08 23:02:30.897180 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.347641 2574 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 08 23:02:30.897180 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.348347 2574 server.go:310] "Adding debug handlers to kubelet server" Jul 08 23:02:30.897180 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:02:30.353931 2574 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 08 23:02:30.897180 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:02:30.352854 2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-79.ec2.internal.18c072de05dbfaea default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-79.ec2.internal,UID:ip-10-0-140-79.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-140-79.ec2.internal,},FirstTimestamp:2026-07-08 23:02:30.34532529 +0000 UTC m=+0.393599183,LastTimestamp:2026-07-08 23:02:30.34532529 +0000 UTC m=+0.393599183,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-79.ec2.internal,}" Jul 08 23:02:30.897180 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.355853 2574 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 08 23:02:30.897180 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.355870 2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 08 23:02:30.897180 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:02:30.355922 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-79.ec2.internal\" not found" Jul 08 23:02:30.897180 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.356539 2574 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 08 23:02:30.897180 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.356541 2574 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 08 23:02:30.897180 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.356577 2574 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 08 23:02:30.897180 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.356604 2574 factory.go:55] Registering systemd factory Jul 08 23:02:30.897180 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.356622 2574 factory.go:223] Registration of the systemd container factory successfully Jul 08 23:02:30.897180 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.356702 2574 reconstruct.go:97] "Volume reconstruction finished" Jul 08 23:02:30.897180 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.356714 2574 reconciler.go:29] "Reconciler: start to sync state" Jul 08 23:02:30.897180 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.356826 2574 factory.go:153] Registering CRI-O factory Jul 08 23:02:30.897180 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.356839 2574 factory.go:223] Registration of the crio container factory successfully Jul 08 23:02:31.084616 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.356895 2574 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 08 23:02:31.084616 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.356921 2574 factory.go:103] Registering Raw factory Jul 08 23:02:31.084616 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.356937 2574 manager.go:1196] Started watching for new ooms in manager Jul 08 23:02:31.084616 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.357379 2574 manager.go:349] Starting recovery of all containers Jul 08 23:02:31.084616 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.360222 2574 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-dzr6s" Jul 08 23:02:31.084616 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:02:30.361538 2574 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-140-79.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 08 23:02:31.084616 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:02:30.361558 2574 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 08 23:02:31.084616 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.367618 2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-dzr6s" Jul 08 23:02:31.084616 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.369691 2574 manager.go:354] Recovery completed Jul 08 23:02:31.084616 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.373719 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 23:02:31.084616 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.375548 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-79.ec2.internal" event="NodeHasSufficientMemory" Jul 08 23:02:31.084616 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.375575 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-79.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 23:02:31.084616 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.375587 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-79.ec2.internal" event="NodeHasSufficientPID" Jul 08 23:02:31.084616 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.376073 2574 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 08 23:02:31.084616 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.376082 2574 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 08 23:02:31.084616 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.376085 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 23:02:31.084616 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.376095 2574 state_mem.go:36] "Initialized new in-memory state store" Jul 08 23:02:31.084616 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.376749 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-79.ec2.internal" event="NodeHasSufficientMemory" Jul 08 23:02:31.084616 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.376773 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-79.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 23:02:31.084616 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.376783 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-79.ec2.internal" event="NodeHasSufficientPID" Jul 08 23:02:31.084616 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.377055 2574 policy_none.go:49] "None policy: Start" Jul 08 23:02:31.084616 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.377068 2574 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 08 23:02:31.084616 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.377078 2574 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 08 23:02:31.084616 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:02:30.377612 2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-79.ec2.internal.18c072de07a95426 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-79.ec2.internal,UID:ip-10-0-140-79.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-140-79.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-140-79.ec2.internal,},FirstTimestamp:2026-07-08 23:02:30.37556023 +0000 UTC m=+0.423834124,LastTimestamp:2026-07-08 23:02:30.37556023 +0000 UTC m=+0.423834124,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-79.ec2.internal,}" Jul 08 23:02:31.084616 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.378066 2574 policy_none.go:47] "Start" Jul 08 23:02:31.084616 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.433061 2574 manager.go:337] "Starting Device Plugin manager" Jul 08 23:02:31.084616 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:02:30.433094 2574 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 08 23:02:31.084616 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.433106 2574 server.go:87] "Starting device plugin registration server" Jul 08 23:02:31.084616 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.433327 2574 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 08 23:02:31.084616 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.433340 2574 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 08 23:02:31.084616 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.433429 2574 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 08 23:02:31.084616 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.433499 2574 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 08 23:02:31.084616 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.433523 2574 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 08 23:02:31.084616 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:02:30.434238 2574 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 08 23:02:31.084616 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:02:30.434285 2574 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-79.ec2.internal\" not found" Jul 08 23:02:31.084616 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.473983 2574 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 08 23:02:31.084616 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.475104 2574 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 08 23:02:31.084616 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.475138 2574 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 08 23:02:31.084616 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.475160 2574 kubelet.go:2448] "Starting kubelet main sync loop" Jul 08 23:02:31.086419 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:02:30.475195 2574 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 08 23:02:31.086419 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.477750 2574 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 23:02:31.086419 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.533595 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 23:02:31.086419 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.534395 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-79.ec2.internal" event="NodeHasSufficientMemory" Jul 08 23:02:31.086419 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.534425 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-79.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 23:02:31.086419 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.534435 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-79.ec2.internal" event="NodeHasSufficientPID" Jul 08 23:02:31.086419 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.534457 2574 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-79.ec2.internal" Jul 08 23:02:31.086419 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.543313 2574 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-79.ec2.internal" Jul 08 23:02:31.086419 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:02:30.543330 2574 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-79.ec2.internal\": node \"ip-10-0-140-79.ec2.internal\" not found" Jul 08 23:02:31.086419 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:02:30.565775 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-79.ec2.internal\" not found" Jul 08 23:02:31.086419 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.576111 2574 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-79.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-140-79.ec2.internal"] Jul 08 23:02:31.086419 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.576337 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 23:02:31.086419 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.577647 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-79.ec2.internal" event="NodeHasSufficientMemory" Jul 08 23:02:31.086419 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.577674 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-79.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 23:02:31.086419 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.577688 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-79.ec2.internal" event="NodeHasSufficientPID" Jul 08 23:02:31.086419 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.579223 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 23:02:31.086419 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.579318 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-79.ec2.internal" Jul 08 23:02:31.086419 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.579348 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 23:02:31.086419 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.579929 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-79.ec2.internal" event="NodeHasSufficientMemory" Jul 08 23:02:31.086419 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.579957 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-79.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 23:02:31.086419 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.579932 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-79.ec2.internal" event="NodeHasSufficientMemory" Jul 08 23:02:31.086419 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.579992 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-79.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 23:02:31.086419 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.580004 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-79.ec2.internal" event="NodeHasSufficientPID" Jul 08 23:02:31.086419 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.579969 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-79.ec2.internal" event="NodeHasSufficientPID" Jul 08 23:02:31.086419 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.581174 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-79.ec2.internal" Jul 08 23:02:31.086419 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.581201 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 23:02:31.086419 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.581803 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-79.ec2.internal" event="NodeHasSufficientMemory" Jul 08 23:02:31.086419 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.581833 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-79.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 23:02:31.086419 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.581846 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-79.ec2.internal" event="NodeHasSufficientPID" Jul 08 23:02:31.086419 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:02:30.615097 2574 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-79.ec2.internal\" not found" node="ip-10-0-140-79.ec2.internal" Jul 08 23:02:31.086419 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:02:30.618387 2574 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-79.ec2.internal\" not found" node="ip-10-0-140-79.ec2.internal" Jul 08 23:02:31.086419 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.658769 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/25b7acb0a5b1d364918439540aae206c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-79.ec2.internal\" (UID: \"25b7acb0a5b1d364918439540aae206c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-79.ec2.internal" Jul 08 23:02:31.086419 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.658800 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/25b7acb0a5b1d364918439540aae206c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-79.ec2.internal\" (UID: \"25b7acb0a5b1d364918439540aae206c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-79.ec2.internal" Jul 08 23:02:31.086419 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.658826 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8e8c734951fb463aee77d0849d578390-config\") pod \"kube-apiserver-proxy-ip-10-0-140-79.ec2.internal\" (UID: \"8e8c734951fb463aee77d0849d578390\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-79.ec2.internal" Jul 08 23:02:31.087354 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:02:30.666477 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-79.ec2.internal\" not found" Jul 08 23:02:31.087354 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.759471 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/25b7acb0a5b1d364918439540aae206c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-79.ec2.internal\" (UID: \"25b7acb0a5b1d364918439540aae206c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-79.ec2.internal" Jul 08 23:02:31.087354 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.759532 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/25b7acb0a5b1d364918439540aae206c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-79.ec2.internal\" (UID: \"25b7acb0a5b1d364918439540aae206c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-79.ec2.internal" Jul 08 23:02:31.087354 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.759549 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8e8c734951fb463aee77d0849d578390-config\") pod \"kube-apiserver-proxy-ip-10-0-140-79.ec2.internal\" (UID: \"8e8c734951fb463aee77d0849d578390\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-79.ec2.internal" Jul 08 23:02:31.087354 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.759480 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/25b7acb0a5b1d364918439540aae206c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-79.ec2.internal\" (UID: \"25b7acb0a5b1d364918439540aae206c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-79.ec2.internal" Jul 08 23:02:31.087354 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.759598 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8e8c734951fb463aee77d0849d578390-config\") pod \"kube-apiserver-proxy-ip-10-0-140-79.ec2.internal\" (UID: \"8e8c734951fb463aee77d0849d578390\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-79.ec2.internal" Jul 08 23:02:31.087354 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.759614 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/25b7acb0a5b1d364918439540aae206c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-79.ec2.internal\" (UID: \"25b7acb0a5b1d364918439540aae206c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-79.ec2.internal" Jul 08 23:02:31.087354 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:02:30.767545 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-79.ec2.internal\" not found" Jul 08 23:02:31.087354 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:02:30.868284 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-79.ec2.internal\" not found" Jul 08 23:02:31.087354 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.918432 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-79.ec2.internal" Jul 08 23:02:31.087354 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:30.920909 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-79.ec2.internal" Jul 08 23:02:31.087354 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:02:30.969153 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-79.ec2.internal\" not found" Jul 08 23:02:31.087354 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:02:31.069697 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-79.ec2.internal\" not found" Jul 08 23:02:31.367727 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:02:31.170176 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-79.ec2.internal\" not found" Jul 08 23:02:31.367727 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:02:31.270701 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-79.ec2.internal\" not found" Jul 08 23:02:31.367727 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:31.287824 2574 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 08 23:02:31.367727 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:31.287964 2574 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 08 23:02:31.367727 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:31.351978 2574 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 23:02:31.367727 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:31.358197 2574 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 23:02:31.646135 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:31.369459 2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-07 22:57:31 +0000 UTC" deadline="2027-12-24 20:17:52.902151571 +0000 UTC" Jul 08 23:02:31.646135 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:31.369480 2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12813h15m21.532674281s" Jul 08 23:02:31.646135 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:02:31.371596 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-79.ec2.internal\" not found" Jul 08 23:02:31.646135 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:02:31.472187 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-79.ec2.internal\" not found" Jul 08 23:02:31.646135 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:31.498036 2574 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 23:02:31.646135 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:31.556006 2574 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-79.ec2.internal" Jul 08 23:02:31.646135 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:31.556415 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25b7acb0a5b1d364918439540aae206c.slice/crio-88636a13ac92e7455268b2aeb973480c6cb59937ce0056387de6be748fdb3c3e WatchSource:0}: Error finding container 88636a13ac92e7455268b2aeb973480c6cb59937ce0056387de6be748fdb3c3e: Status 404 returned error can't find the container with id 88636a13ac92e7455268b2aeb973480c6cb59937ce0056387de6be748fdb3c3e Jul 08 23:02:31.646135 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:31.556925 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e8c734951fb463aee77d0849d578390.slice/crio-ff2ad5f1875ab551e12b2f600c7c2e6d99ecebb77e2d27887e821b43b4a98c7d WatchSource:0}: Error finding container ff2ad5f1875ab551e12b2f600c7c2e6d99ecebb77e2d27887e821b43b4a98c7d: Status 404 returned error can't find the container with id ff2ad5f1875ab551e12b2f600c7c2e6d99ecebb77e2d27887e821b43b4a98c7d Jul 08 23:02:31.646135 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:31.560329 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 08 23:02:31.646135 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:31.570114 2574 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 08 23:02:31.646135 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:31.571075 2574 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-79.ec2.internal" Jul 08 23:02:31.646135 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:31.579552 2574 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 08 23:02:32.355245 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.334882 2574 apiserver.go:52] "Watching apiserver" Jul 08 23:02:32.355245 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.342618 2574 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 08 23:02:32.355245 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.343162 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-n5f8s","openshift-dns/node-resolver-b9mrk","openshift-image-registry/node-ca-wkdzq","openshift-multus/multus-additional-cni-plugins-wwbc6","openshift-multus/multus-mbgq5","openshift-network-diagnostics/network-check-target-264tg","kube-system/global-pull-secret-syncer-gggnj","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sf9lt","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-79.ec2.internal","openshift-multus/network-metrics-daemon-wj6vf","openshift-network-operator/iptables-alerter-rd6zz","openshift-ovn-kubernetes/ovnkube-node-8mcjt","kube-system/konnectivity-agent-tmmqj","kube-system/kube-apiserver-proxy-ip-10-0-140-79.ec2.internal"] Jul 08 23:02:32.355245 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.344977 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gggnj" Jul 08 23:02:32.355245 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:02:32.345054 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gggnj" podUID="da74ec55-7cda-4f1a-ba6d-0b4222b5fcb5" Jul 08 23:02:32.355245 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.346563 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-tmmqj" Jul 08 23:02:32.355245 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.347875 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wkdzq" Jul 08 23:02:32.355245 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.349428 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-27vjp\"" Jul 08 23:02:32.355245 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.349452 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 08 23:02:32.355245 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.349463 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 08 23:02:32.355245 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.349666 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-wwbc6" Jul 08 23:02:32.355245 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.350601 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 08 23:02:32.355245 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.350654 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 08 23:02:32.355245 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.350608 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-bf7kl\"" Jul 08 23:02:32.355245 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.350605 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 08 23:02:32.355245 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.352158 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mbgq5" Jul 08 23:02:32.355245 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.352230 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 08 23:02:32.355245 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.352911 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 08 23:02:32.355245 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.352974 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 08 23:02:32.355245 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.353034 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-lblxr\"" Jul 08 23:02:32.355245 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.353051 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 08 23:02:32.355245 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.353403 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 08 23:02:32.360768 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.355455 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-v4j9b\"" Jul 08 23:02:32.360768 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.355600 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-264tg" Jul 08 23:02:32.360768 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:02:32.355659 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-264tg" podUID="994c671c-e4ec-474c-94fa-53f4cab24a16" Jul 08 23:02:32.360768 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.356913 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 08 23:02:32.360768 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.357114 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sf9lt" Jul 08 23:02:32.360768 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.356966 2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 08 23:02:32.360768 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.358660 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-n5f8s" Jul 08 23:02:32.360768 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.359609 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-vncq8\"" Jul 08 23:02:32.360768 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.359644 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 08 23:02:32.360768 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.360313 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 08 23:02:32.360768 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.360547 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 08 23:02:32.361732 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.361466 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-b9mrk" Jul 08 23:02:32.361732 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.361687 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-9cfj5\"" Jul 08 23:02:32.362497 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.361969 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 08 23:02:32.362497 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.362011 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 08 23:02:32.364265 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.363656 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wj6vf" Jul 08 23:02:32.364265 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:02:32.363733 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wj6vf" podUID="bfaa3f60-05b5-436b-9c10-324361b4bae0" Jul 08 23:02:32.441437 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.364770 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-ds8f2\"" Jul 08 23:02:32.441437 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.364967 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 08 23:02:32.441437 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.365144 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 08 23:02:32.441437 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.366214 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-rd6zz" Jul 08 23:02:32.441437 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.368103 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-8mcjt" Jul 08 23:02:32.441437 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.369027 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 08 23:02:32.441437 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.369346 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-5d62l\"" Jul 08 23:02:32.441437 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.369372 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 08 23:02:32.441437 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.369579 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 08 23:02:32.441437 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.369819 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/22547ee0-3b85-431f-8552-d324da7a59df-lib-modules\") pod \"tuned-n5f8s\" (UID: \"22547ee0-3b85-431f-8552-d324da7a59df\") " pod="openshift-cluster-node-tuning-operator/tuned-n5f8s" Jul 08 23:02:32.441437 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.369850 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/22547ee0-3b85-431f-8552-d324da7a59df-var-lib-kubelet\") pod \"tuned-n5f8s\" (UID: \"22547ee0-3b85-431f-8552-d324da7a59df\") " pod="openshift-cluster-node-tuning-operator/tuned-n5f8s" Jul 08 23:02:32.441437 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.369874 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a5263de3-74ad-4282-a8c2-68d99202547b-os-release\") pod \"multus-mbgq5\" (UID: \"a5263de3-74ad-4282-a8c2-68d99202547b\") " pod="openshift-multus/multus-mbgq5" Jul 08 23:02:32.441437 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.369901 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a5263de3-74ad-4282-a8c2-68d99202547b-host-var-lib-cni-multus\") pod \"multus-mbgq5\" (UID: \"a5263de3-74ad-4282-a8c2-68d99202547b\") " pod="openshift-multus/multus-mbgq5" Jul 08 23:02:32.441437 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.369930 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b8a428fb-e40d-437f-ae4d-ecd7141e03a5-konnectivity-ca\") pod \"konnectivity-agent-tmmqj\" (UID: \"b8a428fb-e40d-437f-ae4d-ecd7141e03a5\") " pod="kube-system/konnectivity-agent-tmmqj" Jul 08 23:02:32.441437 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.369953 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a5263de3-74ad-4282-a8c2-68d99202547b-host-run-k8s-cni-cncf-io\") pod \"multus-mbgq5\" (UID: \"a5263de3-74ad-4282-a8c2-68d99202547b\") " pod="openshift-multus/multus-mbgq5" Jul 08 23:02:32.441437 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.369978 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7d4ee776-7adc-4068-917b-e4c017076d4d-system-cni-dir\") pod \"multus-additional-cni-plugins-wwbc6\" (UID: \"7d4ee776-7adc-4068-917b-e4c017076d4d\") " pod="openshift-multus/multus-additional-cni-plugins-wwbc6" Jul 08 23:02:32.441437 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.370001 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/22547ee0-3b85-431f-8552-d324da7a59df-etc-modprobe-d\") pod \"tuned-n5f8s\" (UID: \"22547ee0-3b85-431f-8552-d324da7a59df\") " pod="openshift-cluster-node-tuning-operator/tuned-n5f8s" Jul 08 23:02:32.441437 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.370026 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/22547ee0-3b85-431f-8552-d324da7a59df-run\") pod \"tuned-n5f8s\" (UID: \"22547ee0-3b85-431f-8552-d324da7a59df\") " pod="openshift-cluster-node-tuning-operator/tuned-n5f8s" Jul 08 23:02:32.441437 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.370050 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a5263de3-74ad-4282-a8c2-68d99202547b-etc-kubernetes\") pod \"multus-mbgq5\" (UID: \"a5263de3-74ad-4282-a8c2-68d99202547b\") " pod="openshift-multus/multus-mbgq5" Jul 08 23:02:32.441437 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.370074 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/38442020-34ab-4cdf-a0e8-af93e6c046e1-host\") pod \"node-ca-wkdzq\" (UID: \"38442020-34ab-4cdf-a0e8-af93e6c046e1\") " pod="openshift-image-registry/node-ca-wkdzq" Jul 08 23:02:32.441437 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.370099 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a9d05e92-6b0d-4ae2-8c1a-699f40fed3fa-device-dir\") pod \"aws-ebs-csi-driver-node-sf9lt\" (UID: \"a9d05e92-6b0d-4ae2-8c1a-699f40fed3fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sf9lt" Jul 08 23:02:32.441437 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.370139 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a5263de3-74ad-4282-a8c2-68d99202547b-hostroot\") pod \"multus-mbgq5\" (UID: \"a5263de3-74ad-4282-a8c2-68d99202547b\") " pod="openshift-multus/multus-mbgq5" Jul 08 23:02:32.443724 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.370164 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rnjsm\" (UniqueName: \"kubernetes.io/projected/38442020-34ab-4cdf-a0e8-af93e6c046e1-kube-api-access-rnjsm\") pod \"node-ca-wkdzq\" (UID: \"38442020-34ab-4cdf-a0e8-af93e6c046e1\") " pod="openshift-image-registry/node-ca-wkdzq" Jul 08 23:02:32.443724 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.370204 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/22547ee0-3b85-431f-8552-d324da7a59df-etc-systemd\") pod \"tuned-n5f8s\" (UID: \"22547ee0-3b85-431f-8552-d324da7a59df\") " pod="openshift-cluster-node-tuning-operator/tuned-n5f8s" Jul 08 23:02:32.443724 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.370228 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/da74ec55-7cda-4f1a-ba6d-0b4222b5fcb5-dbus\") pod \"global-pull-secret-syncer-gggnj\" (UID: \"da74ec55-7cda-4f1a-ba6d-0b4222b5fcb5\") " pod="kube-system/global-pull-secret-syncer-gggnj" Jul 08 23:02:32.443724 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.370254 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a5263de3-74ad-4282-a8c2-68d99202547b-host-run-multus-certs\") pod \"multus-mbgq5\" (UID: \"a5263de3-74ad-4282-a8c2-68d99202547b\") " pod="openshift-multus/multus-mbgq5" Jul 08 23:02:32.443724 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.370283 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/38442020-34ab-4cdf-a0e8-af93e6c046e1-serviceca\") pod \"node-ca-wkdzq\" (UID: \"38442020-34ab-4cdf-a0e8-af93e6c046e1\") " pod="openshift-image-registry/node-ca-wkdzq" Jul 08 23:02:32.443724 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.370323 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7d4ee776-7adc-4068-917b-e4c017076d4d-cni-binary-copy\") pod \"multus-additional-cni-plugins-wwbc6\" (UID: \"7d4ee776-7adc-4068-917b-e4c017076d4d\") " pod="openshift-multus/multus-additional-cni-plugins-wwbc6" Jul 08 23:02:32.443724 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.370376 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7d4ee776-7adc-4068-917b-e4c017076d4d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wwbc6\" (UID: \"7d4ee776-7adc-4068-917b-e4c017076d4d\") " pod="openshift-multus/multus-additional-cni-plugins-wwbc6" Jul 08 23:02:32.443724 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.370416 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a5263de3-74ad-4282-a8c2-68d99202547b-host-var-lib-cni-bin\") pod \"multus-mbgq5\" (UID: \"a5263de3-74ad-4282-a8c2-68d99202547b\") " pod="openshift-multus/multus-mbgq5" Jul 08 23:02:32.443724 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.370457 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a5263de3-74ad-4282-a8c2-68d99202547b-multus-daemon-config\") pod \"multus-mbgq5\" (UID: \"a5263de3-74ad-4282-a8c2-68d99202547b\") " pod="openshift-multus/multus-mbgq5" Jul 08 23:02:32.443724 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.370483 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b8a428fb-e40d-437f-ae4d-ecd7141e03a5-agent-certs\") pod \"konnectivity-agent-tmmqj\" (UID: \"b8a428fb-e40d-437f-ae4d-ecd7141e03a5\") " pod="kube-system/konnectivity-agent-tmmqj" Jul 08 23:02:32.443724 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.370509 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6zd8m\" (UniqueName: \"kubernetes.io/projected/7d4ee776-7adc-4068-917b-e4c017076d4d-kube-api-access-6zd8m\") pod \"multus-additional-cni-plugins-wwbc6\" (UID: \"7d4ee776-7adc-4068-917b-e4c017076d4d\") " pod="openshift-multus/multus-additional-cni-plugins-wwbc6" Jul 08 23:02:32.443724 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.370521 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 08 23:02:32.443724 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.370533 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/22547ee0-3b85-431f-8552-d324da7a59df-tmp\") pod \"tuned-n5f8s\" (UID: \"22547ee0-3b85-431f-8552-d324da7a59df\") " pod="openshift-cluster-node-tuning-operator/tuned-n5f8s" Jul 08 23:02:32.443724 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.370557 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7x64b\" (UniqueName: \"kubernetes.io/projected/22547ee0-3b85-431f-8552-d324da7a59df-kube-api-access-7x64b\") pod \"tuned-n5f8s\" (UID: \"22547ee0-3b85-431f-8552-d324da7a59df\") " pod="openshift-cluster-node-tuning-operator/tuned-n5f8s" Jul 08 23:02:32.443724 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.370599 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/da74ec55-7cda-4f1a-ba6d-0b4222b5fcb5-kubelet-config\") pod \"global-pull-secret-syncer-gggnj\" (UID: \"da74ec55-7cda-4f1a-ba6d-0b4222b5fcb5\") " pod="kube-system/global-pull-secret-syncer-gggnj" Jul 08 23:02:32.443724 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.370625 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7d4ee776-7adc-4068-917b-e4c017076d4d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wwbc6\" (UID: \"7d4ee776-7adc-4068-917b-e4c017076d4d\") " pod="openshift-multus/multus-additional-cni-plugins-wwbc6" Jul 08 23:02:32.443724 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.370649 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sv77x\" (UniqueName: \"kubernetes.io/projected/a9d05e92-6b0d-4ae2-8c1a-699f40fed3fa-kube-api-access-sv77x\") pod \"aws-ebs-csi-driver-node-sf9lt\" (UID: \"a9d05e92-6b0d-4ae2-8c1a-699f40fed3fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sf9lt" Jul 08 23:02:32.444816 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.370677 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/22547ee0-3b85-431f-8552-d324da7a59df-etc-sysctl-conf\") pod \"tuned-n5f8s\" (UID: \"22547ee0-3b85-431f-8552-d324da7a59df\") " pod="openshift-cluster-node-tuning-operator/tuned-n5f8s" Jul 08 23:02:32.444816 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.370720 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a5263de3-74ad-4282-a8c2-68d99202547b-host-var-lib-kubelet\") pod \"multus-mbgq5\" (UID: \"a5263de3-74ad-4282-a8c2-68d99202547b\") " pod="openshift-multus/multus-mbgq5" Jul 08 23:02:32.444816 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.370746 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q6b7p\" (UniqueName: \"kubernetes.io/projected/994c671c-e4ec-474c-94fa-53f4cab24a16-kube-api-access-q6b7p\") pod \"network-check-target-264tg\" (UID: \"994c671c-e4ec-474c-94fa-53f4cab24a16\") " pod="openshift-network-diagnostics/network-check-target-264tg" Jul 08 23:02:32.444816 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.370769 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a9d05e92-6b0d-4ae2-8c1a-699f40fed3fa-kubelet-dir\") pod \"aws-ebs-csi-driver-node-sf9lt\" (UID: \"a9d05e92-6b0d-4ae2-8c1a-699f40fed3fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sf9lt" Jul 08 23:02:32.444816 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.370793 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a9d05e92-6b0d-4ae2-8c1a-699f40fed3fa-socket-dir\") pod \"aws-ebs-csi-driver-node-sf9lt\" (UID: \"a9d05e92-6b0d-4ae2-8c1a-699f40fed3fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sf9lt" Jul 08 23:02:32.444816 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.370830 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/22547ee0-3b85-431f-8552-d324da7a59df-etc-tuned\") pod \"tuned-n5f8s\" (UID: \"22547ee0-3b85-431f-8552-d324da7a59df\") " pod="openshift-cluster-node-tuning-operator/tuned-n5f8s" Jul 08 23:02:32.444816 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.370871 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a5263de3-74ad-4282-a8c2-68d99202547b-multus-cni-dir\") pod \"multus-mbgq5\" (UID: \"a5263de3-74ad-4282-a8c2-68d99202547b\") " pod="openshift-multus/multus-mbgq5" Jul 08 23:02:32.444816 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.370896 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7d4ee776-7adc-4068-917b-e4c017076d4d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wwbc6\" (UID: \"7d4ee776-7adc-4068-917b-e4c017076d4d\") " pod="openshift-multus/multus-additional-cni-plugins-wwbc6" Jul 08 23:02:32.444816 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.370922 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a9d05e92-6b0d-4ae2-8c1a-699f40fed3fa-sys-fs\") pod \"aws-ebs-csi-driver-node-sf9lt\" (UID: \"a9d05e92-6b0d-4ae2-8c1a-699f40fed3fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sf9lt" Jul 08 23:02:32.444816 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.370946 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/22547ee0-3b85-431f-8552-d324da7a59df-etc-kubernetes\") pod \"tuned-n5f8s\" (UID: \"22547ee0-3b85-431f-8552-d324da7a59df\") " pod="openshift-cluster-node-tuning-operator/tuned-n5f8s" Jul 08 23:02:32.444816 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.370972 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a5263de3-74ad-4282-a8c2-68d99202547b-multus-conf-dir\") pod \"multus-mbgq5\" (UID: \"a5263de3-74ad-4282-a8c2-68d99202547b\") " pod="openshift-multus/multus-mbgq5" Jul 08 23:02:32.444816 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.370997 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/22547ee0-3b85-431f-8552-d324da7a59df-host\") pod \"tuned-n5f8s\" (UID: \"22547ee0-3b85-431f-8552-d324da7a59df\") " pod="openshift-cluster-node-tuning-operator/tuned-n5f8s" Jul 08 23:02:32.444816 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.371003 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-89jz2\"" Jul 08 23:02:32.444816 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.371023 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a5263de3-74ad-4282-a8c2-68d99202547b-cni-binary-copy\") pod \"multus-mbgq5\" (UID: \"a5263de3-74ad-4282-a8c2-68d99202547b\") " pod="openshift-multus/multus-mbgq5" Jul 08 23:02:32.444816 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.371050 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7d4ee776-7adc-4068-917b-e4c017076d4d-cnibin\") pod \"multus-additional-cni-plugins-wwbc6\" (UID: \"7d4ee776-7adc-4068-917b-e4c017076d4d\") " pod="openshift-multus/multus-additional-cni-plugins-wwbc6" Jul 08 23:02:32.444816 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.371077 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7d4ee776-7adc-4068-917b-e4c017076d4d-os-release\") pod \"multus-additional-cni-plugins-wwbc6\" (UID: \"7d4ee776-7adc-4068-917b-e4c017076d4d\") " pod="openshift-multus/multus-additional-cni-plugins-wwbc6" Jul 08 23:02:32.444816 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.371084 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 08 23:02:32.445881 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.371108 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a5263de3-74ad-4282-a8c2-68d99202547b-cnibin\") pod \"multus-mbgq5\" (UID: \"a5263de3-74ad-4282-a8c2-68d99202547b\") " pod="openshift-multus/multus-mbgq5" Jul 08 23:02:32.445881 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.371134 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chz8n\" (UniqueName: \"kubernetes.io/projected/a5263de3-74ad-4282-a8c2-68d99202547b-kube-api-access-chz8n\") pod \"multus-mbgq5\" (UID: \"a5263de3-74ad-4282-a8c2-68d99202547b\") " pod="openshift-multus/multus-mbgq5" Jul 08 23:02:32.445881 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.371170 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 08 23:02:32.445881 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.371172 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a9d05e92-6b0d-4ae2-8c1a-699f40fed3fa-registration-dir\") pod \"aws-ebs-csi-driver-node-sf9lt\" (UID: \"a9d05e92-6b0d-4ae2-8c1a-699f40fed3fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sf9lt" Jul 08 23:02:32.445881 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.371200 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a9d05e92-6b0d-4ae2-8c1a-699f40fed3fa-etc-selinux\") pod \"aws-ebs-csi-driver-node-sf9lt\" (UID: \"a9d05e92-6b0d-4ae2-8c1a-699f40fed3fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sf9lt" Jul 08 23:02:32.445881 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.371230 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/22547ee0-3b85-431f-8552-d324da7a59df-etc-sysctl-d\") pod \"tuned-n5f8s\" (UID: \"22547ee0-3b85-431f-8552-d324da7a59df\") " pod="openshift-cluster-node-tuning-operator/tuned-n5f8s" Jul 08 23:02:32.445881 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.371260 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/da74ec55-7cda-4f1a-ba6d-0b4222b5fcb5-original-pull-secret\") pod \"global-pull-secret-syncer-gggnj\" (UID: \"da74ec55-7cda-4f1a-ba6d-0b4222b5fcb5\") " pod="kube-system/global-pull-secret-syncer-gggnj" Jul 08 23:02:32.445881 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.371290 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a5263de3-74ad-4282-a8c2-68d99202547b-host-run-netns\") pod \"multus-mbgq5\" (UID: \"a5263de3-74ad-4282-a8c2-68d99202547b\") " pod="openshift-multus/multus-mbgq5" Jul 08 23:02:32.445881 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.371326 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/22547ee0-3b85-431f-8552-d324da7a59df-etc-sysconfig\") pod \"tuned-n5f8s\" (UID: \"22547ee0-3b85-431f-8552-d324da7a59df\") " pod="openshift-cluster-node-tuning-operator/tuned-n5f8s" Jul 08 23:02:32.445881 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.371445 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/22547ee0-3b85-431f-8552-d324da7a59df-sys\") pod \"tuned-n5f8s\" (UID: \"22547ee0-3b85-431f-8552-d324da7a59df\") " pod="openshift-cluster-node-tuning-operator/tuned-n5f8s" Jul 08 23:02:32.445881 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.371463 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a5263de3-74ad-4282-a8c2-68d99202547b-system-cni-dir\") pod \"multus-mbgq5\" (UID: \"a5263de3-74ad-4282-a8c2-68d99202547b\") " pod="openshift-multus/multus-mbgq5" Jul 08 23:02:32.445881 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.371481 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a5263de3-74ad-4282-a8c2-68d99202547b-multus-socket-dir-parent\") pod \"multus-mbgq5\" (UID: \"a5263de3-74ad-4282-a8c2-68d99202547b\") " pod="openshift-multus/multus-mbgq5" Jul 08 23:02:32.445881 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.371502 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 08 23:02:32.445881 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.371615 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 08 23:02:32.445881 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.372369 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 08 23:02:32.445881 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.372655 2574 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 08 23:02:32.445881 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.390164 2574 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-n879h" Jul 08 23:02:32.445881 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.401003 2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-n879h" Jul 08 23:02:32.458920 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.458131 2574 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 08 23:02:32.530443 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.473191 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/22547ee0-3b85-431f-8552-d324da7a59df-etc-sysconfig\") pod \"tuned-n5f8s\" (UID: \"22547ee0-3b85-431f-8552-d324da7a59df\") " pod="openshift-cluster-node-tuning-operator/tuned-n5f8s" Jul 08 23:02:32.530443 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.473228 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/22547ee0-3b85-431f-8552-d324da7a59df-sys\") pod \"tuned-n5f8s\" (UID: \"22547ee0-3b85-431f-8552-d324da7a59df\") " pod="openshift-cluster-node-tuning-operator/tuned-n5f8s" Jul 08 23:02:32.530443 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.473256 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a5263de3-74ad-4282-a8c2-68d99202547b-system-cni-dir\") pod \"multus-mbgq5\" (UID: \"a5263de3-74ad-4282-a8c2-68d99202547b\") " pod="openshift-multus/multus-mbgq5" Jul 08 23:02:32.530443 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.473282 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a5263de3-74ad-4282-a8c2-68d99202547b-multus-socket-dir-parent\") pod \"multus-mbgq5\" (UID: \"a5263de3-74ad-4282-a8c2-68d99202547b\") " pod="openshift-multus/multus-mbgq5" Jul 08 23:02:32.530443 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.473310 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/82783d98-33c2-4050-b38f-5ba0a9701953-var-lib-openvswitch\") pod \"ovnkube-node-8mcjt\" (UID: \"82783d98-33c2-4050-b38f-5ba0a9701953\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mcjt" Jul 08 23:02:32.530443 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.473337 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ns2qw\" (UniqueName: \"kubernetes.io/projected/82783d98-33c2-4050-b38f-5ba0a9701953-kube-api-access-ns2qw\") pod \"ovnkube-node-8mcjt\" (UID: \"82783d98-33c2-4050-b38f-5ba0a9701953\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mcjt" Jul 08 23:02:32.530443 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.473364 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/22547ee0-3b85-431f-8552-d324da7a59df-lib-modules\") pod \"tuned-n5f8s\" (UID: \"22547ee0-3b85-431f-8552-d324da7a59df\") " pod="openshift-cluster-node-tuning-operator/tuned-n5f8s" Jul 08 23:02:32.530443 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.473388 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/22547ee0-3b85-431f-8552-d324da7a59df-var-lib-kubelet\") pod \"tuned-n5f8s\" (UID: \"22547ee0-3b85-431f-8552-d324da7a59df\") " pod="openshift-cluster-node-tuning-operator/tuned-n5f8s" Jul 08 23:02:32.530443 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.473413 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a5263de3-74ad-4282-a8c2-68d99202547b-os-release\") pod \"multus-mbgq5\" (UID: \"a5263de3-74ad-4282-a8c2-68d99202547b\") " pod="openshift-multus/multus-mbgq5" Jul 08 23:02:32.530443 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.473438 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a5263de3-74ad-4282-a8c2-68d99202547b-host-var-lib-cni-multus\") pod \"multus-mbgq5\" (UID: \"a5263de3-74ad-4282-a8c2-68d99202547b\") " pod="openshift-multus/multus-mbgq5" Jul 08 23:02:32.530443 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.473467 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bfaa3f60-05b5-436b-9c10-324361b4bae0-metrics-certs\") pod \"network-metrics-daemon-wj6vf\" (UID: \"bfaa3f60-05b5-436b-9c10-324361b4bae0\") " pod="openshift-multus/network-metrics-daemon-wj6vf" Jul 08 23:02:32.530443 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.473496 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2l5q5\" (UniqueName: \"kubernetes.io/projected/bfaa3f60-05b5-436b-9c10-324361b4bae0-kube-api-access-2l5q5\") pod \"network-metrics-daemon-wj6vf\" (UID: \"bfaa3f60-05b5-436b-9c10-324361b4bae0\") " pod="openshift-multus/network-metrics-daemon-wj6vf" Jul 08 23:02:32.530443 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.473525 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/afe09ce0-02a0-4d20-900c-346952958fc5-host-slash\") pod \"iptables-alerter-rd6zz\" (UID: \"afe09ce0-02a0-4d20-900c-346952958fc5\") " pod="openshift-network-operator/iptables-alerter-rd6zz" Jul 08 23:02:32.530443 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.473551 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fz2ht\" (UniqueName: \"kubernetes.io/projected/afe09ce0-02a0-4d20-900c-346952958fc5-kube-api-access-fz2ht\") pod \"iptables-alerter-rd6zz\" (UID: \"afe09ce0-02a0-4d20-900c-346952958fc5\") " pod="openshift-network-operator/iptables-alerter-rd6zz" Jul 08 23:02:32.530443 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.473577 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b8a428fb-e40d-437f-ae4d-ecd7141e03a5-konnectivity-ca\") pod \"konnectivity-agent-tmmqj\" (UID: \"b8a428fb-e40d-437f-ae4d-ecd7141e03a5\") " pod="kube-system/konnectivity-agent-tmmqj" Jul 08 23:02:32.530443 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.473627 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a5263de3-74ad-4282-a8c2-68d99202547b-host-run-k8s-cni-cncf-io\") pod \"multus-mbgq5\" (UID: \"a5263de3-74ad-4282-a8c2-68d99202547b\") " pod="openshift-multus/multus-mbgq5" Jul 08 23:02:32.530443 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.473652 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/82783d98-33c2-4050-b38f-5ba0a9701953-host-run-ovn-kubernetes\") pod \"ovnkube-node-8mcjt\" (UID: \"82783d98-33c2-4050-b38f-5ba0a9701953\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mcjt" Jul 08 23:02:32.531625 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.473678 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/82783d98-33c2-4050-b38f-5ba0a9701953-ovnkube-script-lib\") pod \"ovnkube-node-8mcjt\" (UID: \"82783d98-33c2-4050-b38f-5ba0a9701953\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mcjt" Jul 08 23:02:32.531625 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.473700 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/025aa4fb-e602-4ca7-ab4d-982dbbfbea11-tmp-dir\") pod \"node-resolver-b9mrk\" (UID: \"025aa4fb-e602-4ca7-ab4d-982dbbfbea11\") " pod="openshift-dns/node-resolver-b9mrk" Jul 08 23:02:32.531625 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.473726 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7d4ee776-7adc-4068-917b-e4c017076d4d-system-cni-dir\") pod \"multus-additional-cni-plugins-wwbc6\" (UID: \"7d4ee776-7adc-4068-917b-e4c017076d4d\") " pod="openshift-multus/multus-additional-cni-plugins-wwbc6" Jul 08 23:02:32.531625 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.473766 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/22547ee0-3b85-431f-8552-d324da7a59df-etc-modprobe-d\") pod \"tuned-n5f8s\" (UID: \"22547ee0-3b85-431f-8552-d324da7a59df\") " pod="openshift-cluster-node-tuning-operator/tuned-n5f8s" Jul 08 23:02:32.531625 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.473790 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/22547ee0-3b85-431f-8552-d324da7a59df-run\") pod \"tuned-n5f8s\" (UID: \"22547ee0-3b85-431f-8552-d324da7a59df\") " pod="openshift-cluster-node-tuning-operator/tuned-n5f8s" Jul 08 23:02:32.531625 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.473854 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a5263de3-74ad-4282-a8c2-68d99202547b-host-var-lib-cni-multus\") pod \"multus-mbgq5\" (UID: \"a5263de3-74ad-4282-a8c2-68d99202547b\") " pod="openshift-multus/multus-mbgq5" Jul 08 23:02:32.531625 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.473888 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a5263de3-74ad-4282-a8c2-68d99202547b-etc-kubernetes\") pod \"multus-mbgq5\" (UID: \"a5263de3-74ad-4282-a8c2-68d99202547b\") " pod="openshift-multus/multus-mbgq5" Jul 08 23:02:32.531625 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.473925 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/82783d98-33c2-4050-b38f-5ba0a9701953-host-cni-bin\") pod \"ovnkube-node-8mcjt\" (UID: \"82783d98-33c2-4050-b38f-5ba0a9701953\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mcjt" Jul 08 23:02:32.531625 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.473952 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/22547ee0-3b85-431f-8552-d324da7a59df-run\") pod \"tuned-n5f8s\" (UID: \"22547ee0-3b85-431f-8552-d324da7a59df\") " pod="openshift-cluster-node-tuning-operator/tuned-n5f8s" Jul 08 23:02:32.531625 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.473993 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/38442020-34ab-4cdf-a0e8-af93e6c046e1-host\") pod \"node-ca-wkdzq\" (UID: \"38442020-34ab-4cdf-a0e8-af93e6c046e1\") " pod="openshift-image-registry/node-ca-wkdzq" Jul 08 23:02:32.531625 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.474005 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/22547ee0-3b85-431f-8552-d324da7a59df-etc-sysconfig\") pod \"tuned-n5f8s\" (UID: \"22547ee0-3b85-431f-8552-d324da7a59df\") " pod="openshift-cluster-node-tuning-operator/tuned-n5f8s" Jul 08 23:02:32.531625 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.474054 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/22547ee0-3b85-431f-8552-d324da7a59df-sys\") pod \"tuned-n5f8s\" (UID: \"22547ee0-3b85-431f-8552-d324da7a59df\") " pod="openshift-cluster-node-tuning-operator/tuned-n5f8s" Jul 08 23:02:32.531625 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.474102 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a5263de3-74ad-4282-a8c2-68d99202547b-system-cni-dir\") pod \"multus-mbgq5\" (UID: \"a5263de3-74ad-4282-a8c2-68d99202547b\") " pod="openshift-multus/multus-mbgq5" Jul 08 23:02:32.531625 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.474152 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a5263de3-74ad-4282-a8c2-68d99202547b-multus-socket-dir-parent\") pod \"multus-mbgq5\" (UID: \"a5263de3-74ad-4282-a8c2-68d99202547b\") " pod="openshift-multus/multus-mbgq5" Jul 08 23:02:32.531625 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.474283 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/22547ee0-3b85-431f-8552-d324da7a59df-lib-modules\") pod \"tuned-n5f8s\" (UID: \"22547ee0-3b85-431f-8552-d324da7a59df\") " pod="openshift-cluster-node-tuning-operator/tuned-n5f8s" Jul 08 23:02:32.531625 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.474336 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/22547ee0-3b85-431f-8552-d324da7a59df-var-lib-kubelet\") pod \"tuned-n5f8s\" (UID: \"22547ee0-3b85-431f-8552-d324da7a59df\") " pod="openshift-cluster-node-tuning-operator/tuned-n5f8s" Jul 08 23:02:32.531625 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.474397 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a5263de3-74ad-4282-a8c2-68d99202547b-os-release\") pod \"multus-mbgq5\" (UID: \"a5263de3-74ad-4282-a8c2-68d99202547b\") " pod="openshift-multus/multus-mbgq5" Jul 08 23:02:32.531625 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.474436 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a5263de3-74ad-4282-a8c2-68d99202547b-etc-kubernetes\") pod \"multus-mbgq5\" (UID: \"a5263de3-74ad-4282-a8c2-68d99202547b\") " pod="openshift-multus/multus-mbgq5" Jul 08 23:02:32.532928 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.474504 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a5263de3-74ad-4282-a8c2-68d99202547b-host-run-k8s-cni-cncf-io\") pod \"multus-mbgq5\" (UID: \"a5263de3-74ad-4282-a8c2-68d99202547b\") " pod="openshift-multus/multus-mbgq5" Jul 08 23:02:32.532928 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.474606 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b8a428fb-e40d-437f-ae4d-ecd7141e03a5-konnectivity-ca\") pod \"konnectivity-agent-tmmqj\" (UID: \"b8a428fb-e40d-437f-ae4d-ecd7141e03a5\") " pod="kube-system/konnectivity-agent-tmmqj" Jul 08 23:02:32.532928 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.474637 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/22547ee0-3b85-431f-8552-d324da7a59df-etc-modprobe-d\") pod \"tuned-n5f8s\" (UID: \"22547ee0-3b85-431f-8552-d324da7a59df\") " pod="openshift-cluster-node-tuning-operator/tuned-n5f8s" Jul 08 23:02:32.532928 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.473951 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/38442020-34ab-4cdf-a0e8-af93e6c046e1-host\") pod \"node-ca-wkdzq\" (UID: \"38442020-34ab-4cdf-a0e8-af93e6c046e1\") " pod="openshift-image-registry/node-ca-wkdzq" Jul 08 23:02:32.532928 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.474682 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7d4ee776-7adc-4068-917b-e4c017076d4d-system-cni-dir\") pod \"multus-additional-cni-plugins-wwbc6\" (UID: \"7d4ee776-7adc-4068-917b-e4c017076d4d\") " pod="openshift-multus/multus-additional-cni-plugins-wwbc6" Jul 08 23:02:32.532928 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.474690 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a9d05e92-6b0d-4ae2-8c1a-699f40fed3fa-device-dir\") pod \"aws-ebs-csi-driver-node-sf9lt\" (UID: \"a9d05e92-6b0d-4ae2-8c1a-699f40fed3fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sf9lt" Jul 08 23:02:32.532928 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.474716 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a5263de3-74ad-4282-a8c2-68d99202547b-hostroot\") pod \"multus-mbgq5\" (UID: \"a5263de3-74ad-4282-a8c2-68d99202547b\") " pod="openshift-multus/multus-mbgq5" Jul 08 23:02:32.532928 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.474757 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/82783d98-33c2-4050-b38f-5ba0a9701953-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8mcjt\" (UID: \"82783d98-33c2-4050-b38f-5ba0a9701953\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mcjt" Jul 08 23:02:32.532928 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.474768 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a9d05e92-6b0d-4ae2-8c1a-699f40fed3fa-device-dir\") pod \"aws-ebs-csi-driver-node-sf9lt\" (UID: \"a9d05e92-6b0d-4ae2-8c1a-699f40fed3fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sf9lt" Jul 08 23:02:32.532928 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.474788 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rnjsm\" (UniqueName: \"kubernetes.io/projected/38442020-34ab-4cdf-a0e8-af93e6c046e1-kube-api-access-rnjsm\") pod \"node-ca-wkdzq\" (UID: \"38442020-34ab-4cdf-a0e8-af93e6c046e1\") " pod="openshift-image-registry/node-ca-wkdzq" Jul 08 23:02:32.532928 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.474814 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a5263de3-74ad-4282-a8c2-68d99202547b-hostroot\") pod \"multus-mbgq5\" (UID: \"a5263de3-74ad-4282-a8c2-68d99202547b\") " pod="openshift-multus/multus-mbgq5" Jul 08 23:02:32.532928 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.474818 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/22547ee0-3b85-431f-8552-d324da7a59df-etc-systemd\") pod \"tuned-n5f8s\" (UID: \"22547ee0-3b85-431f-8552-d324da7a59df\") " pod="openshift-cluster-node-tuning-operator/tuned-n5f8s" Jul 08 23:02:32.532928 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.474848 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/da74ec55-7cda-4f1a-ba6d-0b4222b5fcb5-dbus\") pod \"global-pull-secret-syncer-gggnj\" (UID: \"da74ec55-7cda-4f1a-ba6d-0b4222b5fcb5\") " pod="kube-system/global-pull-secret-syncer-gggnj" Jul 08 23:02:32.532928 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.474859 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/22547ee0-3b85-431f-8552-d324da7a59df-etc-systemd\") pod \"tuned-n5f8s\" (UID: \"22547ee0-3b85-431f-8552-d324da7a59df\") " pod="openshift-cluster-node-tuning-operator/tuned-n5f8s" Jul 08 23:02:32.532928 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.474875 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a5263de3-74ad-4282-a8c2-68d99202547b-host-run-multus-certs\") pod \"multus-mbgq5\" (UID: \"a5263de3-74ad-4282-a8c2-68d99202547b\") " pod="openshift-multus/multus-mbgq5" Jul 08 23:02:32.532928 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.474902 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/38442020-34ab-4cdf-a0e8-af93e6c046e1-serviceca\") pod \"node-ca-wkdzq\" (UID: \"38442020-34ab-4cdf-a0e8-af93e6c046e1\") " pod="openshift-image-registry/node-ca-wkdzq" Jul 08 23:02:32.532928 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.474925 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7d4ee776-7adc-4068-917b-e4c017076d4d-cni-binary-copy\") pod \"multus-additional-cni-plugins-wwbc6\" (UID: \"7d4ee776-7adc-4068-917b-e4c017076d4d\") " pod="openshift-multus/multus-additional-cni-plugins-wwbc6" Jul 08 23:02:32.534062 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.474950 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7d4ee776-7adc-4068-917b-e4c017076d4d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wwbc6\" (UID: \"7d4ee776-7adc-4068-917b-e4c017076d4d\") " pod="openshift-multus/multus-additional-cni-plugins-wwbc6" Jul 08 23:02:32.534062 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.474980 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a5263de3-74ad-4282-a8c2-68d99202547b-host-var-lib-cni-bin\") pod \"multus-mbgq5\" (UID: \"a5263de3-74ad-4282-a8c2-68d99202547b\") " pod="openshift-multus/multus-mbgq5" Jul 08 23:02:32.534062 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.475002 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a5263de3-74ad-4282-a8c2-68d99202547b-multus-daemon-config\") pod \"multus-mbgq5\" (UID: \"a5263de3-74ad-4282-a8c2-68d99202547b\") " pod="openshift-multus/multus-mbgq5" Jul 08 23:02:32.534062 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.475026 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b8a428fb-e40d-437f-ae4d-ecd7141e03a5-agent-certs\") pod \"konnectivity-agent-tmmqj\" (UID: \"b8a428fb-e40d-437f-ae4d-ecd7141e03a5\") " pod="kube-system/konnectivity-agent-tmmqj" Jul 08 23:02:32.534062 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.475049 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zd8m\" (UniqueName: \"kubernetes.io/projected/7d4ee776-7adc-4068-917b-e4c017076d4d-kube-api-access-6zd8m\") pod \"multus-additional-cni-plugins-wwbc6\" (UID: \"7d4ee776-7adc-4068-917b-e4c017076d4d\") " pod="openshift-multus/multus-additional-cni-plugins-wwbc6" Jul 08 23:02:32.534062 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.475074 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/22547ee0-3b85-431f-8552-d324da7a59df-tmp\") pod \"tuned-n5f8s\" (UID: \"22547ee0-3b85-431f-8552-d324da7a59df\") " pod="openshift-cluster-node-tuning-operator/tuned-n5f8s" Jul 08 23:02:32.534062 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.475098 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7x64b\" (UniqueName: \"kubernetes.io/projected/22547ee0-3b85-431f-8552-d324da7a59df-kube-api-access-7x64b\") pod \"tuned-n5f8s\" (UID: \"22547ee0-3b85-431f-8552-d324da7a59df\") " pod="openshift-cluster-node-tuning-operator/tuned-n5f8s" Jul 08 23:02:32.534062 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.475122 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/da74ec55-7cda-4f1a-ba6d-0b4222b5fcb5-kubelet-config\") pod \"global-pull-secret-syncer-gggnj\" (UID: \"da74ec55-7cda-4f1a-ba6d-0b4222b5fcb5\") " pod="kube-system/global-pull-secret-syncer-gggnj" Jul 08 23:02:32.534062 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.475150 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/82783d98-33c2-4050-b38f-5ba0a9701953-systemd-units\") pod \"ovnkube-node-8mcjt\" (UID: \"82783d98-33c2-4050-b38f-5ba0a9701953\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mcjt" Jul 08 23:02:32.534062 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.475176 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/82783d98-33c2-4050-b38f-5ba0a9701953-host-cni-netd\") pod \"ovnkube-node-8mcjt\" (UID: \"82783d98-33c2-4050-b38f-5ba0a9701953\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mcjt" Jul 08 23:02:32.534062 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.475202 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7d4ee776-7adc-4068-917b-e4c017076d4d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wwbc6\" (UID: \"7d4ee776-7adc-4068-917b-e4c017076d4d\") " pod="openshift-multus/multus-additional-cni-plugins-wwbc6" Jul 08 23:02:32.534062 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.475230 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sv77x\" (UniqueName: \"kubernetes.io/projected/a9d05e92-6b0d-4ae2-8c1a-699f40fed3fa-kube-api-access-sv77x\") pod \"aws-ebs-csi-driver-node-sf9lt\" (UID: \"a9d05e92-6b0d-4ae2-8c1a-699f40fed3fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sf9lt" Jul 08 23:02:32.534062 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.475259 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/afe09ce0-02a0-4d20-900c-346952958fc5-iptables-alerter-script\") pod \"iptables-alerter-rd6zz\" (UID: \"afe09ce0-02a0-4d20-900c-346952958fc5\") " pod="openshift-network-operator/iptables-alerter-rd6zz" Jul 08 23:02:32.534062 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.475308 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/82783d98-33c2-4050-b38f-5ba0a9701953-host-slash\") pod \"ovnkube-node-8mcjt\" (UID: \"82783d98-33c2-4050-b38f-5ba0a9701953\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mcjt" Jul 08 23:02:32.534062 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.475337 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/22547ee0-3b85-431f-8552-d324da7a59df-etc-sysctl-conf\") pod \"tuned-n5f8s\" (UID: \"22547ee0-3b85-431f-8552-d324da7a59df\") " pod="openshift-cluster-node-tuning-operator/tuned-n5f8s" Jul 08 23:02:32.534062 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.475363 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a5263de3-74ad-4282-a8c2-68d99202547b-host-var-lib-kubelet\") pod \"multus-mbgq5\" (UID: \"a5263de3-74ad-4282-a8c2-68d99202547b\") " pod="openshift-multus/multus-mbgq5" Jul 08 23:02:32.534062 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.475388 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/82783d98-33c2-4050-b38f-5ba0a9701953-node-log\") pod \"ovnkube-node-8mcjt\" (UID: \"82783d98-33c2-4050-b38f-5ba0a9701953\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mcjt" Jul 08 23:02:32.535131 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.475413 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/82783d98-33c2-4050-b38f-5ba0a9701953-log-socket\") pod \"ovnkube-node-8mcjt\" (UID: \"82783d98-33c2-4050-b38f-5ba0a9701953\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mcjt" Jul 08 23:02:32.535131 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.475438 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/82783d98-33c2-4050-b38f-5ba0a9701953-env-overrides\") pod \"ovnkube-node-8mcjt\" (UID: \"82783d98-33c2-4050-b38f-5ba0a9701953\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mcjt" Jul 08 23:02:32.535131 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.475465 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q6b7p\" (UniqueName: \"kubernetes.io/projected/994c671c-e4ec-474c-94fa-53f4cab24a16-kube-api-access-q6b7p\") pod \"network-check-target-264tg\" (UID: \"994c671c-e4ec-474c-94fa-53f4cab24a16\") " pod="openshift-network-diagnostics/network-check-target-264tg" Jul 08 23:02:32.535131 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.475497 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a9d05e92-6b0d-4ae2-8c1a-699f40fed3fa-kubelet-dir\") pod \"aws-ebs-csi-driver-node-sf9lt\" (UID: \"a9d05e92-6b0d-4ae2-8c1a-699f40fed3fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sf9lt" Jul 08 23:02:32.535131 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.475526 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a9d05e92-6b0d-4ae2-8c1a-699f40fed3fa-socket-dir\") pod \"aws-ebs-csi-driver-node-sf9lt\" (UID: \"a9d05e92-6b0d-4ae2-8c1a-699f40fed3fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sf9lt" Jul 08 23:02:32.535131 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.475553 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/22547ee0-3b85-431f-8552-d324da7a59df-etc-tuned\") pod \"tuned-n5f8s\" (UID: \"22547ee0-3b85-431f-8552-d324da7a59df\") " pod="openshift-cluster-node-tuning-operator/tuned-n5f8s" Jul 08 23:02:32.535131 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.475602 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a5263de3-74ad-4282-a8c2-68d99202547b-multus-cni-dir\") pod \"multus-mbgq5\" (UID: \"a5263de3-74ad-4282-a8c2-68d99202547b\") " pod="openshift-multus/multus-mbgq5" Jul 08 23:02:32.535131 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.475628 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/82783d98-33c2-4050-b38f-5ba0a9701953-run-systemd\") pod \"ovnkube-node-8mcjt\" (UID: \"82783d98-33c2-4050-b38f-5ba0a9701953\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mcjt" Jul 08 23:02:32.535131 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.475667 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/82783d98-33c2-4050-b38f-5ba0a9701953-run-ovn\") pod \"ovnkube-node-8mcjt\" (UID: \"82783d98-33c2-4050-b38f-5ba0a9701953\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mcjt" Jul 08 23:02:32.535131 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.475706 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qwbpn\" (UniqueName: \"kubernetes.io/projected/025aa4fb-e602-4ca7-ab4d-982dbbfbea11-kube-api-access-qwbpn\") pod \"node-resolver-b9mrk\" (UID: \"025aa4fb-e602-4ca7-ab4d-982dbbfbea11\") " pod="openshift-dns/node-resolver-b9mrk" Jul 08 23:02:32.535131 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.475703 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/da74ec55-7cda-4f1a-ba6d-0b4222b5fcb5-dbus\") pod \"global-pull-secret-syncer-gggnj\" (UID: \"da74ec55-7cda-4f1a-ba6d-0b4222b5fcb5\") " pod="kube-system/global-pull-secret-syncer-gggnj" Jul 08 23:02:32.535131 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.475803 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a5263de3-74ad-4282-a8c2-68d99202547b-host-var-lib-cni-bin\") pod \"multus-mbgq5\" (UID: \"a5263de3-74ad-4282-a8c2-68d99202547b\") " pod="openshift-multus/multus-mbgq5" Jul 08 23:02:32.535131 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.475935 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7d4ee776-7adc-4068-917b-e4c017076d4d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wwbc6\" (UID: \"7d4ee776-7adc-4068-917b-e4c017076d4d\") " pod="openshift-multus/multus-additional-cni-plugins-wwbc6" Jul 08 23:02:32.535131 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.475994 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7d4ee776-7adc-4068-917b-e4c017076d4d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wwbc6\" (UID: \"7d4ee776-7adc-4068-917b-e4c017076d4d\") " pod="openshift-multus/multus-additional-cni-plugins-wwbc6" Jul 08 23:02:32.535131 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.476036 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a9d05e92-6b0d-4ae2-8c1a-699f40fed3fa-sys-fs\") pod \"aws-ebs-csi-driver-node-sf9lt\" (UID: \"a9d05e92-6b0d-4ae2-8c1a-699f40fed3fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sf9lt" Jul 08 23:02:32.535131 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.476067 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/22547ee0-3b85-431f-8552-d324da7a59df-etc-kubernetes\") pod \"tuned-n5f8s\" (UID: \"22547ee0-3b85-431f-8552-d324da7a59df\") " pod="openshift-cluster-node-tuning-operator/tuned-n5f8s" Jul 08 23:02:32.535131 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.476195 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a9d05e92-6b0d-4ae2-8c1a-699f40fed3fa-socket-dir\") pod \"aws-ebs-csi-driver-node-sf9lt\" (UID: \"a9d05e92-6b0d-4ae2-8c1a-699f40fed3fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sf9lt" Jul 08 23:02:32.536128 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.476212 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a5263de3-74ad-4282-a8c2-68d99202547b-host-run-multus-certs\") pod \"multus-mbgq5\" (UID: \"a5263de3-74ad-4282-a8c2-68d99202547b\") " pod="openshift-multus/multus-mbgq5" Jul 08 23:02:32.536128 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.476254 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a5263de3-74ad-4282-a8c2-68d99202547b-multus-conf-dir\") pod \"multus-mbgq5\" (UID: \"a5263de3-74ad-4282-a8c2-68d99202547b\") " pod="openshift-multus/multus-mbgq5" Jul 08 23:02:32.536128 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.476294 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/22547ee0-3b85-431f-8552-d324da7a59df-host\") pod \"tuned-n5f8s\" (UID: \"22547ee0-3b85-431f-8552-d324da7a59df\") " pod="openshift-cluster-node-tuning-operator/tuned-n5f8s" Jul 08 23:02:32.536128 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.476321 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a5263de3-74ad-4282-a8c2-68d99202547b-cni-binary-copy\") pod \"multus-mbgq5\" (UID: \"a5263de3-74ad-4282-a8c2-68d99202547b\") " pod="openshift-multus/multus-mbgq5" Jul 08 23:02:32.536128 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.476347 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/82783d98-33c2-4050-b38f-5ba0a9701953-ovnkube-config\") pod \"ovnkube-node-8mcjt\" (UID: \"82783d98-33c2-4050-b38f-5ba0a9701953\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mcjt" Jul 08 23:02:32.536128 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.476371 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/025aa4fb-e602-4ca7-ab4d-982dbbfbea11-hosts-file\") pod \"node-resolver-b9mrk\" (UID: \"025aa4fb-e602-4ca7-ab4d-982dbbfbea11\") " pod="openshift-dns/node-resolver-b9mrk" Jul 08 23:02:32.536128 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.476394 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7d4ee776-7adc-4068-917b-e4c017076d4d-cnibin\") pod \"multus-additional-cni-plugins-wwbc6\" (UID: \"7d4ee776-7adc-4068-917b-e4c017076d4d\") " pod="openshift-multus/multus-additional-cni-plugins-wwbc6" Jul 08 23:02:32.536128 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.476417 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7d4ee776-7adc-4068-917b-e4c017076d4d-os-release\") pod \"multus-additional-cni-plugins-wwbc6\" (UID: \"7d4ee776-7adc-4068-917b-e4c017076d4d\") " pod="openshift-multus/multus-additional-cni-plugins-wwbc6" Jul 08 23:02:32.536128 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.476443 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/82783d98-33c2-4050-b38f-5ba0a9701953-etc-openvswitch\") pod \"ovnkube-node-8mcjt\" (UID: \"82783d98-33c2-4050-b38f-5ba0a9701953\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mcjt" Jul 08 23:02:32.536128 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.476479 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/82783d98-33c2-4050-b38f-5ba0a9701953-run-openvswitch\") pod \"ovnkube-node-8mcjt\" (UID: \"82783d98-33c2-4050-b38f-5ba0a9701953\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mcjt" Jul 08 23:02:32.536128 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.476507 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a5263de3-74ad-4282-a8c2-68d99202547b-cnibin\") pod \"multus-mbgq5\" (UID: \"a5263de3-74ad-4282-a8c2-68d99202547b\") " pod="openshift-multus/multus-mbgq5" Jul 08 23:02:32.536128 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.476533 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7d4ee776-7adc-4068-917b-e4c017076d4d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wwbc6\" (UID: \"7d4ee776-7adc-4068-917b-e4c017076d4d\") " pod="openshift-multus/multus-additional-cni-plugins-wwbc6" Jul 08 23:02:32.536128 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.476566 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chz8n\" (UniqueName: \"kubernetes.io/projected/a5263de3-74ad-4282-a8c2-68d99202547b-kube-api-access-chz8n\") pod \"multus-mbgq5\" (UID: \"a5263de3-74ad-4282-a8c2-68d99202547b\") " pod="openshift-multus/multus-mbgq5" Jul 08 23:02:32.536128 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.476606 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/82783d98-33c2-4050-b38f-5ba0a9701953-host-kubelet\") pod \"ovnkube-node-8mcjt\" (UID: \"82783d98-33c2-4050-b38f-5ba0a9701953\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mcjt" Jul 08 23:02:32.536128 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.476642 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/82783d98-33c2-4050-b38f-5ba0a9701953-host-run-netns\") pod \"ovnkube-node-8mcjt\" (UID: \"82783d98-33c2-4050-b38f-5ba0a9701953\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mcjt" Jul 08 23:02:32.536128 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.476684 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7d4ee776-7adc-4068-917b-e4c017076d4d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wwbc6\" (UID: \"7d4ee776-7adc-4068-917b-e4c017076d4d\") " pod="openshift-multus/multus-additional-cni-plugins-wwbc6" Jul 08 23:02:32.536128 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.476742 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/82783d98-33c2-4050-b38f-5ba0a9701953-ovn-node-metrics-cert\") pod \"ovnkube-node-8mcjt\" (UID: \"82783d98-33c2-4050-b38f-5ba0a9701953\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mcjt" Jul 08 23:02:32.537313 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.476782 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a9d05e92-6b0d-4ae2-8c1a-699f40fed3fa-registration-dir\") pod \"aws-ebs-csi-driver-node-sf9lt\" (UID: \"a9d05e92-6b0d-4ae2-8c1a-699f40fed3fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sf9lt" Jul 08 23:02:32.537313 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.476818 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a9d05e92-6b0d-4ae2-8c1a-699f40fed3fa-etc-selinux\") pod \"aws-ebs-csi-driver-node-sf9lt\" (UID: \"a9d05e92-6b0d-4ae2-8c1a-699f40fed3fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sf9lt" Jul 08 23:02:32.537313 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.476860 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/22547ee0-3b85-431f-8552-d324da7a59df-etc-sysctl-d\") pod \"tuned-n5f8s\" (UID: \"22547ee0-3b85-431f-8552-d324da7a59df\") " pod="openshift-cluster-node-tuning-operator/tuned-n5f8s" Jul 08 23:02:32.537313 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.476863 2574 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 08 23:02:32.537313 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.476885 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/da74ec55-7cda-4f1a-ba6d-0b4222b5fcb5-original-pull-secret\") pod \"global-pull-secret-syncer-gggnj\" (UID: \"da74ec55-7cda-4f1a-ba6d-0b4222b5fcb5\") " pod="kube-system/global-pull-secret-syncer-gggnj" Jul 08 23:02:32.537313 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.476919 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a5263de3-74ad-4282-a8c2-68d99202547b-host-var-lib-kubelet\") pod \"multus-mbgq5\" (UID: \"a5263de3-74ad-4282-a8c2-68d99202547b\") " pod="openshift-multus/multus-mbgq5" Jul 08 23:02:32.537313 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.476914 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a5263de3-74ad-4282-a8c2-68d99202547b-host-run-netns\") pod \"multus-mbgq5\" (UID: \"a5263de3-74ad-4282-a8c2-68d99202547b\") " pod="openshift-multus/multus-mbgq5" Jul 08 23:02:32.537313 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.477007 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a5263de3-74ad-4282-a8c2-68d99202547b-host-run-netns\") pod \"multus-mbgq5\" (UID: \"a5263de3-74ad-4282-a8c2-68d99202547b\") " pod="openshift-multus/multus-mbgq5" Jul 08 23:02:32.537313 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.477037 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/22547ee0-3b85-431f-8552-d324da7a59df-etc-sysctl-conf\") pod \"tuned-n5f8s\" (UID: \"22547ee0-3b85-431f-8552-d324da7a59df\") " pod="openshift-cluster-node-tuning-operator/tuned-n5f8s" Jul 08 23:02:32.537313 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.477055 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a5263de3-74ad-4282-a8c2-68d99202547b-cnibin\") pod \"multus-mbgq5\" (UID: \"a5263de3-74ad-4282-a8c2-68d99202547b\") " pod="openshift-multus/multus-mbgq5" Jul 08 23:02:32.537313 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.477085 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a9d05e92-6b0d-4ae2-8c1a-699f40fed3fa-kubelet-dir\") pod \"aws-ebs-csi-driver-node-sf9lt\" (UID: \"a9d05e92-6b0d-4ae2-8c1a-699f40fed3fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sf9lt" Jul 08 23:02:32.537313 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.477109 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/22547ee0-3b85-431f-8552-d324da7a59df-etc-kubernetes\") pod \"tuned-n5f8s\" (UID: \"22547ee0-3b85-431f-8552-d324da7a59df\") " pod="openshift-cluster-node-tuning-operator/tuned-n5f8s" Jul 08 23:02:32.537313 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.477195 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a5263de3-74ad-4282-a8c2-68d99202547b-multus-daemon-config\") pod \"multus-mbgq5\" (UID: \"a5263de3-74ad-4282-a8c2-68d99202547b\") " pod="openshift-multus/multus-mbgq5" Jul 08 23:02:32.537313 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.477555 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/38442020-34ab-4cdf-a0e8-af93e6c046e1-serviceca\") pod \"node-ca-wkdzq\" (UID: \"38442020-34ab-4cdf-a0e8-af93e6c046e1\") " pod="openshift-image-registry/node-ca-wkdzq" Jul 08 23:02:32.537313 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.477580 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7d4ee776-7adc-4068-917b-e4c017076d4d-cni-binary-copy\") pod \"multus-additional-cni-plugins-wwbc6\" (UID: \"7d4ee776-7adc-4068-917b-e4c017076d4d\") " pod="openshift-multus/multus-additional-cni-plugins-wwbc6" Jul 08 23:02:32.537313 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.477679 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a5263de3-74ad-4282-a8c2-68d99202547b-multus-conf-dir\") pod \"multus-mbgq5\" (UID: \"a5263de3-74ad-4282-a8c2-68d99202547b\") " pod="openshift-multus/multus-mbgq5" Jul 08 23:02:32.537313 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:02:32.477709 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 23:02:32.537313 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.477733 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/22547ee0-3b85-431f-8552-d324da7a59df-host\") pod \"tuned-n5f8s\" (UID: \"22547ee0-3b85-431f-8552-d324da7a59df\") " pod="openshift-cluster-node-tuning-operator/tuned-n5f8s" Jul 08 23:02:32.538382 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:02:32.477778 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da74ec55-7cda-4f1a-ba6d-0b4222b5fcb5-original-pull-secret podName:da74ec55-7cda-4f1a-ba6d-0b4222b5fcb5 nodeName:}" failed. No retries permitted until 2026-07-08 23:02:32.977749908 +0000 UTC m=+3.026023806 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/da74ec55-7cda-4f1a-ba6d-0b4222b5fcb5-original-pull-secret") pod "global-pull-secret-syncer-gggnj" (UID: "da74ec55-7cda-4f1a-ba6d-0b4222b5fcb5") : object "kube-system"/"original-pull-secret" not registered Jul 08 23:02:32.538382 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.476887 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/da74ec55-7cda-4f1a-ba6d-0b4222b5fcb5-kubelet-config\") pod \"global-pull-secret-syncer-gggnj\" (UID: \"da74ec55-7cda-4f1a-ba6d-0b4222b5fcb5\") " pod="kube-system/global-pull-secret-syncer-gggnj" Jul 08 23:02:32.538382 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.477988 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7d4ee776-7adc-4068-917b-e4c017076d4d-cnibin\") pod \"multus-additional-cni-plugins-wwbc6\" (UID: \"7d4ee776-7adc-4068-917b-e4c017076d4d\") " pod="openshift-multus/multus-additional-cni-plugins-wwbc6" Jul 08 23:02:32.538382 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.478040 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7d4ee776-7adc-4068-917b-e4c017076d4d-os-release\") pod \"multus-additional-cni-plugins-wwbc6\" (UID: \"7d4ee776-7adc-4068-917b-e4c017076d4d\") " pod="openshift-multus/multus-additional-cni-plugins-wwbc6" Jul 08 23:02:32.538382 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.478179 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a5263de3-74ad-4282-a8c2-68d99202547b-cni-binary-copy\") pod \"multus-mbgq5\" (UID: \"a5263de3-74ad-4282-a8c2-68d99202547b\") " pod="openshift-multus/multus-mbgq5" Jul 08 23:02:32.538382 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.478243 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a9d05e92-6b0d-4ae2-8c1a-699f40fed3fa-sys-fs\") pod \"aws-ebs-csi-driver-node-sf9lt\" (UID: \"a9d05e92-6b0d-4ae2-8c1a-699f40fed3fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sf9lt" Jul 08 23:02:32.538382 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.478299 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a5263de3-74ad-4282-a8c2-68d99202547b-multus-cni-dir\") pod \"multus-mbgq5\" (UID: \"a5263de3-74ad-4282-a8c2-68d99202547b\") " pod="openshift-multus/multus-mbgq5" Jul 08 23:02:32.538382 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.478369 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a9d05e92-6b0d-4ae2-8c1a-699f40fed3fa-etc-selinux\") pod \"aws-ebs-csi-driver-node-sf9lt\" (UID: \"a9d05e92-6b0d-4ae2-8c1a-699f40fed3fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sf9lt" Jul 08 23:02:32.538382 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.478401 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/22547ee0-3b85-431f-8552-d324da7a59df-etc-sysctl-d\") pod \"tuned-n5f8s\" (UID: \"22547ee0-3b85-431f-8552-d324da7a59df\") " pod="openshift-cluster-node-tuning-operator/tuned-n5f8s" Jul 08 23:02:32.538382 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.478455 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a9d05e92-6b0d-4ae2-8c1a-699f40fed3fa-registration-dir\") pod \"aws-ebs-csi-driver-node-sf9lt\" (UID: \"a9d05e92-6b0d-4ae2-8c1a-699f40fed3fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sf9lt" Jul 08 23:02:32.538382 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:02:32.482353 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 23:02:32.538382 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:02:32.482375 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 23:02:32.538382 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:02:32.482388 2574 projected.go:196] Error preparing data for projected volume kube-api-access-q6b7p for pod openshift-network-diagnostics/network-check-target-264tg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 23:02:32.538382 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:02:32.482458 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/994c671c-e4ec-474c-94fa-53f4cab24a16-kube-api-access-q6b7p podName:994c671c-e4ec-474c-94fa-53f4cab24a16 nodeName:}" failed. No retries permitted until 2026-07-08 23:02:32.98244205 +0000 UTC m=+3.030715951 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-q6b7p" (UniqueName: "kubernetes.io/projected/994c671c-e4ec-474c-94fa-53f4cab24a16-kube-api-access-q6b7p") pod "network-check-target-264tg" (UID: "994c671c-e4ec-474c-94fa-53f4cab24a16") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 23:02:32.538382 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.487757 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-chz8n\" (UniqueName: \"kubernetes.io/projected/a5263de3-74ad-4282-a8c2-68d99202547b-kube-api-access-chz8n\") pod \"multus-mbgq5\" (UID: \"a5263de3-74ad-4282-a8c2-68d99202547b\") " pod="openshift-multus/multus-mbgq5" Jul 08 23:02:32.538382 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.487972 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-79.ec2.internal" event={"ID":"8e8c734951fb463aee77d0849d578390","Type":"ContainerStarted","Data":"ff2ad5f1875ab551e12b2f600c7c2e6d99ecebb77e2d27887e821b43b4a98c7d"} Jul 08 23:02:32.539288 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.493640 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sv77x\" (UniqueName: \"kubernetes.io/projected/a9d05e92-6b0d-4ae2-8c1a-699f40fed3fa-kube-api-access-sv77x\") pod \"aws-ebs-csi-driver-node-sf9lt\" (UID: \"a9d05e92-6b0d-4ae2-8c1a-699f40fed3fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sf9lt" Jul 08 23:02:32.539288 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.493644 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b8a428fb-e40d-437f-ae4d-ecd7141e03a5-agent-certs\") pod \"konnectivity-agent-tmmqj\" (UID: \"b8a428fb-e40d-437f-ae4d-ecd7141e03a5\") " pod="kube-system/konnectivity-agent-tmmqj" Jul 08 23:02:32.539288 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.493673 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6zd8m\" (UniqueName: \"kubernetes.io/projected/7d4ee776-7adc-4068-917b-e4c017076d4d-kube-api-access-6zd8m\") pod \"multus-additional-cni-plugins-wwbc6\" (UID: \"7d4ee776-7adc-4068-917b-e4c017076d4d\") " pod="openshift-multus/multus-additional-cni-plugins-wwbc6" Jul 08 23:02:32.539288 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.493661 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rnjsm\" (UniqueName: \"kubernetes.io/projected/38442020-34ab-4cdf-a0e8-af93e6c046e1-kube-api-access-rnjsm\") pod \"node-ca-wkdzq\" (UID: \"38442020-34ab-4cdf-a0e8-af93e6c046e1\") " pod="openshift-image-registry/node-ca-wkdzq" Jul 08 23:02:32.539288 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.493956 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/22547ee0-3b85-431f-8552-d324da7a59df-etc-tuned\") pod \"tuned-n5f8s\" (UID: \"22547ee0-3b85-431f-8552-d324da7a59df\") " pod="openshift-cluster-node-tuning-operator/tuned-n5f8s" Jul 08 23:02:32.539288 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.497374 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7x64b\" (UniqueName: \"kubernetes.io/projected/22547ee0-3b85-431f-8552-d324da7a59df-kube-api-access-7x64b\") pod \"tuned-n5f8s\" (UID: \"22547ee0-3b85-431f-8552-d324da7a59df\") " pod="openshift-cluster-node-tuning-operator/tuned-n5f8s" Jul 08 23:02:32.539288 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.497821 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-79.ec2.internal" event={"ID":"25b7acb0a5b1d364918439540aae206c","Type":"ContainerStarted","Data":"88636a13ac92e7455268b2aeb973480c6cb59937ce0056387de6be748fdb3c3e"} Jul 08 23:02:32.539288 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.498932 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/22547ee0-3b85-431f-8552-d324da7a59df-tmp\") pod \"tuned-n5f8s\" (UID: \"22547ee0-3b85-431f-8552-d324da7a59df\") " pod="openshift-cluster-node-tuning-operator/tuned-n5f8s" Jul 08 23:02:32.662354 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.577624 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/82783d98-33c2-4050-b38f-5ba0a9701953-host-kubelet\") pod \"ovnkube-node-8mcjt\" (UID: \"82783d98-33c2-4050-b38f-5ba0a9701953\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mcjt" Jul 08 23:02:32.662354 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.577664 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/82783d98-33c2-4050-b38f-5ba0a9701953-host-run-netns\") pod \"ovnkube-node-8mcjt\" (UID: \"82783d98-33c2-4050-b38f-5ba0a9701953\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mcjt" Jul 08 23:02:32.662354 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.577693 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/82783d98-33c2-4050-b38f-5ba0a9701953-ovn-node-metrics-cert\") pod \"ovnkube-node-8mcjt\" (UID: \"82783d98-33c2-4050-b38f-5ba0a9701953\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mcjt" Jul 08 23:02:32.662354 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.577739 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/82783d98-33c2-4050-b38f-5ba0a9701953-var-lib-openvswitch\") pod \"ovnkube-node-8mcjt\" (UID: \"82783d98-33c2-4050-b38f-5ba0a9701953\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mcjt" Jul 08 23:02:32.662354 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.577764 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ns2qw\" (UniqueName: \"kubernetes.io/projected/82783d98-33c2-4050-b38f-5ba0a9701953-kube-api-access-ns2qw\") pod \"ovnkube-node-8mcjt\" (UID: \"82783d98-33c2-4050-b38f-5ba0a9701953\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mcjt" Jul 08 23:02:32.662354 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.577762 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/82783d98-33c2-4050-b38f-5ba0a9701953-host-kubelet\") pod \"ovnkube-node-8mcjt\" (UID: \"82783d98-33c2-4050-b38f-5ba0a9701953\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mcjt" Jul 08 23:02:32.662354 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.577817 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bfaa3f60-05b5-436b-9c10-324361b4bae0-metrics-certs\") pod \"network-metrics-daemon-wj6vf\" (UID: \"bfaa3f60-05b5-436b-9c10-324361b4bae0\") " pod="openshift-multus/network-metrics-daemon-wj6vf" Jul 08 23:02:32.662354 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.577851 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2l5q5\" (UniqueName: \"kubernetes.io/projected/bfaa3f60-05b5-436b-9c10-324361b4bae0-kube-api-access-2l5q5\") pod \"network-metrics-daemon-wj6vf\" (UID: \"bfaa3f60-05b5-436b-9c10-324361b4bae0\") " pod="openshift-multus/network-metrics-daemon-wj6vf" Jul 08 23:02:32.662354 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.577878 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/afe09ce0-02a0-4d20-900c-346952958fc5-host-slash\") pod \"iptables-alerter-rd6zz\" (UID: \"afe09ce0-02a0-4d20-900c-346952958fc5\") " pod="openshift-network-operator/iptables-alerter-rd6zz" Jul 08 23:02:32.662354 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.577902 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fz2ht\" (UniqueName: \"kubernetes.io/projected/afe09ce0-02a0-4d20-900c-346952958fc5-kube-api-access-fz2ht\") pod \"iptables-alerter-rd6zz\" (UID: \"afe09ce0-02a0-4d20-900c-346952958fc5\") " pod="openshift-network-operator/iptables-alerter-rd6zz" Jul 08 23:02:32.662354 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.577930 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/82783d98-33c2-4050-b38f-5ba0a9701953-host-run-ovn-kubernetes\") pod \"ovnkube-node-8mcjt\" (UID: \"82783d98-33c2-4050-b38f-5ba0a9701953\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mcjt" Jul 08 23:02:32.662354 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.577955 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/82783d98-33c2-4050-b38f-5ba0a9701953-ovnkube-script-lib\") pod \"ovnkube-node-8mcjt\" (UID: \"82783d98-33c2-4050-b38f-5ba0a9701953\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mcjt" Jul 08 23:02:32.662354 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.577980 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/025aa4fb-e602-4ca7-ab4d-982dbbfbea11-tmp-dir\") pod \"node-resolver-b9mrk\" (UID: \"025aa4fb-e602-4ca7-ab4d-982dbbfbea11\") " pod="openshift-dns/node-resolver-b9mrk" Jul 08 23:02:32.662354 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.578005 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/82783d98-33c2-4050-b38f-5ba0a9701953-host-cni-bin\") pod \"ovnkube-node-8mcjt\" (UID: \"82783d98-33c2-4050-b38f-5ba0a9701953\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mcjt" Jul 08 23:02:32.662354 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.578045 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/82783d98-33c2-4050-b38f-5ba0a9701953-host-run-netns\") pod \"ovnkube-node-8mcjt\" (UID: \"82783d98-33c2-4050-b38f-5ba0a9701953\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mcjt" Jul 08 23:02:32.662354 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.578046 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/82783d98-33c2-4050-b38f-5ba0a9701953-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8mcjt\" (UID: \"82783d98-33c2-4050-b38f-5ba0a9701953\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mcjt" Jul 08 23:02:32.662354 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.578093 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/82783d98-33c2-4050-b38f-5ba0a9701953-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8mcjt\" (UID: \"82783d98-33c2-4050-b38f-5ba0a9701953\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mcjt" Jul 08 23:02:32.663524 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.578131 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/82783d98-33c2-4050-b38f-5ba0a9701953-systemd-units\") pod \"ovnkube-node-8mcjt\" (UID: \"82783d98-33c2-4050-b38f-5ba0a9701953\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mcjt" Jul 08 23:02:32.663524 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.578168 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/82783d98-33c2-4050-b38f-5ba0a9701953-host-cni-netd\") pod \"ovnkube-node-8mcjt\" (UID: \"82783d98-33c2-4050-b38f-5ba0a9701953\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mcjt" Jul 08 23:02:32.663524 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:02:32.578187 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 23:02:32.663524 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.578215 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/82783d98-33c2-4050-b38f-5ba0a9701953-host-cni-netd\") pod \"ovnkube-node-8mcjt\" (UID: \"82783d98-33c2-4050-b38f-5ba0a9701953\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mcjt" Jul 08 23:02:32.663524 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.578225 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/82783d98-33c2-4050-b38f-5ba0a9701953-host-run-ovn-kubernetes\") pod \"ovnkube-node-8mcjt\" (UID: \"82783d98-33c2-4050-b38f-5ba0a9701953\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mcjt" Jul 08 23:02:32.663524 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:02:32.578248 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bfaa3f60-05b5-436b-9c10-324361b4bae0-metrics-certs podName:bfaa3f60-05b5-436b-9c10-324361b4bae0 nodeName:}" failed. No retries permitted until 2026-07-08 23:02:33.078229561 +0000 UTC m=+3.126503463 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bfaa3f60-05b5-436b-9c10-324361b4bae0-metrics-certs") pod "network-metrics-daemon-wj6vf" (UID: "bfaa3f60-05b5-436b-9c10-324361b4bae0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 23:02:32.663524 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.578287 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/afe09ce0-02a0-4d20-900c-346952958fc5-host-slash\") pod \"iptables-alerter-rd6zz\" (UID: \"afe09ce0-02a0-4d20-900c-346952958fc5\") " pod="openshift-network-operator/iptables-alerter-rd6zz" Jul 08 23:02:32.663524 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.578671 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/82783d98-33c2-4050-b38f-5ba0a9701953-var-lib-openvswitch\") pod \"ovnkube-node-8mcjt\" (UID: \"82783d98-33c2-4050-b38f-5ba0a9701953\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mcjt" Jul 08 23:02:32.663524 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.578731 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/82783d98-33c2-4050-b38f-5ba0a9701953-host-cni-bin\") pod \"ovnkube-node-8mcjt\" (UID: \"82783d98-33c2-4050-b38f-5ba0a9701953\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mcjt" Jul 08 23:02:32.663524 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.578942 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/82783d98-33c2-4050-b38f-5ba0a9701953-ovnkube-script-lib\") pod \"ovnkube-node-8mcjt\" (UID: \"82783d98-33c2-4050-b38f-5ba0a9701953\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mcjt" Jul 08 23:02:32.663524 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.579042 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/025aa4fb-e602-4ca7-ab4d-982dbbfbea11-tmp-dir\") pod \"node-resolver-b9mrk\" (UID: \"025aa4fb-e602-4ca7-ab4d-982dbbfbea11\") " pod="openshift-dns/node-resolver-b9mrk" Jul 08 23:02:32.663524 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.579055 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/82783d98-33c2-4050-b38f-5ba0a9701953-systemd-units\") pod \"ovnkube-node-8mcjt\" (UID: \"82783d98-33c2-4050-b38f-5ba0a9701953\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mcjt" Jul 08 23:02:32.663524 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.579173 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/afe09ce0-02a0-4d20-900c-346952958fc5-iptables-alerter-script\") pod \"iptables-alerter-rd6zz\" (UID: \"afe09ce0-02a0-4d20-900c-346952958fc5\") " pod="openshift-network-operator/iptables-alerter-rd6zz" Jul 08 23:02:32.663524 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.579207 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/82783d98-33c2-4050-b38f-5ba0a9701953-host-slash\") pod \"ovnkube-node-8mcjt\" (UID: \"82783d98-33c2-4050-b38f-5ba0a9701953\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mcjt" Jul 08 23:02:32.663524 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.579235 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/82783d98-33c2-4050-b38f-5ba0a9701953-node-log\") pod \"ovnkube-node-8mcjt\" (UID: \"82783d98-33c2-4050-b38f-5ba0a9701953\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mcjt" Jul 08 23:02:32.663524 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.579258 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/82783d98-33c2-4050-b38f-5ba0a9701953-log-socket\") pod \"ovnkube-node-8mcjt\" (UID: \"82783d98-33c2-4050-b38f-5ba0a9701953\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mcjt" Jul 08 23:02:32.663524 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.579270 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/82783d98-33c2-4050-b38f-5ba0a9701953-host-slash\") pod \"ovnkube-node-8mcjt\" (UID: \"82783d98-33c2-4050-b38f-5ba0a9701953\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mcjt" Jul 08 23:02:32.664898 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.579283 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/82783d98-33c2-4050-b38f-5ba0a9701953-env-overrides\") pod \"ovnkube-node-8mcjt\" (UID: \"82783d98-33c2-4050-b38f-5ba0a9701953\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mcjt" Jul 08 23:02:32.664898 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.579319 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/82783d98-33c2-4050-b38f-5ba0a9701953-node-log\") pod \"ovnkube-node-8mcjt\" (UID: \"82783d98-33c2-4050-b38f-5ba0a9701953\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mcjt" Jul 08 23:02:32.664898 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.579326 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/82783d98-33c2-4050-b38f-5ba0a9701953-run-systemd\") pod \"ovnkube-node-8mcjt\" (UID: \"82783d98-33c2-4050-b38f-5ba0a9701953\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mcjt" Jul 08 23:02:32.664898 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.579350 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/82783d98-33c2-4050-b38f-5ba0a9701953-run-ovn\") pod \"ovnkube-node-8mcjt\" (UID: \"82783d98-33c2-4050-b38f-5ba0a9701953\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mcjt" Jul 08 23:02:32.664898 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.579359 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/82783d98-33c2-4050-b38f-5ba0a9701953-log-socket\") pod \"ovnkube-node-8mcjt\" (UID: \"82783d98-33c2-4050-b38f-5ba0a9701953\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mcjt" Jul 08 23:02:32.664898 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.579375 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qwbpn\" (UniqueName: \"kubernetes.io/projected/025aa4fb-e602-4ca7-ab4d-982dbbfbea11-kube-api-access-qwbpn\") pod \"node-resolver-b9mrk\" (UID: \"025aa4fb-e602-4ca7-ab4d-982dbbfbea11\") " pod="openshift-dns/node-resolver-b9mrk" Jul 08 23:02:32.664898 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.579404 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/82783d98-33c2-4050-b38f-5ba0a9701953-run-systemd\") pod \"ovnkube-node-8mcjt\" (UID: \"82783d98-33c2-4050-b38f-5ba0a9701953\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mcjt" Jul 08 23:02:32.664898 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.579408 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/82783d98-33c2-4050-b38f-5ba0a9701953-ovnkube-config\") pod \"ovnkube-node-8mcjt\" (UID: \"82783d98-33c2-4050-b38f-5ba0a9701953\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mcjt" Jul 08 23:02:32.664898 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.579434 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/025aa4fb-e602-4ca7-ab4d-982dbbfbea11-hosts-file\") pod \"node-resolver-b9mrk\" (UID: \"025aa4fb-e602-4ca7-ab4d-982dbbfbea11\") " pod="openshift-dns/node-resolver-b9mrk" Jul 08 23:02:32.664898 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.579460 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/82783d98-33c2-4050-b38f-5ba0a9701953-etc-openvswitch\") pod \"ovnkube-node-8mcjt\" (UID: \"82783d98-33c2-4050-b38f-5ba0a9701953\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mcjt" Jul 08 23:02:32.664898 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.579496 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/82783d98-33c2-4050-b38f-5ba0a9701953-run-openvswitch\") pod \"ovnkube-node-8mcjt\" (UID: \"82783d98-33c2-4050-b38f-5ba0a9701953\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mcjt" Jul 08 23:02:32.664898 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.579582 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/82783d98-33c2-4050-b38f-5ba0a9701953-run-openvswitch\") pod \"ovnkube-node-8mcjt\" (UID: \"82783d98-33c2-4050-b38f-5ba0a9701953\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mcjt" Jul 08 23:02:32.664898 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.579631 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/82783d98-33c2-4050-b38f-5ba0a9701953-run-ovn\") pod \"ovnkube-node-8mcjt\" (UID: \"82783d98-33c2-4050-b38f-5ba0a9701953\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mcjt" Jul 08 23:02:32.664898 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.579780 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/82783d98-33c2-4050-b38f-5ba0a9701953-env-overrides\") pod \"ovnkube-node-8mcjt\" (UID: \"82783d98-33c2-4050-b38f-5ba0a9701953\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mcjt" Jul 08 23:02:32.664898 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.579810 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/afe09ce0-02a0-4d20-900c-346952958fc5-iptables-alerter-script\") pod \"iptables-alerter-rd6zz\" (UID: \"afe09ce0-02a0-4d20-900c-346952958fc5\") " pod="openshift-network-operator/iptables-alerter-rd6zz" Jul 08 23:02:32.664898 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.579856 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/025aa4fb-e602-4ca7-ab4d-982dbbfbea11-hosts-file\") pod \"node-resolver-b9mrk\" (UID: \"025aa4fb-e602-4ca7-ab4d-982dbbfbea11\") " pod="openshift-dns/node-resolver-b9mrk" Jul 08 23:02:32.664898 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.579873 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/82783d98-33c2-4050-b38f-5ba0a9701953-etc-openvswitch\") pod \"ovnkube-node-8mcjt\" (UID: \"82783d98-33c2-4050-b38f-5ba0a9701953\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mcjt" Jul 08 23:02:32.664898 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.580271 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/82783d98-33c2-4050-b38f-5ba0a9701953-ovnkube-config\") pod \"ovnkube-node-8mcjt\" (UID: \"82783d98-33c2-4050-b38f-5ba0a9701953\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mcjt" Jul 08 23:02:32.666227 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.582852 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/82783d98-33c2-4050-b38f-5ba0a9701953-ovn-node-metrics-cert\") pod \"ovnkube-node-8mcjt\" (UID: \"82783d98-33c2-4050-b38f-5ba0a9701953\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mcjt" Jul 08 23:02:32.666227 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.595716 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fz2ht\" (UniqueName: \"kubernetes.io/projected/afe09ce0-02a0-4d20-900c-346952958fc5-kube-api-access-fz2ht\") pod \"iptables-alerter-rd6zz\" (UID: \"afe09ce0-02a0-4d20-900c-346952958fc5\") " pod="openshift-network-operator/iptables-alerter-rd6zz" Jul 08 23:02:32.666227 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.595736 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ns2qw\" (UniqueName: \"kubernetes.io/projected/82783d98-33c2-4050-b38f-5ba0a9701953-kube-api-access-ns2qw\") pod \"ovnkube-node-8mcjt\" (UID: \"82783d98-33c2-4050-b38f-5ba0a9701953\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mcjt" Jul 08 23:02:32.666227 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.596186 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2l5q5\" (UniqueName: \"kubernetes.io/projected/bfaa3f60-05b5-436b-9c10-324361b4bae0-kube-api-access-2l5q5\") pod \"network-metrics-daemon-wj6vf\" (UID: \"bfaa3f60-05b5-436b-9c10-324361b4bae0\") " pod="openshift-multus/network-metrics-daemon-wj6vf" Jul 08 23:02:32.666227 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.597182 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwbpn\" (UniqueName: \"kubernetes.io/projected/025aa4fb-e602-4ca7-ab4d-982dbbfbea11-kube-api-access-qwbpn\") pod \"node-resolver-b9mrk\" (UID: \"025aa4fb-e602-4ca7-ab4d-982dbbfbea11\") " pod="openshift-dns/node-resolver-b9mrk" Jul 08 23:02:32.669750 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.668626 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-tmmqj" Jul 08 23:02:32.797368 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.709572 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wkdzq" Jul 08 23:02:32.797368 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.712211 2574 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 23:02:32.797368 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:32.721385 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38442020_34ab_4cdf_a0e8_af93e6c046e1.slice/crio-0668d48a8ab6bc580c0de65cd6c27e8dc5949d17d6505b5e4830b06da5a9f396 WatchSource:0}: Error finding container 0668d48a8ab6bc580c0de65cd6c27e8dc5949d17d6505b5e4830b06da5a9f396: Status 404 returned error can't find the container with id 0668d48a8ab6bc580c0de65cd6c27e8dc5949d17d6505b5e4830b06da5a9f396 Jul 08 23:02:32.797368 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.740813 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-wwbc6" Jul 08 23:02:32.797368 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.748775 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mbgq5" Jul 08 23:02:32.797368 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:32.749067 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d4ee776_7adc_4068_917b_e4c017076d4d.slice/crio-46a9821fd21158ea7a983cb46adfcedcb10d3ebaa347ca4c547730e2355df49e WatchSource:0}: Error finding container 46a9821fd21158ea7a983cb46adfcedcb10d3ebaa347ca4c547730e2355df49e: Status 404 returned error can't find the container with id 46a9821fd21158ea7a983cb46adfcedcb10d3ebaa347ca4c547730e2355df49e Jul 08 23:02:32.797368 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.756216 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sf9lt" Jul 08 23:02:32.797368 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:32.760306 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5263de3_74ad_4282_a8c2_68d99202547b.slice/crio-9e6220c9dcce05f9d65492e8f7c0b97ae31e83e93e2fdcef7d221268d3246c5d WatchSource:0}: Error finding container 9e6220c9dcce05f9d65492e8f7c0b97ae31e83e93e2fdcef7d221268d3246c5d: Status 404 returned error can't find the container with id 9e6220c9dcce05f9d65492e8f7c0b97ae31e83e93e2fdcef7d221268d3246c5d Jul 08 23:02:32.797368 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.764023 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-n5f8s" Jul 08 23:02:32.797368 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:32.773151 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22547ee0_3b85_431f_8552_d324da7a59df.slice/crio-1e6ca1424b592741a46ece9912d567c3502cd2c4faf5893d9b25aaeac91a12a2 WatchSource:0}: Error finding container 1e6ca1424b592741a46ece9912d567c3502cd2c4faf5893d9b25aaeac91a12a2: Status 404 returned error can't find the container with id 1e6ca1424b592741a46ece9912d567c3502cd2c4faf5893d9b25aaeac91a12a2 Jul 08 23:02:32.797368 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.775547 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-b9mrk" Jul 08 23:02:32.797368 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:32.784655 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod025aa4fb_e602_4ca7_ab4d_982dbbfbea11.slice/crio-4239f6b8e9a9e96dea404412723e70b5aa1dc23707f9657c93581426a40f1dd7 WatchSource:0}: Error finding container 4239f6b8e9a9e96dea404412723e70b5aa1dc23707f9657c93581426a40f1dd7: Status 404 returned error can't find the container with id 4239f6b8e9a9e96dea404412723e70b5aa1dc23707f9657c93581426a40f1dd7 Jul 08 23:02:32.917996 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.808445 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-rd6zz" Jul 08 23:02:32.917996 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:32.818563 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podafe09ce0_02a0_4d20_900c_346952958fc5.slice/crio-b56f92be800822660f3b028b1f055cf6e5d3f0f1943e51d89fc13fa469e863d5 WatchSource:0}: Error finding container b56f92be800822660f3b028b1f055cf6e5d3f0f1943e51d89fc13fa469e863d5: Status 404 returned error can't find the container with id b56f92be800822660f3b028b1f055cf6e5d3f0f1943e51d89fc13fa469e863d5 Jul 08 23:02:32.917996 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.829236 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-8mcjt" Jul 08 23:02:32.917996 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:02:32.839756 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82783d98_33c2_4050_b38f_5ba0a9701953.slice/crio-bc5df9482016cca2e0daf9177bcc645e13f04a46eea53d3a87a396807612f240 WatchSource:0}: Error finding container bc5df9482016cca2e0daf9177bcc645e13f04a46eea53d3a87a396807612f240: Status 404 returned error can't find the container with id bc5df9482016cca2e0daf9177bcc645e13f04a46eea53d3a87a396807612f240 Jul 08 23:02:32.992934 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:32.982042 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/da74ec55-7cda-4f1a-ba6d-0b4222b5fcb5-original-pull-secret\") pod \"global-pull-secret-syncer-gggnj\" (UID: \"da74ec55-7cda-4f1a-ba6d-0b4222b5fcb5\") " pod="kube-system/global-pull-secret-syncer-gggnj" Jul 08 23:02:32.992934 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:02:32.982218 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 23:02:32.992934 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:02:32.982313 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da74ec55-7cda-4f1a-ba6d-0b4222b5fcb5-original-pull-secret podName:da74ec55-7cda-4f1a-ba6d-0b4222b5fcb5 nodeName:}" failed. No retries permitted until 2026-07-08 23:02:33.982282696 +0000 UTC m=+4.030556582 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/da74ec55-7cda-4f1a-ba6d-0b4222b5fcb5-original-pull-secret") pod "global-pull-secret-syncer-gggnj" (UID: "da74ec55-7cda-4f1a-ba6d-0b4222b5fcb5") : object "kube-system"/"original-pull-secret" not registered Jul 08 23:02:33.283031 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:33.083053 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q6b7p\" (UniqueName: \"kubernetes.io/projected/994c671c-e4ec-474c-94fa-53f4cab24a16-kube-api-access-q6b7p\") pod \"network-check-target-264tg\" (UID: \"994c671c-e4ec-474c-94fa-53f4cab24a16\") " pod="openshift-network-diagnostics/network-check-target-264tg" Jul 08 23:02:33.283031 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:33.083125 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bfaa3f60-05b5-436b-9c10-324361b4bae0-metrics-certs\") pod \"network-metrics-daemon-wj6vf\" (UID: \"bfaa3f60-05b5-436b-9c10-324361b4bae0\") " pod="openshift-multus/network-metrics-daemon-wj6vf" Jul 08 23:02:33.283031 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:02:33.083225 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 23:02:33.283031 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:02:33.083234 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 23:02:33.283031 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:02:33.083251 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 23:02:33.283031 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:02:33.083262 2574 projected.go:196] Error preparing data for projected volume kube-api-access-q6b7p for pod openshift-network-diagnostics/network-check-target-264tg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 23:02:33.283031 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:02:33.083309 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bfaa3f60-05b5-436b-9c10-324361b4bae0-metrics-certs podName:bfaa3f60-05b5-436b-9c10-324361b4bae0 nodeName:}" failed. No retries permitted until 2026-07-08 23:02:34.083287057 +0000 UTC m=+4.131560949 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bfaa3f60-05b5-436b-9c10-324361b4bae0-metrics-certs") pod "network-metrics-daemon-wj6vf" (UID: "bfaa3f60-05b5-436b-9c10-324361b4bae0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 23:02:33.283031 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:02:33.083329 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/994c671c-e4ec-474c-94fa-53f4cab24a16-kube-api-access-q6b7p podName:994c671c-e4ec-474c-94fa-53f4cab24a16 nodeName:}" failed. No retries permitted until 2026-07-08 23:02:34.083319877 +0000 UTC m=+4.131593763 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-q6b7p" (UniqueName: "kubernetes.io/projected/994c671c-e4ec-474c-94fa-53f4cab24a16-kube-api-access-q6b7p") pod "network-check-target-264tg" (UID: "994c671c-e4ec-474c-94fa-53f4cab24a16") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 23:02:33.403267 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:33.403139 2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-07 22:57:33 +0000 UTC" deadline="2027-12-17 04:25:36.060514638 +0000 UTC" Jul 08 23:02:33.403267 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:33.403218 2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12629h23m2.657301946s" Jul 08 23:02:33.476324 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:33.476284 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wj6vf" Jul 08 23:02:33.476973 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:33.476334 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-264tg" Jul 08 23:02:33.476973 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:02:33.476427 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wj6vf" podUID="bfaa3f60-05b5-436b-9c10-324361b4bae0" Jul 08 23:02:33.476973 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:02:33.476618 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-264tg" podUID="994c671c-e4ec-474c-94fa-53f4cab24a16" Jul 08 23:02:33.501415 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:33.501383 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8mcjt" event={"ID":"82783d98-33c2-4050-b38f-5ba0a9701953","Type":"ContainerStarted","Data":"bc5df9482016cca2e0daf9177bcc645e13f04a46eea53d3a87a396807612f240"} Jul 08 23:02:33.502804 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:33.502769 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-rd6zz" event={"ID":"afe09ce0-02a0-4d20-900c-346952958fc5","Type":"ContainerStarted","Data":"b56f92be800822660f3b028b1f055cf6e5d3f0f1943e51d89fc13fa469e863d5"} Jul 08 23:02:33.504173 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:33.504139 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mbgq5" event={"ID":"a5263de3-74ad-4282-a8c2-68d99202547b","Type":"ContainerStarted","Data":"9e6220c9dcce05f9d65492e8f7c0b97ae31e83e93e2fdcef7d221268d3246c5d"} Jul 08 23:02:33.505382 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:33.505354 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wwbc6" event={"ID":"7d4ee776-7adc-4068-917b-e4c017076d4d","Type":"ContainerStarted","Data":"46a9821fd21158ea7a983cb46adfcedcb10d3ebaa347ca4c547730e2355df49e"} Jul 08 23:02:33.506629 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:33.506604 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-b9mrk" event={"ID":"025aa4fb-e602-4ca7-ab4d-982dbbfbea11","Type":"ContainerStarted","Data":"4239f6b8e9a9e96dea404412723e70b5aa1dc23707f9657c93581426a40f1dd7"} Jul 08 23:02:33.507831 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:33.507805 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-n5f8s" event={"ID":"22547ee0-3b85-431f-8552-d324da7a59df","Type":"ContainerStarted","Data":"1e6ca1424b592741a46ece9912d567c3502cd2c4faf5893d9b25aaeac91a12a2"} Jul 08 23:02:33.509173 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:33.509146 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sf9lt" event={"ID":"a9d05e92-6b0d-4ae2-8c1a-699f40fed3fa","Type":"ContainerStarted","Data":"411355a44bb7ea39c2d1df5806a863b364ae4d413626b0cc303c2a2ef425f4c7"} Jul 08 23:02:33.510416 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:33.510388 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wkdzq" event={"ID":"38442020-34ab-4cdf-a0e8-af93e6c046e1","Type":"ContainerStarted","Data":"0668d48a8ab6bc580c0de65cd6c27e8dc5949d17d6505b5e4830b06da5a9f396"} Jul 08 23:02:33.511574 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:33.511525 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-tmmqj" event={"ID":"b8a428fb-e40d-437f-ae4d-ecd7141e03a5","Type":"ContainerStarted","Data":"36813c1da4b9091a02c572cc5ecefae8bac04a42c0ca2caf27be9417e773a389"} Jul 08 23:02:33.991226 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:33.991189 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/da74ec55-7cda-4f1a-ba6d-0b4222b5fcb5-original-pull-secret\") pod \"global-pull-secret-syncer-gggnj\" (UID: \"da74ec55-7cda-4f1a-ba6d-0b4222b5fcb5\") " pod="kube-system/global-pull-secret-syncer-gggnj" Jul 08 23:02:33.991428 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:02:33.991376 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 23:02:33.991500 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:02:33.991455 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da74ec55-7cda-4f1a-ba6d-0b4222b5fcb5-original-pull-secret podName:da74ec55-7cda-4f1a-ba6d-0b4222b5fcb5 nodeName:}" failed. No retries permitted until 2026-07-08 23:02:35.991433154 +0000 UTC m=+6.039707045 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/da74ec55-7cda-4f1a-ba6d-0b4222b5fcb5-original-pull-secret") pod "global-pull-secret-syncer-gggnj" (UID: "da74ec55-7cda-4f1a-ba6d-0b4222b5fcb5") : object "kube-system"/"original-pull-secret" not registered Jul 08 23:02:34.092531 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:34.092481 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bfaa3f60-05b5-436b-9c10-324361b4bae0-metrics-certs\") pod \"network-metrics-daemon-wj6vf\" (UID: \"bfaa3f60-05b5-436b-9c10-324361b4bae0\") " pod="openshift-multus/network-metrics-daemon-wj6vf" Jul 08 23:02:34.092651 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:34.092582 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q6b7p\" (UniqueName: \"kubernetes.io/projected/994c671c-e4ec-474c-94fa-53f4cab24a16-kube-api-access-q6b7p\") pod \"network-check-target-264tg\" (UID: \"994c671c-e4ec-474c-94fa-53f4cab24a16\") " pod="openshift-network-diagnostics/network-check-target-264tg" Jul 08 23:02:34.092715 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:02:34.092687 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 23:02:34.092769 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:02:34.092719 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 23:02:34.092769 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:02:34.092733 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 23:02:34.092769 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:02:34.092742 2574 projected.go:196] Error preparing data for projected volume kube-api-access-q6b7p for pod openshift-network-diagnostics/network-check-target-264tg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 23:02:34.092769 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:02:34.092754 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bfaa3f60-05b5-436b-9c10-324361b4bae0-metrics-certs podName:bfaa3f60-05b5-436b-9c10-324361b4bae0 nodeName:}" failed. No retries permitted until 2026-07-08 23:02:36.092734796 +0000 UTC m=+6.141008703 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bfaa3f60-05b5-436b-9c10-324361b4bae0-metrics-certs") pod "network-metrics-daemon-wj6vf" (UID: "bfaa3f60-05b5-436b-9c10-324361b4bae0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 23:02:34.093004 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:02:34.092780 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/994c671c-e4ec-474c-94fa-53f4cab24a16-kube-api-access-q6b7p podName:994c671c-e4ec-474c-94fa-53f4cab24a16 nodeName:}" failed. No retries permitted until 2026-07-08 23:02:36.092768486 +0000 UTC m=+6.141042369 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-q6b7p" (UniqueName: "kubernetes.io/projected/994c671c-e4ec-474c-94fa-53f4cab24a16-kube-api-access-q6b7p") pod "network-check-target-264tg" (UID: "994c671c-e4ec-474c-94fa-53f4cab24a16") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 23:02:34.404131 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:34.404038 2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-07 22:57:33 +0000 UTC" deadline="2028-02-01 15:13:09.24160406 +0000 UTC" Jul 08 23:02:34.404131 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:34.404105 2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13744h10m34.837503491s" Jul 08 23:02:34.475767 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:34.475741 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gggnj" Jul 08 23:02:34.475899 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:02:34.475873 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gggnj" podUID="da74ec55-7cda-4f1a-ba6d-0b4222b5fcb5" Jul 08 23:02:34.522232 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:34.522193 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-79.ec2.internal" event={"ID":"8e8c734951fb463aee77d0849d578390","Type":"ContainerStarted","Data":"8561bd2b1c778beeb547fc372bfc03851b81dd9e34095ac65265f76c67ec879d"} Jul 08 23:02:34.528687 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:34.528656 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-79.ec2.internal" event={"ID":"25b7acb0a5b1d364918439540aae206c","Type":"ContainerStarted","Data":"0ff42682061bb2ea51d9242d251c5620351a54e2df7d38282135517dd0d37f42"} Jul 08 23:02:34.560859 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:34.560796 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-79.ec2.internal" podStartSLOduration=2.56077271 podStartE2EDuration="2.56077271s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 23:02:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:02:34.540000087 +0000 UTC m=+4.588273996" watchObservedRunningTime="2026-07-08 23:02:34.56077271 +0000 UTC m=+4.609046620" Jul 08 23:02:35.475655 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:35.475600 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-264tg" Jul 08 23:02:35.475835 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:02:35.475737 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-264tg" podUID="994c671c-e4ec-474c-94fa-53f4cab24a16" Jul 08 23:02:35.476116 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:35.476093 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wj6vf" Jul 08 23:02:35.476274 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:02:35.476220 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wj6vf" podUID="bfaa3f60-05b5-436b-9c10-324361b4bae0" Jul 08 23:02:35.560554 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:35.560517 2574 generic.go:356] "Generic (PLEG): container finished" podID="25b7acb0a5b1d364918439540aae206c" containerID="0ff42682061bb2ea51d9242d251c5620351a54e2df7d38282135517dd0d37f42" exitCode=0 Jul 08 23:02:35.561627 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:35.561550 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-79.ec2.internal" event={"ID":"25b7acb0a5b1d364918439540aae206c","Type":"ContainerDied","Data":"0ff42682061bb2ea51d9242d251c5620351a54e2df7d38282135517dd0d37f42"} Jul 08 23:02:36.008365 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:36.008277 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/da74ec55-7cda-4f1a-ba6d-0b4222b5fcb5-original-pull-secret\") pod \"global-pull-secret-syncer-gggnj\" (UID: \"da74ec55-7cda-4f1a-ba6d-0b4222b5fcb5\") " pod="kube-system/global-pull-secret-syncer-gggnj" Jul 08 23:02:36.008603 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:02:36.008492 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 23:02:36.008603 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:02:36.008583 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da74ec55-7cda-4f1a-ba6d-0b4222b5fcb5-original-pull-secret podName:da74ec55-7cda-4f1a-ba6d-0b4222b5fcb5 nodeName:}" failed. No retries permitted until 2026-07-08 23:02:40.008563092 +0000 UTC m=+10.056836990 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/da74ec55-7cda-4f1a-ba6d-0b4222b5fcb5-original-pull-secret") pod "global-pull-secret-syncer-gggnj" (UID: "da74ec55-7cda-4f1a-ba6d-0b4222b5fcb5") : object "kube-system"/"original-pull-secret" not registered Jul 08 23:02:36.109066 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:36.109026 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q6b7p\" (UniqueName: \"kubernetes.io/projected/994c671c-e4ec-474c-94fa-53f4cab24a16-kube-api-access-q6b7p\") pod \"network-check-target-264tg\" (UID: \"994c671c-e4ec-474c-94fa-53f4cab24a16\") " pod="openshift-network-diagnostics/network-check-target-264tg" Jul 08 23:02:36.109271 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:36.109113 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bfaa3f60-05b5-436b-9c10-324361b4bae0-metrics-certs\") pod \"network-metrics-daemon-wj6vf\" (UID: \"bfaa3f60-05b5-436b-9c10-324361b4bae0\") " pod="openshift-multus/network-metrics-daemon-wj6vf" Jul 08 23:02:36.109271 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:02:36.109255 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 23:02:36.109383 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:02:36.109317 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bfaa3f60-05b5-436b-9c10-324361b4bae0-metrics-certs podName:bfaa3f60-05b5-436b-9c10-324361b4bae0 nodeName:}" failed. No retries permitted until 2026-07-08 23:02:40.109297515 +0000 UTC m=+10.157571417 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bfaa3f60-05b5-436b-9c10-324361b4bae0-metrics-certs") pod "network-metrics-daemon-wj6vf" (UID: "bfaa3f60-05b5-436b-9c10-324361b4bae0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 23:02:36.109782 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:02:36.109759 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 23:02:36.109878 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:02:36.109785 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 23:02:36.109878 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:02:36.109801 2574 projected.go:196] Error preparing data for projected volume kube-api-access-q6b7p for pod openshift-network-diagnostics/network-check-target-264tg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 23:02:36.109878 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:02:36.109849 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/994c671c-e4ec-474c-94fa-53f4cab24a16-kube-api-access-q6b7p podName:994c671c-e4ec-474c-94fa-53f4cab24a16 nodeName:}" failed. No retries permitted until 2026-07-08 23:02:40.10983354 +0000 UTC m=+10.158107446 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-q6b7p" (UniqueName: "kubernetes.io/projected/994c671c-e4ec-474c-94fa-53f4cab24a16-kube-api-access-q6b7p") pod "network-check-target-264tg" (UID: "994c671c-e4ec-474c-94fa-53f4cab24a16") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 23:02:36.478986 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:36.478941 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gggnj" Jul 08 23:02:36.479177 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:02:36.479089 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gggnj" podUID="da74ec55-7cda-4f1a-ba6d-0b4222b5fcb5" Jul 08 23:02:36.582690 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:36.582578 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-79.ec2.internal" event={"ID":"25b7acb0a5b1d364918439540aae206c","Type":"ContainerStarted","Data":"67c478d1c39c581cb9e613534b08bc20d85d2b84247ba1cd82cbd77a4865983b"} Jul 08 23:02:36.599110 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:36.598576 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-79.ec2.internal" podStartSLOduration=4.59855606 podStartE2EDuration="4.59855606s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 23:02:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:02:36.597957493 +0000 UTC m=+6.646231401" watchObservedRunningTime="2026-07-08 23:02:36.59855606 +0000 UTC m=+6.646829967" Jul 08 23:02:37.476431 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:37.476061 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-264tg" Jul 08 23:02:37.476431 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:37.476082 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wj6vf" Jul 08 23:02:37.476431 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:02:37.476203 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-264tg" podUID="994c671c-e4ec-474c-94fa-53f4cab24a16" Jul 08 23:02:37.476431 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:02:37.476351 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wj6vf" podUID="bfaa3f60-05b5-436b-9c10-324361b4bae0" Jul 08 23:02:38.475727 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:38.475693 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gggnj" Jul 08 23:02:38.476256 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:02:38.475833 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gggnj" podUID="da74ec55-7cda-4f1a-ba6d-0b4222b5fcb5" Jul 08 23:02:39.475826 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:39.475740 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-264tg" Jul 08 23:02:39.476299 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:02:39.475885 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-264tg" podUID="994c671c-e4ec-474c-94fa-53f4cab24a16" Jul 08 23:02:39.476299 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:39.475954 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wj6vf" Jul 08 23:02:39.476299 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:02:39.476065 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wj6vf" podUID="bfaa3f60-05b5-436b-9c10-324361b4bae0" Jul 08 23:02:40.043347 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:40.043306 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/da74ec55-7cda-4f1a-ba6d-0b4222b5fcb5-original-pull-secret\") pod \"global-pull-secret-syncer-gggnj\" (UID: \"da74ec55-7cda-4f1a-ba6d-0b4222b5fcb5\") " pod="kube-system/global-pull-secret-syncer-gggnj" Jul 08 23:02:40.043535 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:02:40.043438 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 23:02:40.043535 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:02:40.043519 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da74ec55-7cda-4f1a-ba6d-0b4222b5fcb5-original-pull-secret podName:da74ec55-7cda-4f1a-ba6d-0b4222b5fcb5 nodeName:}" failed. No retries permitted until 2026-07-08 23:02:48.043498436 +0000 UTC m=+18.091772335 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/da74ec55-7cda-4f1a-ba6d-0b4222b5fcb5-original-pull-secret") pod "global-pull-secret-syncer-gggnj" (UID: "da74ec55-7cda-4f1a-ba6d-0b4222b5fcb5") : object "kube-system"/"original-pull-secret" not registered Jul 08 23:02:40.144646 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:40.143988 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q6b7p\" (UniqueName: \"kubernetes.io/projected/994c671c-e4ec-474c-94fa-53f4cab24a16-kube-api-access-q6b7p\") pod \"network-check-target-264tg\" (UID: \"994c671c-e4ec-474c-94fa-53f4cab24a16\") " pod="openshift-network-diagnostics/network-check-target-264tg" Jul 08 23:02:40.144646 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:40.144078 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bfaa3f60-05b5-436b-9c10-324361b4bae0-metrics-certs\") pod \"network-metrics-daemon-wj6vf\" (UID: \"bfaa3f60-05b5-436b-9c10-324361b4bae0\") " pod="openshift-multus/network-metrics-daemon-wj6vf" Jul 08 23:02:40.144646 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:02:40.144215 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 23:02:40.144646 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:02:40.144277 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bfaa3f60-05b5-436b-9c10-324361b4bae0-metrics-certs podName:bfaa3f60-05b5-436b-9c10-324361b4bae0 nodeName:}" failed. No retries permitted until 2026-07-08 23:02:48.144258506 +0000 UTC m=+18.192532445 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bfaa3f60-05b5-436b-9c10-324361b4bae0-metrics-certs") pod "network-metrics-daemon-wj6vf" (UID: "bfaa3f60-05b5-436b-9c10-324361b4bae0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 23:02:40.144646 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:02:40.144326 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 23:02:40.144646 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:02:40.144347 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 23:02:40.144646 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:02:40.144360 2574 projected.go:196] Error preparing data for projected volume kube-api-access-q6b7p for pod openshift-network-diagnostics/network-check-target-264tg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 23:02:40.144646 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:02:40.144410 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/994c671c-e4ec-474c-94fa-53f4cab24a16-kube-api-access-q6b7p podName:994c671c-e4ec-474c-94fa-53f4cab24a16 nodeName:}" failed. No retries permitted until 2026-07-08 23:02:48.144395948 +0000 UTC m=+18.192669845 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-q6b7p" (UniqueName: "kubernetes.io/projected/994c671c-e4ec-474c-94fa-53f4cab24a16-kube-api-access-q6b7p") pod "network-check-target-264tg" (UID: "994c671c-e4ec-474c-94fa-53f4cab24a16") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 23:02:40.479362 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:40.477958 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gggnj" Jul 08 23:02:40.479362 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:02:40.478072 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gggnj" podUID="da74ec55-7cda-4f1a-ba6d-0b4222b5fcb5" Jul 08 23:02:41.476122 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:41.475761 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wj6vf" Jul 08 23:02:41.476122 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:02:41.475909 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wj6vf" podUID="bfaa3f60-05b5-436b-9c10-324361b4bae0" Jul 08 23:02:41.476388 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:41.476365 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-264tg" Jul 08 23:02:41.476490 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:02:41.476465 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-264tg" podUID="994c671c-e4ec-474c-94fa-53f4cab24a16" Jul 08 23:02:42.479528 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:42.479493 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gggnj" Jul 08 23:02:42.479985 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:02:42.479624 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gggnj" podUID="da74ec55-7cda-4f1a-ba6d-0b4222b5fcb5" Jul 08 23:02:43.475727 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:43.475698 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-264tg" Jul 08 23:02:43.475923 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:02:43.475825 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-264tg" podUID="994c671c-e4ec-474c-94fa-53f4cab24a16" Jul 08 23:02:43.475923 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:43.475869 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wj6vf" Jul 08 23:02:43.476037 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:02:43.475968 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wj6vf" podUID="bfaa3f60-05b5-436b-9c10-324361b4bae0" Jul 08 23:02:44.482087 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:44.482064 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gggnj" Jul 08 23:02:44.482497 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:02:44.482182 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gggnj" podUID="da74ec55-7cda-4f1a-ba6d-0b4222b5fcb5" Jul 08 23:02:45.476272 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:45.476179 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wj6vf" Jul 08 23:02:45.476423 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:02:45.476306 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wj6vf" podUID="bfaa3f60-05b5-436b-9c10-324361b4bae0" Jul 08 23:02:45.476423 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:45.476342 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-264tg" Jul 08 23:02:45.476552 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:02:45.476441 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-264tg" podUID="994c671c-e4ec-474c-94fa-53f4cab24a16" Jul 08 23:02:45.605278 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:45.605236 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wwbc6" event={"ID":"7d4ee776-7adc-4068-917b-e4c017076d4d","Type":"ContainerStarted","Data":"543f1f365986a5391530b18c871922189a530e0cd7fe9113b8e63d4445f6a660"} Jul 08 23:02:45.606965 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:45.606902 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-b9mrk" event={"ID":"025aa4fb-e602-4ca7-ab4d-982dbbfbea11","Type":"ContainerStarted","Data":"0dc21235d5dcf3e75e70fba9bb96e7a55123b804cbad57ba3814f9081f7506d3"} Jul 08 23:02:45.608565 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:45.608539 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-n5f8s" event={"ID":"22547ee0-3b85-431f-8552-d324da7a59df","Type":"ContainerStarted","Data":"9ee724c5db9e3c0233363ebb9d4bd2d63c79c2f1bbb9cf93f227f591ad78f3b2"} Jul 08 23:02:45.610087 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:45.610062 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sf9lt" event={"ID":"a9d05e92-6b0d-4ae2-8c1a-699f40fed3fa","Type":"ContainerStarted","Data":"eaece0504ae574e7e92e54496b283bfd1c9c5655f4ff2f899ad8264169bc2d53"} Jul 08 23:02:45.611599 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:45.611571 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wkdzq" event={"ID":"38442020-34ab-4cdf-a0e8-af93e6c046e1","Type":"ContainerStarted","Data":"d3a8c09df842398a7995ce2aa7f421726582fa8b81a2d6696cb0b551519ed89a"} Jul 08 23:02:45.613000 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:45.612978 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-tmmqj" event={"ID":"b8a428fb-e40d-437f-ae4d-ecd7141e03a5","Type":"ContainerStarted","Data":"a92494bace563e805fa02c0c01ba30a91e7ada6ae52da7dc2344d81f079c2bc1"} Jul 08 23:02:45.646236 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:45.646186 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-n5f8s" podStartSLOduration=2.9906898589999997 podStartE2EDuration="14.646169413s" totalImagesPullingTime="11.655479554s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 23:02:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:02:45.645807245 +0000 UTC m=+15.694081148" watchObservedRunningTime="2026-07-08 23:02:45.646169413 +0000 UTC m=+15.694443320" Jul 08 23:02:45.659864 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:45.659804 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-b9mrk" podStartSLOduration=3.033190574 podStartE2EDuration="14.659789041s" totalImagesPullingTime="11.626598467s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 23:02:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:02:45.659450389 +0000 UTC m=+15.707724315" watchObservedRunningTime="2026-07-08 23:02:45.659789041 +0000 UTC m=+15.708062943" Jul 08 23:02:45.674095 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:45.674050 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-wkdzq" podStartSLOduration=2.984386951 podStartE2EDuration="14.674032228s" totalImagesPullingTime="11.689645277s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 23:02:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:02:45.673909645 +0000 UTC m=+15.722183554" watchObservedRunningTime="2026-07-08 23:02:45.674032228 +0000 UTC m=+15.722306129" Jul 08 23:02:45.706034 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:45.705987 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-tmmqj" podStartSLOduration=2.975515444 podStartE2EDuration="14.705967456s" totalImagesPullingTime="11.730452012s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:02:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:02:45.705467832 +0000 UTC m=+15.753741736" watchObservedRunningTime="2026-07-08 23:02:45.705967456 +0000 UTC m=+15.754241361" Jul 08 23:02:46.476272 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:46.476177 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gggnj" Jul 08 23:02:46.476431 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:02:46.476305 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gggnj" podUID="da74ec55-7cda-4f1a-ba6d-0b4222b5fcb5" Jul 08 23:02:46.617201 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:46.617130 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-rd6zz" event={"ID":"afe09ce0-02a0-4d20-900c-346952958fc5","Type":"ContainerStarted","Data":"ca55911b5cdf2b812787b71dff31c48beac7a27faa127eb1f64c1835ce06c548"} Jul 08 23:02:46.631257 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:46.631215 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-rd6zz" podStartSLOduration=3.962495601 podStartE2EDuration="15.631200987s" totalImagesPullingTime="11.668705386s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 23:02:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:02:46.630852419 +0000 UTC m=+16.679126325" watchObservedRunningTime="2026-07-08 23:02:46.631200987 +0000 UTC m=+16.679474889" Jul 08 23:02:47.475832 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:47.475800 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-264tg" Jul 08 23:02:47.476042 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:47.475800 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wj6vf" Jul 08 23:02:47.476042 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:02:47.475924 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-264tg" podUID="994c671c-e4ec-474c-94fa-53f4cab24a16" Jul 08 23:02:47.476042 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:02:47.476004 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wj6vf" podUID="bfaa3f60-05b5-436b-9c10-324361b4bae0" Jul 08 23:02:48.109050 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:48.109016 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/da74ec55-7cda-4f1a-ba6d-0b4222b5fcb5-original-pull-secret\") pod \"global-pull-secret-syncer-gggnj\" (UID: \"da74ec55-7cda-4f1a-ba6d-0b4222b5fcb5\") " pod="kube-system/global-pull-secret-syncer-gggnj" Jul 08 23:02:48.109485 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:02:48.109139 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 23:02:48.109485 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:02:48.109219 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da74ec55-7cda-4f1a-ba6d-0b4222b5fcb5-original-pull-secret podName:da74ec55-7cda-4f1a-ba6d-0b4222b5fcb5 nodeName:}" failed. No retries permitted until 2026-07-08 23:03:04.109195438 +0000 UTC m=+34.157469318 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/da74ec55-7cda-4f1a-ba6d-0b4222b5fcb5-original-pull-secret") pod "global-pull-secret-syncer-gggnj" (UID: "da74ec55-7cda-4f1a-ba6d-0b4222b5fcb5") : object "kube-system"/"original-pull-secret" not registered Jul 08 23:02:48.210027 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:48.209997 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q6b7p\" (UniqueName: \"kubernetes.io/projected/994c671c-e4ec-474c-94fa-53f4cab24a16-kube-api-access-q6b7p\") pod \"network-check-target-264tg\" (UID: \"994c671c-e4ec-474c-94fa-53f4cab24a16\") " pod="openshift-network-diagnostics/network-check-target-264tg" Jul 08 23:02:48.210194 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:48.210067 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bfaa3f60-05b5-436b-9c10-324361b4bae0-metrics-certs\") pod \"network-metrics-daemon-wj6vf\" (UID: \"bfaa3f60-05b5-436b-9c10-324361b4bae0\") " pod="openshift-multus/network-metrics-daemon-wj6vf" Jul 08 23:02:48.210194 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:02:48.210159 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 23:02:48.210194 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:02:48.210179 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 23:02:48.210349 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:02:48.210206 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 23:02:48.210349 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:02:48.210210 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bfaa3f60-05b5-436b-9c10-324361b4bae0-metrics-certs podName:bfaa3f60-05b5-436b-9c10-324361b4bae0 nodeName:}" failed. No retries permitted until 2026-07-08 23:03:04.21019705 +0000 UTC m=+34.258470934 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bfaa3f60-05b5-436b-9c10-324361b4bae0-metrics-certs") pod "network-metrics-daemon-wj6vf" (UID: "bfaa3f60-05b5-436b-9c10-324361b4bae0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 23:02:48.210349 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:02:48.210219 2574 projected.go:196] Error preparing data for projected volume kube-api-access-q6b7p for pod openshift-network-diagnostics/network-check-target-264tg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 23:02:48.210349 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:02:48.210272 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/994c671c-e4ec-474c-94fa-53f4cab24a16-kube-api-access-q6b7p podName:994c671c-e4ec-474c-94fa-53f4cab24a16 nodeName:}" failed. No retries permitted until 2026-07-08 23:03:04.210252123 +0000 UTC m=+34.258526021 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-q6b7p" (UniqueName: "kubernetes.io/projected/994c671c-e4ec-474c-94fa-53f4cab24a16-kube-api-access-q6b7p") pod "network-check-target-264tg" (UID: "994c671c-e4ec-474c-94fa-53f4cab24a16") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 23:02:48.475742 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:48.475666 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gggnj" Jul 08 23:02:48.475897 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:02:48.475800 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gggnj" podUID="da74ec55-7cda-4f1a-ba6d-0b4222b5fcb5" Jul 08 23:02:48.622448 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:48.622421 2574 generic.go:356] "Generic (PLEG): container finished" podID="7d4ee776-7adc-4068-917b-e4c017076d4d" containerID="543f1f365986a5391530b18c871922189a530e0cd7fe9113b8e63d4445f6a660" exitCode=0 Jul 08 23:02:48.622596 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:48.622462 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wwbc6" event={"ID":"7d4ee776-7adc-4068-917b-e4c017076d4d","Type":"ContainerDied","Data":"543f1f365986a5391530b18c871922189a530e0cd7fe9113b8e63d4445f6a660"} Jul 08 23:02:49.475903 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:49.475868 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wj6vf" Jul 08 23:02:49.476553 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:49.475924 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-264tg" Jul 08 23:02:49.476553 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:02:49.475994 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wj6vf" podUID="bfaa3f60-05b5-436b-9c10-324361b4bae0" Jul 08 23:02:49.476553 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:02:49.476129 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-264tg" podUID="994c671c-e4ec-474c-94fa-53f4cab24a16" Jul 08 23:02:50.143028 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:50.142992 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-tmmqj" Jul 08 23:02:50.143631 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:50.143604 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-tmmqj" Jul 08 23:02:50.477147 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:50.477074 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gggnj" Jul 08 23:02:50.477730 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:02:50.477160 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gggnj" podUID="da74ec55-7cda-4f1a-ba6d-0b4222b5fcb5" Jul 08 23:02:50.626262 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:50.626231 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-tmmqj" Jul 08 23:02:50.627038 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:50.627014 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-tmmqj" Jul 08 23:02:51.475727 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:51.475691 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-264tg" Jul 08 23:02:51.475902 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:51.475704 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wj6vf" Jul 08 23:02:51.475902 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:02:51.475804 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-264tg" podUID="994c671c-e4ec-474c-94fa-53f4cab24a16" Jul 08 23:02:51.476008 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:02:51.475937 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wj6vf" podUID="bfaa3f60-05b5-436b-9c10-324361b4bae0" Jul 08 23:02:52.475867 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:52.475835 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gggnj" Jul 08 23:02:52.476336 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:02:52.475972 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gggnj" podUID="da74ec55-7cda-4f1a-ba6d-0b4222b5fcb5" Jul 08 23:02:53.476235 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:53.476205 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wj6vf" Jul 08 23:02:53.476663 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:02:53.476348 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wj6vf" podUID="bfaa3f60-05b5-436b-9c10-324361b4bae0" Jul 08 23:02:53.476663 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:53.476408 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-264tg" Jul 08 23:02:53.476663 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:02:53.476619 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-264tg" podUID="994c671c-e4ec-474c-94fa-53f4cab24a16" Jul 08 23:02:53.635015 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:53.634896 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mbgq5" event={"ID":"a5263de3-74ad-4282-a8c2-68d99202547b","Type":"ContainerStarted","Data":"a3c85aeee43185f408fae178894d43dc2d4345289494e5d852b5b5bb0617b3ea"} Jul 08 23:02:53.637844 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:53.637813 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8mcjt_82783d98-33c2-4050-b38f-5ba0a9701953/ovn-acl-logging/0.log" Jul 08 23:02:53.638362 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:53.638196 2574 generic.go:356] "Generic (PLEG): container finished" podID="82783d98-33c2-4050-b38f-5ba0a9701953" containerID="25894946fdb47d0e5ef4cb95db1c898ff4b6642cfd8ca35a498760f61fef37ed" exitCode=1 Jul 08 23:02:53.638362 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:53.638231 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8mcjt" event={"ID":"82783d98-33c2-4050-b38f-5ba0a9701953","Type":"ContainerDied","Data":"25894946fdb47d0e5ef4cb95db1c898ff4b6642cfd8ca35a498760f61fef37ed"} Jul 08 23:02:53.638362 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:53.638298 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8mcjt" event={"ID":"82783d98-33c2-4050-b38f-5ba0a9701953","Type":"ContainerStarted","Data":"de61a4c507331d2361f52721460001ddf952e201b23e25e4a668bf703ed3eb35"} Jul 08 23:02:53.654480 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:53.653841 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-mbgq5" podStartSLOduration=2.111598343 podStartE2EDuration="22.653820442s" totalImagesPullingTime="20.542222099s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 23:02:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:02:53.653533972 +0000 UTC m=+23.701807876" watchObservedRunningTime="2026-07-08 23:02:53.653820442 +0000 UTC m=+23.702094346" Jul 08 23:02:53.735337 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:53.735133 2574 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 08 23:02:54.445264 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:54.445176 2574 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-08T23:02:53.735334276Z","UUID":"d1ea1c72-c7c1-4bcd-9918-ca7921f1cf0c","Handler":null,"Name":"","Endpoint":""} Jul 08 23:02:54.446875 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:54.446849 2574 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 08 23:02:54.447002 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:54.446893 2574 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 08 23:02:54.476336 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:54.476306 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gggnj" Jul 08 23:02:54.476717 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:02:54.476424 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gggnj" podUID="da74ec55-7cda-4f1a-ba6d-0b4222b5fcb5" Jul 08 23:02:54.643891 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:54.643862 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8mcjt_82783d98-33c2-4050-b38f-5ba0a9701953/ovn-acl-logging/0.log" Jul 08 23:02:54.644444 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:54.644420 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8mcjt" event={"ID":"82783d98-33c2-4050-b38f-5ba0a9701953","Type":"ContainerStarted","Data":"c69a26b9e6a6dc9cf7277ad09b49bb8c551398df7390eac25d0501b476b46dc9"} Jul 08 23:02:54.644565 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:54.644503 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8mcjt" event={"ID":"82783d98-33c2-4050-b38f-5ba0a9701953","Type":"ContainerStarted","Data":"e0b040b17847807f83e61a4a346b4b5c34d300d3a26e10bc97f250099fa0381e"} Jul 08 23:02:54.644632 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:54.644571 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8mcjt" event={"ID":"82783d98-33c2-4050-b38f-5ba0a9701953","Type":"ContainerStarted","Data":"2c7a97a17bc5ee3c0526a309f1ce441cb64b31385ae310da1795e0bed25acaf1"} Jul 08 23:02:54.644632 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:54.644617 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8mcjt" event={"ID":"82783d98-33c2-4050-b38f-5ba0a9701953","Type":"ContainerStarted","Data":"441b8ea23d01e6867cdc5168dfbbdabfe8d991f212e5bdaf8c3756dc32a287b9"} Jul 08 23:02:54.646539 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:54.646385 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sf9lt" event={"ID":"a9d05e92-6b0d-4ae2-8c1a-699f40fed3fa","Type":"ContainerStarted","Data":"0109b60adfcd03feb48883e83891651d74dbebf42ba86c025d6c639fc5c6eaec"} Jul 08 23:02:55.475603 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:55.475578 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wj6vf" Jul 08 23:02:55.475831 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:55.475608 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-264tg" Jul 08 23:02:55.475831 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:02:55.475716 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wj6vf" podUID="bfaa3f60-05b5-436b-9c10-324361b4bae0" Jul 08 23:02:55.475831 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:02:55.475819 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-264tg" podUID="994c671c-e4ec-474c-94fa-53f4cab24a16" Jul 08 23:02:55.650624 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:55.650586 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sf9lt" event={"ID":"a9d05e92-6b0d-4ae2-8c1a-699f40fed3fa","Type":"ContainerStarted","Data":"07bd54bd8c7b20c4d281598e11c710869ee9e388e0d8715459ae3ef1c2b027d2"} Jul 08 23:02:55.670771 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:55.670711 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sf9lt" podStartSLOduration=2.597502689 podStartE2EDuration="24.670693686s" totalImagesPullingTime="22.073190997s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 23:02:31 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:02:55.670229806 +0000 UTC m=+25.718503712" watchObservedRunningTime="2026-07-08 23:02:55.670693686 +0000 UTC m=+25.718967588" Jul 08 23:02:56.476209 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:56.475679 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gggnj" Jul 08 23:02:56.476209 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:02:56.475828 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gggnj" podUID="da74ec55-7cda-4f1a-ba6d-0b4222b5fcb5" Jul 08 23:02:56.656081 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:56.656054 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8mcjt_82783d98-33c2-4050-b38f-5ba0a9701953/ovn-acl-logging/0.log" Jul 08 23:02:56.656496 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:56.656407 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8mcjt" event={"ID":"82783d98-33c2-4050-b38f-5ba0a9701953","Type":"ContainerStarted","Data":"5008f794edab8de9068c91423f1c96edcae51efc52c2f7b51b20c7ccdbea4a26"} Jul 08 23:02:57.476356 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:57.476323 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wj6vf" Jul 08 23:02:57.476524 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:02:57.476477 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wj6vf" podUID="bfaa3f60-05b5-436b-9c10-324361b4bae0" Jul 08 23:02:57.476595 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:57.476537 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-264tg" Jul 08 23:02:57.476681 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:02:57.476653 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-264tg" podUID="994c671c-e4ec-474c-94fa-53f4cab24a16" Jul 08 23:02:58.476498 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:58.476285 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gggnj" Jul 08 23:02:58.477155 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:02:58.476563 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gggnj" podUID="da74ec55-7cda-4f1a-ba6d-0b4222b5fcb5" Jul 08 23:02:58.663407 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:58.663378 2574 generic.go:356] "Generic (PLEG): container finished" podID="7d4ee776-7adc-4068-917b-e4c017076d4d" containerID="30d2fef8c2300461283e198c0a4c1acf6551b18096776960e1ee3f581c81e250" exitCode=0 Jul 08 23:02:58.663687 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:58.663458 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wwbc6" event={"ID":"7d4ee776-7adc-4068-917b-e4c017076d4d","Type":"ContainerDied","Data":"30d2fef8c2300461283e198c0a4c1acf6551b18096776960e1ee3f581c81e250"} Jul 08 23:02:58.667000 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:58.666985 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8mcjt_82783d98-33c2-4050-b38f-5ba0a9701953/ovn-acl-logging/0.log" Jul 08 23:02:58.667356 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:58.667287 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8mcjt" event={"ID":"82783d98-33c2-4050-b38f-5ba0a9701953","Type":"ContainerStarted","Data":"b6c26f2d6fcabaace48aa7344e090c6573af7c3863f317d1aaefa1b4aceb6e7b"} Jul 08 23:02:58.667599 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:58.667573 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8mcjt" Jul 08 23:02:58.667647 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:58.667638 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8mcjt" Jul 08 23:02:58.667853 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:58.667830 2574 scope.go:117] "RemoveContainer" containerID="25894946fdb47d0e5ef4cb95db1c898ff4b6642cfd8ca35a498760f61fef37ed" Jul 08 23:02:58.684972 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:58.684950 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8mcjt" Jul 08 23:02:58.685391 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:58.685373 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8mcjt" Jul 08 23:02:59.476295 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:59.476236 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-264tg" Jul 08 23:02:59.476295 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:59.476269 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wj6vf" Jul 08 23:02:59.476866 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:02:59.476351 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-264tg" podUID="994c671c-e4ec-474c-94fa-53f4cab24a16" Jul 08 23:02:59.476866 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:02:59.476571 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wj6vf" podUID="bfaa3f60-05b5-436b-9c10-324361b4bae0" Jul 08 23:02:59.673631 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:59.673607 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8mcjt_82783d98-33c2-4050-b38f-5ba0a9701953/ovn-acl-logging/0.log" Jul 08 23:02:59.673944 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:59.673922 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8mcjt" event={"ID":"82783d98-33c2-4050-b38f-5ba0a9701953","Type":"ContainerStarted","Data":"a23bcce24cb5886878aac6eab907213c65793653770412271b56d3c88f263b89"} Jul 08 23:02:59.674075 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:59.674060 2574 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 08 23:02:59.709782 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:02:59.709740 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-8mcjt" podStartSLOduration=8.246768189 podStartE2EDuration="28.709725218s" totalImagesPullingTime="20.462957029s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 23:02:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:02:59.708315708 +0000 UTC m=+29.756589635" watchObservedRunningTime="2026-07-08 23:02:59.709725218 +0000 UTC m=+29.757999129" Jul 08 23:03:00.476244 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:00.476215 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gggnj" Jul 08 23:03:00.476427 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:03:00.476326 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gggnj" podUID="da74ec55-7cda-4f1a-ba6d-0b4222b5fcb5" Jul 08 23:03:00.677733 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:00.677697 2574 generic.go:356] "Generic (PLEG): container finished" podID="7d4ee776-7adc-4068-917b-e4c017076d4d" containerID="a1aa80270e75d90e9d2d59e7b13dd0b080eedea09eaaf40e73e8909ddd35e043" exitCode=0 Jul 08 23:03:00.678176 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:00.677769 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wwbc6" event={"ID":"7d4ee776-7adc-4068-917b-e4c017076d4d","Type":"ContainerDied","Data":"a1aa80270e75d90e9d2d59e7b13dd0b080eedea09eaaf40e73e8909ddd35e043"} Jul 08 23:03:00.678176 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:00.677845 2574 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 08 23:03:00.721966 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:00.721934 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-gggnj"] Jul 08 23:03:00.722109 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:00.722019 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gggnj" Jul 08 23:03:00.722170 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:03:00.722113 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gggnj" podUID="da74ec55-7cda-4f1a-ba6d-0b4222b5fcb5" Jul 08 23:03:00.724764 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:00.724742 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-wj6vf"] Jul 08 23:03:00.724888 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:00.724816 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wj6vf" Jul 08 23:03:00.724932 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:03:00.724893 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wj6vf" podUID="bfaa3f60-05b5-436b-9c10-324361b4bae0" Jul 08 23:03:00.727690 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:00.727634 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-264tg"] Jul 08 23:03:00.727793 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:00.727703 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-264tg" Jul 08 23:03:00.727793 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:03:00.727769 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-264tg" podUID="994c671c-e4ec-474c-94fa-53f4cab24a16" Jul 08 23:03:01.906158 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:01.906124 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8mcjt" Jul 08 23:03:02.475859 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:02.475789 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gggnj" Jul 08 23:03:02.475859 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:02.475837 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-264tg" Jul 08 23:03:02.476069 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:02.475792 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wj6vf" Jul 08 23:03:02.476069 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:03:02.475937 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gggnj" podUID="da74ec55-7cda-4f1a-ba6d-0b4222b5fcb5" Jul 08 23:03:02.476069 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:03:02.476020 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wj6vf" podUID="bfaa3f60-05b5-436b-9c10-324361b4bae0" Jul 08 23:03:02.476197 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:03:02.476099 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-264tg" podUID="994c671c-e4ec-474c-94fa-53f4cab24a16" Jul 08 23:03:02.685002 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:02.684945 2574 generic.go:356] "Generic (PLEG): container finished" podID="7d4ee776-7adc-4068-917b-e4c017076d4d" containerID="098efe1b4f5fc6df526cd34b13e227ec8f998d0cb07006c792dad7a864aded90" exitCode=0 Jul 08 23:03:02.685103 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:02.684992 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wwbc6" event={"ID":"7d4ee776-7adc-4068-917b-e4c017076d4d","Type":"ContainerDied","Data":"098efe1b4f5fc6df526cd34b13e227ec8f998d0cb07006c792dad7a864aded90"} Jul 08 23:03:04.135986 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:04.135780 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/da74ec55-7cda-4f1a-ba6d-0b4222b5fcb5-original-pull-secret\") pod \"global-pull-secret-syncer-gggnj\" (UID: \"da74ec55-7cda-4f1a-ba6d-0b4222b5fcb5\") " pod="kube-system/global-pull-secret-syncer-gggnj" Jul 08 23:03:04.136396 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:03:04.135936 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 23:03:04.136396 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:03:04.136126 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da74ec55-7cda-4f1a-ba6d-0b4222b5fcb5-original-pull-secret podName:da74ec55-7cda-4f1a-ba6d-0b4222b5fcb5 nodeName:}" failed. No retries permitted until 2026-07-08 23:03:36.136109747 +0000 UTC m=+66.184383632 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/da74ec55-7cda-4f1a-ba6d-0b4222b5fcb5-original-pull-secret") pod "global-pull-secret-syncer-gggnj" (UID: "da74ec55-7cda-4f1a-ba6d-0b4222b5fcb5") : object "kube-system"/"original-pull-secret" not registered Jul 08 23:03:04.236808 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:04.236771 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bfaa3f60-05b5-436b-9c10-324361b4bae0-metrics-certs\") pod \"network-metrics-daemon-wj6vf\" (UID: \"bfaa3f60-05b5-436b-9c10-324361b4bae0\") " pod="openshift-multus/network-metrics-daemon-wj6vf" Jul 08 23:03:04.236982 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:04.236829 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q6b7p\" (UniqueName: \"kubernetes.io/projected/994c671c-e4ec-474c-94fa-53f4cab24a16-kube-api-access-q6b7p\") pod \"network-check-target-264tg\" (UID: \"994c671c-e4ec-474c-94fa-53f4cab24a16\") " pod="openshift-network-diagnostics/network-check-target-264tg" Jul 08 23:03:04.236982 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:03:04.236929 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 23:03:04.237084 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:03:04.237007 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bfaa3f60-05b5-436b-9c10-324361b4bae0-metrics-certs podName:bfaa3f60-05b5-436b-9c10-324361b4bae0 nodeName:}" failed. No retries permitted until 2026-07-08 23:03:36.236986839 +0000 UTC m=+66.285260721 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bfaa3f60-05b5-436b-9c10-324361b4bae0-metrics-certs") pod "network-metrics-daemon-wj6vf" (UID: "bfaa3f60-05b5-436b-9c10-324361b4bae0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 23:03:04.237084 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:03:04.236937 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 23:03:04.237084 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:03:04.237043 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 23:03:04.237084 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:03:04.237056 2574 projected.go:196] Error preparing data for projected volume kube-api-access-q6b7p for pod openshift-network-diagnostics/network-check-target-264tg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 23:03:04.237295 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:03:04.237108 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/994c671c-e4ec-474c-94fa-53f4cab24a16-kube-api-access-q6b7p podName:994c671c-e4ec-474c-94fa-53f4cab24a16 nodeName:}" failed. No retries permitted until 2026-07-08 23:03:36.237095312 +0000 UTC m=+66.285369214 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-q6b7p" (UniqueName: "kubernetes.io/projected/994c671c-e4ec-474c-94fa-53f4cab24a16-kube-api-access-q6b7p") pod "network-check-target-264tg" (UID: "994c671c-e4ec-474c-94fa-53f4cab24a16") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 23:03:04.476026 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:04.475945 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-264tg" Jul 08 23:03:04.476219 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:04.475949 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gggnj" Jul 08 23:03:04.476219 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:03:04.476077 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-264tg" podUID="994c671c-e4ec-474c-94fa-53f4cab24a16" Jul 08 23:03:04.476219 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:04.475945 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wj6vf" Jul 08 23:03:04.476219 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:03:04.476121 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gggnj" podUID="da74ec55-7cda-4f1a-ba6d-0b4222b5fcb5" Jul 08 23:03:04.476422 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:03:04.476250 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wj6vf" podUID="bfaa3f60-05b5-436b-9c10-324361b4bae0" Jul 08 23:03:06.237434 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:06.237405 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-79.ec2.internal" event="NodeReady" Jul 08 23:03:06.237848 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:06.237554 2574 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 08 23:03:06.269058 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:06.269028 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-59d44dd9bb-4zrm7"] Jul 08 23:03:06.271117 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:06.271092 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59d44dd9bb-4zrm7" Jul 08 23:03:06.273701 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:06.273668 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 08 23:03:06.273835 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:06.273670 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 08 23:03:06.273835 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:06.273733 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-qxxgd\"" Jul 08 23:03:06.273835 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:06.273737 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 08 23:03:06.280121 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:06.279261 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-pr92b"] Jul 08 23:03:06.280121 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:06.279320 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 08 23:03:06.281115 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:06.281095 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pr92b" Jul 08 23:03:06.283310 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:06.283289 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 08 23:03:06.283414 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:06.283297 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 08 23:03:06.283414 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:06.283404 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-2zvtt\"" Jul 08 23:03:06.285987 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:06.285961 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-59d44dd9bb-4zrm7"] Jul 08 23:03:06.288918 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:06.288786 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-zknln"] Jul 08 23:03:06.290620 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:06.290602 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zknln" Jul 08 23:03:06.292608 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:06.292587 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-pr92b"] Jul 08 23:03:06.293152 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:06.293135 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 08 23:03:06.293248 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:06.293196 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-xlh5l\"" Jul 08 23:03:06.293438 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:06.293417 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 08 23:03:06.293550 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:06.293443 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 08 23:03:06.300550 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:06.300528 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-zknln"] Jul 08 23:03:06.453160 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:06.453119 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/95b3aab3-2dca-4fc5-9de4-eef31714950d-ca-trust-extracted\") pod \"image-registry-59d44dd9bb-4zrm7\" (UID: \"95b3aab3-2dca-4fc5-9de4-eef31714950d\") " pod="openshift-image-registry/image-registry-59d44dd9bb-4zrm7" Jul 08 23:03:06.453330 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:06.453165 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/95b3aab3-2dca-4fc5-9de4-eef31714950d-bound-sa-token\") pod \"image-registry-59d44dd9bb-4zrm7\" (UID: \"95b3aab3-2dca-4fc5-9de4-eef31714950d\") " pod="openshift-image-registry/image-registry-59d44dd9bb-4zrm7" Jul 08 23:03:06.453330 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:06.453196 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d8ceaaa0-c406-4ac5-9ff4-027bcdb1b508-cert\") pod \"ingress-canary-zknln\" (UID: \"d8ceaaa0-c406-4ac5-9ff4-027bcdb1b508\") " pod="openshift-ingress-canary/ingress-canary-zknln" Jul 08 23:03:06.453330 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:06.453224 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8r6nx\" (UniqueName: \"kubernetes.io/projected/95b3aab3-2dca-4fc5-9de4-eef31714950d-kube-api-access-8r6nx\") pod \"image-registry-59d44dd9bb-4zrm7\" (UID: \"95b3aab3-2dca-4fc5-9de4-eef31714950d\") " pod="openshift-image-registry/image-registry-59d44dd9bb-4zrm7" Jul 08 23:03:06.453330 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:06.453290 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4798cc78-68f0-447d-8ac9-b4b71ee8801d-metrics-tls\") pod \"dns-default-pr92b\" (UID: \"4798cc78-68f0-447d-8ac9-b4b71ee8801d\") " pod="openshift-dns/dns-default-pr92b" Jul 08 23:03:06.453330 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:06.453316 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/95b3aab3-2dca-4fc5-9de4-eef31714950d-registry-certificates\") pod \"image-registry-59d44dd9bb-4zrm7\" (UID: \"95b3aab3-2dca-4fc5-9de4-eef31714950d\") " pod="openshift-image-registry/image-registry-59d44dd9bb-4zrm7" Jul 08 23:03:06.453547 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:06.453346 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4798cc78-68f0-447d-8ac9-b4b71ee8801d-config-volume\") pod \"dns-default-pr92b\" (UID: \"4798cc78-68f0-447d-8ac9-b4b71ee8801d\") " pod="openshift-dns/dns-default-pr92b" Jul 08 23:03:06.453547 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:06.453381 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/95b3aab3-2dca-4fc5-9de4-eef31714950d-registry-tls\") pod \"image-registry-59d44dd9bb-4zrm7\" (UID: \"95b3aab3-2dca-4fc5-9de4-eef31714950d\") " pod="openshift-image-registry/image-registry-59d44dd9bb-4zrm7" Jul 08 23:03:06.453547 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:06.453426 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2bfk\" (UniqueName: \"kubernetes.io/projected/d8ceaaa0-c406-4ac5-9ff4-027bcdb1b508-kube-api-access-j2bfk\") pod \"ingress-canary-zknln\" (UID: \"d8ceaaa0-c406-4ac5-9ff4-027bcdb1b508\") " pod="openshift-ingress-canary/ingress-canary-zknln" Jul 08 23:03:06.453547 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:06.453475 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/95b3aab3-2dca-4fc5-9de4-eef31714950d-image-registry-private-configuration\") pod \"image-registry-59d44dd9bb-4zrm7\" (UID: \"95b3aab3-2dca-4fc5-9de4-eef31714950d\") " pod="openshift-image-registry/image-registry-59d44dd9bb-4zrm7" Jul 08 23:03:06.453707 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:06.453561 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/95b3aab3-2dca-4fc5-9de4-eef31714950d-trusted-ca\") pod \"image-registry-59d44dd9bb-4zrm7\" (UID: \"95b3aab3-2dca-4fc5-9de4-eef31714950d\") " pod="openshift-image-registry/image-registry-59d44dd9bb-4zrm7" Jul 08 23:03:06.453707 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:06.453591 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/95b3aab3-2dca-4fc5-9de4-eef31714950d-installation-pull-secrets\") pod \"image-registry-59d44dd9bb-4zrm7\" (UID: \"95b3aab3-2dca-4fc5-9de4-eef31714950d\") " pod="openshift-image-registry/image-registry-59d44dd9bb-4zrm7" Jul 08 23:03:06.453707 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:06.453618 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4798cc78-68f0-447d-8ac9-b4b71ee8801d-tmp-dir\") pod \"dns-default-pr92b\" (UID: \"4798cc78-68f0-447d-8ac9-b4b71ee8801d\") " pod="openshift-dns/dns-default-pr92b" Jul 08 23:03:06.453707 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:06.453640 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvxlk\" (UniqueName: \"kubernetes.io/projected/4798cc78-68f0-447d-8ac9-b4b71ee8801d-kube-api-access-wvxlk\") pod \"dns-default-pr92b\" (UID: \"4798cc78-68f0-447d-8ac9-b4b71ee8801d\") " pod="openshift-dns/dns-default-pr92b" Jul 08 23:03:06.476448 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:06.476421 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-264tg" Jul 08 23:03:06.476448 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:06.476438 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gggnj" Jul 08 23:03:06.476631 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:06.476451 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wj6vf" Jul 08 23:03:06.479239 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:06.479215 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 08 23:03:06.479409 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:06.479269 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-f6f6s\"" Jul 08 23:03:06.479409 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:06.479215 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 08 23:03:06.479536 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:06.479454 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 08 23:03:06.479536 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:06.479490 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8bt8r\"" Jul 08 23:03:06.479638 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:06.479558 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 08 23:03:06.554419 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:06.554393 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4798cc78-68f0-447d-8ac9-b4b71ee8801d-tmp-dir\") pod \"dns-default-pr92b\" (UID: \"4798cc78-68f0-447d-8ac9-b4b71ee8801d\") " pod="openshift-dns/dns-default-pr92b" Jul 08 23:03:06.554570 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:06.554429 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvxlk\" (UniqueName: \"kubernetes.io/projected/4798cc78-68f0-447d-8ac9-b4b71ee8801d-kube-api-access-wvxlk\") pod \"dns-default-pr92b\" (UID: \"4798cc78-68f0-447d-8ac9-b4b71ee8801d\") " pod="openshift-dns/dns-default-pr92b" Jul 08 23:03:06.554570 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:06.554457 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/95b3aab3-2dca-4fc5-9de4-eef31714950d-ca-trust-extracted\") pod \"image-registry-59d44dd9bb-4zrm7\" (UID: \"95b3aab3-2dca-4fc5-9de4-eef31714950d\") " pod="openshift-image-registry/image-registry-59d44dd9bb-4zrm7" Jul 08 23:03:06.554570 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:06.554476 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/95b3aab3-2dca-4fc5-9de4-eef31714950d-bound-sa-token\") pod \"image-registry-59d44dd9bb-4zrm7\" (UID: \"95b3aab3-2dca-4fc5-9de4-eef31714950d\") " pod="openshift-image-registry/image-registry-59d44dd9bb-4zrm7" Jul 08 23:03:06.554570 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:06.554498 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d8ceaaa0-c406-4ac5-9ff4-027bcdb1b508-cert\") pod \"ingress-canary-zknln\" (UID: \"d8ceaaa0-c406-4ac5-9ff4-027bcdb1b508\") " pod="openshift-ingress-canary/ingress-canary-zknln" Jul 08 23:03:06.554570 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:06.554542 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8r6nx\" (UniqueName: \"kubernetes.io/projected/95b3aab3-2dca-4fc5-9de4-eef31714950d-kube-api-access-8r6nx\") pod \"image-registry-59d44dd9bb-4zrm7\" (UID: \"95b3aab3-2dca-4fc5-9de4-eef31714950d\") " pod="openshift-image-registry/image-registry-59d44dd9bb-4zrm7" Jul 08 23:03:06.554825 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:06.554701 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4798cc78-68f0-447d-8ac9-b4b71ee8801d-metrics-tls\") pod \"dns-default-pr92b\" (UID: \"4798cc78-68f0-447d-8ac9-b4b71ee8801d\") " pod="openshift-dns/dns-default-pr92b" Jul 08 23:03:06.554825 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:06.554742 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/95b3aab3-2dca-4fc5-9de4-eef31714950d-registry-certificates\") pod \"image-registry-59d44dd9bb-4zrm7\" (UID: \"95b3aab3-2dca-4fc5-9de4-eef31714950d\") " pod="openshift-image-registry/image-registry-59d44dd9bb-4zrm7" Jul 08 23:03:06.554825 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:06.554781 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4798cc78-68f0-447d-8ac9-b4b71ee8801d-config-volume\") pod \"dns-default-pr92b\" (UID: \"4798cc78-68f0-447d-8ac9-b4b71ee8801d\") " pod="openshift-dns/dns-default-pr92b" Jul 08 23:03:06.554825 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:06.554794 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4798cc78-68f0-447d-8ac9-b4b71ee8801d-tmp-dir\") pod \"dns-default-pr92b\" (UID: \"4798cc78-68f0-447d-8ac9-b4b71ee8801d\") " pod="openshift-dns/dns-default-pr92b" Jul 08 23:03:06.554825 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:03:06.554802 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 23:03:06.554825 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:06.554821 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/95b3aab3-2dca-4fc5-9de4-eef31714950d-registry-tls\") pod \"image-registry-59d44dd9bb-4zrm7\" (UID: \"95b3aab3-2dca-4fc5-9de4-eef31714950d\") " pod="openshift-image-registry/image-registry-59d44dd9bb-4zrm7" Jul 08 23:03:06.555106 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:06.554846 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2bfk\" (UniqueName: \"kubernetes.io/projected/d8ceaaa0-c406-4ac5-9ff4-027bcdb1b508-kube-api-access-j2bfk\") pod \"ingress-canary-zknln\" (UID: \"d8ceaaa0-c406-4ac5-9ff4-027bcdb1b508\") " pod="openshift-ingress-canary/ingress-canary-zknln" Jul 08 23:03:06.555106 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:03:06.554863 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4798cc78-68f0-447d-8ac9-b4b71ee8801d-metrics-tls podName:4798cc78-68f0-447d-8ac9-b4b71ee8801d nodeName:}" failed. No retries permitted until 2026-07-08 23:03:07.054840074 +0000 UTC m=+37.103113955 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4798cc78-68f0-447d-8ac9-b4b71ee8801d-metrics-tls") pod "dns-default-pr92b" (UID: "4798cc78-68f0-447d-8ac9-b4b71ee8801d") : secret "dns-default-metrics-tls" not found Jul 08 23:03:06.555106 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:06.554874 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/95b3aab3-2dca-4fc5-9de4-eef31714950d-ca-trust-extracted\") pod \"image-registry-59d44dd9bb-4zrm7\" (UID: \"95b3aab3-2dca-4fc5-9de4-eef31714950d\") " pod="openshift-image-registry/image-registry-59d44dd9bb-4zrm7" Jul 08 23:03:06.555106 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:06.554914 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/95b3aab3-2dca-4fc5-9de4-eef31714950d-image-registry-private-configuration\") pod \"image-registry-59d44dd9bb-4zrm7\" (UID: \"95b3aab3-2dca-4fc5-9de4-eef31714950d\") " pod="openshift-image-registry/image-registry-59d44dd9bb-4zrm7" Jul 08 23:03:06.555106 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:06.554972 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/95b3aab3-2dca-4fc5-9de4-eef31714950d-trusted-ca\") pod \"image-registry-59d44dd9bb-4zrm7\" (UID: \"95b3aab3-2dca-4fc5-9de4-eef31714950d\") " pod="openshift-image-registry/image-registry-59d44dd9bb-4zrm7" Jul 08 23:03:06.555106 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:06.555003 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/95b3aab3-2dca-4fc5-9de4-eef31714950d-installation-pull-secrets\") pod \"image-registry-59d44dd9bb-4zrm7\" (UID: \"95b3aab3-2dca-4fc5-9de4-eef31714950d\") " pod="openshift-image-registry/image-registry-59d44dd9bb-4zrm7" Jul 08 23:03:06.555424 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:03:06.555169 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 08 23:03:06.555424 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:03:06.555184 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59d44dd9bb-4zrm7: secret "image-registry-tls" not found Jul 08 23:03:06.555424 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:03:06.555262 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/95b3aab3-2dca-4fc5-9de4-eef31714950d-registry-tls podName:95b3aab3-2dca-4fc5-9de4-eef31714950d nodeName:}" failed. No retries permitted until 2026-07-08 23:03:07.055226588 +0000 UTC m=+37.103500489 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/95b3aab3-2dca-4fc5-9de4-eef31714950d-registry-tls") pod "image-registry-59d44dd9bb-4zrm7" (UID: "95b3aab3-2dca-4fc5-9de4-eef31714950d") : secret "image-registry-tls" not found Jul 08 23:03:06.555424 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:06.555281 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/95b3aab3-2dca-4fc5-9de4-eef31714950d-registry-certificates\") pod \"image-registry-59d44dd9bb-4zrm7\" (UID: \"95b3aab3-2dca-4fc5-9de4-eef31714950d\") " pod="openshift-image-registry/image-registry-59d44dd9bb-4zrm7" Jul 08 23:03:06.555424 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:06.555343 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4798cc78-68f0-447d-8ac9-b4b71ee8801d-config-volume\") pod \"dns-default-pr92b\" (UID: \"4798cc78-68f0-447d-8ac9-b4b71ee8801d\") " pod="openshift-dns/dns-default-pr92b" Jul 08 23:03:06.556048 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:06.556025 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/95b3aab3-2dca-4fc5-9de4-eef31714950d-trusted-ca\") pod \"image-registry-59d44dd9bb-4zrm7\" (UID: \"95b3aab3-2dca-4fc5-9de4-eef31714950d\") " pod="openshift-image-registry/image-registry-59d44dd9bb-4zrm7" Jul 08 23:03:06.559306 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:06.559284 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/95b3aab3-2dca-4fc5-9de4-eef31714950d-image-registry-private-configuration\") pod \"image-registry-59d44dd9bb-4zrm7\" (UID: \"95b3aab3-2dca-4fc5-9de4-eef31714950d\") " pod="openshift-image-registry/image-registry-59d44dd9bb-4zrm7" Jul 08 23:03:06.559395 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:06.559370 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/95b3aab3-2dca-4fc5-9de4-eef31714950d-installation-pull-secrets\") pod \"image-registry-59d44dd9bb-4zrm7\" (UID: \"95b3aab3-2dca-4fc5-9de4-eef31714950d\") " pod="openshift-image-registry/image-registry-59d44dd9bb-4zrm7" Jul 08 23:03:06.559441 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:06.559402 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d8ceaaa0-c406-4ac5-9ff4-027bcdb1b508-cert\") pod \"ingress-canary-zknln\" (UID: \"d8ceaaa0-c406-4ac5-9ff4-027bcdb1b508\") " pod="openshift-ingress-canary/ingress-canary-zknln" Jul 08 23:03:06.563391 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:06.563348 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/95b3aab3-2dca-4fc5-9de4-eef31714950d-bound-sa-token\") pod \"image-registry-59d44dd9bb-4zrm7\" (UID: \"95b3aab3-2dca-4fc5-9de4-eef31714950d\") " pod="openshift-image-registry/image-registry-59d44dd9bb-4zrm7" Jul 08 23:03:06.563918 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:06.563889 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8r6nx\" (UniqueName: \"kubernetes.io/projected/95b3aab3-2dca-4fc5-9de4-eef31714950d-kube-api-access-8r6nx\") pod \"image-registry-59d44dd9bb-4zrm7\" (UID: \"95b3aab3-2dca-4fc5-9de4-eef31714950d\") " pod="openshift-image-registry/image-registry-59d44dd9bb-4zrm7" Jul 08 23:03:06.564115 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:06.564090 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvxlk\" (UniqueName: \"kubernetes.io/projected/4798cc78-68f0-447d-8ac9-b4b71ee8801d-kube-api-access-wvxlk\") pod \"dns-default-pr92b\" (UID: \"4798cc78-68f0-447d-8ac9-b4b71ee8801d\") " pod="openshift-dns/dns-default-pr92b" Jul 08 23:03:06.564950 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:06.564925 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2bfk\" (UniqueName: \"kubernetes.io/projected/d8ceaaa0-c406-4ac5-9ff4-027bcdb1b508-kube-api-access-j2bfk\") pod \"ingress-canary-zknln\" (UID: \"d8ceaaa0-c406-4ac5-9ff4-027bcdb1b508\") " pod="openshift-ingress-canary/ingress-canary-zknln" Jul 08 23:03:06.600392 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:06.600370 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zknln" Jul 08 23:03:07.060250 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:07.060200 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4798cc78-68f0-447d-8ac9-b4b71ee8801d-metrics-tls\") pod \"dns-default-pr92b\" (UID: \"4798cc78-68f0-447d-8ac9-b4b71ee8801d\") " pod="openshift-dns/dns-default-pr92b" Jul 08 23:03:07.060444 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:07.060260 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/95b3aab3-2dca-4fc5-9de4-eef31714950d-registry-tls\") pod \"image-registry-59d44dd9bb-4zrm7\" (UID: \"95b3aab3-2dca-4fc5-9de4-eef31714950d\") " pod="openshift-image-registry/image-registry-59d44dd9bb-4zrm7" Jul 08 23:03:07.060444 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:03:07.060351 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 08 23:03:07.060444 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:03:07.060358 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 23:03:07.060444 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:03:07.060424 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4798cc78-68f0-447d-8ac9-b4b71ee8801d-metrics-tls podName:4798cc78-68f0-447d-8ac9-b4b71ee8801d nodeName:}" failed. No retries permitted until 2026-07-08 23:03:08.060408796 +0000 UTC m=+38.108682677 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4798cc78-68f0-447d-8ac9-b4b71ee8801d-metrics-tls") pod "dns-default-pr92b" (UID: "4798cc78-68f0-447d-8ac9-b4b71ee8801d") : secret "dns-default-metrics-tls" not found Jul 08 23:03:07.060684 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:03:07.060365 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59d44dd9bb-4zrm7: secret "image-registry-tls" not found Jul 08 23:03:07.060684 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:03:07.060530 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/95b3aab3-2dca-4fc5-9de4-eef31714950d-registry-tls podName:95b3aab3-2dca-4fc5-9de4-eef31714950d nodeName:}" failed. No retries permitted until 2026-07-08 23:03:08.060500891 +0000 UTC m=+38.108774772 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/95b3aab3-2dca-4fc5-9de4-eef31714950d-registry-tls") pod "image-registry-59d44dd9bb-4zrm7" (UID: "95b3aab3-2dca-4fc5-9de4-eef31714950d") : secret "image-registry-tls" not found Jul 08 23:03:07.520422 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:07.520391 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-zknln"] Jul 08 23:03:07.524245 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:03:07.524063 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8ceaaa0_c406_4ac5_9ff4_027bcdb1b508.slice/crio-1ba2f0775d56f73eec42d1cdb18ea4059bce4b0bc27cf7d9199a7c196b36f0a1 WatchSource:0}: Error finding container 1ba2f0775d56f73eec42d1cdb18ea4059bce4b0bc27cf7d9199a7c196b36f0a1: Status 404 returned error can't find the container with id 1ba2f0775d56f73eec42d1cdb18ea4059bce4b0bc27cf7d9199a7c196b36f0a1 Jul 08 23:03:07.699755 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:07.699727 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wwbc6" event={"ID":"7d4ee776-7adc-4068-917b-e4c017076d4d","Type":"ContainerStarted","Data":"8eaa700e5932bab5f9354a3a26713bfb7766a5e65936c5849ed9feec5aa90eff"} Jul 08 23:03:07.701484 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:07.701463 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-zknln" event={"ID":"d8ceaaa0-c406-4ac5-9ff4-027bcdb1b508","Type":"ContainerStarted","Data":"1ba2f0775d56f73eec42d1cdb18ea4059bce4b0bc27cf7d9199a7c196b36f0a1"} Jul 08 23:03:08.068619 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:08.068596 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/95b3aab3-2dca-4fc5-9de4-eef31714950d-registry-tls\") pod \"image-registry-59d44dd9bb-4zrm7\" (UID: \"95b3aab3-2dca-4fc5-9de4-eef31714950d\") " pod="openshift-image-registry/image-registry-59d44dd9bb-4zrm7" Jul 08 23:03:08.068743 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:08.068658 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4798cc78-68f0-447d-8ac9-b4b71ee8801d-metrics-tls\") pod \"dns-default-pr92b\" (UID: \"4798cc78-68f0-447d-8ac9-b4b71ee8801d\") " pod="openshift-dns/dns-default-pr92b" Jul 08 23:03:08.068743 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:03:08.068725 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 08 23:03:08.068743 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:03:08.068741 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59d44dd9bb-4zrm7: secret "image-registry-tls" not found Jul 08 23:03:08.068838 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:03:08.068744 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 23:03:08.068838 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:03:08.068789 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/95b3aab3-2dca-4fc5-9de4-eef31714950d-registry-tls podName:95b3aab3-2dca-4fc5-9de4-eef31714950d nodeName:}" failed. No retries permitted until 2026-07-08 23:03:10.068774702 +0000 UTC m=+40.117048584 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/95b3aab3-2dca-4fc5-9de4-eef31714950d-registry-tls") pod "image-registry-59d44dd9bb-4zrm7" (UID: "95b3aab3-2dca-4fc5-9de4-eef31714950d") : secret "image-registry-tls" not found Jul 08 23:03:08.068838 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:03:08.068803 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4798cc78-68f0-447d-8ac9-b4b71ee8801d-metrics-tls podName:4798cc78-68f0-447d-8ac9-b4b71ee8801d nodeName:}" failed. No retries permitted until 2026-07-08 23:03:10.068797426 +0000 UTC m=+40.117071307 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4798cc78-68f0-447d-8ac9-b4b71ee8801d-metrics-tls") pod "dns-default-pr92b" (UID: "4798cc78-68f0-447d-8ac9-b4b71ee8801d") : secret "dns-default-metrics-tls" not found Jul 08 23:03:08.707007 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:08.706974 2574 generic.go:356] "Generic (PLEG): container finished" podID="7d4ee776-7adc-4068-917b-e4c017076d4d" containerID="8eaa700e5932bab5f9354a3a26713bfb7766a5e65936c5849ed9feec5aa90eff" exitCode=0 Jul 08 23:03:08.707007 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:08.707021 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wwbc6" event={"ID":"7d4ee776-7adc-4068-917b-e4c017076d4d","Type":"ContainerDied","Data":"8eaa700e5932bab5f9354a3a26713bfb7766a5e65936c5849ed9feec5aa90eff"} Jul 08 23:03:09.713779 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:09.713745 2574 generic.go:356] "Generic (PLEG): container finished" podID="7d4ee776-7adc-4068-917b-e4c017076d4d" containerID="e7f0f3cb305c097f3ac6365c6e7d1be1a75f3c231c3e9a70eb1a7d035f06e3f6" exitCode=0 Jul 08 23:03:09.713779 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:09.713786 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wwbc6" event={"ID":"7d4ee776-7adc-4068-917b-e4c017076d4d","Type":"ContainerDied","Data":"e7f0f3cb305c097f3ac6365c6e7d1be1a75f3c231c3e9a70eb1a7d035f06e3f6"} Jul 08 23:03:10.084111 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:10.084083 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4798cc78-68f0-447d-8ac9-b4b71ee8801d-metrics-tls\") pod \"dns-default-pr92b\" (UID: \"4798cc78-68f0-447d-8ac9-b4b71ee8801d\") " pod="openshift-dns/dns-default-pr92b" Jul 08 23:03:10.084274 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:10.084130 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/95b3aab3-2dca-4fc5-9de4-eef31714950d-registry-tls\") pod \"image-registry-59d44dd9bb-4zrm7\" (UID: \"95b3aab3-2dca-4fc5-9de4-eef31714950d\") " pod="openshift-image-registry/image-registry-59d44dd9bb-4zrm7" Jul 08 23:03:10.084274 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:03:10.084250 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 23:03:10.084358 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:03:10.084319 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4798cc78-68f0-447d-8ac9-b4b71ee8801d-metrics-tls podName:4798cc78-68f0-447d-8ac9-b4b71ee8801d nodeName:}" failed. No retries permitted until 2026-07-08 23:03:14.084305554 +0000 UTC m=+44.132579440 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4798cc78-68f0-447d-8ac9-b4b71ee8801d-metrics-tls") pod "dns-default-pr92b" (UID: "4798cc78-68f0-447d-8ac9-b4b71ee8801d") : secret "dns-default-metrics-tls" not found Jul 08 23:03:10.084358 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:03:10.084253 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 08 23:03:10.084358 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:03:10.084357 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59d44dd9bb-4zrm7: secret "image-registry-tls" not found Jul 08 23:03:10.084493 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:03:10.084409 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/95b3aab3-2dca-4fc5-9de4-eef31714950d-registry-tls podName:95b3aab3-2dca-4fc5-9de4-eef31714950d nodeName:}" failed. No retries permitted until 2026-07-08 23:03:14.084396602 +0000 UTC m=+44.132670498 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/95b3aab3-2dca-4fc5-9de4-eef31714950d-registry-tls") pod "image-registry-59d44dd9bb-4zrm7" (UID: "95b3aab3-2dca-4fc5-9de4-eef31714950d") : secret "image-registry-tls" not found Jul 08 23:03:10.719621 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:10.719545 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wwbc6" event={"ID":"7d4ee776-7adc-4068-917b-e4c017076d4d","Type":"ContainerStarted","Data":"b5a0426f3d85e80f3ebde4f311fe5517fed3007633202b05ce72857b392ae2f6"} Jul 08 23:03:10.741425 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:10.741368 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-wwbc6" podStartSLOduration=11.191371029999999 podStartE2EDuration="39.741344856s" totalImagesPullingTime="28.549973826s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 23:02:31 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:03:10.739650928 +0000 UTC m=+40.787924831" watchObservedRunningTime="2026-07-08 23:03:10.741344856 +0000 UTC m=+40.789618760" Jul 08 23:03:10.887459 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:10.887420 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tmmqj_b8a428fb-e40d-437f-ae4d-ecd7141e03a5/konnectivity-agent/0.log" limit=1024 Jul 08 23:03:10.964979 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:10.964947 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tmmqj_b8a428fb-e40d-437f-ae4d-ecd7141e03a5/konnectivity-agent/0.log" limit=1024 Jul 08 23:03:11.723176 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:11.723140 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-zknln" event={"ID":"d8ceaaa0-c406-4ac5-9ff4-027bcdb1b508","Type":"ContainerStarted","Data":"2b9d240c9131262c44fe2270a24fbfcdd52dd08c1a6295404001c93ae6df34b8"} Jul 08 23:03:11.739767 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:11.739725 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-zknln" podStartSLOduration=2.52338466 podStartE2EDuration="5.739710793s" totalImagesPullingTime="3.216326133s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:03:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:03:11.739231784 +0000 UTC m=+41.787505688" watchObservedRunningTime="2026-07-08 23:03:11.739710793 +0000 UTC m=+41.787984695" Jul 08 23:03:13.221987 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.221952 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-wtb28"] Jul 08 23:03:13.255885 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.255862 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-7nc87"] Jul 08 23:03:13.256008 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.255978 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-wtb28" Jul 08 23:03:13.258353 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.258337 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-xj6hb\"" Jul 08 23:03:13.270709 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.270692 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-gqzqm"] Jul 08 23:03:13.270826 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.270791 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-7nc87" Jul 08 23:03:13.273040 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.273020 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 08 23:03:13.273155 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.273138 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 08 23:03:13.273370 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.273342 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-9msgc\"" Jul 08 23:03:13.273370 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.273364 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 08 23:03:13.273527 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.273370 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 08 23:03:13.290701 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.290684 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-gqzqm" Jul 08 23:03:13.290787 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.290687 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-wl687"] Jul 08 23:03:13.292874 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.292853 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 08 23:03:13.292994 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.292981 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-fcl2j\"" Jul 08 23:03:13.293126 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.293109 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 08 23:03:13.293223 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.293211 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 08 23:03:13.305322 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.305302 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-wtb28"] Jul 08 23:03:13.305394 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.305330 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-gqzqm"] Jul 08 23:03:13.305394 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.305347 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-7nc87"] Jul 08 23:03:13.305394 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.305365 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-wl687"] Jul 08 23:03:13.305491 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.305400 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-wl687" Jul 08 23:03:13.306259 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.306240 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0763848e-1c09-4df3-a4b8-37e8a00c3ba2-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-7nc87\" (UID: \"0763848e-1c09-4df3-a4b8-37e8a00c3ba2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-7nc87" Jul 08 23:03:13.306317 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.306267 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0763848e-1c09-4df3-a4b8-37e8a00c3ba2-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-7nc87\" (UID: \"0763848e-1c09-4df3-a4b8-37e8a00c3ba2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-7nc87" Jul 08 23:03:13.306317 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.306285 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvhjs\" (UniqueName: \"kubernetes.io/projected/0763848e-1c09-4df3-a4b8-37e8a00c3ba2-kube-api-access-xvhjs\") pod \"kube-storage-version-migrator-operator-846bf668f7-7nc87\" (UID: \"0763848e-1c09-4df3-a4b8-37e8a00c3ba2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-7nc87" Jul 08 23:03:13.306382 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.306312 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pp4gg\" (UniqueName: \"kubernetes.io/projected/03e6221f-5609-44a4-9635-7c99defdf4e1-kube-api-access-pp4gg\") pod \"cluster-samples-operator-56fcf86bf-gqzqm\" (UID: \"03e6221f-5609-44a4-9635-7c99defdf4e1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-gqzqm" Jul 08 23:03:13.306452 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.306430 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/03e6221f-5609-44a4-9635-7c99defdf4e1-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-gqzqm\" (UID: \"03e6221f-5609-44a4-9635-7c99defdf4e1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-gqzqm" Jul 08 23:03:13.306486 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.306467 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fsj79\" (UniqueName: \"kubernetes.io/projected/cc85fe60-ad63-443a-9b7c-d39b1ed167d2-kube-api-access-fsj79\") pod \"network-check-source-989f8b8dc-wtb28\" (UID: \"cc85fe60-ad63-443a-9b7c-d39b1ed167d2\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-wtb28" Jul 08 23:03:13.307649 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.307633 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 08 23:03:13.307867 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.307851 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 08 23:03:13.307935 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.307853 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-cqgvw\"" Jul 08 23:03:13.308097 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.308081 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 08 23:03:13.308176 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.308082 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 08 23:03:13.312087 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.312070 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 08 23:03:13.322772 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.322754 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-h5zzc"] Jul 08 23:03:13.344002 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.343977 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-s5dnv"] Jul 08 23:03:13.344143 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.344106 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-h5zzc" Jul 08 23:03:13.346797 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.346776 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 08 23:03:13.346797 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.346776 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-bkfzx\"" Jul 08 23:03:13.347730 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.347713 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 08 23:03:13.347779 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.347736 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 08 23:03:13.347835 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.347820 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 08 23:03:13.356428 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.356410 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-hfb2g"] Jul 08 23:03:13.356541 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.356528 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-s5dnv" Jul 08 23:03:13.358874 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.358855 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 08 23:03:13.358975 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.358856 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 08 23:03:13.359211 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.359195 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-rwpkf\"" Jul 08 23:03:13.376801 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.376781 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-b7vhr"] Jul 08 23:03:13.376895 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.376881 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-hfb2g" Jul 08 23:03:13.379256 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.379236 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 08 23:03:13.379256 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.379246 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 08 23:03:13.379410 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.379241 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 08 23:03:13.379472 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.379459 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 08 23:03:13.379770 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.379751 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-vvpdn\"" Jul 08 23:03:13.401138 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.401114 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-7c85f98b97-bnhrb"] Jul 08 23:03:13.401232 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.401220 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-b7vhr" Jul 08 23:03:13.403722 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.403702 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 08 23:03:13.403838 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.403795 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-tdp29\"" Jul 08 23:03:13.403838 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.403795 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 08 23:03:13.403838 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.403827 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 08 23:03:13.403991 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.403928 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 08 23:03:13.406789 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.406770 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/820d35fb-fba2-4328-9e2b-0874474cb416-config\") pod \"console-operator-68b757fb67-b7vhr\" (UID: \"820d35fb-fba2-4328-9e2b-0874474cb416\") " pod="openshift-console-operator/console-operator-68b757fb67-b7vhr" Jul 08 23:03:13.406880 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.406803 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pp4gg\" (UniqueName: \"kubernetes.io/projected/03e6221f-5609-44a4-9635-7c99defdf4e1-kube-api-access-pp4gg\") pod \"cluster-samples-operator-56fcf86bf-gqzqm\" (UID: \"03e6221f-5609-44a4-9635-7c99defdf4e1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-gqzqm" Jul 08 23:03:13.406880 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.406837 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/33e501aa-07a6-45eb-a543-897fb2b59fa8-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-hfb2g\" (UID: \"33e501aa-07a6-45eb-a543-897fb2b59fa8\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-hfb2g" Jul 08 23:03:13.406880 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.406869 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x86t6\" (UniqueName: \"kubernetes.io/projected/e4f8810f-3199-4a12-9f3e-696df87448d4-kube-api-access-x86t6\") pod \"cluster-monitoring-operator-64786d9cbb-h5zzc\" (UID: \"e4f8810f-3199-4a12-9f3e-696df87448d4\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-h5zzc" Jul 08 23:03:13.407071 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.406900 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/4ed7b90f-7d34-4d31-b1fb-276d9906fc64-snapshots\") pod \"insights-operator-5c847dcfc4-wl687\" (UID: \"4ed7b90f-7d34-4d31-b1fb-276d9906fc64\") " pod="openshift-insights/insights-operator-5c847dcfc4-wl687" Jul 08 23:03:13.407071 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.406929 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrdj9\" (UniqueName: \"kubernetes.io/projected/4ed7b90f-7d34-4d31-b1fb-276d9906fc64-kube-api-access-hrdj9\") pod \"insights-operator-5c847dcfc4-wl687\" (UID: \"4ed7b90f-7d34-4d31-b1fb-276d9906fc64\") " pod="openshift-insights/insights-operator-5c847dcfc4-wl687" Jul 08 23:03:13.407071 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.406956 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c85sl\" (UniqueName: \"kubernetes.io/projected/33e501aa-07a6-45eb-a543-897fb2b59fa8-kube-api-access-c85sl\") pod \"service-ca-operator-5d46d9ffd4-hfb2g\" (UID: \"33e501aa-07a6-45eb-a543-897fb2b59fa8\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-hfb2g" Jul 08 23:03:13.407071 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.406987 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/03e6221f-5609-44a4-9635-7c99defdf4e1-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-gqzqm\" (UID: \"03e6221f-5609-44a4-9635-7c99defdf4e1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-gqzqm" Jul 08 23:03:13.407071 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.407013 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ct92q\" (UniqueName: \"kubernetes.io/projected/820d35fb-fba2-4328-9e2b-0874474cb416-kube-api-access-ct92q\") pod \"console-operator-68b757fb67-b7vhr\" (UID: \"820d35fb-fba2-4328-9e2b-0874474cb416\") " pod="openshift-console-operator/console-operator-68b757fb67-b7vhr" Jul 08 23:03:13.407071 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.407036 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4ed7b90f-7d34-4d31-b1fb-276d9906fc64-tmp\") pod \"insights-operator-5c847dcfc4-wl687\" (UID: \"4ed7b90f-7d34-4d31-b1fb-276d9906fc64\") " pod="openshift-insights/insights-operator-5c847dcfc4-wl687" Jul 08 23:03:13.407071 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:03:13.407082 2574 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 08 23:03:13.407464 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.407108 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/820d35fb-fba2-4328-9e2b-0874474cb416-serving-cert\") pod \"console-operator-68b757fb67-b7vhr\" (UID: \"820d35fb-fba2-4328-9e2b-0874474cb416\") " pod="openshift-console-operator/console-operator-68b757fb67-b7vhr" Jul 08 23:03:13.407464 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:03:13.407156 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03e6221f-5609-44a4-9635-7c99defdf4e1-samples-operator-tls podName:03e6221f-5609-44a4-9635-7c99defdf4e1 nodeName:}" failed. No retries permitted until 2026-07-08 23:03:13.907142684 +0000 UTC m=+43.955416568 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/03e6221f-5609-44a4-9635-7c99defdf4e1-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-gqzqm" (UID: "03e6221f-5609-44a4-9635-7c99defdf4e1") : secret "samples-operator-tls" not found Jul 08 23:03:13.407464 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.407170 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ed7b90f-7d34-4d31-b1fb-276d9906fc64-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-wl687\" (UID: \"4ed7b90f-7d34-4d31-b1fb-276d9906fc64\") " pod="openshift-insights/insights-operator-5c847dcfc4-wl687" Jul 08 23:03:13.407464 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.407189 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ed7b90f-7d34-4d31-b1fb-276d9906fc64-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-wl687\" (UID: \"4ed7b90f-7d34-4d31-b1fb-276d9906fc64\") " pod="openshift-insights/insights-operator-5c847dcfc4-wl687" Jul 08 23:03:13.407464 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.407208 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fsj79\" (UniqueName: \"kubernetes.io/projected/cc85fe60-ad63-443a-9b7c-d39b1ed167d2-kube-api-access-fsj79\") pod \"network-check-source-989f8b8dc-wtb28\" (UID: \"cc85fe60-ad63-443a-9b7c-d39b1ed167d2\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-wtb28" Jul 08 23:03:13.407464 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.407278 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0763848e-1c09-4df3-a4b8-37e8a00c3ba2-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-7nc87\" (UID: \"0763848e-1c09-4df3-a4b8-37e8a00c3ba2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-7nc87" Jul 08 23:03:13.407464 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.407305 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0763848e-1c09-4df3-a4b8-37e8a00c3ba2-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-7nc87\" (UID: \"0763848e-1c09-4df3-a4b8-37e8a00c3ba2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-7nc87" Jul 08 23:03:13.407464 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.407430 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/33e501aa-07a6-45eb-a543-897fb2b59fa8-config\") pod \"service-ca-operator-5d46d9ffd4-hfb2g\" (UID: \"33e501aa-07a6-45eb-a543-897fb2b59fa8\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-hfb2g" Jul 08 23:03:13.407824 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.407474 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e4f8810f-3199-4a12-9f3e-696df87448d4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-h5zzc\" (UID: \"e4f8810f-3199-4a12-9f3e-696df87448d4\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-h5zzc" Jul 08 23:03:13.407824 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.407505 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/55cfa647-c40e-4556-b295-ad4fb60fde44-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-s5dnv\" (UID: \"55cfa647-c40e-4556-b295-ad4fb60fde44\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-s5dnv" Jul 08 23:03:13.407824 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.407549 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/820d35fb-fba2-4328-9e2b-0874474cb416-trusted-ca\") pod \"console-operator-68b757fb67-b7vhr\" (UID: \"820d35fb-fba2-4328-9e2b-0874474cb416\") " pod="openshift-console-operator/console-operator-68b757fb67-b7vhr" Jul 08 23:03:13.407824 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.407590 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4ed7b90f-7d34-4d31-b1fb-276d9906fc64-serving-cert\") pod \"insights-operator-5c847dcfc4-wl687\" (UID: \"4ed7b90f-7d34-4d31-b1fb-276d9906fc64\") " pod="openshift-insights/insights-operator-5c847dcfc4-wl687" Jul 08 23:03:13.407824 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.407701 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/e4f8810f-3199-4a12-9f3e-696df87448d4-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-h5zzc\" (UID: \"e4f8810f-3199-4a12-9f3e-696df87448d4\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-h5zzc" Jul 08 23:03:13.407824 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.407761 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/55cfa647-c40e-4556-b295-ad4fb60fde44-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-s5dnv\" (UID: \"55cfa647-c40e-4556-b295-ad4fb60fde44\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-s5dnv" Jul 08 23:03:13.407824 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.407807 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0763848e-1c09-4df3-a4b8-37e8a00c3ba2-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-7nc87\" (UID: \"0763848e-1c09-4df3-a4b8-37e8a00c3ba2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-7nc87" Jul 08 23:03:13.407824 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.407814 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvhjs\" (UniqueName: \"kubernetes.io/projected/0763848e-1c09-4df3-a4b8-37e8a00c3ba2-kube-api-access-xvhjs\") pod \"kube-storage-version-migrator-operator-846bf668f7-7nc87\" (UID: \"0763848e-1c09-4df3-a4b8-37e8a00c3ba2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-7nc87" Jul 08 23:03:13.410449 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.410317 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 08 23:03:13.411940 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.411924 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0763848e-1c09-4df3-a4b8-37e8a00c3ba2-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-7nc87\" (UID: \"0763848e-1c09-4df3-a4b8-37e8a00c3ba2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-7nc87" Jul 08 23:03:13.419925 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.419807 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pp4gg\" (UniqueName: \"kubernetes.io/projected/03e6221f-5609-44a4-9635-7c99defdf4e1-kube-api-access-pp4gg\") pod \"cluster-samples-operator-56fcf86bf-gqzqm\" (UID: \"03e6221f-5609-44a4-9635-7c99defdf4e1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-gqzqm" Jul 08 23:03:13.422869 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.422852 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-s5dnv"] Jul 08 23:03:13.422979 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.422887 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-h5zzc"] Jul 08 23:03:13.422979 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.422907 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-hfb2g"] Jul 08 23:03:13.422979 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.422934 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fsj79\" (UniqueName: \"kubernetes.io/projected/cc85fe60-ad63-443a-9b7c-d39b1ed167d2-kube-api-access-fsj79\") pod \"network-check-source-989f8b8dc-wtb28\" (UID: \"cc85fe60-ad63-443a-9b7c-d39b1ed167d2\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-wtb28" Jul 08 23:03:13.422979 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.422956 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-b7vhr"] Jul 08 23:03:13.422979 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.422977 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7c85f98b97-bnhrb"] Jul 08 23:03:13.423275 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.423068 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7c85f98b97-bnhrb" Jul 08 23:03:13.424334 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.424319 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-z56vz"] Jul 08 23:03:13.425569 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.425551 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 08 23:03:13.426001 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.425983 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-fbqrd\"" Jul 08 23:03:13.426061 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.425995 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 08 23:03:13.426397 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.426379 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 08 23:03:13.426474 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.426425 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 08 23:03:13.426629 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.426609 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 08 23:03:13.426709 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.426633 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 08 23:03:13.427094 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.427074 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvhjs\" (UniqueName: \"kubernetes.io/projected/0763848e-1c09-4df3-a4b8-37e8a00c3ba2-kube-api-access-xvhjs\") pod \"kube-storage-version-migrator-operator-846bf668f7-7nc87\" (UID: \"0763848e-1c09-4df3-a4b8-37e8a00c3ba2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-7nc87" Jul 08 23:03:13.447137 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.447119 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-z56vz"] Jul 08 23:03:13.447228 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.447190 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-z56vz" Jul 08 23:03:13.449537 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.449521 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-fvrjz\"" Jul 08 23:03:13.449614 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.449601 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 08 23:03:13.449718 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.449703 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 08 23:03:13.455281 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.455257 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tmmqj_b8a428fb-e40d-437f-ae4d-ecd7141e03a5/konnectivity-agent/0.log" limit=1024 Jul 08 23:03:13.508289 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.508202 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/820d35fb-fba2-4328-9e2b-0874474cb416-config\") pod \"console-operator-68b757fb67-b7vhr\" (UID: \"820d35fb-fba2-4328-9e2b-0874474cb416\") " pod="openshift-console-operator/console-operator-68b757fb67-b7vhr" Jul 08 23:03:13.508289 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.508240 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/33e501aa-07a6-45eb-a543-897fb2b59fa8-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-hfb2g\" (UID: \"33e501aa-07a6-45eb-a543-897fb2b59fa8\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-hfb2g" Jul 08 23:03:13.508289 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.508262 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/2edaad22-d491-4a9c-ae1f-eb9f87b42986-default-certificate\") pod \"router-default-7c85f98b97-bnhrb\" (UID: \"2edaad22-d491-4a9c-ae1f-eb9f87b42986\") " pod="openshift-ingress/router-default-7c85f98b97-bnhrb" Jul 08 23:03:13.508586 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.508327 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x86t6\" (UniqueName: \"kubernetes.io/projected/e4f8810f-3199-4a12-9f3e-696df87448d4-kube-api-access-x86t6\") pod \"cluster-monitoring-operator-64786d9cbb-h5zzc\" (UID: \"e4f8810f-3199-4a12-9f3e-696df87448d4\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-h5zzc" Jul 08 23:03:13.508586 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.508358 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/4ed7b90f-7d34-4d31-b1fb-276d9906fc64-snapshots\") pod \"insights-operator-5c847dcfc4-wl687\" (UID: \"4ed7b90f-7d34-4d31-b1fb-276d9906fc64\") " pod="openshift-insights/insights-operator-5c847dcfc4-wl687" Jul 08 23:03:13.508586 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.508374 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrdj9\" (UniqueName: \"kubernetes.io/projected/4ed7b90f-7d34-4d31-b1fb-276d9906fc64-kube-api-access-hrdj9\") pod \"insights-operator-5c847dcfc4-wl687\" (UID: \"4ed7b90f-7d34-4d31-b1fb-276d9906fc64\") " pod="openshift-insights/insights-operator-5c847dcfc4-wl687" Jul 08 23:03:13.508586 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.508392 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c85sl\" (UniqueName: \"kubernetes.io/projected/33e501aa-07a6-45eb-a543-897fb2b59fa8-kube-api-access-c85sl\") pod \"service-ca-operator-5d46d9ffd4-hfb2g\" (UID: \"33e501aa-07a6-45eb-a543-897fb2b59fa8\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-hfb2g" Jul 08 23:03:13.508586 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.508415 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/2edaad22-d491-4a9c-ae1f-eb9f87b42986-stats-auth\") pod \"router-default-7c85f98b97-bnhrb\" (UID: \"2edaad22-d491-4a9c-ae1f-eb9f87b42986\") " pod="openshift-ingress/router-default-7c85f98b97-bnhrb" Jul 08 23:03:13.508586 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.508454 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ct92q\" (UniqueName: \"kubernetes.io/projected/820d35fb-fba2-4328-9e2b-0874474cb416-kube-api-access-ct92q\") pod \"console-operator-68b757fb67-b7vhr\" (UID: \"820d35fb-fba2-4328-9e2b-0874474cb416\") " pod="openshift-console-operator/console-operator-68b757fb67-b7vhr" Jul 08 23:03:13.508586 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.508477 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4ed7b90f-7d34-4d31-b1fb-276d9906fc64-tmp\") pod \"insights-operator-5c847dcfc4-wl687\" (UID: \"4ed7b90f-7d34-4d31-b1fb-276d9906fc64\") " pod="openshift-insights/insights-operator-5c847dcfc4-wl687" Jul 08 23:03:13.508586 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.508502 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4skw\" (UniqueName: \"kubernetes.io/projected/61d74e97-1a73-4512-8b91-047aaae34a2d-kube-api-access-w4skw\") pod \"volume-data-source-validator-5d456fdbcd-z56vz\" (UID: \"61d74e97-1a73-4512-8b91-047aaae34a2d\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-z56vz" Jul 08 23:03:13.508586 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.508549 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/820d35fb-fba2-4328-9e2b-0874474cb416-serving-cert\") pod \"console-operator-68b757fb67-b7vhr\" (UID: \"820d35fb-fba2-4328-9e2b-0874474cb416\") " pod="openshift-console-operator/console-operator-68b757fb67-b7vhr" Jul 08 23:03:13.508586 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.508574 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ed7b90f-7d34-4d31-b1fb-276d9906fc64-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-wl687\" (UID: \"4ed7b90f-7d34-4d31-b1fb-276d9906fc64\") " pod="openshift-insights/insights-operator-5c847dcfc4-wl687" Jul 08 23:03:13.509095 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.508595 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2edaad22-d491-4a9c-ae1f-eb9f87b42986-metrics-certs\") pod \"router-default-7c85f98b97-bnhrb\" (UID: \"2edaad22-d491-4a9c-ae1f-eb9f87b42986\") " pod="openshift-ingress/router-default-7c85f98b97-bnhrb" Jul 08 23:03:13.509095 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.508625 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ed7b90f-7d34-4d31-b1fb-276d9906fc64-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-wl687\" (UID: \"4ed7b90f-7d34-4d31-b1fb-276d9906fc64\") " pod="openshift-insights/insights-operator-5c847dcfc4-wl687" Jul 08 23:03:13.509095 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.508648 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2edaad22-d491-4a9c-ae1f-eb9f87b42986-service-ca-bundle\") pod \"router-default-7c85f98b97-bnhrb\" (UID: \"2edaad22-d491-4a9c-ae1f-eb9f87b42986\") " pod="openshift-ingress/router-default-7c85f98b97-bnhrb" Jul 08 23:03:13.509095 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.509002 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/33e501aa-07a6-45eb-a543-897fb2b59fa8-config\") pod \"service-ca-operator-5d46d9ffd4-hfb2g\" (UID: \"33e501aa-07a6-45eb-a543-897fb2b59fa8\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-hfb2g" Jul 08 23:03:13.509095 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.509048 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e4f8810f-3199-4a12-9f3e-696df87448d4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-h5zzc\" (UID: \"e4f8810f-3199-4a12-9f3e-696df87448d4\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-h5zzc" Jul 08 23:03:13.509095 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.509069 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/820d35fb-fba2-4328-9e2b-0874474cb416-config\") pod \"console-operator-68b757fb67-b7vhr\" (UID: \"820d35fb-fba2-4328-9e2b-0874474cb416\") " pod="openshift-console-operator/console-operator-68b757fb67-b7vhr" Jul 08 23:03:13.509095 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.509080 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/55cfa647-c40e-4556-b295-ad4fb60fde44-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-s5dnv\" (UID: \"55cfa647-c40e-4556-b295-ad4fb60fde44\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-s5dnv" Jul 08 23:03:13.509437 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.509104 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/4ed7b90f-7d34-4d31-b1fb-276d9906fc64-snapshots\") pod \"insights-operator-5c847dcfc4-wl687\" (UID: \"4ed7b90f-7d34-4d31-b1fb-276d9906fc64\") " pod="openshift-insights/insights-operator-5c847dcfc4-wl687" Jul 08 23:03:13.509437 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.509112 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/820d35fb-fba2-4328-9e2b-0874474cb416-trusted-ca\") pod \"console-operator-68b757fb67-b7vhr\" (UID: \"820d35fb-fba2-4328-9e2b-0874474cb416\") " pod="openshift-console-operator/console-operator-68b757fb67-b7vhr" Jul 08 23:03:13.509437 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.509141 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4ed7b90f-7d34-4d31-b1fb-276d9906fc64-serving-cert\") pod \"insights-operator-5c847dcfc4-wl687\" (UID: \"4ed7b90f-7d34-4d31-b1fb-276d9906fc64\") " pod="openshift-insights/insights-operator-5c847dcfc4-wl687" Jul 08 23:03:13.509437 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:03:13.509221 2574 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 08 23:03:13.509437 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:03:13.509289 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/55cfa647-c40e-4556-b295-ad4fb60fde44-networking-console-plugin-cert podName:55cfa647-c40e-4556-b295-ad4fb60fde44 nodeName:}" failed. No retries permitted until 2026-07-08 23:03:14.009264219 +0000 UTC m=+44.057538105 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/55cfa647-c40e-4556-b295-ad4fb60fde44-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-s5dnv" (UID: "55cfa647-c40e-4556-b295-ad4fb60fde44") : secret "networking-console-plugin-cert" not found Jul 08 23:03:13.509437 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.509293 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4ed7b90f-7d34-4d31-b1fb-276d9906fc64-tmp\") pod \"insights-operator-5c847dcfc4-wl687\" (UID: \"4ed7b90f-7d34-4d31-b1fb-276d9906fc64\") " pod="openshift-insights/insights-operator-5c847dcfc4-wl687" Jul 08 23:03:13.509437 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.509223 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ed7b90f-7d34-4d31-b1fb-276d9906fc64-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-wl687\" (UID: \"4ed7b90f-7d34-4d31-b1fb-276d9906fc64\") " pod="openshift-insights/insights-operator-5c847dcfc4-wl687" Jul 08 23:03:13.509437 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.509329 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/e4f8810f-3199-4a12-9f3e-696df87448d4-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-h5zzc\" (UID: \"e4f8810f-3199-4a12-9f3e-696df87448d4\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-h5zzc" Jul 08 23:03:13.509852 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.509497 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wsqr8\" (UniqueName: \"kubernetes.io/projected/2edaad22-d491-4a9c-ae1f-eb9f87b42986-kube-api-access-wsqr8\") pod \"router-default-7c85f98b97-bnhrb\" (UID: \"2edaad22-d491-4a9c-ae1f-eb9f87b42986\") " pod="openshift-ingress/router-default-7c85f98b97-bnhrb" Jul 08 23:03:13.509852 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.509554 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/55cfa647-c40e-4556-b295-ad4fb60fde44-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-s5dnv\" (UID: \"55cfa647-c40e-4556-b295-ad4fb60fde44\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-s5dnv" Jul 08 23:03:13.509852 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.509687 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ed7b90f-7d34-4d31-b1fb-276d9906fc64-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-wl687\" (UID: \"4ed7b90f-7d34-4d31-b1fb-276d9906fc64\") " pod="openshift-insights/insights-operator-5c847dcfc4-wl687" Jul 08 23:03:13.509852 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.509767 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/33e501aa-07a6-45eb-a543-897fb2b59fa8-config\") pod \"service-ca-operator-5d46d9ffd4-hfb2g\" (UID: \"33e501aa-07a6-45eb-a543-897fb2b59fa8\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-hfb2g" Jul 08 23:03:13.509852 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:03:13.509789 2574 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 08 23:03:13.510105 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:03:13.509896 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4f8810f-3199-4a12-9f3e-696df87448d4-cluster-monitoring-operator-tls podName:e4f8810f-3199-4a12-9f3e-696df87448d4 nodeName:}" failed. No retries permitted until 2026-07-08 23:03:14.00987548 +0000 UTC m=+44.058149376 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e4f8810f-3199-4a12-9f3e-696df87448d4-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-h5zzc" (UID: "e4f8810f-3199-4a12-9f3e-696df87448d4") : secret "cluster-monitoring-operator-tls" not found Jul 08 23:03:13.510105 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.510071 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/e4f8810f-3199-4a12-9f3e-696df87448d4-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-h5zzc\" (UID: \"e4f8810f-3199-4a12-9f3e-696df87448d4\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-h5zzc" Jul 08 23:03:13.510215 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.510099 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/820d35fb-fba2-4328-9e2b-0874474cb416-trusted-ca\") pod \"console-operator-68b757fb67-b7vhr\" (UID: \"820d35fb-fba2-4328-9e2b-0874474cb416\") " pod="openshift-console-operator/console-operator-68b757fb67-b7vhr" Jul 08 23:03:13.510215 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.510200 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/55cfa647-c40e-4556-b295-ad4fb60fde44-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-s5dnv\" (UID: \"55cfa647-c40e-4556-b295-ad4fb60fde44\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-s5dnv" Jul 08 23:03:13.510873 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.510855 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/33e501aa-07a6-45eb-a543-897fb2b59fa8-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-hfb2g\" (UID: \"33e501aa-07a6-45eb-a543-897fb2b59fa8\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-hfb2g" Jul 08 23:03:13.511252 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.511238 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/820d35fb-fba2-4328-9e2b-0874474cb416-serving-cert\") pod \"console-operator-68b757fb67-b7vhr\" (UID: \"820d35fb-fba2-4328-9e2b-0874474cb416\") " pod="openshift-console-operator/console-operator-68b757fb67-b7vhr" Jul 08 23:03:13.512169 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.512142 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4ed7b90f-7d34-4d31-b1fb-276d9906fc64-serving-cert\") pod \"insights-operator-5c847dcfc4-wl687\" (UID: \"4ed7b90f-7d34-4d31-b1fb-276d9906fc64\") " pod="openshift-insights/insights-operator-5c847dcfc4-wl687" Jul 08 23:03:13.519252 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.519231 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ct92q\" (UniqueName: \"kubernetes.io/projected/820d35fb-fba2-4328-9e2b-0874474cb416-kube-api-access-ct92q\") pod \"console-operator-68b757fb67-b7vhr\" (UID: \"820d35fb-fba2-4328-9e2b-0874474cb416\") " pod="openshift-console-operator/console-operator-68b757fb67-b7vhr" Jul 08 23:03:13.519646 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.519624 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c85sl\" (UniqueName: \"kubernetes.io/projected/33e501aa-07a6-45eb-a543-897fb2b59fa8-kube-api-access-c85sl\") pod \"service-ca-operator-5d46d9ffd4-hfb2g\" (UID: \"33e501aa-07a6-45eb-a543-897fb2b59fa8\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-hfb2g" Jul 08 23:03:13.519949 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.519932 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrdj9\" (UniqueName: \"kubernetes.io/projected/4ed7b90f-7d34-4d31-b1fb-276d9906fc64-kube-api-access-hrdj9\") pod \"insights-operator-5c847dcfc4-wl687\" (UID: \"4ed7b90f-7d34-4d31-b1fb-276d9906fc64\") " pod="openshift-insights/insights-operator-5c847dcfc4-wl687" Jul 08 23:03:13.520011 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.519976 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x86t6\" (UniqueName: \"kubernetes.io/projected/e4f8810f-3199-4a12-9f3e-696df87448d4-kube-api-access-x86t6\") pod \"cluster-monitoring-operator-64786d9cbb-h5zzc\" (UID: \"e4f8810f-3199-4a12-9f3e-696df87448d4\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-h5zzc" Jul 08 23:03:13.553765 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.553739 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tmmqj_b8a428fb-e40d-437f-ae4d-ecd7141e03a5/konnectivity-agent/0.log" limit=1024 Jul 08 23:03:13.565397 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.565374 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-wtb28" Jul 08 23:03:13.578585 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.578561 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-7nc87" Jul 08 23:03:13.610125 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.610104 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wsqr8\" (UniqueName: \"kubernetes.io/projected/2edaad22-d491-4a9c-ae1f-eb9f87b42986-kube-api-access-wsqr8\") pod \"router-default-7c85f98b97-bnhrb\" (UID: \"2edaad22-d491-4a9c-ae1f-eb9f87b42986\") " pod="openshift-ingress/router-default-7c85f98b97-bnhrb" Jul 08 23:03:13.610215 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.610165 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/2edaad22-d491-4a9c-ae1f-eb9f87b42986-default-certificate\") pod \"router-default-7c85f98b97-bnhrb\" (UID: \"2edaad22-d491-4a9c-ae1f-eb9f87b42986\") " pod="openshift-ingress/router-default-7c85f98b97-bnhrb" Jul 08 23:03:13.610215 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.610193 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/2edaad22-d491-4a9c-ae1f-eb9f87b42986-stats-auth\") pod \"router-default-7c85f98b97-bnhrb\" (UID: \"2edaad22-d491-4a9c-ae1f-eb9f87b42986\") " pod="openshift-ingress/router-default-7c85f98b97-bnhrb" Jul 08 23:03:13.610310 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.610228 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w4skw\" (UniqueName: \"kubernetes.io/projected/61d74e97-1a73-4512-8b91-047aaae34a2d-kube-api-access-w4skw\") pod \"volume-data-source-validator-5d456fdbcd-z56vz\" (UID: \"61d74e97-1a73-4512-8b91-047aaae34a2d\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-z56vz" Jul 08 23:03:13.610385 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.610355 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2edaad22-d491-4a9c-ae1f-eb9f87b42986-metrics-certs\") pod \"router-default-7c85f98b97-bnhrb\" (UID: \"2edaad22-d491-4a9c-ae1f-eb9f87b42986\") " pod="openshift-ingress/router-default-7c85f98b97-bnhrb" Jul 08 23:03:13.610501 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.610406 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2edaad22-d491-4a9c-ae1f-eb9f87b42986-service-ca-bundle\") pod \"router-default-7c85f98b97-bnhrb\" (UID: \"2edaad22-d491-4a9c-ae1f-eb9f87b42986\") " pod="openshift-ingress/router-default-7c85f98b97-bnhrb" Jul 08 23:03:13.610501 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:03:13.610464 2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 08 23:03:13.610645 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:03:13.610568 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2edaad22-d491-4a9c-ae1f-eb9f87b42986-metrics-certs podName:2edaad22-d491-4a9c-ae1f-eb9f87b42986 nodeName:}" failed. No retries permitted until 2026-07-08 23:03:14.110547357 +0000 UTC m=+44.158821243 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2edaad22-d491-4a9c-ae1f-eb9f87b42986-metrics-certs") pod "router-default-7c85f98b97-bnhrb" (UID: "2edaad22-d491-4a9c-ae1f-eb9f87b42986") : secret "router-metrics-certs-default" not found Jul 08 23:03:13.610645 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:03:13.610608 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2edaad22-d491-4a9c-ae1f-eb9f87b42986-service-ca-bundle podName:2edaad22-d491-4a9c-ae1f-eb9f87b42986 nodeName:}" failed. No retries permitted until 2026-07-08 23:03:14.110588873 +0000 UTC m=+44.158862776 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2edaad22-d491-4a9c-ae1f-eb9f87b42986-service-ca-bundle") pod "router-default-7c85f98b97-bnhrb" (UID: "2edaad22-d491-4a9c-ae1f-eb9f87b42986") : configmap references non-existent config key: service-ca.crt Jul 08 23:03:13.612583 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.612563 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/2edaad22-d491-4a9c-ae1f-eb9f87b42986-stats-auth\") pod \"router-default-7c85f98b97-bnhrb\" (UID: \"2edaad22-d491-4a9c-ae1f-eb9f87b42986\") " pod="openshift-ingress/router-default-7c85f98b97-bnhrb" Jul 08 23:03:13.612653 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.612586 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/2edaad22-d491-4a9c-ae1f-eb9f87b42986-default-certificate\") pod \"router-default-7c85f98b97-bnhrb\" (UID: \"2edaad22-d491-4a9c-ae1f-eb9f87b42986\") " pod="openshift-ingress/router-default-7c85f98b97-bnhrb" Jul 08 23:03:13.614564 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.614541 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-wl687" Jul 08 23:03:13.621316 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.621290 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wsqr8\" (UniqueName: \"kubernetes.io/projected/2edaad22-d491-4a9c-ae1f-eb9f87b42986-kube-api-access-wsqr8\") pod \"router-default-7c85f98b97-bnhrb\" (UID: \"2edaad22-d491-4a9c-ae1f-eb9f87b42986\") " pod="openshift-ingress/router-default-7c85f98b97-bnhrb" Jul 08 23:03:13.621418 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.621400 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4skw\" (UniqueName: \"kubernetes.io/projected/61d74e97-1a73-4512-8b91-047aaae34a2d-kube-api-access-w4skw\") pod \"volume-data-source-validator-5d456fdbcd-z56vz\" (UID: \"61d74e97-1a73-4512-8b91-047aaae34a2d\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-z56vz" Jul 08 23:03:13.654527 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.654473 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tmmqj_b8a428fb-e40d-437f-ae4d-ecd7141e03a5/konnectivity-agent/0.log" limit=1024 Jul 08 23:03:13.685171 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.685133 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-hfb2g" Jul 08 23:03:13.713644 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.713076 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-b7vhr" Jul 08 23:03:13.741011 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.740908 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-wtb28"] Jul 08 23:03:13.744477 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.744370 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tmmqj_b8a428fb-e40d-437f-ae4d-ecd7141e03a5/konnectivity-agent/0.log" limit=1024 Jul 08 23:03:13.744910 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:03:13.744881 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc85fe60_ad63_443a_9b7c_d39b1ed167d2.slice/crio-daaba9774498724304bf94e6782ce7798d35c2ff381045f16bc24aa305a1a058 WatchSource:0}: Error finding container daaba9774498724304bf94e6782ce7798d35c2ff381045f16bc24aa305a1a058: Status 404 returned error can't find the container with id daaba9774498724304bf94e6782ce7798d35c2ff381045f16bc24aa305a1a058 Jul 08 23:03:13.758817 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.758740 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-z56vz" Jul 08 23:03:13.760705 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.760670 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-7nc87"] Jul 08 23:03:13.763982 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:03:13.763932 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0763848e_1c09_4df3_a4b8_37e8a00c3ba2.slice/crio-dd83994362c1ef2f609f0e1c831d448dd668b128046c6259bea7ee625112334e WatchSource:0}: Error finding container dd83994362c1ef2f609f0e1c831d448dd668b128046c6259bea7ee625112334e: Status 404 returned error can't find the container with id dd83994362c1ef2f609f0e1c831d448dd668b128046c6259bea7ee625112334e Jul 08 23:03:13.790943 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.790571 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-wl687"] Jul 08 23:03:13.794695 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:03:13.794656 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ed7b90f_7d34_4d31_b1fb_276d9906fc64.slice/crio-eae0cafae1e884500b75d87d622dc8f5ed0acd7e349d60a9361f5fc5b80d9480 WatchSource:0}: Error finding container eae0cafae1e884500b75d87d622dc8f5ed0acd7e349d60a9361f5fc5b80d9480: Status 404 returned error can't find the container with id eae0cafae1e884500b75d87d622dc8f5ed0acd7e349d60a9361f5fc5b80d9480 Jul 08 23:03:13.856051 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.856017 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-hfb2g"] Jul 08 23:03:13.859499 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:03:13.859471 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33e501aa_07a6_45eb_a543_897fb2b59fa8.slice/crio-e6cecd9ea7e042a134758910a0027c2c6c9bc7afa02b74d9332f221338646551 WatchSource:0}: Error finding container e6cecd9ea7e042a134758910a0027c2c6c9bc7afa02b74d9332f221338646551: Status 404 returned error can't find the container with id e6cecd9ea7e042a134758910a0027c2c6c9bc7afa02b74d9332f221338646551 Jul 08 23:03:13.883575 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.883486 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-b7vhr"] Jul 08 23:03:13.886663 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:03:13.886639 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod820d35fb_fba2_4328_9e2b_0874474cb416.slice/crio-a6cc8f035d993d21dc3b48c9b4cefba7873397a88752985283f803d607403adf WatchSource:0}: Error finding container a6cc8f035d993d21dc3b48c9b4cefba7873397a88752985283f803d607403adf: Status 404 returned error can't find the container with id a6cc8f035d993d21dc3b48c9b4cefba7873397a88752985283f803d607403adf Jul 08 23:03:13.916941 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.916914 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/03e6221f-5609-44a4-9635-7c99defdf4e1-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-gqzqm\" (UID: \"03e6221f-5609-44a4-9635-7c99defdf4e1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-gqzqm" Jul 08 23:03:13.917138 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:03:13.917096 2574 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 08 23:03:13.917138 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:03:13.917169 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03e6221f-5609-44a4-9635-7c99defdf4e1-samples-operator-tls podName:03e6221f-5609-44a4-9635-7c99defdf4e1 nodeName:}" failed. No retries permitted until 2026-07-08 23:03:14.917146712 +0000 UTC m=+44.965420593 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/03e6221f-5609-44a4-9635-7c99defdf4e1-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-gqzqm" (UID: "03e6221f-5609-44a4-9635-7c99defdf4e1") : secret "samples-operator-tls" not found Jul 08 23:03:13.918470 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:13.918450 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-z56vz"] Jul 08 23:03:13.921005 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:03:13.920989 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61d74e97_1a73_4512_8b91_047aaae34a2d.slice/crio-b762582a3d76e20ac2ff8e2ebb8e1df745855f48cf02d2a4e9ffae2cb0032c90 WatchSource:0}: Error finding container b762582a3d76e20ac2ff8e2ebb8e1df745855f48cf02d2a4e9ffae2cb0032c90: Status 404 returned error can't find the container with id b762582a3d76e20ac2ff8e2ebb8e1df745855f48cf02d2a4e9ffae2cb0032c90 Jul 08 23:03:14.017399 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:14.017350 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e4f8810f-3199-4a12-9f3e-696df87448d4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-h5zzc\" (UID: \"e4f8810f-3199-4a12-9f3e-696df87448d4\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-h5zzc" Jul 08 23:03:14.017399 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:14.017377 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/55cfa647-c40e-4556-b295-ad4fb60fde44-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-s5dnv\" (UID: \"55cfa647-c40e-4556-b295-ad4fb60fde44\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-s5dnv" Jul 08 23:03:14.017556 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:03:14.017466 2574 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 08 23:03:14.017556 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:03:14.017485 2574 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 08 23:03:14.017556 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:03:14.017532 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/55cfa647-c40e-4556-b295-ad4fb60fde44-networking-console-plugin-cert podName:55cfa647-c40e-4556-b295-ad4fb60fde44 nodeName:}" failed. No retries permitted until 2026-07-08 23:03:15.017496997 +0000 UTC m=+45.065770880 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/55cfa647-c40e-4556-b295-ad4fb60fde44-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-s5dnv" (UID: "55cfa647-c40e-4556-b295-ad4fb60fde44") : secret "networking-console-plugin-cert" not found Jul 08 23:03:14.017556 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:03:14.017549 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4f8810f-3199-4a12-9f3e-696df87448d4-cluster-monitoring-operator-tls podName:e4f8810f-3199-4a12-9f3e-696df87448d4 nodeName:}" failed. No retries permitted until 2026-07-08 23:03:15.01754111 +0000 UTC m=+45.065814991 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e4f8810f-3199-4a12-9f3e-696df87448d4-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-h5zzc" (UID: "e4f8810f-3199-4a12-9f3e-696df87448d4") : secret "cluster-monitoring-operator-tls" not found Jul 08 23:03:14.118710 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:14.118686 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2edaad22-d491-4a9c-ae1f-eb9f87b42986-metrics-certs\") pod \"router-default-7c85f98b97-bnhrb\" (UID: \"2edaad22-d491-4a9c-ae1f-eb9f87b42986\") " pod="openshift-ingress/router-default-7c85f98b97-bnhrb" Jul 08 23:03:14.118788 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:14.118714 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2edaad22-d491-4a9c-ae1f-eb9f87b42986-service-ca-bundle\") pod \"router-default-7c85f98b97-bnhrb\" (UID: \"2edaad22-d491-4a9c-ae1f-eb9f87b42986\") " pod="openshift-ingress/router-default-7c85f98b97-bnhrb" Jul 08 23:03:14.118788 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:14.118738 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/95b3aab3-2dca-4fc5-9de4-eef31714950d-registry-tls\") pod \"image-registry-59d44dd9bb-4zrm7\" (UID: \"95b3aab3-2dca-4fc5-9de4-eef31714950d\") " pod="openshift-image-registry/image-registry-59d44dd9bb-4zrm7" Jul 08 23:03:14.118862 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:14.118792 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4798cc78-68f0-447d-8ac9-b4b71ee8801d-metrics-tls\") pod \"dns-default-pr92b\" (UID: \"4798cc78-68f0-447d-8ac9-b4b71ee8801d\") " pod="openshift-dns/dns-default-pr92b" Jul 08 23:03:14.118862 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:03:14.118821 2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 08 23:03:14.118862 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:03:14.118853 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2edaad22-d491-4a9c-ae1f-eb9f87b42986-service-ca-bundle podName:2edaad22-d491-4a9c-ae1f-eb9f87b42986 nodeName:}" failed. No retries permitted until 2026-07-08 23:03:15.118834237 +0000 UTC m=+45.167108118 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2edaad22-d491-4a9c-ae1f-eb9f87b42986-service-ca-bundle") pod "router-default-7c85f98b97-bnhrb" (UID: "2edaad22-d491-4a9c-ae1f-eb9f87b42986") : configmap references non-existent config key: service-ca.crt Jul 08 23:03:14.118969 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:03:14.118875 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2edaad22-d491-4a9c-ae1f-eb9f87b42986-metrics-certs podName:2edaad22-d491-4a9c-ae1f-eb9f87b42986 nodeName:}" failed. No retries permitted until 2026-07-08 23:03:15.118865742 +0000 UTC m=+45.167139622 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2edaad22-d491-4a9c-ae1f-eb9f87b42986-metrics-certs") pod "router-default-7c85f98b97-bnhrb" (UID: "2edaad22-d491-4a9c-ae1f-eb9f87b42986") : secret "router-metrics-certs-default" not found Jul 08 23:03:14.118969 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:03:14.118906 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 23:03:14.118969 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:03:14.118910 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 08 23:03:14.118969 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:03:14.118923 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59d44dd9bb-4zrm7: secret "image-registry-tls" not found Jul 08 23:03:14.118969 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:03:14.118954 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4798cc78-68f0-447d-8ac9-b4b71ee8801d-metrics-tls podName:4798cc78-68f0-447d-8ac9-b4b71ee8801d nodeName:}" failed. No retries permitted until 2026-07-08 23:03:22.118939153 +0000 UTC m=+52.167213037 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4798cc78-68f0-447d-8ac9-b4b71ee8801d-metrics-tls") pod "dns-default-pr92b" (UID: "4798cc78-68f0-447d-8ac9-b4b71ee8801d") : secret "dns-default-metrics-tls" not found Jul 08 23:03:14.119139 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:03:14.118972 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/95b3aab3-2dca-4fc5-9de4-eef31714950d-registry-tls podName:95b3aab3-2dca-4fc5-9de4-eef31714950d nodeName:}" failed. No retries permitted until 2026-07-08 23:03:22.118961997 +0000 UTC m=+52.167235883 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/95b3aab3-2dca-4fc5-9de4-eef31714950d-registry-tls") pod "image-registry-59d44dd9bb-4zrm7" (UID: "95b3aab3-2dca-4fc5-9de4-eef31714950d") : secret "image-registry-tls" not found Jul 08 23:03:14.733450 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:14.733136 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-b7vhr" event={"ID":"820d35fb-fba2-4328-9e2b-0874474cb416","Type":"ContainerStarted","Data":"a6cc8f035d993d21dc3b48c9b4cefba7873397a88752985283f803d607403adf"} Jul 08 23:03:14.737145 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:14.737073 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-wtb28" event={"ID":"cc85fe60-ad63-443a-9b7c-d39b1ed167d2","Type":"ContainerStarted","Data":"daaba9774498724304bf94e6782ce7798d35c2ff381045f16bc24aa305a1a058"} Jul 08 23:03:14.740677 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:14.740610 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-z56vz" event={"ID":"61d74e97-1a73-4512-8b91-047aaae34a2d","Type":"ContainerStarted","Data":"b762582a3d76e20ac2ff8e2ebb8e1df745855f48cf02d2a4e9ffae2cb0032c90"} Jul 08 23:03:14.742948 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:14.742876 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-wl687" event={"ID":"4ed7b90f-7d34-4d31-b1fb-276d9906fc64","Type":"ContainerStarted","Data":"eae0cafae1e884500b75d87d622dc8f5ed0acd7e349d60a9361f5fc5b80d9480"} Jul 08 23:03:14.745787 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:14.745721 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-hfb2g" event={"ID":"33e501aa-07a6-45eb-a543-897fb2b59fa8","Type":"ContainerStarted","Data":"e6cecd9ea7e042a134758910a0027c2c6c9bc7afa02b74d9332f221338646551"} Jul 08 23:03:14.748424 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:14.748399 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-7nc87" event={"ID":"0763848e-1c09-4df3-a4b8-37e8a00c3ba2","Type":"ContainerStarted","Data":"dd83994362c1ef2f609f0e1c831d448dd668b128046c6259bea7ee625112334e"} Jul 08 23:03:14.927749 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:14.927715 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/03e6221f-5609-44a4-9635-7c99defdf4e1-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-gqzqm\" (UID: \"03e6221f-5609-44a4-9635-7c99defdf4e1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-gqzqm" Jul 08 23:03:14.928129 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:03:14.928108 2574 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 08 23:03:14.928238 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:03:14.928178 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03e6221f-5609-44a4-9635-7c99defdf4e1-samples-operator-tls podName:03e6221f-5609-44a4-9635-7c99defdf4e1 nodeName:}" failed. No retries permitted until 2026-07-08 23:03:16.928160001 +0000 UTC m=+46.976433885 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/03e6221f-5609-44a4-9635-7c99defdf4e1-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-gqzqm" (UID: "03e6221f-5609-44a4-9635-7c99defdf4e1") : secret "samples-operator-tls" not found Jul 08 23:03:15.029256 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:15.028809 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e4f8810f-3199-4a12-9f3e-696df87448d4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-h5zzc\" (UID: \"e4f8810f-3199-4a12-9f3e-696df87448d4\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-h5zzc" Jul 08 23:03:15.029256 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:15.028857 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/55cfa647-c40e-4556-b295-ad4fb60fde44-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-s5dnv\" (UID: \"55cfa647-c40e-4556-b295-ad4fb60fde44\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-s5dnv" Jul 08 23:03:15.029256 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:03:15.029004 2574 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 08 23:03:15.029256 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:03:15.029175 2574 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 08 23:03:15.029570 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:03:15.029262 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/55cfa647-c40e-4556-b295-ad4fb60fde44-networking-console-plugin-cert podName:55cfa647-c40e-4556-b295-ad4fb60fde44 nodeName:}" failed. No retries permitted until 2026-07-08 23:03:17.029045578 +0000 UTC m=+47.077319460 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/55cfa647-c40e-4556-b295-ad4fb60fde44-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-s5dnv" (UID: "55cfa647-c40e-4556-b295-ad4fb60fde44") : secret "networking-console-plugin-cert" not found Jul 08 23:03:15.029570 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:03:15.029296 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4f8810f-3199-4a12-9f3e-696df87448d4-cluster-monitoring-operator-tls podName:e4f8810f-3199-4a12-9f3e-696df87448d4 nodeName:}" failed. No retries permitted until 2026-07-08 23:03:17.029283043 +0000 UTC m=+47.077556928 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e4f8810f-3199-4a12-9f3e-696df87448d4-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-h5zzc" (UID: "e4f8810f-3199-4a12-9f3e-696df87448d4") : secret "cluster-monitoring-operator-tls" not found Jul 08 23:03:15.130344 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:15.130309 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2edaad22-d491-4a9c-ae1f-eb9f87b42986-metrics-certs\") pod \"router-default-7c85f98b97-bnhrb\" (UID: \"2edaad22-d491-4a9c-ae1f-eb9f87b42986\") " pod="openshift-ingress/router-default-7c85f98b97-bnhrb" Jul 08 23:03:15.130505 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:15.130389 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2edaad22-d491-4a9c-ae1f-eb9f87b42986-service-ca-bundle\") pod \"router-default-7c85f98b97-bnhrb\" (UID: \"2edaad22-d491-4a9c-ae1f-eb9f87b42986\") " pod="openshift-ingress/router-default-7c85f98b97-bnhrb" Jul 08 23:03:15.130505 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:03:15.130447 2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 08 23:03:15.130668 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:03:15.130536 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2edaad22-d491-4a9c-ae1f-eb9f87b42986-metrics-certs podName:2edaad22-d491-4a9c-ae1f-eb9f87b42986 nodeName:}" failed. No retries permitted until 2026-07-08 23:03:17.130499152 +0000 UTC m=+47.178773034 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2edaad22-d491-4a9c-ae1f-eb9f87b42986-metrics-certs") pod "router-default-7c85f98b97-bnhrb" (UID: "2edaad22-d491-4a9c-ae1f-eb9f87b42986") : secret "router-metrics-certs-default" not found Jul 08 23:03:15.130668 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:03:15.130574 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2edaad22-d491-4a9c-ae1f-eb9f87b42986-service-ca-bundle podName:2edaad22-d491-4a9c-ae1f-eb9f87b42986 nodeName:}" failed. No retries permitted until 2026-07-08 23:03:17.130558107 +0000 UTC m=+47.178832002 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2edaad22-d491-4a9c-ae1f-eb9f87b42986-service-ca-bundle") pod "router-default-7c85f98b97-bnhrb" (UID: "2edaad22-d491-4a9c-ae1f-eb9f87b42986") : configmap references non-existent config key: service-ca.crt Jul 08 23:03:16.953031 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:16.952998 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/03e6221f-5609-44a4-9635-7c99defdf4e1-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-gqzqm\" (UID: \"03e6221f-5609-44a4-9635-7c99defdf4e1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-gqzqm" Jul 08 23:03:16.953543 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:03:16.953160 2574 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 08 23:03:16.953543 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:03:16.953239 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03e6221f-5609-44a4-9635-7c99defdf4e1-samples-operator-tls podName:03e6221f-5609-44a4-9635-7c99defdf4e1 nodeName:}" failed. No retries permitted until 2026-07-08 23:03:20.953221215 +0000 UTC m=+51.001495096 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/03e6221f-5609-44a4-9635-7c99defdf4e1-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-gqzqm" (UID: "03e6221f-5609-44a4-9635-7c99defdf4e1") : secret "samples-operator-tls" not found Jul 08 23:03:17.053417 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:17.053381 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e4f8810f-3199-4a12-9f3e-696df87448d4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-h5zzc\" (UID: \"e4f8810f-3199-4a12-9f3e-696df87448d4\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-h5zzc" Jul 08 23:03:17.053628 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:17.053431 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/55cfa647-c40e-4556-b295-ad4fb60fde44-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-s5dnv\" (UID: \"55cfa647-c40e-4556-b295-ad4fb60fde44\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-s5dnv" Jul 08 23:03:17.053628 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:03:17.053566 2574 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 08 23:03:17.053628 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:03:17.053596 2574 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 08 23:03:17.053748 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:03:17.053637 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4f8810f-3199-4a12-9f3e-696df87448d4-cluster-monitoring-operator-tls podName:e4f8810f-3199-4a12-9f3e-696df87448d4 nodeName:}" failed. No retries permitted until 2026-07-08 23:03:21.053621006 +0000 UTC m=+51.101894887 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e4f8810f-3199-4a12-9f3e-696df87448d4-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-h5zzc" (UID: "e4f8810f-3199-4a12-9f3e-696df87448d4") : secret "cluster-monitoring-operator-tls" not found Jul 08 23:03:17.053748 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:03:17.053652 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/55cfa647-c40e-4556-b295-ad4fb60fde44-networking-console-plugin-cert podName:55cfa647-c40e-4556-b295-ad4fb60fde44 nodeName:}" failed. No retries permitted until 2026-07-08 23:03:21.053646274 +0000 UTC m=+51.101920155 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/55cfa647-c40e-4556-b295-ad4fb60fde44-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-s5dnv" (UID: "55cfa647-c40e-4556-b295-ad4fb60fde44") : secret "networking-console-plugin-cert" not found Jul 08 23:03:17.154708 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:17.154679 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2edaad22-d491-4a9c-ae1f-eb9f87b42986-metrics-certs\") pod \"router-default-7c85f98b97-bnhrb\" (UID: \"2edaad22-d491-4a9c-ae1f-eb9f87b42986\") " pod="openshift-ingress/router-default-7c85f98b97-bnhrb" Jul 08 23:03:17.154883 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:17.154721 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2edaad22-d491-4a9c-ae1f-eb9f87b42986-service-ca-bundle\") pod \"router-default-7c85f98b97-bnhrb\" (UID: \"2edaad22-d491-4a9c-ae1f-eb9f87b42986\") " pod="openshift-ingress/router-default-7c85f98b97-bnhrb" Jul 08 23:03:17.154883 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:03:17.154831 2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 08 23:03:17.155001 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:03:17.154898 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2edaad22-d491-4a9c-ae1f-eb9f87b42986-metrics-certs podName:2edaad22-d491-4a9c-ae1f-eb9f87b42986 nodeName:}" failed. No retries permitted until 2026-07-08 23:03:21.154879318 +0000 UTC m=+51.203153213 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2edaad22-d491-4a9c-ae1f-eb9f87b42986-metrics-certs") pod "router-default-7c85f98b97-bnhrb" (UID: "2edaad22-d491-4a9c-ae1f-eb9f87b42986") : secret "router-metrics-certs-default" not found Jul 08 23:03:17.155001 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:03:17.154969 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2edaad22-d491-4a9c-ae1f-eb9f87b42986-service-ca-bundle podName:2edaad22-d491-4a9c-ae1f-eb9f87b42986 nodeName:}" failed. No retries permitted until 2026-07-08 23:03:21.15495134 +0000 UTC m=+51.203225241 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2edaad22-d491-4a9c-ae1f-eb9f87b42986-service-ca-bundle") pod "router-default-7c85f98b97-bnhrb" (UID: "2edaad22-d491-4a9c-ae1f-eb9f87b42986") : configmap references non-existent config key: service-ca.crt Jul 08 23:03:18.797525 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:18.797475 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tmmqj_b8a428fb-e40d-437f-ae4d-ecd7141e03a5/konnectivity-agent/0.log" limit=1024 Jul 08 23:03:20.767874 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:20.767842 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-b7vhr_820d35fb-fba2-4328-9e2b-0874474cb416/console-operator/0.log" Jul 08 23:03:20.768321 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:20.767888 2574 generic.go:356] "Generic (PLEG): container finished" podID="820d35fb-fba2-4328-9e2b-0874474cb416" containerID="1d7a98ea8d70be9ef03364390c456d00f4e0e3520c9a728107851d1de499e5c8" exitCode=255 Jul 08 23:03:20.768321 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:20.767963 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-b7vhr" event={"ID":"820d35fb-fba2-4328-9e2b-0874474cb416","Type":"ContainerDied","Data":"1d7a98ea8d70be9ef03364390c456d00f4e0e3520c9a728107851d1de499e5c8"} Jul 08 23:03:20.768321 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:20.768280 2574 scope.go:117] "RemoveContainer" containerID="1d7a98ea8d70be9ef03364390c456d00f4e0e3520c9a728107851d1de499e5c8" Jul 08 23:03:20.770168 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:20.770144 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-wtb28" event={"ID":"cc85fe60-ad63-443a-9b7c-d39b1ed167d2","Type":"ContainerStarted","Data":"4796666c4950a38749e7410609a9ce914cf2c95a0043b0b13c7ac6bae28044a1"} Jul 08 23:03:20.772190 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:20.772169 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-z56vz" event={"ID":"61d74e97-1a73-4512-8b91-047aaae34a2d","Type":"ContainerStarted","Data":"90074cc735af8f9ee11503f1b0ba53798fa565f55898e639e3755c9b5f33409e"} Jul 08 23:03:20.774197 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:20.774172 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-wl687" event={"ID":"4ed7b90f-7d34-4d31-b1fb-276d9906fc64","Type":"ContainerStarted","Data":"6876fcda2aa0df063c13f6af35cb7bcb63c4af29db25c7b1459815b2f64f4a17"} Jul 08 23:03:20.775887 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:20.775865 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-hfb2g" event={"ID":"33e501aa-07a6-45eb-a543-897fb2b59fa8","Type":"ContainerStarted","Data":"cc56bca684b6e848f1d286c4c372a51e30741b0cc5cc1876228784d850c9df43"} Jul 08 23:03:20.777492 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:20.777467 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-7nc87" event={"ID":"0763848e-1c09-4df3-a4b8-37e8a00c3ba2","Type":"ContainerStarted","Data":"1f7640210c660a60d803a3b098d811a5d6239f1fcbc9e9aa99ffdbc0c74dc437"} Jul 08 23:03:20.798113 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:20.798075 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-wtb28" podStartSLOduration=1.342384956 podStartE2EDuration="7.798062672s" totalImagesPullingTime="6.455677716s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:03:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:03:20.797111519 +0000 UTC m=+50.845385433" watchObservedRunningTime="2026-07-08 23:03:20.798062672 +0000 UTC m=+50.846336607" Jul 08 23:03:20.811874 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:20.811835 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-7nc87" podStartSLOduration=1.384931191 podStartE2EDuration="7.811821606s" totalImagesPullingTime="6.426890415s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:03:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:03:20.810473171 +0000 UTC m=+50.858747075" watchObservedRunningTime="2026-07-08 23:03:20.811821606 +0000 UTC m=+50.860095508" Jul 08 23:03:20.846717 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:20.846354 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5c847dcfc4-wl687" podStartSLOduration=1.449475565 podStartE2EDuration="7.84633304s" totalImagesPullingTime="6.396857475s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:03:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:03:20.828251536 +0000 UTC m=+50.876525439" watchObservedRunningTime="2026-07-08 23:03:20.84633304 +0000 UTC m=+50.894606945" Jul 08 23:03:20.864367 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:20.864319 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-hfb2g" podStartSLOduration=1.531664586 podStartE2EDuration="7.864301591s" totalImagesPullingTime="6.332637005s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:03:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:03:20.846742437 +0000 UTC m=+50.895016351" watchObservedRunningTime="2026-07-08 23:03:20.864301591 +0000 UTC m=+50.912575490" Jul 08 23:03:20.941064 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:20.941038 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tmmqj_b8a428fb-e40d-437f-ae4d-ecd7141e03a5/konnectivity-agent/0.log" limit=1024 Jul 08 23:03:20.988715 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:20.988684 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/03e6221f-5609-44a4-9635-7c99defdf4e1-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-gqzqm\" (UID: \"03e6221f-5609-44a4-9635-7c99defdf4e1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-gqzqm" Jul 08 23:03:20.988881 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:03:20.988861 2574 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 08 23:03:20.988961 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:03:20.988940 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03e6221f-5609-44a4-9635-7c99defdf4e1-samples-operator-tls podName:03e6221f-5609-44a4-9635-7c99defdf4e1 nodeName:}" failed. No retries permitted until 2026-07-08 23:03:28.988918811 +0000 UTC m=+59.037192706 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/03e6221f-5609-44a4-9635-7c99defdf4e1-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-gqzqm" (UID: "03e6221f-5609-44a4-9635-7c99defdf4e1") : secret "samples-operator-tls" not found Jul 08 23:03:20.996551 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:20.996502 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tmmqj_b8a428fb-e40d-437f-ae4d-ecd7141e03a5/konnectivity-agent/0.log" limit=1024 Jul 08 23:03:21.089811 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:21.089774 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e4f8810f-3199-4a12-9f3e-696df87448d4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-h5zzc\" (UID: \"e4f8810f-3199-4a12-9f3e-696df87448d4\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-h5zzc" Jul 08 23:03:21.089962 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:21.089821 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/55cfa647-c40e-4556-b295-ad4fb60fde44-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-s5dnv\" (UID: \"55cfa647-c40e-4556-b295-ad4fb60fde44\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-s5dnv" Jul 08 23:03:21.089962 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:03:21.089936 2574 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 08 23:03:21.090069 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:03:21.090000 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/55cfa647-c40e-4556-b295-ad4fb60fde44-networking-console-plugin-cert podName:55cfa647-c40e-4556-b295-ad4fb60fde44 nodeName:}" failed. No retries permitted until 2026-07-08 23:03:29.089984506 +0000 UTC m=+59.138258391 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/55cfa647-c40e-4556-b295-ad4fb60fde44-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-s5dnv" (UID: "55cfa647-c40e-4556-b295-ad4fb60fde44") : secret "networking-console-plugin-cert" not found Jul 08 23:03:21.090379 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:03:21.090361 2574 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 08 23:03:21.090434 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:03:21.090424 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4f8810f-3199-4a12-9f3e-696df87448d4-cluster-monitoring-operator-tls podName:e4f8810f-3199-4a12-9f3e-696df87448d4 nodeName:}" failed. No retries permitted until 2026-07-08 23:03:29.090406419 +0000 UTC m=+59.138680307 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e4f8810f-3199-4a12-9f3e-696df87448d4-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-h5zzc" (UID: "e4f8810f-3199-4a12-9f3e-696df87448d4") : secret "cluster-monitoring-operator-tls" not found Jul 08 23:03:21.191147 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:21.191109 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2edaad22-d491-4a9c-ae1f-eb9f87b42986-metrics-certs\") pod \"router-default-7c85f98b97-bnhrb\" (UID: \"2edaad22-d491-4a9c-ae1f-eb9f87b42986\") " pod="openshift-ingress/router-default-7c85f98b97-bnhrb" Jul 08 23:03:21.191341 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:21.191156 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2edaad22-d491-4a9c-ae1f-eb9f87b42986-service-ca-bundle\") pod \"router-default-7c85f98b97-bnhrb\" (UID: \"2edaad22-d491-4a9c-ae1f-eb9f87b42986\") " pod="openshift-ingress/router-default-7c85f98b97-bnhrb" Jul 08 23:03:21.191341 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:03:21.191247 2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 08 23:03:21.191450 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:03:21.191350 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2edaad22-d491-4a9c-ae1f-eb9f87b42986-metrics-certs podName:2edaad22-d491-4a9c-ae1f-eb9f87b42986 nodeName:}" failed. No retries permitted until 2026-07-08 23:03:29.191332879 +0000 UTC m=+59.239606767 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2edaad22-d491-4a9c-ae1f-eb9f87b42986-metrics-certs") pod "router-default-7c85f98b97-bnhrb" (UID: "2edaad22-d491-4a9c-ae1f-eb9f87b42986") : secret "router-metrics-certs-default" not found Jul 08 23:03:21.191450 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:03:21.191371 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2edaad22-d491-4a9c-ae1f-eb9f87b42986-service-ca-bundle podName:2edaad22-d491-4a9c-ae1f-eb9f87b42986 nodeName:}" failed. No retries permitted until 2026-07-08 23:03:29.191361385 +0000 UTC m=+59.239635269 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2edaad22-d491-4a9c-ae1f-eb9f87b42986-service-ca-bundle") pod "router-default-7c85f98b97-bnhrb" (UID: "2edaad22-d491-4a9c-ae1f-eb9f87b42986") : configmap references non-existent config key: service-ca.crt Jul 08 23:03:21.218377 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:21.218340 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tmmqj_b8a428fb-e40d-437f-ae4d-ecd7141e03a5/konnectivity-agent/0.log" limit=1024 Jul 08 23:03:21.313714 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:21.313681 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tmmqj_b8a428fb-e40d-437f-ae4d-ecd7141e03a5/konnectivity-agent/0.log" limit=1024 Jul 08 23:03:21.672342 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:21.672285 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-z56vz" podStartSLOduration=2.47208246 podStartE2EDuration="8.67226623s" totalImagesPullingTime="6.20018377s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:03:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:03:20.865481949 +0000 UTC m=+50.913755854" watchObservedRunningTime="2026-07-08 23:03:21.67226623 +0000 UTC m=+51.720540148" Jul 08 23:03:21.672771 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:21.672743 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-8mtw6"] Jul 08 23:03:21.687725 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:21.687702 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8mtw6" Jul 08 23:03:21.690297 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:21.690263 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 08 23:03:21.690410 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:21.690335 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 08 23:03:21.691419 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:21.691396 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-ntpx9\"" Jul 08 23:03:21.697478 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:21.697455 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8mtw6"] Jul 08 23:03:21.722629 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:21.722608 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tmmqj_b8a428fb-e40d-437f-ae4d-ecd7141e03a5/konnectivity-agent/0.log" limit=1024 Jul 08 23:03:21.783017 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:21.782992 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-b7vhr_820d35fb-fba2-4328-9e2b-0874474cb416/console-operator/1.log" Jul 08 23:03:21.783449 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:21.783435 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-b7vhr_820d35fb-fba2-4328-9e2b-0874474cb416/console-operator/0.log" Jul 08 23:03:21.783504 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:21.783475 2574 generic.go:356] "Generic (PLEG): container finished" podID="820d35fb-fba2-4328-9e2b-0874474cb416" containerID="a6959674e907ab6c66b960df6be9c59804d5d80afaf34be21e125d8b17810b32" exitCode=255 Jul 08 23:03:21.783575 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:21.783549 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-b7vhr" event={"ID":"820d35fb-fba2-4328-9e2b-0874474cb416","Type":"ContainerDied","Data":"a6959674e907ab6c66b960df6be9c59804d5d80afaf34be21e125d8b17810b32"} Jul 08 23:03:21.783626 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:21.783602 2574 scope.go:117] "RemoveContainer" containerID="1d7a98ea8d70be9ef03364390c456d00f4e0e3520c9a728107851d1de499e5c8" Jul 08 23:03:21.783815 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:21.783796 2574 scope.go:117] "RemoveContainer" containerID="a6959674e907ab6c66b960df6be9c59804d5d80afaf34be21e125d8b17810b32" Jul 08 23:03:21.784018 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:03:21.783981 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-b7vhr_openshift-console-operator(820d35fb-fba2-4328-9e2b-0874474cb416)\"" pod="openshift-console-operator/console-operator-68b757fb67-b7vhr" podUID="820d35fb-fba2-4328-9e2b-0874474cb416" Jul 08 23:03:21.796177 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:21.796156 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dg5f8\" (UniqueName: \"kubernetes.io/projected/4e57d4ab-946f-4067-b9dd-8305e346e99b-kube-api-access-dg5f8\") pod \"insights-runtime-extractor-8mtw6\" (UID: \"4e57d4ab-946f-4067-b9dd-8305e346e99b\") " pod="openshift-insights/insights-runtime-extractor-8mtw6" Jul 08 23:03:21.796273 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:21.796202 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4e57d4ab-946f-4067-b9dd-8305e346e99b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8mtw6\" (UID: \"4e57d4ab-946f-4067-b9dd-8305e346e99b\") " pod="openshift-insights/insights-runtime-extractor-8mtw6" Jul 08 23:03:21.796315 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:21.796288 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4e57d4ab-946f-4067-b9dd-8305e346e99b-data-volume\") pod \"insights-runtime-extractor-8mtw6\" (UID: \"4e57d4ab-946f-4067-b9dd-8305e346e99b\") " pod="openshift-insights/insights-runtime-extractor-8mtw6" Jul 08 23:03:21.796349 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:21.796335 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4e57d4ab-946f-4067-b9dd-8305e346e99b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8mtw6\" (UID: \"4e57d4ab-946f-4067-b9dd-8305e346e99b\") " pod="openshift-insights/insights-runtime-extractor-8mtw6" Jul 08 23:03:21.796411 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:21.796397 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4e57d4ab-946f-4067-b9dd-8305e346e99b-crio-socket\") pod \"insights-runtime-extractor-8mtw6\" (UID: \"4e57d4ab-946f-4067-b9dd-8305e346e99b\") " pod="openshift-insights/insights-runtime-extractor-8mtw6" Jul 08 23:03:21.897340 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:21.897307 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4e57d4ab-946f-4067-b9dd-8305e346e99b-data-volume\") pod \"insights-runtime-extractor-8mtw6\" (UID: \"4e57d4ab-946f-4067-b9dd-8305e346e99b\") " pod="openshift-insights/insights-runtime-extractor-8mtw6" Jul 08 23:03:21.897734 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:21.897363 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4e57d4ab-946f-4067-b9dd-8305e346e99b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8mtw6\" (UID: \"4e57d4ab-946f-4067-b9dd-8305e346e99b\") " pod="openshift-insights/insights-runtime-extractor-8mtw6" Jul 08 23:03:21.897734 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:03:21.897438 2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 08 23:03:21.897734 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:03:21.897541 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4e57d4ab-946f-4067-b9dd-8305e346e99b-kube-rbac-proxy-cm podName:4e57d4ab-946f-4067-b9dd-8305e346e99b nodeName:}" failed. No retries permitted until 2026-07-08 23:03:22.397520263 +0000 UTC m=+52.445794148 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4e57d4ab-946f-4067-b9dd-8305e346e99b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8mtw6" (UID: "4e57d4ab-946f-4067-b9dd-8305e346e99b") : configmap "kube-rbac-proxy" not found Jul 08 23:03:21.898598 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:21.898147 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4e57d4ab-946f-4067-b9dd-8305e346e99b-crio-socket\") pod \"insights-runtime-extractor-8mtw6\" (UID: \"4e57d4ab-946f-4067-b9dd-8305e346e99b\") " pod="openshift-insights/insights-runtime-extractor-8mtw6" Jul 08 23:03:21.902191 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:21.898643 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4e57d4ab-946f-4067-b9dd-8305e346e99b-crio-socket\") pod \"insights-runtime-extractor-8mtw6\" (UID: \"4e57d4ab-946f-4067-b9dd-8305e346e99b\") " pod="openshift-insights/insights-runtime-extractor-8mtw6" Jul 08 23:03:21.902191 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:21.899082 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dg5f8\" (UniqueName: \"kubernetes.io/projected/4e57d4ab-946f-4067-b9dd-8305e346e99b-kube-api-access-dg5f8\") pod \"insights-runtime-extractor-8mtw6\" (UID: \"4e57d4ab-946f-4067-b9dd-8305e346e99b\") " pod="openshift-insights/insights-runtime-extractor-8mtw6" Jul 08 23:03:21.902191 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:21.899132 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4e57d4ab-946f-4067-b9dd-8305e346e99b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8mtw6\" (UID: \"4e57d4ab-946f-4067-b9dd-8305e346e99b\") " pod="openshift-insights/insights-runtime-extractor-8mtw6" Jul 08 23:03:21.902191 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:03:21.899980 2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 08 23:03:21.902191 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:03:21.900039 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e57d4ab-946f-4067-b9dd-8305e346e99b-insights-runtime-extractor-tls podName:4e57d4ab-946f-4067-b9dd-8305e346e99b nodeName:}" failed. No retries permitted until 2026-07-08 23:03:22.400022201 +0000 UTC m=+52.448296089 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4e57d4ab-946f-4067-b9dd-8305e346e99b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8mtw6" (UID: "4e57d4ab-946f-4067-b9dd-8305e346e99b") : secret "insights-runtime-extractor-tls" not found Jul 08 23:03:21.905598 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:21.905575 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4e57d4ab-946f-4067-b9dd-8305e346e99b-data-volume\") pod \"insights-runtime-extractor-8mtw6\" (UID: \"4e57d4ab-946f-4067-b9dd-8305e346e99b\") " pod="openshift-insights/insights-runtime-extractor-8mtw6" Jul 08 23:03:21.907837 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:21.907814 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dg5f8\" (UniqueName: \"kubernetes.io/projected/4e57d4ab-946f-4067-b9dd-8305e346e99b-kube-api-access-dg5f8\") pod \"insights-runtime-extractor-8mtw6\" (UID: \"4e57d4ab-946f-4067-b9dd-8305e346e99b\") " pod="openshift-insights/insights-runtime-extractor-8mtw6" Jul 08 23:03:22.002747 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:22.002679 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-lbf4d"] Jul 08 23:03:22.006762 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:22.006736 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tmmqj_b8a428fb-e40d-437f-ae4d-ecd7141e03a5/konnectivity-agent/0.log" limit=1024 Jul 08 23:03:22.017200 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:22.017178 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-lbf4d"] Jul 08 23:03:22.017320 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:22.017287 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-lbf4d" Jul 08 23:03:22.019820 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:22.019794 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 08 23:03:22.019952 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:22.019806 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-6xqln\"" Jul 08 23:03:22.019952 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:22.019855 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 08 23:03:22.063614 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:22.063579 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tmmqj_b8a428fb-e40d-437f-ae4d-ecd7141e03a5/konnectivity-agent/0.log" limit=1024 Jul 08 23:03:22.101272 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:22.101245 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6k4zd\" (UniqueName: \"kubernetes.io/projected/7af8cd0a-2c59-4ccb-87ce-80ca8c8809a6-kube-api-access-6k4zd\") pod \"migrator-d57d58cc9-lbf4d\" (UID: \"7af8cd0a-2c59-4ccb-87ce-80ca8c8809a6\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-lbf4d" Jul 08 23:03:22.177564 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:22.177526 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tmmqj_b8a428fb-e40d-437f-ae4d-ecd7141e03a5/konnectivity-agent/0.log" limit=1024 Jul 08 23:03:22.201907 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:22.201878 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6k4zd\" (UniqueName: \"kubernetes.io/projected/7af8cd0a-2c59-4ccb-87ce-80ca8c8809a6-kube-api-access-6k4zd\") pod \"migrator-d57d58cc9-lbf4d\" (UID: \"7af8cd0a-2c59-4ccb-87ce-80ca8c8809a6\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-lbf4d" Jul 08 23:03:22.202009 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:22.201994 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/95b3aab3-2dca-4fc5-9de4-eef31714950d-registry-tls\") pod \"image-registry-59d44dd9bb-4zrm7\" (UID: \"95b3aab3-2dca-4fc5-9de4-eef31714950d\") " pod="openshift-image-registry/image-registry-59d44dd9bb-4zrm7" Jul 08 23:03:22.202109 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:22.202093 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4798cc78-68f0-447d-8ac9-b4b71ee8801d-metrics-tls\") pod \"dns-default-pr92b\" (UID: \"4798cc78-68f0-447d-8ac9-b4b71ee8801d\") " pod="openshift-dns/dns-default-pr92b" Jul 08 23:03:22.202148 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:03:22.202129 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 08 23:03:22.202148 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:03:22.202144 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59d44dd9bb-4zrm7: secret "image-registry-tls" not found Jul 08 23:03:22.202227 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:03:22.202191 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/95b3aab3-2dca-4fc5-9de4-eef31714950d-registry-tls podName:95b3aab3-2dca-4fc5-9de4-eef31714950d nodeName:}" failed. No retries permitted until 2026-07-08 23:03:38.202177534 +0000 UTC m=+68.250451414 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/95b3aab3-2dca-4fc5-9de4-eef31714950d-registry-tls") pod "image-registry-59d44dd9bb-4zrm7" (UID: "95b3aab3-2dca-4fc5-9de4-eef31714950d") : secret "image-registry-tls" not found Jul 08 23:03:22.202227 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:03:22.202214 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 23:03:22.202311 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:03:22.202268 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4798cc78-68f0-447d-8ac9-b4b71ee8801d-metrics-tls podName:4798cc78-68f0-447d-8ac9-b4b71ee8801d nodeName:}" failed. No retries permitted until 2026-07-08 23:03:38.202252361 +0000 UTC m=+68.250526246 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4798cc78-68f0-447d-8ac9-b4b71ee8801d-metrics-tls") pod "dns-default-pr92b" (UID: "4798cc78-68f0-447d-8ac9-b4b71ee8801d") : secret "dns-default-metrics-tls" not found Jul 08 23:03:22.212375 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:22.212347 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6k4zd\" (UniqueName: \"kubernetes.io/projected/7af8cd0a-2c59-4ccb-87ce-80ca8c8809a6-kube-api-access-6k4zd\") pod \"migrator-d57d58cc9-lbf4d\" (UID: \"7af8cd0a-2c59-4ccb-87ce-80ca8c8809a6\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-lbf4d" Jul 08 23:03:22.278834 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:22.278763 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tmmqj_b8a428fb-e40d-437f-ae4d-ecd7141e03a5/konnectivity-agent/0.log" limit=1024 Jul 08 23:03:22.326588 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:22.326566 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-lbf4d" Jul 08 23:03:22.327365 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:22.327340 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tmmqj_b8a428fb-e40d-437f-ae4d-ecd7141e03a5/konnectivity-agent/0.log" limit=1024 Jul 08 23:03:22.404399 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:22.404203 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4e57d4ab-946f-4067-b9dd-8305e346e99b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8mtw6\" (UID: \"4e57d4ab-946f-4067-b9dd-8305e346e99b\") " pod="openshift-insights/insights-runtime-extractor-8mtw6" Jul 08 23:03:22.404399 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:03:22.404328 2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 08 23:03:22.404399 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:03:22.404398 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4e57d4ab-946f-4067-b9dd-8305e346e99b-kube-rbac-proxy-cm podName:4e57d4ab-946f-4067-b9dd-8305e346e99b nodeName:}" failed. No retries permitted until 2026-07-08 23:03:23.40437797 +0000 UTC m=+53.452651865 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4e57d4ab-946f-4067-b9dd-8305e346e99b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8mtw6" (UID: "4e57d4ab-946f-4067-b9dd-8305e346e99b") : configmap "kube-rbac-proxy" not found Jul 08 23:03:22.404727 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:22.404423 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4e57d4ab-946f-4067-b9dd-8305e346e99b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8mtw6\" (UID: \"4e57d4ab-946f-4067-b9dd-8305e346e99b\") " pod="openshift-insights/insights-runtime-extractor-8mtw6" Jul 08 23:03:22.404727 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:03:22.404554 2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 08 23:03:22.404727 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:03:22.404591 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e57d4ab-946f-4067-b9dd-8305e346e99b-insights-runtime-extractor-tls podName:4e57d4ab-946f-4067-b9dd-8305e346e99b nodeName:}" failed. No retries permitted until 2026-07-08 23:03:23.404579788 +0000 UTC m=+53.452853684 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4e57d4ab-946f-4067-b9dd-8305e346e99b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8mtw6" (UID: "4e57d4ab-946f-4067-b9dd-8305e346e99b") : secret "insights-runtime-extractor-tls" not found Jul 08 23:03:22.472451 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:22.472399 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-lbf4d"] Jul 08 23:03:22.477077 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:03:22.477048 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7af8cd0a_2c59_4ccb_87ce_80ca8c8809a6.slice/crio-6e20ef0e2c791b1d59f5994654b5591215794cb2f9a51ab4eadd7615f66b401d WatchSource:0}: Error finding container 6e20ef0e2c791b1d59f5994654b5591215794cb2f9a51ab4eadd7615f66b401d: Status 404 returned error can't find the container with id 6e20ef0e2c791b1d59f5994654b5591215794cb2f9a51ab4eadd7615f66b401d Jul 08 23:03:22.665923 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:22.665900 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-b9mrk_025aa4fb-e602-4ca7-ab4d-982dbbfbea11/dns-node-resolver/0.log" Jul 08 23:03:22.694252 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:22.694211 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tmmqj_b8a428fb-e40d-437f-ae4d-ecd7141e03a5/konnectivity-agent/0.log" limit=1024 Jul 08 23:03:22.787983 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:22.787957 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-b7vhr_820d35fb-fba2-4328-9e2b-0874474cb416/console-operator/1.log" Jul 08 23:03:22.788332 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:22.788266 2574 scope.go:117] "RemoveContainer" containerID="a6959674e907ab6c66b960df6be9c59804d5d80afaf34be21e125d8b17810b32" Jul 08 23:03:22.788445 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:03:22.788422 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-b7vhr_openshift-console-operator(820d35fb-fba2-4328-9e2b-0874474cb416)\"" pod="openshift-console-operator/console-operator-68b757fb67-b7vhr" podUID="820d35fb-fba2-4328-9e2b-0874474cb416" Jul 08 23:03:22.790875 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:22.790847 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-lbf4d" event={"ID":"7af8cd0a-2c59-4ccb-87ce-80ca8c8809a6","Type":"ContainerStarted","Data":"6e20ef0e2c791b1d59f5994654b5591215794cb2f9a51ab4eadd7615f66b401d"} Jul 08 23:03:22.794984 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:22.794956 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tmmqj_b8a428fb-e40d-437f-ae4d-ecd7141e03a5/konnectivity-agent/0.log" limit=1024 Jul 08 23:03:23.118686 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:23.118652 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tmmqj_b8a428fb-e40d-437f-ae4d-ecd7141e03a5/konnectivity-agent/0.log" limit=1024 Jul 08 23:03:23.399181 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:23.399015 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tmmqj_b8a428fb-e40d-437f-ae4d-ecd7141e03a5/konnectivity-agent/0.log" limit=1024 Jul 08 23:03:23.412966 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:23.412936 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4e57d4ab-946f-4067-b9dd-8305e346e99b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8mtw6\" (UID: \"4e57d4ab-946f-4067-b9dd-8305e346e99b\") " pod="openshift-insights/insights-runtime-extractor-8mtw6" Jul 08 23:03:23.413159 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:23.413057 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4e57d4ab-946f-4067-b9dd-8305e346e99b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8mtw6\" (UID: \"4e57d4ab-946f-4067-b9dd-8305e346e99b\") " pod="openshift-insights/insights-runtime-extractor-8mtw6" Jul 08 23:03:23.413159 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:03:23.413076 2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 08 23:03:23.413159 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:03:23.413150 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4e57d4ab-946f-4067-b9dd-8305e346e99b-kube-rbac-proxy-cm podName:4e57d4ab-946f-4067-b9dd-8305e346e99b nodeName:}" failed. No retries permitted until 2026-07-08 23:03:25.413130916 +0000 UTC m=+55.461404810 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4e57d4ab-946f-4067-b9dd-8305e346e99b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8mtw6" (UID: "4e57d4ab-946f-4067-b9dd-8305e346e99b") : configmap "kube-rbac-proxy" not found Jul 08 23:03:23.413335 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:03:23.413162 2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 08 23:03:23.413335 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:03:23.413217 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e57d4ab-946f-4067-b9dd-8305e346e99b-insights-runtime-extractor-tls podName:4e57d4ab-946f-4067-b9dd-8305e346e99b nodeName:}" failed. No retries permitted until 2026-07-08 23:03:25.413204338 +0000 UTC m=+55.461478222 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4e57d4ab-946f-4067-b9dd-8305e346e99b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8mtw6" (UID: "4e57d4ab-946f-4067-b9dd-8305e346e99b") : secret "insights-runtime-extractor-tls" not found Jul 08 23:03:23.502171 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:23.502135 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tmmqj_b8a428fb-e40d-437f-ae4d-ecd7141e03a5/konnectivity-agent/0.log" limit=1024 Jul 08 23:03:23.713771 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:23.713696 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-b7vhr" Jul 08 23:03:23.713771 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:23.713759 2574 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-b7vhr" Jul 08 23:03:23.795289 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:23.795259 2574 scope.go:117] "RemoveContainer" containerID="a6959674e907ab6c66b960df6be9c59804d5d80afaf34be21e125d8b17810b32" Jul 08 23:03:23.795725 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:03:23.795455 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-b7vhr_openshift-console-operator(820d35fb-fba2-4328-9e2b-0874474cb416)\"" pod="openshift-console-operator/console-operator-68b757fb67-b7vhr" podUID="820d35fb-fba2-4328-9e2b-0874474cb416" Jul 08 23:03:24.068397 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:24.068377 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wkdzq_38442020-34ab-4cdf-a0e8-af93e6c046e1/node-ca/0.log" Jul 08 23:03:24.097641 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:24.097611 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tmmqj_b8a428fb-e40d-437f-ae4d-ecd7141e03a5/konnectivity-agent/0.log" limit=1024 Jul 08 23:03:24.197718 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:24.197684 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tmmqj_b8a428fb-e40d-437f-ae4d-ecd7141e03a5/konnectivity-agent/0.log" limit=1024 Jul 08 23:03:24.298390 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:24.298325 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tmmqj_b8a428fb-e40d-437f-ae4d-ecd7141e03a5/konnectivity-agent/0.log" limit=1024 Jul 08 23:03:24.466235 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:24.466210 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-zknln_d8ceaaa0-c406-4ac5-9ff4-027bcdb1b508/serve-healthcheck-canary/0.log" Jul 08 23:03:24.799495 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:24.799459 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-lbf4d" event={"ID":"7af8cd0a-2c59-4ccb-87ce-80ca8c8809a6","Type":"ContainerStarted","Data":"eb5e901ace59afb7b86f02286334ebc82374363814845db41eb3d8ddda15382e"} Jul 08 23:03:24.799848 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:24.799525 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-lbf4d" event={"ID":"7af8cd0a-2c59-4ccb-87ce-80ca8c8809a6","Type":"ContainerStarted","Data":"a3dcb932b41cf489e7e89be8f09add07818cd3ddc3882c04aafe3dce6ea82a64"} Jul 08 23:03:24.815221 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:24.815173 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-lbf4d" podStartSLOduration=2.255758462 podStartE2EDuration="3.815159913s" totalImagesPullingTime="1.559401451s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:03:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:03:24.813997161 +0000 UTC m=+54.862271064" watchObservedRunningTime="2026-07-08 23:03:24.815159913 +0000 UTC m=+54.863433815" Jul 08 23:03:24.889772 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:24.889733 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tmmqj_b8a428fb-e40d-437f-ae4d-ecd7141e03a5/konnectivity-agent/0.log" limit=1024 Jul 08 23:03:24.994250 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:24.994222 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-758f599c5-nmt8n"] Jul 08 23:03:24.996374 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:24.996360 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-nmt8n" Jul 08 23:03:24.998780 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:24.998761 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 08 23:03:24.998894 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:24.998851 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 08 23:03:24.998894 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:24.998860 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-smd9m\"" Jul 08 23:03:24.999009 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:24.998908 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 08 23:03:24.999009 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:24.998998 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 08 23:03:25.004606 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:25.004588 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-nmt8n"] Jul 08 23:03:25.028875 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:25.028849 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tmmqj_b8a428fb-e40d-437f-ae4d-ecd7141e03a5/konnectivity-agent/0.log" limit=1024 Jul 08 23:03:25.088301 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:25.088241 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tmmqj_b8a428fb-e40d-437f-ae4d-ecd7141e03a5/konnectivity-agent/0.log" limit=1024 Jul 08 23:03:25.127230 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:25.127205 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/c3706171-5a28-40f9-ba1c-a2de8a2087d3-signing-key\") pod \"service-ca-758f599c5-nmt8n\" (UID: \"c3706171-5a28-40f9-ba1c-a2de8a2087d3\") " pod="openshift-service-ca/service-ca-758f599c5-nmt8n" Jul 08 23:03:25.127321 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:25.127244 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/c3706171-5a28-40f9-ba1c-a2de8a2087d3-signing-cabundle\") pod \"service-ca-758f599c5-nmt8n\" (UID: \"c3706171-5a28-40f9-ba1c-a2de8a2087d3\") " pod="openshift-service-ca/service-ca-758f599c5-nmt8n" Jul 08 23:03:25.127360 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:25.127337 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-blcjx\" (UniqueName: \"kubernetes.io/projected/c3706171-5a28-40f9-ba1c-a2de8a2087d3-kube-api-access-blcjx\") pod \"service-ca-758f599c5-nmt8n\" (UID: \"c3706171-5a28-40f9-ba1c-a2de8a2087d3\") " pod="openshift-service-ca/service-ca-758f599c5-nmt8n" Jul 08 23:03:25.190098 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:25.190069 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tmmqj_b8a428fb-e40d-437f-ae4d-ecd7141e03a5/konnectivity-agent/0.log" limit=1024 Jul 08 23:03:25.228712 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:25.228692 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/c3706171-5a28-40f9-ba1c-a2de8a2087d3-signing-cabundle\") pod \"service-ca-758f599c5-nmt8n\" (UID: \"c3706171-5a28-40f9-ba1c-a2de8a2087d3\") " pod="openshift-service-ca/service-ca-758f599c5-nmt8n" Jul 08 23:03:25.228826 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:25.228813 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-blcjx\" (UniqueName: \"kubernetes.io/projected/c3706171-5a28-40f9-ba1c-a2de8a2087d3-kube-api-access-blcjx\") pod \"service-ca-758f599c5-nmt8n\" (UID: \"c3706171-5a28-40f9-ba1c-a2de8a2087d3\") " pod="openshift-service-ca/service-ca-758f599c5-nmt8n" Jul 08 23:03:25.228891 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:25.228877 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/c3706171-5a28-40f9-ba1c-a2de8a2087d3-signing-key\") pod \"service-ca-758f599c5-nmt8n\" (UID: \"c3706171-5a28-40f9-ba1c-a2de8a2087d3\") " pod="openshift-service-ca/service-ca-758f599c5-nmt8n" Jul 08 23:03:25.229339 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:25.229315 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/c3706171-5a28-40f9-ba1c-a2de8a2087d3-signing-cabundle\") pod \"service-ca-758f599c5-nmt8n\" (UID: \"c3706171-5a28-40f9-ba1c-a2de8a2087d3\") " pod="openshift-service-ca/service-ca-758f599c5-nmt8n" Jul 08 23:03:25.231131 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:25.231115 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/c3706171-5a28-40f9-ba1c-a2de8a2087d3-signing-key\") pod \"service-ca-758f599c5-nmt8n\" (UID: \"c3706171-5a28-40f9-ba1c-a2de8a2087d3\") " pod="openshift-service-ca/service-ca-758f599c5-nmt8n" Jul 08 23:03:25.236613 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:25.236593 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-blcjx\" (UniqueName: \"kubernetes.io/projected/c3706171-5a28-40f9-ba1c-a2de8a2087d3-kube-api-access-blcjx\") pod \"service-ca-758f599c5-nmt8n\" (UID: \"c3706171-5a28-40f9-ba1c-a2de8a2087d3\") " pod="openshift-service-ca/service-ca-758f599c5-nmt8n" Jul 08 23:03:25.306661 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:25.306638 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-nmt8n" Jul 08 23:03:25.426058 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:25.426035 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-nmt8n"] Jul 08 23:03:25.428473 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:03:25.428445 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3706171_5a28_40f9_ba1c_a2de8a2087d3.slice/crio-666928f2c10041fb11bb776d24a368114bea0dd68ec5024a5741c23adeb198d6 WatchSource:0}: Error finding container 666928f2c10041fb11bb776d24a368114bea0dd68ec5024a5741c23adeb198d6: Status 404 returned error can't find the container with id 666928f2c10041fb11bb776d24a368114bea0dd68ec5024a5741c23adeb198d6 Jul 08 23:03:25.430131 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:25.430111 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4e57d4ab-946f-4067-b9dd-8305e346e99b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8mtw6\" (UID: \"4e57d4ab-946f-4067-b9dd-8305e346e99b\") " pod="openshift-insights/insights-runtime-extractor-8mtw6" Jul 08 23:03:25.430240 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:03:25.430224 2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 08 23:03:25.430306 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:03:25.430290 2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 08 23:03:25.430306 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:25.430229 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4e57d4ab-946f-4067-b9dd-8305e346e99b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8mtw6\" (UID: \"4e57d4ab-946f-4067-b9dd-8305e346e99b\") " pod="openshift-insights/insights-runtime-extractor-8mtw6" Jul 08 23:03:25.430399 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:03:25.430294 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4e57d4ab-946f-4067-b9dd-8305e346e99b-kube-rbac-proxy-cm podName:4e57d4ab-946f-4067-b9dd-8305e346e99b nodeName:}" failed. No retries permitted until 2026-07-08 23:03:29.430271577 +0000 UTC m=+59.478545460 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4e57d4ab-946f-4067-b9dd-8305e346e99b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8mtw6" (UID: "4e57d4ab-946f-4067-b9dd-8305e346e99b") : configmap "kube-rbac-proxy" not found Jul 08 23:03:25.430399 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:03:25.430357 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e57d4ab-946f-4067-b9dd-8305e346e99b-insights-runtime-extractor-tls podName:4e57d4ab-946f-4067-b9dd-8305e346e99b nodeName:}" failed. No retries permitted until 2026-07-08 23:03:29.430342088 +0000 UTC m=+59.478615981 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4e57d4ab-946f-4067-b9dd-8305e346e99b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8mtw6" (UID: "4e57d4ab-946f-4067-b9dd-8305e346e99b") : secret "insights-runtime-extractor-tls" not found Jul 08 23:03:25.804400 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:25.804369 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-nmt8n" event={"ID":"c3706171-5a28-40f9-ba1c-a2de8a2087d3","Type":"ContainerStarted","Data":"a6396e92b0b7c193092f54eeb00be9493725eb3bca4ad6743765dc1bdb9a8a52"} Jul 08 23:03:25.804876 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:25.804418 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-nmt8n" event={"ID":"c3706171-5a28-40f9-ba1c-a2de8a2087d3","Type":"ContainerStarted","Data":"666928f2c10041fb11bb776d24a368114bea0dd68ec5024a5741c23adeb198d6"} Jul 08 23:03:25.820828 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:25.820774 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-758f599c5-nmt8n" podStartSLOduration=1.8207540679999998 podStartE2EDuration="1.820754068s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:03:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:03:25.8203712 +0000 UTC m=+55.868645098" watchObservedRunningTime="2026-07-08 23:03:25.820754068 +0000 UTC m=+55.869027972" Jul 08 23:03:25.897018 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:25.896992 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tmmqj_b8a428fb-e40d-437f-ae4d-ecd7141e03a5/konnectivity-agent/0.log" limit=1024 Jul 08 23:03:29.069162 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:29.069127 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/03e6221f-5609-44a4-9635-7c99defdf4e1-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-gqzqm\" (UID: \"03e6221f-5609-44a4-9635-7c99defdf4e1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-gqzqm" Jul 08 23:03:29.071474 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:29.071436 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/03e6221f-5609-44a4-9635-7c99defdf4e1-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-gqzqm\" (UID: \"03e6221f-5609-44a4-9635-7c99defdf4e1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-gqzqm" Jul 08 23:03:29.169732 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:29.169700 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e4f8810f-3199-4a12-9f3e-696df87448d4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-h5zzc\" (UID: \"e4f8810f-3199-4a12-9f3e-696df87448d4\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-h5zzc" Jul 08 23:03:29.169879 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:29.169748 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/55cfa647-c40e-4556-b295-ad4fb60fde44-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-s5dnv\" (UID: \"55cfa647-c40e-4556-b295-ad4fb60fde44\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-s5dnv" Jul 08 23:03:29.169879 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:03:29.169840 2574 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 08 23:03:29.169992 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:03:29.169909 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4f8810f-3199-4a12-9f3e-696df87448d4-cluster-monitoring-operator-tls podName:e4f8810f-3199-4a12-9f3e-696df87448d4 nodeName:}" failed. No retries permitted until 2026-07-08 23:03:45.169893918 +0000 UTC m=+75.218167799 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e4f8810f-3199-4a12-9f3e-696df87448d4-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-h5zzc" (UID: "e4f8810f-3199-4a12-9f3e-696df87448d4") : secret "cluster-monitoring-operator-tls" not found Jul 08 23:03:29.169992 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:03:29.169930 2574 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 08 23:03:29.170081 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:03:29.169998 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/55cfa647-c40e-4556-b295-ad4fb60fde44-networking-console-plugin-cert podName:55cfa647-c40e-4556-b295-ad4fb60fde44 nodeName:}" failed. No retries permitted until 2026-07-08 23:03:45.169980318 +0000 UTC m=+75.218254217 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/55cfa647-c40e-4556-b295-ad4fb60fde44-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-s5dnv" (UID: "55cfa647-c40e-4556-b295-ad4fb60fde44") : secret "networking-console-plugin-cert" not found Jul 08 23:03:29.198814 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:29.198791 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-gqzqm" Jul 08 23:03:29.271172 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:29.271145 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2edaad22-d491-4a9c-ae1f-eb9f87b42986-metrics-certs\") pod \"router-default-7c85f98b97-bnhrb\" (UID: \"2edaad22-d491-4a9c-ae1f-eb9f87b42986\") " pod="openshift-ingress/router-default-7c85f98b97-bnhrb" Jul 08 23:03:29.271334 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:29.271179 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2edaad22-d491-4a9c-ae1f-eb9f87b42986-service-ca-bundle\") pod \"router-default-7c85f98b97-bnhrb\" (UID: \"2edaad22-d491-4a9c-ae1f-eb9f87b42986\") " pod="openshift-ingress/router-default-7c85f98b97-bnhrb" Jul 08 23:03:29.271395 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:03:29.271376 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2edaad22-d491-4a9c-ae1f-eb9f87b42986-service-ca-bundle podName:2edaad22-d491-4a9c-ae1f-eb9f87b42986 nodeName:}" failed. No retries permitted until 2026-07-08 23:03:45.271363465 +0000 UTC m=+75.319637347 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2edaad22-d491-4a9c-ae1f-eb9f87b42986-service-ca-bundle") pod "router-default-7c85f98b97-bnhrb" (UID: "2edaad22-d491-4a9c-ae1f-eb9f87b42986") : configmap references non-existent config key: service-ca.crt Jul 08 23:03:29.271623 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:03:29.271595 2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 08 23:03:29.271758 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:03:29.271680 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2edaad22-d491-4a9c-ae1f-eb9f87b42986-metrics-certs podName:2edaad22-d491-4a9c-ae1f-eb9f87b42986 nodeName:}" failed. No retries permitted until 2026-07-08 23:03:45.271660332 +0000 UTC m=+75.319934219 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2edaad22-d491-4a9c-ae1f-eb9f87b42986-metrics-certs") pod "router-default-7c85f98b97-bnhrb" (UID: "2edaad22-d491-4a9c-ae1f-eb9f87b42986") : secret "router-metrics-certs-default" not found Jul 08 23:03:29.336659 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:29.336586 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-gqzqm"] Jul 08 23:03:29.472561 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:29.472529 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4e57d4ab-946f-4067-b9dd-8305e346e99b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8mtw6\" (UID: \"4e57d4ab-946f-4067-b9dd-8305e346e99b\") " pod="openshift-insights/insights-runtime-extractor-8mtw6" Jul 08 23:03:29.472665 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:29.472601 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4e57d4ab-946f-4067-b9dd-8305e346e99b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8mtw6\" (UID: \"4e57d4ab-946f-4067-b9dd-8305e346e99b\") " pod="openshift-insights/insights-runtime-extractor-8mtw6" Jul 08 23:03:29.472725 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:03:29.472675 2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 08 23:03:29.472770 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:03:29.472731 2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 08 23:03:29.472770 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:03:29.472740 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e57d4ab-946f-4067-b9dd-8305e346e99b-insights-runtime-extractor-tls podName:4e57d4ab-946f-4067-b9dd-8305e346e99b nodeName:}" failed. No retries permitted until 2026-07-08 23:03:37.472720518 +0000 UTC m=+67.520994403 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4e57d4ab-946f-4067-b9dd-8305e346e99b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8mtw6" (UID: "4e57d4ab-946f-4067-b9dd-8305e346e99b") : secret "insights-runtime-extractor-tls" not found Jul 08 23:03:29.472850 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:03:29.472781 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4e57d4ab-946f-4067-b9dd-8305e346e99b-kube-rbac-proxy-cm podName:4e57d4ab-946f-4067-b9dd-8305e346e99b nodeName:}" failed. No retries permitted until 2026-07-08 23:03:37.472770035 +0000 UTC m=+67.521043921 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4e57d4ab-946f-4067-b9dd-8305e346e99b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8mtw6" (UID: "4e57d4ab-946f-4067-b9dd-8305e346e99b") : configmap "kube-rbac-proxy" not found Jul 08 23:03:29.820497 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:29.820463 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-gqzqm" event={"ID":"03e6221f-5609-44a4-9635-7c99defdf4e1","Type":"ContainerStarted","Data":"cadf84e62ac9e64ece1e4e742df5b49670926b3d4c24fbaf8007e800dcec1ca5"} Jul 08 23:03:31.827971 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:31.827930 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-gqzqm" event={"ID":"03e6221f-5609-44a4-9635-7c99defdf4e1","Type":"ContainerStarted","Data":"b9ec1e39c8daf98ffbbad51c6cc6ca16560274af6a039fbbbaf3f4eb7b579f59"} Jul 08 23:03:31.828415 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:31.827991 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-gqzqm" event={"ID":"03e6221f-5609-44a4-9635-7c99defdf4e1","Type":"ContainerStarted","Data":"d9d74e894c57b02f41fa0dc33b3a7ec5d01b7e722eba62a4c7d7fa2f4ce2001b"} Jul 08 23:03:31.842734 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:31.842687 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-gqzqm" podStartSLOduration=16.78604231 podStartE2EDuration="18.84267214s" totalImagesPullingTime="2.05662983s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:03:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:03:31.841631082 +0000 UTC m=+61.889904986" watchObservedRunningTime="2026-07-08 23:03:31.84267214 +0000 UTC m=+61.890946043" Jul 08 23:03:31.916981 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:31.916955 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8mcjt" Jul 08 23:03:36.232223 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:36.232141 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/da74ec55-7cda-4f1a-ba6d-0b4222b5fcb5-original-pull-secret\") pod \"global-pull-secret-syncer-gggnj\" (UID: \"da74ec55-7cda-4f1a-ba6d-0b4222b5fcb5\") " pod="kube-system/global-pull-secret-syncer-gggnj" Jul 08 23:03:36.234733 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:36.234713 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 08 23:03:36.244957 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:36.244935 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/da74ec55-7cda-4f1a-ba6d-0b4222b5fcb5-original-pull-secret\") pod \"global-pull-secret-syncer-gggnj\" (UID: \"da74ec55-7cda-4f1a-ba6d-0b4222b5fcb5\") " pod="kube-system/global-pull-secret-syncer-gggnj" Jul 08 23:03:36.333142 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:36.333115 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bfaa3f60-05b5-436b-9c10-324361b4bae0-metrics-certs\") pod \"network-metrics-daemon-wj6vf\" (UID: \"bfaa3f60-05b5-436b-9c10-324361b4bae0\") " pod="openshift-multus/network-metrics-daemon-wj6vf" Jul 08 23:03:36.333238 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:36.333224 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q6b7p\" (UniqueName: \"kubernetes.io/projected/994c671c-e4ec-474c-94fa-53f4cab24a16-kube-api-access-q6b7p\") pod \"network-check-target-264tg\" (UID: \"994c671c-e4ec-474c-94fa-53f4cab24a16\") " pod="openshift-network-diagnostics/network-check-target-264tg" Jul 08 23:03:36.335498 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:36.335474 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q6b7p\" (UniqueName: \"kubernetes.io/projected/994c671c-e4ec-474c-94fa-53f4cab24a16-kube-api-access-q6b7p\") pod \"network-check-target-264tg\" (UID: \"994c671c-e4ec-474c-94fa-53f4cab24a16\") " pod="openshift-network-diagnostics/network-check-target-264tg" Jul 08 23:03:36.335642 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:36.335629 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 08 23:03:36.345531 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:36.345491 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bfaa3f60-05b5-436b-9c10-324361b4bae0-metrics-certs\") pod \"network-metrics-daemon-wj6vf\" (UID: \"bfaa3f60-05b5-436b-9c10-324361b4bae0\") " pod="openshift-multus/network-metrics-daemon-wj6vf" Jul 08 23:03:36.476138 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:36.476110 2574 scope.go:117] "RemoveContainer" containerID="a6959674e907ab6c66b960df6be9c59804d5d80afaf34be21e125d8b17810b32" Jul 08 23:03:36.490674 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:36.490652 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-f6f6s\"" Jul 08 23:03:36.494119 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:36.494102 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gggnj" Jul 08 23:03:36.497912 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:36.497896 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-264tg" Jul 08 23:03:36.501831 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:36.501805 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8bt8r\"" Jul 08 23:03:36.510002 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:36.509937 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wj6vf" Jul 08 23:03:36.650965 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:36.650931 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-gggnj"] Jul 08 23:03:36.666391 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:36.666359 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-264tg"] Jul 08 23:03:36.689216 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:36.689085 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-wj6vf"] Jul 08 23:03:36.695486 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:03:36.695459 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda74ec55_7cda_4f1a_ba6d_0b4222b5fcb5.slice/crio-c2a65ff4d73abf4c4875282c0c5ce10a32695455c76313363e60e9295949796a WatchSource:0}: Error finding container c2a65ff4d73abf4c4875282c0c5ce10a32695455c76313363e60e9295949796a: Status 404 returned error can't find the container with id c2a65ff4d73abf4c4875282c0c5ce10a32695455c76313363e60e9295949796a Jul 08 23:03:36.695717 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:03:36.695699 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbfaa3f60_05b5_436b_9c10_324361b4bae0.slice/crio-6e73f7de1c54a7eabe054fa5e7c9585b9f700383e815ff7c15b43d2c835eee13 WatchSource:0}: Error finding container 6e73f7de1c54a7eabe054fa5e7c9585b9f700383e815ff7c15b43d2c835eee13: Status 404 returned error can't find the container with id 6e73f7de1c54a7eabe054fa5e7c9585b9f700383e815ff7c15b43d2c835eee13 Jul 08 23:03:36.695867 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:03:36.695850 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod994c671c_e4ec_474c_94fa_53f4cab24a16.slice/crio-e6bb599e694202d46880c99bf7e74bf673bc80371fb21d7ece9e06fb3459672b WatchSource:0}: Error finding container e6bb599e694202d46880c99bf7e74bf673bc80371fb21d7ece9e06fb3459672b: Status 404 returned error can't find the container with id e6bb599e694202d46880c99bf7e74bf673bc80371fb21d7ece9e06fb3459672b Jul 08 23:03:36.851652 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:36.851613 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wj6vf" event={"ID":"bfaa3f60-05b5-436b-9c10-324361b4bae0","Type":"ContainerStarted","Data":"6e73f7de1c54a7eabe054fa5e7c9585b9f700383e815ff7c15b43d2c835eee13"} Jul 08 23:03:36.853093 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:36.853072 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-b7vhr_820d35fb-fba2-4328-9e2b-0874474cb416/console-operator/2.log" Jul 08 23:03:36.853419 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:36.853405 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-b7vhr_820d35fb-fba2-4328-9e2b-0874474cb416/console-operator/1.log" Jul 08 23:03:36.853463 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:36.853439 2574 generic.go:356] "Generic (PLEG): container finished" podID="820d35fb-fba2-4328-9e2b-0874474cb416" containerID="457bd11a755b9e31cb6cdf186c1f3480a74a61d3c10be1986ce3a9faa790240d" exitCode=255 Jul 08 23:03:36.853520 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:36.853477 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-b7vhr" event={"ID":"820d35fb-fba2-4328-9e2b-0874474cb416","Type":"ContainerDied","Data":"457bd11a755b9e31cb6cdf186c1f3480a74a61d3c10be1986ce3a9faa790240d"} Jul 08 23:03:36.853559 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:36.853537 2574 scope.go:117] "RemoveContainer" containerID="a6959674e907ab6c66b960df6be9c59804d5d80afaf34be21e125d8b17810b32" Jul 08 23:03:36.853807 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:36.853790 2574 scope.go:117] "RemoveContainer" containerID="457bd11a755b9e31cb6cdf186c1f3480a74a61d3c10be1986ce3a9faa790240d" Jul 08 23:03:36.853988 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:03:36.853970 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-68b757fb67-b7vhr_openshift-console-operator(820d35fb-fba2-4328-9e2b-0874474cb416)\"" pod="openshift-console-operator/console-operator-68b757fb67-b7vhr" podUID="820d35fb-fba2-4328-9e2b-0874474cb416" Jul 08 23:03:36.855064 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:36.855036 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-264tg" event={"ID":"994c671c-e4ec-474c-94fa-53f4cab24a16","Type":"ContainerStarted","Data":"2978d6c17731ff056be5bc52d067704aa25b8d18d68d8301785715a99409bf98"} Jul 08 23:03:36.855171 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:36.855075 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-264tg" event={"ID":"994c671c-e4ec-474c-94fa-53f4cab24a16","Type":"ContainerStarted","Data":"e6bb599e694202d46880c99bf7e74bf673bc80371fb21d7ece9e06fb3459672b"} Jul 08 23:03:36.855171 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:36.855101 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-264tg" Jul 08 23:03:36.856115 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:36.856096 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-gggnj" event={"ID":"da74ec55-7cda-4f1a-ba6d-0b4222b5fcb5","Type":"ContainerStarted","Data":"c2a65ff4d73abf4c4875282c0c5ce10a32695455c76313363e60e9295949796a"} Jul 08 23:03:36.882131 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:36.882093 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-264tg" podStartSLOduration=65.882079318 podStartE2EDuration="1m5.882079318s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:02:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:03:36.881700017 +0000 UTC m=+66.929973920" watchObservedRunningTime="2026-07-08 23:03:36.882079318 +0000 UTC m=+66.930353221" Jul 08 23:03:37.545129 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:37.545050 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4e57d4ab-946f-4067-b9dd-8305e346e99b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8mtw6\" (UID: \"4e57d4ab-946f-4067-b9dd-8305e346e99b\") " pod="openshift-insights/insights-runtime-extractor-8mtw6" Jul 08 23:03:37.545129 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:37.545128 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4e57d4ab-946f-4067-b9dd-8305e346e99b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8mtw6\" (UID: \"4e57d4ab-946f-4067-b9dd-8305e346e99b\") " pod="openshift-insights/insights-runtime-extractor-8mtw6" Jul 08 23:03:37.545789 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:37.545761 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4e57d4ab-946f-4067-b9dd-8305e346e99b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8mtw6\" (UID: \"4e57d4ab-946f-4067-b9dd-8305e346e99b\") " pod="openshift-insights/insights-runtime-extractor-8mtw6" Jul 08 23:03:37.547763 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:37.547739 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4e57d4ab-946f-4067-b9dd-8305e346e99b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8mtw6\" (UID: \"4e57d4ab-946f-4067-b9dd-8305e346e99b\") " pod="openshift-insights/insights-runtime-extractor-8mtw6" Jul 08 23:03:37.602115 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:37.601984 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-ntpx9\"" Jul 08 23:03:37.610109 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:37.610083 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8mtw6" Jul 08 23:03:37.763861 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:37.763777 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8mtw6"] Jul 08 23:03:37.863070 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:37.862979 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-b7vhr_820d35fb-fba2-4328-9e2b-0874474cb416/console-operator/2.log" Jul 08 23:03:38.009848 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:03:38.009805 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e57d4ab_946f_4067_b9dd_8305e346e99b.slice/crio-d983f74734c4928b94c342dc501353db762632bac228aeb53096e1072e020fe5 WatchSource:0}: Error finding container d983f74734c4928b94c342dc501353db762632bac228aeb53096e1072e020fe5: Status 404 returned error can't find the container with id d983f74734c4928b94c342dc501353db762632bac228aeb53096e1072e020fe5 Jul 08 23:03:38.251857 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:38.251781 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4798cc78-68f0-447d-8ac9-b4b71ee8801d-metrics-tls\") pod \"dns-default-pr92b\" (UID: \"4798cc78-68f0-447d-8ac9-b4b71ee8801d\") " pod="openshift-dns/dns-default-pr92b" Jul 08 23:03:38.252021 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:38.251880 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/95b3aab3-2dca-4fc5-9de4-eef31714950d-registry-tls\") pod \"image-registry-59d44dd9bb-4zrm7\" (UID: \"95b3aab3-2dca-4fc5-9de4-eef31714950d\") " pod="openshift-image-registry/image-registry-59d44dd9bb-4zrm7" Jul 08 23:03:38.254288 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:38.254262 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4798cc78-68f0-447d-8ac9-b4b71ee8801d-metrics-tls\") pod \"dns-default-pr92b\" (UID: \"4798cc78-68f0-447d-8ac9-b4b71ee8801d\") " pod="openshift-dns/dns-default-pr92b" Jul 08 23:03:38.254539 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:38.254500 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/95b3aab3-2dca-4fc5-9de4-eef31714950d-registry-tls\") pod \"image-registry-59d44dd9bb-4zrm7\" (UID: \"95b3aab3-2dca-4fc5-9de4-eef31714950d\") " pod="openshift-image-registry/image-registry-59d44dd9bb-4zrm7" Jul 08 23:03:38.386153 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:38.385840 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-qxxgd\"" Jul 08 23:03:38.393015 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:38.392981 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59d44dd9bb-4zrm7" Jul 08 23:03:38.393940 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:38.393919 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-2zvtt\"" Jul 08 23:03:38.402889 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:38.402866 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pr92b" Jul 08 23:03:38.580795 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:38.580764 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-59d44dd9bb-4zrm7"] Jul 08 23:03:38.585137 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:03:38.585002 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95b3aab3_2dca_4fc5_9de4_eef31714950d.slice/crio-273f70f9d4f5e07ebf1e0be78f643ffe11d987fbc9ba748129bf304051af6ef2 WatchSource:0}: Error finding container 273f70f9d4f5e07ebf1e0be78f643ffe11d987fbc9ba748129bf304051af6ef2: Status 404 returned error can't find the container with id 273f70f9d4f5e07ebf1e0be78f643ffe11d987fbc9ba748129bf304051af6ef2 Jul 08 23:03:38.607205 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:38.607024 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-pr92b"] Jul 08 23:03:38.610813 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:03:38.610783 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4798cc78_68f0_447d_8ac9_b4b71ee8801d.slice/crio-a4b8cb10748219b9d6c035484eee809b917ad80b299fc7b2a9ea3ed023b9d355 WatchSource:0}: Error finding container a4b8cb10748219b9d6c035484eee809b917ad80b299fc7b2a9ea3ed023b9d355: Status 404 returned error can't find the container with id a4b8cb10748219b9d6c035484eee809b917ad80b299fc7b2a9ea3ed023b9d355 Jul 08 23:03:38.876559 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:38.875565 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wj6vf" event={"ID":"bfaa3f60-05b5-436b-9c10-324361b4bae0","Type":"ContainerStarted","Data":"973ed1964ed19d59f5f17d371a9143999b551166dd30803500a31d06186cf0e7"} Jul 08 23:03:38.876559 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:38.875632 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wj6vf" event={"ID":"bfaa3f60-05b5-436b-9c10-324361b4bae0","Type":"ContainerStarted","Data":"149b772fe8f453563553d0ec4cb26d9bb81c42ac40b8e0f91297e3c34b664c3e"} Jul 08 23:03:38.878715 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:38.878623 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pr92b" event={"ID":"4798cc78-68f0-447d-8ac9-b4b71ee8801d","Type":"ContainerStarted","Data":"a4b8cb10748219b9d6c035484eee809b917ad80b299fc7b2a9ea3ed023b9d355"} Jul 08 23:03:38.881859 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:38.881775 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8mtw6" event={"ID":"4e57d4ab-946f-4067-b9dd-8305e346e99b","Type":"ContainerStarted","Data":"d983f74734c4928b94c342dc501353db762632bac228aeb53096e1072e020fe5"} Jul 08 23:03:38.885434 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:38.885408 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-59d44dd9bb-4zrm7" event={"ID":"95b3aab3-2dca-4fc5-9de4-eef31714950d","Type":"ContainerStarted","Data":"2b44ebce608049c0f2db0b06778db63be4af6312883e13b34d989b1ed390adee"} Jul 08 23:03:38.885562 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:38.885456 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-59d44dd9bb-4zrm7" event={"ID":"95b3aab3-2dca-4fc5-9de4-eef31714950d","Type":"ContainerStarted","Data":"273f70f9d4f5e07ebf1e0be78f643ffe11d987fbc9ba748129bf304051af6ef2"} Jul 08 23:03:38.885994 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:38.885973 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-59d44dd9bb-4zrm7" Jul 08 23:03:38.894741 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:38.893431 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-wj6vf" podStartSLOduration=66.275622243 podStartE2EDuration="1m7.893413544s" totalImagesPullingTime="1.617791301s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:02:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:03:38.89106806 +0000 UTC m=+68.939341964" watchObservedRunningTime="2026-07-08 23:03:38.893413544 +0000 UTC m=+68.941687446" Jul 08 23:03:38.913176 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:38.911504 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-59d44dd9bb-4zrm7" podStartSLOduration=67.911483905 podStartE2EDuration="1m7.911483905s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:02:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:03:38.910970072 +0000 UTC m=+68.959243976" watchObservedRunningTime="2026-07-08 23:03:38.911483905 +0000 UTC m=+68.959757810" Jul 08 23:03:43.713912 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:43.713878 2574 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-b7vhr" Jul 08 23:03:43.714312 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:43.713946 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-b7vhr" Jul 08 23:03:43.714312 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:43.714298 2574 scope.go:117] "RemoveContainer" containerID="457bd11a755b9e31cb6cdf186c1f3480a74a61d3c10be1986ce3a9faa790240d" Jul 08 23:03:43.714542 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:03:43.714500 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-68b757fb67-b7vhr_openshift-console-operator(820d35fb-fba2-4328-9e2b-0874474cb416)\"" pod="openshift-console-operator/console-operator-68b757fb67-b7vhr" podUID="820d35fb-fba2-4328-9e2b-0874474cb416" Jul 08 23:03:43.904723 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:43.904657 2574 scope.go:117] "RemoveContainer" containerID="457bd11a755b9e31cb6cdf186c1f3480a74a61d3c10be1986ce3a9faa790240d" Jul 08 23:03:43.904900 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:03:43.904874 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-68b757fb67-b7vhr_openshift-console-operator(820d35fb-fba2-4328-9e2b-0874474cb416)\"" pod="openshift-console-operator/console-operator-68b757fb67-b7vhr" podUID="820d35fb-fba2-4328-9e2b-0874474cb416" Jul 08 23:03:44.909393 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:44.909357 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pr92b" event={"ID":"4798cc78-68f0-447d-8ac9-b4b71ee8801d","Type":"ContainerStarted","Data":"01a68e66fc1143840c51d748e5ecd1c558cd1f78ae37f60f19211a485df8f257"} Jul 08 23:03:44.909820 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:44.909412 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pr92b" event={"ID":"4798cc78-68f0-447d-8ac9-b4b71ee8801d","Type":"ContainerStarted","Data":"07815cb16693b58ca0b3f70119d5e97475f185345c6d98659ad6565c818db643"} Jul 08 23:03:44.909820 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:44.909469 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-pr92b" Jul 08 23:03:44.911399 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:44.911372 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8mtw6" event={"ID":"4e57d4ab-946f-4067-b9dd-8305e346e99b","Type":"ContainerStarted","Data":"66d839c913194545ecdfa382d64e12346af6db401c1008b9abc31f8e693892c5"} Jul 08 23:03:44.911534 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:44.911426 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8mtw6" event={"ID":"4e57d4ab-946f-4067-b9dd-8305e346e99b","Type":"ContainerStarted","Data":"0708df8b278c74cd0a0759419712fc90540f17b3c1f8e883edc87276d613014d"} Jul 08 23:03:44.912785 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:44.912761 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-gggnj" event={"ID":"da74ec55-7cda-4f1a-ba6d-0b4222b5fcb5","Type":"ContainerStarted","Data":"49ca2c76c1dbf626fa171e90f67dce8be04d6dc1d825cd0f30d33cb28c5a77ba"} Jul 08 23:03:44.926935 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:44.926859 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-pr92b" podStartSLOduration=33.573865878 podStartE2EDuration="38.926845321s" totalImagesPullingTime="5.352979443s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:03:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:03:44.92491973 +0000 UTC m=+74.973193643" watchObservedRunningTime="2026-07-08 23:03:44.926845321 +0000 UTC m=+74.975119609" Jul 08 23:03:44.942240 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:44.939701 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-gggnj" podStartSLOduration=66.671087668 podStartE2EDuration="1m13.93968149s" totalImagesPullingTime="7.268593822s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 23:02:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:03:44.93778378 +0000 UTC m=+74.986057685" watchObservedRunningTime="2026-07-08 23:03:44.93968149 +0000 UTC m=+74.987955394" Jul 08 23:03:45.217062 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:45.216970 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e4f8810f-3199-4a12-9f3e-696df87448d4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-h5zzc\" (UID: \"e4f8810f-3199-4a12-9f3e-696df87448d4\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-h5zzc" Jul 08 23:03:45.217062 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:45.217006 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/55cfa647-c40e-4556-b295-ad4fb60fde44-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-s5dnv\" (UID: \"55cfa647-c40e-4556-b295-ad4fb60fde44\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-s5dnv" Jul 08 23:03:45.219481 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:45.219453 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/55cfa647-c40e-4556-b295-ad4fb60fde44-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-s5dnv\" (UID: \"55cfa647-c40e-4556-b295-ad4fb60fde44\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-s5dnv" Jul 08 23:03:45.219607 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:45.219453 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e4f8810f-3199-4a12-9f3e-696df87448d4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-h5zzc\" (UID: \"e4f8810f-3199-4a12-9f3e-696df87448d4\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-h5zzc" Jul 08 23:03:45.317681 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:45.317647 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2edaad22-d491-4a9c-ae1f-eb9f87b42986-metrics-certs\") pod \"router-default-7c85f98b97-bnhrb\" (UID: \"2edaad22-d491-4a9c-ae1f-eb9f87b42986\") " pod="openshift-ingress/router-default-7c85f98b97-bnhrb" Jul 08 23:03:45.317681 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:45.317684 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2edaad22-d491-4a9c-ae1f-eb9f87b42986-service-ca-bundle\") pod \"router-default-7c85f98b97-bnhrb\" (UID: \"2edaad22-d491-4a9c-ae1f-eb9f87b42986\") " pod="openshift-ingress/router-default-7c85f98b97-bnhrb" Jul 08 23:03:45.318327 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:45.318310 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2edaad22-d491-4a9c-ae1f-eb9f87b42986-service-ca-bundle\") pod \"router-default-7c85f98b97-bnhrb\" (UID: \"2edaad22-d491-4a9c-ae1f-eb9f87b42986\") " pod="openshift-ingress/router-default-7c85f98b97-bnhrb" Jul 08 23:03:45.320495 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:45.320476 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2edaad22-d491-4a9c-ae1f-eb9f87b42986-metrics-certs\") pod \"router-default-7c85f98b97-bnhrb\" (UID: \"2edaad22-d491-4a9c-ae1f-eb9f87b42986\") " pod="openshift-ingress/router-default-7c85f98b97-bnhrb" Jul 08 23:03:45.455676 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:45.455648 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-bkfzx\"" Jul 08 23:03:45.463639 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:45.463614 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-h5zzc" Jul 08 23:03:45.467043 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:45.466844 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-rwpkf\"" Jul 08 23:03:45.475410 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:45.475387 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-s5dnv" Jul 08 23:03:45.544585 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:45.544559 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-fbqrd\"" Jul 08 23:03:45.551349 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:45.551287 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7c85f98b97-bnhrb" Jul 08 23:03:45.622076 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:45.621963 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-h5zzc"] Jul 08 23:03:45.627731 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:03:45.627701 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4f8810f_3199_4a12_9f3e_696df87448d4.slice/crio-79b6e8c7ad5035b967e15edb9ab2f6fd7eef219b5cad316273e6de31ec65c4f2 WatchSource:0}: Error finding container 79b6e8c7ad5035b967e15edb9ab2f6fd7eef219b5cad316273e6de31ec65c4f2: Status 404 returned error can't find the container with id 79b6e8c7ad5035b967e15edb9ab2f6fd7eef219b5cad316273e6de31ec65c4f2 Jul 08 23:03:45.645038 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:45.645013 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-s5dnv"] Jul 08 23:03:45.648925 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:03:45.648755 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55cfa647_c40e_4556_b295_ad4fb60fde44.slice/crio-4308198e0a348ce5ed11249c5667d9d387f8dd6575af0e5f593c6fc91c011292 WatchSource:0}: Error finding container 4308198e0a348ce5ed11249c5667d9d387f8dd6575af0e5f593c6fc91c011292: Status 404 returned error can't find the container with id 4308198e0a348ce5ed11249c5667d9d387f8dd6575af0e5f593c6fc91c011292 Jul 08 23:03:45.700585 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:45.700490 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7c85f98b97-bnhrb"] Jul 08 23:03:45.703349 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:03:45.703322 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2edaad22_d491_4a9c_ae1f_eb9f87b42986.slice/crio-09d5eb8ec0bdf91c20dd63824a2d02e2e7990b6606f39338bc0d05c6186f472c WatchSource:0}: Error finding container 09d5eb8ec0bdf91c20dd63824a2d02e2e7990b6606f39338bc0d05c6186f472c: Status 404 returned error can't find the container with id 09d5eb8ec0bdf91c20dd63824a2d02e2e7990b6606f39338bc0d05c6186f472c Jul 08 23:03:45.918678 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:45.918638 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-h5zzc" event={"ID":"e4f8810f-3199-4a12-9f3e-696df87448d4","Type":"ContainerStarted","Data":"79b6e8c7ad5035b967e15edb9ab2f6fd7eef219b5cad316273e6de31ec65c4f2"} Jul 08 23:03:45.920617 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:45.920577 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7c85f98b97-bnhrb" event={"ID":"2edaad22-d491-4a9c-ae1f-eb9f87b42986","Type":"ContainerStarted","Data":"97fe238c504e579983585c34e8de05aff175c3311f12f0f4c4090ca39d83ad91"} Jul 08 23:03:45.920769 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:45.920626 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7c85f98b97-bnhrb" event={"ID":"2edaad22-d491-4a9c-ae1f-eb9f87b42986","Type":"ContainerStarted","Data":"09d5eb8ec0bdf91c20dd63824a2d02e2e7990b6606f39338bc0d05c6186f472c"} Jul 08 23:03:45.921919 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:45.921877 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-s5dnv" event={"ID":"55cfa647-c40e-4556-b295-ad4fb60fde44","Type":"ContainerStarted","Data":"4308198e0a348ce5ed11249c5667d9d387f8dd6575af0e5f593c6fc91c011292"} Jul 08 23:03:45.939544 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:45.939477 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-7c85f98b97-bnhrb" podStartSLOduration=32.93945702 podStartE2EDuration="32.93945702s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:03:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:03:45.938212503 +0000 UTC m=+75.986486410" watchObservedRunningTime="2026-07-08 23:03:45.93945702 +0000 UTC m=+75.987730925" Jul 08 23:03:46.551848 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:46.551806 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-7c85f98b97-bnhrb" Jul 08 23:03:46.560274 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:46.560250 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-7c85f98b97-bnhrb" Jul 08 23:03:46.927129 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:46.927026 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-7c85f98b97-bnhrb" Jul 08 23:03:46.928498 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:46.928476 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-7c85f98b97-bnhrb" Jul 08 23:03:48.183783 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:48.183752 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b8d6cc6f6-2d2wd"] Jul 08 23:03:48.188200 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:48.188173 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-578bdf959d-kkfx2"] Jul 08 23:03:48.188339 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:48.188319 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b8d6cc6f6-2d2wd" Jul 08 23:03:48.191233 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:48.191207 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-x4nws\"" Jul 08 23:03:48.192252 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:48.192229 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 08 23:03:48.192813 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:48.192606 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 08 23:03:48.193530 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:48.193096 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 08 23:03:48.193530 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:48.193349 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 08 23:03:48.198161 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:48.196816 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-d8bcd9c69-pp7d2"] Jul 08 23:03:48.198161 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:48.197502 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-578bdf959d-kkfx2" Jul 08 23:03:48.205895 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:48.200866 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 08 23:03:48.205895 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:48.201085 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 08 23:03:48.205895 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:48.201445 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 08 23:03:48.205895 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:48.200969 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 08 23:03:48.205895 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:48.203365 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b8d6cc6f6-2d2wd"] Jul 08 23:03:48.205895 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:48.203570 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d8bcd9c69-pp7d2" Jul 08 23:03:48.205895 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:48.203758 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-d8bcd9c69-pp7d2"] Jul 08 23:03:48.207199 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:48.207174 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-578bdf959d-kkfx2"] Jul 08 23:03:48.207882 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:48.207863 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 08 23:03:48.343195 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:48.343165 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2f27b6d9-2632-4f2f-8f45-f80bf2251091-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-b8d6cc6f6-2d2wd\" (UID: \"2f27b6d9-2632-4f2f-8f45-f80bf2251091\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b8d6cc6f6-2d2wd" Jul 08 23:03:48.343389 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:48.343205 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/930cdf8c-3e63-47c6-a9c1-aa30c2a9bc5b-additional-service-ca\") pod \"cluster-proxy-proxy-agent-578bdf959d-kkfx2\" (UID: \"930cdf8c-3e63-47c6-a9c1-aa30c2a9bc5b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-578bdf959d-kkfx2" Jul 08 23:03:48.343389 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:48.343237 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/c2d7d459-a7af-4582-ab47-3091cd450548-klusterlet-config\") pod \"klusterlet-addon-workmgr-d8bcd9c69-pp7d2\" (UID: \"c2d7d459-a7af-4582-ab47-3091cd450548\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d8bcd9c69-pp7d2" Jul 08 23:03:48.343389 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:48.343257 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b7ndq\" (UniqueName: \"kubernetes.io/projected/c2d7d459-a7af-4582-ab47-3091cd450548-kube-api-access-b7ndq\") pod \"klusterlet-addon-workmgr-d8bcd9c69-pp7d2\" (UID: \"c2d7d459-a7af-4582-ab47-3091cd450548\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d8bcd9c69-pp7d2" Jul 08 23:03:48.343389 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:48.343288 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/930cdf8c-3e63-47c6-a9c1-aa30c2a9bc5b-ca\") pod \"cluster-proxy-proxy-agent-578bdf959d-kkfx2\" (UID: \"930cdf8c-3e63-47c6-a9c1-aa30c2a9bc5b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-578bdf959d-kkfx2" Jul 08 23:03:48.343615 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:48.343388 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxfrb\" (UniqueName: \"kubernetes.io/projected/2f27b6d9-2632-4f2f-8f45-f80bf2251091-kube-api-access-rxfrb\") pod \"managed-serviceaccount-addon-agent-b8d6cc6f6-2d2wd\" (UID: \"2f27b6d9-2632-4f2f-8f45-f80bf2251091\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b8d6cc6f6-2d2wd" Jul 08 23:03:48.343615 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:48.343416 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/930cdf8c-3e63-47c6-a9c1-aa30c2a9bc5b-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-578bdf959d-kkfx2\" (UID: \"930cdf8c-3e63-47c6-a9c1-aa30c2a9bc5b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-578bdf959d-kkfx2" Jul 08 23:03:48.343615 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:48.343456 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c2d7d459-a7af-4582-ab47-3091cd450548-tmp\") pod \"klusterlet-addon-workmgr-d8bcd9c69-pp7d2\" (UID: \"c2d7d459-a7af-4582-ab47-3091cd450548\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d8bcd9c69-pp7d2" Jul 08 23:03:48.343615 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:48.343577 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/930cdf8c-3e63-47c6-a9c1-aa30c2a9bc5b-hub\") pod \"cluster-proxy-proxy-agent-578bdf959d-kkfx2\" (UID: \"930cdf8c-3e63-47c6-a9c1-aa30c2a9bc5b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-578bdf959d-kkfx2" Jul 08 23:03:48.343615 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:48.343606 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxr75\" (UniqueName: \"kubernetes.io/projected/930cdf8c-3e63-47c6-a9c1-aa30c2a9bc5b-kube-api-access-gxr75\") pod \"cluster-proxy-proxy-agent-578bdf959d-kkfx2\" (UID: \"930cdf8c-3e63-47c6-a9c1-aa30c2a9bc5b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-578bdf959d-kkfx2" Jul 08 23:03:48.343817 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:48.343639 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/930cdf8c-3e63-47c6-a9c1-aa30c2a9bc5b-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-578bdf959d-kkfx2\" (UID: \"930cdf8c-3e63-47c6-a9c1-aa30c2a9bc5b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-578bdf959d-kkfx2" Jul 08 23:03:48.444556 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:48.444524 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/c2d7d459-a7af-4582-ab47-3091cd450548-klusterlet-config\") pod \"klusterlet-addon-workmgr-d8bcd9c69-pp7d2\" (UID: \"c2d7d459-a7af-4582-ab47-3091cd450548\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d8bcd9c69-pp7d2" Jul 08 23:03:48.444664 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:48.444560 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b7ndq\" (UniqueName: \"kubernetes.io/projected/c2d7d459-a7af-4582-ab47-3091cd450548-kube-api-access-b7ndq\") pod \"klusterlet-addon-workmgr-d8bcd9c69-pp7d2\" (UID: \"c2d7d459-a7af-4582-ab47-3091cd450548\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d8bcd9c69-pp7d2" Jul 08 23:03:48.444748 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:48.444725 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/930cdf8c-3e63-47c6-a9c1-aa30c2a9bc5b-ca\") pod \"cluster-proxy-proxy-agent-578bdf959d-kkfx2\" (UID: \"930cdf8c-3e63-47c6-a9c1-aa30c2a9bc5b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-578bdf959d-kkfx2" Jul 08 23:03:48.444810 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:48.444793 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rxfrb\" (UniqueName: \"kubernetes.io/projected/2f27b6d9-2632-4f2f-8f45-f80bf2251091-kube-api-access-rxfrb\") pod \"managed-serviceaccount-addon-agent-b8d6cc6f6-2d2wd\" (UID: \"2f27b6d9-2632-4f2f-8f45-f80bf2251091\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b8d6cc6f6-2d2wd" Jul 08 23:03:48.444856 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:48.444826 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/930cdf8c-3e63-47c6-a9c1-aa30c2a9bc5b-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-578bdf959d-kkfx2\" (UID: \"930cdf8c-3e63-47c6-a9c1-aa30c2a9bc5b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-578bdf959d-kkfx2" Jul 08 23:03:48.444893 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:48.444880 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c2d7d459-a7af-4582-ab47-3091cd450548-tmp\") pod \"klusterlet-addon-workmgr-d8bcd9c69-pp7d2\" (UID: \"c2d7d459-a7af-4582-ab47-3091cd450548\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d8bcd9c69-pp7d2" Jul 08 23:03:48.444946 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:48.444925 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/930cdf8c-3e63-47c6-a9c1-aa30c2a9bc5b-hub\") pod \"cluster-proxy-proxy-agent-578bdf959d-kkfx2\" (UID: \"930cdf8c-3e63-47c6-a9c1-aa30c2a9bc5b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-578bdf959d-kkfx2" Jul 08 23:03:48.445004 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:48.444946 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gxr75\" (UniqueName: \"kubernetes.io/projected/930cdf8c-3e63-47c6-a9c1-aa30c2a9bc5b-kube-api-access-gxr75\") pod \"cluster-proxy-proxy-agent-578bdf959d-kkfx2\" (UID: \"930cdf8c-3e63-47c6-a9c1-aa30c2a9bc5b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-578bdf959d-kkfx2" Jul 08 23:03:48.445004 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:48.444968 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/930cdf8c-3e63-47c6-a9c1-aa30c2a9bc5b-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-578bdf959d-kkfx2\" (UID: \"930cdf8c-3e63-47c6-a9c1-aa30c2a9bc5b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-578bdf959d-kkfx2" Jul 08 23:03:48.445095 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:48.445012 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2f27b6d9-2632-4f2f-8f45-f80bf2251091-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-b8d6cc6f6-2d2wd\" (UID: \"2f27b6d9-2632-4f2f-8f45-f80bf2251091\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b8d6cc6f6-2d2wd" Jul 08 23:03:48.445095 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:48.445040 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/930cdf8c-3e63-47c6-a9c1-aa30c2a9bc5b-additional-service-ca\") pod \"cluster-proxy-proxy-agent-578bdf959d-kkfx2\" (UID: \"930cdf8c-3e63-47c6-a9c1-aa30c2a9bc5b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-578bdf959d-kkfx2" Jul 08 23:03:48.445447 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:48.445385 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c2d7d459-a7af-4582-ab47-3091cd450548-tmp\") pod \"klusterlet-addon-workmgr-d8bcd9c69-pp7d2\" (UID: \"c2d7d459-a7af-4582-ab47-3091cd450548\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d8bcd9c69-pp7d2" Jul 08 23:03:48.445805 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:48.445738 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/930cdf8c-3e63-47c6-a9c1-aa30c2a9bc5b-additional-service-ca\") pod \"cluster-proxy-proxy-agent-578bdf959d-kkfx2\" (UID: \"930cdf8c-3e63-47c6-a9c1-aa30c2a9bc5b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-578bdf959d-kkfx2" Jul 08 23:03:48.447356 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:48.447312 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/930cdf8c-3e63-47c6-a9c1-aa30c2a9bc5b-ca\") pod \"cluster-proxy-proxy-agent-578bdf959d-kkfx2\" (UID: \"930cdf8c-3e63-47c6-a9c1-aa30c2a9bc5b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-578bdf959d-kkfx2" Jul 08 23:03:48.447710 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:48.447686 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/c2d7d459-a7af-4582-ab47-3091cd450548-klusterlet-config\") pod \"klusterlet-addon-workmgr-d8bcd9c69-pp7d2\" (UID: \"c2d7d459-a7af-4582-ab47-3091cd450548\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d8bcd9c69-pp7d2" Jul 08 23:03:48.447899 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:48.447875 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/930cdf8c-3e63-47c6-a9c1-aa30c2a9bc5b-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-578bdf959d-kkfx2\" (UID: \"930cdf8c-3e63-47c6-a9c1-aa30c2a9bc5b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-578bdf959d-kkfx2" Jul 08 23:03:48.447973 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:48.447912 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/930cdf8c-3e63-47c6-a9c1-aa30c2a9bc5b-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-578bdf959d-kkfx2\" (UID: \"930cdf8c-3e63-47c6-a9c1-aa30c2a9bc5b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-578bdf959d-kkfx2" Jul 08 23:03:48.448094 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:48.448074 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2f27b6d9-2632-4f2f-8f45-f80bf2251091-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-b8d6cc6f6-2d2wd\" (UID: \"2f27b6d9-2632-4f2f-8f45-f80bf2251091\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b8d6cc6f6-2d2wd" Jul 08 23:03:48.448138 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:48.448094 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/930cdf8c-3e63-47c6-a9c1-aa30c2a9bc5b-hub\") pod \"cluster-proxy-proxy-agent-578bdf959d-kkfx2\" (UID: \"930cdf8c-3e63-47c6-a9c1-aa30c2a9bc5b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-578bdf959d-kkfx2" Jul 08 23:03:48.457569 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:48.457474 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxr75\" (UniqueName: \"kubernetes.io/projected/930cdf8c-3e63-47c6-a9c1-aa30c2a9bc5b-kube-api-access-gxr75\") pod \"cluster-proxy-proxy-agent-578bdf959d-kkfx2\" (UID: \"930cdf8c-3e63-47c6-a9c1-aa30c2a9bc5b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-578bdf959d-kkfx2" Jul 08 23:03:48.457569 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:48.457503 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxfrb\" (UniqueName: \"kubernetes.io/projected/2f27b6d9-2632-4f2f-8f45-f80bf2251091-kube-api-access-rxfrb\") pod \"managed-serviceaccount-addon-agent-b8d6cc6f6-2d2wd\" (UID: \"2f27b6d9-2632-4f2f-8f45-f80bf2251091\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b8d6cc6f6-2d2wd" Jul 08 23:03:48.459243 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:48.459222 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b7ndq\" (UniqueName: \"kubernetes.io/projected/c2d7d459-a7af-4582-ab47-3091cd450548-kube-api-access-b7ndq\") pod \"klusterlet-addon-workmgr-d8bcd9c69-pp7d2\" (UID: \"c2d7d459-a7af-4582-ab47-3091cd450548\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d8bcd9c69-pp7d2" Jul 08 23:03:48.515681 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:48.515656 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b8d6cc6f6-2d2wd" Jul 08 23:03:48.523591 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:48.523395 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-578bdf959d-kkfx2" Jul 08 23:03:48.532492 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:48.532472 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d8bcd9c69-pp7d2" Jul 08 23:03:48.720692 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:48.720654 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-578bdf959d-kkfx2"] Jul 08 23:03:48.723534 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:03:48.723484 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod930cdf8c_3e63_47c6_a9c1_aa30c2a9bc5b.slice/crio-ceb4d7b78380ae9070e4223e3811cd0087176979e4a6d080a4d2e4ccabdda489 WatchSource:0}: Error finding container ceb4d7b78380ae9070e4223e3811cd0087176979e4a6d080a4d2e4ccabdda489: Status 404 returned error can't find the container with id ceb4d7b78380ae9070e4223e3811cd0087176979e4a6d080a4d2e4ccabdda489 Jul 08 23:03:48.725405 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:48.725385 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b8d6cc6f6-2d2wd"] Jul 08 23:03:48.727001 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:03:48.726976 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2f27b6d9_2632_4f2f_8f45_f80bf2251091.slice/crio-7a0fd382a04803942c55360d8fc9b3bc477ed66068ebc79fbc9bd3fe5280735b WatchSource:0}: Error finding container 7a0fd382a04803942c55360d8fc9b3bc477ed66068ebc79fbc9bd3fe5280735b: Status 404 returned error can't find the container with id 7a0fd382a04803942c55360d8fc9b3bc477ed66068ebc79fbc9bd3fe5280735b Jul 08 23:03:48.745305 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:48.745282 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-d8bcd9c69-pp7d2"] Jul 08 23:03:48.747854 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:03:48.747833 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2d7d459_a7af_4582_ab47_3091cd450548.slice/crio-ef76fc3babf992f9cd0dfdbf6ed215d8132ab5bc6707b28f0e58f54d592dc346 WatchSource:0}: Error finding container ef76fc3babf992f9cd0dfdbf6ed215d8132ab5bc6707b28f0e58f54d592dc346: Status 404 returned error can't find the container with id ef76fc3babf992f9cd0dfdbf6ed215d8132ab5bc6707b28f0e58f54d592dc346 Jul 08 23:03:48.936120 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:48.936086 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-h5zzc" event={"ID":"e4f8810f-3199-4a12-9f3e-696df87448d4","Type":"ContainerStarted","Data":"bbe1e6de4b73b7433ff6389fc807f85b0a6771583123586c30b21250e8f430b6"} Jul 08 23:03:48.937322 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:48.937298 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d8bcd9c69-pp7d2" event={"ID":"c2d7d459-a7af-4582-ab47-3091cd450548","Type":"ContainerStarted","Data":"ef76fc3babf992f9cd0dfdbf6ed215d8132ab5bc6707b28f0e58f54d592dc346"} Jul 08 23:03:48.938519 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:48.938487 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-578bdf959d-kkfx2" event={"ID":"930cdf8c-3e63-47c6-a9c1-aa30c2a9bc5b","Type":"ContainerStarted","Data":"ceb4d7b78380ae9070e4223e3811cd0087176979e4a6d080a4d2e4ccabdda489"} Jul 08 23:03:48.940091 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:48.940029 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-s5dnv" event={"ID":"55cfa647-c40e-4556-b295-ad4fb60fde44","Type":"ContainerStarted","Data":"2de9335fece10eddd9ae6d6dd4533ac737c11038b680ff4f1d404e0340bac140"} Jul 08 23:03:48.941159 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:48.941133 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b8d6cc6f6-2d2wd" event={"ID":"2f27b6d9-2632-4f2f-8f45-f80bf2251091","Type":"ContainerStarted","Data":"7a0fd382a04803942c55360d8fc9b3bc477ed66068ebc79fbc9bd3fe5280735b"} Jul 08 23:03:48.943251 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:48.943227 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8mtw6" event={"ID":"4e57d4ab-946f-4067-b9dd-8305e346e99b","Type":"ContainerStarted","Data":"bc0d70b1f8dde6e464bd217f735167158ec71af77d7eabdfa56578a4fcb8377f"} Jul 08 23:03:48.952362 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:48.952325 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-h5zzc" podStartSLOduration=33.11934484 podStartE2EDuration="35.952312214s" totalImagesPullingTime="2.832967374s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:03:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:03:48.951290342 +0000 UTC m=+78.999564246" watchObservedRunningTime="2026-07-08 23:03:48.952312214 +0000 UTC m=+79.000586116" Jul 08 23:03:48.969227 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:48.969190 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6bffdf9778-s5dnv" podStartSLOduration=33.162760896 podStartE2EDuration="35.969177245s" totalImagesPullingTime="2.806416349s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:03:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:03:48.968207186 +0000 UTC m=+79.016481090" watchObservedRunningTime="2026-07-08 23:03:48.969177245 +0000 UTC m=+79.017451148" Jul 08 23:03:49.041656 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:49.041603 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-8mtw6" podStartSLOduration=17.712114852 podStartE2EDuration="28.04158545s" totalImagesPullingTime="10.329470598s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 23:03:21 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:03:48.997725934 +0000 UTC m=+79.045999849" watchObservedRunningTime="2026-07-08 23:03:49.04158545 +0000 UTC m=+79.089859331" Jul 08 23:03:49.042088 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:49.042075 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-nwn2r"] Jul 08 23:03:49.046606 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:49.046585 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-nwn2r" Jul 08 23:03:49.049009 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:49.048987 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-v9mxv\"" Jul 08 23:03:49.049119 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:49.048987 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 08 23:03:49.050810 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:49.050788 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/ef5fa55d-c531-415a-a836-f0e829d11692-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-nwn2r\" (UID: \"ef5fa55d-c531-415a-a836-f0e829d11692\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-nwn2r" Jul 08 23:03:49.055289 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:49.055262 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-nwn2r"] Jul 08 23:03:49.151355 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:49.151326 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/ef5fa55d-c531-415a-a836-f0e829d11692-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-nwn2r\" (UID: \"ef5fa55d-c531-415a-a836-f0e829d11692\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-nwn2r" Jul 08 23:03:49.151552 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:03:49.151461 2574 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jul 08 23:03:49.151630 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:03:49.151557 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef5fa55d-c531-415a-a836-f0e829d11692-tls-certificates podName:ef5fa55d-c531-415a-a836-f0e829d11692 nodeName:}" failed. No retries permitted until 2026-07-08 23:03:49.651535149 +0000 UTC m=+79.699809032 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/ef5fa55d-c531-415a-a836-f0e829d11692-tls-certificates") pod "prometheus-operator-admission-webhook-d559d66d5-nwn2r" (UID: "ef5fa55d-c531-415a-a836-f0e829d11692") : secret "prometheus-operator-admission-webhook-tls" not found Jul 08 23:03:49.655434 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:49.655257 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/ef5fa55d-c531-415a-a836-f0e829d11692-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-nwn2r\" (UID: \"ef5fa55d-c531-415a-a836-f0e829d11692\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-nwn2r" Jul 08 23:03:49.659969 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:49.659943 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/ef5fa55d-c531-415a-a836-f0e829d11692-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-nwn2r\" (UID: \"ef5fa55d-c531-415a-a836-f0e829d11692\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-nwn2r" Jul 08 23:03:49.956819 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:49.956744 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-nwn2r" Jul 08 23:03:50.171331 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:50.171252 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-nwn2r"] Jul 08 23:03:50.175073 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:03:50.175041 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef5fa55d_c531_415a_a836_f0e829d11692.slice/crio-6b374a7ce5e8373d395c27498e66e7bd38b032efeb7935af82a55a2f985c5408 WatchSource:0}: Error finding container 6b374a7ce5e8373d395c27498e66e7bd38b032efeb7935af82a55a2f985c5408: Status 404 returned error can't find the container with id 6b374a7ce5e8373d395c27498e66e7bd38b032efeb7935af82a55a2f985c5408 Jul 08 23:03:50.957308 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:50.957255 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-nwn2r" event={"ID":"ef5fa55d-c531-415a-a836-f0e829d11692","Type":"ContainerStarted","Data":"6b374a7ce5e8373d395c27498e66e7bd38b032efeb7935af82a55a2f985c5408"} Jul 08 23:03:54.476077 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:54.475957 2574 scope.go:117] "RemoveContainer" containerID="457bd11a755b9e31cb6cdf186c1f3480a74a61d3c10be1986ce3a9faa790240d" Jul 08 23:03:54.476493 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:03:54.476177 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-68b757fb67-b7vhr_openshift-console-operator(820d35fb-fba2-4328-9e2b-0874474cb416)\"" pod="openshift-console-operator/console-operator-68b757fb67-b7vhr" podUID="820d35fb-fba2-4328-9e2b-0874474cb416" Jul 08 23:03:54.924674 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:54.924643 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-pr92b" Jul 08 23:03:55.982571 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:55.982535 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b8d6cc6f6-2d2wd" event={"ID":"2f27b6d9-2632-4f2f-8f45-f80bf2251091","Type":"ContainerStarted","Data":"143e05c67e16f7fd0b3f66205310e6487ef71927fe460e5b305e59260425dae3"} Jul 08 23:03:55.984173 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:55.984147 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d8bcd9c69-pp7d2" event={"ID":"c2d7d459-a7af-4582-ab47-3091cd450548","Type":"ContainerStarted","Data":"313ca5264c90dfaa0190610ff2031d7a8bad06fbb66cd5378b68ad2912992da3"} Jul 08 23:03:55.984306 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:55.984194 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d8bcd9c69-pp7d2" Jul 08 23:03:55.986338 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:55.986317 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d8bcd9c69-pp7d2" Jul 08 23:03:55.986574 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:55.986550 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-578bdf959d-kkfx2" event={"ID":"930cdf8c-3e63-47c6-a9c1-aa30c2a9bc5b","Type":"ContainerStarted","Data":"85e4ae5001ad774f15f39760546b9c047167cab9de6adfe60b4037f5eed802af"} Jul 08 23:03:55.986675 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:55.986589 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-578bdf959d-kkfx2" event={"ID":"930cdf8c-3e63-47c6-a9c1-aa30c2a9bc5b","Type":"ContainerStarted","Data":"419f4a87bf7a682dd383f7b04c9c1d008132eb266cc6db38923480febbc62554"} Jul 08 23:03:55.986675 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:55.986606 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-578bdf959d-kkfx2" event={"ID":"930cdf8c-3e63-47c6-a9c1-aa30c2a9bc5b","Type":"ContainerStarted","Data":"bc22f666d2474ed37e60d9216414c8fd66bf040c78c4c989cb352807ebf84ba9"} Jul 08 23:03:55.987988 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:55.987964 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-nwn2r" event={"ID":"ef5fa55d-c531-415a-a836-f0e829d11692","Type":"ContainerStarted","Data":"d4836ea362172f8550613a9262271fcef8120c469bca8e64ce5dfd4694f2c797"} Jul 08 23:03:55.988187 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:55.988167 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-nwn2r" Jul 08 23:03:55.992520 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:55.992490 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-nwn2r" Jul 08 23:03:55.996452 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:55.996405 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b8d6cc6f6-2d2wd" podStartSLOduration=1.3308282980000001 podStartE2EDuration="7.996389471s" totalImagesPullingTime="6.665561173s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:03:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:03:55.996147625 +0000 UTC m=+86.044421541" watchObservedRunningTime="2026-07-08 23:03:55.996389471 +0000 UTC m=+86.044663373" Jul 08 23:03:56.011012 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:56.010971 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-nwn2r" podStartSLOduration=1.794379688 podStartE2EDuration="7.01095992s" totalImagesPullingTime="5.216580232s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:03:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:03:56.009715782 +0000 UTC m=+86.057989687" watchObservedRunningTime="2026-07-08 23:03:56.01095992 +0000 UTC m=+86.059233823" Jul 08 23:03:56.028441 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:56.028398 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-578bdf959d-kkfx2" podStartSLOduration=1.342903207 podStartE2EDuration="8.028385391s" totalImagesPullingTime="6.685482184s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:03:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:03:56.027630096 +0000 UTC m=+86.075904000" watchObservedRunningTime="2026-07-08 23:03:56.028385391 +0000 UTC m=+86.076659294" Jul 08 23:03:56.043014 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:56.042966 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d8bcd9c69-pp7d2" podStartSLOduration=1.376568783 podStartE2EDuration="8.042949535s" totalImagesPullingTime="6.666380752s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:03:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:03:56.04107863 +0000 UTC m=+86.089352535" watchObservedRunningTime="2026-07-08 23:03:56.042949535 +0000 UTC m=+86.091223443" Jul 08 23:03:58.397503 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:58.397469 2574 patch_prober.go:28] interesting pod/image-registry-59d44dd9bb-4zrm7 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 08 23:03:58.397938 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:03:58.397535 2574 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-59d44dd9bb-4zrm7" podUID="95b3aab3-2dca-4fc5-9de4-eef31714950d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 08 23:04:00.897782 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:04:00.897752 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-59d44dd9bb-4zrm7" Jul 08 23:04:03.495869 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:04:03.495832 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-pxcdw"] Jul 08 23:04:03.498918 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:04:03.498901 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-pxcdw" Jul 08 23:04:03.501417 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:04:03.501395 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 08 23:04:03.501784 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:04:03.501762 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 08 23:04:03.501898 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:04:03.501880 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 08 23:04:03.503008 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:04:03.502988 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-sc5qc\"" Jul 08 23:04:03.503239 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:04:03.503222 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 08 23:04:03.572561 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:04:03.572531 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/aff11bc5-0c86-427d-b5de-f2bad619281d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pxcdw\" (UID: \"aff11bc5-0c86-427d-b5de-f2bad619281d\") " pod="openshift-monitoring/node-exporter-pxcdw" Jul 08 23:04:03.572684 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:04:03.572564 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/aff11bc5-0c86-427d-b5de-f2bad619281d-node-exporter-textfile\") pod \"node-exporter-pxcdw\" (UID: \"aff11bc5-0c86-427d-b5de-f2bad619281d\") " pod="openshift-monitoring/node-exporter-pxcdw" Jul 08 23:04:03.572684 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:04:03.572585 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/aff11bc5-0c86-427d-b5de-f2bad619281d-root\") pod \"node-exporter-pxcdw\" (UID: \"aff11bc5-0c86-427d-b5de-f2bad619281d\") " pod="openshift-monitoring/node-exporter-pxcdw" Jul 08 23:04:03.572684 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:04:03.572608 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9wjsj\" (UniqueName: \"kubernetes.io/projected/aff11bc5-0c86-427d-b5de-f2bad619281d-kube-api-access-9wjsj\") pod \"node-exporter-pxcdw\" (UID: \"aff11bc5-0c86-427d-b5de-f2bad619281d\") " pod="openshift-monitoring/node-exporter-pxcdw" Jul 08 23:04:03.572684 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:04:03.572656 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/aff11bc5-0c86-427d-b5de-f2bad619281d-node-exporter-wtmp\") pod \"node-exporter-pxcdw\" (UID: \"aff11bc5-0c86-427d-b5de-f2bad619281d\") " pod="openshift-monitoring/node-exporter-pxcdw" Jul 08 23:04:03.572914 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:04:03.572709 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/aff11bc5-0c86-427d-b5de-f2bad619281d-node-exporter-accelerators-collector-config\") pod \"node-exporter-pxcdw\" (UID: \"aff11bc5-0c86-427d-b5de-f2bad619281d\") " pod="openshift-monitoring/node-exporter-pxcdw" Jul 08 23:04:03.572914 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:04:03.572744 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/aff11bc5-0c86-427d-b5de-f2bad619281d-node-exporter-tls\") pod \"node-exporter-pxcdw\" (UID: \"aff11bc5-0c86-427d-b5de-f2bad619281d\") " pod="openshift-monitoring/node-exporter-pxcdw" Jul 08 23:04:03.572914 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:04:03.572824 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aff11bc5-0c86-427d-b5de-f2bad619281d-metrics-client-ca\") pod \"node-exporter-pxcdw\" (UID: \"aff11bc5-0c86-427d-b5de-f2bad619281d\") " pod="openshift-monitoring/node-exporter-pxcdw" Jul 08 23:04:03.572914 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:04:03.572895 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/aff11bc5-0c86-427d-b5de-f2bad619281d-sys\") pod \"node-exporter-pxcdw\" (UID: \"aff11bc5-0c86-427d-b5de-f2bad619281d\") " pod="openshift-monitoring/node-exporter-pxcdw" Jul 08 23:04:03.673426 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:04:03.673397 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aff11bc5-0c86-427d-b5de-f2bad619281d-metrics-client-ca\") pod \"node-exporter-pxcdw\" (UID: \"aff11bc5-0c86-427d-b5de-f2bad619281d\") " pod="openshift-monitoring/node-exporter-pxcdw" Jul 08 23:04:03.673567 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:04:03.673434 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/aff11bc5-0c86-427d-b5de-f2bad619281d-sys\") pod \"node-exporter-pxcdw\" (UID: \"aff11bc5-0c86-427d-b5de-f2bad619281d\") " pod="openshift-monitoring/node-exporter-pxcdw" Jul 08 23:04:03.673567 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:04:03.673456 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/aff11bc5-0c86-427d-b5de-f2bad619281d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pxcdw\" (UID: \"aff11bc5-0c86-427d-b5de-f2bad619281d\") " pod="openshift-monitoring/node-exporter-pxcdw" Jul 08 23:04:03.673567 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:04:03.673500 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/aff11bc5-0c86-427d-b5de-f2bad619281d-sys\") pod \"node-exporter-pxcdw\" (UID: \"aff11bc5-0c86-427d-b5de-f2bad619281d\") " pod="openshift-monitoring/node-exporter-pxcdw" Jul 08 23:04:03.673567 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:04:03.673549 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/aff11bc5-0c86-427d-b5de-f2bad619281d-node-exporter-textfile\") pod \"node-exporter-pxcdw\" (UID: \"aff11bc5-0c86-427d-b5de-f2bad619281d\") " pod="openshift-monitoring/node-exporter-pxcdw" Jul 08 23:04:03.673755 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:04:03.673580 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/aff11bc5-0c86-427d-b5de-f2bad619281d-root\") pod \"node-exporter-pxcdw\" (UID: \"aff11bc5-0c86-427d-b5de-f2bad619281d\") " pod="openshift-monitoring/node-exporter-pxcdw" Jul 08 23:04:03.673755 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:04:03.673617 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9wjsj\" (UniqueName: \"kubernetes.io/projected/aff11bc5-0c86-427d-b5de-f2bad619281d-kube-api-access-9wjsj\") pod \"node-exporter-pxcdw\" (UID: \"aff11bc5-0c86-427d-b5de-f2bad619281d\") " pod="openshift-monitoring/node-exporter-pxcdw" Jul 08 23:04:03.673755 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:04:03.673640 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/aff11bc5-0c86-427d-b5de-f2bad619281d-node-exporter-wtmp\") pod \"node-exporter-pxcdw\" (UID: \"aff11bc5-0c86-427d-b5de-f2bad619281d\") " pod="openshift-monitoring/node-exporter-pxcdw" Jul 08 23:04:03.673755 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:04:03.673676 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/aff11bc5-0c86-427d-b5de-f2bad619281d-node-exporter-accelerators-collector-config\") pod \"node-exporter-pxcdw\" (UID: \"aff11bc5-0c86-427d-b5de-f2bad619281d\") " pod="openshift-monitoring/node-exporter-pxcdw" Jul 08 23:04:03.673942 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:04:03.673746 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/aff11bc5-0c86-427d-b5de-f2bad619281d-node-exporter-tls\") pod \"node-exporter-pxcdw\" (UID: \"aff11bc5-0c86-427d-b5de-f2bad619281d\") " pod="openshift-monitoring/node-exporter-pxcdw" Jul 08 23:04:03.673942 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:04:03.673890 2574 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 08 23:04:03.673942 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:04:03.673934 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/aff11bc5-0c86-427d-b5de-f2bad619281d-root\") pod \"node-exporter-pxcdw\" (UID: \"aff11bc5-0c86-427d-b5de-f2bad619281d\") " pod="openshift-monitoring/node-exporter-pxcdw" Jul 08 23:04:03.674078 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:04:03.673950 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aff11bc5-0c86-427d-b5de-f2bad619281d-node-exporter-tls podName:aff11bc5-0c86-427d-b5de-f2bad619281d nodeName:}" failed. No retries permitted until 2026-07-08 23:04:04.173929773 +0000 UTC m=+94.222203670 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/aff11bc5-0c86-427d-b5de-f2bad619281d-node-exporter-tls") pod "node-exporter-pxcdw" (UID: "aff11bc5-0c86-427d-b5de-f2bad619281d") : secret "node-exporter-tls" not found Jul 08 23:04:03.674078 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:04:03.673891 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/aff11bc5-0c86-427d-b5de-f2bad619281d-node-exporter-textfile\") pod \"node-exporter-pxcdw\" (UID: \"aff11bc5-0c86-427d-b5de-f2bad619281d\") " pod="openshift-monitoring/node-exporter-pxcdw" Jul 08 23:04:03.674078 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:04:03.674072 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/aff11bc5-0c86-427d-b5de-f2bad619281d-node-exporter-wtmp\") pod \"node-exporter-pxcdw\" (UID: \"aff11bc5-0c86-427d-b5de-f2bad619281d\") " pod="openshift-monitoring/node-exporter-pxcdw" Jul 08 23:04:03.674252 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:04:03.674085 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aff11bc5-0c86-427d-b5de-f2bad619281d-metrics-client-ca\") pod \"node-exporter-pxcdw\" (UID: \"aff11bc5-0c86-427d-b5de-f2bad619281d\") " pod="openshift-monitoring/node-exporter-pxcdw" Jul 08 23:04:03.674252 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:04:03.674185 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/aff11bc5-0c86-427d-b5de-f2bad619281d-node-exporter-accelerators-collector-config\") pod \"node-exporter-pxcdw\" (UID: \"aff11bc5-0c86-427d-b5de-f2bad619281d\") " pod="openshift-monitoring/node-exporter-pxcdw" Jul 08 23:04:03.676322 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:04:03.676299 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/aff11bc5-0c86-427d-b5de-f2bad619281d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pxcdw\" (UID: \"aff11bc5-0c86-427d-b5de-f2bad619281d\") " pod="openshift-monitoring/node-exporter-pxcdw" Jul 08 23:04:03.686563 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:04:03.686545 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9wjsj\" (UniqueName: \"kubernetes.io/projected/aff11bc5-0c86-427d-b5de-f2bad619281d-kube-api-access-9wjsj\") pod \"node-exporter-pxcdw\" (UID: \"aff11bc5-0c86-427d-b5de-f2bad619281d\") " pod="openshift-monitoring/node-exporter-pxcdw" Jul 08 23:04:04.179202 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:04:04.179163 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/aff11bc5-0c86-427d-b5de-f2bad619281d-node-exporter-tls\") pod \"node-exporter-pxcdw\" (UID: \"aff11bc5-0c86-427d-b5de-f2bad619281d\") " pod="openshift-monitoring/node-exporter-pxcdw" Jul 08 23:04:04.181549 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:04:04.181524 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/aff11bc5-0c86-427d-b5de-f2bad619281d-node-exporter-tls\") pod \"node-exporter-pxcdw\" (UID: \"aff11bc5-0c86-427d-b5de-f2bad619281d\") " pod="openshift-monitoring/node-exporter-pxcdw" Jul 08 23:04:04.410148 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:04:04.410109 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-pxcdw" Jul 08 23:04:04.423285 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:04:04.423255 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaff11bc5_0c86_427d_b5de_f2bad619281d.slice/crio-b4f2f545814853868e98263806c41d5c241cf78c3cd3a3c7ee36e955adf6f6fe WatchSource:0}: Error finding container b4f2f545814853868e98263806c41d5c241cf78c3cd3a3c7ee36e955adf6f6fe: Status 404 returned error can't find the container with id b4f2f545814853868e98263806c41d5c241cf78c3cd3a3c7ee36e955adf6f6fe Jul 08 23:04:05.026162 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:04:05.026122 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pxcdw" event={"ID":"aff11bc5-0c86-427d-b5de-f2bad619281d","Type":"ContainerStarted","Data":"b4f2f545814853868e98263806c41d5c241cf78c3cd3a3c7ee36e955adf6f6fe"} Jul 08 23:04:06.031137 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:04:06.031049 2574 generic.go:356] "Generic (PLEG): container finished" podID="aff11bc5-0c86-427d-b5de-f2bad619281d" containerID="9b1a0f7e110319909319cae0b6fba0ba7796fe25ac246fad6c7772968cc7af40" exitCode=0 Jul 08 23:04:06.031484 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:04:06.031140 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pxcdw" event={"ID":"aff11bc5-0c86-427d-b5de-f2bad619281d","Type":"ContainerDied","Data":"9b1a0f7e110319909319cae0b6fba0ba7796fe25ac246fad6c7772968cc7af40"} Jul 08 23:04:07.036411 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:04:07.036373 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pxcdw" event={"ID":"aff11bc5-0c86-427d-b5de-f2bad619281d","Type":"ContainerStarted","Data":"edb74f877147af0438a43551f9c27066a744e21715ec274972b95d890e7ce49c"} Jul 08 23:04:07.036795 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:04:07.036430 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pxcdw" event={"ID":"aff11bc5-0c86-427d-b5de-f2bad619281d","Type":"ContainerStarted","Data":"3aecae066413865d85b86793dde8b44016f4fbb4e0cff894e673a0dc3faf10cc"} Jul 08 23:04:07.056553 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:04:07.056484 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-pxcdw" podStartSLOduration=2.851476631 podStartE2EDuration="4.056469887s" totalImagesPullingTime="1.141657167s" totalInitContainerRuntime="63.336089ms" isStatefulPod=true podCreationTimestamp="2026-07-08 23:04:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:04:07.054534668 +0000 UTC m=+97.102808569" watchObservedRunningTime="2026-07-08 23:04:07.056469887 +0000 UTC m=+97.104743838" Jul 08 23:04:07.865828 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:04:07.865800 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-264tg" Jul 08 23:04:09.476368 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:04:09.476339 2574 scope.go:117] "RemoveContainer" containerID="457bd11a755b9e31cb6cdf186c1f3480a74a61d3c10be1986ce3a9faa790240d" Jul 08 23:04:10.050761 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:04:10.050729 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-b7vhr_820d35fb-fba2-4328-9e2b-0874474cb416/console-operator/2.log" Jul 08 23:04:10.050881 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:04:10.050847 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-b7vhr" event={"ID":"820d35fb-fba2-4328-9e2b-0874474cb416","Type":"ContainerStarted","Data":"3a7d1420fbe983aff96ccaaf40aa31d186bc508aebde0d78dc822c7fea651b6c"} Jul 08 23:04:10.051173 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:04:10.051152 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-b7vhr" Jul 08 23:04:10.069991 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:04:10.069947 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-68b757fb67-b7vhr" podStartSLOduration=50.764542831 podStartE2EDuration="57.069933905s" totalImagesPullingTime="6.305391074s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:03:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:04:10.067816303 +0000 UTC m=+100.116090228" watchObservedRunningTime="2026-07-08 23:04:10.069933905 +0000 UTC m=+100.118207849" Jul 08 23:04:10.155073 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:04:10.155042 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-68b757fb67-b7vhr" Jul 08 23:04:11.222596 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:04:11.222559 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-59d44dd9bb-4zrm7"] Jul 08 23:04:26.114138 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:04:26.114105 2574 generic.go:356] "Generic (PLEG): container finished" podID="4ed7b90f-7d34-4d31-b1fb-276d9906fc64" containerID="6876fcda2aa0df063c13f6af35cb7bcb63c4af29db25c7b1459815b2f64f4a17" exitCode=0 Jul 08 23:04:26.114536 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:04:26.114175 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-wl687" event={"ID":"4ed7b90f-7d34-4d31-b1fb-276d9906fc64","Type":"ContainerDied","Data":"6876fcda2aa0df063c13f6af35cb7bcb63c4af29db25c7b1459815b2f64f4a17"} Jul 08 23:04:26.114536 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:04:26.114533 2574 scope.go:117] "RemoveContainer" containerID="6876fcda2aa0df063c13f6af35cb7bcb63c4af29db25c7b1459815b2f64f4a17" Jul 08 23:04:27.119304 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:04:27.119220 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-wl687" event={"ID":"4ed7b90f-7d34-4d31-b1fb-276d9906fc64","Type":"ContainerStarted","Data":"568e4662ec0d3135bd3e009e96df3f7ded1ccefc992bbf20275f73fe1de5b41b"} Jul 08 23:04:27.120719 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:04:27.120692 2574 generic.go:356] "Generic (PLEG): container finished" podID="33e501aa-07a6-45eb-a543-897fb2b59fa8" containerID="cc56bca684b6e848f1d286c4c372a51e30741b0cc5cc1876228784d850c9df43" exitCode=0 Jul 08 23:04:27.120832 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:04:27.120755 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-hfb2g" event={"ID":"33e501aa-07a6-45eb-a543-897fb2b59fa8","Type":"ContainerDied","Data":"cc56bca684b6e848f1d286c4c372a51e30741b0cc5cc1876228784d850c9df43"} Jul 08 23:04:27.121012 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:04:27.121000 2574 scope.go:117] "RemoveContainer" containerID="cc56bca684b6e848f1d286c4c372a51e30741b0cc5cc1876228784d850c9df43" Jul 08 23:04:28.126367 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:04:28.126332 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-hfb2g" event={"ID":"33e501aa-07a6-45eb-a543-897fb2b59fa8","Type":"ContainerStarted","Data":"d57932976fc6df45d3c896d907c31484f0e9f872c97f4a1c30e4276c056f5b93"} Jul 08 23:04:29.369824 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:04:29.369793 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-h5zzc_e4f8810f-3199-4a12-9f3e-696df87448d4/cluster-monitoring-operator/0.log" Jul 08 23:04:31.140087 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:04:31.140047 2574 generic.go:356] "Generic (PLEG): container finished" podID="0763848e-1c09-4df3-a4b8-37e8a00c3ba2" containerID="1f7640210c660a60d803a3b098d811a5d6239f1fcbc9e9aa99ffdbc0c74dc437" exitCode=0 Jul 08 23:04:31.140603 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:04:31.140124 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-7nc87" event={"ID":"0763848e-1c09-4df3-a4b8-37e8a00c3ba2","Type":"ContainerDied","Data":"1f7640210c660a60d803a3b098d811a5d6239f1fcbc9e9aa99ffdbc0c74dc437"} Jul 08 23:04:31.140603 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:04:31.140441 2574 scope.go:117] "RemoveContainer" containerID="1f7640210c660a60d803a3b098d811a5d6239f1fcbc9e9aa99ffdbc0c74dc437" Jul 08 23:04:31.167292 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:04:31.167271 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pxcdw_aff11bc5-0c86-427d-b5de-f2bad619281d/init-textfile/0.log" Jul 08 23:04:31.369270 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:04:31.369197 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pxcdw_aff11bc5-0c86-427d-b5de-f2bad619281d/node-exporter/0.log" Jul 08 23:04:31.567357 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:04:31.567328 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pxcdw_aff11bc5-0c86-427d-b5de-f2bad619281d/kube-rbac-proxy/0.log" Jul 08 23:04:32.146722 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:04:32.146692 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-7nc87" event={"ID":"0763848e-1c09-4df3-a4b8-37e8a00c3ba2","Type":"ContainerStarted","Data":"eeb8abeae2a9436ba257855a23b7d15d54ddcf7bb22eabd11475fa84424b4ac6"} Jul 08 23:04:34.766642 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:04:34.766606 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-d559d66d5-nwn2r_ef5fa55d-c531-415a-a836-f0e829d11692/prometheus-operator-admission-webhook/0.log" Jul 08 23:04:36.166962 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:04:36.166926 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6bffdf9778-s5dnv_55cfa647-c40e-4556-b295-ad4fb60fde44/networking-console-plugin/0.log" Jul 08 23:04:36.243672 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:04:36.243611 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-59d44dd9bb-4zrm7" podUID="95b3aab3-2dca-4fc5-9de4-eef31714950d" containerName="registry" containerID="cri-o://2b44ebce608049c0f2db0b06778db63be4af6312883e13b34d989b1ed390adee" gracePeriod=30 Jul 08 23:04:36.367182 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:04:36.367117 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-b7vhr_820d35fb-fba2-4328-9e2b-0874474cb416/console-operator/2.log" Jul 08 23:04:36.484409 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:04:36.484386 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59d44dd9bb-4zrm7" Jul 08 23:04:36.569931 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:04:36.569893 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-b7vhr_820d35fb-fba2-4328-9e2b-0874474cb416/console-operator/3.log" Jul 08 23:04:36.652683 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:04:36.652650 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/95b3aab3-2dca-4fc5-9de4-eef31714950d-registry-tls\") pod \"95b3aab3-2dca-4fc5-9de4-eef31714950d\" (UID: \"95b3aab3-2dca-4fc5-9de4-eef31714950d\") " Jul 08 23:04:36.652837 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:04:36.652691 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/95b3aab3-2dca-4fc5-9de4-eef31714950d-bound-sa-token\") pod \"95b3aab3-2dca-4fc5-9de4-eef31714950d\" (UID: \"95b3aab3-2dca-4fc5-9de4-eef31714950d\") " Jul 08 23:04:36.652837 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:04:36.652713 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/95b3aab3-2dca-4fc5-9de4-eef31714950d-registry-certificates\") pod \"95b3aab3-2dca-4fc5-9de4-eef31714950d\" (UID: \"95b3aab3-2dca-4fc5-9de4-eef31714950d\") " Jul 08 23:04:36.652837 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:04:36.652747 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/95b3aab3-2dca-4fc5-9de4-eef31714950d-trusted-ca\") pod \"95b3aab3-2dca-4fc5-9de4-eef31714950d\" (UID: \"95b3aab3-2dca-4fc5-9de4-eef31714950d\") " Jul 08 23:04:36.652837 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:04:36.652776 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/95b3aab3-2dca-4fc5-9de4-eef31714950d-image-registry-private-configuration\") pod \"95b3aab3-2dca-4fc5-9de4-eef31714950d\" (UID: \"95b3aab3-2dca-4fc5-9de4-eef31714950d\") " Jul 08 23:04:36.652837 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:04:36.652802 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/95b3aab3-2dca-4fc5-9de4-eef31714950d-installation-pull-secrets\") pod \"95b3aab3-2dca-4fc5-9de4-eef31714950d\" (UID: \"95b3aab3-2dca-4fc5-9de4-eef31714950d\") " Jul 08 23:04:36.653099 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:04:36.652839 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/95b3aab3-2dca-4fc5-9de4-eef31714950d-ca-trust-extracted\") pod \"95b3aab3-2dca-4fc5-9de4-eef31714950d\" (UID: \"95b3aab3-2dca-4fc5-9de4-eef31714950d\") " Jul 08 23:04:36.653099 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:04:36.652876 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8r6nx\" (UniqueName: \"kubernetes.io/projected/95b3aab3-2dca-4fc5-9de4-eef31714950d-kube-api-access-8r6nx\") pod \"95b3aab3-2dca-4fc5-9de4-eef31714950d\" (UID: \"95b3aab3-2dca-4fc5-9de4-eef31714950d\") " Jul 08 23:04:36.653251 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:04:36.653220 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/95b3aab3-2dca-4fc5-9de4-eef31714950d-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "95b3aab3-2dca-4fc5-9de4-eef31714950d" (UID: "95b3aab3-2dca-4fc5-9de4-eef31714950d"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 23:04:36.653332 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:04:36.653291 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/95b3aab3-2dca-4fc5-9de4-eef31714950d-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "95b3aab3-2dca-4fc5-9de4-eef31714950d" (UID: "95b3aab3-2dca-4fc5-9de4-eef31714950d"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 23:04:36.655500 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:04:36.655441 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/95b3aab3-2dca-4fc5-9de4-eef31714950d-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "95b3aab3-2dca-4fc5-9de4-eef31714950d" (UID: "95b3aab3-2dca-4fc5-9de4-eef31714950d"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 23:04:36.655648 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:04:36.655550 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95b3aab3-2dca-4fc5-9de4-eef31714950d-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "95b3aab3-2dca-4fc5-9de4-eef31714950d" (UID: "95b3aab3-2dca-4fc5-9de4-eef31714950d"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 23:04:36.655719 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:04:36.655697 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95b3aab3-2dca-4fc5-9de4-eef31714950d-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "95b3aab3-2dca-4fc5-9de4-eef31714950d" (UID: "95b3aab3-2dca-4fc5-9de4-eef31714950d"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 23:04:36.655772 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:04:36.655718 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/95b3aab3-2dca-4fc5-9de4-eef31714950d-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "95b3aab3-2dca-4fc5-9de4-eef31714950d" (UID: "95b3aab3-2dca-4fc5-9de4-eef31714950d"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 23:04:36.655896 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:04:36.655878 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95b3aab3-2dca-4fc5-9de4-eef31714950d-kube-api-access-8r6nx" (OuterVolumeSpecName: "kube-api-access-8r6nx") pod "95b3aab3-2dca-4fc5-9de4-eef31714950d" (UID: "95b3aab3-2dca-4fc5-9de4-eef31714950d"). InnerVolumeSpecName "kube-api-access-8r6nx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 23:04:36.662553 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:04:36.662503 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95b3aab3-2dca-4fc5-9de4-eef31714950d-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "95b3aab3-2dca-4fc5-9de4-eef31714950d" (UID: "95b3aab3-2dca-4fc5-9de4-eef31714950d"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 23:04:36.753660 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:04:36.753584 2574 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/95b3aab3-2dca-4fc5-9de4-eef31714950d-installation-pull-secrets\") on node \"ip-10-0-140-79.ec2.internal\" DevicePath \"\"" Jul 08 23:04:36.753660 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:04:36.753611 2574 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/95b3aab3-2dca-4fc5-9de4-eef31714950d-ca-trust-extracted\") on node \"ip-10-0-140-79.ec2.internal\" DevicePath \"\"" Jul 08 23:04:36.753660 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:04:36.753620 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8r6nx\" (UniqueName: \"kubernetes.io/projected/95b3aab3-2dca-4fc5-9de4-eef31714950d-kube-api-access-8r6nx\") on node \"ip-10-0-140-79.ec2.internal\" DevicePath \"\"" Jul 08 23:04:36.753660 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:04:36.753631 2574 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/95b3aab3-2dca-4fc5-9de4-eef31714950d-registry-tls\") on node \"ip-10-0-140-79.ec2.internal\" DevicePath \"\"" Jul 08 23:04:36.753660 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:04:36.753640 2574 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/95b3aab3-2dca-4fc5-9de4-eef31714950d-bound-sa-token\") on node \"ip-10-0-140-79.ec2.internal\" DevicePath \"\"" Jul 08 23:04:36.753660 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:04:36.753649 2574 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/95b3aab3-2dca-4fc5-9de4-eef31714950d-registry-certificates\") on node \"ip-10-0-140-79.ec2.internal\" DevicePath \"\"" Jul 08 23:04:36.753660 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:04:36.753657 2574 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/95b3aab3-2dca-4fc5-9de4-eef31714950d-trusted-ca\") on node \"ip-10-0-140-79.ec2.internal\" DevicePath \"\"" Jul 08 23:04:36.753660 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:04:36.753666 2574 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/95b3aab3-2dca-4fc5-9de4-eef31714950d-image-registry-private-configuration\") on node \"ip-10-0-140-79.ec2.internal\" DevicePath \"\"" Jul 08 23:04:37.166456 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:04:37.166419 2574 generic.go:356] "Generic (PLEG): container finished" podID="95b3aab3-2dca-4fc5-9de4-eef31714950d" containerID="2b44ebce608049c0f2db0b06778db63be4af6312883e13b34d989b1ed390adee" exitCode=0 Jul 08 23:04:37.166456 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:04:37.166459 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-59d44dd9bb-4zrm7" event={"ID":"95b3aab3-2dca-4fc5-9de4-eef31714950d","Type":"ContainerDied","Data":"2b44ebce608049c0f2db0b06778db63be4af6312883e13b34d989b1ed390adee"} Jul 08 23:04:37.166702 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:04:37.166469 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59d44dd9bb-4zrm7" Jul 08 23:04:37.166702 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:04:37.166531 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-59d44dd9bb-4zrm7" event={"ID":"95b3aab3-2dca-4fc5-9de4-eef31714950d","Type":"ContainerDied","Data":"273f70f9d4f5e07ebf1e0be78f643ffe11d987fbc9ba748129bf304051af6ef2"} Jul 08 23:04:37.166702 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:04:37.166575 2574 scope.go:117] "RemoveContainer" containerID="2b44ebce608049c0f2db0b06778db63be4af6312883e13b34d989b1ed390adee" Jul 08 23:04:37.175474 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:04:37.175458 2574 scope.go:117] "RemoveContainer" containerID="2b44ebce608049c0f2db0b06778db63be4af6312883e13b34d989b1ed390adee" Jul 08 23:04:37.175748 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:04:37.175714 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2b44ebce608049c0f2db0b06778db63be4af6312883e13b34d989b1ed390adee\": container with ID starting with 2b44ebce608049c0f2db0b06778db63be4af6312883e13b34d989b1ed390adee not found: ID does not exist" containerID="2b44ebce608049c0f2db0b06778db63be4af6312883e13b34d989b1ed390adee" Jul 08 23:04:37.175798 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:04:37.175736 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b44ebce608049c0f2db0b06778db63be4af6312883e13b34d989b1ed390adee"} err="failed to get container status \"2b44ebce608049c0f2db0b06778db63be4af6312883e13b34d989b1ed390adee\": rpc error: code = NotFound desc = could not find container \"2b44ebce608049c0f2db0b06778db63be4af6312883e13b34d989b1ed390adee\": container with ID starting with 2b44ebce608049c0f2db0b06778db63be4af6312883e13b34d989b1ed390adee not found: ID does not exist" Jul 08 23:04:37.186940 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:04:37.186918 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-59d44dd9bb-4zrm7"] Jul 08 23:04:37.192698 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:04:37.192678 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-59d44dd9bb-4zrm7"] Jul 08 23:04:37.367085 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:04:37.367058 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7c85f98b97-bnhrb_2edaad22-d491-4a9c-ae1f-eb9f87b42986/router/0.log" Jul 08 23:04:37.966645 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:04:37.966615 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-zknln_d8ceaaa0-c406-4ac5-9ff4-027bcdb1b508/serve-healthcheck-canary/0.log" Jul 08 23:04:38.480967 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:04:38.480934 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="95b3aab3-2dca-4fc5-9de4-eef31714950d" path="/var/lib/kubelet/pods/95b3aab3-2dca-4fc5-9de4-eef31714950d/volumes" Jul 08 23:07:30.368334 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:07:30.368306 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-b7vhr_820d35fb-fba2-4328-9e2b-0874474cb416/console-operator/2.log" Jul 08 23:07:30.370692 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:07:30.370668 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-b7vhr_820d35fb-fba2-4328-9e2b-0874474cb416/console-operator/2.log" Jul 08 23:07:30.372731 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:07:30.372711 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8mcjt_82783d98-33c2-4050-b38f-5ba0a9701953/ovn-acl-logging/0.log" Jul 08 23:07:30.375448 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:07:30.375429 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8mcjt_82783d98-33c2-4050-b38f-5ba0a9701953/ovn-acl-logging/0.log" Jul 08 23:07:30.380989 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:07:30.380969 2574 kubelet.go:1648] "Image garbage collection succeeded" Jul 08 23:08:45.524904 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:08:45.524868 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-ccc7894f9-q6lkd"] Jul 08 23:08:45.525396 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:08:45.525153 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95b3aab3-2dca-4fc5-9de4-eef31714950d" containerName="registry" Jul 08 23:08:45.525396 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:08:45.525164 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="95b3aab3-2dca-4fc5-9de4-eef31714950d" containerName="registry" Jul 08 23:08:45.525396 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:08:45.525234 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="95b3aab3-2dca-4fc5-9de4-eef31714950d" containerName="registry" Jul 08 23:08:45.527255 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:08:45.527239 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-ccc7894f9-q6lkd" Jul 08 23:08:45.530796 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:08:45.530773 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 08 23:08:45.530914 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:08:45.530798 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-9g6bh\"" Jul 08 23:08:45.530914 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:08:45.530806 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 08 23:08:45.531005 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:08:45.530933 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 08 23:08:45.531075 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:08:45.531061 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 08 23:08:45.552317 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:08:45.552298 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-ccc7894f9-q6lkd"] Jul 08 23:08:45.653247 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:08:45.653218 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x72s7\" (UniqueName: \"kubernetes.io/projected/8c4463f3-70e5-4588-b8ae-79e9f6ea80e3-kube-api-access-x72s7\") pod \"opendatahub-operator-controller-manager-ccc7894f9-q6lkd\" (UID: \"8c4463f3-70e5-4588-b8ae-79e9f6ea80e3\") " pod="opendatahub/opendatahub-operator-controller-manager-ccc7894f9-q6lkd" Jul 08 23:08:45.653397 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:08:45.653259 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8c4463f3-70e5-4588-b8ae-79e9f6ea80e3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-ccc7894f9-q6lkd\" (UID: \"8c4463f3-70e5-4588-b8ae-79e9f6ea80e3\") " pod="opendatahub/opendatahub-operator-controller-manager-ccc7894f9-q6lkd" Jul 08 23:08:45.653397 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:08:45.653317 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8c4463f3-70e5-4588-b8ae-79e9f6ea80e3-tmp\") pod \"opendatahub-operator-controller-manager-ccc7894f9-q6lkd\" (UID: \"8c4463f3-70e5-4588-b8ae-79e9f6ea80e3\") " pod="opendatahub/opendatahub-operator-controller-manager-ccc7894f9-q6lkd" Jul 08 23:08:45.653397 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:08:45.653339 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8c4463f3-70e5-4588-b8ae-79e9f6ea80e3-webhook-cert\") pod \"opendatahub-operator-controller-manager-ccc7894f9-q6lkd\" (UID: \"8c4463f3-70e5-4588-b8ae-79e9f6ea80e3\") " pod="opendatahub/opendatahub-operator-controller-manager-ccc7894f9-q6lkd" Jul 08 23:08:45.653397 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:08:45.653368 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8c4463f3-70e5-4588-b8ae-79e9f6ea80e3-manifests\") pod \"opendatahub-operator-controller-manager-ccc7894f9-q6lkd\" (UID: \"8c4463f3-70e5-4588-b8ae-79e9f6ea80e3\") " pod="opendatahub/opendatahub-operator-controller-manager-ccc7894f9-q6lkd" Jul 08 23:08:45.754675 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:08:45.754639 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8c4463f3-70e5-4588-b8ae-79e9f6ea80e3-manifests\") pod \"opendatahub-operator-controller-manager-ccc7894f9-q6lkd\" (UID: \"8c4463f3-70e5-4588-b8ae-79e9f6ea80e3\") " pod="opendatahub/opendatahub-operator-controller-manager-ccc7894f9-q6lkd" Jul 08 23:08:45.754818 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:08:45.754687 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x72s7\" (UniqueName: \"kubernetes.io/projected/8c4463f3-70e5-4588-b8ae-79e9f6ea80e3-kube-api-access-x72s7\") pod \"opendatahub-operator-controller-manager-ccc7894f9-q6lkd\" (UID: \"8c4463f3-70e5-4588-b8ae-79e9f6ea80e3\") " pod="opendatahub/opendatahub-operator-controller-manager-ccc7894f9-q6lkd" Jul 08 23:08:45.754818 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:08:45.754721 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8c4463f3-70e5-4588-b8ae-79e9f6ea80e3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-ccc7894f9-q6lkd\" (UID: \"8c4463f3-70e5-4588-b8ae-79e9f6ea80e3\") " pod="opendatahub/opendatahub-operator-controller-manager-ccc7894f9-q6lkd" Jul 08 23:08:45.754818 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:08:45.754752 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8c4463f3-70e5-4588-b8ae-79e9f6ea80e3-tmp\") pod \"opendatahub-operator-controller-manager-ccc7894f9-q6lkd\" (UID: \"8c4463f3-70e5-4588-b8ae-79e9f6ea80e3\") " pod="opendatahub/opendatahub-operator-controller-manager-ccc7894f9-q6lkd" Jul 08 23:08:45.754818 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:08:45.754768 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8c4463f3-70e5-4588-b8ae-79e9f6ea80e3-webhook-cert\") pod \"opendatahub-operator-controller-manager-ccc7894f9-q6lkd\" (UID: \"8c4463f3-70e5-4588-b8ae-79e9f6ea80e3\") " pod="opendatahub/opendatahub-operator-controller-manager-ccc7894f9-q6lkd" Jul 08 23:08:45.755098 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:08:45.755066 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8c4463f3-70e5-4588-b8ae-79e9f6ea80e3-manifests\") pod \"opendatahub-operator-controller-manager-ccc7894f9-q6lkd\" (UID: \"8c4463f3-70e5-4588-b8ae-79e9f6ea80e3\") " pod="opendatahub/opendatahub-operator-controller-manager-ccc7894f9-q6lkd" Jul 08 23:08:45.757132 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:08:45.757110 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8c4463f3-70e5-4588-b8ae-79e9f6ea80e3-tmp\") pod \"opendatahub-operator-controller-manager-ccc7894f9-q6lkd\" (UID: \"8c4463f3-70e5-4588-b8ae-79e9f6ea80e3\") " pod="opendatahub/opendatahub-operator-controller-manager-ccc7894f9-q6lkd" Jul 08 23:08:45.757348 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:08:45.757328 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8c4463f3-70e5-4588-b8ae-79e9f6ea80e3-webhook-cert\") pod \"opendatahub-operator-controller-manager-ccc7894f9-q6lkd\" (UID: \"8c4463f3-70e5-4588-b8ae-79e9f6ea80e3\") " pod="opendatahub/opendatahub-operator-controller-manager-ccc7894f9-q6lkd" Jul 08 23:08:45.757394 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:08:45.757328 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8c4463f3-70e5-4588-b8ae-79e9f6ea80e3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-ccc7894f9-q6lkd\" (UID: \"8c4463f3-70e5-4588-b8ae-79e9f6ea80e3\") " pod="opendatahub/opendatahub-operator-controller-manager-ccc7894f9-q6lkd" Jul 08 23:08:45.765197 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:08:45.765176 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x72s7\" (UniqueName: \"kubernetes.io/projected/8c4463f3-70e5-4588-b8ae-79e9f6ea80e3-kube-api-access-x72s7\") pod \"opendatahub-operator-controller-manager-ccc7894f9-q6lkd\" (UID: \"8c4463f3-70e5-4588-b8ae-79e9f6ea80e3\") " pod="opendatahub/opendatahub-operator-controller-manager-ccc7894f9-q6lkd" Jul 08 23:08:45.838121 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:08:45.838103 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-ccc7894f9-q6lkd" Jul 08 23:08:45.968930 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:08:45.968881 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-ccc7894f9-q6lkd"] Jul 08 23:08:45.971144 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:08:45.971114 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c4463f3_70e5_4588_b8ae_79e9f6ea80e3.slice/crio-8760fb9667bf0cb6b2b0d06762acc592c3244b8b0830fcbd76d0c87444f91b13 WatchSource:0}: Error finding container 8760fb9667bf0cb6b2b0d06762acc592c3244b8b0830fcbd76d0c87444f91b13: Status 404 returned error can't find the container with id 8760fb9667bf0cb6b2b0d06762acc592c3244b8b0830fcbd76d0c87444f91b13 Jul 08 23:08:45.973148 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:08:45.973128 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 08 23:08:46.100673 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:08:46.100595 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-ccc7894f9-q6lkd" event={"ID":"8c4463f3-70e5-4588-b8ae-79e9f6ea80e3","Type":"ContainerStarted","Data":"8760fb9667bf0cb6b2b0d06762acc592c3244b8b0830fcbd76d0c87444f91b13"} Jul 08 23:08:49.116141 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:08:49.116114 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-ccc7894f9-q6lkd" event={"ID":"8c4463f3-70e5-4588-b8ae-79e9f6ea80e3","Type":"ContainerStarted","Data":"f03a833720eee056c3db80bf9e60bf34db23dc4f011821ce75bf1534a47d7822"} Jul 08 23:08:51.125682 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:08:51.125648 2574 generic.go:356] "Generic (PLEG): container finished" podID="8c4463f3-70e5-4588-b8ae-79e9f6ea80e3" containerID="f03a833720eee056c3db80bf9e60bf34db23dc4f011821ce75bf1534a47d7822" exitCode=0 Jul 08 23:08:51.126239 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:08:51.125706 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-ccc7894f9-q6lkd" event={"ID":"8c4463f3-70e5-4588-b8ae-79e9f6ea80e3","Type":"ContainerDied","Data":"f03a833720eee056c3db80bf9e60bf34db23dc4f011821ce75bf1534a47d7822"} Jul 08 23:08:52.131705 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:08:52.131662 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-ccc7894f9-q6lkd" event={"ID":"8c4463f3-70e5-4588-b8ae-79e9f6ea80e3","Type":"ContainerStarted","Data":"1acddb1773e2ef7056a1a96091d6913e3320e57fd3c7f88c9cbd9be8a3d65e01"} Jul 08 23:08:52.132095 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:08:52.131878 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-ccc7894f9-q6lkd" Jul 08 23:08:52.161847 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:08:52.161794 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-ccc7894f9-q6lkd" podStartSLOduration=2.660125082 podStartE2EDuration="7.161780595s" totalImagesPullingTime="3.46958528s" totalInitContainerRuntime="1.032070233s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:08:45 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:08:52.160678892 +0000 UTC m=+382.208952795" watchObservedRunningTime="2026-07-08 23:08:52.161780595 +0000 UTC m=+382.210054491" Jul 08 23:09:03.137674 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:09:03.137645 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-ccc7894f9-q6lkd" Jul 08 23:09:06.235618 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:09:06.235586 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-kvgws"] Jul 08 23:09:06.244678 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:09:06.244656 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-kvgws" Jul 08 23:09:06.247587 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:09:06.247562 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jul 08 23:09:06.248338 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:09:06.248310 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-kvgws"] Jul 08 23:09:06.322169 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:09:06.322140 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5c73bea0-88de-4537-b136-e4d0780fa5b9-tls-certs\") pod \"model-serving-api-54d89bd5fc-kvgws\" (UID: \"5c73bea0-88de-4537-b136-e4d0780fa5b9\") " pod="opendatahub/model-serving-api-54d89bd5fc-kvgws" Jul 08 23:09:06.322311 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:09:06.322176 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jmvbl\" (UniqueName: \"kubernetes.io/projected/5c73bea0-88de-4537-b136-e4d0780fa5b9-kube-api-access-jmvbl\") pod \"model-serving-api-54d89bd5fc-kvgws\" (UID: \"5c73bea0-88de-4537-b136-e4d0780fa5b9\") " pod="opendatahub/model-serving-api-54d89bd5fc-kvgws" Jul 08 23:09:06.422991 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:09:06.422964 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5c73bea0-88de-4537-b136-e4d0780fa5b9-tls-certs\") pod \"model-serving-api-54d89bd5fc-kvgws\" (UID: \"5c73bea0-88de-4537-b136-e4d0780fa5b9\") " pod="opendatahub/model-serving-api-54d89bd5fc-kvgws" Jul 08 23:09:06.423122 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:09:06.422998 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jmvbl\" (UniqueName: \"kubernetes.io/projected/5c73bea0-88de-4537-b136-e4d0780fa5b9-kube-api-access-jmvbl\") pod \"model-serving-api-54d89bd5fc-kvgws\" (UID: \"5c73bea0-88de-4537-b136-e4d0780fa5b9\") " pod="opendatahub/model-serving-api-54d89bd5fc-kvgws" Jul 08 23:09:06.425408 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:09:06.425391 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5c73bea0-88de-4537-b136-e4d0780fa5b9-tls-certs\") pod \"model-serving-api-54d89bd5fc-kvgws\" (UID: \"5c73bea0-88de-4537-b136-e4d0780fa5b9\") " pod="opendatahub/model-serving-api-54d89bd5fc-kvgws" Jul 08 23:09:06.430658 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:09:06.430615 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jmvbl\" (UniqueName: \"kubernetes.io/projected/5c73bea0-88de-4537-b136-e4d0780fa5b9-kube-api-access-jmvbl\") pod \"model-serving-api-54d89bd5fc-kvgws\" (UID: \"5c73bea0-88de-4537-b136-e4d0780fa5b9\") " pod="opendatahub/model-serving-api-54d89bd5fc-kvgws" Jul 08 23:09:06.557235 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:09:06.557213 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-kvgws" Jul 08 23:09:06.692408 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:09:06.692381 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-kvgws"] Jul 08 23:09:06.694943 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:09:06.694915 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c73bea0_88de_4537_b136_e4d0780fa5b9.slice/crio-b4ac70feaec2d70f7d57ceedecddea96e2720e8ebf727eb1d80075af6cdbb7c0 WatchSource:0}: Error finding container b4ac70feaec2d70f7d57ceedecddea96e2720e8ebf727eb1d80075af6cdbb7c0: Status 404 returned error can't find the container with id b4ac70feaec2d70f7d57ceedecddea96e2720e8ebf727eb1d80075af6cdbb7c0 Jul 08 23:09:07.192175 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:09:07.192140 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-kvgws" event={"ID":"5c73bea0-88de-4537-b136-e4d0780fa5b9","Type":"ContainerStarted","Data":"b4ac70feaec2d70f7d57ceedecddea96e2720e8ebf727eb1d80075af6cdbb7c0"} Jul 08 23:09:09.203380 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:09:09.203348 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-kvgws" event={"ID":"5c73bea0-88de-4537-b136-e4d0780fa5b9","Type":"ContainerStarted","Data":"afeafdebb4e7b2951cb90315a5495cee2c1a6683776d8fdf27c9731492c8a804"} Jul 08 23:09:09.203789 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:09:09.203426 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-kvgws" Jul 08 23:09:09.221863 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:09:09.221812 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-kvgws" podStartSLOduration=1.297468512 podStartE2EDuration="3.221799238s" totalImagesPullingTime="1.924330726s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:09:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:09:09.221192927 +0000 UTC m=+399.269466843" watchObservedRunningTime="2026-07-08 23:09:09.221799238 +0000 UTC m=+399.270073141" Jul 08 23:09:14.671373 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:09:14.671341 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-9ll2q"] Jul 08 23:09:14.674714 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:09:14.674696 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-9ll2q" Jul 08 23:09:14.678378 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:09:14.678352 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jul 08 23:09:14.678497 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:09:14.678388 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-qpkgp\"" Jul 08 23:09:14.679663 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:09:14.679643 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-pm788"] Jul 08 23:09:14.683411 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:09:14.683390 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-pm788" Jul 08 23:09:14.686070 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:09:14.685765 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-wfnwp\"" Jul 08 23:09:14.686186 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:09:14.686099 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-9ll2q"] Jul 08 23:09:14.686186 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:09:14.686139 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jul 08 23:09:14.694421 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:09:14.694400 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-pm788"] Jul 08 23:09:14.782016 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:09:14.781986 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/26708738-9177-4a84-8c5c-6c8f4b8ba622-cert\") pod \"kserve-controller-manager-d6f4b65b8-9ll2q\" (UID: \"26708738-9177-4a84-8c5c-6c8f4b8ba622\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-9ll2q" Jul 08 23:09:14.782151 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:09:14.782022 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7ac850fc-87e7-4c22-b422-291fe95524c1-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-pm788\" (UID: \"7ac850fc-87e7-4c22-b422-291fe95524c1\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-pm788" Jul 08 23:09:14.782151 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:09:14.782040 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-65gxr\" (UniqueName: \"kubernetes.io/projected/7ac850fc-87e7-4c22-b422-291fe95524c1-kube-api-access-65gxr\") pod \"llmisvc-controller-manager-777c6bd7d5-pm788\" (UID: \"7ac850fc-87e7-4c22-b422-291fe95524c1\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-pm788" Jul 08 23:09:14.782239 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:09:14.782168 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rqvs\" (UniqueName: \"kubernetes.io/projected/26708738-9177-4a84-8c5c-6c8f4b8ba622-kube-api-access-5rqvs\") pod \"kserve-controller-manager-d6f4b65b8-9ll2q\" (UID: \"26708738-9177-4a84-8c5c-6c8f4b8ba622\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-9ll2q" Jul 08 23:09:14.883017 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:09:14.882986 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5rqvs\" (UniqueName: \"kubernetes.io/projected/26708738-9177-4a84-8c5c-6c8f4b8ba622-kube-api-access-5rqvs\") pod \"kserve-controller-manager-d6f4b65b8-9ll2q\" (UID: \"26708738-9177-4a84-8c5c-6c8f4b8ba622\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-9ll2q" Jul 08 23:09:14.883017 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:09:14.883022 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/26708738-9177-4a84-8c5c-6c8f4b8ba622-cert\") pod \"kserve-controller-manager-d6f4b65b8-9ll2q\" (UID: \"26708738-9177-4a84-8c5c-6c8f4b8ba622\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-9ll2q" Jul 08 23:09:14.883221 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:09:14.883044 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7ac850fc-87e7-4c22-b422-291fe95524c1-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-pm788\" (UID: \"7ac850fc-87e7-4c22-b422-291fe95524c1\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-pm788" Jul 08 23:09:14.883221 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:09:14.883068 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-65gxr\" (UniqueName: \"kubernetes.io/projected/7ac850fc-87e7-4c22-b422-291fe95524c1-kube-api-access-65gxr\") pod \"llmisvc-controller-manager-777c6bd7d5-pm788\" (UID: \"7ac850fc-87e7-4c22-b422-291fe95524c1\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-pm788" Jul 08 23:09:14.885701 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:09:14.885668 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7ac850fc-87e7-4c22-b422-291fe95524c1-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-pm788\" (UID: \"7ac850fc-87e7-4c22-b422-291fe95524c1\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-pm788" Jul 08 23:09:14.885829 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:09:14.885668 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/26708738-9177-4a84-8c5c-6c8f4b8ba622-cert\") pod \"kserve-controller-manager-d6f4b65b8-9ll2q\" (UID: \"26708738-9177-4a84-8c5c-6c8f4b8ba622\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-9ll2q" Jul 08 23:09:14.893693 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:09:14.893644 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rqvs\" (UniqueName: \"kubernetes.io/projected/26708738-9177-4a84-8c5c-6c8f4b8ba622-kube-api-access-5rqvs\") pod \"kserve-controller-manager-d6f4b65b8-9ll2q\" (UID: \"26708738-9177-4a84-8c5c-6c8f4b8ba622\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-9ll2q" Jul 08 23:09:14.894789 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:09:14.894736 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-65gxr\" (UniqueName: \"kubernetes.io/projected/7ac850fc-87e7-4c22-b422-291fe95524c1-kube-api-access-65gxr\") pod \"llmisvc-controller-manager-777c6bd7d5-pm788\" (UID: \"7ac850fc-87e7-4c22-b422-291fe95524c1\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-pm788" Jul 08 23:09:14.986798 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:09:14.986717 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-9ll2q" Jul 08 23:09:14.996869 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:09:14.996851 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-pm788" Jul 08 23:09:15.135678 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:09:15.135643 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-9ll2q"] Jul 08 23:09:15.139089 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:09:15.139061 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26708738_9177_4a84_8c5c_6c8f4b8ba622.slice/crio-e84b6637cc2225c8c8f0bbe658b0a273d5448e45082d542528770a0b854d2d90 WatchSource:0}: Error finding container e84b6637cc2225c8c8f0bbe658b0a273d5448e45082d542528770a0b854d2d90: Status 404 returned error can't find the container with id e84b6637cc2225c8c8f0bbe658b0a273d5448e45082d542528770a0b854d2d90 Jul 08 23:09:15.154439 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:09:15.154416 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-pm788"] Jul 08 23:09:15.155980 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:09:15.155955 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod7ac850fc_87e7_4c22_b422_291fe95524c1.slice/crio-2c9682cba8cd7711ee65a5113056f9b2fff09e7756dc6c593e3a18130d9194a7 WatchSource:0}: Error finding container 2c9682cba8cd7711ee65a5113056f9b2fff09e7756dc6c593e3a18130d9194a7: Status 404 returned error can't find the container with id 2c9682cba8cd7711ee65a5113056f9b2fff09e7756dc6c593e3a18130d9194a7 Jul 08 23:09:15.231685 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:09:15.231655 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-9ll2q" event={"ID":"26708738-9177-4a84-8c5c-6c8f4b8ba622","Type":"ContainerStarted","Data":"e84b6637cc2225c8c8f0bbe658b0a273d5448e45082d542528770a0b854d2d90"} Jul 08 23:09:15.232764 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:09:15.232740 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-pm788" event={"ID":"7ac850fc-87e7-4c22-b422-291fe95524c1","Type":"ContainerStarted","Data":"2c9682cba8cd7711ee65a5113056f9b2fff09e7756dc6c593e3a18130d9194a7"} Jul 08 23:09:16.160720 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:09:16.160688 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7dc6c875b-zsqc7"] Jul 08 23:09:16.164442 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:09:16.164407 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7dc6c875b-zsqc7" Jul 08 23:09:16.167955 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:09:16.167924 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-n5ms9\"" Jul 08 23:09:16.168293 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:09:16.168269 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 08 23:09:16.168875 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:09:16.168845 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 08 23:09:16.187430 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:09:16.186908 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7dc6c875b-zsqc7"] Jul 08 23:09:16.194339 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:09:16.194313 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9703bd00-80a1-4b43-bb4f-79f098a13b13-tls-certs\") pod \"kube-auth-proxy-7dc6c875b-zsqc7\" (UID: \"9703bd00-80a1-4b43-bb4f-79f098a13b13\") " pod="openshift-ingress/kube-auth-proxy-7dc6c875b-zsqc7" Jul 08 23:09:16.194450 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:09:16.194376 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9703bd00-80a1-4b43-bb4f-79f098a13b13-tmp\") pod \"kube-auth-proxy-7dc6c875b-zsqc7\" (UID: \"9703bd00-80a1-4b43-bb4f-79f098a13b13\") " pod="openshift-ingress/kube-auth-proxy-7dc6c875b-zsqc7" Jul 08 23:09:16.194450 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:09:16.194430 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rlt9m\" (UniqueName: \"kubernetes.io/projected/9703bd00-80a1-4b43-bb4f-79f098a13b13-kube-api-access-rlt9m\") pod \"kube-auth-proxy-7dc6c875b-zsqc7\" (UID: \"9703bd00-80a1-4b43-bb4f-79f098a13b13\") " pod="openshift-ingress/kube-auth-proxy-7dc6c875b-zsqc7" Jul 08 23:09:16.295846 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:09:16.295645 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rlt9m\" (UniqueName: \"kubernetes.io/projected/9703bd00-80a1-4b43-bb4f-79f098a13b13-kube-api-access-rlt9m\") pod \"kube-auth-proxy-7dc6c875b-zsqc7\" (UID: \"9703bd00-80a1-4b43-bb4f-79f098a13b13\") " pod="openshift-ingress/kube-auth-proxy-7dc6c875b-zsqc7" Jul 08 23:09:16.295846 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:09:16.295764 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9703bd00-80a1-4b43-bb4f-79f098a13b13-tls-certs\") pod \"kube-auth-proxy-7dc6c875b-zsqc7\" (UID: \"9703bd00-80a1-4b43-bb4f-79f098a13b13\") " pod="openshift-ingress/kube-auth-proxy-7dc6c875b-zsqc7" Jul 08 23:09:16.295846 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:09:16.295804 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9703bd00-80a1-4b43-bb4f-79f098a13b13-tmp\") pod \"kube-auth-proxy-7dc6c875b-zsqc7\" (UID: \"9703bd00-80a1-4b43-bb4f-79f098a13b13\") " pod="openshift-ingress/kube-auth-proxy-7dc6c875b-zsqc7" Jul 08 23:09:16.298704 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:09:16.298674 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9703bd00-80a1-4b43-bb4f-79f098a13b13-tmp\") pod \"kube-auth-proxy-7dc6c875b-zsqc7\" (UID: \"9703bd00-80a1-4b43-bb4f-79f098a13b13\") " pod="openshift-ingress/kube-auth-proxy-7dc6c875b-zsqc7" Jul 08 23:09:16.298964 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:09:16.298942 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9703bd00-80a1-4b43-bb4f-79f098a13b13-tls-certs\") pod \"kube-auth-proxy-7dc6c875b-zsqc7\" (UID: \"9703bd00-80a1-4b43-bb4f-79f098a13b13\") " pod="openshift-ingress/kube-auth-proxy-7dc6c875b-zsqc7" Jul 08 23:09:16.307963 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:09:16.307926 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rlt9m\" (UniqueName: \"kubernetes.io/projected/9703bd00-80a1-4b43-bb4f-79f098a13b13-kube-api-access-rlt9m\") pod \"kube-auth-proxy-7dc6c875b-zsqc7\" (UID: \"9703bd00-80a1-4b43-bb4f-79f098a13b13\") " pod="openshift-ingress/kube-auth-proxy-7dc6c875b-zsqc7" Jul 08 23:09:16.478416 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:09:16.478339 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7dc6c875b-zsqc7" Jul 08 23:09:16.739240 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:09:16.739160 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7dc6c875b-zsqc7"] Jul 08 23:09:16.742543 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:09:16.742493 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9703bd00_80a1_4b43_bb4f_79f098a13b13.slice/crio-7778fd88f0445247a30f5945602196059fa68b274f0c5ed6dd8b310af07f0d8d WatchSource:0}: Error finding container 7778fd88f0445247a30f5945602196059fa68b274f0c5ed6dd8b310af07f0d8d: Status 404 returned error can't find the container with id 7778fd88f0445247a30f5945602196059fa68b274f0c5ed6dd8b310af07f0d8d Jul 08 23:09:17.244194 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:09:17.244161 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7dc6c875b-zsqc7" event={"ID":"9703bd00-80a1-4b43-bb4f-79f098a13b13","Type":"ContainerStarted","Data":"7778fd88f0445247a30f5945602196059fa68b274f0c5ed6dd8b310af07f0d8d"} Jul 08 23:09:17.859102 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:09:17.858849 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-c5b2r"] Jul 08 23:09:17.862375 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:09:17.862347 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-c5b2r" Jul 08 23:09:17.864990 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:09:17.864955 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 08 23:09:17.865108 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:09:17.864987 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 08 23:09:17.865108 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:09:17.865008 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 08 23:09:17.865108 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:09:17.865082 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 08 23:09:17.865342 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:09:17.865324 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-zzqdl\"" Jul 08 23:09:17.876499 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:09:17.876472 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-c5b2r"] Jul 08 23:09:17.911838 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:09:17.911814 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f6f973e6-e403-47c5-8870-822dbc0020a3-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-c5b2r\" (UID: \"f6f973e6-e403-47c5-8870-822dbc0020a3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-c5b2r" Jul 08 23:09:17.911980 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:09:17.911858 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f6f973e6-e403-47c5-8870-822dbc0020a3-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-c5b2r\" (UID: \"f6f973e6-e403-47c5-8870-822dbc0020a3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-c5b2r" Jul 08 23:09:17.911980 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:09:17.911906 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f6f973e6-e403-47c5-8870-822dbc0020a3-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-c5b2r\" (UID: \"f6f973e6-e403-47c5-8870-822dbc0020a3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-c5b2r" Jul 08 23:09:17.911980 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:09:17.911946 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bb4tm\" (UniqueName: \"kubernetes.io/projected/f6f973e6-e403-47c5-8870-822dbc0020a3-kube-api-access-bb4tm\") pod \"istiod-openshift-gateway-94bb8fbfd-c5b2r\" (UID: \"f6f973e6-e403-47c5-8870-822dbc0020a3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-c5b2r" Jul 08 23:09:17.912156 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:09:17.911981 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f6f973e6-e403-47c5-8870-822dbc0020a3-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-c5b2r\" (UID: \"f6f973e6-e403-47c5-8870-822dbc0020a3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-c5b2r" Jul 08 23:09:17.912156 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:09:17.912094 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f6f973e6-e403-47c5-8870-822dbc0020a3-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-c5b2r\" (UID: \"f6f973e6-e403-47c5-8870-822dbc0020a3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-c5b2r" Jul 08 23:09:17.912156 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:09:17.912150 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f6f973e6-e403-47c5-8870-822dbc0020a3-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-c5b2r\" (UID: \"f6f973e6-e403-47c5-8870-822dbc0020a3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-c5b2r" Jul 08 23:09:18.013175 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:09:18.013136 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bb4tm\" (UniqueName: \"kubernetes.io/projected/f6f973e6-e403-47c5-8870-822dbc0020a3-kube-api-access-bb4tm\") pod \"istiod-openshift-gateway-94bb8fbfd-c5b2r\" (UID: \"f6f973e6-e403-47c5-8870-822dbc0020a3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-c5b2r" Jul 08 23:09:18.013341 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:09:18.013192 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f6f973e6-e403-47c5-8870-822dbc0020a3-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-c5b2r\" (UID: \"f6f973e6-e403-47c5-8870-822dbc0020a3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-c5b2r" Jul 08 23:09:18.013341 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:09:18.013261 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f6f973e6-e403-47c5-8870-822dbc0020a3-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-c5b2r\" (UID: \"f6f973e6-e403-47c5-8870-822dbc0020a3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-c5b2r" Jul 08 23:09:18.013341 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:09:18.013324 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f6f973e6-e403-47c5-8870-822dbc0020a3-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-c5b2r\" (UID: \"f6f973e6-e403-47c5-8870-822dbc0020a3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-c5b2r" Jul 08 23:09:18.013494 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:09:18.013372 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f6f973e6-e403-47c5-8870-822dbc0020a3-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-c5b2r\" (UID: \"f6f973e6-e403-47c5-8870-822dbc0020a3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-c5b2r" Jul 08 23:09:18.013494 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:09:18.013414 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f6f973e6-e403-47c5-8870-822dbc0020a3-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-c5b2r\" (UID: \"f6f973e6-e403-47c5-8870-822dbc0020a3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-c5b2r" Jul 08 23:09:18.013494 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:09:18.013455 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f6f973e6-e403-47c5-8870-822dbc0020a3-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-c5b2r\" (UID: \"f6f973e6-e403-47c5-8870-822dbc0020a3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-c5b2r" Jul 08 23:09:18.014143 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:09:18.014117 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f6f973e6-e403-47c5-8870-822dbc0020a3-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-c5b2r\" (UID: \"f6f973e6-e403-47c5-8870-822dbc0020a3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-c5b2r" Jul 08 23:09:18.015948 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:09:18.015924 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f6f973e6-e403-47c5-8870-822dbc0020a3-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-c5b2r\" (UID: \"f6f973e6-e403-47c5-8870-822dbc0020a3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-c5b2r" Jul 08 23:09:18.016058 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:09:18.015952 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f6f973e6-e403-47c5-8870-822dbc0020a3-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-c5b2r\" (UID: \"f6f973e6-e403-47c5-8870-822dbc0020a3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-c5b2r" Jul 08 23:09:18.016180 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:09:18.016156 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f6f973e6-e403-47c5-8870-822dbc0020a3-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-c5b2r\" (UID: \"f6f973e6-e403-47c5-8870-822dbc0020a3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-c5b2r" Jul 08 23:09:18.016867 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:09:18.016844 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f6f973e6-e403-47c5-8870-822dbc0020a3-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-c5b2r\" (UID: \"f6f973e6-e403-47c5-8870-822dbc0020a3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-c5b2r" Jul 08 23:09:18.022708 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:09:18.022685 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f6f973e6-e403-47c5-8870-822dbc0020a3-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-c5b2r\" (UID: \"f6f973e6-e403-47c5-8870-822dbc0020a3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-c5b2r" Jul 08 23:09:18.023000 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:09:18.022983 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bb4tm\" (UniqueName: \"kubernetes.io/projected/f6f973e6-e403-47c5-8870-822dbc0020a3-kube-api-access-bb4tm\") pod \"istiod-openshift-gateway-94bb8fbfd-c5b2r\" (UID: \"f6f973e6-e403-47c5-8870-822dbc0020a3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-c5b2r" Jul 08 23:09:18.182266 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:09:18.182110 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-c5b2r" Jul 08 23:09:18.250135 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:09:18.250097 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-9ll2q" event={"ID":"26708738-9177-4a84-8c5c-6c8f4b8ba622","Type":"ContainerStarted","Data":"2c118bbaf1ca9c6c9f13c3e0e3219c06e1d7ea5904d22a7cbe3dc7196bcc1a78"} Jul 08 23:09:18.250540 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:09:18.250197 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-9ll2q" Jul 08 23:09:18.275014 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:09:18.274965 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-9ll2q" podStartSLOduration=1.596750261 podStartE2EDuration="4.274945325s" totalImagesPullingTime="2.678195064s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:09:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:09:18.273496658 +0000 UTC m=+408.321770561" watchObservedRunningTime="2026-07-08 23:09:18.274945325 +0000 UTC m=+408.323219242" Jul 08 23:09:18.623560 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:09:18.623530 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-c5b2r"] Jul 08 23:09:18.626333 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:09:18.626303 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6f973e6_e403_47c5_8870_822dbc0020a3.slice/crio-9741208859f906dd1fe79e57812d33d906383d159cc15a06dc85b7063d094747 WatchSource:0}: Error finding container 9741208859f906dd1fe79e57812d33d906383d159cc15a06dc85b7063d094747: Status 404 returned error can't find the container with id 9741208859f906dd1fe79e57812d33d906383d159cc15a06dc85b7063d094747 Jul 08 23:09:19.256371 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:09:19.256331 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-pm788" event={"ID":"7ac850fc-87e7-4c22-b422-291fe95524c1","Type":"ContainerStarted","Data":"095dc0b391641a68f9bc151e9d54ff61e75175a22c3fc615a91d62182cfe9f36"} Jul 08 23:09:19.256961 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:09:19.256407 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-pm788" Jul 08 23:09:19.257706 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:09:19.257651 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-c5b2r" event={"ID":"f6f973e6-e403-47c5-8870-822dbc0020a3","Type":"ContainerStarted","Data":"9741208859f906dd1fe79e57812d33d906383d159cc15a06dc85b7063d094747"} Jul 08 23:09:19.293135 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:09:19.293088 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-pm788" podStartSLOduration=1.919990579 podStartE2EDuration="5.293071553s" totalImagesPullingTime="3.373080974s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:09:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:09:19.291684187 +0000 UTC m=+409.339958103" watchObservedRunningTime="2026-07-08 23:09:19.293071553 +0000 UTC m=+409.341345455" Jul 08 23:09:20.213046 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:09:20.212965 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-kvgws" Jul 08 23:09:20.264880 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:09:20.264839 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7dc6c875b-zsqc7" event={"ID":"9703bd00-80a1-4b43-bb4f-79f098a13b13","Type":"ContainerStarted","Data":"2477870bb2a189fa774ff1296c7521e881e10c6d2745872c5633d5ec53dd552f"} Jul 08 23:09:20.295348 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:09:20.295295 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7dc6c875b-zsqc7" podStartSLOduration=1.226260528 podStartE2EDuration="4.295277377s" totalImagesPullingTime="3.069016849s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:09:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:09:20.29305438 +0000 UTC m=+410.341328285" watchObservedRunningTime="2026-07-08 23:09:20.295277377 +0000 UTC m=+410.343551287" Jul 08 23:09:21.654140 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:09:21.654106 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"} Jul 08 23:09:21.654374 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:09:21.654168 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"} Jul 08 23:09:22.276947 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:09:22.276904 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-c5b2r" event={"ID":"f6f973e6-e403-47c5-8870-822dbc0020a3","Type":"ContainerStarted","Data":"ddee2e6241cca34d9bb0695423ec2d4bb7c19bfb331cbbf90dba43d7677e6711"} Jul 08 23:09:22.277152 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:09:22.277001 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-c5b2r" Jul 08 23:09:22.278715 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:09:22.278689 2574 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-c5b2r container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 08 23:09:22.278829 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:09:22.278742 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-c5b2r" podUID="f6f973e6-e403-47c5-8870-822dbc0020a3" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 08 23:09:22.297909 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:09:22.297863 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-c5b2r" podStartSLOduration=2.272737976 podStartE2EDuration="5.297851121s" totalImagesPullingTime="3.025113145s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:09:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:09:22.296241296 +0000 UTC m=+412.344515212" watchObservedRunningTime="2026-07-08 23:09:22.297851121 +0000 UTC m=+412.346125024" Jul 08 23:09:23.282068 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:09:23.282034 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-c5b2r" Jul 08 23:09:49.263126 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:09:49.263086 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-9ll2q" Jul 08 23:09:50.266987 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:09:50.266954 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-pm788" Jul 08 23:11:10.626318 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:11:10.626286 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-65mlz"] Jul 08 23:11:10.634670 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:11:10.632801 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-65mlz" Jul 08 23:11:10.636326 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:11:10.636299 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 08 23:11:10.636465 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:11:10.636370 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 08 23:11:10.637413 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:11:10.637387 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-m8jsz\"" Jul 08 23:11:10.640546 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:11:10.640493 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-65mlz"] Jul 08 23:11:10.709660 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:11:10.709629 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gt8gt\" (UniqueName: \"kubernetes.io/projected/83a022ab-11c0-4bed-ba41-8704b770e9d7-kube-api-access-gt8gt\") pod \"limitador-operator-controller-manager-859d7b78bd-65mlz\" (UID: \"83a022ab-11c0-4bed-ba41-8704b770e9d7\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-65mlz" Jul 08 23:11:10.810132 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:11:10.810101 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gt8gt\" (UniqueName: \"kubernetes.io/projected/83a022ab-11c0-4bed-ba41-8704b770e9d7-kube-api-access-gt8gt\") pod \"limitador-operator-controller-manager-859d7b78bd-65mlz\" (UID: \"83a022ab-11c0-4bed-ba41-8704b770e9d7\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-65mlz" Jul 08 23:11:10.818107 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:11:10.818076 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gt8gt\" (UniqueName: \"kubernetes.io/projected/83a022ab-11c0-4bed-ba41-8704b770e9d7-kube-api-access-gt8gt\") pod \"limitador-operator-controller-manager-859d7b78bd-65mlz\" (UID: \"83a022ab-11c0-4bed-ba41-8704b770e9d7\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-65mlz" Jul 08 23:11:10.946684 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:11:10.946602 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-65mlz" Jul 08 23:11:11.083702 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:11:11.083341 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-65mlz"] Jul 08 23:11:11.086161 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:11:11.086134 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83a022ab_11c0_4bed_ba41_8704b770e9d7.slice/crio-c420b081e9b6d2fd0903c9241e61f2e895ad5be061434cc59125d56d07f7df9a WatchSource:0}: Error finding container c420b081e9b6d2fd0903c9241e61f2e895ad5be061434cc59125d56d07f7df9a: Status 404 returned error can't find the container with id c420b081e9b6d2fd0903c9241e61f2e895ad5be061434cc59125d56d07f7df9a Jul 08 23:11:11.751816 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:11:11.751787 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-65mlz" event={"ID":"83a022ab-11c0-4bed-ba41-8704b770e9d7","Type":"ContainerStarted","Data":"c420b081e9b6d2fd0903c9241e61f2e895ad5be061434cc59125d56d07f7df9a"} Jul 08 23:11:13.765803 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:11:13.765764 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-65mlz" event={"ID":"83a022ab-11c0-4bed-ba41-8704b770e9d7","Type":"ContainerStarted","Data":"c36a76723672d2cb55b5354043de60a552d432cc99cc630e5405d6fa4d84e3de"} Jul 08 23:11:13.766269 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:11:13.765913 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-65mlz" Jul 08 23:11:13.782197 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:11:13.782150 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-65mlz" podStartSLOduration=2.026312947 podStartE2EDuration="3.782136675s" totalImagesPullingTime="1.755823728s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:11:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:11:13.781044914 +0000 UTC m=+523.829318818" watchObservedRunningTime="2026-07-08 23:11:13.782136675 +0000 UTC m=+523.830410578" Jul 08 23:11:24.771576 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:11:24.771483 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-65mlz" Jul 08 23:12:30.399448 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:12:30.399417 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-b7vhr_820d35fb-fba2-4328-9e2b-0874474cb416/console-operator/2.log" Jul 08 23:12:30.399946 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:12:30.399921 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-b7vhr_820d35fb-fba2-4328-9e2b-0874474cb416/console-operator/2.log" Jul 08 23:12:30.403429 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:12:30.403408 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8mcjt_82783d98-33c2-4050-b38f-5ba0a9701953/ovn-acl-logging/0.log" Jul 08 23:12:30.403889 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:12:30.403872 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8mcjt_82783d98-33c2-4050-b38f-5ba0a9701953/ovn-acl-logging/0.log" Jul 08 23:12:50.613813 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:12:50.613782 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-d8957bd74-dq96d"] Jul 08 23:12:50.617104 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:12:50.617081 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-d8957bd74-dq96d" Jul 08 23:12:50.621010 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:12:50.620984 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-n84h8\"" Jul 08 23:12:50.621168 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:12:50.621148 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 08 23:12:50.621910 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:12:50.621892 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 08 23:12:50.629245 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:12:50.629226 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-d8957bd74-dq96d"] Jul 08 23:12:50.677208 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:12:50.677178 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5448cdae-b466-498f-b270-285736cbca4f-webhook-cert\") pod \"maas-controller-d8957bd74-dq96d\" (UID: \"5448cdae-b466-498f-b270-285736cbca4f\") " pod="opendatahub/maas-controller-d8957bd74-dq96d" Jul 08 23:12:50.677347 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:12:50.677221 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nmkxj\" (UniqueName: \"kubernetes.io/projected/5448cdae-b466-498f-b270-285736cbca4f-kube-api-access-nmkxj\") pod \"maas-controller-d8957bd74-dq96d\" (UID: \"5448cdae-b466-498f-b270-285736cbca4f\") " pod="opendatahub/maas-controller-d8957bd74-dq96d" Jul 08 23:12:50.777854 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:12:50.777822 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5448cdae-b466-498f-b270-285736cbca4f-webhook-cert\") pod \"maas-controller-d8957bd74-dq96d\" (UID: \"5448cdae-b466-498f-b270-285736cbca4f\") " pod="opendatahub/maas-controller-d8957bd74-dq96d" Jul 08 23:12:50.778000 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:12:50.777867 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nmkxj\" (UniqueName: \"kubernetes.io/projected/5448cdae-b466-498f-b270-285736cbca4f-kube-api-access-nmkxj\") pod \"maas-controller-d8957bd74-dq96d\" (UID: \"5448cdae-b466-498f-b270-285736cbca4f\") " pod="opendatahub/maas-controller-d8957bd74-dq96d" Jul 08 23:12:50.780300 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:12:50.780270 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5448cdae-b466-498f-b270-285736cbca4f-webhook-cert\") pod \"maas-controller-d8957bd74-dq96d\" (UID: \"5448cdae-b466-498f-b270-285736cbca4f\") " pod="opendatahub/maas-controller-d8957bd74-dq96d" Jul 08 23:12:50.786639 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:12:50.786614 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nmkxj\" (UniqueName: \"kubernetes.io/projected/5448cdae-b466-498f-b270-285736cbca4f-kube-api-access-nmkxj\") pod \"maas-controller-d8957bd74-dq96d\" (UID: \"5448cdae-b466-498f-b270-285736cbca4f\") " pod="opendatahub/maas-controller-d8957bd74-dq96d" Jul 08 23:12:50.928070 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:12:50.927987 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-d8957bd74-dq96d" Jul 08 23:12:51.064700 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:12:51.064662 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-d8957bd74-dq96d"] Jul 08 23:12:51.066846 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:12:51.066817 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5448cdae_b466_498f_b270_285736cbca4f.slice/crio-3357a245e1ea2ea59aa4ae36d87d9241b37aa059adbddf748b001f8278ef6933 WatchSource:0}: Error finding container 3357a245e1ea2ea59aa4ae36d87d9241b37aa059adbddf748b001f8278ef6933: Status 404 returned error can't find the container with id 3357a245e1ea2ea59aa4ae36d87d9241b37aa059adbddf748b001f8278ef6933 Jul 08 23:12:51.206491 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:12:51.206403 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-d8957bd74-dq96d" event={"ID":"5448cdae-b466-498f-b270-285736cbca4f","Type":"ContainerStarted","Data":"3357a245e1ea2ea59aa4ae36d87d9241b37aa059adbddf748b001f8278ef6933"} Jul 08 23:12:54.231965 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:12:54.231930 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-d8957bd74-dq96d" event={"ID":"5448cdae-b466-498f-b270-285736cbca4f","Type":"ContainerStarted","Data":"098c77d5cd99db26e6532c84eaa33dbd5c659ecba4aec5f45859bc8d2d9f6338"} Jul 08 23:12:54.232376 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:12:54.232021 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-d8957bd74-dq96d" Jul 08 23:12:54.248492 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:12:54.248445 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-d8957bd74-dq96d" podStartSLOduration=1.684642938 podStartE2EDuration="4.248432593s" totalImagesPullingTime="2.563789655s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:12:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:12:54.247324241 +0000 UTC m=+624.295598137" watchObservedRunningTime="2026-07-08 23:12:54.248432593 +0000 UTC m=+624.296706496" Jul 08 23:13:04.457617 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:13:04.457580 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-d8957bd74-dq96d"] Jul 08 23:13:04.458168 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:13:04.457779 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-d8957bd74-dq96d" podUID="5448cdae-b466-498f-b270-285736cbca4f" containerName="manager" containerID="cri-o://098c77d5cd99db26e6532c84eaa33dbd5c659ecba4aec5f45859bc8d2d9f6338" gracePeriod=30 Jul 08 23:13:04.464530 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:13:04.464469 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-d8957bd74-dq96d" Jul 08 23:13:04.708691 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:13:04.708637 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-d8957bd74-dq96d" Jul 08 23:13:04.790412 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:13:04.790382 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nmkxj\" (UniqueName: \"kubernetes.io/projected/5448cdae-b466-498f-b270-285736cbca4f-kube-api-access-nmkxj\") pod \"5448cdae-b466-498f-b270-285736cbca4f\" (UID: \"5448cdae-b466-498f-b270-285736cbca4f\") " Jul 08 23:13:04.790598 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:13:04.790451 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5448cdae-b466-498f-b270-285736cbca4f-webhook-cert\") pod \"5448cdae-b466-498f-b270-285736cbca4f\" (UID: \"5448cdae-b466-498f-b270-285736cbca4f\") " Jul 08 23:13:04.792527 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:13:04.792489 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5448cdae-b466-498f-b270-285736cbca4f-kube-api-access-nmkxj" (OuterVolumeSpecName: "kube-api-access-nmkxj") pod "5448cdae-b466-498f-b270-285736cbca4f" (UID: "5448cdae-b466-498f-b270-285736cbca4f"). InnerVolumeSpecName "kube-api-access-nmkxj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 23:13:04.792645 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:13:04.792631 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5448cdae-b466-498f-b270-285736cbca4f-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "5448cdae-b466-498f-b270-285736cbca4f" (UID: "5448cdae-b466-498f-b270-285736cbca4f"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 23:13:04.891846 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:13:04.891819 2574 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5448cdae-b466-498f-b270-285736cbca4f-webhook-cert\") on node \"ip-10-0-140-79.ec2.internal\" DevicePath \"\"" Jul 08 23:13:04.891846 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:13:04.891843 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nmkxj\" (UniqueName: \"kubernetes.io/projected/5448cdae-b466-498f-b270-285736cbca4f-kube-api-access-nmkxj\") on node \"ip-10-0-140-79.ec2.internal\" DevicePath \"\"" Jul 08 23:13:05.283325 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:13:05.283290 2574 generic.go:356] "Generic (PLEG): container finished" podID="5448cdae-b466-498f-b270-285736cbca4f" containerID="098c77d5cd99db26e6532c84eaa33dbd5c659ecba4aec5f45859bc8d2d9f6338" exitCode=0 Jul 08 23:13:05.283325 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:13:05.283329 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-d8957bd74-dq96d" Jul 08 23:13:05.283545 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:13:05.283376 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-d8957bd74-dq96d" event={"ID":"5448cdae-b466-498f-b270-285736cbca4f","Type":"ContainerDied","Data":"098c77d5cd99db26e6532c84eaa33dbd5c659ecba4aec5f45859bc8d2d9f6338"} Jul 08 23:13:05.283545 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:13:05.283427 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-d8957bd74-dq96d" event={"ID":"5448cdae-b466-498f-b270-285736cbca4f","Type":"ContainerDied","Data":"3357a245e1ea2ea59aa4ae36d87d9241b37aa059adbddf748b001f8278ef6933"} Jul 08 23:13:05.283545 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:13:05.283455 2574 scope.go:117] "RemoveContainer" containerID="098c77d5cd99db26e6532c84eaa33dbd5c659ecba4aec5f45859bc8d2d9f6338" Jul 08 23:13:05.292331 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:13:05.292303 2574 scope.go:117] "RemoveContainer" containerID="098c77d5cd99db26e6532c84eaa33dbd5c659ecba4aec5f45859bc8d2d9f6338" Jul 08 23:13:05.292592 ip-10-0-140-79 kubenswrapper[2574]: E0708 23:13:05.292572 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"098c77d5cd99db26e6532c84eaa33dbd5c659ecba4aec5f45859bc8d2d9f6338\": container with ID starting with 098c77d5cd99db26e6532c84eaa33dbd5c659ecba4aec5f45859bc8d2d9f6338 not found: ID does not exist" containerID="098c77d5cd99db26e6532c84eaa33dbd5c659ecba4aec5f45859bc8d2d9f6338" Jul 08 23:13:05.292656 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:13:05.292602 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"098c77d5cd99db26e6532c84eaa33dbd5c659ecba4aec5f45859bc8d2d9f6338"} err="failed to get container status \"098c77d5cd99db26e6532c84eaa33dbd5c659ecba4aec5f45859bc8d2d9f6338\": rpc error: code = NotFound desc = could not find container \"098c77d5cd99db26e6532c84eaa33dbd5c659ecba4aec5f45859bc8d2d9f6338\": container with ID starting with 098c77d5cd99db26e6532c84eaa33dbd5c659ecba4aec5f45859bc8d2d9f6338 not found: ID does not exist" Jul 08 23:13:05.303804 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:13:05.303780 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-d8957bd74-dq96d"] Jul 08 23:13:05.307819 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:13:05.307797 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-d8957bd74-dq96d"] Jul 08 23:13:06.480961 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:13:06.480925 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5448cdae-b466-498f-b270-285736cbca4f" path="/var/lib/kubelet/pods/5448cdae-b466-498f-b270-285736cbca4f/volumes" Jul 08 23:13:26.042834 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:13:26.042796 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-68s5n"] Jul 08 23:13:26.045114 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:13:26.043139 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5448cdae-b466-498f-b270-285736cbca4f" containerName="manager" Jul 08 23:13:26.045114 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:13:26.043151 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="5448cdae-b466-498f-b270-285736cbca4f" containerName="manager" Jul 08 23:13:26.045114 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:13:26.043230 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="5448cdae-b466-498f-b270-285736cbca4f" containerName="manager" Jul 08 23:13:26.046074 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:13:26.046052 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-68s5n" Jul 08 23:13:26.049204 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:13:26.049179 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 08 23:13:26.049335 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:13:26.049235 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-p5d2q\"" Jul 08 23:13:26.063794 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:13:26.063766 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-68s5n"] Jul 08 23:13:26.155822 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:13:26.155784 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/023c7065-2fac-4599-ac0b-858ff20cf426-plugins-config-volume\") pod \"payload-pre-processing-7964457696-68s5n\" (UID: \"023c7065-2fac-4599-ac0b-858ff20cf426\") " pod="openshift-ingress/payload-pre-processing-7964457696-68s5n" Jul 08 23:13:26.155822 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:13:26.155829 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwjng\" (UniqueName: \"kubernetes.io/projected/023c7065-2fac-4599-ac0b-858ff20cf426-kube-api-access-hwjng\") pod \"payload-pre-processing-7964457696-68s5n\" (UID: \"023c7065-2fac-4599-ac0b-858ff20cf426\") " pod="openshift-ingress/payload-pre-processing-7964457696-68s5n" Jul 08 23:13:26.256656 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:13:26.256617 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/023c7065-2fac-4599-ac0b-858ff20cf426-plugins-config-volume\") pod \"payload-pre-processing-7964457696-68s5n\" (UID: \"023c7065-2fac-4599-ac0b-858ff20cf426\") " pod="openshift-ingress/payload-pre-processing-7964457696-68s5n" Jul 08 23:13:26.256656 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:13:26.256665 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwjng\" (UniqueName: \"kubernetes.io/projected/023c7065-2fac-4599-ac0b-858ff20cf426-kube-api-access-hwjng\") pod \"payload-pre-processing-7964457696-68s5n\" (UID: \"023c7065-2fac-4599-ac0b-858ff20cf426\") " pod="openshift-ingress/payload-pre-processing-7964457696-68s5n" Jul 08 23:13:26.257277 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:13:26.257258 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/023c7065-2fac-4599-ac0b-858ff20cf426-plugins-config-volume\") pod \"payload-pre-processing-7964457696-68s5n\" (UID: \"023c7065-2fac-4599-ac0b-858ff20cf426\") " pod="openshift-ingress/payload-pre-processing-7964457696-68s5n" Jul 08 23:13:26.264657 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:13:26.264630 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwjng\" (UniqueName: \"kubernetes.io/projected/023c7065-2fac-4599-ac0b-858ff20cf426-kube-api-access-hwjng\") pod \"payload-pre-processing-7964457696-68s5n\" (UID: \"023c7065-2fac-4599-ac0b-858ff20cf426\") " pod="openshift-ingress/payload-pre-processing-7964457696-68s5n" Jul 08 23:13:26.365496 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:13:26.365464 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-68s5n" Jul 08 23:13:26.490829 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:13:26.490805 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-68s5n"] Jul 08 23:13:26.492698 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:13:26.492662 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod023c7065_2fac_4599_ac0b_858ff20cf426.slice/crio-d2fecf9c0ad1f71c59094051b7a02297d21095752dc15e2b21dd916e072a7671 WatchSource:0}: Error finding container d2fecf9c0ad1f71c59094051b7a02297d21095752dc15e2b21dd916e072a7671: Status 404 returned error can't find the container with id d2fecf9c0ad1f71c59094051b7a02297d21095752dc15e2b21dd916e072a7671 Jul 08 23:13:27.390701 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:13:27.390664 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-68s5n" event={"ID":"023c7065-2fac-4599-ac0b-858ff20cf426","Type":"ContainerStarted","Data":"d2fecf9c0ad1f71c59094051b7a02297d21095752dc15e2b21dd916e072a7671"} Jul 08 23:13:28.397241 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:13:28.397201 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-68s5n" event={"ID":"023c7065-2fac-4599-ac0b-858ff20cf426","Type":"ContainerStarted","Data":"04bfd0c2d33cfe7fcc1bee3eafe3a098ca859aabd602c565a601bb995d9507f0"} Jul 08 23:13:28.397696 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:13:28.397301 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7964457696-68s5n" Jul 08 23:13:28.412689 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:13:28.412645 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7964457696-68s5n" podStartSLOduration=2.072825292 podStartE2EDuration="3.412630177s" totalImagesPullingTime="1.339804885s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:13:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:13:28.411730875 +0000 UTC m=+658.460004789" watchObservedRunningTime="2026-07-08 23:13:28.412630177 +0000 UTC m=+658.460904079" Jul 08 23:13:39.403652 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:13:39.403618 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7964457696-68s5n" Jul 08 23:13:51.506002 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:13:51.505966 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-sgk4c"] Jul 08 23:13:51.511262 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:13:51.511241 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sgk4c" Jul 08 23:13:51.513691 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:13:51.513663 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 08 23:13:51.514995 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:13:51.514974 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jul 08 23:13:51.515294 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:13:51.514999 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-6p7fv\"" Jul 08 23:13:51.515537 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:13:51.515053 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 08 23:13:51.517791 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:13:51.517768 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-sgk4c"] Jul 08 23:13:51.553635 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:13:51.553603 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/75c7334d-8d21-49e5-b928-32563cd3a311-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-sgk4c\" (UID: \"75c7334d-8d21-49e5-b928-32563cd3a311\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sgk4c" Jul 08 23:13:51.553775 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:13:51.553657 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/75c7334d-8d21-49e5-b928-32563cd3a311-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-sgk4c\" (UID: \"75c7334d-8d21-49e5-b928-32563cd3a311\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sgk4c" Jul 08 23:13:51.553775 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:13:51.553674 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/75c7334d-8d21-49e5-b928-32563cd3a311-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-sgk4c\" (UID: \"75c7334d-8d21-49e5-b928-32563cd3a311\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sgk4c" Jul 08 23:13:51.553775 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:13:51.553712 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/75c7334d-8d21-49e5-b928-32563cd3a311-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-sgk4c\" (UID: \"75c7334d-8d21-49e5-b928-32563cd3a311\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sgk4c" Jul 08 23:13:51.553897 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:13:51.553788 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jln8n\" (UniqueName: \"kubernetes.io/projected/75c7334d-8d21-49e5-b928-32563cd3a311-kube-api-access-jln8n\") pod \"e2e-distinct-simulated-kserve-59975d69f9-sgk4c\" (UID: \"75c7334d-8d21-49e5-b928-32563cd3a311\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sgk4c" Jul 08 23:13:51.553897 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:13:51.553837 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/75c7334d-8d21-49e5-b928-32563cd3a311-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-sgk4c\" (UID: \"75c7334d-8d21-49e5-b928-32563cd3a311\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sgk4c" Jul 08 23:13:51.654442 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:13:51.654408 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/75c7334d-8d21-49e5-b928-32563cd3a311-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-sgk4c\" (UID: \"75c7334d-8d21-49e5-b928-32563cd3a311\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sgk4c" Jul 08 23:13:51.654608 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:13:51.654466 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/75c7334d-8d21-49e5-b928-32563cd3a311-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-sgk4c\" (UID: \"75c7334d-8d21-49e5-b928-32563cd3a311\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sgk4c" Jul 08 23:13:51.654608 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:13:51.654486 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/75c7334d-8d21-49e5-b928-32563cd3a311-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-sgk4c\" (UID: \"75c7334d-8d21-49e5-b928-32563cd3a311\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sgk4c" Jul 08 23:13:51.654608 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:13:51.654500 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/75c7334d-8d21-49e5-b928-32563cd3a311-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-sgk4c\" (UID: \"75c7334d-8d21-49e5-b928-32563cd3a311\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sgk4c" Jul 08 23:13:51.654608 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:13:51.654556 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jln8n\" (UniqueName: \"kubernetes.io/projected/75c7334d-8d21-49e5-b928-32563cd3a311-kube-api-access-jln8n\") pod \"e2e-distinct-simulated-kserve-59975d69f9-sgk4c\" (UID: \"75c7334d-8d21-49e5-b928-32563cd3a311\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sgk4c" Jul 08 23:13:51.654608 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:13:51.654600 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/75c7334d-8d21-49e5-b928-32563cd3a311-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-sgk4c\" (UID: \"75c7334d-8d21-49e5-b928-32563cd3a311\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sgk4c" Jul 08 23:13:51.654957 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:13:51.654925 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/75c7334d-8d21-49e5-b928-32563cd3a311-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-sgk4c\" (UID: \"75c7334d-8d21-49e5-b928-32563cd3a311\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sgk4c" Jul 08 23:13:51.655028 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:13:51.654953 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/75c7334d-8d21-49e5-b928-32563cd3a311-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-sgk4c\" (UID: \"75c7334d-8d21-49e5-b928-32563cd3a311\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sgk4c" Jul 08 23:13:51.655028 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:13:51.654986 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/75c7334d-8d21-49e5-b928-32563cd3a311-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-sgk4c\" (UID: \"75c7334d-8d21-49e5-b928-32563cd3a311\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sgk4c" Jul 08 23:13:51.656768 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:13:51.656749 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/75c7334d-8d21-49e5-b928-32563cd3a311-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-sgk4c\" (UID: \"75c7334d-8d21-49e5-b928-32563cd3a311\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sgk4c" Jul 08 23:13:51.656959 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:13:51.656938 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/75c7334d-8d21-49e5-b928-32563cd3a311-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-sgk4c\" (UID: \"75c7334d-8d21-49e5-b928-32563cd3a311\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sgk4c" Jul 08 23:13:51.668269 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:13:51.668248 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jln8n\" (UniqueName: \"kubernetes.io/projected/75c7334d-8d21-49e5-b928-32563cd3a311-kube-api-access-jln8n\") pod \"e2e-distinct-simulated-kserve-59975d69f9-sgk4c\" (UID: \"75c7334d-8d21-49e5-b928-32563cd3a311\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sgk4c" Jul 08 23:13:51.823327 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:13:51.823300 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sgk4c" Jul 08 23:13:51.967798 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:13:51.967467 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-sgk4c"] Jul 08 23:13:51.969822 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:13:51.969796 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75c7334d_8d21_49e5_b928_32563cd3a311.slice/crio-036d797dcc3e2c2d14a38cd4def879c8b1cfdf3bdc83f57af55da998d6c9e6d3 WatchSource:0}: Error finding container 036d797dcc3e2c2d14a38cd4def879c8b1cfdf3bdc83f57af55da998d6c9e6d3: Status 404 returned error can't find the container with id 036d797dcc3e2c2d14a38cd4def879c8b1cfdf3bdc83f57af55da998d6c9e6d3 Jul 08 23:13:51.971277 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:13:51.971258 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 08 23:13:52.509541 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:13:52.509490 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sgk4c" event={"ID":"75c7334d-8d21-49e5-b928-32563cd3a311","Type":"ContainerStarted","Data":"036d797dcc3e2c2d14a38cd4def879c8b1cfdf3bdc83f57af55da998d6c9e6d3"} Jul 08 23:13:53.516124 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:13:53.516090 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sgk4c" event={"ID":"75c7334d-8d21-49e5-b928-32563cd3a311","Type":"ContainerStarted","Data":"a5d73d3ccefeeb9ba0350bd81b47e8a741ec1680ca5eabf4c11809585f75e20e"} Jul 08 23:13:53.534091 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:13:53.534041 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sgk4c" podStartSLOduration=1.490164853 podStartE2EDuration="2.534026892s" totalImagesPullingTime="1.043862039s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:13:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:13:53.532694659 +0000 UTC m=+683.580968563" watchObservedRunningTime="2026-07-08 23:13:53.534026892 +0000 UTC m=+683.582300795" Jul 08 23:14:01.396742 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:14:01.396704 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-6c9hs"] Jul 08 23:14:01.400336 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:14:01.400314 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6c9hs" Jul 08 23:14:01.402876 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:14:01.402854 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 08 23:14:01.411851 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:14:01.411826 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-6c9hs"] Jul 08 23:14:01.434293 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:14:01.434267 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjnbn\" (UniqueName: \"kubernetes.io/projected/87064063-47ad-4a56-939a-646c7affa77a-kube-api-access-mjnbn\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6c9hs\" (UID: \"87064063-47ad-4a56-939a-646c7affa77a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6c9hs" Jul 08 23:14:01.434382 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:14:01.434303 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/87064063-47ad-4a56-939a-646c7affa77a-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6c9hs\" (UID: \"87064063-47ad-4a56-939a-646c7affa77a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6c9hs" Jul 08 23:14:01.434382 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:14:01.434322 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/87064063-47ad-4a56-939a-646c7affa77a-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6c9hs\" (UID: \"87064063-47ad-4a56-939a-646c7affa77a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6c9hs" Jul 08 23:14:01.434451 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:14:01.434380 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/87064063-47ad-4a56-939a-646c7affa77a-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6c9hs\" (UID: \"87064063-47ad-4a56-939a-646c7affa77a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6c9hs" Jul 08 23:14:01.434451 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:14:01.434433 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/87064063-47ad-4a56-939a-646c7affa77a-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6c9hs\" (UID: \"87064063-47ad-4a56-939a-646c7affa77a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6c9hs" Jul 08 23:14:01.434540 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:14:01.434471 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/87064063-47ad-4a56-939a-646c7affa77a-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6c9hs\" (UID: \"87064063-47ad-4a56-939a-646c7affa77a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6c9hs" Jul 08 23:14:01.535322 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:14:01.535288 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjnbn\" (UniqueName: \"kubernetes.io/projected/87064063-47ad-4a56-939a-646c7affa77a-kube-api-access-mjnbn\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6c9hs\" (UID: \"87064063-47ad-4a56-939a-646c7affa77a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6c9hs" Jul 08 23:14:01.535482 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:14:01.535329 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/87064063-47ad-4a56-939a-646c7affa77a-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6c9hs\" (UID: \"87064063-47ad-4a56-939a-646c7affa77a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6c9hs" Jul 08 23:14:01.535482 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:14:01.535347 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/87064063-47ad-4a56-939a-646c7affa77a-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6c9hs\" (UID: \"87064063-47ad-4a56-939a-646c7affa77a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6c9hs" Jul 08 23:14:01.535482 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:14:01.535364 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/87064063-47ad-4a56-939a-646c7affa77a-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6c9hs\" (UID: \"87064063-47ad-4a56-939a-646c7affa77a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6c9hs" Jul 08 23:14:01.535482 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:14:01.535384 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/87064063-47ad-4a56-939a-646c7affa77a-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6c9hs\" (UID: \"87064063-47ad-4a56-939a-646c7affa77a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6c9hs" Jul 08 23:14:01.535482 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:14:01.535414 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/87064063-47ad-4a56-939a-646c7affa77a-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6c9hs\" (UID: \"87064063-47ad-4a56-939a-646c7affa77a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6c9hs" Jul 08 23:14:01.535927 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:14:01.535898 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/87064063-47ad-4a56-939a-646c7affa77a-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6c9hs\" (UID: \"87064063-47ad-4a56-939a-646c7affa77a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6c9hs" Jul 08 23:14:01.535999 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:14:01.535906 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/87064063-47ad-4a56-939a-646c7affa77a-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6c9hs\" (UID: \"87064063-47ad-4a56-939a-646c7affa77a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6c9hs" Jul 08 23:14:01.536046 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:14:01.536000 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/87064063-47ad-4a56-939a-646c7affa77a-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6c9hs\" (UID: \"87064063-47ad-4a56-939a-646c7affa77a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6c9hs" Jul 08 23:14:01.537558 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:14:01.537537 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/87064063-47ad-4a56-939a-646c7affa77a-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6c9hs\" (UID: \"87064063-47ad-4a56-939a-646c7affa77a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6c9hs" Jul 08 23:14:01.537822 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:14:01.537806 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/87064063-47ad-4a56-939a-646c7affa77a-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6c9hs\" (UID: \"87064063-47ad-4a56-939a-646c7affa77a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6c9hs" Jul 08 23:14:01.549162 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:14:01.549133 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjnbn\" (UniqueName: \"kubernetes.io/projected/87064063-47ad-4a56-939a-646c7affa77a-kube-api-access-mjnbn\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6c9hs\" (UID: \"87064063-47ad-4a56-939a-646c7affa77a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6c9hs" Jul 08 23:14:01.710628 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:14:01.710548 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6c9hs" Jul 08 23:14:01.824256 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:14:01.824223 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sgk4c" Jul 08 23:14:01.824389 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:14:01.824305 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sgk4c" Jul 08 23:14:01.836589 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:14:01.836565 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sgk4c" Jul 08 23:14:01.843000 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:14:01.842979 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-6c9hs"] Jul 08 23:14:01.845358 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:14:01.845331 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87064063_47ad_4a56_939a_646c7affa77a.slice/crio-1a69a8ed36f3b02cb6c1b1372bed1bcde71c5bf92d1a878816afafff9e491ac1 WatchSource:0}: Error finding container 1a69a8ed36f3b02cb6c1b1372bed1bcde71c5bf92d1a878816afafff9e491ac1: Status 404 returned error can't find the container with id 1a69a8ed36f3b02cb6c1b1372bed1bcde71c5bf92d1a878816afafff9e491ac1 Jul 08 23:14:02.556932 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:14:02.556885 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6c9hs" event={"ID":"87064063-47ad-4a56-939a-646c7affa77a","Type":"ContainerStarted","Data":"f5535c62afa0f8ac021945b7f16385afcc69a89e3724462ad7776e4d9b736085"} Jul 08 23:14:02.557317 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:14:02.556939 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6c9hs" event={"ID":"87064063-47ad-4a56-939a-646c7affa77a","Type":"ContainerStarted","Data":"1a69a8ed36f3b02cb6c1b1372bed1bcde71c5bf92d1a878816afafff9e491ac1"} Jul 08 23:14:02.568596 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:14:02.568574 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sgk4c" Jul 08 23:14:02.580243 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:14:02.580203 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6c9hs" podStartSLOduration=1.4075568330000001 podStartE2EDuration="1.580189054s" totalImagesPullingTime="172.632221ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:14:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:14:02.578326814 +0000 UTC m=+692.626600728" watchObservedRunningTime="2026-07-08 23:14:02.580189054 +0000 UTC m=+692.628462990" Jul 08 23:14:07.696572 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:14:07.696534 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhtdqt"] Jul 08 23:14:07.700290 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:14:07.700270 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhtdqt" Jul 08 23:14:07.703832 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:14:07.703812 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jul 08 23:14:07.712389 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:14:07.712369 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhtdqt"] Jul 08 23:14:07.789287 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:14:07.789252 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6cee344d-a856-45de-b3a4-9efc050de2bc-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhtdqt\" (UID: \"6cee344d-a856-45de-b3a4-9efc050de2bc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhtdqt" Jul 08 23:14:07.789455 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:14:07.789295 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6cee344d-a856-45de-b3a4-9efc050de2bc-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhtdqt\" (UID: \"6cee344d-a856-45de-b3a4-9efc050de2bc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhtdqt" Jul 08 23:14:07.789455 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:14:07.789352 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6cee344d-a856-45de-b3a4-9efc050de2bc-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhtdqt\" (UID: \"6cee344d-a856-45de-b3a4-9efc050de2bc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhtdqt" Jul 08 23:14:07.789455 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:14:07.789380 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p5g6x\" (UniqueName: \"kubernetes.io/projected/6cee344d-a856-45de-b3a4-9efc050de2bc-kube-api-access-p5g6x\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhtdqt\" (UID: \"6cee344d-a856-45de-b3a4-9efc050de2bc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhtdqt" Jul 08 23:14:07.789455 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:14:07.789441 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6cee344d-a856-45de-b3a4-9efc050de2bc-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhtdqt\" (UID: \"6cee344d-a856-45de-b3a4-9efc050de2bc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhtdqt" Jul 08 23:14:07.789637 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:14:07.789455 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6cee344d-a856-45de-b3a4-9efc050de2bc-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhtdqt\" (UID: \"6cee344d-a856-45de-b3a4-9efc050de2bc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhtdqt" Jul 08 23:14:07.890888 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:14:07.890853 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5g6x\" (UniqueName: \"kubernetes.io/projected/6cee344d-a856-45de-b3a4-9efc050de2bc-kube-api-access-p5g6x\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhtdqt\" (UID: \"6cee344d-a856-45de-b3a4-9efc050de2bc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhtdqt" Jul 08 23:14:07.891082 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:14:07.890907 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6cee344d-a856-45de-b3a4-9efc050de2bc-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhtdqt\" (UID: \"6cee344d-a856-45de-b3a4-9efc050de2bc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhtdqt" Jul 08 23:14:07.891082 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:14:07.890926 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6cee344d-a856-45de-b3a4-9efc050de2bc-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhtdqt\" (UID: \"6cee344d-a856-45de-b3a4-9efc050de2bc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhtdqt" Jul 08 23:14:07.891082 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:14:07.890960 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6cee344d-a856-45de-b3a4-9efc050de2bc-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhtdqt\" (UID: \"6cee344d-a856-45de-b3a4-9efc050de2bc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhtdqt" Jul 08 23:14:07.891082 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:14:07.890980 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6cee344d-a856-45de-b3a4-9efc050de2bc-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhtdqt\" (UID: \"6cee344d-a856-45de-b3a4-9efc050de2bc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhtdqt" Jul 08 23:14:07.891082 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:14:07.891004 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6cee344d-a856-45de-b3a4-9efc050de2bc-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhtdqt\" (UID: \"6cee344d-a856-45de-b3a4-9efc050de2bc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhtdqt" Jul 08 23:14:07.891329 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:14:07.891280 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6cee344d-a856-45de-b3a4-9efc050de2bc-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhtdqt\" (UID: \"6cee344d-a856-45de-b3a4-9efc050de2bc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhtdqt" Jul 08 23:14:07.891382 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:14:07.891358 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6cee344d-a856-45de-b3a4-9efc050de2bc-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhtdqt\" (UID: \"6cee344d-a856-45de-b3a4-9efc050de2bc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhtdqt" Jul 08 23:14:07.891418 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:14:07.891387 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6cee344d-a856-45de-b3a4-9efc050de2bc-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhtdqt\" (UID: \"6cee344d-a856-45de-b3a4-9efc050de2bc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhtdqt" Jul 08 23:14:07.893382 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:14:07.893348 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6cee344d-a856-45de-b3a4-9efc050de2bc-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhtdqt\" (UID: \"6cee344d-a856-45de-b3a4-9efc050de2bc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhtdqt" Jul 08 23:14:07.893489 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:14:07.893477 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6cee344d-a856-45de-b3a4-9efc050de2bc-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhtdqt\" (UID: \"6cee344d-a856-45de-b3a4-9efc050de2bc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhtdqt" Jul 08 23:14:07.898288 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:14:07.898266 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p5g6x\" (UniqueName: \"kubernetes.io/projected/6cee344d-a856-45de-b3a4-9efc050de2bc-kube-api-access-p5g6x\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhtdqt\" (UID: \"6cee344d-a856-45de-b3a4-9efc050de2bc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhtdqt" Jul 08 23:14:08.012005 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:14:08.011940 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhtdqt" Jul 08 23:14:08.139081 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:14:08.139040 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhtdqt"] Jul 08 23:14:08.141901 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:14:08.141873 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cee344d_a856_45de_b3a4_9efc050de2bc.slice/crio-81f300cddf78dc9e4db9e061078cb816bad1523baafa2f55bb8467e376fb8867 WatchSource:0}: Error finding container 81f300cddf78dc9e4db9e061078cb816bad1523baafa2f55bb8467e376fb8867: Status 404 returned error can't find the container with id 81f300cddf78dc9e4db9e061078cb816bad1523baafa2f55bb8467e376fb8867 Jul 08 23:14:08.586793 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:14:08.586759 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhtdqt" event={"ID":"6cee344d-a856-45de-b3a4-9efc050de2bc","Type":"ContainerStarted","Data":"5761dde19302a82436d7a9e2a3eee39912f43e284d4c375d6089451075725ee7"} Jul 08 23:14:08.586969 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:14:08.586804 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhtdqt" event={"ID":"6cee344d-a856-45de-b3a4-9efc050de2bc","Type":"ContainerStarted","Data":"81f300cddf78dc9e4db9e061078cb816bad1523baafa2f55bb8467e376fb8867"} Jul 08 23:14:08.603105 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:14:08.603022 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhtdqt" podStartSLOduration=1.402317387 podStartE2EDuration="1.603006185s" totalImagesPullingTime="200.688798ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:14:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:14:08.601866907 +0000 UTC m=+698.650140812" watchObservedRunningTime="2026-07-08 23:14:08.603006185 +0000 UTC m=+698.651280088" Jul 08 23:14:11.711123 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:14:11.711086 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6c9hs" Jul 08 23:14:11.711619 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:14:11.711148 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6c9hs" Jul 08 23:14:11.723727 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:14:11.723699 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6c9hs" Jul 08 23:14:12.616098 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:14:12.616068 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6c9hs" Jul 08 23:14:18.012889 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:14:18.012850 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhtdqt" Jul 08 23:14:18.013267 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:14:18.012931 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhtdqt" Jul 08 23:14:18.025267 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:14:18.025246 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhtdqt" Jul 08 23:14:18.643824 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:14:18.643794 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhtdqt" Jul 08 23:17:30.434377 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:17:30.434298 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-b7vhr_820d35fb-fba2-4328-9e2b-0874474cb416/console-operator/2.log" Jul 08 23:17:30.435898 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:17:30.435874 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-b7vhr_820d35fb-fba2-4328-9e2b-0874474cb416/console-operator/2.log" Jul 08 23:17:30.438912 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:17:30.438889 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8mcjt_82783d98-33c2-4050-b38f-5ba0a9701953/ovn-acl-logging/0.log" Jul 08 23:17:30.440191 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:17:30.440172 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8mcjt_82783d98-33c2-4050-b38f-5ba0a9701953/ovn-acl-logging/0.log" Jul 08 23:22:30.465004 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:22:30.464971 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-b7vhr_820d35fb-fba2-4328-9e2b-0874474cb416/console-operator/2.log" Jul 08 23:22:30.465903 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:22:30.465874 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-b7vhr_820d35fb-fba2-4328-9e2b-0874474cb416/console-operator/2.log" Jul 08 23:22:30.469293 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:22:30.469261 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8mcjt_82783d98-33c2-4050-b38f-5ba0a9701953/ovn-acl-logging/0.log" Jul 08 23:22:30.470138 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:22:30.470121 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8mcjt_82783d98-33c2-4050-b38f-5ba0a9701953/ovn-acl-logging/0.log" Jul 08 23:27:30.495013 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:27:30.494980 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-b7vhr_820d35fb-fba2-4328-9e2b-0874474cb416/console-operator/2.log" Jul 08 23:27:30.498235 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:27:30.498210 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-b7vhr_820d35fb-fba2-4328-9e2b-0874474cb416/console-operator/2.log" Jul 08 23:27:30.498977 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:27:30.498962 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8mcjt_82783d98-33c2-4050-b38f-5ba0a9701953/ovn-acl-logging/0.log" Jul 08 23:27:30.502337 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:27:30.502319 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8mcjt_82783d98-33c2-4050-b38f-5ba0a9701953/ovn-acl-logging/0.log" Jul 08 23:32:30.521887 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:32:30.521858 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-b7vhr_820d35fb-fba2-4328-9e2b-0874474cb416/console-operator/2.log" Jul 08 23:32:30.525883 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:32:30.525865 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8mcjt_82783d98-33c2-4050-b38f-5ba0a9701953/ovn-acl-logging/0.log" Jul 08 23:32:30.526004 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:32:30.525893 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-b7vhr_820d35fb-fba2-4328-9e2b-0874474cb416/console-operator/2.log" Jul 08 23:32:30.530270 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:32:30.530251 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8mcjt_82783d98-33c2-4050-b38f-5ba0a9701953/ovn-acl-logging/0.log" Jul 08 23:37:30.557169 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:37:30.557140 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-b7vhr_820d35fb-fba2-4328-9e2b-0874474cb416/console-operator/2.log" Jul 08 23:37:30.560213 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:37:30.560188 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-b7vhr_820d35fb-fba2-4328-9e2b-0874474cb416/console-operator/2.log" Jul 08 23:37:30.564048 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:37:30.564029 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8mcjt_82783d98-33c2-4050-b38f-5ba0a9701953/ovn-acl-logging/0.log" Jul 08 23:37:30.567550 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:37:30.567529 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8mcjt_82783d98-33c2-4050-b38f-5ba0a9701953/ovn-acl-logging/0.log" Jul 08 23:42:30.589280 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:42:30.589242 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-b7vhr_820d35fb-fba2-4328-9e2b-0874474cb416/console-operator/2.log" Jul 08 23:42:30.593493 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:42:30.593469 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8mcjt_82783d98-33c2-4050-b38f-5ba0a9701953/ovn-acl-logging/0.log" Jul 08 23:42:30.594014 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:42:30.593998 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-b7vhr_820d35fb-fba2-4328-9e2b-0874474cb416/console-operator/2.log" Jul 08 23:42:30.597948 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:42:30.597930 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8mcjt_82783d98-33c2-4050-b38f-5ba0a9701953/ovn-acl-logging/0.log" Jul 08 23:43:31.015157 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:43:31.015073 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-9ll2q_26708738-9177-4a84-8c5c-6c8f4b8ba622/manager/0.log" Jul 08 23:43:31.130700 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:43:31.130659 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-pm788_7ac850fc-87e7-4c22-b422-291fe95524c1/manager/0.log" Jul 08 23:43:31.359641 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:43:31.359614 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-kvgws_5c73bea0-88de-4537-b136-e4d0780fa5b9/server/0.log" Jul 08 23:43:31.711883 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:43:31.711811 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-ccc7894f9-q6lkd_8c4463f3-70e5-4588-b8ae-79e9f6ea80e3/copy-manifests/0.log" Jul 08 23:43:31.718791 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:43:31.718760 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-ccc7894f9-q6lkd_8c4463f3-70e5-4588-b8ae-79e9f6ea80e3/manager/0.log" Jul 08 23:43:34.348721 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:43:34.348688 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-65mlz_83a022ab-11c0-4bed-ba41-8704b770e9d7/manager/0.log" Jul 08 23:43:34.809210 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:43:34.809178 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-c5b2r_f6f973e6-e403-47c5-8870-822dbc0020a3/discovery/0.log" Jul 08 23:43:35.028480 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:43:35.028455 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7dc6c875b-zsqc7_9703bd00-80a1-4b43-bb4f-79f098a13b13/kube-auth-proxy/0.log" Jul 08 23:43:35.279681 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:43:35.279609 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-68s5n_023c7065-2fac-4599-ac0b-858ff20cf426/payload-pre-processing/0.log" Jul 08 23:43:35.509803 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:43:35.509770 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7c85f98b97-bnhrb_2edaad22-d491-4a9c-ae1f-eb9f87b42986/router/0.log" Jul 08 23:43:35.965625 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:43:35.965591 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-sgk4c_75c7334d-8d21-49e5-b928-32563cd3a311/main/0.log" Jul 08 23:43:36.078871 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:43:36.078841 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-6c9hs_87064063-47ad-4a56-939a-646c7affa77a/main/0.log" Jul 08 23:43:36.194794 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:43:36.194756 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhtdqt_6cee344d-a856-45de-b3a4-9efc050de2bc/main/0.log" Jul 08 23:43:43.127011 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:43:43.126979 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-gggnj_da74ec55-7cda-4f1a-ba6d-0b4222b5fcb5/global-pull-secret-syncer/0.log" Jul 08 23:43:43.257551 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:43:43.257503 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-tmmqj_b8a428fb-e40d-437f-ae4d-ecd7141e03a5/konnectivity-agent/0.log" Jul 08 23:43:43.365754 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:43:43.365722 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-79.ec2.internal_8e8c734951fb463aee77d0849d578390/haproxy/0.log" Jul 08 23:43:48.850565 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:43:48.850527 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-65mlz_83a022ab-11c0-4bed-ba41-8704b770e9d7/manager/0.log" Jul 08 23:43:50.823005 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:43:50.822975 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-h5zzc_e4f8810f-3199-4a12-9f3e-696df87448d4/cluster-monitoring-operator/0.log" Jul 08 23:43:51.093588 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:43:51.093497 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pxcdw_aff11bc5-0c86-427d-b5de-f2bad619281d/node-exporter/0.log" Jul 08 23:43:51.117528 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:43:51.117498 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pxcdw_aff11bc5-0c86-427d-b5de-f2bad619281d/kube-rbac-proxy/0.log" Jul 08 23:43:51.140281 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:43:51.140261 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pxcdw_aff11bc5-0c86-427d-b5de-f2bad619281d/init-textfile/0.log" Jul 08 23:43:51.552115 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:43:51.552086 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-d559d66d5-nwn2r_ef5fa55d-c531-415a-a836-f0e829d11692/prometheus-operator-admission-webhook/0.log" Jul 08 23:43:52.947731 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:43:52.947701 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6bffdf9778-s5dnv_55cfa647-c40e-4556-b295-ad4fb60fde44/networking-console-plugin/0.log" Jul 08 23:43:53.116826 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:43:53.116797 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-rlvz5/perf-node-gather-daemonset-j7dlw"] Jul 08 23:43:53.120269 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:43:53.120249 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rlvz5/perf-node-gather-daemonset-j7dlw" Jul 08 23:43:53.124634 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:43:53.124617 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-rlvz5\"/\"default-dockercfg-hrrrl\"" Jul 08 23:43:53.124737 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:43:53.124722 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-rlvz5\"/\"kube-root-ca.crt\"" Jul 08 23:43:53.125789 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:43:53.125770 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-rlvz5\"/\"openshift-service-ca.crt\"" Jul 08 23:43:53.132689 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:43:53.132670 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rlvz5/perf-node-gather-daemonset-j7dlw"] Jul 08 23:43:53.252131 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:43:53.252053 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6fa0abd2-fbe9-4460-ae7b-8dda9b808f0b-podres\") pod \"perf-node-gather-daemonset-j7dlw\" (UID: \"6fa0abd2-fbe9-4460-ae7b-8dda9b808f0b\") " pod="openshift-must-gather-rlvz5/perf-node-gather-daemonset-j7dlw" Jul 08 23:43:53.252131 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:43:53.252122 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mhnlp\" (UniqueName: \"kubernetes.io/projected/6fa0abd2-fbe9-4460-ae7b-8dda9b808f0b-kube-api-access-mhnlp\") pod \"perf-node-gather-daemonset-j7dlw\" (UID: \"6fa0abd2-fbe9-4460-ae7b-8dda9b808f0b\") " pod="openshift-must-gather-rlvz5/perf-node-gather-daemonset-j7dlw" Jul 08 23:43:53.252287 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:43:53.252158 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6fa0abd2-fbe9-4460-ae7b-8dda9b808f0b-lib-modules\") pod \"perf-node-gather-daemonset-j7dlw\" (UID: \"6fa0abd2-fbe9-4460-ae7b-8dda9b808f0b\") " pod="openshift-must-gather-rlvz5/perf-node-gather-daemonset-j7dlw" Jul 08 23:43:53.252287 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:43:53.252219 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6fa0abd2-fbe9-4460-ae7b-8dda9b808f0b-proc\") pod \"perf-node-gather-daemonset-j7dlw\" (UID: \"6fa0abd2-fbe9-4460-ae7b-8dda9b808f0b\") " pod="openshift-must-gather-rlvz5/perf-node-gather-daemonset-j7dlw" Jul 08 23:43:53.252287 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:43:53.252236 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6fa0abd2-fbe9-4460-ae7b-8dda9b808f0b-sys\") pod \"perf-node-gather-daemonset-j7dlw\" (UID: \"6fa0abd2-fbe9-4460-ae7b-8dda9b808f0b\") " pod="openshift-must-gather-rlvz5/perf-node-gather-daemonset-j7dlw" Jul 08 23:43:53.353069 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:43:53.353039 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhnlp\" (UniqueName: \"kubernetes.io/projected/6fa0abd2-fbe9-4460-ae7b-8dda9b808f0b-kube-api-access-mhnlp\") pod \"perf-node-gather-daemonset-j7dlw\" (UID: \"6fa0abd2-fbe9-4460-ae7b-8dda9b808f0b\") " pod="openshift-must-gather-rlvz5/perf-node-gather-daemonset-j7dlw" Jul 08 23:43:53.353187 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:43:53.353078 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6fa0abd2-fbe9-4460-ae7b-8dda9b808f0b-lib-modules\") pod \"perf-node-gather-daemonset-j7dlw\" (UID: \"6fa0abd2-fbe9-4460-ae7b-8dda9b808f0b\") " pod="openshift-must-gather-rlvz5/perf-node-gather-daemonset-j7dlw" Jul 08 23:43:53.353187 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:43:53.353118 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6fa0abd2-fbe9-4460-ae7b-8dda9b808f0b-proc\") pod \"perf-node-gather-daemonset-j7dlw\" (UID: \"6fa0abd2-fbe9-4460-ae7b-8dda9b808f0b\") " pod="openshift-must-gather-rlvz5/perf-node-gather-daemonset-j7dlw" Jul 08 23:43:53.353187 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:43:53.353137 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6fa0abd2-fbe9-4460-ae7b-8dda9b808f0b-sys\") pod \"perf-node-gather-daemonset-j7dlw\" (UID: \"6fa0abd2-fbe9-4460-ae7b-8dda9b808f0b\") " pod="openshift-must-gather-rlvz5/perf-node-gather-daemonset-j7dlw" Jul 08 23:43:53.353187 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:43:53.353163 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6fa0abd2-fbe9-4460-ae7b-8dda9b808f0b-podres\") pod \"perf-node-gather-daemonset-j7dlw\" (UID: \"6fa0abd2-fbe9-4460-ae7b-8dda9b808f0b\") " pod="openshift-must-gather-rlvz5/perf-node-gather-daemonset-j7dlw" Jul 08 23:43:53.353335 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:43:53.353234 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6fa0abd2-fbe9-4460-ae7b-8dda9b808f0b-proc\") pod \"perf-node-gather-daemonset-j7dlw\" (UID: \"6fa0abd2-fbe9-4460-ae7b-8dda9b808f0b\") " pod="openshift-must-gather-rlvz5/perf-node-gather-daemonset-j7dlw" Jul 08 23:43:53.353335 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:43:53.353255 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6fa0abd2-fbe9-4460-ae7b-8dda9b808f0b-sys\") pod \"perf-node-gather-daemonset-j7dlw\" (UID: \"6fa0abd2-fbe9-4460-ae7b-8dda9b808f0b\") " pod="openshift-must-gather-rlvz5/perf-node-gather-daemonset-j7dlw" Jul 08 23:43:53.353335 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:43:53.353293 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6fa0abd2-fbe9-4460-ae7b-8dda9b808f0b-podres\") pod \"perf-node-gather-daemonset-j7dlw\" (UID: \"6fa0abd2-fbe9-4460-ae7b-8dda9b808f0b\") " pod="openshift-must-gather-rlvz5/perf-node-gather-daemonset-j7dlw" Jul 08 23:43:53.353335 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:43:53.353305 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6fa0abd2-fbe9-4460-ae7b-8dda9b808f0b-lib-modules\") pod \"perf-node-gather-daemonset-j7dlw\" (UID: \"6fa0abd2-fbe9-4460-ae7b-8dda9b808f0b\") " pod="openshift-must-gather-rlvz5/perf-node-gather-daemonset-j7dlw" Jul 08 23:43:53.361345 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:43:53.361321 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mhnlp\" (UniqueName: \"kubernetes.io/projected/6fa0abd2-fbe9-4460-ae7b-8dda9b808f0b-kube-api-access-mhnlp\") pod \"perf-node-gather-daemonset-j7dlw\" (UID: \"6fa0abd2-fbe9-4460-ae7b-8dda9b808f0b\") " pod="openshift-must-gather-rlvz5/perf-node-gather-daemonset-j7dlw" Jul 08 23:43:53.430344 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:43:53.430318 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rlvz5/perf-node-gather-daemonset-j7dlw" Jul 08 23:43:53.564060 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:43:53.564029 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rlvz5/perf-node-gather-daemonset-j7dlw"] Jul 08 23:43:53.567642 ip-10-0-140-79 kubenswrapper[2574]: W0708 23:43:53.567613 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod6fa0abd2_fbe9_4460_ae7b_8dda9b808f0b.slice/crio-011b9836fe01c653e3490fe5232b93d46c7deef43420471d62c4782dc65a1619 WatchSource:0}: Error finding container 011b9836fe01c653e3490fe5232b93d46c7deef43420471d62c4782dc65a1619: Status 404 returned error can't find the container with id 011b9836fe01c653e3490fe5232b93d46c7deef43420471d62c4782dc65a1619 Jul 08 23:43:53.604046 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:43:53.604015 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-b7vhr_820d35fb-fba2-4328-9e2b-0874474cb416/console-operator/2.log" Jul 08 23:43:53.609418 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:43:53.609392 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-b7vhr_820d35fb-fba2-4328-9e2b-0874474cb416/console-operator/3.log" Jul 08 23:43:53.902432 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:43:53.902397 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rlvz5/perf-node-gather-daemonset-j7dlw" event={"ID":"6fa0abd2-fbe9-4460-ae7b-8dda9b808f0b","Type":"ContainerStarted","Data":"f3bf6b91f87e3e57c8e967c3476f2b99e057b53c7b82bf8c12032c8f1eb3f041"} Jul 08 23:43:53.902638 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:43:53.902469 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rlvz5/perf-node-gather-daemonset-j7dlw" event={"ID":"6fa0abd2-fbe9-4460-ae7b-8dda9b808f0b","Type":"ContainerStarted","Data":"011b9836fe01c653e3490fe5232b93d46c7deef43420471d62c4782dc65a1619"} Jul 08 23:43:53.902638 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:43:53.902552 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-rlvz5/perf-node-gather-daemonset-j7dlw" Jul 08 23:43:53.919324 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:43:53.919279 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-rlvz5/perf-node-gather-daemonset-j7dlw" podStartSLOduration=0.919267699 podStartE2EDuration="919.267699ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 23:43:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:43:53.916986808 +0000 UTC m=+2483.965260710" watchObservedRunningTime="2026-07-08 23:43:53.919267699 +0000 UTC m=+2483.967541601" Jul 08 23:43:54.681631 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:43:54.681599 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5d456fdbcd-z56vz_61d74e97-1a73-4512-8b91-047aaae34a2d/volume-data-source-validator/0.log" Jul 08 23:43:55.831153 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:43:55.831114 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-pr92b_4798cc78-68f0-447d-8ac9-b4b71ee8801d/dns/0.log" Jul 08 23:43:55.857310 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:43:55.857288 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-pr92b_4798cc78-68f0-447d-8ac9-b4b71ee8801d/kube-rbac-proxy/0.log" Jul 08 23:43:55.885056 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:43:55.885031 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-b9mrk_025aa4fb-e602-4ca7-ab4d-982dbbfbea11/dns-node-resolver/0.log" Jul 08 23:43:56.548487 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:43:56.548458 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wkdzq_38442020-34ab-4cdf-a0e8-af93e6c046e1/node-ca/0.log" Jul 08 23:43:57.621930 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:43:57.621905 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-c5b2r_f6f973e6-e403-47c5-8870-822dbc0020a3/discovery/0.log" Jul 08 23:43:57.704670 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:43:57.704646 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7dc6c875b-zsqc7_9703bd00-80a1-4b43-bb4f-79f098a13b13/kube-auth-proxy/0.log" Jul 08 23:43:57.836523 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:43:57.836484 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-68s5n_023c7065-2fac-4599-ac0b-858ff20cf426/payload-pre-processing/0.log" Jul 08 23:43:57.966522 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:43:57.966431 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7c85f98b97-bnhrb_2edaad22-d491-4a9c-ae1f-eb9f87b42986/router/0.log" Jul 08 23:43:58.770140 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:43:58.770110 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-zknln_d8ceaaa0-c406-4ac5-9ff4-027bcdb1b508/serve-healthcheck-canary/0.log" Jul 08 23:43:59.244883 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:43:59.244849 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-wl687_4ed7b90f-7d34-4d31-b1fb-276d9906fc64/insights-operator/0.log" Jul 08 23:43:59.246691 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:43:59.246672 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-wl687_4ed7b90f-7d34-4d31-b1fb-276d9906fc64/insights-operator/1.log" Jul 08 23:43:59.342893 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:43:59.342870 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8mtw6_4e57d4ab-946f-4067-b9dd-8305e346e99b/kube-rbac-proxy/0.log" Jul 08 23:43:59.368891 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:43:59.368871 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8mtw6_4e57d4ab-946f-4067-b9dd-8305e346e99b/exporter/0.log" Jul 08 23:43:59.391632 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:43:59.391614 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8mtw6_4e57d4ab-946f-4067-b9dd-8305e346e99b/extractor/0.log" Jul 08 23:43:59.916369 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:43:59.916342 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-rlvz5/perf-node-gather-daemonset-j7dlw" Jul 08 23:44:01.688891 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:44:01.688860 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-9ll2q_26708738-9177-4a84-8c5c-6c8f4b8ba622/manager/0.log" Jul 08 23:44:01.820875 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:44:01.820842 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-pm788_7ac850fc-87e7-4c22-b422-291fe95524c1/manager/0.log" Jul 08 23:44:02.005173 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:44:02.005096 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-kvgws_5c73bea0-88de-4537-b136-e4d0780fa5b9/server/0.log" Jul 08 23:44:02.198893 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:44:02.198869 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-ccc7894f9-q6lkd_8c4463f3-70e5-4588-b8ae-79e9f6ea80e3/manager/0.log" Jul 08 23:44:02.220320 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:44:02.220301 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-ccc7894f9-q6lkd_8c4463f3-70e5-4588-b8ae-79e9f6ea80e3/copy-manifests/0.log" Jul 08 23:44:03.393869 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:44:03.393840 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-c5b2r_f6f973e6-e403-47c5-8870-822dbc0020a3/discovery/0.log" Jul 08 23:44:03.418055 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:44:03.418025 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7dc6c875b-zsqc7_9703bd00-80a1-4b43-bb4f-79f098a13b13/kube-auth-proxy/0.log" Jul 08 23:44:03.504619 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:44:03.504590 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-68s5n_023c7065-2fac-4599-ac0b-858ff20cf426/payload-pre-processing/0.log" Jul 08 23:44:03.592728 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:44:03.592706 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7c85f98b97-bnhrb_2edaad22-d491-4a9c-ae1f-eb9f87b42986/router/0.log" Jul 08 23:44:04.853130 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:44:04.853097 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-c5b2r_f6f973e6-e403-47c5-8870-822dbc0020a3/discovery/0.log" Jul 08 23:44:04.883609 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:44:04.883536 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7dc6c875b-zsqc7_9703bd00-80a1-4b43-bb4f-79f098a13b13/kube-auth-proxy/0.log" Jul 08 23:44:04.970900 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:44:04.970877 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-68s5n_023c7065-2fac-4599-ac0b-858ff20cf426/payload-pre-processing/0.log" Jul 08 23:44:05.072735 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:44:05.072710 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7c85f98b97-bnhrb_2edaad22-d491-4a9c-ae1f-eb9f87b42986/router/0.log" Jul 08 23:44:08.711745 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:44:08.711725 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-lbf4d_7af8cd0a-2c59-4ccb-87ce-80ca8c8809a6/migrator/0.log" Jul 08 23:44:08.739963 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:44:08.739937 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-lbf4d_7af8cd0a-2c59-4ccb-87ce-80ca8c8809a6/graceful-termination/0.log" Jul 08 23:44:09.095022 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:44:09.094995 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-7nc87_0763848e-1c09-4df3-a4b8-37e8a00c3ba2/kube-storage-version-migrator-operator/1.log" Jul 08 23:44:09.096040 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:44:09.096021 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-7nc87_0763848e-1c09-4df3-a4b8-37e8a00c3ba2/kube-storage-version-migrator-operator/0.log" Jul 08 23:44:10.502167 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:44:10.502141 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wwbc6_7d4ee776-7adc-4068-917b-e4c017076d4d/kube-multus-additional-cni-plugins/0.log" Jul 08 23:44:10.527310 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:44:10.527286 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wwbc6_7d4ee776-7adc-4068-917b-e4c017076d4d/egress-router-binary-copy/0.log" Jul 08 23:44:10.550930 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:44:10.550906 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wwbc6_7d4ee776-7adc-4068-917b-e4c017076d4d/cni-plugins/0.log" Jul 08 23:44:10.575098 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:44:10.575081 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wwbc6_7d4ee776-7adc-4068-917b-e4c017076d4d/bond-cni-plugin/0.log" Jul 08 23:44:10.595836 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:44:10.595818 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wwbc6_7d4ee776-7adc-4068-917b-e4c017076d4d/routeoverride-cni/0.log" Jul 08 23:44:10.619656 ip-10-0-140-79 kubenswrapper[2574]: I0708 23:44:10.619635 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wwbc6_7d4ee776-7adc-4068-917b-e4c017076d4d/whereabouts-cni-bincopy/0.log"